Received-SPF: pass (google.com: domain of linux-kernel+bounces-195385-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) client-ip=147.75.80.249;
Content-Type: multipart/signed;
 boundary=ac5239eee89eef8167849c5ee3fad8881c9fbf6bf4cf350a574975beacc1;
 micalg=pgp-sha256; protocol="application/pgp-signature"
Precedence: bulk
Mime-Version: 1.0
Date: Thu, 30 May 2024 14:48:07 +0200
Message-Id: <D1MZOIQR9R4G.16O4LIDN6AN5Q@gmail.com>
Cc: <linux-tegra@vger.kernel.org>, <linux-kernel@vger.kernel.org>,
 <ldewangan@nvidia.com>, <mkumard@nvidia.com>
Subject: Re: [RESEND PATCH 1/2] dt-bindings: dma: Add reg-names to
 nvidia,tegra210-adma
From: "Thierry Reding" <thierry.reding@gmail.com>
To: "Krzysztof Kozlowski" <krzk@kernel.org>, "Sameer Pujar"
 <spujar@nvidia.com>, <vkoul@kernel.org>, <robh@kernel.org>,
 <krzk+dt@kernel.org>, <conor+dt@kernel.org>, <jonathanh@nvidia.com>,
 <dmaengine@vger.kernel.org>, <devicetree@vger.kernel.org>
References: <20240521110801.1692582-1-spujar@nvidia.com>
 <20240521110801.1692582-2-spujar@nvidia.com>
 <80b6e6e6-9805-4a85-97d5-38e1b2bf2dd0@kernel.org>
 <e6fab314-8d1e-4ed7-bb5a-025fd65e1494@nvidia.com>
 <56bf93ac-6c1e-48aa-89d0-7542ea707848@kernel.org>
 <f785f699-be50-4547-9411-d41a4e66a225@nvidia.com>
 <774df64c-56a1-461a-82fa-a0340732b779@kernel.org>
 <D1HPADDIQNIK.2F4AL70NLHQCY@gmail.com>
 <819d7180-db8c-438c-afed-463fe495bfc5@kernel.org>
In-Reply-To: <819d7180-db8c-438c-afed-463fe495bfc5@kernel.org>

--ac5239eee89eef8167849c5ee3fad8881c9fbf6bf4cf350a574975beacc1
Mime-Version: 1.0
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain; charset=UTF-8

On Tue May 28, 2024 at 8:48 AM CEST, Krzysztof Kozlowski wrote:
> On 24/05/2024 09:36, Thierry Reding wrote:
> > On Wed May 22, 2024 at 1:29 PM CEST, Krzysztof Kozlowski wrote:
> >> On 22/05/2024 09:43, Sameer Pujar wrote:
> >>>
> >>>
> >>> On 22-05-2024 12:17, Krzysztof Kozlowski wrote:
> >>>> On 22/05/2024 07:35, Sameer Pujar wrote:
> >>>>> On 21-05-2024 17:23, Krzysztof Kozlowski wrote:
> >>>>>> On 21/05/2024 13:08, Sameer Pujar wrote:
> >>>>>>> From: Mohan Kumar <mkumard@nvidia.com>
> >>>>>>>
> >>>>>>> For Non-Hypervisor mode, Tegra ADMA driver requires the register
> >>>>>>> resource range to include both global and channel page in the reg
> >>>>>>> entry. For Hypervisor more, Tegra ADMA driver requires only the
> >>>>>>> channel page and global page range is not allowed for access.
> >>>>>>>
> >>>>>>> Add reg-names DT binding for Hypervisor mode to help driver to
> >>>>>>> differentiate the config between Hypervisor and Non-Hypervisor
> >>>>>>> mode of execution.
> >>>>>>>
> >>>>>>> Signed-off-by: Mohan Kumar <mkumard@nvidia.com>
> >>>>>>> Signed-off-by: Sameer Pujar <spujar@nvidia.com>
> >>>>>>> ---
> >>>>>>>    .../devicetree/bindings/dma/nvidia,tegra210-adma.yaml  | 10 ++=
++++++++
> >>>>>>>    1 file changed, 10 insertions(+)
> >>>>>>>
> >>>>>>> diff --git a/Documentation/devicetree/bindings/dma/nvidia,tegra21=
0-adma.yaml b/Documentation/devicetree/bindings/dma/nvidia,tegra210-adma.ya=
ml
> >>>>>>> index 877147e95ecc..ede47f4a3eec 100644
> >>>>>>> --- a/Documentation/devicetree/bindings/dma/nvidia,tegra210-adma.=
yaml
> >>>>>>> +++ b/Documentation/devicetree/bindings/dma/nvidia,tegra210-adma.=
yaml
> >>>>>>> @@ -29,8 +29,18 @@ properties:
> >>>>>>>              - const: nvidia,tegra186-adma
> >>>>>>>
> >>>>>>>      reg:
> >>>>>>> +    description: |
> >>>>>>> +      For hypervisor mode, the address range should include a
> >>>>>>> +      ADMA channel page address range, for non-hypervisor mode
> >>>>>>> +      it starts with ADMA base address covering Global and Chann=
el
> >>>>>>> +      page address range.
> >>>>>>>        maxItems: 1
> >>>>>>>
> >>>>>>> +  reg-names:
> >>>>>>> +    description: only required for Hypervisor mode.
> >>>>>> This does not work like that. I provide vm entry for non-hyperviso=
r mode
> >>>>>> and what? You claim it is virtualized?
> >>>>>>
> >>>>>> Drop property.
> >>>>> With 'vm' entry added for hypervisor mode, the 'reg' address range =
needs
> >>>>> to be updated to use channel specific region only. This is used to
> >>>>> inform driver to skip global regions which is taken care by hypervi=
sor.
> >>>>> This is expected to be used in the scenario where Linux acts as a
> >>>>> virtual machine (VM). May be the hypervisor mode gives a different
> >>>>> impression here? Sorry, I did not understand what dropping the prop=
erty
> >>>>> exactly means here.
> >>>> It was imperative. Drop it. Remove it. I provided explanation why.
> >>>
> >>> The driver doesn't know if it is operated in a native config or in th=
e=20
> >>> hypervisor config based on the 'reg' address range alone. So 'vm' ent=
ry=20
> >>> with restricted 'reg' range is used to differentiate here for the=20
> >>> hypervisor config. Just adding 'vm' entry won't be enough, the 'reg'=
=20
> >>> region must be updated as well to have expected behavior. Not sure ho=
w=20
> >>> this dependency can be enforced in the schema.
> >>
> >> That's not a unusual problem, so please come with a solution for your
> >> entire subarch. We've been discussing similar topic in terms of SCMI
> >> controlled resources (see talk on Linaro Connect a week ago:
> >> https://www.kitefor.events/events/linaro-connect-24/submissions/161 I
> >> don't know where is recording or slides, see also discussions on maili=
ng
> >> lists about it), which is not that far away from the problem here. Oth=
er
> >> platforms and maybe nvidia had as well changes in IO space for
> >> virtualized configuration.
> >>
> >> Come with unified approach FOR ALL your devices, not only this one
> >> (that's kind of basic thing we keep repeating... don't solve only one
> >> your problem), do not abuse the regular property, because as I said:
> >> reg-names will be provided as well in non-vm case and then your entire
> >> logic is wrong. The purpose of reg-names is not to tell whether you ha=
ve
> >> or have not virtualized environment.
> >=20
> > This isn't strictly about telling whether this is a virtualized
> > environment or not. Unfortunately the bindings don't make that very
> > clear, so let me try to give a bit more background.
> >=20
> > On Tegra devices the register regions associated with a device are
> > usually split up into 64 KiB chunks.
>
> So describing it as one IO region was incorrect from the start and you
> want to fix it by adding one more incorrect description: making first
> item meaning two different things. Sorry, that's not a correct way to
> fix things.

Yes, describing this as one I/O region was incorrect, and in hindsight
it should have been done differently.

However, I don't think it's correct to describe this as adding one more
incorrect description. Instead, what this does is add reg-names to
provide additional context so that the operating system can make the
necessary decisions as to what is allowed and what isn't.

In the absence of a reg-names property the current definition of the DT
bindings applies, so it means the region represents the entirety of the
device's I/O register space. That's one particular use-case for this
device.

For additional use-cases we can then use reg-names to differentiate
between what separate regions are and use them accordingly.

> Items are defined, thus first item is always expected to be what the
> binding already said. Adding reg-names changes nothing, because (as
> repeated many times) xxx-names is just a helper. Items are already define=
d.

I don't understand what you're trying to say here. I suppose adding
reg-names alone indeed doesn't change anything. But the point is that
once added we can now use these properties, at which point of course
things change.

> > One of these chunks, usually the first one, is a global region that
> > contains registers that configure the device as a whole. This is usuall=
y
> > privileged and accessible only to the hypervisor.
> >=20
> > Subsequent regions are meant to be assigned to individual VMs. Often th=
e
> > regions take the form of "channels", so they are instances of the same
> > register block and control that separate slice of the hardware.
> >=20
> > What makes this a bit confusing is that for the sake of simplicity (and=
,
> > I guess, lack of foresight) the original bindings were written in a way
> > to encompass all registers without making that distinction. This worked
> > fine because we've only ever run Linux as host OS where it has access t=
o
> > all those registers.
> >=20
> > However, when we move to virtualized environments that no longer works.
> >=20
> > Given the above, we can't read any registers in order to probe whether
> > we run as a guest or not. Trying to access any of the global registers
> > from a VM simply won't work and may crash the system. None of the
> > "channel" registers contain information indicating host vs. guest
> > either.
>
> I don't understand how it differs from what I said - you want to
> indicate that you run in virtualized environment and not all resources
> are accessible.
>
> The device still has the first (global) address, just it is not
> available due to hypervisor.

Yes, and that's a bad thing because there's no way for the device to
know that it can't access the registers. So it will just assume that it
can and try to access them, which would then result in a crash/error.

Thierry

--ac5239eee89eef8167849c5ee3fad8881c9fbf6bf4cf350a574975beacc1
Content-Type: application/pgp-signature; name="signature.asc"

-----BEGIN PGP SIGNATURE-----

iQIzBAABCAAdFiEEiOrDCAFJzPfAjcif3SOs138+s6EFAmZYdYgACgkQ3SOs138+
s6FIBA//afkWB6Vob9QbMRD7saZNewxk8vuBbdTpJmw/gbg52qbrpN0dtzUXD583
yfNYtqNdjwgdJYbSqHCs+arzpB6Lbf7A8S4aOTrovjUpnfV4nTjHYSkB4u2wjEZK
Q3ML4SlVtRN/Kddv7L4YXyGdPOB7QgXebsLNLy4z6E8IN8YARlR6m60YIuCOvtHx
YR+bTb3D3D2egFP2PTubdmtzMWL6NBxfgZhjIye1pgxR4znrXxB3Tgg4ZSUnNGVn
IRNvQO27WAcaNBkmu/wiLxZbsgpWGcuxt5Fmxm60PyJGFoJui01l9Kr3isSrOnRE
e+X8F5Xo0dixgdnPdEcub/O5UW1GCMZ64t1Gka0X/xh0TISPItG9TEH/P8JjvYxx
R99Uil42n7cMHzLpfysOylPlsHv/zwGy/fIMQda18cyJB1kWoTSKS1WXlyCwFfD6
BUlBomgPqXSmGpVACdOVAwuXxL1T+ItWBbTpgslZVq2h/vZH7cC0A4OE5siUbH0r
PHfuwU/TPSxWIwWcCWD24brHYSWL2eR297PPG1ZWIC4L0gd3bZTuVmx13CAkzhQM
1fIvAmzWFWoMTz9c6W5RPx0Wi9f3AwnZeCpjmww01YUL6HwTLlvma4nnmpaPC7wT
UstnOjsN1lJCHSzPnS3GXDPskTPSCzXKjig43Zb9zsN5/PhYqBg=
=Vn5+
-----END PGP SIGNATURE-----

--ac5239eee89eef8167849c5ee3fad8881c9fbf6bf4cf350a574975beacc1--