Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18;
IronPort-SDR: /1cSLOadzC74JU2Qw3wC8rVnmPfcuZ67htmTue/UZ+9u0wusL2JEDrM9SDbyO9StiZK8DR+2TQ
 Ej15Fliscoow==
IronPort-SDR: EuqGH+XT8DGedFSVdhlD912IizGA+ugPjuLam46bpXY5ds3FcsADfmCp/CjOCDFTfXdkwRrVUE
 tVMqnsiDRLpg==
From:   "Tian, Kevin" <kevin.tian@intel.com>
To:     Jason Gunthorpe <jgg@nvidia.com>
CC:     Jean-Philippe Brucker <jean-philippe@linaro.org>,
        "Alex Williamson (alex.williamson@redhat.com)" 
        <alex.williamson@redhat.com>, "Raj, Ashok" <ashok.raj@intel.com>,
        "kvm@vger.kernel.org" <kvm@vger.kernel.org>,
        "Jonathan Corbet" <corbet@lwn.net>,
        Robin Murphy <robin.murphy@arm.com>,
        LKML <linux-kernel@vger.kernel.org>,
        Kirti Wankhede <kwankhede@nvidia.com>,
        "iommu@lists.linux-foundation.org" <iommu@lists.linux-foundation.org>,
        "David Gibson" <david@gibson.dropbear.id.au>,
        "Jiang, Dave" <dave.jiang@intel.com>,
        David Woodhouse <dwmw2@infradead.org>,
        Jason Wang <jasowang@redhat.com>
Subject: RE: [RFC] /dev/ioasid uAPI proposal
Thread-Topic: [RFC] /dev/ioasid uAPI proposal
Thread-Index: AddSzQ97BhCb3gd8AUyldaDZ6yOMNABTUTCAAQiuDaAADwOFgAJSmyVgAA0fjwAAEFKEEAAASwWAAAAgcXAAATmRgAAAC9Rg
Date:   Tue, 15 Jun 2021 23:56:28 +0000
Message-ID: <MWHPR11MB1886FD4121F754A6F7C2102A8C309@MWHPR11MB1886.namprd11.prod.outlook.com>
References: <MWHPR11MB1886422D4839B372C6AB245F8C239@MWHPR11MB1886.namprd11.prod.outlook.com>
 <20210528233649.GB3816344@nvidia.com>
 <MWHPR11MB188621A9D1181A414D5491198C3C9@MWHPR11MB1886.namprd11.prod.outlook.com>
 <20210603130519.GY1002214@nvidia.com>
 <MWHPR11MB1886BA2258AFD92D5249AC488C309@MWHPR11MB1886.namprd11.prod.outlook.com>
 <20210615150630.GS1002214@nvidia.com>
 <MWHPR11MB1886E9553A5054DF7D51F27D8C309@MWHPR11MB1886.namprd11.prod.outlook.com>
 <20210615230215.GA1002214@nvidia.com>
 <MWHPR11MB1886A0CAB3AFF424A4A090038C309@MWHPR11MB1886.namprd11.prod.outlook.com>
 <20210615234057.GC1002214@nvidia.com>
In-Reply-To: <20210615234057.GC1002214@nvidia.com>
Accept-Language: en-US
Content-Language: en-US
dlp-version: 11.5.1.3
dlp-product: dlpe-windows
dlp-reaction: no-action
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?jTwFziYnSYs+wIebsoy3h8a1TCQPrNBYS4zsjv6tbLTcv7s6UvKsvE76NrYW?=
 =?us-ascii?Q?J597gfc6K5mmnTY4a9VzwLL0P3gAWOPUKcojDNa7x4I0/KD9A9Dci2v/ReHO?=
 =?us-ascii?Q?TyIXaM66cWKxwsCzFznJNHGOW33BhGfXShwytmIfPaP6N7dlTxKpQKm0nLPt?=
 =?us-ascii?Q?qhMiTuJvk0PAJKqzSooq4T3kp8b+NuvjWGk3T/wHG6+bf9vwGPpn3EixWnLn?=
 =?us-ascii?Q?Ko4dmEZeKTXMSgXMV9dstzYSgvw5cCuhMRPjohHUcQwL2jo6s4Vnc2+lUFI7?=
 =?us-ascii?Q?51viVjx3rKvxm2jfHMy3a6dUnRg8Xlk8ZpNZ5LqcIeNu4nNQ84iqmflVn9Nm?=
 =?us-ascii?Q?n+aCYG4Kq8d8l69wIz6IhcBqrpVJUCN031c99/j2fy+wKPKbva0QA4Ku7eQH?=
 =?us-ascii?Q?xvtLCNbJ5F1D9AEP1JLld1n7+djm6HK6UUgyDiR8GWSZ8xS1s/YIPk9CanMS?=
 =?us-ascii?Q?Y0ftTnM+z0+w+XQUe0ndOA6xFHDS+ZEnkBVpeEIWTXy4iEFG0hRHbiur849E?=
 =?us-ascii?Q?zBoUdQiM0hVSwc9tUmYPBhgOsDi27e/xfYYY5lHU1wUDl7kG0f6OZ7vIjoD6?=
 =?us-ascii?Q?EEepEGR42RqssCotJZaCq+GJnawTu/zWNvMqseiGpZBCLlIi0Nk99ua8RU9c?=
 =?us-ascii?Q?QzZl2T7kNKKsy4bwWAwjysTs3c10JK3mdar2Cv9Pbk3T9OxYBLh9hgllyLs6?=
 =?us-ascii?Q?950FIvnzJwfBEI4MX9P0wyMhsSie8iYTtkBUL0NjZG0NWMSJEBTj2nbZS5oN?=
 =?us-ascii?Q?oDzxxrO8lUFYsFCPzeYnZGmo0EcvujRo9ICPFEBW94HloLPRHqpTvRvPxJCP?=
 =?us-ascii?Q?Njrjps5r76aehrsSI/CYw7xXn/oFZWDpY8Z/aQz9UPRyw3sc53sP9Qn9f9iO?=
 =?us-ascii?Q?6VkEHB7GDL0wy6gj+uPPblUsprlz72aK0gby2pV0uazmhc+0EhHfVbbMMmij?=
 =?us-ascii?Q?nT7yRZj201wGGpBNGh/Z+aleaTVcQsAv2ClRcETJALgrv6IBHy9P0njKvrYe?=
 =?us-ascii?Q?kqbWSaXtNuNG7T5nOnd0heT6mA8KcsdVvwQLkNOTHyf9w5Rze47hlKzhD61A?=
 =?us-ascii?Q?Hl+KHOMV2L1OMVJ2Y+MABsCep60wul2Gd8KXZoX5gu9SrrngF8TQBJqHqOht?=
 =?us-ascii?Q?sNREgYkYpeDYA5oF1uOJEhBDrXz9FAXFDXSoRk3261O/F/Fn1k3kE47kQVS0?=
 =?us-ascii?Q?i50SGOw/t+Rz3D/yWWzv0MRnYjTFip2vtHMZwZdb/px+b+vkUq79cK4T61uQ?=
 =?us-ascii?Q?HIzGqnFEmh2Ev4u/xiymlDDlwBjkQZ1BXhpm9+dbJZrQjccvRtKC2YXO23NM?=
 =?us-ascii?Q?PITWI5o+KA9V4s0pT5MtWBPC?=
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: MWHPR11MB1886.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: f64648c0-1d0d-43df-7ddf-08d930593111
X-MS-Exchange-CrossTenant-originalarrivaltime: 15 Jun 2021 23:56:28.2328
 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: YBbcAGKe1b4pnXMnC1JTtCVVIq6XEYlzPpjhDrY0B6M93oHMtWwC/zkHtKHnsOD9NYKbGhMwoLB/Od8fl2ekVg==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW3PR11MB4521
X-OriginatorOrg: intel.com
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

> From: Jason Gunthorpe <jgg@nvidia.com>
> Sent: Wednesday, June 16, 2021 7:41 AM
>=20
> On Tue, Jun 15, 2021 at 11:09:37PM +0000, Tian, Kevin wrote:
>=20
> > which information can you elaborate? This is the area which I'm not
> > familiar with thus would appreciate if you can help explain how this
> > bus specific information is utilized within the attach function or
> > sometime later.
>=20
> This is the idea that the device driver needs to specify which bus
> specific protocol it uses to issue DMA's when it attaches itself to an
> IOASID. For PCI:

What about defining some general attributes instead of asking iommu
fd to understand those bus specific detail?

>=20
> - Normal RID DMA

this is struct device pointer

> - PASID DMA

this is PASID or SSID which is understood by underlying iommu driver

> - ENQCMD triggered PASID DMA

from iommu p.o.v there is no difference from last one. In v2 the device
driver just needs to communicate the PASID virtualization policy at
device binding time, e.g.  whether vPASID is allowed, if yes whether
vPASID must be registered to the kernel, if via kernel whether per-RID
vs. global, etc. This policy is then conveyed to userspace via device=20
capability query interface via iommu fd.

> - ATS/PRI enabled or not

Just a generic support I/O page fault or not

>=20
> And maybe more. Eg CXL has some other operating modes, I think
>=20
> The device knows what it is going to do, we need to convey that to the
> IOMMU layer so it is prepared properly.
>=20

Yes, but it's not necessarily to have iommu fd understand bus specific
attributes. In the end when /dev/iommu uAPI calls iommu layer interface,
it's all bus agnostic.=20

Thanks
Kevin