Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18;
Date:   Mon, 11 Oct 2021 14:17:48 -0300
From:   Jason Gunthorpe <jgg@nvidia.com>
To:     "david@gibson.dropbear.id.au" <david@gibson.dropbear.id.au>
Cc:     "Tian, Kevin" <kevin.tian@intel.com>,
        "Liu, Yi L" <yi.l.liu@intel.com>,
        "alex.williamson@redhat.com" <alex.williamson@redhat.com>,
        "hch@lst.de" <hch@lst.de>,
        "jasowang@redhat.com" <jasowang@redhat.com>,
        "joro@8bytes.org" <joro@8bytes.org>,
        "jean-philippe@linaro.org" <jean-philippe@linaro.org>,
        "parav@mellanox.com" <parav@mellanox.com>,
        "lkml@metux.net" <lkml@metux.net>,
        "pbonzini@redhat.com" <pbonzini@redhat.com>,
        "lushenming@huawei.com" <lushenming@huawei.com>,
        "eric.auger@redhat.com" <eric.auger@redhat.com>,
        "corbet@lwn.net" <corbet@lwn.net>,
        "Raj, Ashok" <ashok.raj@intel.com>,
        "yi.l.liu@linux.intel.com" <yi.l.liu@linux.intel.com>,
        "Tian, Jun J" <jun.j.tian@intel.com>, "Wu, Hao" <hao.wu@intel.com>,
        "Jiang, Dave" <dave.jiang@intel.com>,
        "jacob.jun.pan@linux.intel.com" <jacob.jun.pan@linux.intel.com>,
        "kwankhede@nvidia.com" <kwankhede@nvidia.com>,
        "robin.murphy@arm.com" <robin.murphy@arm.com>,
        "kvm@vger.kernel.org" <kvm@vger.kernel.org>,
        "iommu@lists.linux-foundation.org" <iommu@lists.linux-foundation.org>,
        "dwmw2@infradead.org" <dwmw2@infradead.org>,
        "linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
        "baolu.lu@linux.intel.com" <baolu.lu@linux.intel.com>,
        "nicolinc@nvidia.com" <nicolinc@nvidia.com>
Subject: Re: [RFC 11/20] iommu/iommufd: Add IOMMU_IOASID_ALLOC/FREE
Message-ID: <20211011171748.GA92207@nvidia.com>
References: <20210919063848.1476776-1-yi.l.liu@intel.com>
 <20210919063848.1476776-12-yi.l.liu@intel.com>
 <20210921174438.GW327412@nvidia.com>
 <BN9PR11MB543362CEBDAD02DA9F06D8ED8CA29@BN9PR11MB5433.namprd11.prod.outlook.com>
 <20210922140911.GT327412@nvidia.com>
 <YVaoamAaqayk1Hja@yekko>
 <20211001122505.GL964074@nvidia.com>
 <YVfeUkW7PWQeYFJQ@yekko>
 <20211002122542.GW964074@nvidia.com>
 <YWPNoknkNW55KQM4@yekko>
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <YWPNoknkNW55KQM4@yekko>
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?T/JyIakPeyuEDo4BHdRHH5c4/UKCPNpsI2Nx9/DixYG04395+QAmS/4rJdi0?=
 =?us-ascii?Q?oxZrZfWlkqK7ckhJ71fKQbJxO8KVrKrtBWMNTBIdOh5mpmJlQR2Huyh5hqVN?=
 =?us-ascii?Q?dim8cmAgoskPAmBcoxz5JB7frywYOBzh1SgTJQNkp8FaNVi9cYVOBnFG21t4?=
 =?us-ascii?Q?OpsY63OFGWNWplDOQyJcAfuZh4V2bcS/700FmjARJPO4bALunrJHhgrk4e80?=
 =?us-ascii?Q?nG7i0rgHXp/n85hkB/Znhp5k9voas5UBwX47IaklW/VrTujvYGtWQkOqOfLU?=
 =?us-ascii?Q?w4pBm4a/OYVNBK9WhrxTfIBOhOpyKMSzvfMCsQWObIRPGLejkv+CLu9dqI6S?=
 =?us-ascii?Q?/wbJ2v9r3qEiKTOl3FdV+NjDRlZ92fbg9eRciqPe8wcy3BrsdDhyuwhvyA5a?=
 =?us-ascii?Q?LZnONdww9TqxFijzr2EpRUmIVQLwF1rm64bFredB+zsVyklwV11cwGBvoJlc?=
 =?us-ascii?Q?tcO6a381UFy/cCwtEsnmSDZ3BhDG1Yf8bMGC3FPgPYJu1jB1qje2hY6oBIed?=
 =?us-ascii?Q?z5GQL21lOO4gfvbJiwh9FoJ3SiNKCCJS5wQfIU1IVRvALoMtSnMxtlNYGZkU?=
 =?us-ascii?Q?3ZR5a4U9ThEQPH/S+LA4JsVn1LrhwBpuD4mFH18kph8NL9fhfVmJ4Dn+7q42?=
 =?us-ascii?Q?HN5rkjlbHUuajZj/txuWgvcD5TiXxDJBx/ki/HIc8tguQ3/fMvwCd1l4girT?=
 =?us-ascii?Q?73NpQbVr+HannE841KmQJ0dcx/+2bPEbW0izo4wKTL9bU/Iy6ljpgjAQhdwB?=
 =?us-ascii?Q?TXv4S73Sat1dZ9dE9vLpMesxOfdbTM0/UKj4Wd3sGw8mlX6ZkKoSwSPQapAg?=
 =?us-ascii?Q?ISjZETSYepfk62SJvb/YVTnKOQyWdas/shWJc/s2rnJtkGSP0E276DeYsshc?=
 =?us-ascii?Q?m24RrMdeK7pN3fowWmcsOhlZyFCy+bKEE2vmXpY9Ab+j1g978t+GPe7j/aaV?=
 =?us-ascii?Q?pPdMqDmQ4cYGVmzCTSMckdbawvCE8e46x7Dry8MJqk9Qw6P0ij+99YW2d4fq?=
 =?us-ascii?Q?0u0mHHnecFeMuwHs5eY+Xfp1qartgdj+CWt6VaK6ndA5I3r5UPZnKEJ5A/Zv?=
 =?us-ascii?Q?FkggVOS9S2c2TdvjzRTvh1qRu+lJW7U6e5vNsYJ2pfZym2XEKjEGQ2dPMkd1?=
 =?us-ascii?Q?KkspWhZdKMQ/sAegmaG8rRZD/e8YOJJwYAU8Gzo5ogkUEPnsuOwFVPRPui56?=
 =?us-ascii?Q?zOtagzCkymvTxs1zQtE4YzsA0LmdL4bxxZ6HuFqqN/alE992GKNzSv94Bjr1?=
 =?us-ascii?Q?mBsLC5V5gUx/GMODUcZQY5rdS2r3Ej/DB9SeKkE1cU2bepSptI3uP3VM3cPU?=
 =?us-ascii?Q?Sxd2ZFiOjsMgLKQrAmrM8X+L?=
X-OriginatorOrg: Nvidia.com
X-MS-Exchange-CrossTenant-Network-Message-Id: f7deb26a-6f52-49f5-2ae2-08d98cdb0c8c
X-MS-Exchange-CrossTenant-AuthSource: BL0PR12MB5506.namprd12.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 11 Oct 2021 17:17:48.7647
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: i8w/fM/NVn7+0mb82RdQ1gMDYIsb9h1no7I9Hz2iZSQWcMBPgloCclrxqjdpky5B
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL1PR12MB5362
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

On Mon, Oct 11, 2021 at 04:37:38PM +1100, david@gibson.dropbear.id.au wrote:
> > PASID support will already require that a device can be multi-bound to
> > many IOAS's, couldn't PPC do the same with the windows?
> 
> I don't see how that would make sense.  The device has no awareness of
> multiple windows the way it does of PASIDs.  It just sends
> transactions over the bus with the IOVAs it's told.  If those IOVAs
> lie within one of the windows, the IOMMU picks them up and translates
> them.  If they don't, it doesn't.

To my mind that address centric routing is awareness.

If the HW can attach multiple non-overlapping IOAS's to the same
device then the HW is routing to the correct IOAS by using the address
bits. This is not much different from the prior discussion we had
where we were thinking of the PASID as an 80 bit address

The fact the PPC HW actually has multiple page table roots and those
roots even have different page tables layouts while still connected to
the same device suggests this is not even an unnatural modelling
approach...

Jason