Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.32 as permitted sender) client-ip=23.128.96.32;
Message-ID: <3e77a4a3-3be8-4e04-9435-1f66df93078d@intel.com>
Date:   Mon, 11 Dec 2023 20:36:46 +0800
User-Agent: Mozilla Thunderbird
Subject: Re: [PATCH v6 0/6] iommufd: Add nesting infrastructure (part 2/2)
Content-Language: en-US
To:     "Tian, Kevin" <kevin.tian@intel.com>,
        Jason Gunthorpe <jgg@nvidia.com>,
        "Giani, Dhaval" <Dhaval.Giani@amd.com>,
        Vasant Hegde <vasant.hegde@amd.com>,
        Suravee Suthikulpanit <suravee.suthikulpanit@amd.com>
CC:     "joro@8bytes.org" <joro@8bytes.org>,
        "alex.williamson@redhat.com" <alex.williamson@redhat.com>,
        "robin.murphy@arm.com" <robin.murphy@arm.com>,
        "baolu.lu@linux.intel.com" <baolu.lu@linux.intel.com>,
        "cohuck@redhat.com" <cohuck@redhat.com>,
        "eric.auger@redhat.com" <eric.auger@redhat.com>,
        "nicolinc@nvidia.com" <nicolinc@nvidia.com>,
        "kvm@vger.kernel.org" <kvm@vger.kernel.org>,
        "mjrosato@linux.ibm.com" <mjrosato@linux.ibm.com>,
        "chao.p.peng@linux.intel.com" <chao.p.peng@linux.intel.com>,
        "yi.y.sun@linux.intel.com" <yi.y.sun@linux.intel.com>,
        "peterx@redhat.com" <peterx@redhat.com>,
        "jasowang@redhat.com" <jasowang@redhat.com>,
        "shameerali.kolothum.thodi@huawei.com" 
        <shameerali.kolothum.thodi@huawei.com>,
        "lulu@redhat.com" <lulu@redhat.com>,
        "iommu@lists.linux.dev" <iommu@lists.linux.dev>,
        "linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
        "linux-kselftest@vger.kernel.org" <linux-kselftest@vger.kernel.org>,
        "Duan, Zhenzhong" <zhenzhong.duan@intel.com>,
        "joao.m.martins@oracle.com" <joao.m.martins@oracle.com>,
        "Zeng, Xin" <xin.zeng@intel.com>,
        "Zhao, Yan Y" <yan.y.zhao@intel.com>
References: <20231117130717.19875-1-yi.l.liu@intel.com>
 <20231209014726.GA2945299@nvidia.com>
 <BN9PR11MB527647A4DA1620DE354983898C8FA@BN9PR11MB5276.namprd11.prod.outlook.com>
From:   Yi Liu <yi.l.liu@intel.com>
In-Reply-To: <BN9PR11MB527647A4DA1620DE354983898C8FA@BN9PR11MB5276.namprd11.prod.outlook.com>
Content-Type: text/plain; charset="UTF-8"; format=flowed
Content-Transfer-Encoding: 7bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?ckJvcUl2YnUzUGRjQ3ZQeGtJRVZpQThBd0tmK1FiaDBTUlJIOGgxdEtjbUdN?=
 =?utf-8?B?YW52SXlZSlJEcDIvS3h6eGtXNlBnNnpyVGEybzdRL3owT1NHcHlFT05kaitD?=
 =?utf-8?B?WmxmNlNKa1Rxc2NxbGNNcE4vT2xYbzN5amFyM3dCRDFSV3JQVkFvOWpUMFhP?=
 =?utf-8?B?cm1CZkQxNlNIaTZtSzFGbldYb29WWWd3bmVUbDhwSkZ1UjNVVlZuSzF2WGww?=
 =?utf-8?B?VytvemMzN2t4RDZ1OTZ3SlJMWEpDN0VRY3B6YjlLbFBZbVBUSzZSR1crMFd1?=
 =?utf-8?B?bE9CNmFXKy9ZWDl5ZnhOS0dWMzlSNHV3QjBBViswOFBtOGhCNjZHR1gzWW1M?=
 =?utf-8?B?RVVaYWtLYjN1TXpSd0dSNnFSRVZ5MGhuSG82UHlzSXBVaFoxWkZYTllwUjZo?=
 =?utf-8?B?Q3lTd1puVXRTZzF1dlhqUm5CVkdsbUVib2VNRGJhQkgxS3ljWG9xNngrODQ0?=
 =?utf-8?B?eE53Q3ZJNkJRUitHWE1nc3VhTTIxbEJoNDVmRW51cUlJZXkxSEZ6b3l4S09l?=
 =?utf-8?B?NFlPN0krTEkrNjhLc01QTzU4TDhYV2NrSFNxcFRQcHNrUU1hVzNJSjhmK2Y3?=
 =?utf-8?B?bmlwUFBJQ1RKTnNWSHVvMW5lU0NWSWlPVEdzbWQrTzZJZzlQNWZybk1YSGVp?=
 =?utf-8?B?T2FsQ2dPb1gzcHlIOHNzWnVreEdya3RZUWNRRk5JdmsreE8reXdKb0lWVGhq?=
 =?utf-8?B?em9pSFRIZTZBbWwzYnd3OFY1TjBobUFKOWJLVy9pd1VwWXB4RGozWDY1Rk9F?=
 =?utf-8?B?Y2t2RDkweUlvVVdRMEMzOWdXY0RjY0xPNTlCRGs0MVg0NGJ5UE0vWVprdEk4?=
 =?utf-8?B?YW96TWdqSGt3N3RWeTF3TzVUNjVGT1BJcGg0QjF5MjZJZ3VwRDh2TGZJdkw1?=
 =?utf-8?B?RGZHY0tLd3FsRStzNWliL01IclhkMDFXZ09DV3dyTStwYnFKRWhNbURqQ3JJ?=
 =?utf-8?B?Z01tK1pnR2VoWGo4Y2ZCZGhWUENUREkwemplb2QzRWdCNCsvM3pLUUM0NnJG?=
 =?utf-8?B?eWo1K0xjd2JmWnBtdU13ZFd3NURmQm41NENLdTVMK3duOUlRRUdlQ0dhZGF1?=
 =?utf-8?B?dGI1K0MyVlBLN3lsWUZDUjhueFVyZGhHOXR0angyVFFoZldVOTB1QXdCSzhH?=
 =?utf-8?B?ZUNQTSt0cHQycytoUnpXUm1DZWthYzl2MGgvZDBNYmpFaGVFS3VEdmpZNUw2?=
 =?utf-8?B?ODdBYWhkZ29aKzZqVUQrTWU2aHF4cjE1VzZad25sT05QSE1yYXFzSzBEMGdT?=
 =?utf-8?B?c0FPVG93QkxxNnFOVGZVY0w0Ni9SN1BWVWhVcEpYODZrZmM2Z1JkbkIyK1ZG?=
 =?utf-8?B?YU12ZEJxeStBMEJTVkhyZHNhZFdZaSt3MGs4Qk5iWDYyeDFuNWJ4L29xVzVL?=
 =?utf-8?B?MlZFUlB4d3ZuNzRzRFlyVjArSDR2eFc2V3JFWjQxbXlINjJEN2k0RmNXSXZm?=
 =?utf-8?B?ZFl2c2JnLzAveUV5bEVxVmJRQWJJQ3REa3ZSSVJxOGxRNXFjbHQ0M3Rtbkhv?=
 =?utf-8?B?M1hXV1k0ZGt3TnhLcWl1QmJWQlRkc2p3TGdibnBqdXZoeDFqWmNNd3U2SnZv?=
 =?utf-8?B?Wk9lc2FhUzIzMFNTZU1nSGhqdHVEYisxcEJxSUNMbnRDdEcwbEY4L3cvSzN3?=
 =?utf-8?B?MmtZd3hnN21OVTRNWEQ2Vi93eFAzYjhPTEQ5QUZjaDlYcklOZjNBM3NRZ0pH?=
 =?utf-8?B?TTduNUZ4UUlKcXJpYmp2eHhWV2hvYVhTcDFVZytIdXZVbmFOYkJoQ21WTFk3?=
 =?utf-8?B?eE1CR1RYVHI3RGEybzJEaGpZaGptUzAxbWZFY05UZmZvc01jVEEvbFFSL2RK?=
 =?utf-8?B?T1lZY3dLWVJ5U0FlSUN2a20xQkNUakRkcDdwZzBMSWI2ZVluRzBFM2JkN1E2?=
 =?utf-8?B?dFAyaTlubDhMS1MrS2IvTU9kUm05amJQanpoZDhKVEJrclROSXZXQjA1T2pl?=
 =?utf-8?B?a1U4UEJHbEdFRFZMTUtXWE13VzUyVkFrcURtcm05djBrdnpqZkVCdGJtU3h0?=
 =?utf-8?B?MDAvRHZjQXluS2xhdVhkKzlxYWpoOWhVc1pqNnlTWlM0THRReTBYdXkvdUoz?=
 =?utf-8?B?cmY0T0Zvbkwydk1jZU5ydkpIaEFzTllYS2VVNVJjb04yM0hWcnYzdC9ycklX?=
 =?utf-8?Q?9YQ+ta167mZ7pbdRvEWe7tHMT?=
X-MS-Exchange-CrossTenant-Network-Message-Id: 00a3316c-2873-4268-8d2e-08dbfa4579cb
X-MS-Exchange-CrossTenant-AuthSource: DS0PR11MB7529.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 11 Dec 2023 12:34:10.9375
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: g0Xddd55G0fpUoQZZQyGDk8cLHssFpXMEYciEolpzgOJER+YWmYKLWhrHmgDVqGLKox2glFj9Of2I9p5Y9S8Qg==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SJ0PR11MB4829
X-OriginatorOrg: intel.com
X-Spam-Status: No, score=-0.9 required=5.0 tests=DKIMWL_WL_HIGH,DKIM_SIGNED,
	DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,
	MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE
	autolearn=unavailable autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on agentk.vger.email
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org
X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (agentk.vger.email [0.0.0.0]); Mon, 11 Dec 2023 04:34:28 -0800 (PST)

On 2023/12/11 10:29, Tian, Kevin wrote:
>> From: Jason Gunthorpe <jgg@nvidia.com>
>> Sent: Saturday, December 9, 2023 9:47 AM
>>
>> What is in a Nested domain:
>>   Intel: A single IO page table refereed to by a PASID entry
>>          Each vDomain-ID,PASID allocates a unique nesting domain
>>   AMD: A GCR3 table pointer
>>        Nesting domains are created for every unique GCR3 pointer.
>>        vDomain-ID can possibly refer to multiple Nesting domains :(
>>   ARM: A CD table pointer
>>        Nesting domains are created for every unique CD table top pointer.
> 
> this AMD/ARM difference is not very clear to me.
> 
> How could a vDomain-ID refer to multiple GCR3 pointers? Wouldn't it
> lead to cache tag conflict when a same PASID entry in multiple GCR3 tables
> points to different I/O page tables?

Perhaps due to only one DomainID in the DTE table indexed by BDF? Actually,
the vDomainID will not be used to tag cache, the host DomainId would be
used instead. @Jason?

-- 
Regards,
Yi Liu