Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
From:   "Tian, Kevin" <kevin.tian@intel.com>
To:     Jason Gunthorpe <jgg@nvidia.com>
CC:     "Liu, Yi L" <yi.l.liu@intel.com>,
        "joro@8bytes.org" <joro@8bytes.org>,
        "alex.williamson@redhat.com" <alex.williamson@redhat.com>,
        "robin.murphy@arm.com" <robin.murphy@arm.com>,
        "baolu.lu@linux.intel.com" <baolu.lu@linux.intel.com>,
        "cohuck@redhat.com" <cohuck@redhat.com>,
        "eric.auger@redhat.com" <eric.auger@redhat.com>,
        "nicolinc@nvidia.com" <nicolinc@nvidia.com>,
        "kvm@vger.kernel.org" <kvm@vger.kernel.org>,
        "mjrosato@linux.ibm.com" <mjrosato@linux.ibm.com>,
        "chao.p.peng@linux.intel.com" <chao.p.peng@linux.intel.com>,
        "yi.y.sun@linux.intel.com" <yi.y.sun@linux.intel.com>,
        "peterx@redhat.com" <peterx@redhat.com>,
        "jasowang@redhat.com" <jasowang@redhat.com>,
        "shameerali.kolothum.thodi@huawei.com" 
        <shameerali.kolothum.thodi@huawei.com>,
        "lulu@redhat.com" <lulu@redhat.com>,
        "suravee.suthikulpanit@amd.com" <suravee.suthikulpanit@amd.com>,
        "iommu@lists.linux.dev" <iommu@lists.linux.dev>,
        "linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
        "linux-kselftest@vger.kernel.org" <linux-kselftest@vger.kernel.org>,
        "Duan, Zhenzhong" <zhenzhong.duan@intel.com>
Subject: RE: [PATCH v2 00/11] iommufd: Add nesting infrastructure
Thread-Topic: [PATCH v2 00/11] iommufd: Add nesting infrastructure
Thread-Index: AQHZhBZTNX7dDuLMFEel2CdlG13MGq9hZYMwgAAiQoCAB0Y6EIAVLTqAgA7xydCABWBTgIAA1LOwgADAhgCAARBZAIAAdf0AgAd8YcA=
Date:   Mon, 26 Jun 2023 06:32:39 +0000
Message-ID: <BN9PR11MB52767763FF245EC5820A6B728C26A@BN9PR11MB5276.namprd11.prod.outlook.com>
References: <20230511143844.22693-1-yi.l.liu@intel.com>
 <BN9PR11MB5276DAF0A11809CF8433EE338C7C9@BN9PR11MB5276.namprd11.prod.outlook.com>
 <ZGdiS2m8jcd5OOt5@nvidia.com>
 <BN9PR11MB5276A74B2DA86C79908A420B8C419@BN9PR11MB5276.namprd11.prod.outlook.com>
 <ZH9AGWf1yRDu/86q@nvidia.com>
 <BN9PR11MB52763C7B838B04D3200322FD8C58A@BN9PR11MB5276.namprd11.prod.outlook.com>
 <ZJBL8QLLBiwRsUSI@nvidia.com>
 <BN9PR11MB527663567ECB8AD52D3170818C5CA@BN9PR11MB5276.namprd11.prod.outlook.com>
 <ZJGf3sgLKr9HLZuE@nvidia.com>
 <BN9PR11MB5276B852A32F53BE8EAA1A7D8C5DA@BN9PR11MB5276.namprd11.prod.outlook.com>
 <ZJLnTt/lCyTYBm7G@nvidia.com>
In-Reply-To: <ZJLnTt/lCyTYBm7G@nvidia.com>
Accept-Language: en-US
Content-Language: en-US
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?rhkqy48euPcFZ69nXjTQ1FTQolRCar9i5Sj/93LkG7M8ZIBJ1hyRffPC95Sc?=
 =?us-ascii?Q?QUQWAtJW+O0+UsJnUfJ258BemH2dGDybVpGO+BMAlf6NoTiZqTts5SRGOKcg?=
 =?us-ascii?Q?eCdOBEzbFv+d9DwfJF6vPGsAF+TrUcQpU0OKaR1N2tfjZOlZmnhIJWxvycgJ?=
 =?us-ascii?Q?Wjzsz2jynPjKEjjgrNvAUBqLSBpJB9Ju1XialGCORdltqEzFL1eawIkPoSxA?=
 =?us-ascii?Q?CKklS7sS7lk3zmISEy181biHOjiuhtUA20mZguXHVbL0SOiCT0/sIgNNpB/K?=
 =?us-ascii?Q?RQu1fdfO3OLGcxf/ToUg7X6Hj8KhTk1eWs/4J29Fx2HA/cGl97xEwIozUfMl?=
 =?us-ascii?Q?1xd2ArkQt3wfXjC2lqdg3xtdZV7RIH7wZ4YOR0zcKcnbBueT/Qy9Zgz9AlIF?=
 =?us-ascii?Q?3Tv4gC+mnts19tVFEmRmgO89NqO4ooDCypggpCJnQ5svCUBdCJKvBY+NS31W?=
 =?us-ascii?Q?KT70P6UYZA2YiaaMe2nO8QhVB783oYgq2Nvr4mDn3onwYIFY1wwzPTpF9K6S?=
 =?us-ascii?Q?GYdE3UPLi1shJf8e9D/9m5JOuCSOfgCbcVJ2K8CHNPMeCdZLXqRjnHMI8+Rl?=
 =?us-ascii?Q?CClhfBJp3STvKYjqxqjGgEu411RYW3rX9QdklSXPz7Qj7X7Q+CNnsQ71U+Nj?=
 =?us-ascii?Q?d0iwnZpgaE35VwRfPxwIkIoXjZYWkNwROX8yn/UeuRP/NxNfwjQDYG8Owv5v?=
 =?us-ascii?Q?ixtsUkZvoEIabN0vD3NJryUB4f6gCK8hYowEBcqpZJDJ8n/Mdouo6QrbQNyM?=
 =?us-ascii?Q?2ktFQdhAvTt6OieswQ6VezJIxh7PsdALjbovrVGZ73ueuJa2t069cNHQqR9c?=
 =?us-ascii?Q?NqZcalxl7EMQl0L/w3n47E5k///Ca+yok/2RrJxX+QSt1KBgPz+83vOVsD4S?=
 =?us-ascii?Q?dPPeRMCTU3WLMJ8h3FaBNOz8Uan2bkYOgxsjJsW+IkbA330DaU3n92IbqmFu?=
 =?us-ascii?Q?H0/QHSl0mM5xZUqgawJvb73duQp67TcWntbn7pG+akKl8DqcXJuOwrtY4Nkk?=
 =?us-ascii?Q?Bop8f9wKLeGQH68hO6UqYP4Ds96Q7eYDloUBX7GNt/kqLffSKefNhIXggaVZ?=
 =?us-ascii?Q?7gLWbst7gAqv3K3hPm9nr1Tep6SB2lW+k4ArcH1OgFsTo8jcsxTd+bMvXRyC?=
 =?us-ascii?Q?rjGtB/tmQhZZAD0mT/QJGdw+vLZeV55oA0WXl7nV88u2gih6OqozqTL+sqCn?=
 =?us-ascii?Q?ayu3IYoWOdKF5AagnmeCbbB9aB+yUbhHtsvJFzBG+at5DeKgEjGF4yrCJfEV?=
 =?us-ascii?Q?xdsuU8V6mp+QTTnz79bx5V1Nsxdyory7P4jUoVTbg3XoDG6gwusG5ljzNGc+?=
 =?us-ascii?Q?gkgnocKwV6D2qObuXgwo3xQXoarzPc9Ld7ifF3OSIU2VCdX+Z7WqIQAaHxUZ?=
 =?us-ascii?Q?S1ESh2yxzL50F8UCKlH98PQ3lOWW3MTNgn5TOJhcGZW0eP6Db1SBYh06B9NS?=
 =?us-ascii?Q?x4qDfFbGvRTrMXTp5F53zvuGYpRbfauONw6z3C3yFjKbOEc4rPTUtRLeqoIc?=
 =?us-ascii?Q?n4Du7ZVqSRu08SYLJnWe+NA25FtJmmLEbLF4RXurBFXcTCj95z6nFJ4L5cpW?=
 =?us-ascii?Q?9+NqUlkT0wIeES4icxpsw/pC5+e/vDj043r9ogQn?=
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: BN9PR11MB5276.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 1d162002-7443-424f-3428-08db760f2397
X-MS-Exchange-CrossTenant-originalarrivaltime: 26 Jun 2023 06:32:39.6528
 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: aUOu7DEFHbkcLbHI76Dth1+gY0Bye+trt5GdqtholDdnrTgZ/AY3qOOqJFddcadLaK7PsoUZx1ZCh2zqUWRsAg==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SA2PR11MB4987
X-OriginatorOrg: intel.com
X-Spam-Status: No, score=-4.4 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH,
        DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_MED,
        SPF_HELO_NONE,SPF_NONE,T_SCC_BODY_TEXT_LINE autolearn=ham
        autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

> From: Jason Gunthorpe <jgg@nvidia.com>
> Sent: Wednesday, June 21, 2023 8:05 PM
>=20
> On Wed, Jun 21, 2023 at 06:02:21AM +0000, Tian, Kevin wrote:
> > > > My understanding of ARM SMMU is that from host p.o.v. the CD is the
> > > > S1 in the nested configuration. 'identity' is one configuration in =
the CD
> > > > then it's in the business of nesting.
> > >
> > > I think it is the same. A CD doesn't come into the picture until the
> > > guest installs a CD pointing STE. Until that time the S2 is being use=
d
> > > as identity.
> > >
> > > It sounds like the same basic flow.
> >
> > After a CD table is installed in a STE I assume the SMMU still allows t=
o
> > configure an individual CD entry as identity? e.g. while vSVA is enable=
d
> > on a device the guest can continue to keep CD#0 as identity when the
> > default domain of the device is set as 'passthrough'. In this case the
> > IOAS still needs to gain reserved regions even though S2 is not directl=
y
> > attached from host p.o.v.
>=20
> In any nesting configuration the hypervisor cannot directly restrict
> what IOVA the guest will use. The VM could make a normal nest and try
> to use unusable IOVA. Identity is not really special.

Sure. What I talked is the end result e.g. after the user explicitly reques=
ts
to load reserved regions into an IOAS.

>=20
> The VMM should construct the guest memory map so that an identity
> iommu_domain can meet the reserved requirements - it needs to do this
> anyhow for the initial boot part. It shouuld try to forward the
> reserved regions to the guest via ACPI/etc.

Yes.

>=20
> Being able to explicitly load reserved regions into an IOAS seems like
> a useful way to help construct this.
>=20

And it's correct in concept because the IOAS is 'implicitly' accessed by
the device when the guest domain is identity in this case.