Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
From:   "Tian, Kevin" <kevin.tian@intel.com>
To:     Jason Gunthorpe <jgg@nvidia.com>,
        Robin Murphy <robin.murphy@arm.com>
CC:     Lu Baolu <baolu.lu@linux.intel.com>,
        Joerg Roedel <joro@8bytes.org>,
        "Will Deacon" <will@kernel.org>,
        Alex Williamson <alex.williamson@redhat.com>,
        Nicolin Chen <nicolinc@nvidia.com>,
        "iommu@lists.linux.dev" <iommu@lists.linux.dev>,
        "kvm@vger.kernel.org" <kvm@vger.kernel.org>,
        "linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>
Subject: RE: [PATCH 1/2] iommu: Prevent RESV_DIRECT devices from blocking
 domains
Thread-Topic: [PATCH 1/2] iommu: Prevent RESV_DIRECT devices from blocking
 domains
Thread-Index: AQHZmPOfW21nPHSVEEOmSVh5Edp4ra+SM08AgAACagCAAArGAIAAE4eAgAwTMHA=
Date:   Tue, 27 Jun 2023 08:10:48 +0000
Message-ID: <BN9PR11MB5276478406FDC2119A8EBD568C27A@BN9PR11MB5276.namprd11.prod.outlook.com>
References: <20230607035145.343698-1-baolu.lu@linux.intel.com>
 <20230607035145.343698-2-baolu.lu@linux.intel.com>
 <5d0d6665-93e4-f61f-d700-008c0fcb4a2f@arm.com> <ZJBbJHevOa8mAdll@nvidia.com>
 <0c1aec7a-8724-0f49-bccb-6025f5863bb7@arm.com> <ZJB0jyMQpZXWVANP@nvidia.com>
In-Reply-To: <ZJB0jyMQpZXWVANP@nvidia.com>
Accept-Language: en-US
Content-Language: en-US
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?m5r0dsqwGRoavbTjswRSGHVVFprqVIQ00kpHfx2MQMnV6DGgln6KaQNqYw2a?=
 =?us-ascii?Q?14wWeG7DZhC1Ep2kysVacCXnJ0qwRS086C+SEj+ogbPXYGgCaqddSfGojLjF?=
 =?us-ascii?Q?0y3Fifip2g83pY3KX8xnhf176uWXnQ0E5U0/erhd0tVpwNUfeSiIC10mJvbn?=
 =?us-ascii?Q?O7xV8v6ejgK13OcKNPxijVQD3eZFLtWuHC3pDUI84ztdIralfkqycU9x2GDd?=
 =?us-ascii?Q?7MUuwNdVIA9i0Yd8uyAgzF5SZxs8WPCppf5bfjbsaSMdLdxUkewDjQzIeagE?=
 =?us-ascii?Q?9JGjqnoBYh7WDRM7NXvAn4CJWGxkyj604UBabKRy3WTksv18oxCmFJBDZNIQ?=
 =?us-ascii?Q?UvGtVytRkS2VIrVFknbQCwkt38wqYClkuQQM8GPg9QD25oY5Z+DlU597UJiE?=
 =?us-ascii?Q?JF4NyvmmsTuQi21myhSYAOpiNw2TK2nbY+KyTngGUCxdwkxh1iRZS92dHKVv?=
 =?us-ascii?Q?SF3LlzRAlnwbwqw/xTplh6TN6mK6B0LHvX6lJ33vkK65JuYnBfa90YPsy/pE?=
 =?us-ascii?Q?nJoDhet4YYZQAMCeQ8NYbZO15ZCXJpRnCWcckIzv9/aep3Blk2XdfU70vaHF?=
 =?us-ascii?Q?kC1t6NH3pSVncq60eDmPa05NMgp1fj1aldGwTzxeqzBLeZMlhJmixP7IQkIP?=
 =?us-ascii?Q?IEO1PiB+ehieJw9lHQUh/2gvv1k/1CVcrDVorR2UxxyYnlUx/EwiW6gU8T+k?=
 =?us-ascii?Q?/ck5eGpdqdKechGYb9Ek3YW5vVzwTXh+tx8pqHKamMewsb6p5+8gBQ/wr25f?=
 =?us-ascii?Q?I+hxXAzimtEdat2wOGD+c/SJQR7aUghF24zQ7IqV6Ufq9EZn1hJA9Un+8sHc?=
 =?us-ascii?Q?17caqtGbm3neG96K5xuC6ZJMX+iNU4SPGpPvCJPggVeFGe1VnAcT58SAy97O?=
 =?us-ascii?Q?9Yznva1x5F1Ji7XsTzk1kwEuMh3CFqv+mdWvMRWiv4QoNqoWR98X69WUkTzT?=
 =?us-ascii?Q?MeKLs9Y5lJYiO+NBv1pyurgLAqkSJjk8ePHQ7CaBUCdkXd8hwOeCoN4OibkW?=
 =?us-ascii?Q?BMFGmiG8FOCtWkTeHUwT/ZiIgFFdTSZyygZLzwVXLNfM71JK4iiwEyaBSGad?=
 =?us-ascii?Q?Yvc4ML+UbbZhJdyDwQxED4TnQ1yXcLbKMHrY9yxhrT0xYssygSuYE+Ab6q5M?=
 =?us-ascii?Q?Ppx4QwtCiGaZf5P6pj55lBWgzCgj4bAI0IOSZlVqTGFt/KanudWWtotOKtTD?=
 =?us-ascii?Q?r10tlrBZWONNjY3MO7IO4Wgd82U7ZkjVt2KRtcu1oQK0MwOOr/2H1WMyQTSP?=
 =?us-ascii?Q?2yiLGU9sreIszqjmeulSXKwwIgSWx1SlpBRrNSatkzk14a3Pd2Uv/ot4auM0?=
 =?us-ascii?Q?x5sWWdXvsP9gscNhUZZf4iIZcNxSDQKD/CC2QdcE22KzUwS4KUkT4NqJrCs3?=
 =?us-ascii?Q?zFPsa1CBfjmdvWiSlWgx/tgBKx9eVC9QjMsAItkx6IBKKmpSwPsoJd6rQd1J?=
 =?us-ascii?Q?DBQm9HB4VwxaToCVyK3e+P0X65GR0LVPnUGkvspboOZseDxh6Q2vIKnWMa+e?=
 =?us-ascii?Q?511p6MBKaVXZtsDVIvIIEUf66l9ZCVwb3PNz+tylbk7p95SnzNECq19a2isf?=
 =?us-ascii?Q?GwkUGa/naSvWvdhWQ8N+RX6mCgoT2ZXiehOaMNCs?=
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: BN9PR11MB5276.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 5d221269-ab85-4d53-ced4-08db76e603e5
X-MS-Exchange-CrossTenant-originalarrivaltime: 27 Jun 2023 08:10:48.2989
 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: Vl7zZrc0iF0wKr0ijXok6yW/cF4UyVTEbSOPu01NfwjxUC2CaVLdrH+Zs0UkZPLiwikoOE0H082VTa4Bno7KJg==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH7PR11MB7479
X-OriginatorOrg: intel.com
X-Spam-Status: No, score=-4.4 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH,
        DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_MED,
        SPF_HELO_NONE,SPF_NONE,T_SCC_BODY_TEXT_LINE,URIBL_BLOCKED
        autolearn=ham autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

> From: Jason Gunthorpe <jgg@nvidia.com>
> Sent: Monday, June 19, 2023 11:30 PM
>=20
> On Mon, Jun 19, 2023 at 03:20:30PM +0100, Robin Murphy wrote:
>=20
> > so if the only time they're used is when the IOMMU driver has
> > already had a catastrophic internal failure such that we decide to
> > declare the device toasted and deliberately put it into an unusable
> > state, blocking its reserved regions doesn't seem like a big deal.
>=20
> I think we should discuss then when we get to actually implementing
> the error recovery flow we want. I do like blocking in general for the
> reasons you give, and that was my first plan.. But if the BIOS will
> crash or something if we don't do the reserved region maps that isn't
> so good either. IDK would like to hear from the people using this BIOS
> feature.
>=20

The only devices with RMRR which I'm aware of on Intel platforms are
GPU and USB. However they are all RESV_DIRECT_RELAXABLE type.

Here is one reference from the Xen hypervisor. It has a concept called
quarantine domain (similar to blocking domain) when a device is
de-assigned w/o an owner. The quarantine domain has no mappings
except the ones identity-mapped for RMRR types. I'm not sure whether
they observed real examples of RMRR devices which are not GPU/USB.

I guess the reason of not going fully identity or fully blocked is from
the same worry that the BIOS may go insane while Xen still wants to
quarantine the device as much as possible.