Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
From:   "Tian, Kevin" <kevin.tian@intel.com>
To:     Nicolin Chen <nicolinc@nvidia.com>,
        Jason Gunthorpe <jgg@nvidia.com>
CC:     Robin Murphy <robin.murphy@arm.com>,
        "will@kernel.org" <will@kernel.org>,
        "eric.auger@redhat.com" <eric.auger@redhat.com>,
        "baolu.lu@linux.intel.com" <baolu.lu@linux.intel.com>,
        "joro@8bytes.org" <joro@8bytes.org>,
        "shameerali.kolothum.thodi@huawei.com" 
        <shameerali.kolothum.thodi@huawei.com>,
        "jean-philippe@linaro.org" <jean-philippe@linaro.org>,
        "linux-arm-kernel@lists.infradead.org" 
        <linux-arm-kernel@lists.infradead.org>,
        "iommu@lists.linux.dev" <iommu@lists.linux.dev>,
        "linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>
Subject: RE: [PATCH v1 14/14] iommu/arm-smmu-v3: Add
 arm_smmu_cache_invalidate_user
Thread-Topic: [PATCH v1 14/14] iommu/arm-smmu-v3: Add
 arm_smmu_cache_invalidate_user
Thread-Index: AQHZUnWe1bQRwtfhAUSI/T7BqHBa167yh7YAgAALsACAANbagIAAyRsAgAqMnjCABPKxgIAANdgAgAAeawCAAPG3IIAAOI6AgAE8z4CAA0qgoIAAZESAgAAsM4CABVH2EA==
Date:   Tue, 28 Mar 2023 03:03:11 +0000
Message-ID: <BN9PR11MB5276F4741682627DB4EE0A008C889@BN9PR11MB5276.namprd11.prod.outlook.com>
References: <ZAtYphmOuEqQ1BiC@nvidia.com>
 <BN9PR11MB52768F4D3E21C5231C1A04D38CBD9@BN9PR11MB5276.namprd11.prod.outlook.com>
 <ZBhYq8o4gqFZVb6k@nvidia.com> <ZBiF1hZVrp/aJRM6@Asurada-Nvidia>
 <ZBifWkY2Lt/U1Z7R@nvidia.com>
 <BN9PR11MB5276E6E3FCA90582AA61BDDE8C819@BN9PR11MB5276.namprd11.prod.outlook.com>
 <ZBmZj2pscX0hx2kQ@nvidia.com> <ZBqjUeEjjtCclgLN@Asurada-Nvidia>
 <BN9PR11MB527622D86AE048D3394C12A28C849@BN9PR11MB5276.namprd11.prod.outlook.com>
 <ZB26RWV53wYtc2L2@nvidia.com> <ZB3fWVD/Addk70zY@Asurada-Nvidia>
In-Reply-To: <ZB3fWVD/Addk70zY@Asurada-Nvidia>
Accept-Language: en-US
Content-Language: en-US
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?5ZMEy+qJEtB8Ki74khRMwa2UpthINA3a8ZI0AoAZvvBO+a2QOsjH7AGVpqL/?=
 =?us-ascii?Q?YZJsN1cprwgON+BH3/43BEYSGU5KgGUMEbX9l9pxpJUSgt7R5ru2N68fMGg4?=
 =?us-ascii?Q?521A2v22sqNl1nDInekRyFd7xrUD1MSdZValSdQ6tj7vYnInPWcVvXN+IzA1?=
 =?us-ascii?Q?Ms63ZsGSeAT1UV6iVFoGCvxp7X7yWrKSr+YCrY9zT6XhFEBlSIqzmcuxTn+R?=
 =?us-ascii?Q?fq76rhMiNBaZ3QDrl7D2FdeHmvWNWSRxjvVsz+KBlY81r0qQFpNoZPmhE+F2?=
 =?us-ascii?Q?V8g6VFZBCPlT+Ye3+GtD2Z2lWrfvHtNVm1XoNEm+DI9grAf6Ukx9RTASU6VJ?=
 =?us-ascii?Q?OB12sfDREXHJ8g1JI1gP3gijX1FDdxnNPmaoNdXVt5fj/SklUhLNlQoxUaZH?=
 =?us-ascii?Q?Bj3t25z8inS43wOeBHBzjeq4TCxILWm5FJRt+/m92xX3HjknBfi/Io3RE+ei?=
 =?us-ascii?Q?sgLQMCqGmcbyCMAcuL6TmaGjN62FoU438m/xHkTZkVj1mam2yGzpPvh6DYVN?=
 =?us-ascii?Q?Hf/JgY2essz8ZlkYsUxVmcogE27/9WH5OeMxctjlnLYtY25b2+KK2mkA6zTE?=
 =?us-ascii?Q?TFJT9OEfeqwe2CMbWj52D53tUJzEBPqAsVgZUb5fJJWvO/RnDT4arcnq0HVN?=
 =?us-ascii?Q?zP0eA5E+QphoLQrm3NRwhARBw333l3CtyCC4Y2krsRz8NLPX7h0talSCIW16?=
 =?us-ascii?Q?K4Nl1iMp6FnfK2ksJfxSyTTiLoTgABwxzzLEhyF35sU1GPfTlkvKE/21vrco?=
 =?us-ascii?Q?vCpJhB9G7Vken2Zn7+89DfJ0ufJZB9LwEA7cbOCg3f7nmgg8YZgryM78jJZW?=
 =?us-ascii?Q?XmwdBmYTUy9ZEuupCqvngcb28lvwTLePt9Crl7xWRsn6tezh4t3tAlHEOYY9?=
 =?us-ascii?Q?cT7KapTKDqQ/lmhMDl+yMNtibPqk4kWRuu/2doy9b2X+kQ1hHS+7uUpJckqk?=
 =?us-ascii?Q?9oznKwTtWhx688s1CSYeoizS+2241D8x+KEHdQDw3A8vjpIFQo+fdGpCKWty?=
 =?us-ascii?Q?PKYWPDxi2Mya4E+I/ENsaoj+8UngP1q1eWpvScl/N33OcgGuV/yZ0p4clYjs?=
 =?us-ascii?Q?aj4MFBHV9eiQGl561Gt//d7VzXEEokirGFF+LX7LyAkZQ7dVJwtmxzsiHRTt?=
 =?us-ascii?Q?bEGwJ9/DZPbmNN1X+MpC4HomiaJha0VXVS6HCjl/Yqh6DHXhuQTwpCWHjPqK?=
 =?us-ascii?Q?6zCeOvpPMy8XAAA0AGlCbzGqrYzeaCVAj7cb+0MBXfIGGNZ0zVXNWZLrr68y?=
 =?us-ascii?Q?pDovwqDnFq39R1k78tYBH5dynfCYk9sqtTn6pikv6pn8hXCS9TkNMsmBc4jJ?=
 =?us-ascii?Q?5Tc5cBFphQmTA3srOM2330GbXu6KrRJJfBKHFrJJk2zl/eG7naTYNoJ6AdK4?=
 =?us-ascii?Q?aEllV20WsAqY/0c3ejfozKq4YM5nkgkiL1+DUIA9FzzhnjltjT2zlgohmuRX?=
 =?us-ascii?Q?c8CtUBeRyzwlvp4v80ptvGgQpt3Iq1Coj8Fm76kKBhB63ln1PkcTM+JxzgOY?=
 =?us-ascii?Q?kbUKxbCcXOGsXgkJtbtj38GMNq412Bd4J6sfgf4B6nZMEuzaYqAhK6meb9IG?=
 =?us-ascii?Q?r7pHzmsAgDaXcr4SkAuI2rzoo9oWzIhKXH+Q4w7e?=
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: BN9PR11MB5276.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: bcfab895-9721-4f66-0b44-08db2f38f755
X-MS-Exchange-CrossTenant-originalarrivaltime: 28 Mar 2023 03:03:11.6665
 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: rW5RCX3ivGVW6dtjrW+1dzyD4Wq/dbkQehuQNdbwIVYhweADzkj6gu9yXN5+v53FpIYnHNwyMCKG+WE1mXWe7Q==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SA1PR11MB7061
X-OriginatorOrg: intel.com
X-Spam-Status: No, score=-2.5 required=5.0 tests=DKIMWL_WL_HIGH,DKIM_SIGNED,
        DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_MED,SPF_HELO_NONE,
        SPF_NONE autolearn=unavailable autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

> From: Nicolin Chen <nicolinc@nvidia.com>
> Sent: Saturday, March 25, 2023 1:35 AM
>=20
> On Fri, Mar 24, 2023 at 11:57:09AM -0300, Jason Gunthorpe wrote:
> >
> > If you suggest to overlay the main cmdq with the vcmdq and then don't
> > tell the guest about it.. Robin suggested something similar.

yes, that's my point.

>=20
> Yea, I remember that too, from the email that I received from
> Robin on Christmas Eve :)
>=20
> Yet, I haven't got a chance to run some experiment with that.
>=20
> > This idea would be a half and half, the HW would run the queue and the
> > doorbell and generate error interrupts back to the hypervisor and tell
> > it that the queue is paused and ask it to fix the failed entry and
> > restart.
> >
> > I could see this as an interesting solution, but I don't know if this
> > HW can support it..
>=20
> It possibly can, since an unsupported command will trigger an
> Illegal Command interrupt, then the IRQ handler could read it
> out of the CMDQ. Again, I'd need to run some experiment, once
> this SMMU nesting series is settled down to certain level.
>=20

also you want to ensure that error is a recoverable type so
once sw fixes it the hw can continue to behave correctly.