Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
Date:   Thu, 6 Oct 2022 09:02:21 -0300
From:   Jason Gunthorpe <jgg@nvidia.com>
To:     Niklas Schnelle <schnelle@linux.ibm.com>
Cc:     Matthew Rosato <mjrosato@linux.ibm.com>,
        Pierre Morel <pmorel@linux.ibm.com>, iommu@lists.linux.dev,
        linux-s390@vger.kernel.org, borntraeger@linux.ibm.com,
        hca@linux.ibm.com, gor@linux.ibm.com,
        gerald.schaefer@linux.ibm.com, agordeev@linux.ibm.com,
        svens@linux.ibm.com, joro@8bytes.org, will@kernel.org,
        robin.murphy@arm.com, linux-kernel@vger.kernel.org
Subject: Re: [PATCH v4 1/5] iommu/s390: Fix duplicate domain attachments
Message-ID: <Yz7Dzayee74Mu4NH@nvidia.com>
References: <20221004120706.2957492-1-schnelle@linux.ibm.com>
 <20221004120706.2957492-2-schnelle@linux.ibm.com>
 <2a56d7bc-3beb-51fe-fc65-f2f3bd192e34@linux.ibm.com>
 <dd92817a13601a4a449096b7ae94caa66a113853.camel@linux.ibm.com>
 <Yz1vF7B0FLvLVvE0@nvidia.com>
 <8c01ad419e91c0ce06bec8700d960c57f1a7c436.camel@linux.ibm.com>
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <8c01ad419e91c0ce06bec8700d960c57f1a7c436.camel@linux.ibm.com>
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?C078+V4PU4DVk/KO5IOI4P1Gqiwt1vBMZw6NW0wV3RpVM5XYM28o5ffrPQBp?=
 =?us-ascii?Q?6QnRTXgD2Kjt78W4Dq4Sh/FEzVWw9hFbBPODLqxszyuBP/AeCHJULH+JBxHx?=
 =?us-ascii?Q?6ZoqufCUDJxFRQCBG4ZCi/lQezGNz/ybUAkeXyIFKvir1rmJsBHolnn++NNq?=
 =?us-ascii?Q?J1G9BuXFlVNvA5jbbmk7m2WubCk5s6RHMmDna6OxJcZzXtG/79h4FdvdWLj7?=
 =?us-ascii?Q?bIeryOEKfaI1RfoN/dQgE+y83T1dK/DnNgP7f0u0y7nM7ADOIP5NOsXRoSVh?=
 =?us-ascii?Q?eccKCmV18PR1Ja2PrjR4crpEjGqy8kRayNYWYviw4EezAQwVUwnYyB9ivPVr?=
 =?us-ascii?Q?2xHMTuL7TogyAmdAwqa/EQcGWVhgplcFjOccJrLmQaBgBT70XXt87D/HYCQT?=
 =?us-ascii?Q?UrbNjHNWGCqv0BcXVzLilbkzU/lUR7WOkN6iojntHX4WNZDzYoso/4MGDmn/?=
 =?us-ascii?Q?Wuo2CDXTvJ0DCTM9qHdrsaYiSq9sdEOdbvkI4EA5HguqFSOFHOG7dMM/+evr?=
 =?us-ascii?Q?SvoR43o3ch5GJN8CLb4Gc/eT/ZDT60D8L7S6P5/AVI4dJjEWLUnkHc5HtKc9?=
 =?us-ascii?Q?t8lm+n+vVJLOo/MuLKbcShE7qBvHyAvLPxp3OBQvVdb4K4uRYWtdo5MmU5kl?=
 =?us-ascii?Q?B2W/qIQUqaDwC9f5oEsb5zsyAKueRWV819WgWwm5o/qojlCz94VMWmXT3KWL?=
 =?us-ascii?Q?86PATsxTRiHNvlLILPZ25XyF2d6RzQ1JH+ILAHZOtIfL7PwxrpsK/cA3Tp4B?=
 =?us-ascii?Q?3kjXiHUjDFQELnewuvmTpKewHBRh7s9jvYVll0rAk5kN/OP2ikXBOKT8A7N6?=
 =?us-ascii?Q?BN8df+kuH/4j7OAgOYISpx+ra9qCgDLTwWt//AuVLh6bOk9s8Tv4b0KrVcHQ?=
 =?us-ascii?Q?pVYxox5kv8MrJhCwZzOEmty1AKkKByoH3BJoRMkUJvlzpNxA7kGuScLyL7uh?=
 =?us-ascii?Q?3UyRMYnqYVZHYN9yfjSpnDGorygn5aJ+KKzZJoDmxKBNf73dPrv+tlzgUR6E?=
 =?us-ascii?Q?0CEnMD72Z232WFJmk+zz0H0wibE+qSFwhT+TzfTgRcQlfIlL4hb7i1G7ZNCd?=
 =?us-ascii?Q?OzY/CsIn3ye7Y8HIvZUiF6e/dXcGP4X5xB92qjMd7euqDOIe1xqWLrwNMb8v?=
 =?us-ascii?Q?FkQBa2BnmS47YFR3fwfamMfxmnhMcZ+aP+CP2KBh/Uocb7qdd644Sjih5QCm?=
 =?us-ascii?Q?EHy3b47s95/HRZfd8IxLKBiNg7tEofeUAQAstA39oHt0vp2V8UFgngSXoJk2?=
 =?us-ascii?Q?xQ3mwBj4iMA+O1fNIBl0qjjwonWdxMTeo5Y9hbA50NguaY1Q0FtfKPYFORia?=
 =?us-ascii?Q?sKlh79uLh+VUP7zbp1OSvzotnF3SpoZsl/z0rF3ZaueCVnaAsiKI7dl9+ffO?=
 =?us-ascii?Q?lZiTcXlRsPn0AZAkn8rYIRoCOCF0BSSm8uevzzMhjSXiYwCPNaL0NYhEVAdC?=
 =?us-ascii?Q?WQ7iMBojjbVKhJvYEOEOKpK8bkcZD82iO4rxan1BvLJ0pioj3ZPuKEZ2VC4A?=
 =?us-ascii?Q?amNrnZf6PkS6X+eMcqVpomvYyThS0xUCBzWVmwsarJr8paloTJ6/lkv5ksgq?=
 =?us-ascii?Q?4tuS76n6h2/gy32IbeY=3D?=
X-OriginatorOrg: Nvidia.com
X-MS-Exchange-CrossTenant-Network-Message-Id: d6756676-5fef-4796-fa62-08daa792a020
X-MS-Exchange-CrossTenant-AuthSource: LV2PR12MB5869.namprd12.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 06 Oct 2022 12:02:22.0863
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: VajNB70VUdmLCwPtBOgnz9Pit6YZ+jX8T8778CbFj0YLmnUHj0yDb58ymCyiXVzF
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SA0PR12MB4575
X-Spam-Status: No, score=-1.1 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH,
        DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FORGED_SPF_HELO,
        RCVD_IN_DNSWL_NONE,RCVD_IN_MSPIKE_H2,SPF_HELO_PASS,SPF_NONE
        autolearn=no autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

On Thu, Oct 06, 2022 at 01:52:44PM +0200, Niklas Schnelle wrote:

> One option I see would be to ignore the error return from
> zpci_register_ioat() if it indicates case 2b. Then we would still add
> the device to the IOMMU's devices list and return success despite
> knowing that the device is inaccessible (DMA and MMIO blocked).
> 
> Then the recovery/reset code will register the new domain once the
> device comes out of the error state. At least from an IOMMU API point
> of view that would make the attachment always succeed for all
> zpci_register_ioat() error cases that aren't programming bugs and can
> conceivably be recovered from.

This is what I was thinking..

> If you agree I would propose adding this as a robustness improvement as
> part of my upcoming series of IOMMU improvements needed for the DMA API
> conversion. As stated above before the DMA API conversion any error
> that would cause zpci_register_ioat() to fail while the IOMMU API is
> being used will need a "power cycle" anyway so postponing this doesn't
> hurt.

Yes, I think this series is fine as is

Patch 4 mostly deletes all these error cases, and the one hunk that is left:

+	if (domain->geometry.aperture_start > zdev->end_dma ||
+	    domain->geometry.aperture_end < zdev->start_dma)
+		return -EINVAL;

Is misplaced. If a device cannot be supported by the IOMMU, which is
what that is really saying since it only s390 creates one aperture
size, then it should fail to probe, not fail at attach.

So I'd change the above to a WARN_ON() for future safety and add a
similar test to probe and then all that is left is the
zpci_register_ioat() which you have a plan for.

Jason