Received: by 2002:a05:6a11:4021:0:0:0:0 with SMTP id ky33csp5213671pxb; Tue, 28 Sep 2021 13:07:30 -0700 (PDT) X-Google-Smtp-Source: ABdhPJxr8loFQc0ruXxwqfsz5qGHwacpv2PXiQCrAYNSH4KknZb84+luo5N2VY4RgvKG7sl8CsEA X-Received: by 2002:aa7:d9d7:: with SMTP id v23mr9766876eds.248.1632859650186; Tue, 28 Sep 2021 13:07:30 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1632859650; cv=none; d=google.com; s=arc-20160816; b=WVjry14qOMQdY+ywhAYAAtc7oLnMwqOe7/BVKXkYdZw/kbw5FYZW1VEc6KOYbtdVWc drVUpQ2A/NDX3m9626knFBS/u2iGatkWwKzB/XOdtGvGj3/kgKkzCnNb8hwJpayQEYty rxyH4oc+VhBHsepnW3P84IxRxX3/UI+oYjDWJBbzUEI4ueYeqIFL07Ir+Eg5xtEO9H0Y WJSMoQAkwjDrYZX1+b3nKqyDaLv06wukE76U0UOSjPqUntdbl6NMZwqbF0o/ZCaozzU3 0Cyd1oJ5NP1QUmYhCuFQRKNyFTImg6fjNbjw+Kp/f5iGkosH5Xsa1WzN8hwnUEh6kZfZ kkig== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:in-reply-to:content-disposition:mime-version :references:message-id:subject:cc:to:from:date:dkim-signature; bh=8ofNzGMHz0Qp7Vb1PEGbzr+csLxgvNVMaUgwkeEL8ao=; b=mpkX2+8YjMjbGCwSv75m34V1fH8k17uJJgR3MCkgQXPo2QRJkMmbdeH5nmMe4sRkzT rXbFStHJuqiiAPG0mK7kYiB+1nAzH3tLpm+HcNb8BJAb/IyNDHQWaQ3mTq/pCbB0s98T +l6t6m4VLRStMzgeJUhD6PTmuP/BKfBmbEFU+yA4MicUPQz50nzsFIVD3EZVLjCfi8pm ZmxDXAJpphiwdVU4VYA7TbJlz71NiPDcvYnlg/l3xku5DbM+vMxS7QJEgNxRtxkotP1Q jDtlzadwP/H+TXL4oberKeB4UokqqcA9tr/Jm3d+Jta4yIhaWO28KUFb6zk13n7J8Udg araw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@ziepe.ca header.s=google header.b=BTYTlYEg; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id dk9si20416edb.143.2021.09.28.13.07.06; Tue, 28 Sep 2021 13:07:30 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@ziepe.ca header.s=google header.b=BTYTlYEg; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S242120AbhI1UD7 (ORCPT + 99 others); Tue, 28 Sep 2021 16:03:59 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:45498 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S242547AbhI1UD6 (ORCPT ); Tue, 28 Sep 2021 16:03:58 -0400 Received: from mail-qv1-xf2e.google.com (mail-qv1-xf2e.google.com [IPv6:2607:f8b0:4864:20::f2e]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id B11A5C061746 for ; Tue, 28 Sep 2021 13:02:18 -0700 (PDT) Received: by mail-qv1-xf2e.google.com with SMTP id dk4so90420qvb.2 for ; Tue, 28 Sep 2021 13:02:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ziepe.ca; s=google; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=8ofNzGMHz0Qp7Vb1PEGbzr+csLxgvNVMaUgwkeEL8ao=; b=BTYTlYEgPWO99OPBZyk/cDtFjiKDi6RUgSJ31zCZYRP6tGSCQBiYMS+UXlfSM0VbBD 6Tu9VdA0CwUny5io4aMB9uF5u1nLSiIwBCKDebs10z/0ZskvnJP7PB1zZvCzBpBiEt29 qhHuWeg3mDcttX2rZBXbRiaPEQPfCC27N6qrBwkEJroXzsejH0SCT2whj/UIzgeE8KCq G0HlbMZZCKbHxBZ07c9L+w8YU9ao1gj0SAdqI8eVVGNZyalMrwaQSzOBrWoj283raOhh fjZPTOhOgCStfsb2qPWpV+p11BFXZXufzBmGMyAwN31llm3krg0lMdM93E/edRRHHsRz HR6Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=8ofNzGMHz0Qp7Vb1PEGbzr+csLxgvNVMaUgwkeEL8ao=; b=iz7BcrKyNaohYQPvNcTXflofxZ4psYEVi11CWGIQOPgV9njKx0iWrEk4EA7c3FtQon rzqavtF54j1HTp0tbZ8SvawnXBoPJOMPJZYuzZv1vn8WNTX5DQ2u97H2GrP8GosfjdOJ cIkpr2/NMS5/bEueYTyVRNy54fvPhQz91hEhbFpkiPIxfhwJFjrTELWCKviyBWzYZ3W2 vAH4wl6QLwTMApIt7KA+FZcAR+LiA5eBrzgpfKErIp6OjDklK230eZ1XfsLjSx40OUJV 2lsKX1lVQi6Z7kbPWhEpgP2XFh0uVR5VUZ+nK6esKpDXkfuIAVK0gFXpYgtVg1zcgsrl wAaQ== X-Gm-Message-State: AOAM532eSCPIQIjxmZvOZCp4Kt1ZvxM4364Wg6vOQvYGCmyooK5lHDBS 7st7rdiGZjnyEY+maqT7Fnt+EA== X-Received: by 2002:ad4:54cd:: with SMTP id j13mr7586675qvx.4.1632859337946; Tue, 28 Sep 2021 13:02:17 -0700 (PDT) Received: from ziepe.ca ([206.223.160.26]) by smtp.gmail.com with ESMTPSA id t17sm98562qtq.56.2021.09.28.13.02.17 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 28 Sep 2021 13:02:17 -0700 (PDT) Received: from jgg by mlx with local (Exim 4.94) (envelope-from ) id 1mVJIu-007GrC-E4; Tue, 28 Sep 2021 17:02:16 -0300 Date: Tue, 28 Sep 2021 17:02:16 -0300 From: Jason Gunthorpe To: Logan Gunthorpe Cc: linux-kernel@vger.kernel.org, linux-nvme@lists.infradead.org, linux-block@vger.kernel.org, linux-pci@vger.kernel.org, linux-mm@kvack.org, iommu@lists.linux-foundation.org, Stephen Bates , Christoph Hellwig , Dan Williams , Christian =?utf-8?B?S8O2bmln?= , John Hubbard , Don Dutile , Matthew Wilcox , Daniel Vetter , Jakowski Andrzej , Minturn Dave B , Jason Ekstrand , Dave Hansen , Xiong Jianxin , Bjorn Helgaas , Ira Weiny , Robin Murphy , Martin Oliveira , Chaitanya Kulkarni Subject: Re: [PATCH v3 00/20] Userspace P2PDMA with O_DIRECT NVMe devices Message-ID: <20210928200216.GW3544071@ziepe.ca> References: <20210916234100.122368-1-logang@deltatee.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20210916234100.122368-1-logang@deltatee.com> Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, Sep 16, 2021 at 05:40:40PM -0600, Logan Gunthorpe wrote: > Hi, > > This patchset continues my work to add userspace P2PDMA access using > O_DIRECT NVMe devices. My last posting[1] just included the first 13 > patches in this series, but the early P2PDMA cleanup and map_sg error > changes from that series have been merged into v5.15-rc1. To address > concerns that that series did not add any new functionality, I've added > back the userspcae functionality from the original RFC[2] (but improved > based on the original feedback). I really think this is the best series yet, it really looks nice overall. I know the sg flag was a bit of a debate at the start, but it serves an undeniable purpose and the resulting standard DMA APIs 'just working' is really clean. There is more possible here, we could also pass the new GUP flag in the ib_umem code.. After this gets merged I would make a series to split out the CMD genalloc related stuff and try and probably get something like VFIO to export this kind of memory as well, then it would have pretty nice coverage. Jason