Received: by 2002:a05:6a11:4021:0:0:0:0 with SMTP id ky33csp1090579pxb; Wed, 29 Sep 2021 17:02:35 -0700 (PDT) X-Google-Smtp-Source: ABdhPJwc83rAOd0C3Ao2XlTOvS6yvlkGxX+Ift0ceVWor9JVEd3xIrjKCVKeDkx39mciY0QEcz6m X-Received: by 2002:a17:90a:1a11:: with SMTP id 17mr2865503pjk.234.1632960155414; Wed, 29 Sep 2021 17:02:35 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1632960155; cv=none; d=google.com; s=arc-20160816; b=YWO+4yET+9yPlyZZTHXQsBTb/FUWrTxoYekZX/hbF1ES1JVgoyvNZbom/KW4Os7xrS VO86EKyJjMzEQ31uUJmBzdaNRIaxgUUwkKDGNmXHJlJGAod3mUc9ygt5hOONFt7cbs6f VI4Sa133dcUBvKyvC/r54oTqa0oLllxH1LoBFWk6eA+1BDgXmUvFDmtmP8oHSMzUI0BO 887QXgdt7W2YlSeJLwq+uv3BQU5hyrmoLGS4bhhPyHK3J8El0lD40jQdSqEHUc+Dvrzu 5UjXqnA+KIwYQqmCLVzWcSbE6usL/3r+dorsHuQAkeUs6jyfGheStETXP/Ro6od43d0h edVQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:in-reply-to:content-disposition:mime-version :references:message-id:subject:cc:to:from:date:dkim-signature; bh=p44CKw5NqI0dRYxuOA5K9AcDSEZdsWaIBA8jXRcCw5I=; b=Ovm2CSrTzofloCresLU8zOXhQbRLjGU1sBcp9ygrrK6rEaKLID3eyctpo6Bs7ZcWWa SB3ypXylV29hiCtY1s/t6r+fXyGFUiA9ShGJSoAlewgk+IFwgppTv5eojhiaKpMySFwC 60hzvMJTUkt+ijUpwxKmWYWC63Jr0akm5oTkQhJOVTNY84AyHv7LXig0Odokfhz3YXQD hGpU4742UdY9n0qZCgqtY7nX8ii/oHGd4VC26bPrmf/LRh0SuaJY3yaOUWCNXzUj3YTP Eu8pu60R1Cb6IF4jQefsp1hTP7dcjw4H3y6/6bjC+j3Iv0xugmR4KU83ZjxRfpo0ieV0 kIIQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@ziepe.ca header.s=google header.b=BPbV7Ye4; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id s4si1418622pjf.156.2021.09.29.17.02.11; Wed, 29 Sep 2021 17:02:35 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@ziepe.ca header.s=google header.b=BPbV7Ye4; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1347606AbhI2XiR (ORCPT + 99 others); Wed, 29 Sep 2021 19:38:17 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:57180 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1347608AbhI2XiJ (ORCPT ); Wed, 29 Sep 2021 19:38:09 -0400 Received: from mail-qt1-x830.google.com (mail-qt1-x830.google.com [IPv6:2607:f8b0:4864:20::830]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id E48BCC061769 for ; Wed, 29 Sep 2021 16:36:26 -0700 (PDT) Received: by mail-qt1-x830.google.com with SMTP id j13so4021301qtq.6 for ; Wed, 29 Sep 2021 16:36:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ziepe.ca; s=google; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=p44CKw5NqI0dRYxuOA5K9AcDSEZdsWaIBA8jXRcCw5I=; b=BPbV7Ye4Bg5a1ZTPc0nR9KOXAhWl4vBzAsDP0t40qxFSH4OCK6/MQKoFgPTEuzSC9v 9WzoiGlY1hhlhin2gZEWJVK42YbLrmi7f51aphr87IllDIDa/mW2TlwOq98Zvj0JRk6r inxpNiGI/a0tzZNBGtrfuGtkApxUXeOUvY5k07EjRTxe3FM8zYJRfjjEr2wiowyupIsP pguKaqLo4Vxp8H1+LxCZCv8O7UiZItzZkw/1xqVdmL+zc9QUl9vc75MtsgPZmJ4AEECN dBdxRWVA8aWYCV8FKdHpO9CE7a3VgpFt7E/hUggJ2cfyrdgPqy3taLCfKIMAeO9CnW6s e4ng== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=p44CKw5NqI0dRYxuOA5K9AcDSEZdsWaIBA8jXRcCw5I=; b=g3VsVkQgJR0bPTFoo5s7bdNicvLect1UY/XRsRuqfjwMkNvAx8JHzO/cEzpV3+aSkV gAGvfhZleDHTWDvjWN0+iYO4FgvWvDyny5mzlGwVmUNw1BJf1DekaXJARNcGX1cH2+9g uI2rkY7Mlagqdsam4DF73iBMyHmwO2TQ8ezhGv5ADGnQpsZ8Y4xk9SET4dvY5m6MLVaC U4Gcn7OEJsQv5tyOe4gHTiqeUIpiZ5MGolbksxR60BtYFa5xd2fUpfybwEthDRMvA++n NROrY2XqOLxZR+cn4gW7scCqV6vmaSTZAdsjwhzPmN8ZSpOtlmFLw5aMk6fw64mWnjGq hLfA== X-Gm-Message-State: AOAM5333u2LfmVHT39PA+d/EMdpgsGRSRzLpx2PYMtcqx3a/zH3NDVsp MSWu4ryPgSLbTAY32ntFbujHmg== X-Received: by 2002:a05:622a:492:: with SMTP id p18mr3159519qtx.282.1632958586146; Wed, 29 Sep 2021 16:36:26 -0700 (PDT) Received: from ziepe.ca (hlfxns017vw-142-162-113-129.dhcp-dynamic.fibreop.ns.bellaliant.net. [142.162.113.129]) by smtp.gmail.com with ESMTPSA id f5sm706662qtp.44.2021.09.29.16.36.25 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 29 Sep 2021 16:36:25 -0700 (PDT) Received: from jgg by mlx with local (Exim 4.94) (envelope-from ) id 1mVj7g-007iwP-Pe; Wed, 29 Sep 2021 20:36:24 -0300 Date: Wed, 29 Sep 2021 20:36:24 -0300 From: Jason Gunthorpe To: Logan Gunthorpe Cc: linux-kernel@vger.kernel.org, linux-nvme@lists.infradead.org, linux-block@vger.kernel.org, linux-pci@vger.kernel.org, linux-mm@kvack.org, iommu@lists.linux-foundation.org, Stephen Bates , Christoph Hellwig , Dan Williams , Christian =?utf-8?B?S8O2bmln?= , John Hubbard , Don Dutile , Matthew Wilcox , Daniel Vetter , Jakowski Andrzej , Minturn Dave B , Jason Ekstrand , Dave Hansen , Xiong Jianxin , Bjorn Helgaas , Ira Weiny , Robin Murphy , Martin Oliveira , Chaitanya Kulkarni Subject: Re: [PATCH v3 00/20] Userspace P2PDMA with O_DIRECT NVMe devices Message-ID: <20210929233624.GG3544071@ziepe.ca> References: <20210916234100.122368-1-logang@deltatee.com> <20210928200216.GW3544071@ziepe.ca> <06d75fcb-ce8b-30a5-db36-b6c108460d3d@deltatee.com> <20210929232147.GD3544071@ziepe.ca> <93f56919-03ee-8326-10ee-8fbd9078b8e0@deltatee.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <93f56919-03ee-8326-10ee-8fbd9078b8e0@deltatee.com> Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Wed, Sep 29, 2021 at 05:28:38PM -0600, Logan Gunthorpe wrote: > > > On 2021-09-29 5:21 p.m., Jason Gunthorpe wrote: > > On Wed, Sep 29, 2021 at 03:50:02PM -0600, Logan Gunthorpe wrote: > >> > >> > >> On 2021-09-28 2:02 p.m., Jason Gunthorpe wrote: > >>> On Thu, Sep 16, 2021 at 05:40:40PM -0600, Logan Gunthorpe wrote: > >>>> Hi, > >>>> > >>>> This patchset continues my work to add userspace P2PDMA access using > >>>> O_DIRECT NVMe devices. My last posting[1] just included the first 13 > >>>> patches in this series, but the early P2PDMA cleanup and map_sg error > >>>> changes from that series have been merged into v5.15-rc1. To address > >>>> concerns that that series did not add any new functionality, I've added > >>>> back the userspcae functionality from the original RFC[2] (but improved > >>>> based on the original feedback). > >>> > >>> I really think this is the best series yet, it really looks nice > >>> overall. I know the sg flag was a bit of a debate at the start, but it > >>> serves an undeniable purpose and the resulting standard DMA APIs 'just > >>> working' is really clean. > >> > >> Actually, so far, nobody has said anything negative about using the SG flag. > >> > >>> There is more possible here, we could also pass the new GUP flag in the > >>> ib_umem code.. > >> > >> Yes, that would be very useful. > > > > You might actually prefer to do that then the bio changes to get the > > infrastructur merged as it seems less "core" > > I'm a little bit more concerned about my patch set growing too large. > It's already at 20 patches and I think I'll need to add a couple more > based on the feedback you've already provided. So I'm leaning toward > pushing more functionality as future work. I mean you could postpone the three block related patches and use a single ib_umem patch instead as the consumer. Jason