Received: by 10.223.185.116 with SMTP id b49csp8041293wrg; Thu, 1 Mar 2018 16:04:52 -0800 (PST) X-Google-Smtp-Source: AG47ELt3RrYmkeRchEmMskKWh5+7R8fXnOWjMVbTPk7yqSBUD9UOcwjJKCqL7/h5Wha7LvKs8upG X-Received: by 10.99.96.73 with SMTP id u70mr2875379pgb.199.1519949092098; Thu, 01 Mar 2018 16:04:52 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1519949092; cv=none; d=google.com; s=arc-20160816; b=0SbQ/iei8Xc33vvYJOwcUHSecl8ynhLSsfji4CqexdHYt7syTBeVLUSWCshKu5EbMT VT5Es96/27G53iCjKa1yi+s/3cwwc13AIxyINuD4Tk20qHAe17W4eMV1is+Sw+54LAE0 HyLB1NrJp4198cKF+8adCNwrBEuWpOFgs13mOCogn9fAUTk+KVLPS7rMmgaPfFeSSJTE wNSlJDUx/9x6smKBJJSsYxoilYNvYUYaHYFq5Swuf25GHCpbcyxgHv7Zf4LBhGXT2qSk 8NKl4iDBeZsQuVvZkPUOSgQ+Xwrzy1d920wO1fXj+kAIevqgtKlXXyLNS+3N58rtgkmo BSPg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:subject:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:from:references:cc:to:arc-authentication-results; bh=E6FVqfcyxYbvEVKkco6KRsSuhZzlr6EDe6i0T8Wiv2o=; b=sDTvq6vVL38NJOVV+bpOm2DguDBJnTtOwnLK96mtdilkzmG+qwo1bftMXQX1Wi+zyW OAnxR9rjo31ISq3Mcc8eyUvGTpb86tM6fRJrQ6BDmHmxGZbEba9BZiFn+liotcpqfmni HLevAhE7/gBIstcNKEhiGaFBWWKmib13BoEZMorT8N0v+o606Oypr9i4DkAdsj8ywZX7 hmITGwBNuvEIovfiyDUNcIafxY+M2D5paidTv/P5VyuK0wdG5zs8NJk2A2ezMD47B6LQ DHTXGn227X4IS6b/c49uO620UGs9KYtvRUvxWRytVMuHpUIoTjjeTGkE5U8h+EdE3yIh zsCQ== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id c8-v6si1555216pli.418.2018.03.01.16.04.37; Thu, 01 Mar 2018 16:04:52 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1163643AbeCBADW (ORCPT + 99 others); Thu, 1 Mar 2018 19:03:22 -0500 Received: from ale.deltatee.com ([207.54.116.67]:39994 "EHLO ale.deltatee.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1163541AbeCBADT (ORCPT ); Thu, 1 Mar 2018 19:03:19 -0500 Received: from guinness.priv.deltatee.com ([172.16.1.162]) by ale.deltatee.com with esmtp (Exim 4.89) (envelope-from ) id 1erYAH-0003dJ-Su; Thu, 01 Mar 2018 17:03:10 -0700 To: Stephen Bates , Keith Busch Cc: Jason Gunthorpe , Sagi Grimberg , "linux-kernel@vger.kernel.org" , "linux-pci@vger.kernel.org" , "linux-nvme@lists.infradead.org" , "linux-rdma@vger.kernel.org" , "linux-nvdimm@lists.01.org" , "linux-block@vger.kernel.org" , Christoph Hellwig , Jens Axboe , Bjorn Helgaas , Max Gurtovoy , Dan Williams , =?UTF-8?B?SsOpcsO0bWUgR2xpc3Nl?= , Benjamin Herrenschmidt , Alex Williamson , Steve Wise References: <20180228234006.21093-1-logang@deltatee.com> <20180228234006.21093-11-logang@deltatee.com> <749e3752-4349-0bdf-5243-3d510c2b26db@grimberg.me> <40d69074-31a8-d06a-ade9-90de7712c553@deltatee.com> <5649098f-b775-815b-8b9a-f34628873ff4@grimberg.me> <20180301184249.GI19007@ziepe.ca> <20180301224540.GL19007@ziepe.ca> <77591162-4CCD-446E-A27C-1CDB4996ACB7@raithlin.com> <20180301234930.GG14799@localhost.localdomain> From: Logan Gunthorpe Message-ID: <9de7d9d1-3469-c315-ce47-0faa67a4e4c4@deltatee.com> Date: Thu, 1 Mar 2018 17:03:09 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-SA-Exim-Connect-IP: 172.16.1.162 X-SA-Exim-Rcpt-To: swise@opengridcomputing.com, alex.williamson@redhat.com, benh@kernel.crashing.org, jglisse@redhat.com, dan.j.williams@intel.com, maxg@mellanox.com, bhelgaas@google.com, axboe@kernel.dk, hch@lst.de, linux-block@vger.kernel.org, linux-nvdimm@lists.01.org, linux-rdma@vger.kernel.org, linux-nvme@lists.infradead.org, linux-pci@vger.kernel.org, linux-kernel@vger.kernel.org, sagi@grimberg.me, jgg@ziepe.ca, keith.busch@intel.com, sbates@raithlin.com X-SA-Exim-Mail-From: logang@deltatee.com X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on ale.deltatee.com X-Spam-Level: X-Spam-Status: No, score=-8.9 required=5.0 tests=ALL_TRUSTED,BAYES_00, GREYLIST_ISWHITE,T_RP_MATCHES_RCVD autolearn=ham autolearn_force=no version=3.4.1 Subject: Re: [PATCH v2 10/10] nvmet: Optionally use PCI P2P memory X-SA-Exim-Version: 4.2.1 (built Tue, 02 Aug 2016 21:08:31 +0000) X-SA-Exim-Scanned: Yes (on ale.deltatee.com) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 01/03/18 04:57 PM, Stephen Bates wrote: >> We don't want to lump these all together without knowing which region you're allocating from, right? > > In all seriousness I do agree with you on these Keith in the long term. We would consider adding property flags for the memory as it is added to the p2p core and then the allocator could evolve to intelligently dish it out. Attributes like endurance, latency and special write commit requirements could all become attributes in time. Perhaps one more reason for a central entity for p2p memory allocation so this code does not end up having to go into many different drivers? Ugh, I don't know... An allocator for PMR is going to be quite a different animal. It would probably need to look more like a filesystem given you'd need to access the same regions across reboots. I don't think it fits the p2pmem paradigm at all. I think it's something entirely new all together and who knows exactly what it will look like. Logan