Received: by 2002:a05:6a10:f347:0:0:0:0 with SMTP id d7csp231302pxu; Fri, 11 Dec 2020 00:31:59 -0800 (PST) X-Google-Smtp-Source: ABdhPJxYjudFh0it+5wiP0wUpYyfDyHtA3dXABeTw4fr3NATpqAno++jcuN3CqfkPjCA/MmfBtUp X-Received: by 2002:a17:906:f05:: with SMTP id z5mr10155997eji.8.1607675519675; Fri, 11 Dec 2020 00:31:59 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1607675519; cv=none; d=google.com; s=arc-20160816; b=gJnUhZr3Km7qu4ownsAH7eB/wyDAs55HtlHG6UTLrWL1HVBTQ4/QHo/uRTj4LGGIyP sajhEfqA4hbu4K4IUdIZ92HdVR0biN0RBghKg2sjOBg030qd1lBkLW3D3X/BOLXLwB0k MgQck2bzZKYxouMGBNJzzY3/dx1IclwqkhRzgwErGisC+8YSNyt90K5WzKxdJnVsgi37 dlXT5GkdhAcdHrVIcE5gVnafYIZkxg0PvSuAAoJAFPKkeUM4CO8MUBsb3DtKBk0o1OwS nYoJ5l4p6wkFAjUr+ORPZxIQi29YZ8L2/WWk+XqUISwmFfAhJ1oHzCknnjCdfI2o00qE hcYg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:content-language :in-reply-to:mime-version:user-agent:date:message-id:from:references :cc:to:subject:dkim-signature; bh=sUTklf9jBEwzs6UhWeShzolt35srKpXJ+Aec/2jQSUU=; b=zYg6T29eI4HxPHc9jp+25tSvN6qZ12JBH6nmBiHHHmgrhkYF282xcnCgz5d1IDtxk3 nzl7VtjiV/UX+m3oAwGM8j/4nPSKtAI7gXpkQf6TxzEZJrvD0DlHE528F7ZAlYVkNflN WDTqc7fNq0GP05OpIuBwe6FrMJeuhp8DSYgNOISq1KEYAjarp+eFtG8s1rilcPlL9Sjd j0XYyGjd3vNixEaFEInWJql7sgxefQg4Uo7Ms6tlU2T/Ed3olfqlfVOuQCUyr0P5SG94 qHs3ByBKTIgDbjNjLQUjdSnP6C4LMPWU20XS2mTg+n+247HIRHJVY7VGg2ancU4X6uA3 wcQQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@toxicpanda-com.20150623.gappssmtp.com header.s=20150623 header.b="h/WaKNT1"; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id i12si4235708edr.321.2020.12.11.00.31.37; Fri, 11 Dec 2020 00:31:59 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@toxicpanda-com.20150623.gappssmtp.com header.s=20150623 header.b="h/WaKNT1"; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S2390922AbgLJRET (ORCPT + 99 others); Thu, 10 Dec 2020 12:04:19 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:56472 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1731566AbgLJREF (ORCPT ); Thu, 10 Dec 2020 12:04:05 -0500 Received: from mail-qk1-x744.google.com (mail-qk1-x744.google.com [IPv6:2607:f8b0:4864:20::744]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 91313C061794 for ; Thu, 10 Dec 2020 09:03:25 -0800 (PST) Received: by mail-qk1-x744.google.com with SMTP id n142so5437382qkn.2 for ; Thu, 10 Dec 2020 09:03:25 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=toxicpanda-com.20150623.gappssmtp.com; s=20150623; h=subject:to:cc:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=sUTklf9jBEwzs6UhWeShzolt35srKpXJ+Aec/2jQSUU=; b=h/WaKNT1y3XBZzgswgsh3Ixjw2N5x/28mj80swAvklzGIkVrj6MJ8wuNisjEyktydT zCseyjCchbMSPmxaGGplDZeJZGmP5oyuuVuXTxCHsGpXk0qls2m66qjTPGaKUsL8ZRao pG1Gub5CnI64JSe7Y7ezFsY7qfQdgeOGSHy9txvrSC33WOO2k81hdMm/P+2raMibY7v9 fJHm6P4C0LRQcU3U5FIZ0KPx7ZPzEHxNce551WR814F2jYgp0wq9R/aJ9NcE8kgU8u2e QyaXhCI11vcVH6ukyAI3qKqvg5kI9bv6rPVXMAlpIk9CUlSY5f7ETZmBRFKsxQ/oRgfO 7ZoA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=sUTklf9jBEwzs6UhWeShzolt35srKpXJ+Aec/2jQSUU=; b=HVIGrNAvp33NXQ00xMCtks2/51p8PkKgHQ09qc3dQNATACQbHmN3TDwffCfBvSu7FR 3ky0r6OmGfWMbQOwBxFTxRBag//bMKdHt5M1i+CRTatG4piLFoWt22U1oumIBEh3vWyt cwVC9vNR86ikIvMECN3GDpIpjqHiWIATe4EMIlCiCJP23vEomUcc9l3bX1yHFvmqeNz1 S2GxnDxPyLgzYzxJr7Ze34sFmkReMOeSDxoTx3TplOa29FLq+U1K/LbS4CQrZft+ogTT qU4JSpU6aInotUIxo0GDPYZ4QQT5P1bDor8zpm5zWLbqituutplwn5UnLy4Hmz8VJVLR d3zA== X-Gm-Message-State: AOAM5328XhiLjhlao81uShBx04o+mC37G0aHAJK+d99teIDOnOSpOWO6 aO6r+USm1VYmqzTBscZZMiuXPQ== X-Received: by 2002:a37:bac7:: with SMTP id k190mr10524292qkf.464.1607619804657; Thu, 10 Dec 2020 09:03:24 -0800 (PST) Received: from [192.168.1.45] (cpe-174-109-172-136.nc.res.rr.com. [174.109.172.136]) by smtp.gmail.com with ESMTPSA id y22sm3789944qkj.129.2020.12.10.09.03.23 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Thu, 10 Dec 2020 09:03:23 -0800 (PST) Subject: Re: [dm-devel] [PATCH v1 0/5] dm: dm-user: New target that proxies BIOs to userspace To: Bart Van Assche , Palmer Dabbelt , Christoph Hellwig Cc: snitzer@redhat.com, corbet@lwn.net, kernel-team@android.com, linux-doc@vger.kernel.org, linux-kernel@vger.kernel.org, linux-raid@vger.kernel.org, song@kernel.org, dm-devel@redhat.com, linux-kselftest@vger.kernel.org, shuah@kernel.org, agk@redhat.com, Mike Christie References: <6fb5be2d-c6ca-c21b-dddf-9b314973dcfe@acm.org> From: Josef Bacik Message-ID: <30d39293-80a4-9ef5-92bb-6b6dec464be3@toxicpanda.com> Date: Thu, 10 Dec 2020 12:03:21 -0500 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:78.0) Gecko/20100101 Thunderbird/78.5.1 MIME-Version: 1.0 In-Reply-To: <6fb5be2d-c6ca-c21b-dddf-9b314973dcfe@acm.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 12/9/20 10:38 PM, Bart Van Assche wrote: > On 12/7/20 10:55 AM, Palmer Dabbelt wrote: >> All in all, I've found it a bit hard to figure out what sort of interest >> people >> have in dm-user: when I bring this up I seem to run into people who've done >> similar things before and are vaguely interested, but certainly nobody is >> chomping at the bit.  I'm sending it out in this early state to try and >> figure >> out if it's interesting enough to keep going. > > Cc-ing Josef and Mike since their nbd contributions make me wonder > whether this new driver could be useful to their use cases? > Sorry gmail+imap sucks and I can't get my email client to get at the original thread. However here is my take. 1) The advantages of using dm-user of NBD that you listed aren't actually problems for NBD. We have NBD working in production where you can hand off the sockets for the server without ending in timeouts, it was actually the main reason we wrote our own server so we could use the FD transfer stuff to restart the server without impacting any clients that had the device in use. 2) The extra copy is a big deal, in fact we already have too many copies in our existing NBD setup and are actively looking for ways to avoid those. Don't take this as I don't think dm-user is a good idea, but I think at the very least it should start with the very best we have to offer, starting with as few copies as possible. If you are using it currently in production then cool, there's clearly a usecase for it. Personally as I get older and grouchier I want less things in the kernel, so if this enables us to eventually do everything NBD related in userspace with no performance drop then I'd be down. I don't think you need to make that your primary goal, but at least polishing this up so it could potentially be abused in the future would make it more compelling for merging. Thanks, Josef