Received: by 2002:a05:6358:3188:b0:123:57c1:9b43 with SMTP id q8csp2216663rwd; Fri, 26 May 2023 03:35:57 -0700 (PDT) X-Google-Smtp-Source: ACHHUZ6zCzHJkpA+QQf3BsQH5EVn9IdRrj07e8vXUTExJtSep/b0zaM8vc9b9nkqakHFRWX1T4xJ X-Received: by 2002:a17:902:ab91:b0:1a6:b971:faf6 with SMTP id f17-20020a170902ab9100b001a6b971faf6mr1858466plr.35.1685097356741; Fri, 26 May 2023 03:35:56 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1685097356; cv=none; d=google.com; s=arc-20160816; b=aO61DFNv8aBBKz1Qi08qqNymdatXE1LsyjesTVGmo5Yx84Ni1uA4Bc9NrjWDcGxFbI bsM89EzKodoYZB8kDzm1cwoXrCF/XbJaPCACE59Dlke+UGeTeWACHbjwZJ47kSztMtKS vefnMdQKzDLiPHLsJMq6+KB+/a6Fu2sZQGveD1sYxUg11lS8AErRCww3aDDogFFdKnKL pkMKfshlk8i4YGVa6XJxXyO/GRE7qV/q6jbWsc5zLbTDY6Y8iwJ+jXgPrYCSu6abWUtt 1WrRl758HBDplO6KJGXabL2Wh/MmCN5UqeEjBXc53SRfq1QZKSIt7d0ooNW9ssdSTCoZ yWHA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from; bh=eEx7H2bIdyK9hPRMRmP/hs9sQ3smyvnwTOb8RnCEy+E=; b=mjzha0kAMz1QF8zLXvGtDE2Uz0p4QdtfU4qoLtTy/jHEDLi/4GPF7eRJCf1ezSdSDs VtjyLGZOKruQCEvyBtC5WuZU9JkunCieOh9ezT0uHHJ1r4IBK5hAm2bk+K3hBYrmQmgL HHpr5ThAR5G/sWH0SmMCfx6yKMk/4+Wq0W8UZu7wzKSVdnZtq9tCEG/Swf5GJAi1XBrf ilPblmvF7hjWPjCQGHDy1Q0bCqk2tgankTT9GQ95SUfEH19vd9FTAn0xscSxhYZ8c0Jx z6MfzazjJIi5uAin7d77M32edtGKMn9z9u8xid6ijrmtv30qkRkhJneUsQtcQ+sLjdYm 1r/g== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=alibaba.com Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id h24-20020a170902ac9800b0019a71e14c19si1513538plr.320.2023.05.26.03.35.42; Fri, 26 May 2023 03:35:56 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=alibaba.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S242800AbjEZK0j (ORCPT + 99 others); Fri, 26 May 2023 06:26:39 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:35920 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S236835AbjEZK0i (ORCPT ); Fri, 26 May 2023 06:26:38 -0400 Received: from out30-99.freemail.mail.aliyun.com (out30-99.freemail.mail.aliyun.com [115.124.30.99]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 38584FB for ; Fri, 26 May 2023 03:26:37 -0700 (PDT) X-Alimail-AntiSpam: AC=PASS;BC=-1|-1;BR=01201311R391e4;CH=green;DM=||false|;DS=||;FP=0|-1|-1|-1|0|-1|-1|-1;HT=ay29a033018046051;MF=durui@linux.alibaba.com;NM=1;PH=DS;RN=7;SR=0;TI=SMTPD_---0VjW4Oiz_1685096793; Received: from localhost(mailfrom:durui@linux.alibaba.com fp:SMTPD_---0VjW4Oiz_1685096793) by smtp.aliyun-inc.com; Fri, 26 May 2023 18:26:34 +0800 From: Du Rui To: alexl@redhat.com Cc: agk@redhat.com, dm-devel@redhat.com, durui@linux.alibaba.com, gscrivan@redhat.com, linux-kernel@vger.kernel.org, snitzer@kernel.org Subject: Re: Re: dm overlaybd: targets mapping OverlayBD image Date: Fri, 26 May 2023 18:26:33 +0800 Message-Id: <20230526102633.31160-1-durui@linux.alibaba.com> X-Mailer: git-send-email 2.19.1.6.gb485710b In-Reply-To: References: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-9.9 required=5.0 tests=BAYES_00, ENV_AND_HDR_SPF_MATCH,SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE, UNPARSEABLE_RELAY,USER_IN_DEF_SPF_WL autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hi Alexander, > all the lvm volume changes and mounts during runtime caused > weird behaviour (especially at scale) that was painful to manage (just > search the docker issue tracker for devmapper backend). In the end > everyone moved to a filesystem based implementation (overlayfs based). Yes, we had exactly the same experience. This is another reason why this proposal is for dm and lvm, not for container. (BTW, we are using TCMU and ublk for overlaybd in production. They are awesome.) > This solution doesn't even allow page cache sharing between shared > layers (like current containers do), much less between independent > layers. Page cache sharing can be realized with DAX support of the dm targets (and the inner file system), together with virtual pmem device backend. > Erofs already has some block-level support for container images It is interesting. Erofs runs insider a block device in the first place, like what many file systems do. But do you konw why it implements another "some block-level support" by itself? > And this new approach doesn't help No. It is intended for dm and lvm.