Received: by 2002:a25:8b91:0:0:0:0:0 with SMTP id j17csp7033939ybl; Wed, 15 Jan 2020 14:23:38 -0800 (PST) X-Google-Smtp-Source: APXvYqwtzX0uG4a02xT5EqwFiQUiCaFj6Cq7baJ8XhwTqJfwTzsZF6BtPgbIl3k14KBwEmFw3GTT X-Received: by 2002:a9d:5545:: with SMTP id h5mr4449096oti.296.1579127018417; Wed, 15 Jan 2020 14:23:38 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1579127018; cv=none; d=google.com; s=arc-20160816; b=qUd+UA3ompGfP9Z6bkuLxa+JIWRCTsIrrix8L1roLEEG2793oBSumiHbWDFqOckB7Z pS7qkwzdGKI26pCK/J0J2/q6t6o1Op7qr7EDrs+kT2wSp5i3Bk2NJshlCmJFPOkcaYGb Bix2tzIQeCNwbtHNDdmk6/I2QY/iN9NTnzmoln+fk74mheKLCj+CxJuKqu9AzJFOQ/dx 7ZOshaP6cBCw2i8f3e0CyRXDGKSIdIrr3UipUY071Jhq/M3kox4CNJLX/KrgN5nUoEuw bFdPI0JLr0my5iZKcd6QcFkRR4Xx/ebPvhLNr/kElT1fhsNsmca0qVFmPNZjmWNoXfP+ +btw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:references:to:cc:in-reply-to:date:subject :mime-version:message-id:from:dkim-signature; bh=mslewm5+SfbCxNU2yFy5UYCpQMf3EmAJSTZ9e3ERDC4=; b=JVzm3pCyv/7BDpZ9F2N9SZgW+yqjrYNXCB/Lv+Bbhd04BFy+vHrAHqDV4ydCCWCBc9 lScdNG00Hggbz5blPuWiHgLnxcQ20nw0rgqy3oiuaSnOVWG0oXDnKc4XRksSwenbeylA DuggHseSgrGOhrGHdzrPt0kX2nwta6va5OlqMGJT/OMXAhQkHvrmXzMMI6vZqw16CNLD lCXupy+0Y1ALE3uiebwGBg3QheaQZZLjRvt4wFhAo1G15Lf10l57f4dVMw9FWjLy3M7N YshfWar2DCsfz87YiNmTgk4PkvYad7W3JyJ9pS7FMBx/P6mNtb0IcGE27FYuYNjqfSLQ 2xaQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@dilger-ca.20150623.gappssmtp.com header.s=20150623 header.b=zFWJ4tw9; spf=pass (google.com: best guess record for domain of linux-ext4-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-ext4-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id u21si10223603oic.263.2020.01.15.14.23.19; Wed, 15 Jan 2020 14:23:38 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-ext4-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@dilger-ca.20150623.gappssmtp.com header.s=20150623 header.b=zFWJ4tw9; spf=pass (google.com: best guess record for domain of linux-ext4-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-ext4-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1730612AbgAOWL6 (ORCPT + 99 others); Wed, 15 Jan 2020 17:11:58 -0500 Received: from mail-pj1-f42.google.com ([209.85.216.42]:39141 "EHLO mail-pj1-f42.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1730607AbgAOWLz (ORCPT ); Wed, 15 Jan 2020 17:11:55 -0500 Received: by mail-pj1-f42.google.com with SMTP id e11so565962pjt.4 for ; Wed, 15 Jan 2020 14:11:55 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dilger-ca.20150623.gappssmtp.com; s=20150623; h=from:message-id:mime-version:subject:date:in-reply-to:cc:to :references; bh=mslewm5+SfbCxNU2yFy5UYCpQMf3EmAJSTZ9e3ERDC4=; b=zFWJ4tw9NdTE8/RivajUBkzEuxpE/H9cW8bulC4dc9b/pISeLWpKXvAi0OFgbsXh5Z BKn1Bqy6JxICbCTLRP74lsy/qux4+NtLSf2cqQfM011MHlcYO5oJIMBfxSnwfDcpFQZ4 cUUrQ9y4eI2cnQqiU+YlcjIxv+GuQCGvzog55WGU+lOGMD+VdJKjLd2tIlP2RixUA6nR 5trCjjXXOBIBYeUnNCCJK/GvHrqtbPzkbXqxg2bTCjcJ9GXOV00NWe12rFOTCO33QmyC wvz6NSpFcK1RKdCDUrcYEuyri+PeU8QsWgDf2CYY+cL7ST0+5nbTil09Q+PulbBMAf2r UgGQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:message-id:mime-version:subject:date :in-reply-to:cc:to:references; bh=mslewm5+SfbCxNU2yFy5UYCpQMf3EmAJSTZ9e3ERDC4=; b=huL6Qbk3LkI5/wzhhwitjVtnXnZR42wMr6w6SVzvERRuI8bXplPXd+Lj4d6x+cqxfB VtqcU+KG88zvYcpc64fTG8t7cR5Zmk3ZfkIv4aCpOv4rDz6nn3AHan+MKXDsmGgVz2RT exg8eg0ZrRNDsLkaaIDsO5TE9/yosNRxAY7nmjMfmch1gNzdRQ+dqsK4/S5fkXW7tBKL KDJSbtoeanwi3mC+OD8uaNGSDjeIyzNVql8QDLzOn8rAejAPYM2DNX2T3PRJ4+MBzoZh MVjDfmBLdYeij6LE1DoKQFkoIdIIePoEIiz9onJUImT3l8HrX5k+RLtfMnsuuVfuE9XP 837w== X-Gm-Message-State: APjAAAUp4xJBQiJ5RCscXS2A8saq9woMt13eWx94i0U1dodRuYcx5V5c x2ba986aLXo9yseKcxYOGFywAw== X-Received: by 2002:a17:902:6948:: with SMTP id k8mr27989255plt.223.1579126314676; Wed, 15 Jan 2020 14:11:54 -0800 (PST) Received: from cabot-wlan.adilger.int (S0106a84e3fe4b223.cg.shawcable.net. [70.77.216.213]) by smtp.gmail.com with ESMTPSA id k23sm21025444pgg.7.2020.01.15.14.11.53 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 15 Jan 2020 14:11:53 -0800 (PST) From: Andreas Dilger Message-Id: <7233E240-8EE5-4CD1-B8A4-A90925F51A1B@dilger.ca> Content-Type: multipart/signed; boundary="Apple-Mail=_9180B67E-F18A-478C-A1F5-692FAFE1F5AF"; protocol="application/pgp-signature"; micalg=pgp-sha256 Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: Re: Problems with determining data presence by examining extents? Date: Wed, 15 Jan 2020 15:11:51 -0700 In-Reply-To: <23762.1579121702@warthog.procyon.org.uk> Cc: Christoph Hellwig , Qu Wenruo , linux-fsdevel , Al Viro , "Theodore Y. Ts'o" , "Darrick J. Wong" , Chris Mason , Josef Bacik , David Sterba , linux-ext4 , linux-xfs , linux-btrfs , Linux Kernel Mailing List To: David Howells References: <4467.1579020509@warthog.procyon.org.uk> <00fc7691-77d5-5947-5493-5c97f262da81@gmx.com> <27181AE2-C63F-4932-A022-8B0563C72539@dilger.ca> <20200115133101.GA28583@lst.de> <23762.1579121702@warthog.procyon.org.uk> X-Mailer: Apple Mail (2.3273) Sender: linux-ext4-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-ext4@vger.kernel.org --Apple-Mail=_9180B67E-F18A-478C-A1F5-692FAFE1F5AF Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii On Jan 15, 2020, at 1:55 PM, David Howells wrote: >=20 > Andreas Dilger wrote: >=20 >> I think what is needed here is an fadvise/ioctl that tells the = filesystem >> "don't allocate blocks unless actually written" for that file. >=20 > Yeah - and it would probably need to find its way onto disk so that = its effect > is persistent and visible to out-of-kernel tools. >=20 > It would also have to say that blocks of zeros shouldn't be optimised = away. I don't necessarily see that as a requirement, so long as the filesystem stores a "block" at that offset, but it could dedupe all zero-filled = blocks to the same "zero block". That still allows saving storage space, while keeping the semantics of "this block was written into the file" rather = than "there is a hole at this offset". Cheers, Andreas --Apple-Mail=_9180B67E-F18A-478C-A1F5-692FAFE1F5AF Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP -----BEGIN PGP SIGNATURE----- Comment: GPGTools - http://gpgtools.org iQIzBAEBCAAdFiEEDb73u6ZejP5ZMprvcqXauRfMH+AFAl4fjicACgkQcqXauRfM H+BxLw//bGPhOXY/3cJ9PneKWUn06Um6NY3nyZUxUJ2M6trfAY9A/EIwnVNilORR +TN7uAZKVs76niQRqQxdKu+VDhpUOE82MCSAsanpyVGvQr+TpMizhyEoyOqaocva FqkU24Ip/QamHcrV7w2zF9QuE2b0pI5TrPkd22wlhvV9ZZVFZXXVyxAaTif1ShAK pse8COxvbF5sGh+Ey4pBAc2y7I06rs0MoR4nBrhCLv9gqVQIzIBA2IEs1YTefdbT /jaK1a9HEn32rPwiSwM0g2+wJny/+/96RDAunfnrWUSeZBhJLWGpjLdmw8X9Cx7u /55vlxGqdh9ETjHcKY3NInau59u74y+wRchpSb+NXU+hVb/vcJSISEn1YaI/+lZX /pflGhxiTbj0i0q60DAzg0w6/W4GpQw5K2jlI23A/2WSP+fMEaFUYum0MgjGBxOT b+C6QAoMNymAjoPwSwvglVWkOZ1lYbHxLMFUVXkZ1mp+Y8NisgfaSAeQw+58F6vN HpjVWeXrddFPKe/jKMNrkdeXUh3Md+9K0KWWrPmFnyWEnfyYFSA3QT78O3cDz1K9 1rRNKXrUrWBdalZzgcf3lLfleMnyZ2k3Ctss2bVVtNYNtkam+dV16rXNxx/qxPJJ krdME9fHBPJBEGeg1TBOd/t4UFLJxqvo+hYLz98k7vDsINvDcMo= =7Uqr -----END PGP SIGNATURE----- --Apple-Mail=_9180B67E-F18A-478C-A1F5-692FAFE1F5AF--