Received: by 2002:a05:7412:419a:b0:f3:1519:9f41 with SMTP id i26csp3244000rdh; Mon, 27 Nov 2023 09:19:46 -0800 (PST) X-Google-Smtp-Source: AGHT+IG0cg5eLjOb79WvPCpqiSzJsdizOcNHhvzllojqnuxP82WXqKfeoNlJU05KPGjZE4zp4d79 X-Received: by 2002:a05:6e02:1849:b0:35b:24ef:ddb6 with SMTP id b9-20020a056e02184900b0035b24efddb6mr17641358ilv.19.1701105585791; Mon, 27 Nov 2023 09:19:45 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1701105585; cv=none; d=google.com; s=arc-20160816; b=fLBd/DfJYZYkDp38qgZ/wjPmX6m9HPOEelulqsoODbORRicKSj7UA2LflzWI9pGKZ6 iyB1M2wdfp+Y+Mxb32O/R9gIVj9O6s/o12Lq3vaTtbkmFP1vP/mmQKenFJegPc4f+Lk+ NgdrGkENVbhO24/SRSY6mI4Vnbg0DMV1/sLRjly4puWI8vYbBnwCJyVJcVvdMvXB6W17 V7jQWHd+zT4cKezd4SazOP72jyTOmSu7rL1GmLkXm9gNjFH2e86ZRK+EzMJ7KN3ITe/q euDaTCL2AIhe+K2wn/iemCdYj30U4ncQXnX5awz1i3674Y6NWQUDGQG+Q5yqYlFcmI/A 5bCA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=in-reply-to:content-disposition:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:references:message-id:subject:cc :to:from:date:dkim-signature; bh=izdgl9OMTrve/VgGaU+Po2+ZToRQOkGAUt7Q3g9emHo=; fh=2h5kuHYWkDn83/X+qGbYnO3p0L2iAJ0p8m8WMl6bJQw=; b=c5HanAW+M0x1dqhrJ9HqbxRXnvuWsOmPyrDYUDZABp1DFTC5OIvyv5BwVAWbEhWyhn 0mi+qKPwy/w7U6vbvvSH+UM4yVHiI3Wtt7QDcyVVx3JfjEZk+4yHm+Cd8/sMVuFAdM5J 9QQIBUYMi42LDYLEm1ejsX22EpZ8KCKeA9y3lOCGio8hTNEI42DnnysQwRAneJBdqzP8 6Evi9fx5TuIxDhxrLwkMrejZbtbFwrvcfOex79KsPZyplmr1Na9UeYbeaxQbyOYmZMzh Pq9lIkqHOvLpdoabFU4d0xWCL9Ash048O3zumWY56A7bUenKScZBV5FAjjmsHjYqJo+u 8jag== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@infradead.org header.s=bombadil.20210309 header.b="QoBl/5Qa"; spf=pass (google.com: domain of linux-nfs+bounces-105-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:40f1:3f00::1 as permitted sender) smtp.mailfrom="linux-nfs+bounces-105-linux.lists.archive=gmail.com@vger.kernel.org" Return-Path: Received: from sy.mirrors.kernel.org (sy.mirrors.kernel.org. [2604:1380:40f1:3f00::1]) by mx.google.com with ESMTPS id 33-20020a631661000000b005be03f0da68si10075437pgw.13.2023.11.27.09.19.45 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 27 Nov 2023 09:19:45 -0800 (PST) Received-SPF: pass (google.com: domain of linux-nfs+bounces-105-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:40f1:3f00::1 as permitted sender) client-ip=2604:1380:40f1:3f00::1; Authentication-Results: mx.google.com; dkim=pass header.i=@infradead.org header.s=bombadil.20210309 header.b="QoBl/5Qa"; spf=pass (google.com: domain of linux-nfs+bounces-105-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:40f1:3f00::1 as permitted sender) smtp.mailfrom="linux-nfs+bounces-105-linux.lists.archive=gmail.com@vger.kernel.org" Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by sy.mirrors.kernel.org (Postfix) with ESMTPS id BC440B20D6C for ; Mon, 27 Nov 2023 17:19:43 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 3629A37156; Mon, 27 Nov 2023 17:19:41 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=infradead.org header.i=@infradead.org header.b="QoBl/5Qa" X-Original-To: linux-nfs@vger.kernel.org Received: from bombadil.infradead.org (bombadil.infradead.org [IPv6:2607:7c80:54:3::133]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id DA684B8 for ; Mon, 27 Nov 2023 09:19:37 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=bombadil.20210309; h=In-Reply-To:Content-Type:MIME-Version :References:Message-ID:Subject:Cc:To:From:Date:Sender:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description; bh=izdgl9OMTrve/VgGaU+Po2+ZToRQOkGAUt7Q3g9emHo=; b=QoBl/5QaMQ4O9f6rWlWCe0H7Xi aQHJKlqr43Tq/59Bxj5+KP6T7zHQ4s+dwhkggnLx0LOE/wtnMGowvkpjk8XVbtvXlGAMPfK1u1DlF 79ADzYf+rWMEDIHEvgjq1CH4YGr99QvohuVvd0sb/druzoqYxDAE6yB98RSUAx1aQZC63O9uHIgpK bd8P3rA4jZvUkPvN7H3mzPQnAtKluNvhyiqxW3MZo2u0EPqx9gElTAtCKcQsLdjCoKZVyM3efuoQK D5gew1UGEc0YYlzQhuwtEz3W9FaX9+y56eycuRG0Ifv5o9nxvzJ+Gf2IJ4Mj+qBVUatynylU9BAsC +xFORQtg==; Received: from hch by bombadil.infradead.org with local (Exim 4.96 #2 (Red Hat Linux)) id 1r7fGh-0037KU-3D; Mon, 27 Nov 2023 17:19:36 +0000 Date: Mon, 27 Nov 2023 09:19:35 -0800 From: "hch@infradead.org" To: Trond Myklebust Cc: "hch@infradead.org" , "tao.lyu@epfl.ch" , "linux-nfs@vger.kernel.org" Subject: Re: Question about O_APPEND | O_DIRECT Message-ID: References: <2d948b43fa625952e50589e4bedf9551df7ee112.camel@hammerspace.com> <7d2d17e4d3904d29b75fadcfd916b2a3@epfl.ch> <20107e878f185628a8d498ebb046e55618abfd4f.camel@hammerspace.com> Precedence: bulk X-Mailing-List: linux-nfs@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20107e878f185628a8d498ebb046e55618abfd4f.camel@hammerspace.com> X-SRS-Rewrite: SMTP reverse-path rewritten from by bombadil.infradead.org. See http://www.infradead.org/rpr.html On Mon, Nov 27, 2023 at 05:08:22PM +0000, Trond Myklebust wrote: > Note that APPEND would only really work with O_DIRECT, since it is > anathema to cached I/O to not be able to control the placement of the > data. Yes. > In addition, the model will always break down if someone decides they > want to write a log entry of size > wsize. Once you have to split up > the data, you (obviously) lose the atomicity you need in order to write > a contiguous record. Yes. Note that there is work going on to define atomic I/O limits on the various Linux lists currently. Although in the block layer we also have a separate limit for the maximum append size already.