Received: by 2002:ac0:a5a6:0:0:0:0:0 with SMTP id m35-v6csp2102287imm; Thu, 27 Sep 2018 07:28:22 -0700 (PDT) X-Google-Smtp-Source: ACcGV62CpzbpBoRQP0j/hYxhQOc21miMYTOK06+Yr51pIWlikm9XSE0Vt3usnm7CJlBwzKG4X+Fi X-Received: by 2002:a63:4b44:: with SMTP id k4-v6mr10527918pgl.51.1538058501980; Thu, 27 Sep 2018 07:28:21 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1538058501; cv=none; d=google.com; s=arc-20160816; b=h/ngq2N39xrT9BGTap/CHDw1p825hr1nGl19uYd02+nDZXSUlB/zPQP1sBJqfudCu2 1NozKvYmYTIvchjktW4cG0wqE2w+FyDSKDTkOT26cyhH3RFUvd1+FsSdqYUyLCp2ra4j /HkOr5BbqvGjjChyjpGyh1J2it2yNbijQXPc2vywOwebdu7q7VyXGISJRuUKpvOTibhl diA7ePeJ4XDrKKhhoBQdx+0Kmn7mG+Dm7mj9BgkrFvMbV4zOakn+6+GnrC99tnThmJ2B DNw2azHNHuSwGoIrBW+U52n6wD4rg92Po8XETx3wn8h6HBLBTsQzKeANRZfylmRUAhSN b5wQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-disposition:mime-version:references:mail-followup-to :message-id:subject:cc:to:from:date:dkim-signature; bh=ZYlrqMOhksGog2bsb0hkNk6SNq9XjE4g7z8zHlLl9ZY=; b=bxtsAe+f95UjqwjlXXNVG8Cl2O+qkBXJ4HVvpCqYRERvFOPn4rR5zFsErlFe3Gzrm4 iVHbWWYD1rX+ypXrT4vu58Sy4ULS7NiijIKM/bTgrGiSEJHvX3F/cJeDkgALadJtODkp +DebZVMM/M2GajUtvF/YdwKW5pB+b30uNig7hSM52qhoMTwsg4ShKw8o5xwt0lZNiy+1 htILht2xtjY0LuB0smfEOjX7LbkUOcYvm9H/X62bvfuYtrKKlM388xlxss2sNYtoOJdS X0Cx908apSa3DfirjcCXnju273SmnMKenzwJH61pG76kuqFi4JE0tAfadPe7sj3s6hkS 4sBA== ARC-Authentication-Results: i=1; mx.google.com; dkim=fail header.i=@thunk.org header.s=ef5046eb header.b=sW1h+Dc3; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id i64-v6si2255125pfb.314.2018.09.27.07.28.06; Thu, 27 Sep 2018 07:28:21 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=fail header.i=@thunk.org header.s=ef5046eb header.b=sW1h+Dc3; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728009AbeI0UqX (ORCPT + 99 others); Thu, 27 Sep 2018 16:46:23 -0400 Received: from imap.thunk.org ([74.207.234.97]:55496 "EHLO imap.thunk.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727751AbeI0UqX (ORCPT ); Thu, 27 Sep 2018 16:46:23 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=thunk.org; s=ef5046eb; h=In-Reply-To:Content-Type:MIME-Version:References:Message-ID: Subject:Cc:To:From:Date:Sender:Reply-To:Content-Transfer-Encoding:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=ZYlrqMOhksGog2bsb0hkNk6SNq9XjE4g7z8zHlLl9ZY=; b=sW1h+Dc3eEkvqanxTbpIo5Uc4X AkUyVii2i6yN9XJTAsqVUoMHg79W2GlkdCKaz22uFNxl8ubgna5UI9D1rVT38/cKMykbbQXumlVEp rOt4mn0BvjOsnRYYQ0qPIaxpy/iK1eQhfTzZdd2y3+sHRLIVhcbQYIveksiLx983gHnM=; Received: from root (helo=callcc.thunk.org) by imap.thunk.org with local-esmtp (Exim 4.89) (envelope-from ) id 1g5XGW-00005h-CO; Thu, 27 Sep 2018 14:27:40 +0000 Received: by callcc.thunk.org (Postfix, from userid 15806) id 3E7D97A518E; Thu, 27 Sep 2018 10:27:38 -0400 (EDT) Date: Thu, 27 Sep 2018 10:27:38 -0400 From: "Theodore Y. Ts'o" To: Jeff Layton Cc: Alan Cox , =?utf-8?B?54Sm5pmT5Yas?= , linux-fsdevel@vger.kernel.org, linux-kernel@vger.kernel.org, Rogier Wolff , Matthew Wilcox Subject: Re: POSIX violation by writeback error Message-ID: <20180927142738.GA27040@thunk.org> Mail-Followup-To: "Theodore Y. Ts'o" , Jeff Layton , Alan Cox , =?utf-8?B?54Sm5pmT5Yas?= , linux-fsdevel@vger.kernel.org, linux-kernel@vger.kernel.org, Rogier Wolff , Matthew Wilcox References: <486f6105fd4076c1af67dae7fdfe6826019f7ff4.camel@redhat.com> <20180925003044.239531c7@alans-desktop> <0662a4c5d2e164d651a6a116d06da380f317100f.camel@redhat.com> <20180925154627.GC2933@thunk.org> <23cd68a665d27216415dc79367ffc3bee1b60b86.camel@redhat.com> <20180925223054.GH2933@thunk.org> <51b401b82356c2d8e124bb8701f310afd98e0838.camel@redhat.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <51b401b82356c2d8e124bb8701f310afd98e0838.camel@redhat.com> User-Agent: Mutt/1.10.1 (2018-07-13) X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: tytso@thunk.org X-SA-Exim-Scanned: No (on imap.thunk.org); SAEximRunCond expanded to false Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, Sep 27, 2018 at 08:43:10AM -0400, Jeff Layton wrote: > > Basically, the problem (as I see it) is that we can end up evicting > uncleanable data from the cache before you have a chance to call fsync, > and that means that the results of a read after a write are not > completely reliable. Part of the problem is that people don't agree on what the problem is. :-) The original posting was from someone who claimed it was a "POSIX violation" if a subsequent read returns *successfully*, but then the writeback succeeds. Other people are worried about this problem; yet others are worried about the system wedging and OOM-killing itself, etc. The problem is that in the face of I/O errors, it's impossible to keep everyone happy. (You could make the local storage device completely reliable, with a multi-million dollar storage array with remote replication, but then the CFO won't be happy; and other people were talking about making things work with cheap USB thumb drives and laptops. This is the very definition of an over-constained problem.) - Ted