Received: by 2002:ac0:a5a7:0:0:0:0:0 with SMTP id m36-v6csp148059imm; Tue, 14 Aug 2018 15:57:36 -0700 (PDT) X-Google-Smtp-Source: AA+uWPxHRi6GzFcq1IMeQhNfMjcEAQRP2m3yUj5edcLR11KMU7W0RnD4+iC6Gx9Atstsp4+hmD5O X-Received: by 2002:a17:902:1121:: with SMTP id d30-v6mr11524734pla.250.1534287456225; Tue, 14 Aug 2018 15:57:36 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1534287456; cv=none; d=google.com; s=arc-20160816; b=sDg7P27IMuJT7lHFs/UAUfPaiOAtprahAEebRTloveojXyy6ZoZLWIXK2XU5It8r1t HQ/eKn0yL0XL39V5owbUY9WpTed57MTxDJym7G3uC6Vo84ZyoVB7vHf6WRdhNaJJ26Bi txLBGFTLmjAdNANhGGwkKj8v6t7lPqyf6/zIMKFF7ojuOCly2op5OIbVB0W7dYS0N1H5 aN1C+a+pIC3Bid/qtl4o1D4TovYv94QOS4Bkj0wMuqfkvRlRlgwW0VO/fy/MUyJPZkgj yduNghdonQGcK+A7+meQWkvLlkjl0dq34rEde3/xmiLUcBwweVNokj+MkEho7bIUZAnh ZP7A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-disposition:mime-version:references:message-id:subject:cc :to:from:date:arc-authentication-results; bh=04QyEwdjnftLJbNtEx3C15QRATjQkOHqYGc/8+AbBH8=; b=WjY/frAMA/MBMUmnDsLJEE/QEn5xKfpCiWjwlb24inPMjWwyxae9ValeFKqBOMdNku nEUrDSbpWSXJejd+iz4J0K0l3mnmxMWrfEsOgeI1A0ayuDw3b1HWjlWuzu4Y9kD9H/Is QUpkLKd1biL/2nDQAJOJTdQLGXVlyAqeXWTDcG0NG19AHClDmsBqECudEvZS8XKxqKr4 MiYe9cnzH2Z5PlxYyGaBpl4/LjQPjnd9ChucE5F31GEVSfHjPqQGNQKGwveewc1BQ0/M 2VLZeIOF9KKaTcAoKxL/9xkN1BH9J2vtfW4EFxde+BTlZS/mTTRVLNMmw9VnaE+Kpybx 5k5A== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id a13-v6si21955700pgj.495.2018.08.14.15.57.20; Tue, 14 Aug 2018 15:57:36 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1732174AbeHOBpy (ORCPT + 99 others); Tue, 14 Aug 2018 21:45:54 -0400 Received: from mga04.intel.com ([192.55.52.120]:31857 "EHLO mga04.intel.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1729652AbeHOBpy (ORCPT ); Tue, 14 Aug 2018 21:45:54 -0400 X-Amp-Result: UNKNOWN X-Amp-Original-Verdict: FILE UNKNOWN X-Amp-File-Uploaded: False Received: from fmsmga004.fm.intel.com ([10.253.24.48]) by fmsmga104.fm.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 14 Aug 2018 15:56:32 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.53,240,1531810800"; d="scan'208";a="80317844" Received: from unknown (HELO localhost.localdomain) ([10.232.112.44]) by fmsmga004.fm.intel.com with ESMTP; 14 Aug 2018 15:56:31 -0700 Date: Tue, 14 Aug 2018 16:57:16 -0600 From: Keith Busch To: Michal Wnukowski Cc: Jens Axboe , Sagi Grimberg , linux-kernel@vger.kernel.org, linux-nvme@lists.infradead.org, Keith Busch , yigitfiliz@google.com, Christoph Hellwig Subject: Re: [PATCH] Bugfix for handling of shadow doorbell buffer. Message-ID: <20180814225716.GA3224@localhost.localdomain> References: <20180814221735.62804-1-wnukowski@google.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20180814221735.62804-1-wnukowski@google.com> User-Agent: Mutt/1.9.1 (2017-09-22) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Tue, Aug 14, 2018 at 03:17:35PM -0700, Michal Wnukowski wrote: > /* Update dbbuf and return true if an MMIO is required */ > static bool nvme_dbbuf_update_and_check_event(u16 value, u32 *dbbuf_db, > - volatile u32 *dbbuf_ei) > + u32 *dbbuf_ei) > { > if (dbbuf_db) { > u16 old_value; > @@ -306,6 +306,12 @@ static bool nvme_dbbuf_update_and_check_event(u16 value, u32 *dbbuf_db, > old_value = *dbbuf_db; > *dbbuf_db = value; > > + /* > + * Ensure that the doorbell is updated before reading > + * the EventIdx from memory > + */ > + mb(); > + > if (!nvme_dbbuf_need_event(*dbbuf_ei, value, old_value)) > return false; > } You just want to ensure the '*dbbuf_db = value' isn't reordered, right? The order dependency might be more obvious if done as: WRITE_ONCE(*dbbuf_db, value); if (!nvme_dbbuf_need_event(READ_ONCE(*dbbuf_ei), value, old_value)) return false; And 'volatile' is again redundant.