Received: by 2002:a5b:505:0:0:0:0:0 with SMTP id o5csp779925ybp; Fri, 11 Oct 2019 04:21:27 -0700 (PDT) X-Google-Smtp-Source: APXvYqzQ5HuQXLwAKZySdw0WhuWqwQPFuZhtdwGqZVnhQYZk6D6s6EvGduz2dT3nBdZMgtiZDCKg X-Received: by 2002:a17:906:d928:: with SMTP id rn8mr12800174ejb.143.1570792887215; Fri, 11 Oct 2019 04:21:27 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1570792887; cv=none; d=google.com; s=arc-20160816; b=ryxTjONw3vQL1Cpplx5lKsfkCj+S3oPeboM5tHtiAfV9dF3JpftUr1cwzKlXcw8IEX ME8Zy33qTQYNzZK9No2mdAhVdGpoaSfSA9UvY36YXjBrg8yK3yrc+kwHasNrjmsl4Jg5 /H4zDK5NO/7nDDEDi+haHv2+hzyQws3oliQnq0VmKuRzDzC3E5gH+3Q1g/63qKlxpPjF JPoDF8qY3kEtkMUZn1uBFXkZvi7h47v+IdAxISxMlOScmaaF5wMrUE1m5W1pzOVE6ezG nCn7k/h2P6H9zzhSc2G2MmZvOh+30nygKYESVKimmK5mlfZJAsr5y6PPnM65JSTI6IaV ktMA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=8FUzCXKMgFlRWZSYjz6SB7CgHl35Q9I/1MXzksfCd2M=; b=d6u11vYhNWr96+ROSC4xC6DpghOiBOr2CHtmKrUFDLlMJ3EwiYN3qgcRGTeRmXm0ap OcZE/XvXDIZ8iFF1huJvBjB5xI7+SLb3v5dASZ3FtYbgcsgYrXEfYrbjbW+SdLcAXvOs BCC8iPkREoF5wtnL48zoeWy2j/HhelwwYTIgIqEV5X40epP/WrPHvBwrT4GN/t7v3ZY5 fANXYX9OfF9DJzUPxJpR2orcRylDvIJ3um8AtqeXrGedxaGITHNpjgrN1ZTSHBhQfAII xyadgJUtEhcAasYAvu8juE7PW6SU2eEfaF4DiC+WZgTwxoT4SPXP6ok2DY2V4aOfu3JZ WSgQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@colorfullife-com.20150623.gappssmtp.com header.s=20150623 header.b=J1tLsBFL; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id w5si5045928eds.179.2019.10.11.04.21.03; Fri, 11 Oct 2019 04:21:27 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@colorfullife-com.20150623.gappssmtp.com header.s=20150623 header.b=J1tLsBFL; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727974AbfJKLUV (ORCPT + 99 others); Fri, 11 Oct 2019 07:20:21 -0400 Received: from mail-wm1-f43.google.com ([209.85.128.43]:52816 "EHLO mail-wm1-f43.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727477AbfJKLUT (ORCPT ); Fri, 11 Oct 2019 07:20:19 -0400 Received: by mail-wm1-f43.google.com with SMTP id r19so10023332wmh.2 for ; Fri, 11 Oct 2019 04:20:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=colorfullife-com.20150623.gappssmtp.com; s=20150623; h=from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=8FUzCXKMgFlRWZSYjz6SB7CgHl35Q9I/1MXzksfCd2M=; b=J1tLsBFLJvqruEsBrGtzikhkMUsPFoBu7PTBR9Aor74VABITwmub6lm3lbGj3o6hx3 sLXUnyjEw24VLTbWji8uSjR5LHxpXOd/P1faFWwu2D/2WrWzz6JLq0S/0qmjwVxhiQjK pKYBxuMjn8WMrCSRHLYpgXACm5gtmDyhgeyIiJ0HFVUIW0r1QiwBNstk2qoYE7jT+t7q +gf9D5EqFxmUmHjeYSraRQUiwB3DcGwBLqp3qwA/MNbtKyW1eb7UtElm+bkJ/rHGRZMv ybwGRQXkjvmpDbfd0owHx9/S5TgKYvkLtA9zl9m/l+rPJysN9JudIHF4ZS/KhodEJl+b Ix6g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=8FUzCXKMgFlRWZSYjz6SB7CgHl35Q9I/1MXzksfCd2M=; b=cdYvnW3bqpUoaFl0Yz253Ad/sDtuP433s+9RLcK9ZUg4Bn9UQKaOIFE7JjdPuKMa9q 03QZEXvatJuqfetue6oJJVhFPOUm/TSlkeDYLcVdKFIg51qp53IAYJJHiTLklPHUAW+q iAonRzvbmrkOB/e8lli50LkPPhHd7lYVGWHIZ5YduQPt4aPx+E29Ufc/E3/qBhiQKvD2 EM402JnD6Tj5bP9m23fCgRpPwxgX2PdBlPO8FYl+t3UC8fHd51AEmalAek5HU/ZZyPsC UoUuSBssr83tDqzOzkyZsMBbtsnTfo2/XzWNDjIux4KGIgWpS/vR44WLxSV9SyGCRIUq daSQ== X-Gm-Message-State: APjAAAVdaj011y3VVzX1ejgPWthz/aIrN8/PL5ncFIkrvwlbQGDX4qQN p6WSP+66U59hnXkyFIMSChi+beakLz4= X-Received: by 2002:a05:600c:2481:: with SMTP id 1mr2690748wms.98.1570792816248; Fri, 11 Oct 2019 04:20:16 -0700 (PDT) Received: from linux.fritz.box (p200300D99705BE00E22045ECB41D901D.dip0.t-ipconnect.de. [2003:d9:9705:be00:e220:45ec:b41d:901d]) by smtp.googlemail.com with ESMTPSA id 63sm12781226wri.25.2019.10.11.04.20.14 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 11 Oct 2019 04:20:15 -0700 (PDT) From: Manfred Spraul To: LKML , Davidlohr Bueso , Waiman Long Cc: 1vier1@web.de, Andrew Morton , Peter Zijlstra , Jonathan Corbet , Manfred Spraul Subject: [PATCH 0/3] Clarify/standardize memory barriers for ipc Date: Fri, 11 Oct 2019 13:20:04 +0200 Message-Id: <20191011112009.2365-1-manfred@colorfullife.com> X-Mailer: git-send-email 2.21.0 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hi, Partially based on the findings from Waiman Long: a) The memory barriers in ipc are not properly documented, and at least for some architectures insufficient: Reading the xyz->status is only a control barrier, thus smp_acquire__after_ctrl_dep() was missing in mqueue.c and msg.c sem.c contained a full smp_mb(), which is not required. Patch 1: Document that wake_q_add() contains a barrier. b) wake_q_add() provides a memory barrier, ipc/mqueue.c relies on this. Move the documentation to wake_q_add(), instead writing it in ipc/mqueue.c Patch 2-4: Update the ipc code, especially add missing smp_mb__after_ctrl_dep(). c) [optional] Clarify that smp_mb__{before,after}_atomic() are compatible with all RMW atomic operations, not just the operations that do not return a value. Patch 5: Documentation for smp_mb__{before,after}_atomic(). From my point of view, patch 1 is a prerequisite for patches 2-4: If the barrier is not part of the documented API, then ipc should not rely on it, i.e. then I would propose to replace the WRITE_ONCE with smp_store_release(). Open issues: - More testing. I did some tests, but doubt that the tests would be sufficient to show issues with regards to incorrect memory barriers. - Should I add a "Fixes:" or "Cc:stable"? The only issues that I see are the missing smp_mb__after_ctrl_dep(), and WRITE_ONCE() vs. "ptr = NULL". What do you think? -- Manfred