Received: by 2002:ac0:a594:0:0:0:0:0 with SMTP id m20-v6csp3815834imm; Fri, 25 May 2018 12:09:26 -0700 (PDT) X-Google-Smtp-Source: AB8JxZqoWqCZCQxipvNLDzVLxkEnYzszPZmqEp/uUViQdsW0CROTQZbAg2/UabgamQdmP5Tc/Nsv X-Received: by 2002:a17:902:2f43:: with SMTP id s61-v6mr3817565plb.274.1527275365981; Fri, 25 May 2018 12:09:25 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1527275365; cv=none; d=google.com; s=arc-20160816; b=dtKLZThCtGh5tbLiP8flWlPzi9ir1M11LoEt8Gm+feeANpNO3eAfBajX1BX3es+Qwg xb0Fvn8VxEsQ3JU/0ljtSgPQJVduDc3IL2S4xgo73E8r2puZHbPfsafvsEmwnhBxzCN4 x0jt2vC9w+gp0UAif2k6n6EFWTJvGDHrveUzgnghm9HXJV70K+CCUuAEnEy6s8WIdKR/ OCtgvoc2oIwQ6bT78cyIZepLBzpHPPhlbpl+jRcOTUffgO9ZA5kmukNlGHt3xou2YxHb dORuA8CfLo1nUzxMSYlQIDtH/PQfEt9HdT3p5JaCui5PVjphd1YI7/jKh30aHIIEbEk2 eMMQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:message-id:user-agent:content-disposition :mime-version:reply-to:subject:cc:to:from:date :arc-authentication-results; bh=MNI6aQ4klZzGYSjRFeW3EjAU4sv9H3vRmB4wpes6wk4=; b=Fe7DD1gzOMStJFUVUw3Z7RxGG4Pek7D52gTSk9FcKJIZlipRDGIfiktUV4zpiUbgBP OpYIuk16fhLE6i3cXm3u114VhfmT2HkSwwDVVR9FKA6kkcdcvLDz7zUHeSj0PzHQsfZ9 ULtoDwLHlU30ojrKsrpCKkBCBqV3czKJ4zDD7EavKBCEnFDyg8cP3WTofkAZz5JEbGtA INYe5B3ardppDV61RZsI7cTF6KA2q1Ef4pdT3XwqiBPyter89KZVtdYdyEaKONli35aE ewg0pXwbaGRLKkd5AXJO5DDFQPCesagA4L2qm70Jiw4sNz2/0MgotsK6GioGqSEDbxtN mgjA== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=ibm.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id q12-v6si23434440plr.358.2018.05.25.12.09.01; Fri, 25 May 2018 12:09:25 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=ibm.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S967912AbeEYTIt (ORCPT + 99 others); Fri, 25 May 2018 15:08:49 -0400 Received: from mx0b-001b2d01.pphosted.com ([148.163.158.5]:41238 "EHLO mx0a-001b2d01.pphosted.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S967684AbeEYTIr (ORCPT ); Fri, 25 May 2018 15:08:47 -0400 Received: from pps.filterd (m0098413.ppops.net [127.0.0.1]) by mx0b-001b2d01.pphosted.com (8.16.0.22/8.16.0.22) with SMTP id w4PIwkxY111505 for ; Fri, 25 May 2018 15:08:47 -0400 Received: from e19.ny.us.ibm.com (e19.ny.us.ibm.com [129.33.205.209]) by mx0b-001b2d01.pphosted.com with ESMTP id 2j6qd4j7d7-1 (version=TLSv1.2 cipher=AES256-GCM-SHA384 bits=256 verify=NOT) for ; Fri, 25 May 2018 15:08:46 -0400 Received: from localhost by e19.ny.us.ibm.com with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted for from ; Fri, 25 May 2018 15:08:46 -0400 Received: from b01cxnp22034.gho.pok.ibm.com (9.57.198.24) by e19.ny.us.ibm.com (146.89.104.206) with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted; (version=TLSv1/SSLv3 cipher=AES256-GCM-SHA384 bits=256/256) Fri, 25 May 2018 15:08:41 -0400 Received: from b01ledav003.gho.pok.ibm.com (b01ledav003.gho.pok.ibm.com [9.57.199.108]) by b01cxnp22034.gho.pok.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id w4PJ8eVL58982650 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Fri, 25 May 2018 19:08:40 GMT Received: from b01ledav003.gho.pok.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id C4357B206C; Fri, 25 May 2018 16:10:26 -0400 (EDT) Received: from b01ledav003.gho.pok.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 938E7B2064; Fri, 25 May 2018 16:10:26 -0400 (EDT) Received: from paulmck-ThinkPad-W541 (unknown [9.70.82.108]) by b01ledav003.gho.pok.ibm.com (Postfix) with ESMTP; Fri, 25 May 2018 16:10:26 -0400 (EDT) Received: by paulmck-ThinkPad-W541 (Postfix, from userid 1000) id 1E7C416C3C88; Fri, 25 May 2018 12:10:20 -0700 (PDT) Date: Fri, 25 May 2018 12:10:20 -0700 From: "Paul E. McKenney" To: linux-kernel@vger.kernel.org, linux-arch@vger.kernel.org Cc: stern@rowland.harvard.edu, andrea.parri@amarulasolutions.com, will.deacon@arm.com, peterz@infradead.org, boqun.feng@gmail.com, npiggin@gmail.com, dhowells@redhat.com, j.alglave@ucl.ac.uk, luc.maranget@inria.fr, akiyks@gmail.com, mingo@kernel.org Subject: [PATCH RFC tools/memory-model] Add litmus-test naming scheme Reply-To: paulmck@linux.vnet.ibm.com MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.21 (2010-09-15) X-TM-AS-GCONF: 00 x-cbid: 18052519-0056-0000-0000-00000455C1D5 X-IBM-SpamModules-Scores: X-IBM-SpamModules-Versions: BY=3.00009083; HX=3.00000241; KW=3.00000007; PH=3.00000004; SC=3.00000262; SDB=6.01037571; UDB=6.00530875; IPR=6.00816699; MB=3.00021296; MTD=3.00000008; XFM=3.00000015; UTC=2018-05-25 19:08:44 X-IBM-AV-DETECTION: SAVI=unused REMOTE=unused XFE=unused x-cbparentid: 18052519-0057-0000-0000-00000899E090 Message-Id: <20180525191020.GA5914@linux.vnet.ibm.com> X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:,, definitions=2018-05-25_07:,, signatures=0 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 priorityscore=1501 malwarescore=0 suspectscore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1015 lowpriorityscore=0 impostorscore=0 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1709140000 definitions=main-1805250199 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org This commit documents the scheme used to generate the names for the litmus tests. Signed-off-by: Paul E. McKenney --- README | 136 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++- 1 file changed, 135 insertions(+), 1 deletion(-) diff --git a/tools/memory-model/litmus-tests/README b/tools/memory-model/litmus-tests/README index 00140aaf58b7..b81f51054cd3 100644 --- a/tools/memory-model/litmus-tests/README +++ b/tools/memory-model/litmus-tests/README @@ -1,4 +1,6 @@ -This directory contains the following litmus tests: +============ +LITMUS TESTS +============ CoRR+poonceonce+Once.litmus Test of read-read coherence, that is, whether or not two @@ -151,3 +153,135 @@ Z6.0+pooncerelease+poacquirerelease+mbonceonce.litmus A great many more litmus tests are available here: https://github.com/paulmckrcu/litmus + +================== +LITMUS TEST NAMING +================== + +Litmus tests are usually named based on their contents, which means that +looking at the name tells you what the litmus test does. The naming +scheme covers litmus tests having a single cycle that passes through +each process exactly once, so litmus tests not fitting this description +are named on an ad-hoc basis. + +The structure of a litmus-test name is the litmus-test class, a plus +sign ("+"), and one string for each process, separated by plus signs. +The end of the name is ".litmus". + +The litmus-test classes may be found in the infamous test6.pdf: +https://www.cl.cam.ac.uk/~pes20/ppc-supplemental/test6.pdf +Each class defines the pattern of accesses and of the variables accessed. +For example, if the one process writes to a pair of variables, and +the other process reads from these same variables, the corresponding +litmus-test class is "MP" (message passing), which may be found on the +left-hand end of the second row of tests on page one of test6.pdf. + +The strings used to identify the actions carried out by each process are +complex due to a desire to have finite-length names. Thus, there is a +tool to generate these strings from a given litmus test's actions. For +example, consider the processes from SB+rfionceonce-poonceonces.litmus: + + P0(int *x, int *y) + { + int r1; + int r2; + + WRITE_ONCE(*x, 1); + r1 = READ_ONCE(*x); + r2 = READ_ONCE(*y); + } + + P1(int *x, int *y) + { + int r3; + int r4; + + WRITE_ONCE(*y, 1); + r3 = READ_ONCE(*y); + r4 = READ_ONCE(*x); + } + +The next step is to construct a space-separated list of descriptors, +interleaving descriptions of the relation between a pair of consecutive +accesses with descriptions of the second access in the pair. + +P0()'s WRITE_ONCE() is read by its first READ_ONCE(), which is a +reads-from link (rf) and internal to the P0() process. This is +"rfi", which is an abbreviation for "reads-from internal". Because +some of the tools string these abbreviations together with space +characters separating processes, the first character is capitalized, +resulting in "Rfi". + +P0()'s second access is a READ_ONCE(), as opposed to (for example) +smp_load_acquire(), so next is "Once". Thus far, we have "Rfi Once". + +P0()'s third access is also a READ_ONCE(), but to y rather than x. +This is related to P0()'s second access by program order ("po"), +to a different variable ("d"), and both accesses are reads ("RR"). +The resulting descriptor is "PodRR". Because P0()'s third access is +READ_ONCE(), we add another "Once" descriptor. + +A from-read ("fre") relation links P0()'s third to P1()'s first +access, and the resulting descriptor is "Fre". P1()'s first access is +WRITE_ONCE(), which as before gives the descriptor "Once". The string +thus far is thus "Rfi Once PodRR Once Fre Once". + +The remainder of P1() is similar to P0(), which means we add +"Rfi Once PodRR Once". Another fre links P1()'s last access to +P0()'s first access, which is WRITE_ONCE(), so we add "Fre Once". +The full string is thus: + + Rfi Once PodRR Once Fre Once Rfi Once PodRR Once Fre Once + +This string can be given to the "norm7" and "classify7" tools to +produce the name: + +$ norm7 -bell linux-kernel.bell Rfi Once PodRR Once Fre Once Rfi Once PodRR Once Fre Once | classify7 -bell linux-kernel.bell -diyone | sed -e 's/:.*//g' +SB+rfionceonce-poonceonces + +Adding the ".litmus" suffix: SB+rfionceonce-poonceonces.litmus + + +======================= +LITMUS TEST DESCRIPTORS +======================= + +These descriptors cover connections between consecutive accesses: + +Fre: From-read external. The current process wrote a variable that + the previous process read. Example: The SB (store buffering) test. +Fri: From-read internal. This process read a variable and then + immediately wrote to it. Example: ??? +PodRR: Program-order different variable, read followed by read. + This process read a variable and again read a different variable. + Example: The read-side process in the MP (message-passing) test. +PodRW: Program-order different variable, read followed by write. + This process read a variable and then wrote a different variable. + Example: The LB (load buffering) test. +PodWR: Program-order different variable, write followed by read. + This process wrote a variable and then read a different variable. + Example: The SB (store buffering) test. +PodWW: Program-order different variable, write followed by write. + This process wrote a variable and again wrote a different variable. + Example: The write-side process in the MP (message-passing) test. +PosRR: Program-order same variable, read followed by read. + This process read a variable and again read that same variable. + Example: ??? +PosRW: Program-order same variable, read followed by write. + This process read a variable and then wrote that same variable. + Example: ??? +PosWR: Program-order same variable, write followed by read. + This process wrote a variable and then read that same variable. + Example: ??? +PosWW: Program-order same variable, write followed by write. + This process wrote a variable and again rrote that same variable. + Example: ??? +Rfe: Read-from external. The current process read a variable written + by the previous process. Example: The MP (message passing) test. +Rfi: Read-from internal. The current process wrote a variable and then + immediately read the value back from it. Example: ??? + Comparison to PosWR??? +Wse: Write same external. The current process wrote to a variable that + was also written to by the previous process. Example: ??? +Wsi: Write same internal. The current process wrote to a variable and + then immediately wrote to it again. Example: ???