Received: by 2002:a05:6a10:6d10:0:0:0:0 with SMTP id gq16csp1983378pxb; Sun, 17 Apr 2022 05:57:02 -0700 (PDT) X-Google-Smtp-Source: ABdhPJwv64rdppg/JYBZTLtecgl/RCQ4SDX50nELEiVqjlv92+SrHLT4ZlSsD3FGqaQI2BP+n/u5 X-Received: by 2002:a17:906:3ec6:b0:6e8:8534:6765 with SMTP id d6-20020a1709063ec600b006e885346765mr5639087ejj.110.1650200221924; Sun, 17 Apr 2022 05:57:01 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1650200221; cv=none; d=google.com; s=arc-20160816; b=L29Grj5nk/cM9FYkpKYHB49IsXd0ABW6P9XiSavvrpetjTljLyNtcREtwUFJzBFCgX /MBoxtWmGc+JeY3FY1oEk+Ti+cWXzd09gZH3cJpsqJw7bG1E31JYhYsxubSaC1JbPs9n HGhDsWSHhkdIAJXJm13lg4d6zt4eTHU9v2YWaWwPqcmwPZDK96yV512RqCJWdvRZlgM7 fY2dM4ZJtE448HEhaKkzJhGRYqeVo/oXfX/6iSZZtpXk2c5qXtHrZV7vuYHsR/ZvFFC6 tc0CSATRi1BTLIVsZKOM2adxQ1RFXidlNcwv/V28Y/7lMG/iEHZXK51koTgoWsN0Lo36 YbwA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=jgklB0jL9Rnz8iRDWPQTu1qSN9xx9yW0zy2F2WNRboA=; b=z715p95I3GKPCOXSXX0S6RO7EXiNRSIOCgXVnKBIH3Qn63RT3ii4UbMzLcjmMh25J3 8gH0e3n7OOfFwc5H2oWWD0OHIzG1PhlcZRsFJijFN4t1Or+kqrVPIcT8d+bxg+rg1uIZ 93UjkDE97n/5P3DoaRD2OCAmwh4lVDq+QJF8WvB+87zQ0L49YmXQO8XnsE6RXJLvxNRv 2+Vu37elyMGWK7Rn4YnsOjhCLGDKYLAZDam808bFiI0gdgWoZILT2Qg7QbCGCL7I+gHI OnGrY14NoZCOq14iGkCZgxdH+Xqj72XQUcAip9URnhzrLhzmZMDdrknSZzQyvxHqRyp0 ok7g== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=DgDPQEzt; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id pk8-20020a170906d7a800b006df76385d62si1325118ejb.514.2022.04.17.05.56.36; Sun, 17 Apr 2022 05:57:01 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=DgDPQEzt; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S233637AbiDQIe4 (ORCPT + 99 others); Sun, 17 Apr 2022 04:34:56 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:55634 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S233627AbiDQIez (ORCPT ); Sun, 17 Apr 2022 04:34:55 -0400 Received: from dfw.source.kernel.org (dfw.source.kernel.org [IPv6:2604:1380:4641:c500::1]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 97A27270A; Sun, 17 Apr 2022 01:32:20 -0700 (PDT) Received: from smtp.kernel.org (relay.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by dfw.source.kernel.org (Postfix) with ESMTPS id 2F13A61156; Sun, 17 Apr 2022 08:32:20 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id C7B82C385A7; Sun, 17 Apr 2022 08:32:16 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1650184339; bh=qxn6V9hPC6xWyUrdMF0MqKwXynUnSClaaMiSRy58f4k=; h=From:To:Cc:Subject:Date:From; b=DgDPQEztAnta1e/OxjJVjBKQ2OhfqdBRA16brTmYHkjUOY9O+ViDCzEeIQqdhDcy3 Fcmz45ONZ64CmDfiGbCtmVuVxMe2hbGtYzeR7UH1QETvYfCzOkt66UBJHb6puoTi5E u48twiVcZnBXzmOJhVlYXdiuhJlucv/kIy/Dbspe3stNVbOPkNTgCU2miLC9Qx6MRZ vt9Fody4TaHuKL4N8WODNh+8XsrBtalOtmktYNqSWnJAHDCGL2HG+omhR255WnuOu9 M0FGKXEDQZ9G45iSMH9BreQF+QnhtBqOWyjBvWuuTagMm7kwcP9a3E5D2Zgrqi7Lhw fcVRu1QLLh+gQ== From: guoren@kernel.org To: guoren@kernel.org, arnd@arndb.de, mark.rutland@arm.com, boqun.feng@gmail.com, peterz@infradead.org, will@kernel.org Cc: linux-arch@vger.kernel.org, linux-kernel@vger.kernel.org, linux-csky@vger.kernel.org, Guo Ren Subject: [PATCH V3 0/3] csky: Optimize with acquire & release for atomic & cmpxchg Date: Sun, 17 Apr 2022 16:32:01 +0800 Message-Id: <20220417083204.2048364-1-guoren@kernel.org> X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-7.1 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_HI, SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org From: Guo Ren Optimize arch_xchg|cmpxchg|cmpxchg_local with ASM acquire|release instructions instead of previous C based. The generic atomic.h used cmpxchg to implement the atomic operations, it will cause daul loop to reduce the forward guarantee. The patch implement csky custom atomic operations with ldex/stex instructions for the best performance. Important reference commit: 8e86f0b409a4 ("arm64: atomics: fix use of acquire + release for full barrier semantics") Changes in V3: - Add arch_atomic_(fetch_add_unless, inc_unless_negative, dec_unless_positive, dec_if_positive) Changes in V2: - Fixup use of acquire + release for barrier semantics by Rutland. Guo Ren (3): csky: cmpxchg: Optimize with acquire & release csky: atomic: Add custom atomic.h implementation csky: atomic: Add conditional atomic operations' optimization arch/csky/include/asm/atomic.h | 249 ++++++++++++++++++++++++++++++++ arch/csky/include/asm/barrier.h | 11 +- arch/csky/include/asm/cmpxchg.h | 64 +++++++- 3 files changed, 316 insertions(+), 8 deletions(-) create mode 100644 arch/csky/include/asm/atomic.h -- 2.25.1