Received: by 2002:a05:6358:45e:b0:b5:b6eb:e1f9 with SMTP id 30csp3137298rwe; Mon, 29 Aug 2022 06:31:32 -0700 (PDT) X-Google-Smtp-Source: AA6agR5YXIic41IS1qDQXjOtSxF95xn2Y25cRqyZl9BgaZ1P0xds9SSbzNouWQG57g+LVHsEiMIL X-Received: by 2002:a17:902:e844:b0:174:79c4:9449 with SMTP id t4-20020a170902e84400b0017479c49449mr10119132plg.66.1661779891707; Mon, 29 Aug 2022 06:31:31 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1661779891; cv=none; d=google.com; s=arc-20160816; b=AT2xDX5J0BlWsCDiypip33r1kpEzZ5sPkT1idxBEGRJWF1C99lAot9JabEBYbPy9eQ WV+HwzYEypHYJ1L7+mvn3WdDsicGnWL+QVJna0RfiSaugZJ6YpcL3+3/fg7FEIajrilY vzUZ9nWjGEMpfjDyBcTX4IXjeTrLifzAzu+6Or5jDbH40QNKUaB2QdHhKZWeWycBMDBe yJcAdcRKraKr8/W1Qr6ljPe3x35TC3NZBlXur3xGVbWeMev+NFTwapZU9K8hrjtBh9ix gr/W0itheSAsl7eCjwHutnwiJ80xz0ZhnVObFzuRng+sGmxFPIrlhE3dwkR58lIsdK8L 7i8g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from; bh=TOei64blNWDYkRtBAQRq5BSbEm+tOTV+56dKNG8sZ4A=; b=ucYSphZZvn3LDIoAODclIfQrE8pxXR3xuU46rY60djsLUVK6pnWRioHJV2Jum8WFbJ ul9mzKmeWCC7M5VL0KLV7DEZrGAKeaLrhu5HYV4C4tUYcx2E7qS5jm9jv4xGDL8oSXyS ePCngPaf4cqykUqVprx5Xna1+4ry08pfvTbGIMNsbWnl2Bjw6pzWaBIFRNtqklPxYoDf SrfCzj4I2D13rPKx1gkZdSXJIvZuOJJfCSVYkPIjGeNLXZpR12mw9UMHqxQoOvWrqwKT M6BfVO2Gw6MheByVMBd6TAKyju59Bu6MgVwwzHStqrjXdRVuDMckZYrKoVYOKfdE6gUZ 1yaQ== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id s7-20020a170902988700b0016f8e803373si8129375plp.394.2022.08.29.06.31.20; Mon, 29 Aug 2022 06:31:31 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230257AbiH2NIr (ORCPT + 99 others); Mon, 29 Aug 2022 09:08:47 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:49072 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229978AbiH2NI3 (ORCPT ); Mon, 29 Aug 2022 09:08:29 -0400 Received: from dggsgout11.his.huawei.com (unknown [45.249.212.51]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id E68A95588; Mon, 29 Aug 2022 06:03:43 -0700 (PDT) Received: from mail02.huawei.com (unknown [172.30.67.169]) by dggsgout11.his.huawei.com (SkyGuard) with ESMTP id 4MGVvZ0KrHzKGDK; Mon, 29 Aug 2022 21:02:02 +0800 (CST) Received: from huaweicloud.com (unknown [10.175.127.227]) by APP4 (Coremail) with SMTP id gCh0CgB3PY0ruQxjk7hcAA--.5381S4; Mon, 29 Aug 2022 21:03:41 +0800 (CST) From: Yu Kuai To: song@kernel.org Cc: linux-raid@vger.kernel.org, linux-kernel@vger.kernel.org, yukuai3@huawei.com, yukuai1@huaweicloud.com, yi.zhang@huawei.com Subject: [PATCH -next 0/3] md/raid10: reduce lock contention for io Date: Mon, 29 Aug 2022 21:14:59 +0800 Message-Id: <20220829131502.165356-1-yukuai1@huaweicloud.com> X-Mailer: git-send-email 2.31.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-CM-TRANSID: gCh0CgB3PY0ruQxjk7hcAA--.5381S4 X-Coremail-Antispam: 1UD129KBjvJXoW7GFy3ArW3Xr45Wryxtr1DZFb_yoW8JrWDpa 1fGF43ZrsrAw1xZrZxtr4UC3W5J3W0q39xC347G34rAFW5ZFWxXw18JFZ5WFWUXF9aqr17 X3WUGr4rGa4UZ3DanT9S1TB71UUUUUUqnTZGkaVYY2UrUUUUjbIjqfuFe4nvWSU5nxnvy2 9KBjDU0xBIdaVrnRJUUUyG14x267AKxVW8JVW5JwAFc2x0x2IEx4CE42xK8VAvwI8IcIk0 rVWrJVCq3wAFIxvE14AKwVWUJVWUGwA2ocxC64kIII0Yj41l84x0c7CEw4AK67xGY2AK02 1l84ACjcxK6xIIjxv20xvE14v26w1j6s0DM28EF7xvwVC0I7IYx2IY6xkF7I0E14v26F4j 6r4UJwA2z4x0Y4vEx4A2jsIE14v26rxl6s0DM28EF7xvwVC2z280aVCY1x0267AKxVW0oV Cq3wAS0I0E0xvYzxvE52x082IY62kv0487Mc02F40EFcxC0VAKzVAqx4xG6I80ewAv7VC0 I7IYx2IY67AKxVWUJVWUGwAv7VC2z280aVAFwI0_Jr0_Gr1lOx8S6xCaFVCjc4AY6r1j6r 4UM4x0Y48IcxkI7VAKI48JM4x0x7Aq67IIx4CEVc8vx2IErcIFxwCF04k20xvY0x0EwIxG rwCFx2IqxVCFs4IE7xkEbVWUJVW8JwC20s026c02F40E14v26r1j6r18MI8I3I0E7480Y4 vE14v26r106r1rMI8E67AF67kF1VAFwI0_JF0_Jw1lIxkGc2Ij64vIr41lIxAIcVC0I7IY x2IY67AKxVWUJVWUCwCI42IY6xIIjxv20xvEc7CjxVAFwI0_Jr0_Gr1lIxAIcVCF04k26c xKx2IYs7xG6rW3Jr0E3s1lIxAIcVC2z280aVAFwI0_Jr0_Gr1lIxAIcVC2z280aVCY1x02 67AKxVW8JVW8JrUvcSsGvfC2KfnxnUUI43ZEXa7VUbXdbUUUUUU== X-CM-SenderInfo: 51xn3trlr6x35dzhxuhorxvhhfrp/ X-CFilter-Loop: Reflected X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,SPF_HELO_NONE, SPF_PASS,T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org From: Yu Kuai patch 1 is a small problem found by code review. patch 2 avoid holding resync_lock in fast path. patch 3 avoid holding lock in wake_up() in fast path. Test environment: Architecture: aarch64 Cpu: Huawei KUNPENG 920, there are four numa nodes Raid10 initialize: mdadm --create /dev/md0 --level 10 --bitmap none --raid-devices 4 /dev/nvme0n1 /dev/nvme1n1 /dev/nvme2n1 /dev/nvme3n1 Test cmd: fio -name=0 -ioengine=libaio -direct=1 -group_reporting=1 -randseed=2022 -rwmixread=70 -refill_buffers -filename=/dev/md0 -numjobs=16 -runtime=60s -bs=4k -iodepth=256 -rw=randread Test result: before this patchset: 2.9 GiB/s after this patchset: 6.6 Gib/s Please noted that in kunpeng-920, memory access latency is very bad accross nodes compare to local node, and in other architecture performance improvement might not be significant. Yu Kuai (3): md/raid10: fix improper BUG_ON() in raise_barrier() md/raid10: convert resync_lock to use seqlock md/raid10: prevent unnecessary calls to wake_up() in fast path drivers/md/raid10.c | 88 +++++++++++++++++++++++++++++---------------- drivers/md/raid10.h | 2 +- 2 files changed, 59 insertions(+), 31 deletions(-) -- 2.31.1