Received: by 2002:a05:6358:700f:b0:131:369:b2a3 with SMTP id 15csp2609206rwo; Thu, 3 Aug 2023 11:59:43 -0700 (PDT) X-Google-Smtp-Source: AGHT+IFeISFAyfmZ37ph9lkFFgDj1tfhysvuCIw1lgjb1KX5/uV6K8LOzSKuyWcfkO7wMsDzVFAT X-Received: by 2002:a05:6a21:9983:b0:13f:cd07:2b40 with SMTP id ve3-20020a056a21998300b0013fcd072b40mr200915pzb.3.1691089182876; Thu, 03 Aug 2023 11:59:42 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1691089182; cv=none; d=google.com; s=arc-20160816; b=uDYjePEgkLRv2JTHQk5k+UCM5hs0MmPymnPWaaddSmcXgSie15wc/zOxUgdEwwMkt4 gcLlMh/KhqxKND51vXRCV5/uAgkOevGO+SZSyGLOgIHd345hcct9XqY7adFuRAaqZxJu ciahACnt9K3p/KN7T1Hl3S5pfMEwi6zXvoQ5llyMOPtoblWdBJbXbgcIY/jxuZeqFDrQ HFyoPuiGC+Qr29t0qEv4PE0ULJuB/QoeOp4XBRbu+495VXSzt9ekNHkIM6He+ZubGp+H SuCRjXc3oW3fX25qgMHNycjx2GeLA0oKK9AJJR/TOo+vRuZmdhjrKLhEPN6ZtqIKKjSU 3YnA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=NnrRTd9/EN/PkUHkAqqwuBsUKw1ZVO/neUjERH5195M=; fh=Vlps4JFAAtvImqC5EDVGqekmEhcBf0z6+Y2DenJNL2w=; b=C+joKjlXrTRACR33lHrQaZ27UdHgaFH4qta4Ss1zg/WjdBP6nmOApPGpbt6L0uoEBz MivbfyHamXqRC8ZbiT9AKjTpjFRAeVVcXQwLXjPS/MIj5s3LI9m9d1vjX4YfiKX0NILh Shno+YyTVjslk8ruPQo8ijo7QIQm29GrJwJe9PCTSt80TnR5CyVRemRFHsN1Nttxons0 jkDkH+UydbHTom57LMB3/7+cjgVIKe8oEsk7DnADhi+AQsT9JrYVJcICtgqKLSD5hj1e PFniwLS/eJjFIm5NSIjTrWGUOOjL+KWHosv2xcsOOxbs6WR4IWY7QFxtP/hPxkvhwx4i N5yA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@xen0n.name header.s=mail header.b=ImA3znyX; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id n7-20020a6543c7000000b0056357ea1d1dsi371428pgp.532.2023.08.03.11.59.29; Thu, 03 Aug 2023 11:59:42 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@xen0n.name header.s=mail header.b=ImA3znyX; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S231565AbjHCRJK (ORCPT + 99 others); Thu, 3 Aug 2023 13:09:10 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:32902 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S233351AbjHCRJJ (ORCPT ); Thu, 3 Aug 2023 13:09:09 -0400 Received: from mailbox.box.xen0n.name (mail.xen0n.name [115.28.160.31]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 437B135B7; Thu, 3 Aug 2023 10:09:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=xen0n.name; s=mail; t=1691082541; bh=tDRhfzXpaq1fM0TjibW5Ku2JH48WhEQAG8YGXEYj5Rw=; h=From:To:Cc:Subject:Date:From; b=ImA3znyX3XeTUoqvroanVe5hjFQ93AWdOSWo/9O92RDhSo/eOIFpyVxdyip3ePSb9 KhqkVxFUa13oabUg6hOv+c+Bj00ceDTuoyUolOL/OSzakdVgbdeTfMLD17+3i/+Wvm 4Nk1jVfMwJeuViYZOK5cvU+2UmbCJlZSSXu3anEk= Received: from ld50.lan (unknown [101.88.28.229]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by mailbox.box.xen0n.name (Postfix) with ESMTPSA id A0324600A6; Fri, 4 Aug 2023 01:09:00 +0800 (CST) From: WANG Xuerui To: Song Liu Cc: Huacai Chen , linux-raid@vger.kernel.org, loongarch@lists.linux.dev, linux-kernel@vger.kernel.org, WANG Xuerui Subject: [PATCH v2 0/3] raid5, raid6: Accelerate RAID math with LoongArch SIMD Date: Fri, 4 Aug 2023 01:08:55 +0800 Message-Id: <20230803170858.781245-1-kernel@xen0n.name> X-Mailer: git-send-email 2.40.0 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_BLOCKED, SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org From: WANG Xuerui Hi, Seeing the LoongArch port recently (finally!) gained the ability to use the vector units, I've subsequently ported the RAID5/6 math to LSX and LASX (which are LoongArch's 128-bit and 256-bit SIMD extensions), with nice speedups observed. They are reasonably straight-forward conversions of existing code, and I hope the comments I put in there are helpful enough for anyone not familiar with LoongArch assembly to get a rough picture of how things work here. Performance numbers are included in each commit's commit message. This series needs [1] ("LoongArch: Allow usage of LSX/LASX in the kernel") as a prerequisite, or the vector context would likely get corrupted by the vector-unaware kernel_fpu_{begin,end} calls. I tested the changes on top of next-20230731 with the raid6test build fixes [2] applied, but the series should apply cleanly to v6.5-rc4 (or maybe any other tag) too; it doesn't depend on the raid6test fixes. The base-commit and prerequisite-patch-id info is available for minimally recreating a working configuration for both the kernel and raid6test tool. [1]: https://lore.kernel.org/loongarch/20230722072201.2677516-1-chenhuacai@loongson.cn/ [2]: https://lore.kernel.org/linux-raid/20230731104911.411964-1-kernel@xen0n.name/ Changes in v2 (no functional change): - minor commit message tweaks - changed comment style from // to /* */ throughout WANG Xuerui (3): LoongArch: Add SIMD-optimized XOR routines raid6: Add LoongArch SIMD syndrome calculation raid6: Add LoongArch SIMD recovery implementation arch/loongarch/include/asm/xor.h | 68 ++++ arch/loongarch/include/asm/xor_simd.h | 42 +++ arch/loongarch/lib/Makefile | 3 + arch/loongarch/lib/xor_simd.c | 93 +++++ arch/loongarch/lib/xor_simd.h | 46 +++ arch/loongarch/lib/xor_simd_glue.c | 71 ++++ arch/loongarch/lib/xor_template.c | 110 ++++++ include/linux/raid/pq.h | 4 + lib/raid6/Makefile | 1 + lib/raid6/algos.c | 16 + lib/raid6/loongarch.h | 38 ++ lib/raid6/loongarch_simd.c | 422 +++++++++++++++++++++ lib/raid6/recov_loongarch_simd.c | 515 ++++++++++++++++++++++++++ lib/raid6/test/Makefile | 12 + 14 files changed, 1441 insertions(+) create mode 100644 arch/loongarch/include/asm/xor.h create mode 100644 arch/loongarch/include/asm/xor_simd.h create mode 100644 arch/loongarch/lib/xor_simd.c create mode 100644 arch/loongarch/lib/xor_simd.h create mode 100644 arch/loongarch/lib/xor_simd_glue.c create mode 100644 arch/loongarch/lib/xor_template.c create mode 100644 lib/raid6/loongarch.h create mode 100644 lib/raid6/loongarch_simd.c create mode 100644 lib/raid6/recov_loongarch_simd.c base-commit: 5d0c230f1de8c7515b6567d9afba1f196fb4e2f4 prerequisite-patch-id: 85d08a9828893250ae78dbca9d6e6f8dac755f61 prerequisite-patch-id: fe0bba41e0bbc676454365ed16fb13fc0aac6ee0 prerequisite-patch-id: 84ef8212b74e696ce019255bbfd9679d7516f7f7 prerequisite-patch-id: b1f8fc4e4acdaff7f821a9fcbd063475178e037b prerequisite-patch-id: 82aacbf27f249fdefe40dd6bcc712e5795256926 prerequisite-patch-id: ae4e026e18f92ffcc93f6b135a3bd48fbdded39a -- 2.40.0