Received: by 2002:a5d:9c59:0:0:0:0:0 with SMTP id 25csp120951iof; Sun, 5 Jun 2022 23:00:35 -0700 (PDT) X-Google-Smtp-Source: ABdhPJygyAQPz7KNfCS/P/GvMJI3VqBaPTAA0WAm0JRBZWHvZuCkQRJKuLy27wC5fmq5aKgS8bFV X-Received: by 2002:a63:56:0:b0:3fd:3447:4e7 with SMTP id 83-20020a630056000000b003fd344704e7mr12123379pga.566.1654495235133; Sun, 05 Jun 2022 23:00:35 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1654495235; cv=none; d=google.com; s=arc-20160816; b=ch+X6nRGZy0BrTeajuy0Kp46gZOXw6ltMF5g7ZUpTUJb0kBdovS6gx9yCIJEpIL/WP qf8kJXzJ1aC12UoG4RjJvRRQezr8PP5KLppm+hcKi9Hft1xfko3/uhr7uyji5w6JYTIt TXfGi538IQMqWsmyzwIAtwQs/2QMPj5X/FrxUodd8wJ6XuqRFjRBIkcn7nB2Paazw1JM PXaTOQH21j8NiIoWmvph81/LRdd1Mjs8DJY2BVFCLIXqyogm1e3bQCc3EmCkgOJM23i9 OGYyn0ZBRO9Uw0hXtKA5SCwJryHpcKB+aw6LMEm+jiKra2fb8eUaFqJqyWIlpM70HzWi 9mjw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=NnfGFE9rpnGX+9bTrl6RV6r/wa/k5nkv7KOySK6aGIY=; b=vMOielrchq29qVZiCWWvs+1b1MMz4/ndkHxyinbOxCjSbjbC6Tj9ULPsrJPD9dzHX8 9z7kg9/RmacxTATMDjBlDaiY3AbrRkyY78Emrbri3yrt2tqWdd6GwCya6wXUDmlpBpEY Hhk1tEHxpQu5ShdlhaXpl8ODqgLHUs96jqg/q8i/O3YFXT90VOcg5nIbAGKvRoDYP/GY KjfTDAIftXXNffBA4f8TIJ0/cZdN+Y+xl8NUP4EoDhbU+SMZULaKB/XYOYNvBUW+W99Z ZCRm1MGZ5aG+JzlVvjsU5UX6hWm2PGBOFWThJ+o634jLEHyKeAlRNb/t7wDUyvQ+fh5a U8gw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20210112 header.b=JKoofcQh; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from lindbergh.monkeyblade.net (lindbergh.monkeyblade.net. [2620:137:e000::1:18]) by mx.google.com with ESMTPS id o17-20020a170902e29100b0016375294933si17246539plc.4.2022.06.05.23.00.33 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 05 Jun 2022 23:00:35 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:18 as permitted sender) client-ip=2620:137:e000::1:18; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20210112 header.b=JKoofcQh; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by lindbergh.monkeyblade.net (Postfix) with ESMTP id 05F4B2FC0E0; Sun, 5 Jun 2022 21:48:47 -0700 (PDT) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S244505AbiFEHjf (ORCPT + 99 others); Sun, 5 Jun 2022 03:39:35 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:58378 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S231497AbiFEHja (ORCPT ); Sun, 5 Jun 2022 03:39:30 -0400 Received: from mail-pl1-x62c.google.com (mail-pl1-x62c.google.com [IPv6:2607:f8b0:4864:20::62c]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 363B4326DD for ; Sun, 5 Jun 2022 00:39:28 -0700 (PDT) Received: by mail-pl1-x62c.google.com with SMTP id h1so9873451plf.11 for ; Sun, 05 Jun 2022 00:39:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=NnfGFE9rpnGX+9bTrl6RV6r/wa/k5nkv7KOySK6aGIY=; b=JKoofcQhkLQxXMTyNH7LnNlZ03La1DQIiiLKLddgZ7SQH9+inM5d/iZT4Svvx3GKZC cUWkSAzEcymrKBCZHW/7v6GETE57SbmMXy1JwEu3F+icwZXVcGQxZ0bjxXfR9uTwWci5 LPoqiE6fuPq8T4xK446YEfg590h99s7N5OiBHZjRJ1+PqkRh5EroWs9z1t3ot2JfKwbu H7MCVi98JleKoqjuhH5nmFguBSDjDTsq90G0EoLaPPksK8jPH87H2Z6vPl7NQzvrYOtl kyKDPMjPcS6+7EWGiWyPsbgxwYTPMV7ytBgi3VlrikGXUPlxkORFzd5eWg5+KeEucnn2 puew== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=NnfGFE9rpnGX+9bTrl6RV6r/wa/k5nkv7KOySK6aGIY=; b=5xbFlNoHrXHNUIklhpcqGt8O0I1WFCZL2pDXoFABpuopY78+QiyxdZasy/JiuJv60H tpNVnZg2LNpTmmFJ6D4dPB1TBontdgMiAz3MS4x0kS4JEQVe7YirDT3JgRkNcxCcRrrW av8lwVBlJxgqdwVEEzFZ8fN3zxHJXU0c8g64PUENVxK078JCtlmQld0McHTNgdvxVeW6 I3fIsLeSWx5qA1dEaYBo/TZibancJTy8EduGF3MiycOqeETJtEv2oK/9c8xDOtYCFxwr 2m+izh/jueog3YAlALk4JKMOx07E8BDPc1f+w0XthlkMaeESoHmIVgiOqkyWFRsoU4lw ffUQ== X-Gm-Message-State: AOAM532LSFyo+/U5PBMiNrgMgp2TpEvAp6T5/ZKnKutnlc4QfZ8qz9py BtOyWzOiUNX8E9hy60jMQlIplGYuRqoaGA== X-Received: by 2002:a17:90b:4b48:b0:1e8:7df8:1e25 with SMTP id mi8-20020a17090b4b4800b001e87df81e25mr49159pjb.186.1654414767585; Sun, 05 Jun 2022 00:39:27 -0700 (PDT) Received: from localhost.localdomain (ec2-13-113-80-70.ap-northeast-1.compute.amazonaws.com. [13.113.80.70]) by smtp.gmail.com with ESMTPSA id v9-20020a17090a0e0900b001e2ebcce5d5sm7787367pje.37.2022.06.05.00.39.25 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 05 Jun 2022 00:39:27 -0700 (PDT) From: Zhang Boyang To: linux-kernel@vger.kernel.org Cc: ferdinand.blomqvist@gmail.com, tglx@linutronix.de, Zhang Boyang Subject: [RFC PATCH] rslib: Replace hard-coded 1 with alpha_to[0] Date: Sun, 5 Jun 2022 15:38:57 +0800 Message-Id: <20220605073857.126497-1-zhangboyang.id@gmail.com> X-Mailer: git-send-email 2.30.2 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-1.7 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,RDNS_NONE, SPF_HELO_NONE,T_SCC_BODY_TEXT_LINE autolearn=no autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Comments for RFC: Hello, I found problems in rslib when I specify `gffunc' as myfunc(x) = bswap_16(gffunc(x)). This patch fixes these problems, please refer to commit message below for details. Since I'm not experienced with GF fields, so I would like to invite people to review my patch. If not using init_rs_non_canonical(), the change is trivial because alpha_to[0] is always 1. So this patch should introduce no regression and safe to merge. The modifications to `test_rslib.c' are not intended to commit, just for showing the idea and a small self-test. It will be removed if this patch is going to be merged. The reason I want to use this `gffunc' is because I'm going to implement Reed-Solomon for BTRFS filesystem. As on-disk-format is little endian, the code of file system must deal with little-endian reed solomon symbols on big-endian machines. One possible approach is to do bswap_16 on every symbol when encoding/decoding, which is not very good. Another approach is to bswap_16 the GF field, so no additional bswap_16 when encoding/decoding is required. This will expose the above problem because gffunc(0) is 0x0100 instead of 0x0001 in that field. Thanks! Best Regards, Zhang Boyang === Currently the rslib allows customizing the finite field by the `gffunc' parameter of init_rs_non_canonical(). However, there are several places in rslib use hard-coded 1 instead of alpha_to[0], leading errors if gffunc(0) != 1. This patch fixes the problem. One of such `gffunc` might be gffunc'(x) = bswap_16(gffunc(x)). This is useful to implement foreign-endian RS coder for 16 bit symbols. Signed-off-by: Zhang Boyang --- lib/reed_solomon/decode_rs.c | 4 ++-- lib/reed_solomon/reed_solomon.c | 4 ++-- lib/reed_solomon/test_rslib.c | 23 ++++++++++++++++++++--- 3 files changed, 24 insertions(+), 7 deletions(-) diff --git a/lib/reed_solomon/decode_rs.c b/lib/reed_solomon/decode_rs.c index 805de84ae83d..6c1d53d1b702 100644 --- a/lib/reed_solomon/decode_rs.c +++ b/lib/reed_solomon/decode_rs.c @@ -104,7 +104,7 @@ decode: memset(&lambda[1], 0, nroots * sizeof(lambda[0])); - lambda[0] = 1; + lambda[0] = alpha_to[0]; if (no_eras > 0) { /* Init lambda to be the erasure locator polynomial */ @@ -198,7 +198,7 @@ memcpy(®[1], &lambda[1], nroots * sizeof(reg[0])); count = 0; /* Number of roots of lambda(x) */ for (i = 1, k = iprim - 1; i <= nn; i++, k = rs_modnn(rs, k + iprim)) { - q = 1; /* lambda[0] is always 0 */ + q = alpha_to[0]; /* lambda[0] is always 0 */ for (j = deg_lambda; j > 0; j--) { if (reg[j] != nn) { reg[j] = rs_modnn(rs, reg[j] + j); diff --git a/lib/reed_solomon/reed_solomon.c b/lib/reed_solomon/reed_solomon.c index bbc01bad3053..bb4f44c8edba 100644 --- a/lib/reed_solomon/reed_solomon.c +++ b/lib/reed_solomon/reed_solomon.c @@ -131,9 +131,9 @@ static struct rs_codec *codec_init(int symsize, int gfpoly, int (*gffunc)(int), rs->iprim = iprim / prim; /* Form RS code generator polynomial from its roots */ - rs->genpoly[0] = 1; + rs->genpoly[0] = rs->alpha_to[0]; for (i = 0, root = fcr * prim; i < nroots; i++, root += prim) { - rs->genpoly[i + 1] = 1; + rs->genpoly[i + 1] = rs->alpha_to[0]; /* Multiply rs->genpoly[] by @**(root + x) */ for (j = i; j > 0; j--) { if (rs->genpoly[j] != 0) { diff --git a/lib/reed_solomon/test_rslib.c b/lib/reed_solomon/test_rslib.c index d9d1c33aebda..1c7fefcc89f2 100644 --- a/lib/reed_solomon/test_rslib.c +++ b/lib/reed_solomon/test_rslib.c @@ -42,9 +42,11 @@ struct etab { int ntrials; }; +#define RS16_GFPOLY 0x1002d + /* List of codes to test */ static struct etab Tab[] = { - {2, 0x7, 1, 1, 1, 100000 }, + /*{2, 0x7, 1, 1, 1, 100000 }, {3, 0xb, 1, 1, 2, 100000 }, {3, 0xb, 1, 1, 3, 100000 }, {3, 0xb, 2, 1, 4, 100000 }, @@ -54,7 +56,8 @@ static struct etab Tab[] = { {7, 0x89, 1, 1, 14, 500 }, {8, 0x11d, 1, 1, 30, 100 }, {8, 0x187, 112, 11, 32, 100 }, - {9, 0x211, 1, 1, 33, 80 }, + {9, 0x211, 1, 1, 33, 80 },*/ + {16,RS16_GFPOLY,1, 1, 33, 100 }, {0, 0, 0, 0, 0, 0}, }; @@ -439,6 +442,19 @@ static int exercise_rs_bc(struct rs_control *rs, struct wspace *ws, return stat.noncw; } + +static int gf_mul(int x) +{ + //printk("x=%04x\n", x); + x = be16_to_cpu(x); + if (x == 0) + return cpu_to_be16(1); + x <<= 1; + if (x & 0x10000) + x ^= RS16_GFPOLY; + x &= 0xFFFF; + return cpu_to_be16(x); +} static int run_exercise(struct etab *e) { int nn = (1 << e->symsize) - 1; @@ -450,7 +466,8 @@ static int run_exercise(struct etab *e) struct wspace *ws; int i; - rsc = init_rs(e->symsize, e->genpoly, e->fcs, e->prim, e->nroots); + //rsc = init_rs(e->symsize, e->genpoly, e->fcs, e->prim, e->nroots); + rsc = init_rs_non_canonical(e->symsize, gf_mul, e->fcs, e->prim, e->nroots); if (!rsc) return retval; -- 2.30.2