Received: by 2002:ac0:a5a7:0:0:0:0:0 with SMTP id m36-v6csp6539921imm; Mon, 23 Jul 2018 21:27:47 -0700 (PDT) X-Google-Smtp-Source: AAOMgpdc2Tu4bdXGe++fjzGSP6JMq2dO8NunaoljL56hVEpIbLIngcRyNaGlSBmSn4vNSnfD0tkR X-Received: by 2002:a63:c252:: with SMTP id l18-v6mr14852503pgg.76.1532406467106; Mon, 23 Jul 2018 21:27:47 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1532406467; cv=none; d=google.com; s=arc-20160816; b=gs/Kz19NLsdzXrJZgLVEZtzCuM05MgEpr8JZSxQa0UWOgk1OF4cWpwAYyg+UCszVw/ 8Qs13R9rZUyaXlq+wQYAflIi0lAFDSGEl2B4o32PzNU5yyQaHsv1WHDdzjI40Gftnp+s 7gh0Rxxiv9bIJcXj9VXXtJHPKE022q8DbI8qE059LI7mSSppkgDoLJvbREQzQPzHqmCe oJk5N8mH9JcYMU+VzC6a6owwO6RSWLUbUkohqgO1ADJmWoXGEDdq+AeGUz+DAVCRYgLa ks/cTJukCFpR317Ku9pgmJ8t/uD4xBoD+/gvWnmcC4P+B+sxpaRg+c0hJzEzmIbbdSQa A7jw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-disposition:mime-version:references:message-id:subject:cc :to:from:date:dkim-signature:arc-authentication-results; bh=6lTIw9y1GXBJmo2GmyDvhhRu707mLcJa8v3k4TNTwkM=; b=KXkugKDAS137QZb/Qt7SriTdsZo/8aiDCiumn9vydL+2xXvF9UmKo2zdtmrTHJMFLb bCKN2vzc9gh5aQpozkauCExEkfmNUOh/z7Tvf6tDslMSqmldVlH9ZotLyYDwxChEsJcW zFuiMpciRK58F9y6rhmyXdg/HaKgkqixxQLW4R8+y5nYrQpiyc+U2TcjLXk+PeB0b462 v+0XrfotvOcvxTyWNLIxUfoOSQ534yHIHTlN8uflpelw3HReBedxtyPhb2ZAH0TfU9ZZ bc2fxwPW4eFn9/ErYtdUnMV61G8ibaudrCR1mUibNHUDerH2w9UQuJ8xWYtzzqR3axqh 5YaA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=MfGfn396; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id u184-v6si9287654pgd.31.2018.07.23.21.27.30; Mon, 23 Jul 2018 21:27:47 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=MfGfn396; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S2388473AbeGXFbK (ORCPT + 99 others); Tue, 24 Jul 2018 01:31:10 -0400 Received: from mail-pl0-f65.google.com ([209.85.160.65]:36873 "EHLO mail-pl0-f65.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S2388236AbeGXFbJ (ORCPT ); Tue, 24 Jul 2018 01:31:09 -0400 Received: by mail-pl0-f65.google.com with SMTP id 31-v6so1156924plc.4; Mon, 23 Jul 2018 21:26:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=6lTIw9y1GXBJmo2GmyDvhhRu707mLcJa8v3k4TNTwkM=; b=MfGfn396n1kDEmGZ5av/vd1862PdIMKGfulm1ffguCGZZaiZ9IEraiYgfGGXVq2kWo MKbU24eaat52zv6tOpYV8AfzX2edhVQEbs7KQQFWmoIma/uLtzRc/Q4rKjgI8pnJBeSR p3Pietsr0JgBzrMuOHemeAwExlASt4pPqzTKAcIHLuFUyy9cch4a8t45ufF2etRD/hoZ 7AArJyzDpD4e3G5Oj/lRHtHewPhrWUb+hjtW5DiWGV5zc31nCaWXVF3bRqoGRybibSWx NQ/+SdW9ApljxzGLviC8k2STv+/84+PqxUhIgPEH3/NPaIMvIOFI144U7P9bwuU3+o5t ZzNQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to:user-agent; bh=6lTIw9y1GXBJmo2GmyDvhhRu707mLcJa8v3k4TNTwkM=; b=L/4G5giX0572Q+tQX3UD3X0kJUXz/FGkaTf7PgUVj7anDpn134c0qXc6B7TjoqL3ag BhwBFmEIAtt7qXUStp+0q0trx13rJfnzMy6umL4EFOP7aGpWNznE2CXQevnzQkkkMkkJ nf/zzp1a3f9obf2Fs7+jKvkKUcSK3V+JtAI3QNbUpZAFyZyWIBYSHP2Sn1iCMS2eV415 5HDDgpLwT92f5+0jjMy3Qz05UxRkAHtBCK6qDFKn/eWyhgQk803l2NhUoC0ItIHtSpxQ iDzTF1oAyFXXKWdVeKv++raKYTwZ/qQ2GJ7uxuPepIHEi4XHtZX6MSViYz1/oyOUtMqd ggtQ== X-Gm-Message-State: AOUpUlHvqzJ0JnMLOxGVjF+Ewmy27fijBTxIu4melRJSPQpBj9pgcPnF 2u8MiD8mnYajXqMhI0aad34= X-Received: by 2002:a17:902:bd4b:: with SMTP id b11-v6mr15031912plx.243.1532406399670; Mon, 23 Jul 2018 21:26:39 -0700 (PDT) Received: from sol.localdomain (c-67-185-97-198.hsd1.wa.comcast.net. [67.185.97.198]) by smtp.gmail.com with ESMTPSA id u1-v6sm20753390pgk.25.2018.07.23.21.26.38 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Mon, 23 Jul 2018 21:26:39 -0700 (PDT) Date: Mon, 23 Jul 2018 21:26:37 -0700 From: Eric Biggers To: Coly Li Cc: linux-kernel@vger.kernel.org, linux-bcache@vger.kernel.org, linux-block@vger.kernel.org, Andy Shevchenko , Greg Kroah-Hartman , Michael Lyle , Kent Overstreet , Linus Torvalds , Thomas Gleixner , Kate Stewart , Andrew Morton , Randy Dunlap Subject: Re: [PATCH v4 1/3] lib: add crc64 calculation routines Message-ID: <20180724042637.GA1944@sol.localdomain> References: <20180718165545.1622-1-colyli@suse.de> <20180718165545.1622-2-colyli@suse.de> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20180718165545.1622-2-colyli@suse.de> User-Agent: Mutt/1.10.1 (2018-07-13) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, Jul 19, 2018 at 12:55:43AM +0800, Coly Li wrote: > This patch adds the re-write crc64 calculation routines for Linux kernel. > The CRC64 polynomical arithmetic follows ECMA-182 specification, inspired "polynomical" => "polynomial". Same everywhere else in the patches. > + * crc64table[256] is the lookup table of a table-driver 64-bit CRC "table-driver" => "table-driven" > + * calculation, which is generated by gen_crc64table.c in kernel build > + * time. The polynomial of crc64 arithmetic is from ECMA-182 specification > + * as well, which is defined as, > + * > + * x^64 + x^62 + x^57 + x^55 + x^54 + x^53 + x^52 + x^47 + x^46 + x^45 + > + * x^40 + x^39 + x^38 + x^37 + x^35 + x^33 + x^32 + x^31 + x^29 + x^27 + > + * x^24 + x^23 + x^22 + x^21 + x^19 + x^17 + x^13 + x^12 + x^10 + x^9 + > + * x^7 + x^4 + x + 1 > + * > + * Copyright 2018 SUSE Linux. > + * Author: Coly Li > + */ > + > +#include > +#include > +#include "crc64table.h" > + > +MODULE_DESCRIPTION("CRC64 calculations"); > +MODULE_LICENSE("GPL v2"); > + > +/** > + * crc64_be - Calculate bitwise big-endian ECMA-182 CRC64 > + * @crc: seed value for computation. 0 for a new CRC computing, or the > + * previous crc64 value if computing incrementally. "0 or (u64)~0 for a new CRC calculation". Both conventions are common in CRCs. In fact the all-ones convention is generally considered better, because it causes leading zeroes in the data to affect the checksum. > + * @p: pointer to buffer over which CRC64 is run > + * @len: length of buffer @p > + */ > +u64 __pure crc64_be(u64 crc, const void *p, size_t len) > +{ > + size_t i, t; > + > + const unsigned char *_p = p; > + > + for (i = 0; i < len; i++) { > + t = ((crc >> 56) ^ (*_p++)) & 0xFF; > + crc = crc64table[t] ^ (crc << 8); > + } > + > + return crc; > +} > +EXPORT_SYMBOL_GPL(crc64_be); > diff --git a/lib/gen_crc64table.c b/lib/gen_crc64table.c > new file mode 100644 > index 000000000000..8296b0c3ea30 > --- /dev/null > +++ b/lib/gen_crc64table.c > @@ -0,0 +1,68 @@ > +// SPDX-License-Identifier: GPL-2.0 > +/* > + * Generate lookup table for the talbe-driven CRC64 calculation. "talbe-driven" => "table-driven" > + * > + * gen_crc64table is executed in kernel build time and generates > + * lib/crc64table.h. This header is included by lib/crc64.c for > + * the table-driver CRC64 calculation. "table-driver" => "table-driven" > + * > + * See lib/crc64.c for more information about which specification > + * and polynomical arithmetic that gen_crc64table.c follows to > + * generate the lookup table. > + * > + * Copyright 2018 SUSE Linux. > + * Author: Coly Li > + */ > +#include > +#include > + > +#include > + > +#define CRC64_ECMA182_POLY 0x42F0E1EBA9EA3693ULL > + > +static int64_t crc64_table[256] = {0}; This really should be uint64_t, not int64_t. > + > +static void generate_crc64_table(void) > +{ > + uint64_t i, j, c, crc; > + > + for (i = 0; i < 256; i++) { > + crc = 0; > + c = i << 56; > + > + for (j = 0; j < 8; j++) { > + if ((crc ^ c) & 0x8000000000000000ULL) > + crc = (crc << 1) ^ CRC64_ECMA182_POLY; > + else > + crc <<= 1; > + c <<= 1; > + } > + > + crc64_table[i] = crc; > + } > +} > + > +static void print_crc64_table(void) > +{ > + int i; > + > + printf("/* this file is generated - do not edit */\n\n"); > + printf("#include \n"); > + printf("#include \n\n"); > + printf("static const u64 ____cacheline_aligned crc64table[256] = {\n"); > + for (i = 0; i < 256; i++) { > + printf("\t0x%016" PRIx64 "ULL", crc64_table[i]); > + if (i & 0x1) > + printf(",\n"); > + else > + printf(", "); > + } > + printf("};\n"); > +} > + > +int main(int argc, char *argv[]) > +{ > + generate_crc64_table(); > + print_crc64_table(); > + return 0; > +} > -- > 2.17.1 > - Eric