Received: by 2002:a05:6a10:8c0a:0:0:0:0 with SMTP id go10csp3358230pxb; Sun, 7 Feb 2021 06:42:51 -0800 (PST) X-Google-Smtp-Source: ABdhPJz+yVmDRmF3L2Kn4KIdCCfJGmv6yMrOc+P+BDFGn3tme+NHxKopmoEUxGfdZXpOn2XofVvL X-Received: by 2002:a05:6402:7ce:: with SMTP id u14mr8503141edy.370.1612708971701; Sun, 07 Feb 2021 06:42:51 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1612708971; cv=none; d=google.com; s=arc-20160816; b=AJyTkJabLqgGuAG2XvJL4CrsAvyaOv2D0w8dpZZ/FLGyO4cT8F8hcGTVJT5vifnAS1 AUlhlezjTNwimbJx3+n3k5z0MQMQHCQv2bE6ikU8LEL8/KkSKDbIvk5mg7cKmOYWpcxy GlyTMM+3VJbOr3G1VLPQiE/6rlRb0NGuOb7yIbbtXYRyY3iY6DKPjjaJCN1/hvFg8I8H Q/oojPKCxZ9ptB2hi13Md6+1sgURwiCH/6TG9WlzrZaDcojQeHDMsRaNF/AdwPgfS5cC VKhrgaNhMlPQCwVFLvg5eQlw63Y9j6CwoLnMbvZHjCl4KGto4ei6aIAoNL6Fxr7AhPaC eQpw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from :dkim-signature; bh=+LusXxwTertju33lCOw7SpWeXYclxlP8wqkw1UaGEms=; b=grSmjHFoThLarLXPLzPcnozAXK4bPv7OcY9r08a7cgat5cNYzEdol15ZXOSN2Qd/kY RU7BwpPoeEdJE7VbrtLuLtAlvCoQ1s0qYDltd3Qn33JuNPGupV7ZaXhDb4l6CqlTulLE JCZzaGliLq8s4wj2iuqXIkghkRElVosZJpSeUTc9wvsnYO8wO5SNqzQBCuNZZ7SrGtgl +tiU4Z/atS8HLAVOQuANSa6oZVnMsptP+cdlfaYXB8kokyOPwzWf0C2ME59oYR2Ak8MC AeC1084TFr3dlKOkf4V33ZwKceAnHig+XRdct4LCFZW2mkGPzx7LVvP0pZn6GqmtDJkn at4Q== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=Pk2ChJ3U; spf=pass (google.com: domain of linux-crypto-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-crypto-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id jx12si8939970ejc.173.2021.02.07.06.42.21; Sun, 07 Feb 2021 06:42:51 -0800 (PST) Received-SPF: pass (google.com: domain of linux-crypto-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=Pk2ChJ3U; spf=pass (google.com: domain of linux-crypto-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-crypto-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229795AbhBGOkb (ORCPT + 99 others); Sun, 7 Feb 2021 09:40:31 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:47718 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229491AbhBGOka (ORCPT ); Sun, 7 Feb 2021 09:40:30 -0500 Received: from mail-qt1-x82c.google.com (mail-qt1-x82c.google.com [IPv6:2607:f8b0:4864:20::82c]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id B2D40C061786 for ; Sun, 7 Feb 2021 06:39:49 -0800 (PST) Received: by mail-qt1-x82c.google.com with SMTP id l23so8594340qtq.13 for ; Sun, 07 Feb 2021 06:39:49 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=+LusXxwTertju33lCOw7SpWeXYclxlP8wqkw1UaGEms=; b=Pk2ChJ3U/b2gZjnWdoIqyc4QGBP/viM9zsxlIhS70TUHEj1xqiJhrlZZfH6U/z9sO5 tKZAJXYP3fPuHxs81grSQwkJyqE8zualh7FHBqYQi3w3zPfCSJFWGWeU92h8DoySfIfn qm6oy95p72+9geN9WqQkpEEO6m12GGfbNEdZ1sCz8WTWilhI8l58Js6rTyM2iwJ8o8a5 LImoaAJWr6aZOVeQBPGh2ibjpTRPI1b4TwnnNtxCuovyivjM/mQeefP34YLUx/zz/jrJ x/m/aW89nT/evYNiMxBFradQ/wA9momYKhyP5iU11jyGzj/uqjtT+xnrnOCYD6MYbW6d YT7Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=+LusXxwTertju33lCOw7SpWeXYclxlP8wqkw1UaGEms=; b=sf4hyfPMgAceF95drQjjUN+I6gpsXhHR8jCfruhcMl9RYtaKwNrqmyu+EefbGtnT7y Sm1cDgqj/yBJ1j7mBgHhkDSPMrbOYmNVkOHqn5TS9khD85sle+uViV7PjU4R9tUBYLDK eU0XO1wBzG9SJLZDUX/LedanNIAg2DLWZIwNhixPI3D3HQ45xVg+rIiK5/gGU/VxkA0E DUDwTXEvqRMSvtIDo/vfJ1bZLXSf2m5GD1MUge0mAQ4c7afSCdBOD2umkUC9c5JN499m GoABW0zxM2MAeaZaOK171lNz4HkIaDIvFqlO+gQ2oQij+U4fzbW1oc6XierJB/X7VLQh vlfA== X-Gm-Message-State: AOAM533H73LZNWN30Qfu5xeeshSvQR2FtZU29JVQALTuOxdIPNHIgw8N Zt6DGFN07hh3oZ//i9P5yc8G5g== X-Received: by 2002:ac8:3759:: with SMTP id p25mr2286162qtb.203.1612708788930; Sun, 07 Feb 2021 06:39:48 -0800 (PST) Received: from pop-os.fios-router.home (pool-71-163-245-5.washdc.fios.verizon.net. [71.163.245.5]) by smtp.googlemail.com with ESMTPSA id c81sm13941493qkb.88.2021.02.07.06.39.48 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 07 Feb 2021 06:39:48 -0800 (PST) From: Thara Gopinath To: herbert@gondor.apana.org.au, davem@davemloft.net, bjorn.andersson@linaro.org Cc: ebiggers@google.com, ardb@kernel.org, sivaprak@codeaurora.org, linux-crypto@vger.kernel.org, linux-kernel@vger.kernel.org Subject: [PATCH v6 01/11] crypto: qce: sha: Restore/save ahash state with custom struct in export/import Date: Sun, 7 Feb 2021 09:39:36 -0500 Message-Id: <20210207143946.2099859-2-thara.gopinath@linaro.org> X-Mailer: git-send-email 2.25.1 In-Reply-To: <20210207143946.2099859-1-thara.gopinath@linaro.org> References: <20210207143946.2099859-1-thara.gopinath@linaro.org> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: linux-crypto@vger.kernel.org Export and import interfaces save and restore partial transformation states. The partial states were being stored and restored in struct sha1_state for sha1/hmac(sha1) transformations and sha256_state for sha256/hmac(sha256) transformations.This led to a bunch of corner cases where improper state was being stored and restored. A few of the corner cases that turned up during testing are: - wrong byte_count restored if export/import is called twice without h/w transaction in between - wrong buflen restored back if the pending buffer length is exactly the block size. - wrong state restored if buffer length is 0. To fix these issues, save and restore the partial transformation state using the newly introduced qce_sha_saved_state struct. This ensures that all the pieces required to properly restart the transformation is captured and restored back Signed-off-by: Thara Gopinath --- drivers/crypto/qce/sha.c | 122 +++++++++++---------------------------- 1 file changed, 34 insertions(+), 88 deletions(-) diff --git a/drivers/crypto/qce/sha.c b/drivers/crypto/qce/sha.c index 61c418c12345..7da562dca740 100644 --- a/drivers/crypto/qce/sha.c +++ b/drivers/crypto/qce/sha.c @@ -12,9 +12,15 @@ #include "core.h" #include "sha.h" -/* crypto hw padding constant for first operation */ -#define SHA_PADDING 64 -#define SHA_PADDING_MASK (SHA_PADDING - 1) +struct qce_sha_saved_state { + u8 pending_buf[QCE_SHA_MAX_BLOCKSIZE]; + u8 partial_digest[QCE_SHA_MAX_DIGESTSIZE]; + __be32 byte_count[2]; + unsigned int pending_buflen; + unsigned int flags; + u64 count; + bool first_blk; +}; static LIST_HEAD(ahash_algs); @@ -139,97 +145,37 @@ static int qce_ahash_init(struct ahash_request *req) static int qce_ahash_export(struct ahash_request *req, void *out) { - struct crypto_ahash *ahash = crypto_ahash_reqtfm(req); struct qce_sha_reqctx *rctx = ahash_request_ctx(req); - unsigned long flags = rctx->flags; - unsigned int digestsize = crypto_ahash_digestsize(ahash); - unsigned int blocksize = - crypto_tfm_alg_blocksize(crypto_ahash_tfm(ahash)); - - if (IS_SHA1(flags) || IS_SHA1_HMAC(flags)) { - struct sha1_state *out_state = out; - - out_state->count = rctx->count; - qce_cpu_to_be32p_array((__be32 *)out_state->state, - rctx->digest, digestsize); - memcpy(out_state->buffer, rctx->buf, blocksize); - } else if (IS_SHA256(flags) || IS_SHA256_HMAC(flags)) { - struct sha256_state *out_state = out; - - out_state->count = rctx->count; - qce_cpu_to_be32p_array((__be32 *)out_state->state, - rctx->digest, digestsize); - memcpy(out_state->buf, rctx->buf, blocksize); - } else { - return -EINVAL; - } - - return 0; -} - -static int qce_import_common(struct ahash_request *req, u64 in_count, - const u32 *state, const u8 *buffer, bool hmac) -{ - struct crypto_ahash *ahash = crypto_ahash_reqtfm(req); - struct qce_sha_reqctx *rctx = ahash_request_ctx(req); - unsigned int digestsize = crypto_ahash_digestsize(ahash); - unsigned int blocksize; - u64 count = in_count; - - blocksize = crypto_tfm_alg_blocksize(crypto_ahash_tfm(ahash)); - rctx->count = in_count; - memcpy(rctx->buf, buffer, blocksize); - - if (in_count <= blocksize) { - rctx->first_blk = 1; - } else { - rctx->first_blk = 0; - /* - * For HMAC, there is a hardware padding done when first block - * is set. Therefore the byte_count must be incremened by 64 - * after the first block operation. - */ - if (hmac) - count += SHA_PADDING; - } + struct qce_sha_saved_state *export_state = out; - rctx->byte_count[0] = (__force __be32)(count & ~SHA_PADDING_MASK); - rctx->byte_count[1] = (__force __be32)(count >> 32); - qce_cpu_to_be32p_array((__be32 *)rctx->digest, (const u8 *)state, - digestsize); - rctx->buflen = (unsigned int)(in_count & (blocksize - 1)); + memcpy(export_state->pending_buf, rctx->buf, rctx->buflen); + memcpy(export_state->partial_digest, rctx->digest, sizeof(rctx->digest)); + export_state->byte_count[0] = rctx->byte_count[0]; + export_state->byte_count[1] = rctx->byte_count[1]; + export_state->pending_buflen = rctx->buflen; + export_state->count = rctx->count; + export_state->first_blk = rctx->first_blk; + export_state->flags = rctx->flags; return 0; } static int qce_ahash_import(struct ahash_request *req, const void *in) { - struct qce_sha_reqctx *rctx; - unsigned long flags; - bool hmac; - int ret; - - ret = qce_ahash_init(req); - if (ret) - return ret; - - rctx = ahash_request_ctx(req); - flags = rctx->flags; - hmac = IS_SHA_HMAC(flags); - - if (IS_SHA1(flags) || IS_SHA1_HMAC(flags)) { - const struct sha1_state *state = in; - - ret = qce_import_common(req, state->count, state->state, - state->buffer, hmac); - } else if (IS_SHA256(flags) || IS_SHA256_HMAC(flags)) { - const struct sha256_state *state = in; + struct qce_sha_reqctx *rctx = ahash_request_ctx(req); + const struct qce_sha_saved_state *import_state = in; - ret = qce_import_common(req, state->count, state->state, - state->buf, hmac); - } + memset(rctx, 0, sizeof(*rctx)); + rctx->count = import_state->count; + rctx->buflen = import_state->pending_buflen; + rctx->first_blk = import_state->first_blk; + rctx->flags = import_state->flags; + rctx->byte_count[0] = import_state->byte_count[0]; + rctx->byte_count[1] = import_state->byte_count[1]; + memcpy(rctx->buf, import_state->pending_buf, rctx->buflen); + memcpy(rctx->digest, import_state->partial_digest, sizeof(rctx->digest)); - return ret; + return 0; } static int qce_ahash_update(struct ahash_request *req) @@ -450,7 +396,7 @@ static const struct qce_ahash_def ahash_def[] = { .drv_name = "sha1-qce", .digestsize = SHA1_DIGEST_SIZE, .blocksize = SHA1_BLOCK_SIZE, - .statesize = sizeof(struct sha1_state), + .statesize = sizeof(struct qce_sha_saved_state), .std_iv = std_iv_sha1, }, { @@ -459,7 +405,7 @@ static const struct qce_ahash_def ahash_def[] = { .drv_name = "sha256-qce", .digestsize = SHA256_DIGEST_SIZE, .blocksize = SHA256_BLOCK_SIZE, - .statesize = sizeof(struct sha256_state), + .statesize = sizeof(struct qce_sha_saved_state), .std_iv = std_iv_sha256, }, { @@ -468,7 +414,7 @@ static const struct qce_ahash_def ahash_def[] = { .drv_name = "hmac-sha1-qce", .digestsize = SHA1_DIGEST_SIZE, .blocksize = SHA1_BLOCK_SIZE, - .statesize = sizeof(struct sha1_state), + .statesize = sizeof(struct qce_sha_saved_state), .std_iv = std_iv_sha1, }, { @@ -477,7 +423,7 @@ static const struct qce_ahash_def ahash_def[] = { .drv_name = "hmac-sha256-qce", .digestsize = SHA256_DIGEST_SIZE, .blocksize = SHA256_BLOCK_SIZE, - .statesize = sizeof(struct sha256_state), + .statesize = sizeof(struct qce_sha_saved_state), .std_iv = std_iv_sha256, }, }; -- 2.25.1