Received: by 2002:a25:ef43:0:0:0:0:0 with SMTP id w3csp996699ybm; Wed, 27 May 2020 13:16:14 -0700 (PDT) X-Google-Smtp-Source: ABdhPJzP4VroQz07SUSlg6QKWQ0IE8lmC7P62Oz6821uJDsdZAXD7VLcuR64NTzmHziie4b63KSW X-Received: by 2002:a17:906:f53:: with SMTP id h19mr6832ejj.343.1590610574128; Wed, 27 May 2020 13:16:14 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1590610574; cv=none; d=google.com; s=arc-20160816; b=qN5Us2BDMQpjLzs+LceVWjrtiIb2inyB56Hu21dhNiJUt2gaLTvYEaZbcB+Z/Kbh/Z kZw+VgVsm3BbNX33o0PHUp7N6VXszOloQ+AsikB5xDOy8naDy+gAeDV77vLrZZSroY1Q 631zaE6D6s/hCbdGoieRGFDVXL/HL+skU/fFlB+ZL0t26rgJU6AIT+fgOpYfXAvzrevs nTbk8Aezx4FS6uPTm+Xc0BGf0viiJSjCiHYlUCiU+7XkuPr1ah8XzXy0UoFY+sg8zPjg J53eFueZsSbC2w2v7bJ2okah/Hgkmqc/FOJoH83I2kQHRrhiSVvPzCqOfygL510MScKr +ELA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from; bh=m9u7mFgOTYIGFU6buisWi2OfblCmRRfBIj12d3ohqV4=; b=iegxfYu3SEIlwmA60LRHzCYfkqnXxvtrdZgKoCjXBzVDOp/BoZChbFUr73VijUc+E5 t5cOKYc2/R56pymP1eTX3g7DOZfC88f/8rOG6ypVx9OYkDmEV1bN2vyS3cO19AIvi3yU xOTN+1/gueh/30qQ/Fg0rP+GszZSNjvq5ypUArkz7jbc2P+DuF+LSIIX1bR1Yk38DCfB 8239ZJQJOXIPaPIbs5DyTeJYMCneVDrVnHnWBW46wPEmgVRhV6kQQ7lineucnsT1afm+ sbLCnEs8fYf4FL789kN5KQse7NV0LREQidLPOlGukEKKpTYq5twTk0V8S69F78bwF5ix LW2A== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id dx10si2547514ejb.496.2020.05.27.13.15.50; Wed, 27 May 2020 13:16:14 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728639AbgE0ULh (ORCPT + 99 others); Wed, 27 May 2020 16:11:37 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:41444 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1728587AbgE0ULa (ORCPT ); Wed, 27 May 2020 16:11:30 -0400 Received: from Galois.linutronix.de (Galois.linutronix.de [IPv6:2a0a:51c0:0:12e:550::1]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 02F40C03E96E for ; Wed, 27 May 2020 13:11:29 -0700 (PDT) Received: from localhost ([127.0.0.1] helo=flow.W.breakpoint.cc) by Galois.linutronix.de with esmtp (Exim 4.80) (envelope-from ) id 1je2Od-0005ku-Du; Wed, 27 May 2020 22:11:27 +0200 From: Sebastian Andrzej Siewior To: linux-kernel@vger.kernel.org Cc: Peter Zijlstra , Ingo Molnar , Steven Rostedt , Will Deacon , Thomas Gleixner , "Paul E . McKenney" , Linus Torvalds , Matthew Wilcox , Mike Galbraith , Minchan Kim , Nitin Gupta , Sergey Senozhatsky , Sebastian Andrzej Siewior Subject: [PATCH v3 7/7] zram: Use local lock to protect per-CPU data Date: Wed, 27 May 2020 22:11:19 +0200 Message-Id: <20200527201119.1692513-8-bigeasy@linutronix.de> X-Mailer: git-send-email 2.27.0.rc0 In-Reply-To: <20200527201119.1692513-1-bigeasy@linutronix.de> References: <20200527201119.1692513-1-bigeasy@linutronix.de> MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org From: Mike Galbraith The zcomp driver uses per-CPU compression. The per-CPU data pointer is acquired with get_cpu_ptr() which implicitly disables preemption. It allocates memory inside the preempt disabled region which conflicts with the PREEMPT_RT semantics. Replace the implicit preemption control with an explicit local lock. This allows RT kernels to substitute it with a real per CPU lock, which serializes the access but keeps the code section preemptible. On non RT kernels this maps to preempt_disable() as before, i.e. no functional change. [bigeasy: Use local_lock(), description, drop reordering] Cc: Minchan Kim Cc: Nitin Gupta Cc: Sergey Senozhatsky Signed-off-by: Mike Galbraith Signed-off-by: Sebastian Andrzej Siewior --- drivers/block/zram/zcomp.c | 7 +++++-- drivers/block/zram/zcomp.h | 3 +++ 2 files changed, 8 insertions(+), 2 deletions(-) diff --git a/drivers/block/zram/zcomp.c b/drivers/block/zram/zcomp.c index 912e3e63d8a09..5ee8e3fae5516 100644 --- a/drivers/block/zram/zcomp.c +++ b/drivers/block/zram/zcomp.c @@ -110,12 +110,13 @@ ssize_t zcomp_available_show(const char *comp, char *= buf) =20 struct zcomp_strm *zcomp_stream_get(struct zcomp *comp) { - return get_cpu_ptr(comp->stream); + local_lock(&comp->stream->lock); + return this_cpu_ptr(comp->stream); } =20 void zcomp_stream_put(struct zcomp *comp) { - put_cpu_ptr(comp->stream); + local_unlock(&comp->stream->lock); } =20 int zcomp_compress(struct zcomp_strm *zstrm, @@ -159,6 +160,8 @@ int zcomp_cpu_up_prepare(unsigned int cpu, struct hlist= _node *node) int ret; =20 zstrm =3D per_cpu_ptr(comp->stream, cpu); + local_lock_init(&zstrm->lock); + ret =3D zcomp_strm_init(zstrm, comp); if (ret) pr_err("Can't allocate a compression stream\n"); diff --git a/drivers/block/zram/zcomp.h b/drivers/block/zram/zcomp.h index 72c2ee4d843ed..40f6420f4b2e9 100644 --- a/drivers/block/zram/zcomp.h +++ b/drivers/block/zram/zcomp.h @@ -5,8 +5,11 @@ =20 #ifndef _ZCOMP_H_ #define _ZCOMP_H_ +#include =20 struct zcomp_strm { + /* The members ->buffer and ->tfm are protected by ->lock. */ + local_lock_t lock; /* compression/decompression buffer */ void *buffer; struct crypto_comp *tfm; --=20 2.27.0.rc0