Received: by 2002:ad5:4acb:0:0:0:0:0 with SMTP id n11csp3540560imw; Mon, 11 Jul 2022 10:31:42 -0700 (PDT) X-Google-Smtp-Source: AGRyM1s/xd47wNBcE6KDe52JgTkwmqUZs+xRHYMRtmkOUGHXVGAxcK/x0efGTW1t0LFQOolgCBLW X-Received: by 2002:a17:907:6e1c:b0:72b:5b54:bd87 with SMTP id sd28-20020a1709076e1c00b0072b5b54bd87mr4444821ejc.581.1657560702430; Mon, 11 Jul 2022 10:31:42 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1657560702; cv=none; d=google.com; s=arc-20160816; b=b+lm/eflSLqsFnBe4skS6NIqcQ5v4vvE17LelrVaN4CMaWiwURvHLXh/mwAyE9QKeB FQJkpv6aNyTYNNqy7ePEeCNCMyWrFKix4Om7gKXY3lhXc4TREfuAjHLmQ1x0hxYewoLa b1VlI5Wgwrnbw9g2nT/j2ze0gus4Q4z7dtewvIXacyRhPrK6diVHkWq95Tmb5Kt/tFf2 mRO3eihnhv13jYRsTe/buAMqVeBDpmdgZIu9r1MGk+JWeCRF4D0ANSn1iEnjuVrH/N5N QUzqQl8mxlAYduhrGA3ACO6qGPp21b7Q8qPXyU0IjT0L59FqvDhOzh6Dobywff7ujaeK kziQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from :dkim-signature; bh=r5CZMjCHrznhAlDAvMwZi4LrvvAMrjysFI7tqvoFjPg=; b=onmtI2ippn2CyBiyxJytOM0uzOyyRTiHstHNL/Ee24rhUWFfpdVrzR9YNvEmsi8eh2 Eb6jWHJ3Auei8VYVwtohZLN3zncKUlbKId6RXbSfzlLTfgXooVotuNqPOGbRYzSQuV1D YdfqjK2+Qw4eRFwwCMi3BR1yTpnjVlxp/3mVCJ04k7849PjIVU235V49dwtYjjxLHXZU XIKaJYpv7PR8KT4I5VA04/zJO/SYUCITZqSy2HVVGBmLfwN/daQYdSHPzPFXS9lDKbAD Y7E/qVwb4sbyvOec3ondmhzK7m41CzUGBKg2acOrhREA4AzKQia5WULcJlYZu99DfYXH sldQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=QHuEVeJ3; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id sc27-20020a1709078a1b00b0072b394cb930si11660167ejc.784.2022.07.11.10.31.16; Mon, 11 Jul 2022 10:31:42 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=QHuEVeJ3; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S231331AbiGKRRa (ORCPT + 99 others); Mon, 11 Jul 2022 13:17:30 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:53836 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S231347AbiGKRR2 (ORCPT ); Mon, 11 Jul 2022 13:17:28 -0400 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.129.124]) by lindbergh.monkeyblade.net (Postfix) with ESMTP id 742B75245B for ; Mon, 11 Jul 2022 10:17:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1657559846; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=r5CZMjCHrznhAlDAvMwZi4LrvvAMrjysFI7tqvoFjPg=; b=QHuEVeJ3E2HsKTgsIrfib4yRWtfauiey4FK2pibXbpv9qd1/oAel0nZNnYRSiLgiDqaViM 806eH4N1k5jSKI7yoiGdm96AHabuVk/W0woXoxGRSAH60QtGCk8zVjURirQRUwZwdsBao8 lw37MSG0EcUQGcm6dFz/BiCXqldTrKA= Received: from mail-wm1-f72.google.com (mail-wm1-f72.google.com [209.85.128.72]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id us-mta-457-u7wqzL9aNBuaFfNR6vudJQ-1; Mon, 11 Jul 2022 13:17:25 -0400 X-MC-Unique: u7wqzL9aNBuaFfNR6vudJQ-1 Received: by mail-wm1-f72.google.com with SMTP id c126-20020a1c3584000000b003a02fa133ceso2965314wma.2 for ; Mon, 11 Jul 2022 10:17:25 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=r5CZMjCHrznhAlDAvMwZi4LrvvAMrjysFI7tqvoFjPg=; b=0eixBvnQBSCwUr/rsVIeqZEj93D8PLrR2WTo7qB8uGDpWml5a154JIyIVO78sQXgAv x8VMttfwwiK1rFZu3nSWChszHgeywxhuLSuc2kCOmwa+3guw4KqyhPXrUpUHk0RHjZ2Z tNGx9Qh5UVZO743cGd9J6GyCNZ/UTDNRrG9leGdcrgGx3ZQXVVUEwslRy8e8hP1A10WL fmCEvAPdhzB3vM/vJ9LYcJN3EHx9wLqDNzGwYM/MmMqmMEO3WoYowNz25wfm3b7LdrD/ u4dcqm6lVWYLU2RpU8Lwoq9kyScnTruFTblWhHofuuKTx5rHgIo1ethzwsjUnSobaNnK hTdg== X-Gm-Message-State: AJIora/3gGXofoUAttQ5C5BhH5FDZnNPapUqA3Nz10Jm4xNBGsyqC7Az EzRpOpb4kfhOMTA9B5EA4jUr8EY5OMXnMx5ev3asAEYssS/XL9oscChno27lxKch3GSOjp3n4CV SDHN+PfYx9BHFw1rxSzMTHGw= X-Received: by 2002:a05:600c:4f95:b0:3a1:7310:62d8 with SMTP id n21-20020a05600c4f9500b003a1731062d8mr16840455wmq.16.1657559844281; Mon, 11 Jul 2022 10:17:24 -0700 (PDT) X-Received: by 2002:a05:600c:4f95:b0:3a1:7310:62d8 with SMTP id n21-20020a05600c4f9500b003a1731062d8mr16840422wmq.16.1657559844102; Mon, 11 Jul 2022 10:17:24 -0700 (PDT) Received: from localhost (cpc111743-lutn13-2-0-cust979.9-3.cable.virginm.net. [82.17.115.212]) by smtp.gmail.com with ESMTPSA id f13-20020a05600c154d00b003a04d19dab3sm26356809wmg.3.2022.07.11.10.17.22 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 11 Jul 2022 10:17:22 -0700 (PDT) From: Aaron Tomlin To: mcgrof@kernel.org, rostedt@goodmis.org Cc: cl@linux.com, pmladek@suse.com, mbenes@suse.cz, christophe.leroy@csgroup.eu, akpm@linux-foundation.org, linux-kernel@vger.kernel.org, linux-modules@vger.kernel.org, atomlin@atomlin.com, ghalat@redhat.com, oleksandr@natalenko.name, neelx@redhat.com, daniel.thompson@linaro.org, hch@infradead.org, tglx@linutronix.de, adrian.hunter@intel.com, linux-rt-users@vger.kernel.org Subject: [PATCH v3 -next 1/1] module: kallsyms: Ensure preemption in add_kallsyms() with PREEMPT_RT Date: Mon, 11 Jul 2022 18:17:19 +0100 Message-Id: <20220711171719.1244255-2-atomlin@redhat.com> X-Mailer: git-send-email 2.34.3 In-Reply-To: <20220711171719.1244255-1-atomlin@redhat.com> References: <20220711171719.1244255-1-atomlin@redhat.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-3.4 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_LOW, SPF_HELO_NONE,SPF_NONE,T_SCC_BODY_TEXT_LINE autolearn=unavailable autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org The commit 08126db5ff73 ("module: kallsyms: Fix suspicious rcu usage") under PREEMPT_RT=y, disabling preemption introduced an unbounded latency since the loop is not fixed. This change caused a regression since previously preemption was not disabled and we would dereference RCU-protected pointers explicitly. That being said, these pointers cannot change. Before kallsyms-specific data is prepared/or set-up, we ensure that the unformed module is known to be unique i.e. does not already exist (see load_module()). Therefore, we can fix this by using the common and more appropriate RCU flavour as this section of code can be safely preempted. Reported-by: Steven Rostedt Fixes: 08126db5ff73 ("module: kallsyms: Fix suspicious rcu usage") Signed-off-by: Aaron Tomlin --- kernel/module/kallsyms.c | 22 +++++++++++----------- 1 file changed, 11 insertions(+), 11 deletions(-) diff --git a/kernel/module/kallsyms.c b/kernel/module/kallsyms.c index 18c23545b984..77e75bead569 100644 --- a/kernel/module/kallsyms.c +++ b/kernel/module/kallsyms.c @@ -176,14 +176,14 @@ void add_kallsyms(struct module *mod, const struct load_info *info) mod->kallsyms = (void __rcu *)mod->init_layout.base + info->mod_kallsyms_init_off; - preempt_disable(); + rcu_read_lock(); /* The following is safe since this pointer cannot change */ - rcu_dereference_sched(mod->kallsyms)->symtab = (void *)symsec->sh_addr; - rcu_dereference_sched(mod->kallsyms)->num_symtab = symsec->sh_size / sizeof(Elf_Sym); + rcu_dereference(mod->kallsyms)->symtab = (void *)symsec->sh_addr; + rcu_dereference(mod->kallsyms)->num_symtab = symsec->sh_size / sizeof(Elf_Sym); /* Make sure we get permanent strtab: don't use info->strtab. */ - rcu_dereference_sched(mod->kallsyms)->strtab = + rcu_dereference(mod->kallsyms)->strtab = (void *)info->sechdrs[info->index.str].sh_addr; - rcu_dereference_sched(mod->kallsyms)->typetab = mod->init_layout.base + info->init_typeoffs; + rcu_dereference(mod->kallsyms)->typetab = mod->init_layout.base + info->init_typeoffs; /* * Now populate the cut down core kallsyms for after init @@ -193,20 +193,20 @@ void add_kallsyms(struct module *mod, const struct load_info *info) mod->core_kallsyms.strtab = s = mod->data_layout.base + info->stroffs; mod->core_kallsyms.typetab = mod->data_layout.base + info->core_typeoffs; strtab_size = info->core_typeoffs - info->stroffs; - src = rcu_dereference_sched(mod->kallsyms)->symtab; - for (ndst = i = 0; i < rcu_dereference_sched(mod->kallsyms)->num_symtab; i++) { - rcu_dereference_sched(mod->kallsyms)->typetab[i] = elf_type(src + i, info); + src = rcu_dereference(mod->kallsyms)->symtab; + for (ndst = i = 0; i < rcu_dereference(mod->kallsyms)->num_symtab; i++) { + rcu_dereference(mod->kallsyms)->typetab[i] = elf_type(src + i, info); if (i == 0 || is_livepatch_module(mod) || is_core_symbol(src + i, info->sechdrs, info->hdr->e_shnum, info->index.pcpu)) { ssize_t ret; mod->core_kallsyms.typetab[ndst] = - rcu_dereference_sched(mod->kallsyms)->typetab[i]; + rcu_dereference(mod->kallsyms)->typetab[i]; dst[ndst] = src[i]; dst[ndst++].st_name = s - mod->core_kallsyms.strtab; ret = strscpy(s, - &rcu_dereference_sched(mod->kallsyms)->strtab[src[i].st_name], + &rcu_dereference(mod->kallsyms)->strtab[src[i].st_name], strtab_size); if (ret < 0) break; @@ -214,7 +214,7 @@ void add_kallsyms(struct module *mod, const struct load_info *info) strtab_size -= ret + 1; } } - preempt_enable(); + rcu_read_unlock(); mod->core_kallsyms.num_symtab = ndst; } -- 2.34.3