Received: by 2002:a05:6a10:206:0:0:0:0 with SMTP id 6csp1046294pxj; Fri, 21 May 2021 05:21:14 -0700 (PDT) X-Google-Smtp-Source: ABdhPJxCGpYo+HjZlbuQdJDDTo7VPU5wSJrjUbkyRH5x1/GQgdq82RPBBQrjyEvwc9gCekY+nolC X-Received: by 2002:a17:906:14c1:: with SMTP id y1mr10319169ejc.481.1621599674640; Fri, 21 May 2021 05:21:14 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1621599674; cv=none; d=google.com; s=arc-20160816; b=L0P4X8YL8LLsuqUXtmmlMH9iRlQT7TIp9J8HostFx6ZqKqUNm4Afca12MSKURjxqnv +Z89EnuqPqrxb4490Sh0sseKJUn+nJHgPxz9s74DSzFTuWiv+COy/mshi2LwqOtwpx4+ TEpegAISHaPWYfxMwAqXq1BtDXa1UTDTMemY/mQmrw/Rzg07d0n/pFXJV9nw1ONOiXBd GUAucL3RtCbXUViBAHgVUN5hwkc17XMElq2iSX05odx3AJiFu4/ifNqrtl+3tGQNMVuV 1XP1FexM2kBuGX5NsEsx4G4K3JTFt6foo0HJ7tXwMrlX55Lw+FTH4l2tt7vf6ewVoPZ0 0CBg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:in-reply-to:content-disposition:mime-version :references:message-id:subject:cc:to:from:date:dkim-signature; bh=C0/mSeupVqWqAXBVr5G9kGpQxNohbXDNfNQ+aqXydZ4=; b=jcKGncB7LFsXTkdtxj4AzSVoINGQWyDI38WiFC0ZshJ757sZXK2SGHruholDmBKtgI sdUe0MZAd0RAOViW4p2dZHfhLHZk+Ihgri+K3UtXiCSXihtK8xFJnlubNKoTeTlQ4XUp a/1CCjH4K0NKhp8qERKMigTT/cW7rI18htMArOCp9NqEHUlsc2nKiptdv5pwCADse2cz 7t7t4eNARGO+dYyMZyHMghSYhSU73kEIwIid8mQe58DeuYPBCFsxWiAKdRrwVoNCH0EC XXIhTDRZl1xUgyM4xWyS2oGZeZtxN6ch7tiHn141fqdpay2zhF4R2vanpHM2v9PaRKBy q6pA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@linuxfoundation.org header.s=korg header.b=pKUnJkSj; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linuxfoundation.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id t16si5416630ejo.378.2021.05.21.05.20.51; Fri, 21 May 2021 05:21:14 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@linuxfoundation.org header.s=korg header.b=pKUnJkSj; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linuxfoundation.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S234273AbhEULOh (ORCPT + 99 others); Fri, 21 May 2021 07:14:37 -0400 Received: from mail.kernel.org ([198.145.29.99]:47310 "EHLO mail.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S233569AbhEULOf (ORCPT ); Fri, 21 May 2021 07:14:35 -0400 Received: by mail.kernel.org (Postfix) with ESMTPSA id E6FE461175; Fri, 21 May 2021 11:13:11 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=linuxfoundation.org; s=korg; t=1621595592; bh=XecTnxnidRExLolqDJJY/zckaN8k3VUJhb3X5jF9uVM=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=pKUnJkSjMi5Wy54HbnwnNUReVRRa/B2BPn0FV4ENTYt+FTAylbh5DLLkDpUG9XkIy ApEk/eF/FyHtpB7DWDlBLDOFZWtNa6JZ66nrfulsklSNZZw5A7kVKUB5XQMpxTOf9Q cGUf1epQNxVOXBG3aQgymN52rhWfl5McXHRVL9T0= Date: Fri, 21 May 2021 13:13:10 +0200 From: Greg Kroah-Hartman To: Lee Jones Cc: Quentin Perret , Masahiro Yamada , open list , Matthias Maennich , Giuliano Procida , kernel-team@android.com Subject: Re: [PATCH] export: Make CRCs robust to symbol trimming Message-ID: References: <20210408180105.2496212-1-qperret@google.com> <20210521110206.GE2549456@dell> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20210521110206.GE2549456@dell> Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Fri, May 21, 2021 at 12:02:06PM +0100, Lee Jones wrote: > On Fri, 21 May 2021, Greg Kroah-Hartman wrote: > > > On Fri, May 21, 2021 at 10:57:44AM +0100, Lee Jones wrote: > > > On Mon, 10 May 2021 at 11:25, Quentin Perret wrote: > > > > > > > Hi, > > > > > > > > On Thursday 08 Apr 2021 at 18:01:05 (+0000), Quentin Perret wrote: > > > > > The CRC calculation done by genksyms is triggered when the parser hits > > > > > EXPORT_SYMBOL*() macros. At this point, genksyms recursively expands the > > > > > types, and uses that as the input for the CRC calculation. In the case > > > > > of forward-declared structs, the type expands to 'UNKNOWN'. Next, the > > > > > result of the expansion of each type is cached, and is re-used when/if > > > > > the same type is seen again for another exported symbol in the file. > > > > > > > > > > Unfortunately, this can cause CRC 'stability' issues when a struct > > > > > definition becomes visible in the middle of a C file. For example, let's > > > > > assume code with the following pattern: > > > > > > > > > > struct foo; > > > > > > > > > > int bar(struct foo *arg) > > > > > { > > > > > /* Do work ... */ > > > > > } > > > > > EXPORT_SYMBOL_GPL(bar); > > > > > > > > > > /* This contains struct foo's definition */ > > > > > #include "foo.h" > > > > > > > > > > int baz(struct foo *arg) > > > > > { > > > > > /* Do more work ... */ > > > > > } > > > > > EXPORT_SYMBOL_GPL(baz); > > > > > > > > > > Here, baz's CRC will be computed using the expansion of struct foo that > > > > > was cached after bar's CRC calculation ('UNKOWN' here). But if > > > > > EXPORT_SYMBOL_GPL(bar) is removed from the file (because of e.g. symbol > > > > > trimming using CONFIG_TRIM_UNUSED_KSYMS), struct foo will be expanded > > > > > late, during baz's CRC calculation, which now has visibility over the > > > > > full struct definition, hence resulting in a different CRC for baz. > > > > > > > > > > This can cause annoying issues for distro kernel (such as the Android > > > > > Generic Kernel Image) which use CONFIG_UNUSED_KSYMS_WHITELIST. Indeed, > > > > > as per the above, adding a symbol to the whitelist can change the CRC of > > > > > symbols that are already kept exported. As such, modules built against a > > > > > kernel with a trimmed ABI may not load against the same kernel built > > > > > with an extended whitelist, even though they are still strictly binary > > > > > compatible. While rebuilding the modules would obviously solve the > > > > > issue, I believe this classifies as an odd genksyms corner case, and it > > > > > gets in the way of kernel updates in the GKI context. > > > > > > > > > > To work around the issue, make sure to keep issuing the > > > > > __GENKSYMS_EXPORT_SYMBOL macros for all trimmed symbols, hence making > > > > > the genksyms parsing insensitive to symbol trimming. > > > > > > > > > > Signed-off-by: Quentin Perret > > > > > > > > Gentle ping. > > > > > > > > Is there anything else I should do in this one? > > > > > > > > > > With Greg's Ack and ~6 weeks on the list, you're probably golden. > > > > > > I *could* pick this up, but seems wrong somehow. > > > > > > Greg, is this something you're prepared to merge? If not, who's the > > > g{uy,al}? > > > > What does get_maintainer.pl show? > > It doesn't [0], which is why I commented in this way. :) > > [0]: > > Jessica Yu (commit_signer:2/5=40%) > Emil Velikov (commit_signer:2/5=40%) > Miroslav Benes (commit_signer:2/5=40%) > Nick Desaulniers (commit_signer:2/5=40%,authored:1/5=20%,added_lines:1/7=14%,removed_lines:1/11=9%) > Greg Kroah-Hartman (commit_signer:1/5=20%) > Quentin Perret (authored:1/5=20%,added_lines:5/7=71%) > Joe Perches (authored:1/5=20%,added_lines:1/7=14%,removed_lines:1/11=9%) > linux-kernel@vger.kernel.org (open list) Bah, ok, fine, I'll scoop it up now :) greg k-h