Received: by 2002:a25:7ec1:0:0:0:0:0 with SMTP id z184csp3018085ybc; Mon, 25 Nov 2019 07:46:25 -0800 (PST) X-Google-Smtp-Source: APXvYqyvcEh+r3EeD2VzT4uj3InHokMkaxqXkojRs/d8dblZZfJwU10KIftd1JWK9zxf4KHw6Tvg X-Received: by 2002:a17:906:3ec2:: with SMTP id d2mr38654601ejj.251.1574696785643; Mon, 25 Nov 2019 07:46:25 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1574696785; cv=none; d=google.com; s=arc-20160816; b=S1Q+6SdoenDnmsHAA+/HnV5rgF70XZqXxnkM1pMqLkpO0scf6jg9eWqQmWdr3MW54X FgtFUVLgkigbG1nE0eUhn4Vv0la9f7pgcnOuK8NWQ/VJmROEHrCzR4pSAEcydheVtoMq nK/+3zbo8L14oKD6n5h0RQznPGDSNgyGpOOXjQ7GzV2dFlQZ3xrFxmzF7Epidd3It0oU zW3A3vnDW2S8XBdbK4Tl391tcpFE7NzSykMzCepnav/GcGXTm45esLbPlh/w8/LUp4eU WuBPG+7PkIJ7GCwQmgJljgAmYuPQu93fYpXm66slCLdfPCQFDsMGSNeTsGh6ylU9uBpz PB9A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:references:in-reply-to:message-id:date :subject:cc:to:from:dkim-signature; bh=Cn7Acy4bXdw4I7UPGoubYywoFCuVCjkXestVLP2CdH0=; b=JQo6jzK/QHyUwZETmNrE1LMceTOfhDy/tGRNGMjCzrN5wiFOpK+d+TCjrALzLuw+fW cVGoJLpD+uOC02H+aJcNGo+CfNln1OH4u4X0dfSrh12pzoADtPXd84Q6kD4WajQEO6FV crpcEtHvoQxK/YbWEoqML9XS1VP+MD+dZi62kIy0t5enh8HaBqMOOhGy0lnkTmcm1WK2 g3A0NVjvQJjdDZboK7cwEOUcUtoFuilLjA3nHjB9Cl7OPx3cegqyaXt3DyfnyAtYfeVB E4aR4DBzzuDgOOTqZTlOdTcyM0jZt1c2kss7Rx8BKBTD3i8WAorLr1idn2qPhA68hbmk G8Ag== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@kernel.org header.s=default header.b=RuekJ8cI; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id j10si5257455eds.133.2019.11.25.07.46.01; Mon, 25 Nov 2019 07:46:25 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=default header.b=RuekJ8cI; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728603AbfKYPms (ORCPT + 99 others); Mon, 25 Nov 2019 10:42:48 -0500 Received: from mail.kernel.org ([198.145.29.99]:50832 "EHLO mail.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1728539AbfKYPms (ORCPT ); Mon, 25 Nov 2019 10:42:48 -0500 Received: from linux-8ccs.suse.de (x2f7fc62.dyn.telefonica.de [2.247.252.98]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id BEEB520863; Mon, 25 Nov 2019 15:42:44 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1574696566; bh=31hwX5FlIH4Z/8XfoZnrO8gvL1IYJqygriQnXw6MWfQ=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=RuekJ8cIfpFCMo1LQPL2FqJuAZZpeyWrls9vqZvw9DOJ/uarAfdZzlBR8XVX+baLo zFNthnknsNZw5ITS3txBxz5QV8EmSlS/m+0/LnEowcEQftvThYXmcFNqt/HDZjtpjy 3aHoYYt2P/ChXUbkYA1nS4PIfHKguRukPfvqPwjg= From: Jessica Yu To: linux-kernel@vger.kernel.org Cc: Matthias Maennich , Masahiro Yamada , Rasmus Villemoes , Arnd Bergmann , Greg Kroah-Hartman , Jessica Yu Subject: [PATCH v2] export.h: reduce __ksymtab_strings string duplication by using "MS" section flags Date: Mon, 25 Nov 2019 16:42:17 +0100 Message-Id: <20191125154217.18640-1-jeyu@kernel.org> X-Mailer: git-send-email 2.16.4 In-Reply-To: <20191120145110.8397-1-jeyu@kernel.org> References: <20191120145110.8397-1-jeyu@kernel.org> Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Commit c3a6cf19e695 ("export: avoid code duplication in include/linux/export.h") refactors export.h quite nicely, but introduces a slight increase in memory usage due to using the empty string "" instead of NULL to indicate that an exported symbol has no namespace. As mentioned in that commit, this meant an increase of 1 byte per exported symbol without a namespace. For example, if a kernel configuration has about 10k exported symbols, this would mean that the size of __ksymtab_strings would increase by roughly 10kB. We can alleviate this situation by utilizing the SHF_MERGE and SHF_STRING section flags. SHF_MERGE|SHF_STRING indicate to the linker that the data in the section are null-terminated strings that can be merged to eliminate duplication. More specifically, from the binutils documentation - "for sections with both M and S, a string which is a suffix of a larger string is considered a duplicate. Thus "def" will be merged with "abcdef"; A reference to the first "def" will be changed to a reference to "abcdef"+3". Thus, all the empty strings would be merged as well as any strings that can be merged according to the cited method above. For example, "memset" and "__memset" would be merged to just "__memset" in __ksymtab_strings. As of v5.4-rc5, the following statistics were gathered with x86 defconfig with approximately 10.7k exported symbols. Size of __ksymtab_strings in vmlinux: ------------------------------------- v5.4-rc5: 213834 bytes v5.4-rc5 with commit c3a6cf19e695: 224455 bytes v5.4-rc5 with this patch: 205759 bytes So, we already see memory savings of ~8kB compared to vanilla -rc5 and savings of nearly 18.7kB compared to -rc5 with commit c3a6cf19e695 on top. Unfortunately, as of this writing, strings will not get deduplicated for kernel modules, as ld does not do the deduplication for SHF_MERGE|SHF_STRINGS sections for relocatable files (ld -r), which kernel modules are. A patch for ld is currently being worked on to hopefully allow for string deduplication in relocatable files in the future. Suggested-by: Rasmus Villemoes Signed-off-by: Jessica Yu --- v2: use %progbits throughout and document the oddity in a comment. include/asm-generic/export.h | 8 +++++--- include/linux/export.h | 27 +++++++++++++++++++++------ 2 files changed, 26 insertions(+), 9 deletions(-) diff --git a/include/asm-generic/export.h b/include/asm-generic/export.h index fa577978fbbd..23bc98e97a66 100644 --- a/include/asm-generic/export.h +++ b/include/asm-generic/export.h @@ -26,9 +26,11 @@ .endm /* - * note on .section use: @progbits vs %progbits nastiness doesn't matter, - * since we immediately emit into those sections anyway. + * note on .section use: we specify progbits since usage of the "M" (SHF_MERGE) + * section flag requires it. Use '%progbits' instead of '@progbits' since the + * former apparently works on all arches according to the binutils source. */ + .macro ___EXPORT_SYMBOL name,val,sec #ifdef CONFIG_MODULES .globl __ksymtab_\name @@ -37,7 +39,7 @@ __ksymtab_\name: __put \val, __kstrtab_\name .previous - .section __ksymtab_strings,"a" + .section __ksymtab_strings,"aMS",%progbits,1 __kstrtab_\name: .asciz "\name" .previous diff --git a/include/linux/export.h b/include/linux/export.h index 201262793369..3d835ca34d33 100644 --- a/include/linux/export.h +++ b/include/linux/export.h @@ -81,16 +81,31 @@ struct kernel_symbol { #else +/* + * note on .section use: we specify progbits since usage of the "M" (SHF_MERGE) + * section flag requires it. Use '%progbits' instead of '@progbits' since the + * former apparently works on all arches according to the binutils source. + */ +#define __KSTRTAB_ENTRY(sym) \ + asm(" .section \"__ksymtab_strings\",\"aMS\",%progbits,1 \n" \ + "__kstrtab_" #sym ": \n" \ + " .asciz \"" #sym "\" \n" \ + " .previous \n") + +#define __KSTRTAB_NS_ENTRY(sym, ns) \ + asm(" .section \"__ksymtab_strings\",\"aMS\",%progbits,1 \n" \ + "__kstrtabns_" #sym ": \n" \ + " .asciz " #ns " \n" \ + " .previous \n") + /* For every exported symbol, place a struct in the __ksymtab section */ #define ___EXPORT_SYMBOL(sym, sec, ns) \ extern typeof(sym) sym; \ + extern const char __kstrtab_##sym[]; \ + extern const char __kstrtabns_##sym[]; \ __CRC_SYMBOL(sym, sec); \ - static const char __kstrtab_##sym[] \ - __attribute__((section("__ksymtab_strings"), used, aligned(1))) \ - = #sym; \ - static const char __kstrtabns_##sym[] \ - __attribute__((section("__ksymtab_strings"), used, aligned(1))) \ - = ns; \ + __KSTRTAB_ENTRY(sym); \ + __KSTRTAB_NS_ENTRY(sym, ns); \ __KSYMTAB_ENTRY(sym, sec) #endif -- 2.16.4