Received: by 2002:a25:8b12:0:0:0:0:0 with SMTP id i18csp1171966ybl; Tue, 13 Aug 2019 08:26:58 -0700 (PDT) X-Google-Smtp-Source: APXvYqxg5vMfl/8PW11TLoGfFeVbXyl+9umOyuYYtw8WlAvkoCU5LqnyZ5mD1EEgSKvnXT5/OjDT X-Received: by 2002:a62:dbc6:: with SMTP id f189mr23671337pfg.237.1565710018044; Tue, 13 Aug 2019 08:26:58 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1565710018; cv=none; d=google.com; s=arc-20160816; b=b0plrqmuO9OTMDdo5CuKKo/l95eKDDa0EYqETmL6upQdhdet/37QxWNB6BJaQqNKkE xj4AyRYrIeOLkQFAl8j9MYZhSWiWm3L9jGXwzohUsRwxzOqNz8bK5Q1tFT83hMiI1i6B r8uySVjau4XMCOZYMW3FIYQN82mBfx1x/xmfXefhcB9BkqU+zwnMl8kUZpCEu+qa4Roz uAME7TDYw8AoC76ZXDHAssWdtbyXrwDJH+JGpJvl/Fo2VbvqBAVcQSWFXqzkkV3rTymM A0yXozo88xFEjH4lIzhWrpgqQ/Iw0R/IiMdCYnxmunGSKvU0bSCKf+w4Mupdp3t8EBgE JQ7Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:cc:to:from:subject:references :mime-version:message-id:in-reply-to:date:dkim-signature; bh=6PgFwT5ybpsMvR73n2NchUIwCDCLdMXSL/zekwZUPV0=; b=T4EPj0xcnkcdlhESkRRbB+zMSVLFMmeBXW4EDTj1PyI8ZVltAVAsdoo/SG9ezhblPF k5DsAJBSwdEM7/P3ph9pU+f0McZi4/LT0WKu7yIqQAYqz7QNkNgGZ0h08L+sEc1qqrlN Ur2uEyb8PW/JBtA2Krfnkgnj6LUSRPZ+LCVbwjw3mw0uYI5Rg1p6WJFP30iQgejCvGsh di9jo9mRfyawMHroJXEXlMiFwsswEEqizrqbeKujCZEM0iZeL4PcdgDMQfrL+m5uebaU FQQgRJoUCL2Y7bIRHZWB91umH6KG810BdfKBkb678IAsF6OLB+l3jyK3Uqv+gUhNzJ+7 wxKg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@google.com header.s=20161025 header.b=jD9ZzgIf; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id a9si12909527pfn.104.2019.08.13.08.26.42; Tue, 13 Aug 2019 08:26:58 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@google.com header.s=20161025 header.b=jD9ZzgIf; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727592AbfHMMTH (ORCPT + 99 others); Tue, 13 Aug 2019 08:19:07 -0400 Received: from mail-qk1-f201.google.com ([209.85.222.201]:57308 "EHLO mail-qk1-f201.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727327AbfHMMTG (ORCPT ); Tue, 13 Aug 2019 08:19:06 -0400 Received: by mail-qk1-f201.google.com with SMTP id j81so95855188qke.23 for ; Tue, 13 Aug 2019 05:19:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=date:in-reply-to:message-id:mime-version:references:subject:from:to :cc; bh=6PgFwT5ybpsMvR73n2NchUIwCDCLdMXSL/zekwZUPV0=; b=jD9ZzgIfaS51gL704kQ5B3pyAxRwAkFR5KAAxqD03+kRrbNxZasQJhXNSpL5IUD3WC 2DcnSWgyDaPoRPIGpldT8mFFTh+D7IvMFxHm7iTt3sA8pZKFy6cUm7d9XJwv/DbGCbp4 apBL8JeZNEGLLuEGK/kJMrUVLy5ehYl2bswCIbpRo4AUdG9z8T7qN7EYG2g6iDYunndi bgvRTsfFKIeh+lV0TGQh07MMCHE7knk8t4nlw97npIIZj92U8RBDn5AI9/CVxQe6kk0P ifVqrzVa67t41udCVDvV3Mua+k4Gh9mqtC5Z6kseL7iHwIkqxHgzBvcScP5+7WLk7K57 pDSw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:in-reply-to:message-id:mime-version :references:subject:from:to:cc; bh=6PgFwT5ybpsMvR73n2NchUIwCDCLdMXSL/zekwZUPV0=; b=mMsZeiEGDXObKpNICoP1Pr827J15gdZFfclA/CJn4Xp90ExHFGjp1bvk4UHVDWz17u tinerdFfTmHF53JGGdAU4CzZ3dkGinpZDUC8fi6TuQ3MDMdUSw9Fj4itpX2MthA/rfg2 CKt64xjD7vXPHtui8LV02vunPiFHEbuv57KR4JGw6lalmtZ5pLsYmsfLMrxnUCt1Iz+z mMVuJWtjpiKiQzAslTiwQASx/tMT2QpmrZdmulY4Hh9IuZiuneQjBngU594uXPWYv/iJ XxkHWlkXW0ltTN7cZqPsITUAZjw3w5CSGk/oXLm1S4ISlrRkpH4E6FBTC9nbQhXlCCey yG9A== X-Gm-Message-State: APjAAAXdSNQM/0ielzCwxibsqFyFIgWEFaio8sbqGGLLbJTdvLsqEHm8 7NtwOfr7EgX4F+epTTYvtycloIMARigklRLIgiR1SUKA8ZyyN4NPecaGiGjAIJGEaP9YVdaLWnW V1UbjHt1x7xBj9VEdjseVYnIDRb2RhGqVMalOxWHtuS4Xnn1DtmFu7O/8RW8vVJdVj7UspeAplf s= X-Received: by 2002:a0c:e28e:: with SMTP id r14mr11313674qvl.32.1565698744842; Tue, 13 Aug 2019 05:19:04 -0700 (PDT) Date: Tue, 13 Aug 2019 13:16:57 +0100 In-Reply-To: <20180716122125.175792-1-maco@android.com> Message-Id: <20190813121733.52480-1-maennich@google.com> Mime-Version: 1.0 References: <20180716122125.175792-1-maco@android.com> X-Mailer: git-send-email 2.23.0.rc1.153.gdeed80330f-goog Subject: [PATCH v2 0/10] Symbol namespaces - RFC From: Matthias Maennich To: linux-kernel@vger.kernel.org, maco@android.com Cc: kernel-team@android.com, maennich@google.com, arnd@arndb.de, geert@linux-m68k.org, gregkh@linuxfoundation.org, hpa@zytor.com, jeyu@kernel.org, joel@joelfernandes.org, kstewart@linuxfoundation.org, linux-arch@vger.kernel.org, linux-kbuild@vger.kernel.org, linux-m68k@lists.linux-m68k.org, linux-modules@vger.kernel.org, linux-scsi@vger.kernel.org, linux-usb@vger.kernel.org, lucas.de.marchi@gmail.com, maco@google.com, michal.lkml@markovi.net, mingo@redhat.com, oneukum@suse.com, pombredanne@nexb.com, sam@ravnborg.org, sboyd@codeaurora.org, sspatil@google.com, stern@rowland.harvard.edu, tglx@linutronix.de, usb-storage@lists.one-eyed-alien.net, x86@kernel.org, yamada.masahiro@socionext.com, Adrian Reber , Andrew Morton , Ard Biesheuvel , cocci@systeme.lip6.fr, Dan Williams , David Howells , "David S. Miller" , Ingo Molnar , Johannes Weiner , Jonathan Cameron , Mauro Carvalho Chehab , Michael Ellerman , Nicolas Ferre , Patrick Bellasi , Richard Guy Briggs , Will Deacon Content-Type: text/plain; charset="UTF-8" Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org As of Linux 5.3-rc4, there are 31203 [1] exported symbols in the kernel. That is a growth of almost 1000 symbols since 4.17 (30206 [2]). There seems to be some consensus amongst kernel devs that the export surface is too large, and hard to reason about. Generally, these symbols fall in one of these categories: 1) Symbols actually meant for drivers 2) Symbols that are only exported because functionality is split over multiple modules, yet they really shouldn't be used by modules outside of their own subsystem 3) Symbols really only meant for in-tree use When module developers try to upstream their code, it regularly turns out that they are using exported symbols that they really shouldn't be using. This problem is even bigger for drivers that are currently out-of-tree, which may be using many symbols that they shouldn't be using, and that break when those symbols are removed or modified. This patch allows subsystem maintainers to partition their exported symbols into separate namespaces, and module authors to import such namespaces only when needed. This allows subsystem maintainers to more easily limit availability of these namespaced symbols to other parts of the kernel. It can also be used to partition the set of exported symbols for documentation purposes; for example, a set of symbols that is really only used for debugging could be in a "SUBSYSTEM_DEBUG" namespace. I continued the work mainly done by Martijn Coenen. In this v2 the following changes have been introduced compared to v1 of this series: - Rather than adding and evaluating separate sections __knsimport_NS, use modinfo tags to declare the namespaces a module introduces. Adjust modpost and the module loader accordingly. - Also add support for reading multiple modinfo values for the same tag to allow list-like access to modinfo tags. - The macros in export.h have been cleaned up to avoid redundancy in the macro parameters (ns, nspost, nspost2). - The introduction of relative references in the ksymtab entries caused a rework of the macros to accommodate that configuration as well. - Alignment of kernel_symbol in the ksymtab needed to be fixed to allow growing the kernel_symbol struct. - Modpost does now also append the namespace suffix to the symbol entries in Module.symvers. - The configuration option MODULE_ALLOW_MISSING_NAMESPACE_IMPORTS allows relaxing the enforcement of properly declared namespace imports at module loading time. - Symbols can be collectively exported into a namespace by defining DEFAULT_SYMBOL_NAMESPACE in the corresponding Makefile. - The requirement for a very recent coccinelle spatch has been lifted by simplifying the script. - nsdeps does now ensures MODULE_IMPORT_NS statements are sorted when patching the module source files. - Some minor bugs have been addressed in nsdeps to allow it to work with modules that have more than one source file. - The RFC for the usb-storage symbols has been simplified by using DEFAULT_SYMBOL_NAMESPACE=USB_STORAGE rather than explicitly exporting each and every symbol into that new namespace. This patch series was developed against v5.3-rc4. [1] git grep "^EXPORT_SYMBOL\w*(" v5.3-rc4 | wc -l [2] git grep "^EXPORT_SYMBOL\w*(" v4.17 | wc -l Matthias Maennich (10): module: support reading multiple values per modinfo tag export: explicitly align struct kernel_symbol module: add support for symbol namespaces. modpost: add support for symbol namespaces module: add config option MODULE_ALLOW_MISSING_NAMESPACE_IMPORTS export: allow definition default namespaces in Makefiles or sources modpost: add support for generating namespace dependencies scripts: Coccinelle script for namespace dependencies. usb-storage: remove single-use define for debugging RFC: usb-storage: export symbols in USB_STORAGE namespace MAINTAINERS | 5 + Makefile | 12 ++ arch/m68k/include/asm/export.h | 1 - drivers/usb/storage/Makefile | 2 + drivers/usb/storage/alauda.c | 1 + drivers/usb/storage/cypress_atacb.c | 1 + drivers/usb/storage/datafab.c | 1 + drivers/usb/storage/debug.h | 2 - drivers/usb/storage/ene_ub6250.c | 1 + drivers/usb/storage/freecom.c | 1 + drivers/usb/storage/isd200.c | 1 + drivers/usb/storage/jumpshot.c | 1 + drivers/usb/storage/karma.c | 1 + drivers/usb/storage/onetouch.c | 1 + drivers/usb/storage/realtek_cr.c | 1 + drivers/usb/storage/scsiglue.c | 2 +- drivers/usb/storage/sddr09.c | 1 + drivers/usb/storage/sddr55.c | 1 + drivers/usb/storage/shuttle_usbat.c | 1 + drivers/usb/storage/uas.c | 1 + include/asm-generic/export.h | 14 +- include/linux/export.h | 92 +++++++++++-- include/linux/module.h | 2 + init/Kconfig | 14 ++ kernel/module.c | 67 ++++++++- scripts/Makefile.modpost | 4 +- scripts/coccinelle/misc/add_namespace.cocci | 23 ++++ scripts/mod/modpost.c | 144 ++++++++++++++++++-- scripts/mod/modpost.h | 9 ++ scripts/nsdeps | 54 ++++++++ 30 files changed, 421 insertions(+), 40 deletions(-) create mode 100644 scripts/coccinelle/misc/add_namespace.cocci create mode 100644 scripts/nsdeps -- 2.23.0.rc1.153.gdeed80330f-goog