Received: by 2002:ac0:aed5:0:0:0:0:0 with SMTP id t21csp644564imb; Fri, 1 Mar 2019 10:03:33 -0800 (PST) X-Google-Smtp-Source: AHgI3IafouctE4Sv7GaN74+Y9p+My7m/5EEfyMEEmqACz6i3n3dEhVVN65jXYR7kMAhr5/o9i6SD X-Received: by 2002:a62:bd13:: with SMTP id a19mr6749006pff.222.1551463413577; Fri, 01 Mar 2019 10:03:33 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1551463413; cv=none; d=google.com; s=arc-20160816; b=vG7+KZNBHTlaBG9KRUWlMUSSrB9hgv+acPjFWK6ZOsrpNKOeI539QmBK2BPlTK5qdx wrtYcUlrYY30omocjmgi7UPUEkeW8R0l6wvmcHETHZ7vSkYsq21Xm5fcwApHCaAGGjGr 4aYYxOTtb8h9YmEhgQJ4Rcg+8sGYic0Q0GVl7izMRxUhk3eBAxwY5xGos82FGeYDChwj Izb1zo5cmR2VzQLaCJLa5Ogs4Qq18e6wJv8SCT5AxlTAv74ZqH0kgntleceWYe8ROn0E oiA6tTBCrYizEuvtpGNxbI+LtiMyXgDp/dGw6YMAN3o1U7OoFMT5dky3vXMPGDO7PXMA XYaA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-disposition:mime-version:references:message-id:subject:cc :to:from:date:dkim-signature; bh=U/9thOjurA+lIRFK0bp+ZG70JtmlEraTbsN+PJD2O9I=; b=hVFdGhXZeytqefD36JSRmCHvmm3iP+E1iPd0ow8vET6ZK/HfOYpwgzvsslLLUcHKfb 5cC9vxcKQJm4Q7HVdcMeuLxu9jIW1rufPsMsfY6jwbKqwpAorsRNddR7FifyE9f/oXwh yG2ep00fVShphgK9DqggxiwWsMLuNNWEzdpjp75E+amRnf7JI5L4bnBBUnb1EWSLnyfO Ah1yH9jcFPZjio9p/g5bBYOMPnyp8/wRjuD45kWz5rUoLXhrrPjjJjQog0XpbnlqY+fp 6JUymP503kIbGyoOpyqETyiA44RgSbUzUl0V0Uw0jA7k+zKH9aG2bUcuDZsiWdt+N/5o NtWA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@joelfernandes.org header.s=google header.b=Le5Ueu53; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id p22si660121pfd.241.2019.03.01.10.03.15; Fri, 01 Mar 2019 10:03:33 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@joelfernandes.org header.s=google header.b=Le5Ueu53; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S2389420AbfCARWB (ORCPT + 99 others); Fri, 1 Mar 2019 12:22:01 -0500 Received: from mail-qt1-f196.google.com ([209.85.160.196]:43379 "EHLO mail-qt1-f196.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S2388088AbfCARWB (ORCPT ); Fri, 1 Mar 2019 12:22:01 -0500 Received: by mail-qt1-f196.google.com with SMTP id y4so28594245qtc.10 for ; Fri, 01 Mar 2019 09:22:00 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=joelfernandes.org; s=google; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=U/9thOjurA+lIRFK0bp+ZG70JtmlEraTbsN+PJD2O9I=; b=Le5Ueu53kunQMlXpyqwk2e4kYM6t5IvX9AiUfdGQPxrJ+VxZfmHQWHOJuSdMOPIR34 PQ6VZS1rE/d5mtizV/jGDXMz0UYRflhcUPSg5ynGCSn8TDqDFvpGOx85DqwQtavqgkFR +TzA2XnKhu3cb9avBoiHXkJ4xszJSyLbVco+s= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to:user-agent; bh=U/9thOjurA+lIRFK0bp+ZG70JtmlEraTbsN+PJD2O9I=; b=ih1tEKn3OV+vcB905h5nQSgPuwrwXWxqQHErPu8l75TiNPadiqXnGlTivu4dQH8Pue fwUgpggoHzM+PMiMvUNH1ouInqVbX35Chp75I3yMSCt9sf8xmIR2q0pJ3+uTStlHLo8B +F77niH0ZJmlDFsMPNb9V7zN7rOuAKl5OiANJeIMHPqqpmRcrJpN+GNoPHR2DCLy0BJ7 8Pof1lPz2nEh7IRaug6j33nlqyNGzkyhr9nmT+KikwmKqRmi0lNqz+e0hZN2JO8VZJN3 xyu00R3k59tKQVwgm8L3o/OFn37WoIHsM3v78sXm8p+NHbBZxXVlxT+7XKcPWPEebRDC XoFw== X-Gm-Message-State: APjAAAX/OnDNfW7wsWuyi8OTIw6dvmKif8AafK/grbk+tSf+INIuvLUF b6rqk+tGndu+bnS5OMB/KypBxg== X-Received: by 2002:ac8:2bc1:: with SMTP id n1mr4777281qtn.176.1551460919817; Fri, 01 Mar 2019 09:21:59 -0800 (PST) Received: from localhost ([2620:0:1004:1100:cca9:fccc:8667:9bdc]) by smtp.gmail.com with ESMTPSA id j139sm12403640qke.26.2019.03.01.09.21.58 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Fri, 01 Mar 2019 09:21:58 -0800 (PST) Date: Fri, 1 Mar 2019 12:21:58 -0500 From: Joel Fernandes To: Masami Hiramatsu Cc: linux-kernel@vger.kernel.org, Andrew Morton , ast@kernel.org, atishp04@gmail.com, dancol@google.com, Dan Williams , gregkh@linuxfoundation.org, Guenter Roeck , Jonathan Corbet , karim.yaghmour@opersys.com, Kees Cook , kernel-team@android.com, linux-doc@vger.kernel.org, linux-kselftest@vger.kernel.org, linux-trace-devel@vger.kernel.org, Manoj Rao , Masahiro Yamada , paulmck@linux.vnet.ibm.com, "Peter Zijlstra (Intel)" , qais.yousef@arm.com, rdunlap@infradead.org, rostedt@goodmis.org, Shuah Khan , Thomas Gleixner , yhs@fb.com Subject: Re: [PATCH v3 1/2] Provide in-kernel headers for making it easy to extend the kernel Message-ID: <20190301172158.GB217990@google.com> References: <20190227193748.132301-1-joel@joelfernandes.org> <20190228173444.54403795211d80ba540b61cb@kernel.org> <20190228150054.GB156098@google.com> <20190301112826.ced40b59fb7e8118fa5b40d6@kernel.org> <20190301032611.GA78818@google.com> <20190301160309.2ddadeeb4aadbab4cdc88171@kernel.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20190301160309.2ddadeeb4aadbab4cdc88171@kernel.org> User-Agent: Mutt/1.10.1 (2018-07-13) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Fri, Mar 01, 2019 at 04:03:09PM +0900, Masami Hiramatsu wrote: > Hi Joel, > > On Thu, 28 Feb 2019 22:26:11 -0500 > Joel Fernandes wrote: > > > On Fri, Mar 01, 2019 at 11:28:26AM +0900, Masami Hiramatsu wrote: [..] > > There are many usecases for this, I have often run into issues with Linux > > over the years not only with Android, but other distros, where I boot custom > > kernels with no linux-headers package. This is quite painful. It is > > convenient to have it as /proc file since the file is dependent on kernel > > being booted up and this will work across all Linux distros and systems. I > > feel that if you can keep an open mind about it, you will see that a lot of > > people will use this feature if it is accepted and there is a lot of positive > > feedback in earlier posts of this set. > > I don't complain about having headers for custom boot kernel. I agree with you > that having kernel headers for debugging is always good. :) > So google recommends built-in, it is reasonable. Ok, thanks :) > > > > > > The code to read the headers is based on /proc/config.gz code and uses > > > > > > the same technique to embed the headers. > > > > > > > > > > > > To build a module, the below steps have been tested on an x86 machine: > > > > > > modprobe kheaders > > > > > > rm -rf $HOME/headers > > > > > > mkdir -p $HOME/headers > > > > > > tar -xvf /proc/kheaders.tar.xz -C $HOME/headers >/dev/null > > > > > > cd my-kernel-module > > > > > > make -C $HOME/headers M=$(pwd) modules > > > > > > rmmod kheaders > > > > > > > > > > It seems a bit complex, but no difference from compared with carrying > > > > > kheaders.tar.gz. I think we would better have a psudo filesystem > > > > > which can mount this compressed header file directly :) Then it becomes > > > > > simpler, like > > > > > > > > > > modprobe headerfs > > > > > mkdir $HOME/headers > > > > > mount -t headerfs $HOME/headers > > > > > > > > > > And this doesn't consume any disk-space. > > > > > > > > I felt using a compressed tar is really the easiest way because of all the > > > > tools are already available. > > > > > > As I asked above, if the pure tarball is useful, you can simply ask vendors > > > to put the header tarball on their vendor directory. I feel making it as > > > a module is not a right way. > > > > I don't see what is the drawback of making it a module, it makes it well > > integrated into kernel build and ecosystem. I also didn't see any > > justification you're providing about why it cannot be a module. If you go > > through this and earlier threads, a lot of people are Ok with having a module > > option. And I asked several top kernel maintainers at LPC and many people > > suggested having it as a module. > > I meant, if we have a tarball, we don't need any operation of loading/unloading > kmodules. But if we have this as built-in, yes, this would be much easier to > deploy it to device. > > Anyway, having that option (make it as a module) is not bad. IMHO, that may > be more complicated than just have a tarball file, but it is a user's choice. > > OK, now I understand it. Sounds good. :) Just sent out v4. thanks, - Joel