Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1757186Ab0GMSK4 (ORCPT ); Tue, 13 Jul 2010 14:10:56 -0400 Received: from mail.lixom.net ([70.86.134.90]:48770 "EHLO mail.lixom.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752001Ab0GMSKy (ORCPT ); Tue, 13 Jul 2010 14:10:54 -0400 X-Greylist: delayed 411 seconds by postgrey-1.27 at vger.kernel.org; Tue, 13 Jul 2010 14:10:54 EDT Date: Tue, 13 Jul 2010 13:04:02 -0500 From: Olof Johansson To: Uwe =?iso-8859-1?Q?Kleine-K=F6nig?= Cc: Linus Torvalds , Grant Likely , Nicolas Pitre , Daniel Walker , Russell King - ARM Linux , Kevin Hilman , linux-arm-msm@vger.kernel.org, Linux Kernel Mailing List , linux-omap@vger.kernel.org, Eric Miao , linux-arm-kernel@lists.infradead.org, Stephen Rothwell , Benjamin Herrenschmidt , linuxppc-dev@lists.ozlabs.org Subject: Re: optimized script [Was: ARM defconfig files] Message-ID: <20100713180402.GA1422@lixom.net> References: <20100712173228.GC9897@n2100.arm.linux.org.uk> <20100712185029.GB14425@pengutronix.de> <20100713070741.GB26442@pengutronix.de> <20100713080705.GA20978@pengutronix.de> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20100713080705.GA20978@pengutronix.de> User-Agent: Mutt/1.5.18 (2008-05-17) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 2786 Lines: 73 On Tue, Jul 13, 2010 at 10:07:05AM +0200, Uwe Kleine-K?nig wrote: > Hello, > > On Tue, Jul 13, 2010 at 09:07:41AM +0200, Uwe Kleine-K?nig wrote: > > Hi > > > > On Mon, Jul 12, 2010 at 01:50:47PM -0600, Grant Likely wrote: > > > On Mon, Jul 12, 2010 at 1:34 PM, Linus Torvalds > > > wrote: > > > > On Mon, Jul 12, 2010 at 12:17 PM, Nicolas Pitre wrote: > > > >> I think Uwe could provide his script and add it to the kernel tree. > > > >> Then all architectures could benefit from it. ?Having the defconfig > > > >> files contain only those options which are different from the defaults > > > >> is certainly more readable, even on x86. > > > > > > > > Quite possible. But maintainers would need to be on the lookout of > > > > people actually using the script, and refusing to apply patches that > > > > re-introduce the whole big thing. > > > > > > I can (partially) speak for powerpc. If ARM uses this approach, then > > > I think we can do the same. After the defconfigs are trimmed, I > > > certainly won't pick up any more full defconfigs. > > I just restarted my script on the powerpc defconfigs basing on rc5, I > > assume they complete in a few days time. > So Stephen was faster than me. I don't know yet how he optimised my > script, meanwhile I put some efforts into it, too by just checking lines > that match "^(# )?CONFIG_". > > Find it attached. > > I will start to reduce the remaining configs (i.e. all but arm and > powerpc). I added just a simple heuristic: If I could remove a line, I attempted to remove twice the amount next time around (and fall back to 1 if it failed). I.e. main loop: i = 0 lines = 1 while i < len(config): print 'test for %r + %d' % (config[i], lines) defconfig = open(defconfig_src, 'w') defconfig.writelines(config[:i]) defconfig.writelines(config[i + lines:]) defconfig.close() subprocess.check_call(['make', '-s', 'ARCH=%s' % arch, target]) if os.stat('.config').st_size == config_size and list(open('.config')) == origconfig: del config[i:i+lines] lines *= 2 else: if lines > 1: lines = 1 else: i += 1 I didn't measure what the actual improvement was, but I saw a fair amount of 2/4/8-attempts passing, so I let it run. Stephen beat me to posting the resulting patch though. :P While this script is great, it is somewhat painful to run given that it attempts one config per line. Even on a fast machine that tends to take a while. -Olof -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/