Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1759368Ab3HMVfH (ORCPT ); Tue, 13 Aug 2013 17:35:07 -0400 Received: from relay1.sgi.com ([192.48.179.29]:53951 "EHLO relay.sgi.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1759350Ab3HMVfF (ORCPT ); Tue, 13 Aug 2013 17:35:05 -0400 Message-ID: <520AA687.3070303@sgi.com> Date: Tue, 13 Aug 2013 16:35:03 -0500 From: Nathan Zimmer User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20130804 Thunderbird/17.0.8 MIME-Version: 1.0 To: Mike Travis CC: Linus Torvalds , Peter Anvin , Ingo Molnar , Linux Kernel Mailing List , linux-mm , Robin Holt , Rob Landley , Daniel J Blueman , Andrew Morton , Greg Kroah-Hartman , Yinghai Lu , Mel Gorman Subject: Re: [RFC v3 0/5] Transparent on-demand struct page initialization embedded in the buddy allocator References: <1375465467-40488-1-git-send-email-nzimmer@sgi.com> <1376344480-156708-1-git-send-email-nzimmer@sgi.com> <520A6DFC.1070201@sgi.com> <520A7514.9020008@sgi.com> In-Reply-To: <520A7514.9020008@sgi.com> Content-Type: text/plain; charset="UTF-8"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [128.162.233.140] Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 1325 Lines: 28 On 08/13/2013 01:04 PM, Mike Travis wrote: > > On 8/13/2013 10:51 AM, Linus Torvalds wrote: >> by the time you can log in. And if it then takes another ten minutes >> until you have the full 16TB initialized, and some things might be a >> tad slower early on, does anybody really care? The machine will be up >> and running with plenty of memory, even if it may not be *all* the >> memory yet. > Before the patches adding memory took ~45 mins for 16TB and almost 2 hours > for 32TB. Adding it late sped up early boot but late insertion was still > very slow, where the full 32TB was still not fully inserted after an hour. > Doing it in parallel along with the memory hotplug lock per node, we got > it down to the 10-15 minute range. Yes but to get it to the 10-15 minute range I had to change an number of system locks. The system_sleep, the memory_hotplug, zonelist_mutex and there was some general alteration to various wmark routines. Some of those fixes I don't know if they would stand up to proper scrutiny but were quick and dirty hacks to allow for progress. Nate -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/