Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1755395AbZF3Pur (ORCPT ); Tue, 30 Jun 2009 11:50:47 -0400 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1752674AbZF3Puk (ORCPT ); Tue, 30 Jun 2009 11:50:40 -0400 Received: from mail-pz0-f188.google.com ([209.85.222.188]:37307 "EHLO mail-pz0-f188.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751644AbZF3Puj convert rfc822-to-8bit (ORCPT ); Tue, 30 Jun 2009 11:50:39 -0400 DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; b=bSCVIgNlyVPG3vgadATdAD9IU+Xh1dyGOPdgrVfhgkitmrkmFYkNha8M02F3mxCEDb Vc7XM/lTYTdBl/Zcx0kbeVMaeSsBWITGq9dmPft/foQIKr1b8kC2kOXYXR53cujr2Pir F8d9WMibmfhSvmioQ8eS0Vz04gQPxNA1eHE98= MIME-Version: 1.0 In-Reply-To: <20090630140512.GA16923@localhost> References: <20090628142239.GA20986@localhost> <20090628151026.GB25076@localhost> <20090629091741.ab815ae7.minchan.kim@barrios-desktop> <17678.1246270219@redhat.com> <20090629125549.GA22932@localhost> <29432.1246285300@redhat.com> <28c262360906290800v37f91d7av3642b1ad8b5f0477@mail.gmail.com> <30071.1246290885@redhat.com> <1246291007.663.630.camel@macbook.infradead.org> <20090630140512.GA16923@localhost> Date: Wed, 1 Jul 2009 00:50:42 +0900 Message-ID: <28c262360906300850l402e2bb0xca14a2d0571eb3cf@mail.gmail.com> Subject: Re: Found the commit that causes the OOMs From: Minchan Kim To: Wu Fengguang Cc: David Woodhouse , David Howells , Mel Gorman , KOSAKI Motohiro , Johannes Weiner , "riel@redhat.com" , Andrew Morton , LKML , Christoph Lameter , "peterz@infradead.org" , "tytso@mit.edu" , "linux-mm@kvack.org" , "elladan@eskimo.com" , "npiggin@suse.de" , "Barnes, Jesse" Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8BIT Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 4318 Lines: 82 On Tue, Jun 30, 2009 at 11:05 PM, Wu Fengguang wrote: > > More data: I boot 2.6.30-rc1 with mem=1G and enabled 1GB swap and run msgctl11. > > It goes OOM at the 2nd run. They are very interesting numbers: memory leaked? Hmm. It's very serious and another problem since this system have swap device and it's not full. Can you reproduce it easily ? I want to reproduce it in my system. Did you ran only msgctl11 not all LTP test ? Just default parameter ? ex) $ ./testcases/bin/msgctl11 2nd run ? You mean you execute msgctl11 two time in order ? I mean after first test is finished successfully and OOM happens second test before ending successfully ? > [ 2259.825958] msgctl11 invoked oom-killer: gfp_mask=0x84d0, order=0, oom_adj=0 > [ 2259.828092] Pid: 29657, comm: msgctl11 Not tainted 2.6.31-rc1 #22 > [ 2259.830505] Call Trace: > [ 2259.832010] [] ? _spin_unlock+0x26/0x30 > [ 2259.834219] [] oom_kill_process+0x176/0x270 > [ 2259.837603] [] ? badness+0x18f/0x300 > [ 2259.839906] [] __out_of_memory+0x135/0x170 > [ 2259.842035] [] out_of_memory+0xf5/0x180 > [ 2259.844270] [] __alloc_pages_nodemask+0x6ac/0x6c0 > [ 2259.846743] [] alloc_pages_current+0x78/0x100 > [ 2259.849083] [] pte_alloc_one+0x15/0x50 > [ 2259.851282] [] __pte_alloc+0x2a/0xf0 > [ 2259.853454] [] handle_mm_fault+0x742/0x830 > [ 2259.855793] [] do_page_fault+0x1cb/0x330 > [ 2259.858033] [] page_fault+0x25/0x30 > [ 2259.860301] Mem-Info: > [ 2259.861706] Node 0 DMA per-cpu: > [ 2259.862523] CPU 0: hi: 0, btch: 1 usd: 0 > [ 2259.864454] CPU 1: hi: 0, btch: 1 usd: 0 > [ 2259.866608] Node 0 DMA32 per-cpu: > [ 2259.867404] CPU 0: hi: 186, btch: 31 usd: 197 > [ 2259.869283] CPU 1: hi: 186, btch: 31 usd: 175 > [ 2259.870511] Active_anon:0 active_file:11 inactive_anon:0 > > zero anon pages! > > [ 2259.870512] inactive_file:0 unevictable:0 dirty:0 writeback:0 unstable:0 > [ 2259.870513] free:1986 slab:42170 mapped:96 pagetables:59427 bounce:0 > [ 2259.877722] Node 0 DMA free:3976kB min:56kB low:68kB high:84kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB present:15164kB pages_scanned:429 all_unreclaimable? no > [ 2259.883804] lowmem_reserve[]: 0 982 982 982 > [ 2259.885814] Node 0 DMA32 free:3968kB min:3980kB low:4972kB high:5968kB active_anon:0kB inactive_anon:0kB active_file:44kB inactive_file:0kB unevictable:0kB present:1005984kB pages_scanned:152 all_unreclaimable? no > [ 2259.890958] lowmem_reserve[]: 0 0 0 0 > [ 2259.893183] Node 0 DMA: 4*4kB 3*8kB 2*16kB 0*32kB 1*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3976kB > [ 2259.897406] Node 0 DMA32: 334*4kB 77*8kB 24*16kB 27*32kB 10*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3968kB > [ 2259.902753] 625 total pagecache pages > [ 2259.903623] 454 pages in swap cache > [ 2259.905299] Swap cache stats: add 95129, delete 94675, find 55783/67607 > [ 2259.908858] Free swap = 1041232kB > [ 2259.909618] Total swap = 1048568kB > > swap far from full! > > [ 2259.919456] 262144 pages RAM > [ 2259.921071] 12513 pages reserved > [ 2259.922790] 314212 pages shared > [ 2259.923548] 165757 pages non-shared > [ 2259.925234] Out of memory: kill process 20791 (msgctl11) score 2280094 or a child > [ 2259.928982] Killed process 21946 (msgctl11) > > -- Kinds regards, Minchan Kim -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/