Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1753244AbbK3HNd (ORCPT ); Mon, 30 Nov 2015 02:13:33 -0500 Received: from e36.co.us.ibm.com ([32.97.110.154]:33476 "EHLO e36.co.us.ibm.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752677AbbK3HNc (ORCPT ); Mon, 30 Nov 2015 02:13:32 -0500 X-IBM-Helo: d03dlp03.boulder.ibm.com X-IBM-MailFrom: raghavendra.kt@linux.vnet.ibm.com X-IBM-RcptTo: linux-kernel@vger.kernel.org Message-ID: <565BF848.7060501@linux.vnet.ibm.com> Date: Mon, 30 Nov 2015 12:48:32 +0530 From: Raghavendra K T Organization: IBM User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20130625 Thunderbird/17.0.7 MIME-Version: 1.0 To: Tejun Heo CC: axboe@fb.com, jack@suse.com, "linux-kernel@vger.kernel.org" , Christoph Hellwig , "Theodore Ts'o" Subject: Re: BUG: Unable to handle kernel paging request for data at address __percpu_counter_add References: <564DA363.9060303@linux.vnet.ibm.com> <20151123211322.GD19072@mtj.duckdns.org> In-Reply-To: <20151123211322.GD19072@mtj.duckdns.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-TM-AS-MML: disable X-Content-Scanned: Fidelis XPS MAILER x-cbid: 15113007-0021-0000-0000-000014E18BD4 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 1604 Lines: 41 On 11/24/2015 02:43 AM, Tejun Heo wrote: > Hello, > > On Thu, Nov 19, 2015 at 03:54:35PM +0530, Raghavendra K T wrote: >> While I was creating thousands of docker container on a power8 baremetal >> (config: 4.3.0 kernel 1TB RAM, 20core (=160 cpu) system. After creating >> around 5600 container >> I have hit below problem. >> [This is looking similar to >> https://bugzilla.kernel.org/show_bug.cgi?id=101011, but >> kernel had Revert "ext4: remove block_device_ejected" (bdfe0cbd746aa9) since >> it is 4.3.0 tagged kernel] >> >> Any hints on how to go about the fix. Please let me know if you think any >> more information needed. >> >> docker daemon is device mapper based. (and it took a day to recreate the >> problem) >> >> [ by disabling CONFIG_BLK_CGROUP and CONFIG_CGROUP_WRITEBACK I am able to >> create 10k containers without any problem] > > Could be the same problem that Ilya is trying to fix. ie. blkdev i_wb > pointing to a stale wb. Can you please see whether the following > patch resolves the issue? > > http://lkml.kernel.org/g/1448054554-24138-1-git-send-email-idryomov@gmail.com > Hi Tejun, Thanks again for the pointer. I was now able to create more than 10k containers without any problem with CGROUP_WRITEBACK on whereas earlier I had hit this problem few times around 5k+ containers itself. (Also Replying to Ilya's thread). -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/