Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1755066AbcCRNcx (ORCPT ); Fri, 18 Mar 2016 09:32:53 -0400 Received: from metis.ext.4.pengutronix.de ([92.198.50.35]:36326 "EHLO metis.ext.4.pengutronix.de" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751410AbcCRNcv (ORCPT ); Fri, 18 Mar 2016 09:32:51 -0400 Message-ID: <1458307955.18134.31.camel@pengutronix.de> Subject: Re: Suspicious error for CMA stress test From: Lucas Stach To: Joonsoo Kim , Vlastimil Babka Cc: Laura Abbott , Arnd Bergmann , Catalin Marinas , Hanjun Guo , Will Deacon , "linux-kernel@vger.kernel.org" , qiuxishi , "linux-mm@kvack.org" , dingtinahong , "Leizhen (ThunderTown)" , Sasha Levin , Joonsoo Kim , Laura Abbott , Andrew Morton , "linux-arm-kernel@lists.infradead.org" , chenjie6@huawei.com Date: Fri, 18 Mar 2016 14:32:35 +0100 In-Reply-To: References: <56DD38E7.3050107@huawei.com> <56DDCB86.4030709@redhat.com> <56DE30CB.7020207@huawei.com> <56DF7B28.9060108@huawei.com> <56E2FB5C.1040602@suse.cz> <20160314064925.GA27587@js1304-P5Q-DELUXE> <56E662E8.700@suse.cz> <20160314071803.GA28094@js1304-P5Q-DELUXE> <56E92AFC.9050208@huawei.com> <20160317065426.GA10315@js1304-P5Q-DELUXE> <56EA77BC.2090702@huawei.com> <56EAD0B4.2060807@suse.cz> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.12.9-1+b1 Mime-Version: 1.0 Content-Transfer-Encoding: 7bit X-SA-Exim-Connect-IP: 2001:67c:670:100:fa0f:41ff:fe58:4010 X-SA-Exim-Mail-From: l.stach@pengutronix.de X-SA-Exim-Scanned: No (on metis.ext.pengutronix.de); SAEximRunCond expanded to false X-PTX-Original-Recipient: linux-kernel@vger.kernel.org Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 3305 Lines: 84 Hi Vlastimil, Joonsoo, Am Freitag, den 18.03.2016, 00:52 +0900 schrieb Joonsoo Kim: > 2016-03-18 0:43 GMT+09:00 Vlastimil Babka : > > On 03/17/2016 10:24 AM, Hanjun Guo wrote: > >> > >> On 2016/3/17 14:54, Joonsoo Kim wrote: > >>> > >>> On Wed, Mar 16, 2016 at 05:44:28PM +0800, Hanjun Guo wrote: > >>>> > >>>> On 2016/3/14 15:18, Joonsoo Kim wrote: > >>>>> > >>>>> On Mon, Mar 14, 2016 at 08:06:16AM +0100, Vlastimil Babka wrote: > >>>>>> > >>>>>> On 03/14/2016 07:49 AM, Joonsoo Kim wrote: > >>>>>>> > >>>>>>> On Fri, Mar 11, 2016 at 06:07:40PM +0100, Vlastimil Babka wrote: > >>>>>>>> > >>>>>>>> On 03/11/2016 04:00 PM, Joonsoo Kim wrote: > >>>>>>>> > >>>>>>>> How about something like this? Just and idea, probably buggy > >>>>>>>> (off-by-one etc.). > >>>>>>>> Should keep away cost from >>>>>>>> expense of the > >>>>>>>> relatively fewer >pageblock_order iterations. > >>>>>>> > >>>>>>> Hmm... I tested this and found that it's code size is a little bit > >>>>>>> larger than mine. I'm not sure why this happens exactly but I guess > >>>>>>> it would be > >>>>>>> related to compiler optimization. In this case, I'm in favor of my > >>>>>>> implementation because it looks like well abstraction. It adds one > >>>>>>> unlikely branch to the merge loop but compiler would optimize it to > >>>>>>> check it once. > >>>>>> > >>>>>> I would be surprised if compiler optimized that to check it once, as > >>>>>> order increases with each loop iteration. But maybe it's smart > >>>>>> enough to do something like I did by hand? Guess I'll check the > >>>>>> disassembly. > >>>>> > >>>>> Okay. I used following slightly optimized version and I need to > >>>>> add 'max_order = min_t(unsigned int, MAX_ORDER, pageblock_order + 1)' > >>>>> to yours. Please consider it, too. > >>>> > >>>> Hmm, this one is not work, I still can see the bug is there after > >>>> applying > >>>> this patch, did I miss something? > >>> > >>> I may find that there is a bug which was introduced by me some time > >>> ago. Could you test following change in __free_one_page() on top of > >>> Vlastimil's patch? > >>> > >>> -page_idx = pfn & ((1 << max_order) - 1); > >>> +page_idx = pfn & ((1 << MAX_ORDER) - 1); > >> > >> > >> I tested Vlastimil's patch + your change with stress for more than half > >> hour, the bug > >> I reported is gone :) > > > > > > Oh, ok, will try to send proper patch, once I figure out what to write in > > the changelog :) > > Thanks in advance! After digging into the "PFN busy" race in CMA (see [1]), I believe we should just prevent any buddy merging in isolated ranges. This fixes the race I'm seeing without the need to hold the zone lock for extend periods of time. Also any merging done in an isolated range is likely to be completely wasted work, as higher order buddy pages are broken up again into single pages in isolate_freepages. If we do that the patch to fix the bug in question for this report would boil down to a check if the current pages buddy is isolated and abort merging at that point, right? undo_isolate_page_range will then do all necessary merging that has been skipped while the range was isolated. Do you see issues with this approach? Regards, Lucas [1] http://thread.gmane.org/gmane.linux.kernel.mm/148383