Received: by 2002:ad5:474a:0:0:0:0:0 with SMTP id i10csp880229imu; Fri, 4 Jan 2019 08:50:11 -0800 (PST) X-Google-Smtp-Source: ALg8bN4PG4ej2IiLfRTjmHHn7mMxw9C7umgTGFYseKyhkAYHwTnF0mYnpsPZApBHOKLf02/ekCxa X-Received: by 2002:a63:c303:: with SMTP id c3mr2265634pgd.268.1546620610969; Fri, 04 Jan 2019 08:50:10 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1546620610; cv=none; d=google.com; s=arc-20160816; b=hCORRSmbbtr01hbqaf09v3GUfuSbPbro4QLWWZCyj2J75hQ1o99gkotd0UyCpw9kyv 7j7AtPjIiCb3Kf7CxAdAiDvewALcO0T+rBBKhUnf45rvVMzbpqmWwIoVbruQWZjG7cho 2BrPK80zcO9srzYMxBxBzpgW6PBF8BISIe28Yd2TSt7ypF7oRKbi/FWeWpeIqz9ctv1N 50pYHo3BxTHON2WCQU4ls6d4GaAr3OfCvs4TGFHZz70k62tnjFirH0wOM2nmxec30Hf5 rxltGKbxeq9YyT2ukN5ef8+vtAZMoGB9rSR8+z6wniYlA/EXDYqoDi46zzFCX9BmCDlI iIRw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-disposition:mime-version:references:message-id:subject:cc :to:from:date; bh=50+x1gmIltNLpV146OGV5uiW52Lt7bJGfKOgTAvnx8c=; b=ebmkhylIbPJR8eM8UqwQK+Q9jKk/AL7L3nz+62Z5CqCXXWNtxGkG7D9RtHzRSR5rrI xeHQPktaurrwZrsE5Af4xKb5dUHU/ED6A1I7fYzHaTqkQmzSEsW0gX5QW8yd0+rKsMMG Z+9lL3QEKIsZaTuXxiWkSmgksaeVpxmUs6SFxD/ecCin29Cteie0vhRB0MQrF6V6Dd/X n7a8roDfSnO1Ed8OGNgmBIiuvBFNfYa4EUlDKP0g37YichAvbTXI/Ncvrxr4feKfoWRQ 0VDQr5gEM98Q59AfYl1cHby2xQ5ve6Cq6ZLWK3z+T6XmIrzgZLBVqpjRoxEFdLK8/md2 ARtw== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id z3si3940742pln.430.2019.01.04.08.49.47; Fri, 04 Jan 2019 08:50:10 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726901AbfADNJJ (ORCPT + 99 others); Fri, 4 Jan 2019 08:09:09 -0500 Received: from mx2.suse.de ([195.135.220.15]:36832 "EHLO mx1.suse.de" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1726459AbfADNJJ (ORCPT ); Fri, 4 Jan 2019 08:09:09 -0500 X-Virus-Scanned: by amavisd-new at test-mx.suse.de Received: from relay2.suse.de (unknown [195.135.220.254]) by mx1.suse.de (Postfix) with ESMTP id BE3F2ADC2; Fri, 4 Jan 2019 13:09:07 +0000 (UTC) Date: Fri, 4 Jan 2019 14:09:06 +0100 From: Michal Hocko To: Qian Cai Cc: akpm@linux-foundation.org, Pavel.Tatashin@microsoft.com, mingo@kernel.org, mgorman@techsingularity.net, iamjoonsoo.kim@lge.com, tglx@linutronix.de, linux-mm@kvack.org, linux-kernel@vger.kernel.org Subject: Re: [PATCH v3] mm/page_owner: fix for deferred struct page init Message-ID: <20190104130906.GO31793@dhcp22.suse.cz> References: <20181220185031.43146-1-cai@lca.pw> <20181220203156.43441-1-cai@lca.pw> <20190103115114.GL31793@dhcp22.suse.cz> <20190103165927.GU31793@dhcp22.suse.cz> <5d8f3a98-a954-c8ab-83d9-2f94c614f268@lca.pw> <20190103190715.GZ31793@dhcp22.suse.cz> <62e96e34-7ea9-491a-b5b6-4828da980d48@lca.pw> <20190103202235.GE31793@dhcp22.suse.cz> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.10.1 (2018-07-13) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu 03-01-19 17:22:29, Qian Cai wrote: > On 1/3/19 3:22 PM, Michal Hocko wrote: > > On Thu 03-01-19 14:53:47, Qian Cai wrote: > >> On 1/3/19 2:07 PM, Michal Hocko wrote> So can we make the revert with an > >> explanation that the patch was wrong? > >>> If we want to make hacks to catch more objects to be tracked then it > >>> would be great to have some numbers in hands. > >> > >> Well, those numbers are subject to change depends on future start_kernel() > >> order. Right now, there are many functions could be caught earlier by page owner. > >> > >> kmemleak_init(); > > [...] > >> sched_init_smp(); > > > > The kernel source dump will not tell us much of course. A ball park > > number whether we are talking about dozen, hundreds or thousands of > > allocations would tell us something at least, doesn't it. > > > > Handwaving that it might help us some is not particurarly useful. We are > > already losing some allocations already. Does it matter? Well, that > > depends, sometimes we do want to catch an owner of particular page and > > it is sad to find nothing. But how many times have you or somebody else > > encountered that in practice. That is exactly a useful information to > > judge an ugly ifdefery in the code. See my point? > > Here is the number without DEFERRED_STRUCT_PAGE_INIT. > > == page_ext_init() after page_alloc_init_late() == > Node 0, zone DMA: page owner found early allocated 0 pages > Node 0, zone DMA32: page owner found early allocated 7009 pages > Node 0, zone Normal: page owner found early allocated 85827 pages > Node 4, zone Normal: page owner found early allocated 75063 pages > > == page_ext_init() before kmemleak_init() == > Node 0, zone DMA: page owner found early allocated 0 pages > Node 0, zone DMA32: page owner found early allocated 6654 pages > Node 0, zone Normal: page owner found early allocated 41907 pages > Node 4, zone Normal: page owner found early allocated 41356 pages > > So, it told us that it will miss tens of thousands of early page allocation call > sites. This is an answer for the first part of the question (how much). The second is _do_we_care_? -- Michal Hocko SUSE Labs