Received: by 2002:a05:6a10:f347:0:0:0:0 with SMTP id d7csp3474403pxu; Mon, 30 Nov 2020 04:07:43 -0800 (PST) X-Google-Smtp-Source: ABdhPJymGmYx88Ytg1SQzMnXMQww6LRXanRNCwUalxrI7xF0iI4IWqqYQv/krIAkiNvXmgyKW3Me X-Received: by 2002:a17:906:2e85:: with SMTP id o5mr15204887eji.521.1606738063062; Mon, 30 Nov 2020 04:07:43 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1606738063; cv=none; d=google.com; s=arc-20160816; b=PaEEcXCHi/a7Fiir1yG67OwubgN84TK52uz07UEwCWskAbJd8eGC7/XwRDahX0YOM3 6jJjp2+JLYA1rQH4EvqKXLhdRRiqUFlAqdRIhrWp9LbNklA8O9WmzK4bmjbh23j0ktZH WcirKo2HH/07bVNDdUqyHBmR3zJjoVTmSlrCNw5uZadNWxmcT/DBT0X5a7VEwLmmoeCo UZfKTG+IYiA3OVJhn93DHOUrJfw8JzflSdEAPooZVVPqDgIMEhgRlFCAyD2a7aFleBa/ miGt6h6sRKcRTX4zEYuir33DlyePx84de9yHrnwjLwbgvLoRKh7i3HJBnrdflhLV8g3n X65Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:content-language :in-reply-to:mime-version:user-agent:date:message-id:from:references :cc:to:subject; bh=h8+EWiRkCzRBMt2HYcUJZOeShJhKXi3jTvhMLSQl3fo=; b=Y4LJTjPrB0jzDCf5k3BMZPP9DZivMfj88zYYQ5Y8WYnqRZiSOXhi0qQjP+wyqjzIGh 1AJagKUM5k9RBFXLqHP5TpyMVNUyoIo7rbABv6LOZxGg/F4yymChutayLE0vMR9YWATi Z63JIfMfj6kd2+G3BztBcenuW8LSzC+9HruQmNMCBH4gv1fODnONAntfR8HGOAIiAwi6 EVn6c3Jn8gnvvxkfWa0rw/oYoD819o5jHBvMkLN+OTtCN0WqmzP3Q98T14tNzQn/lbgJ /yNjOeK+LFcvl8mY/jynUHLHJ0lEk6aSCqf0wLACpZ/VVCgXkN59VVPjYLZh8e9N2ib9 +ODw== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id zh12si5722103ejb.148.2020.11.30.04.07.20; Mon, 30 Nov 2020 04:07:43 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1729323AbgK3MEs (ORCPT + 99 others); Mon, 30 Nov 2020 07:04:48 -0500 Received: from mx2.suse.de ([195.135.220.15]:51732 "EHLO mx2.suse.de" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727656AbgK3MEr (ORCPT ); Mon, 30 Nov 2020 07:04:47 -0500 X-Virus-Scanned: by amavisd-new at test-mx.suse.de Received: from relay2.suse.de (unknown [195.135.221.27]) by mx2.suse.de (Postfix) with ESMTP id 07553AE8C; Mon, 30 Nov 2020 12:04:06 +0000 (UTC) Subject: Re: [PATCH] mm/page_owner: Record timestamp and pid To: Souptick Joarder Cc: Georgi Djakov , Andrew Morton , Linux-MM , linux-kernel@vger.kernel.org, sudaraja@codeaurora.org, pratikp@codeaurora.org, lmark@codeaurora.org References: <20201112184106.733-1-georgi.djakov@linaro.org> <20201112111436.c5deeadd3578877fc0b844a1@linux-foundation.org> <02f682e2-0e9b-76a8-04fa-487891e18bdf@suse.cz> <3ef3d770-d74b-5588-6672-f092c1526461@linaro.org> From: Vlastimil Babka Message-ID: <43993267-7644-3553-8d1f-53f2f39909a6@suse.cz> Date: Mon, 30 Nov 2020 13:04:05 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.5.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 11/27/20 8:23 PM, Souptick Joarder wrote: > On Sat, Nov 28, 2020 at 12:36 AM Vlastimil Babka wrote: >> >> On 11/27/20 7:57 PM, Georgi Djakov wrote: >> > Hi Vlastimil, >> > >> > Thanks for the comment! >> > >> > On 11/27/20 19:52, Vlastimil Babka wrote: >> >> On 11/12/20 8:14 PM, Andrew Morton wrote: >> >>> On Thu, 12 Nov 2020 20:41:06 +0200 Georgi Djakov >> >>> wrote: >> >>> >> >>>> From: Liam Mark >> >>>> >> >>>> Collect the time for each allocation recorded in page owner so that >> >>>> allocation "surges" can be measured. >> >>>> >> >>>> Record the pid for each allocation recorded in page owner so that >> >>>> the source of allocation "surges" can be better identified. >> >>> >> >>> Please provide a description of why this is considered useful. What >> >>> has it been used for, what problems has it been used to solve? >> >> >> >> Worth noting that on x86_64 it doubles the size of struct page_owner >> >> from 16 bytes to 32, so it better be justified: >> > >> > Well, that's true. But for debug options there is almost always some penalty. >> > The timestamp and pid information is very useful for me (and others, i believe) >> > when doing memory analysis. On a crash for example, we can get this information >> > from kdump (or RAM-dump) and look into it to catch memory allocation problems >> > more easily. >> >> Right. Btw, you should add printing the info to __dump_page_owner(). >> >> > If you find the above argument not strong enough, how about a separate config >> > option for this? Maybe something like CONFIG_PAGE_OWNER_EXTENDED, which could >> > be enabled in addition to CONFIG_PAGE_OWNER? >> >> It might be strong enough if it's mentioned in changelog, and also what exactly >> the space tradeoff is :) > > Just a thought ... putting it inside CONFIG_PAGE_OWNER_DEBUG might be > better if it is used > purely for debugging purposes. I don't think we need to introduce new config just yet, until someone makes the case for it. Even then, it could be instead doable as an extension to "page_owner=on" boot option. I mean let's add those fields, but improve the changelog. >> >> You can also mention that SLUB object tracking has also pid+timestamp. >> >> > Thanks, >> > Georgi >> > >> >> >> >> struct page_owner { >> >> short unsigned int order; /* 0 2 */ >> >> short int last_migrate_reason; /* 2 2 */ >> >> gfp_t gfp_mask; /* 4 4 */ >> >> depot_stack_handle_t handle; /* 8 4 */ >> >> depot_stack_handle_t free_handle; /* 12 4 */ >> >> u64 ts_nsec; /* 16 8 */ >> >> int pid; /* 24 4 */ >> >> >> >> /* size: 32, cachelines: 1, members: 7 */ >> >> /* padding: 4 */ >> >> /* last cacheline: 32 bytes */ >> >> }; >> >> >> > >> >> >