Received: by 2002:a05:6a10:9848:0:0:0:0 with SMTP id x8csp877649pxf; Wed, 7 Apr 2021 13:57:51 -0700 (PDT) X-Google-Smtp-Source: ABdhPJwaRQ+M4vvcHAOw3Kda59Jn9LqOct2k9YAlmjL84jqv5dBU3VEC3zw6/iqb8MZ8IfgOhj2y X-Received: by 2002:a05:6402:1777:: with SMTP id da23mr6849380edb.223.1617829071733; Wed, 07 Apr 2021 13:57:51 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1617829071; cv=none; d=google.com; s=arc-20160816; b=IEhUs3yesIxMiKJIGomDdKzrSNu0CSW2LCPrW42Ms+G3v58347zdBk+VwXdgWu0v4+ i8om5RJUIl7XCF+bfIJWXJZSIHVVFSS43j4urfVES1s0RThSqHgT2/Uu8283iVKZh6OO G026KnxBUkpweT0trwpxlWIgFmST3bz7YEyJblViB72u7uPxlWmtm0jNbwBZUSYuX4Pp XWbMMnNseZiodB0x/Gm8QwtQZ6QmAidEQqoFYw+VuQJHG2tu7DuVxUi0qlYg/XnDEUCf mMFqoelUldC1yOc3QTspJ+bk/CK7dbkq0Iv1vylLMVVqva/ugKt1SjkwSFe/C9UIkRy3 FwLg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:content-language :in-reply-to:mime-version:user-agent:date:message-id:from:references :cc:to:subject; bh=anlUdHVW8kIBUKYvDKmcvMeo+xAFyyW1DtmBQstK134=; b=e1XfnA0GZtsDcucQeWz+QbZLFRDBGL6GACfJWKXlaJJf+8BMjWVsA9hgx2VnLzFo50 AJWniuGnik13HPCpgAh7OyflamOKmeyIw6DS5PtwS+FQZ9j9VoNpXMKr3Zif4ek0+Z1v CVqVyOyaBfgdl6S8wdaYXj5NkqPGrOA46Ou3KMRjv6W0uT18PMQKu9joAm/O2tDbs673 Y07y4KBHiZSm6sShN9aNw5d3EcPQsUT8FKlgbbGP5igcYY0nRLsM/N20VTfq9XYw00XP U8NXw5UTi9XsYQdX8n4B8XW+jEgGnJgb4nBUKFrZqPC25oQ/zNGYJVigOL0K+PjcX/Lp U4Kw== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id z9si18466790edb.10.2021.04.07.13.57.28; Wed, 07 Apr 2021 13:57:51 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1352197AbhDGMcT (ORCPT + 99 others); Wed, 7 Apr 2021 08:32:19 -0400 Received: from mx2.suse.de ([195.135.220.15]:58164 "EHLO mx2.suse.de" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S245181AbhDGMcO (ORCPT ); Wed, 7 Apr 2021 08:32:14 -0400 X-Virus-Scanned: by amavisd-new at test-mx.suse.de Received: from relay2.suse.de (unknown [195.135.221.27]) by mx2.suse.de (Postfix) with ESMTP id 6136CB138; Wed, 7 Apr 2021 12:32:04 +0000 (UTC) Subject: Re: [PATCH v2] mm: page_owner: detect page_owner recursion via task_struct To: Sergei Trofimovich , Andrew Morton , linux-mm@kvack.org Cc: linux-kernel@vger.kernel.org, Ingo Molnar , Peter Zijlstra , Juri Lelli , Vincent Guittot , Dietmar Eggemann , Steven Rostedt , Ben Segall , Mel Gorman , Daniel Bristot de Oliveira References: <20210402125039.671f1f40@sf> <20210402115342.1463781-1-slyfox@gentoo.org> From: Vlastimil Babka Message-ID: Date: Wed, 7 Apr 2021 14:32:03 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.8.1 MIME-Version: 1.0 In-Reply-To: <20210402115342.1463781-1-slyfox@gentoo.org> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 4/2/21 1:53 PM, Sergei Trofimovich wrote: > Before the change page_owner recursion was detected via fetching > backtrace and inspecting it for current instruction pointer. > It has a few problems: > - it is slightly slow as it requires extra backtrace and a linear > stack scan of the result > - it is too late to check if backtrace fetching required memory > allocation itself (ia64's unwinder requires it). > > To simplify recursion tracking let's use page_owner recursion flag > in 'struct task_struct'. > > The change make page_owner=on work on ia64 by avoiding infinite > recursion in: > kmalloc() > -> __set_page_owner() > -> save_stack() > -> unwind() [ia64-specific] > -> build_script() > -> kmalloc() > -> __set_page_owner() [we short-circuit here] > -> save_stack() > -> unwind() [recursion] > > CC: Ingo Molnar > CC: Peter Zijlstra > CC: Juri Lelli > CC: Vincent Guittot > CC: Dietmar Eggemann > CC: Steven Rostedt > CC: Ben Segall > CC: Mel Gorman > CC: Daniel Bristot de Oliveira > CC: Andrew Morton > CC: linux-mm@kvack.org > Signed-off-by: Sergei Trofimovich Much better indeed, thanks. Acked-by: Vlastimil Babka > --- > Change since v1: > - use bit from task_struct instead of a new field > - track only one recursion depth level so far > > include/linux/sched.h | 4 ++++ > mm/page_owner.c | 32 ++++++++++---------------------- > 2 files changed, 14 insertions(+), 22 deletions(-) > > diff --git a/include/linux/sched.h b/include/linux/sched.h > index ef00bb22164c..00986450677c 100644 > --- a/include/linux/sched.h > +++ b/include/linux/sched.h > @@ -841,6 +841,10 @@ struct task_struct { > /* Stalled due to lack of memory */ > unsigned in_memstall:1; > #endif > +#ifdef CONFIG_PAGE_OWNER > + /* Used by page_owner=on to detect recursion in page tracking. */ > + unsigned in_page_owner:1; > +#endif > > unsigned long atomic_flags; /* Flags requiring atomic access. */ > > diff --git a/mm/page_owner.c b/mm/page_owner.c > index 7147fd34a948..64b2e4c6afb7 100644 > --- a/mm/page_owner.c > +++ b/mm/page_owner.c > @@ -97,42 +97,30 @@ static inline struct page_owner *get_page_owner(struct page_ext *page_ext) > return (void *)page_ext + page_owner_ops.offset; > } > > -static inline bool check_recursive_alloc(unsigned long *entries, > - unsigned int nr_entries, > - unsigned long ip) > -{ > - unsigned int i; > - > - for (i = 0; i < nr_entries; i++) { > - if (entries[i] == ip) > - return true; > - } > - return false; > -} > - > static noinline depot_stack_handle_t save_stack(gfp_t flags) > { > unsigned long entries[PAGE_OWNER_STACK_DEPTH]; > depot_stack_handle_t handle; > unsigned int nr_entries; > > - nr_entries = stack_trace_save(entries, ARRAY_SIZE(entries), 2); > - > /* > - * We need to check recursion here because our request to > - * stackdepot could trigger memory allocation to save new > - * entry. New memory allocation would reach here and call > - * stack_depot_save_entries() again if we don't catch it. There is > - * still not enough memory in stackdepot so it would try to > - * allocate memory again and loop forever. > + * Avoid recursion. > + * > + * Sometimes page metadata allocation tracking requires more > + * memory to be allocated: > + * - when new stack trace is saved to stack depot > + * - when backtrace itself is calculated (ia64) > */ > - if (check_recursive_alloc(entries, nr_entries, _RET_IP_)) > + if (current->in_page_owner) > return dummy_handle; > + current->in_page_owner = 1; > > + nr_entries = stack_trace_save(entries, ARRAY_SIZE(entries), 2); > handle = stack_depot_save(entries, nr_entries, flags); > if (!handle) > handle = failure_handle; > > + current->in_page_owner = 0; > return handle; > } > >