Received: by 2002:a05:7412:2a91:b0:fc:a2b0:25d7 with SMTP id u17csp635531rdh; Wed, 14 Feb 2024 07:16:03 -0800 (PST) X-Forwarded-Encrypted: i=3; AJvYcCX0D4n1rsFtIAWQJ1CNixWgVoxrbzp9JRFb4+tZrtW6rq2zn+MntAt7HXcbdaR3IRO1qEk4NSl2KIq+lKWeF76pqZqdMbKCCxgoqJhYkw== X-Google-Smtp-Source: AGHT+IHsjE8BMPYWX409ihv7bS39hiAwVdroxEwxc1/Cfu/SE6Zzw2ji9AGXCmnS9W/EGUbTyIW/ X-Received: by 2002:a05:6a20:2d22:b0:19e:376d:eff5 with SMTP id g34-20020a056a202d2200b0019e376deff5mr3472564pzl.43.1707923763611; Wed, 14 Feb 2024 07:16:03 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1707923763; cv=pass; d=google.com; s=arc-20160816; b=0PDtiaKe55eKUNKjSLt0VhiBsq5SvKTYybgElzM3GYHCYugECCl537PyQurKHlomg5 JLddrBqgkzHFxJuQZ5PqwZVkddStsHbSRrE4SHputp8t/qp3E1VZRUjIuxlPl7foaAJp gc+86bcacdDp1/hXZ23eKk4zXz1U6FitUdduqVWVvcbrWCFQvYUvq96a5VXqS3rRBCZv 3Sz9cPkDlwncffcpZJ/oPKLR/2CbwqPprUa8LgyxRKclcOCzY/h2oqScVBVjw16NwvEo YgzrycjdH21xbPIVBLrZwA4d6s1h/bDZRL3rrbp7wFolec8eVB0n0/GJLl7eu8wNmeJm U+tQ== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=in-reply-to:content-disposition:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:references:message-id:subject:cc :to:from:dkim-signature:date; bh=t/AETcYHznmpv4/j2syV358dOWN8/yUI1GROKTci8BI=; fh=Ylw/ODcXdjYF/Ii6SsadcckJfEeOXKBZY2tQr6/ql94=; b=vJJS8KXI5xrXSvEGD9kngYHlALzBvrz93cj5RwIQfkZQLSp/4eTbndQG8YzBy559Hr UaTYY1x/kRWSPvxHAcmCwfi+bvwSqJbjv1iYVIRH8me6vz1O81CCWYsNGS7zISdONzl8 LRo/oFCWBbHZXa2+ZEJH5+jRxDWQ9+yzWtO9Jfl5OsF+OToX3RIJha/YcbBtFUa7i+Ih EHC3iLaq4rS5ZIVfhipEb9rAWmf6e16KNMdh8SavDZgxzvfNP7rNPvnJLFypTwHqzdiq NicTF0p6vQ6hYZOSNUSMSyShysYT5HgyxX0oCQxaPlpK5NZFY9tqRr9FC6nZFPIiPtmI 7YZA==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@linux.dev header.s=key1 header.b=ntCXoZ0V; arc=pass (i=1 spf=pass spfdomain=linux.dev dkim=pass dkdomain=linux.dev dmarc=pass fromdomain=linux.dev); spf=pass (google.com: domain of linux-kernel+bounces-65376-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.48.161 as permitted sender) smtp.mailfrom="linux-kernel+bounces-65376-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linux.dev X-Forwarded-Encrypted: i=2; AJvYcCVBKGFhMfhJLu70FuEiKdtv9GU8fVuvA8c+LwJfPF9shzBFmitDFwQEv+84N0VtOufA1l6SAzInGVJzalGezpDnbcGeXfvhg9qHX2GVYA== Return-Path: Received: from sy.mirrors.kernel.org (sy.mirrors.kernel.org. [147.75.48.161]) by mx.google.com with ESMTPS id t24-20020a63b258000000b005cdfd4aa8b3si3827370pgo.193.2024.02.14.07.16.03 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 14 Feb 2024 07:16:03 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel+bounces-65376-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.48.161 as permitted sender) client-ip=147.75.48.161; Authentication-Results: mx.google.com; dkim=pass header.i=@linux.dev header.s=key1 header.b=ntCXoZ0V; arc=pass (i=1 spf=pass spfdomain=linux.dev dkim=pass dkdomain=linux.dev dmarc=pass fromdomain=linux.dev); spf=pass (google.com: domain of linux-kernel+bounces-65376-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.48.161 as permitted sender) smtp.mailfrom="linux-kernel+bounces-65376-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linux.dev Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by sy.mirrors.kernel.org (Postfix) with ESMTPS id B0CBCB2625C for ; Wed, 14 Feb 2024 15:02:12 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 215A45CDFD; Wed, 14 Feb 2024 15:01:31 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=linux.dev header.i=@linux.dev header.b="ntCXoZ0V" Received: from out-185.mta0.migadu.com (out-185.mta0.migadu.com [91.218.175.185]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 5B2E25CDDC for ; Wed, 14 Feb 2024 15:01:28 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=91.218.175.185 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1707922890; cv=none; b=bXzrU33lKbe5DIYLkPAk+1EVglV+qDvTEBFWX6SHOf6FcLAI1eSYIxnKXxzXrpDmbcShobj/pSBdX0z8bKQ1R4P/oU5XeGH8RdcxMKdVNprDK0vWVA86vZaV2t8McSvJOMttz51ELeDHu1d9mHFsSGMzy7W+m8LmNQU1Wsl3jlY= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1707922890; c=relaxed/simple; bh=NtSv8J+99riBcAJlhZXyLjUBO+73SEMOIxIgW1tEnlw=; h=Date:From:To:Cc:Subject:Message-ID:References:MIME-Version: Content-Type:Content-Disposition:In-Reply-To; b=iZOJK9EZ95Xv/PwAph+yDWX67UWJ/4/oRaBDZD+6dPpWnKfIQyChwUnUy581BvpM6Y2aBMX7ZSci+tzxlz7GC5Lpi0+60Cj4HXm7tyRc52CD/MGwTvnxm3HpxbuiR25GV1+Wk6IhEktQCvCpMYciZtx8oZz87ikSNxakOOYx40g= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linux.dev; spf=pass smtp.mailfrom=linux.dev; dkim=pass (1024-bit key) header.d=linux.dev header.i=@linux.dev header.b=ntCXoZ0V; arc=none smtp.client-ip=91.218.175.185 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linux.dev Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=linux.dev Date: Wed, 14 Feb 2024 10:01:14 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linux.dev; s=key1; t=1707922886; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=t/AETcYHznmpv4/j2syV358dOWN8/yUI1GROKTci8BI=; b=ntCXoZ0VMMCAIYtsPiibjtpORudbEFoAtU1qYcguvGF7mSfGX7qoRUBfyl4bB4idy/W63v fvLCK5XGJcO/TsFo6VG2fL+RXP2HusW2uO949y7vUaBPjM7wvWHNvrysfaEyXdkkF/pz8M wHqh5GWyZyyGIKiP8Dc8AerWtRI9mCY= X-Report-Abuse: Please report any abuse attempt to abuse@migadu.com and include these headers. From: Kent Overstreet To: Michal Hocko Cc: Johannes Weiner , Suren Baghdasaryan , akpm@linux-foundation.org, vbabka@suse.cz, roman.gushchin@linux.dev, mgorman@suse.de, dave@stgolabs.net, willy@infradead.org, liam.howlett@oracle.com, corbet@lwn.net, void@manifault.com, peterz@infradead.org, juri.lelli@redhat.com, catalin.marinas@arm.com, will@kernel.org, arnd@arndb.de, tglx@linutronix.de, mingo@redhat.com, dave.hansen@linux.intel.com, x86@kernel.org, peterx@redhat.com, david@redhat.com, axboe@kernel.dk, mcgrof@kernel.org, masahiroy@kernel.org, nathan@kernel.org, dennis@kernel.org, tj@kernel.org, muchun.song@linux.dev, rppt@kernel.org, paulmck@kernel.org, pasha.tatashin@soleen.com, yosryahmed@google.com, yuzhao@google.com, dhowells@redhat.com, hughd@google.com, andreyknvl@gmail.com, keescook@chromium.org, ndesaulniers@google.com, vvvvvv@google.com, gregkh@linuxfoundation.org, ebiggers@google.com, ytcoode@gmail.com, vincent.guittot@linaro.org, dietmar.eggemann@arm.com, rostedt@goodmis.org, bsegall@google.com, bristot@redhat.com, vschneid@redhat.com, cl@linux.com, penberg@kernel.org, iamjoonsoo.kim@lge.com, 42.hyeyoo@gmail.com, glider@google.com, elver@google.com, dvyukov@google.com, shakeelb@google.com, songmuchun@bytedance.com, jbaron@akamai.com, rientjes@google.com, minchan@google.com, kaleshsingh@google.com, kernel-team@android.com, linux-doc@vger.kernel.org, linux-kernel@vger.kernel.org, iommu@lists.linux.dev, linux-arch@vger.kernel.org, linux-fsdevel@vger.kernel.org, linux-mm@kvack.org, linux-modules@vger.kernel.org, kasan-dev@googlegroups.com, cgroups@vger.kernel.org Subject: Re: [PATCH v3 00/35] Memory allocation profiling Message-ID: References: <20240212213922.783301-1-surenb@google.com> <20240214062020.GA989328@cmpxchg.org> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Migadu-Flow: FLOW_OUT On Wed, Feb 14, 2024 at 03:46:33PM +0100, Michal Hocko wrote: > On Wed 14-02-24 01:20:20, Johannes Weiner wrote: > [...] > > I agree we should discuss how the annotations are implemented on a > > technical basis, but my take is that we need something like this. > > I do not think there is any disagreement on usefulness of a better > memory allocation tracking. At least for me the primary problem is the > implementation. At LFSMM last year we have heard that existing tracing > infrastructure hasn't really been explored much. Cover letter doesn't > really talk much about those alternatives so it is really hard to > evaluate whether the proposed solution is indeed our best way to > approach this. Michal, we covered this before. To do this with tracing you'd have to build up data structures separately, in userspace, that would mirror the allocator's data structures; you would have to track every single allocation so that you could match up the free event to the place it was allocated. Even if it could be built, which I doubt, it'd be completely non viable because the performance would be terrible. Like I said, we covered all this before; if you're going to spend so much time on these threads you really should be making a better attempt at keeping up with what's been talked about.