Received: by 2002:a6b:500f:0:0:0:0:0 with SMTP id e15csp181126iob; Mon, 2 May 2022 16:28:16 -0700 (PDT) X-Google-Smtp-Source: ABdhPJw7xfJ2DUIfBV7lfVnK8ylGIKAgHd3JwQCU2FT6dcNEfw7YQvXtq84/iHpDgOBD31cX18G1 X-Received: by 2002:a63:4402:0:b0:39d:a27b:e594 with SMTP id r2-20020a634402000000b0039da27be594mr11611670pga.98.1651534096606; Mon, 02 May 2022 16:28:16 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1651534096; cv=none; d=google.com; s=arc-20160816; b=LjLu5kqtUNo/UEieWi5Ln+jsA0m3kk3EayvnHV3srfE7RpHfYS+b31QPHYvJ2QwO4X /FBbdS1cn4tn2+Vydebpj5QUDHlfHmT2lBziIC51ojC+zY/19o1T00V5wWkaMmNlfqhU q/g/l8SpJwkXRdefrXm1vQiHuFNFhrkTDmj7djQjZaHrGRjKriUJRf5l/eFfdNINSq1q B8tYRqIVN7tVfDOwUGCuuQprJhFDBkz9302siAxMFb8YMO+UmIg7NlqV807XJtxSyv+6 4mw46WsFSaviH1MfX2W1UcGoDPLR7+xzllaz2jEd5XEAqRhqoJC7BwXhej7ADinhx8Jd NVog== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:cc:to:subject:message-id:date:from:in-reply-to :references:mime-version:dkim-signature; bh=sKB6FlYNwY4+wlgwk3rv/2ltFqVWdp3lmtPGlyyyGGo=; b=TNsL3kZUPg5dS5OooD1syKV0Wly4l5kdE4hFVs4VyDApla+etn1hCJ1N8+Ot9SHOPn d8QEb85MsJJGylzySyeZBjZPJhTidLk9KRtoHLhXn8QAsdT4hYqUqa6+vXSdRvM7/zR4 Ndwb1IV9WKbyWhapmfqPKC7lWjDsJIO5CbdN68roUOK2932TSMmYz6lWVKzoMfRYB4HS i9OVkcgkfs2+Kt2O5WMiGtX1r3+KnmYL9sh1BhxQdAoNOK0bwziZ3Ym1o3SaeIYhDL7e 2TUWTb6GanFZRp1/BSbAZz1CJLr6+aNTMgDi0VyP3ZO1oBXXkdRgj9wCj5BFDZhivvFD Nmkg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=ETSEpC1G; spf=softfail (google.com: domain of transitioning linux-kernel-owner@vger.kernel.org does not designate 23.128.96.19 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from lindbergh.monkeyblade.net (lindbergh.monkeyblade.net. [23.128.96.19]) by mx.google.com with ESMTPS id m4-20020a170902f64400b001590118e14dsi14380833plg.108.2022.05.02.16.28.16 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 02 May 2022 16:28:16 -0700 (PDT) Received-SPF: softfail (google.com: domain of transitioning linux-kernel-owner@vger.kernel.org does not designate 23.128.96.19 as permitted sender) client-ip=23.128.96.19; Authentication-Results: mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=ETSEpC1G; spf=softfail (google.com: domain of transitioning linux-kernel-owner@vger.kernel.org does not designate 23.128.96.19 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by lindbergh.monkeyblade.net (Postfix) with ESMTP id 4E16D27CD7; Mon, 2 May 2022 16:28:07 -0700 (PDT) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S240808AbiD3EEO (ORCPT + 99 others); Sat, 30 Apr 2022 00:04:14 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:42030 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S240665AbiD3ED5 (ORCPT ); Sat, 30 Apr 2022 00:03:57 -0400 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.129.124]) by lindbergh.monkeyblade.net (Postfix) with ESMTP id 7F2B6186D9 for ; Fri, 29 Apr 2022 21:00:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1651291223; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=sKB6FlYNwY4+wlgwk3rv/2ltFqVWdp3lmtPGlyyyGGo=; b=ETSEpC1Grbg5pv+cyJS2gGr2EuAsb+K4EJsx/8DzCLJCuwNqkThpERRqUH/5miiW/I0yDn WsA7Ikn8+A8aGqnzzldBqkbe3epsP4d0b06AlhKAmm4i2Y83vYC0pwwgVxX/byPwVZhJW1 P6CPSOc+fDUG6lcg0MJNqLwECbz60Io= Received: from mail-wr1-f72.google.com (mail-wr1-f72.google.com [209.85.221.72]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id us-mta-663-r9D6Y8RMNt2K4ubyC_VmbA-1; Sat, 30 Apr 2022 00:00:21 -0400 X-MC-Unique: r9D6Y8RMNt2K4ubyC_VmbA-1 Received: by mail-wr1-f72.google.com with SMTP id s14-20020adfa28e000000b0020ac7532f08so3702517wra.15 for ; Fri, 29 Apr 2022 21:00:21 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=sKB6FlYNwY4+wlgwk3rv/2ltFqVWdp3lmtPGlyyyGGo=; b=rELpax+fIf/ZBMR6YcvcdDTrzPGPSWDZPXl2gWv3kX3+4nhaEq7CC7v3sZCjXqYj6l vYudaiECgBaE2hiqh66QPXE322Zm1HRlN60RWcYc/+ZvK3hSQzNsCLi8xDWBtP/VROFI HvduYU07xM7b3i9ZhSqghXm48mbU0/VjtCD9Y1syEo1F19eeHPKRwkQWEDcmISYFpV10 6c4VuulAHCQEzRf7dy8WJf69uVPwPWw4PZdVa6GXKX5c5ZrdEIJwkHsLI7+LBewUbiO+ lCzf83QJI1ZY4lg/BBNo8u5jqgAu8j2d2IRrjnTXqBL7KL7ZX4Ugs93ZGFKPntmfUxwQ JMUw== X-Gm-Message-State: AOAM530766dBbVCQ9XYJwukh4Fu2IGSYcK8CQdvPUaTdoC+HKOhXd7Np DSOoJAfOcFvK5DQZA03FvwOeh/WtUSu4DoxHBZ7QXzXweguEHA5RQ0RSl+T2dDlvlAWdwtliaEI xuadd4ASRKKGapl4pgJQCrDxUd9UxD8pi0eKMnz6u X-Received: by 2002:adf:ee81:0:b0:206:1b32:d6f2 with SMTP id b1-20020adfee81000000b002061b32d6f2mr1559773wro.144.1651291219821; Fri, 29 Apr 2022 21:00:19 -0700 (PDT) X-Received: by 2002:adf:ee81:0:b0:206:1b32:d6f2 with SMTP id b1-20020adfee81000000b002061b32d6f2mr1559762wro.144.1651291219592; Fri, 29 Apr 2022 21:00:19 -0700 (PDT) MIME-Version: 1.0 References: <20220421234837.3629927-1-kent.overstreet@gmail.com> In-Reply-To: <20220421234837.3629927-1-kent.overstreet@gmail.com> From: Dave Young Date: Sat, 30 Apr 2022 12:00:08 +0800 Message-ID: Subject: Re: [PATCH 0/4] Printbufs & shrinker OOM reporting To: Kent Overstreet Cc: "open list:X86 ARCHITECTURE (32-BIT AND 64-BIT)" , linux-mm@kvack.org, linux-fsdevel@vger.kernel.org, roman.gushchin@linux.dev, hannes@cmpxchg.org, kexec@lists.infradead.org Content-Type: text/plain; charset="UTF-8" X-Spam-Status: No, score=-2.6 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,RDNS_NONE,SPF_HELO_NONE,T_SCC_BODY_TEXT_LINE autolearn=unavailable autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hi Kent, On Fri, 22 Apr 2022 at 07:56, Kent Overstreet wrote: > > Debugging OOMs has been one of my sources of frustration, so this patch series > is an attempt to do something about it. > > The first patch in the series is something I've been slowly evolving in bcachefs > for years: simple heap allocated strings meant for appending to and building up > structured log/error messages. They make it easy and straightforward to write > pretty-printers for everything, which in turn makes good logging and error > messages something that just happens naturally. > > We want it here because that means the reporting I'm adding to shrinkers can be > used by both OOM reporting, and for the sysfs (or is it debugfs now) interface > that Roman is adding. > I added the kexec list in cc. It seems like a nice enhancement to oom reporting. I suspect kdump tooling need changes to retrieve the kmsg log from vmcore, could you confirm it? For example makedumpfile, crash, and kexec-tools (its vmcore-dmesg tool). > This patch series also: > - adds OOM reporting on shrinkers, reporting on top 10 shrinkers (in sorted > order!) > - changes slab reporting to be always-on, also reporting top 10 slabs in sorted > order > - starts centralizing OOM reporting in mm/show_mem.c > > The last patch in the series is only a demonstration of how to implement the > shrinker .to_text() method, since bcachefs isn't upstream yet. > > Kent Overstreet (4): > lib/printbuf: New data structure for heap-allocated strings > mm: Add a .to_text() method for shrinkers > mm: Centralize & improve oom reporting in show_mem.c > bcachefs: shrinker.to_text() methods > > fs/bcachefs/btree_cache.c | 18 ++- > fs/bcachefs/btree_key_cache.c | 18 ++- > include/linux/printbuf.h | 140 ++++++++++++++++++ > include/linux/shrinker.h | 5 + > lib/Makefile | 4 +- > lib/printbuf.c | 271 ++++++++++++++++++++++++++++++++++ > mm/Makefile | 2 +- > mm/oom_kill.c | 23 --- > {lib => mm}/show_mem.c | 14 ++ > mm/slab.h | 6 +- > mm/slab_common.c | 53 ++++++- > mm/vmscan.c | 75 ++++++++++ > 12 files changed, 587 insertions(+), 42 deletions(-) > create mode 100644 include/linux/printbuf.h > create mode 100644 lib/printbuf.c > rename {lib => mm}/show_mem.c (78%) > > -- > 2.35.2 > Thanks Dave