Received: by 2002:ab2:b82:0:b0:1f3:401:3cfb with SMTP id 2csp669195lqh; Thu, 28 Mar 2024 12:32:17 -0700 (PDT) X-Forwarded-Encrypted: i=3; AJvYcCWyurkS5AOset+qTp1XKeLLV1e/j+b+nix1ogBHZyhEEO1apYftx/ZoIMNFIrlQXi5SF3xNwV3fwBIx4NjpRWAqLtDynxv5L5FSko8F8A== X-Google-Smtp-Source: AGHT+IE2nL1bwpjQ2vp/tADqXSws44HbYPVqZVenqJcqzPflXk02nJ4CluzLewz9zR300XWF4fqs X-Received: by 2002:a05:622a:1002:b0:431:3df7:ce48 with SMTP id d2-20020a05622a100200b004313df7ce48mr397061qte.12.1711654337554; Thu, 28 Mar 2024 12:32:17 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1711654337; cv=pass; d=google.com; s=arc-20160816; b=iPsv2tsN2TkFKvca3DJRzwxWmLeRfkzQ8rUqVjAWnoVk7GQ/ww94zUEnfK44EbaDCs DafM7fFZl2fMaUkowDELPMjpugITrZdy2a4vVEjkv8H0zSejPMNV42TbxU/JyfmGCqUJ Hlheh7/i7rPju23skFwWaegXKm+DRU6q413R5AoJ6h1iKmZEIvb0+GCkSs+ftsDf/Uc/ uxiytU4fBTT9paW6noLUtq2C4+f7L4pKwX1loHGJJjvrTZS3i3t525sRkx819clZDuFj xNeQHGBcvbc1EqSdpAFOivBLcmU+JCasq40xiBb5fjCsntQoKZsgx0yniPs0cgViPBkN 9UZg== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=in-reply-to:content-disposition:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:references:message-id:subject:cc :to:from:date:sender:dkim-signature; bh=JhfbUSiwIuT8LIHU0+RkNyojAQTzCsx1VSv7AHZemnA=; fh=8BbqwFrJDvBWvHLRyrFCOvfPfNMLfU7jgOGuDR7qwR8=; b=uNGV1XNwoU1JEjNTdwYHh2vgVD4IGNtSg4HwfZvlnGteF0SxtbLpDPUgk0Ps+DlD9m wFAhraeeUhSr4olnDXknqWYOrPk4LowIMVpxYa7Gw3HXj8D2Va8HP9rXE/DnwRl1tSqX javj/vBdrP1C8ADNZQiuUT572BU6PsjLKK1oEoYV7vLOK1uiqiSWrDLspatdnxbBlnKR tjujVAjv2XfburIThni2uAfAllcGXjEe+OM+3t7hZr2bQnQ1EABld3t4dq2zmiGOag6i +AwxYZizywPBM5kS9VFldn35ZHSdFwhAmn635S6sjNhpSICamaXx+6YZfFS89rH/8Orz OIig==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@gmail.com header.s=20230601 header.b=aMt6Crun; arc=pass (i=1 spf=pass spfdomain=gmail.com dkim=pass dkdomain=gmail.com); spf=pass (google.com: domain of linux-kernel+bounces-123482-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.199.223 as permitted sender) smtp.mailfrom="linux-kernel+bounces-123482-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from ny.mirrors.kernel.org (ny.mirrors.kernel.org. [147.75.199.223]) by mx.google.com with ESMTPS id n15-20020ac85a0f000000b00430f9866355si1982415qta.39.2024.03.28.12.32.17 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 28 Mar 2024 12:32:17 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel+bounces-123482-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.199.223 as permitted sender) client-ip=147.75.199.223; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20230601 header.b=aMt6Crun; arc=pass (i=1 spf=pass spfdomain=gmail.com dkim=pass dkdomain=gmail.com); spf=pass (google.com: domain of linux-kernel+bounces-123482-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.199.223 as permitted sender) smtp.mailfrom="linux-kernel+bounces-123482-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ny.mirrors.kernel.org (Postfix) with ESMTPS id 4A1FB1C28A53 for ; Thu, 28 Mar 2024 19:32:17 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id BAE56137C4D; Thu, 28 Mar 2024 19:32:01 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="aMt6Crun" Received: from mail-pl1-f170.google.com (mail-pl1-f170.google.com [209.85.214.170]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 8206E1384A1; Thu, 28 Mar 2024 19:31:59 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.214.170 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1711654320; cv=none; b=g9CrxPW4Wn1FEyrRvl4g8YC7YkVNxa7FxFjBbYreMpTqgffwj2OAqF2289YMNLvZ62+bZ1A98c5G/GamgvubdvXuvlQGZxvvKUE34JpRyN7hra1wU2GXINxQffEtMD5sXPdp3W9lRSoMSMsTaPykP3tBHa48sUg4Yel/n0qZ16Y= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1711654320; c=relaxed/simple; bh=ioVBxNL6RiYBXwxZCjg5XLQJjsF/UPRoMAqrBWo6zwM=; h=Date:From:To:Cc:Subject:Message-ID:References:MIME-Version: Content-Type:Content-Disposition:In-Reply-To; b=FdWJuYoIfevtJ/uyzgB2xGzrR7G6Pah8mXr9ynX+TtbVj+lfn3frUJejdP/iqiUGN5RkdR2+hu7CVEw/k0BMb3P1Zc3p7KYH70Lev790H1kTf+h2bmlJQ8t/bLKME9iuAAcrSbQa58xB6FCt0Ar2qUJMTHJ0FhaVT/MduzeQFro= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=fail (p=none dis=none) header.from=kernel.org; spf=pass smtp.mailfrom=gmail.com; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b=aMt6Crun; arc=none smtp.client-ip=209.85.214.170 Authentication-Results: smtp.subspace.kernel.org; dmarc=fail (p=none dis=none) header.from=kernel.org Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=gmail.com Received: by mail-pl1-f170.google.com with SMTP id d9443c01a7336-1def2a1aafaso10412015ad.3; Thu, 28 Mar 2024 12:31:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1711654319; x=1712259119; darn=vger.kernel.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:sender:from:to:cc:subject:date:message-id :reply-to; bh=JhfbUSiwIuT8LIHU0+RkNyojAQTzCsx1VSv7AHZemnA=; b=aMt6CrunNF7J86g+EklPw4f4E1LqKYAs6pGxWI54QIt9MeHTak4hCeMKwjNPLvFPhz 8WQ5rWyGvBW/1sahvQ+tC56YBSPfVkmAQosYmzH+CNoPZC1UEbADg23OZlHFcqleww/P PVB1v+k8NZ79tpjen8zp/69UghIW80B4TW32wZOi5XlZL9BawrCtiAWV5pun1u3QH9SQ vzyrjeLStcbFj9vVRW6rJ/3BrzVaFZtM/Z5YdF7CdYFZcsMC2EGcPrRMkpLKinV2FQer cKh3zy4MksGLFd/wT44rsco4EnDTwvRDoHuko1d7ci3j0Ucw9CV8LiS//KqCCcPH2Dig ULTw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1711654319; x=1712259119; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:sender:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=JhfbUSiwIuT8LIHU0+RkNyojAQTzCsx1VSv7AHZemnA=; b=AGP0kxZJ1gvzgYgkUO93tmsKFg2fUtwG5vvlPFXZjchSj9uZDSKjJ/cAJze8Gr1wvH z1xoS4v+F4miCdsj2c0Mw5UCXKfJlMszxZTamla+8nVL1KJwIVE0WhvLkqsiWjMFtJyG dETo/0XbL7Et+3vAC8dypF1/8hUo9xtVEcfBtUCH7W0IQHwO0TETrosuCtAJBiiaqLnX e0S0qs8rM6hBWJ4nW8YkMYeW1NaXUFBlUwq1WqS6BHwpK94dG11KPUyRrTGwupE1OyMB duFByuLd7fGHlD3lpRLLvmzXO5TA2Qma+wEq9gJ402mugHhW8yeBg0eXggxiJyPJZmXC vTJA== X-Forwarded-Encrypted: i=1; AJvYcCUD6EeilGA8bKqvpbeStc6CdPCjB6KrfN1AEmZjoWCoCNhrcm6B4EF3NrBu4S+FfBbcb2/dugm+hFtNEC/h5n5IDJnzUFqTAPO+eQmtMuBbR/sx/hHpWVlDTWOSWabBUN61wmWinlVH3YbEfw== X-Gm-Message-State: AOJu0YzCM1Lk/uYUU1I3cvxdBRk0TENfKxQHJOt+ebY9jr0T+2LQjREU o8waNH/i7tF0MB6DOkna8EwSy+ADblbL2K7Kv06bFq806uivm0H/ X-Received: by 2002:a17:902:f54e:b0:1e0:a2cf:62f2 with SMTP id h14-20020a170902f54e00b001e0a2cf62f2mr491565plf.23.1711654318736; Thu, 28 Mar 2024 12:31:58 -0700 (PDT) Received: from localhost (dhcp-141-239-158-86.hawaiiantel.net. [141.239.158.86]) by smtp.gmail.com with ESMTPSA id i17-20020a17090332d100b001e0d88c908bsm1989805plr.281.2024.03.28.12.31.58 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 28 Mar 2024 12:31:58 -0700 (PDT) Sender: Tejun Heo Date: Thu, 28 Mar 2024 09:31:57 -1000 From: Tejun Heo To: Kent Overstreet Cc: Kemeng Shi , akpm@linux-foundation.org, willy@infradead.org, jack@suse.cz, bfoster@redhat.com, dsterba@suse.com, mjguzik@gmail.com, dhowells@redhat.com, linux-kernel@vger.kernel.org, linux-mm@kvack.org, linux-fsdevel@vger.kernel.org Subject: Re: [PATCH v2 0/6] Improve visibility of writeback Message-ID: References: <20240327155751.3536-1-shikemeng@huaweicloud.com> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: Hello, Kent. On Thu, Mar 28, 2024 at 03:24:35PM -0400, Kent Overstreet wrote: > fs/bcachefs/time_stats.c has some code that's going to be moving out to > lib/ at some point, after I switch it to MAD; if you could hook that up > as well to a few points we could see at a glance if there are stalls > happening in the writeback path. Using BPF (whether through bcc or bpftrace) is likely a better approach for this sort of detailed instrumentation. Fixed debug information is useful and it's also a common occurrence that they don't quite reveal the full picture of what one's trying to understand and one needs to dig a bit deeper, wider, aggregate data in a different way, or whatever. So, rather than adding more fixed infrastructure, I'd suggest adding places which can easily be instrumented using the existing tools (they are really great once you get used to them) whether that's tracepoints or just strategically placed noinline functions. Thanks. -- tejun