Received: by 2002:a05:6a10:22f:0:0:0:0 with SMTP id 15csp637897pxk; Thu, 24 Sep 2020 14:37:03 -0700 (PDT) X-Google-Smtp-Source: ABdhPJwhlBrxwX4IwfwOeyT0s0O64dvAk4eTLMCWJeutPJgE4itNyCtdqUJhL34T/XoVsd0qhNXt X-Received: by 2002:a05:6402:84f:: with SMTP id b15mr800374edz.149.1600983422961; Thu, 24 Sep 2020 14:37:02 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1600983422; cv=none; d=google.com; s=arc-20160816; b=n4Wup1hFF3yai0UNmW9JCsQqYzPoBuDb4GuFOsyRca2Rr0WgzbCdxE6kPe009ovcxV bsj4BfB7fvKBHi0fSYqWmjudrX3g8KStMIHSIz19TGc+7hNPXi+MoJ/CHYtaQjq6YqSM j8AFYLBrND7417Y9W3zC8pJ5eOWFgzolUZgZr1dNuxcppqCZa/qIW3QhZmBotlTdo8SQ jTLELR+YdsZBkzrwNR2aos2eG2G06oFc2RUe+XBmqBeN3k0xfkZH9hkVXfmAz2fclPwZ G4Y4BjArcC1bby0wcCCJnFCDdNKGX6pxncQqdgUfaU/gCu7HGr24HZODOTCqlQ61MRDJ 9w8g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:user-agent:in-reply-to:content-disposition :mime-version:references:message-id:subject:cc:to:from:date :dkim-signature:dkim-filter; bh=BFaJcK18CtbE4vBse24BNdUGu+VsbVEXCvynMAwFkjs=; b=vhNNxnk4GdQO+05TUOqo/rNvP9nh6TF5pll5DryEhBurQO/4stxbUIdpzLKifhEQE6 NwaSNlTVAo4vfQR33r7eHt8+ZmV+Ecn9bUpsdR53oj1SEmuGvJzSee+jwXH/8Rlr22N3 wADZ2Nl0tJ+lmpot8NHxlR9jtoxTrBrdxtSkkKemEPa7ClooN6nxxWDXXHvXTRQIKf+e pnY8cwIIz7ZNSgEDDzZgKW2hFa3wH+gNOFWnAE5wMMfx4/5LZaZ3/WDSLNc7FiJNSYrr uObOvsqRB4aGGM2mBN9JMI+cyWsRJ69hUHUZtpENuZNCqMth7O7TZh28E67YsNKjs/2m j/bg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@fieldses.org header.s=default header.b=xIkJ7mso; spf=pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-nfs-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id c61si453508edf.394.2020.09.24.14.36.26; Thu, 24 Sep 2020 14:37:02 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@fieldses.org header.s=default header.b=xIkJ7mso; spf=pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-nfs-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726621AbgIXVgV (ORCPT + 99 others); Thu, 24 Sep 2020 17:36:21 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:39098 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726487AbgIXVgT (ORCPT ); Thu, 24 Sep 2020 17:36:19 -0400 Received: from fieldses.org (fieldses.org [IPv6:2600:3c00:e000:2f7::1]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 041C7C0613CE for ; Thu, 24 Sep 2020 14:36:19 -0700 (PDT) Received: by fieldses.org (Postfix, from userid 2815) id 8FB22C56; Thu, 24 Sep 2020 17:36:17 -0400 (EDT) DKIM-Filter: OpenDKIM Filter v2.11.0 fieldses.org 8FB22C56 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=fieldses.org; s=default; t=1600983377; bh=BFaJcK18CtbE4vBse24BNdUGu+VsbVEXCvynMAwFkjs=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=xIkJ7msoHrvGxqzGeko/VarWihRZlyMMlUNVe2LVjneqUDjbJzz8sbyy17wmNVULh ikIfbQC0Hdk1nR6Y6Go3ADPeVpPVHZnXOuZ3L3aUFXs5pwVFB9ItcBf8Uf9WRdKGXc hwhvDjko0i0N/Z+tNcth7wkXpWCFmvv8fG9QJQUE= Date: Thu, 24 Sep 2020 17:36:17 -0400 From: "J. Bruce Fields" To: Chuck Lever Cc: Bill.Baker@oracle.com, linux-nfs@vger.kernel.org Subject: Re: [PATCH v2 00/27] NFSD operation monitoring tracepoints Message-ID: <20200924213617.GA12407@fieldses.org> References: <160071167664.1468.1365570508917640511.stgit@klimt.1015granger.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <160071167664.1468.1365570508917640511.stgit@klimt.1015granger.net> User-Agent: Mutt/1.5.21 (2010-09-15) Precedence: bulk List-ID: X-Mailing-List: linux-nfs@vger.kernel.org On Mon, Sep 21, 2020 at 02:10:49PM -0400, Chuck Lever wrote: > As I've been working on various server bugs, I've been adding > tracepoints that record NFS operation arguments. Here's an updated > snapshot of this work for your review and comment. > > The idea here is to provide a degree of NFS traffic observability > without needing network capture. Tracepoints are generally lighter- > weight than full network capture, allowing effective capture-time > data reduction: I do wonder when tracepoints seem to duplicate information you could get from network traces, so thanks for taking the time to explain this. It makes sense to me. The patches look fine. The only one I'm I'm on the fence about is the last with the split up of the dispatch functions. I'll ask some questions there.... --b. > > - One or a handful of these can be enabled at a time > - Each tracepoint records much less data per operation than capture > - Extra capture-time filtering can reduce data amount even further > - Some of these operations are infrequent enough that their > tracepoint could be enabled persistently without a significant > performance impact (for example, for security auditing) > > The topic branch has been updated as well: > > git://git.linux-nfs.org/projects/cel/cel-2.6.git nfsd-more-tracepoints > > > Changes since RFC: > * s/SPDK/SPDX and corrected the spelling of Christoph's surname > * Fixed a build error noticed by > * Introduced generic headers for VFS and NFS protocol display macros > * nfsd4_compoundstatus now displays NFS4ERR codes symbolically > * The svc_process tracepoint now displays the RPC procedure symbolically > * NFSD dispatcher now displays procedure names and status codes symbolically > * fh_verify tracepoint tentatively included; it adds a lot of noise, but perhaps not much value > * Cleaned up the remaining PROC() macros in the server code > * Removed trace_printk's that were introduced during the RFC series > * Removed redundant nfsd4_close tracepoint > > --- > > Chuck Lever (27): > NFS: Move generic FS show macros to global header > NFS: Move NFS protocol display macros to global header > NFSD: Add SPDX header for fs/nfsd/trace.c > SUNRPC: Move the svc_xdr_recvfrom() tracepoint > SUNRPC: Add svc_xdr_authenticate tracepoint > lockd: Replace PROC() macro with open code > NFSACL: Replace PROC() macro with open code > SUNRPC: Make trace_svc_process() display the RPC procedure symbolically > NFSD: Clean up the show_nf_may macro > NFSD: Remove extra "0x" in tracepoint format specifier > NFSD: Constify @fh argument of knfsd_fh_hash() > NFSD: Add tracepoint in nfsd_setattr() > NFSD: Add tracepoint for nfsd_access() > NFSD: nfsd_compound_status tracepoint should record XID > NFSD: Add client ID lifetime tracepoints > NFSD: Add tracepoints to report NFSv4 session state > NFSD: Add a tracepoint to report the current filehandle > NFSD: Add GETATTR tracepoint > NFSD: Add tracepoint in nfsd4_stateid_preprocess() > NFSD: Add tracepoint to report arguments to NFSv4 OPEN > NFSD: Add a tracepoint for DELEGRETURN > NFSD: Add a lookup tracepoint > NFSD: Add lock and locku tracepoints > NFSD: Add tracepoints to record the result of TEST_STATEID and FREE_STATEID > NFSD: Rename nfsd_ tracepoints to nfsd4_ > NFSD: Add tracepoints in the NFS dispatcher > NFSD: Replace dprintk callsites in fs/nfsd/nfsfh.c > > > fs/lockd/svc4proc.c | 263 +++++++++-- > fs/lockd/svcproc.c | 265 +++++++++-- > fs/nfs/callback_xdr.c | 2 + > fs/nfs/nfs4trace.h | 387 ++-------------- > fs/nfs/nfstrace.h | 113 +---- > fs/nfs/pnfs.h | 4 - > fs/nfsd/nfs2acl.c | 79 +++- > fs/nfsd/nfs3acl.c | 54 ++- > fs/nfsd/nfs3proc.c | 25 + > fs/nfsd/nfs4callback.c | 28 +- > fs/nfsd/nfs4layouts.c | 16 +- > fs/nfsd/nfs4proc.c | 43 +- > fs/nfsd/nfs4state.c | 100 ++-- > fs/nfsd/nfsd.h | 1 + > fs/nfsd/nfsfh.c | 36 +- > fs/nfsd/nfsfh.h | 7 +- > fs/nfsd/nfsproc.c | 21 + > fs/nfsd/nfssvc.c | 198 +++++--- > fs/nfsd/trace.c | 1 + > fs/nfsd/trace.h | 844 ++++++++++++++++++++++++++++++---- > fs/nfsd/vfs.c | 18 +- > fs/nfsd/xdr4.h | 3 +- > include/linux/nfs4.h | 4 + > include/linux/sunrpc/svc.h | 1 + > include/trace/events/fs.h | 30 ++ > include/trace/events/nfs.h | 511 ++++++++++++++++++++ > include/trace/events/sunrpc.h | 33 +- > include/uapi/linux/nfsacl.h | 2 + > net/sunrpc/svc_xprt.c | 4 +- > net/sunrpc/svcauth.c | 5 +- > 30 files changed, 2187 insertions(+), 911 deletions(-) > create mode 100644 include/trace/events/nfs.h > > -- > Chuck Lever