Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
From:   Ajay Kaher <akaher@vmware.com>
To:     rostedt@goodmis.org, mhiramat@kernel.org, shuah@kernel.org
Cc:     linux-kernel@vger.kernel.org, linux-trace-kernel@vger.kernel.org,
        linux-kselftest@vger.kernel.org, chinglinyu@google.com,
        namit@vmware.com, srivatsa@csail.mit.edu, amakhalov@vmware.com,
        vsirnapalli@vmware.com, tkundu@vmware.com, er.ajay.kaher@gmail.com,
        Ajay Kaher <akaher@vmware.com>
Subject: [PATCH v3 00/10] tracing: introducing eventfs
Date:   Thu,  1 Jun 2023 14:30:03 +0530
Message-Id: <1685610013-33478-1-git-send-email-akaher@vmware.com>
Content-Type: text/plain
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?8qiBejyOGrKzvjlUnZE60JsNOJZW5WvEu/iBEbwdELwhPVj3zgZfb1Nas1Zi?=
 =?us-ascii?Q?bacQvDn5s/lVBbXPwpX9HNd0fdYU7Ep6cDXGz+LPp6WopvAWbXlhTSVXSznH?=
 =?us-ascii?Q?4yPQJDUn7Zq1rnLIw/iinc4rx7GCL2WEjZcoS9bBPbEE0CY7SNULLXq6tR2s?=
 =?us-ascii?Q?ob4C6ZxeQg3HVe3MLu3IyrbgczOoSiPYcH8WQR/XKTua0XjZTD/nMm+7IgM2?=
 =?us-ascii?Q?ZonYrjpLVn46zoi8ZpMqUjNn2s9JUEgkc4xdOyKl6mvAlMGgI9tlKlEoUQYO?=
 =?us-ascii?Q?cV7CBJL6OLpO2tFHOIjnw4W/yY0CX65Dlvr/ahL2jJsx5sKs1skDspb/OC+a?=
 =?us-ascii?Q?++f1RkDs0MoBSDWSIMsZoIv1Ix58+drGat4gyPvUkoNG5//6j2QGMdwG3LJ5?=
 =?us-ascii?Q?csPZjGfBDjPqsMTv/sVpqYSGkSdrQgpQTXsV0IR1LywaTO3gZiypSHj9Mtq2?=
 =?us-ascii?Q?8TY3T4Svh545xU6pFPyOhmez2CWHVYsu/6EF2j7nMC26T+FJkR7PC3UIMZ+h?=
 =?us-ascii?Q?yGf5vern0wQ2DGmvZIDOVQI82vocRIOcbbJe0iy7MHI3nHOQ/VZ2/4XV57rL?=
 =?us-ascii?Q?HErQRgFrErLB9J6Gf20PdGmNjVSyohLFKPGLvpBR6vDSreCa4Fs0F+nSGTAC?=
 =?us-ascii?Q?GQ9Ej9OII5XX+ekU4gw6G9IspJqSknu09iN+2YwVegIFomELWFGOOk3xvB/1?=
 =?us-ascii?Q?QxG15PWmpWyrjxEj73l11ywD+htELoksZmQHit0mi+vQKtmdpl8DF1dfFHYt?=
 =?us-ascii?Q?CSrMCQ7l8nnECztO9Mt12CCwK+9qRkTNd57IEyDf2wBzRzB9oZ8vdp8meaSG?=
 =?us-ascii?Q?UNPQFmUzIYYtTeE7vh7W6Fp3w6EjiWoYWIqvLNM6Rlv2ltFF8whP90aTKV5U?=
 =?us-ascii?Q?QOuv/Rbzly90bLx2ttu9UyXpT4ZQ9ZiXRfJfShotsCniT120sYQZIx1HDABN?=
 =?us-ascii?Q?bgnAk8XB/8DVYc6n67RxJN3qNWP8jg6vSw5/wgE2eo76jt4Vt3fbiOOobUwf?=
 =?us-ascii?Q?B34iHZ+joqPXMHg3ZZHh5XAqQ/mVlaLK+Lhg4RUpdGgkYSqnZj1U0saHl73n?=
 =?us-ascii?Q?devTrr8L2+ok7oOI7Owack16PSVD+6cpqlltLaWr9IRTxXmVXXSjRjGsdTNi?=
 =?us-ascii?Q?dcZYuckFoWlYFQrybYIxzQ//vo8LPEamVVujGOVXvLv2FN7zfHawNb/p6eCC?=
 =?us-ascii?Q?3CCDPc51BU+qp6P1qwT/lu+SHx/c8aVmk8Odn1frKd/+7NBKFAgmRs4jON57?=
 =?us-ascii?Q?psR69dVEeBnCs0Yh/3U+HwjW7kS77uKp6Ov+pA/J23hwMmTFe7QXRswJbklO?=
 =?us-ascii?Q?YzsrPY1jA8sefPzYSYAmFbd3Upq49CtqifrDxFdJ1hvs0xd0/4VGVlzq+cmR?=
 =?us-ascii?Q?7VGscj3rRgKle1dlffnrEG2sIz2c6DT2rlJSZqkwwZc2ElFl3KEkWPVlrZeD?=
 =?us-ascii?Q?Pt7HTIqTQFx7iVZ9BoWByWsAGqbGndz+7ED4VHUxWU2HlVm8mW6CJn3szNsH?=
 =?us-ascii?Q?flHiyzb98tqhaAzOFnKVBpkdqlEjIu2OsiIIYJ0UWWeOIJIFnWOeqaym83b/?=
 =?us-ascii?Q?fjaE3fuy0QsoRRum+/38FoUUlsEY6kwV7+kScj7Z?=
X-OriginatorOrg: vmware.com
X-MS-Exchange-CrossTenant-Network-Message-Id: f27c6882-996f-40b7-033f-08db627eb4d1
X-MS-Exchange-CrossTenant-AuthSource: PH0PR05MB8703.namprd05.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 01 Jun 2023 09:00:54.4282
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: b39138ca-3cee-4b4a-a4d6-cd83d9dd62f0
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: H70jLVt9kXIScuUAGou17hMqCdeg/SsgCbG0x1o/l7YgjSl03ErBQcZrHgfFk7DSkn2FaTFyOqCelz7PO0o90A==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW4PR05MB8617
X-Spam-Status: No, score=-2.3 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH,
        DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_NONE,
        SPF_HELO_NONE,SPF_NONE,T_SCC_BODY_TEXT_LINE autolearn=ham
        autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

Events Tracing infrastructure contains lot of files, directories
(internally in terms of inodes, dentries). And ends up by consuming
memory in MBs. We can have multiple events of Events Tracing, which
further requires more memory.

Instead of creating inodes/dentries, eventfs could keep meta-data and
skip the creation of inodes/dentries. As and when require, eventfs will
create the inodes/dentries only for required files/directories.
Also eventfs would delete the inodes/dentries once no more requires
but preserve the meta data.

Tracing events took ~9MB, with this approach it took ~4.5MB
for ~10K files/dir.

v2:
Patch 01: new patch:'Require all trace events to have a TRACE_SYSTEM'
Patch 02: moved from v1 1/9
Patch 03: moved from v1 2/9
          As suggested by Zheng Yejian, introduced eventfs_prepare_ef()
          helper function to add files or directories to eventfs
          fix WARNING reported by kernel test robot in v1 8/9
Patch 04: moved from v1 3/9
          used eventfs_prepare_ef() to add files
          fix WARNING reported by kernel test robot in v1 8/9
Patch 05: moved from v1 4/9
          fix compiling warning reported by kernel test robot in v1 4/9
Patch 06: moved from v1 5/9
Patch 07: moved from v1 6/9
Patch 08: moved from v1 7/9
Patch 09: moved from v1 8/9
          rebased because of v3 01/10
Patch 10: moved from v1 9/9

v1:
Patch 1: add header file
Patch 2: resolved kernel test robot issues
         protecting eventfs lists using nested eventfs_rwsem
Patch 3: protecting eventfs lists using nested eventfs_rwsem
Patch 4: improve events cleanup code to fix crashes
Patch 5: resolved kernel test robot issues
         removed d_instantiate_anon() calls
Patch 6: resolved kernel test robot issues
         fix kprobe test in eventfs_root_lookup()
         protecting eventfs lists using nested eventfs_rwsem
Patch 7: remove header file
Patch 8: pass eventfs_rwsem as argument to eventfs functions
         called eventfs_remove_events_dir() instead of tracefs_remove()
         from event_trace_del_tracer()
Patch 9: new patch to fix kprobe test case

 fs/tracefs/Makefile                           |   1 +
 fs/tracefs/event_inode.c                      | 757 ++++++++++++++++++
 fs/tracefs/inode.c                            | 124 ++-
 fs/tracefs/internal.h                         |  25 +
 include/linux/trace_events.h                  |   1 +
 include/linux/tracefs.h                       |  49 ++
 kernel/trace/trace.h                          |   3 +-
 kernel/trace/trace_events.c                   |  78 +-
 .../ftrace/test.d/kprobe/kprobe_args_char.tc  |   4 +-
 .../test.d/kprobe/kprobe_args_string.tc       |   4 +-
 10 files changed, 994 insertions(+), 52 deletions(-)
 create mode 100644 fs/tracefs/event_inode.c
 create mode 100644 fs/tracefs/internal.h

-- 
2.40.0