Received: by 2002:a05:7412:d8a:b0:e2:908c:2ebd with SMTP id b10csp3174692rdg; Tue, 17 Oct 2023 06:57:51 -0700 (PDT) X-Google-Smtp-Source: AGHT+IFobXtQkrd9UZ3dlzYHGmFnq3CmpPIIDi7uCRdryxGzXrlEhuwCYllTIYewEInqsDgZIvhh X-Received: by 2002:a17:90b:4c0a:b0:27d:5568:e867 with SMTP id na10-20020a17090b4c0a00b0027d5568e867mr3072394pjb.9.1697551071110; Tue, 17 Oct 2023 06:57:51 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1697551071; cv=none; d=google.com; s=arc-20160816; b=IzP4OfY6pkPKaLotSV8YKlxJTa/PTgabxNeCoctqKUWUxNax/Um26iJLxuKzr1nI4G 05puycp4JDmB8GPTHqixeGNtAUHic+kac2Bg5P22WvFQV2ayPTSZHQZ+ZKQJYADjzB73 XfwNlo/KeY3by/0CkX3jLKL2luedrjMfrdaWRN0+PE4QNtV3Z3JuSCK3x2VVJQ1OZBiZ 3PPsDTnTvDHAIlSxT8ke6a3x2dtVMctt/m5WYcO7B/LnCMDM8hYXSInxK7lEhhFj/8o9 TiFclqLJtk3HdAkBWU+xvBnJ2+Mrad6+0IGhltAnoyouKkuUidF0RoDMn3VJYGZMDWLV taMA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=o2olN8CS4kwWpq+8wsnt0IT2xZ6oZLNjhXVzv2yHZDk=; fh=IpZUYbsqKid0r4pbePo9OTESEiKTs4Y7HhR29dJG614=; b=zWktz2fltrs6OkljzclopFrLEvsE0vbnqhJ1dRsfa+nudd/ciqSLSyKvVJ8CUu02um NgHYWU2ROsbnSzKgjENSaAVqNrHix0BTGh6v7y1Twlkd3aRXuJu0QDBqu4qImVHLzKNi 4Ck238vSs0R7yNZf0RU19lqNv7NNRit9W+UeqqTchOBKFYHysAQJDteYG845YpH98fTb utpo0sCKkyHEFOyyFrb3hj4W+fy2YlOoidvOQEl2cJX23yd+2q8eH+EZ0j1zNuaQie/m 5ltKa3GUtG6IBrCAYElC1bExc4nKDeREo/SHBIDQQnpCWJLTTKZ2zm8vIRXgyFCyyj7B TuSQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@bytedance.com header.s=google header.b=Ji2OX7Xm; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.33 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=QUARANTINE sp=QUARANTINE dis=NONE) header.from=bytedance.com Return-Path: Received: from lipwig.vger.email (lipwig.vger.email. [23.128.96.33]) by mx.google.com with ESMTPS id hk8-20020a17090b224800b00274caaa057asi9170468pjb.42.2023.10.17.06.57.50 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 17 Oct 2023 06:57:51 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.33 as permitted sender) client-ip=23.128.96.33; Authentication-Results: mx.google.com; dkim=pass header.i=@bytedance.com header.s=google header.b=Ji2OX7Xm; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.33 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=QUARANTINE sp=QUARANTINE dis=NONE) header.from=bytedance.com Received: from out1.vger.email (depot.vger.email [IPv6:2620:137:e000::3:0]) by lipwig.vger.email (Postfix) with ESMTP id CF71F80CE7EA; Tue, 17 Oct 2023 06:57:45 -0700 (PDT) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.10 at lipwig.vger.email Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S235025AbjJQN5e (ORCPT + 99 others); Tue, 17 Oct 2023 09:57:34 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:46622 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1343944AbjJQN5b (ORCPT ); Tue, 17 Oct 2023 09:57:31 -0400 Received: from mail-pl1-x636.google.com (mail-pl1-x636.google.com [IPv6:2607:f8b0:4864:20::636]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 536F7EA for ; Tue, 17 Oct 2023 06:57:09 -0700 (PDT) Received: by mail-pl1-x636.google.com with SMTP id d9443c01a7336-1c9e95aa02dso36723045ad.0 for ; Tue, 17 Oct 2023 06:57:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bytedance.com; s=google; t=1697551029; x=1698155829; darn=vger.kernel.org; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:from:to:cc:subject:date:message-id:reply-to; bh=o2olN8CS4kwWpq+8wsnt0IT2xZ6oZLNjhXVzv2yHZDk=; b=Ji2OX7XmG8xiCocwGho/BF41XdMXDsGn/ZaoQK/VaAQyZkv6iGVHAURksq/YnsPJvK C5xgBof2NqPgDT5G5NJqUlM9iAeZ0aaKxdY6iosKpo8IBM5NiZGzDCdRMBFFPC8Nr4HQ 6Yw9FbjG5GOF6WVrjcS/NvwQb7lMkRX0duQJDVrUulI2b8SZSjkzRHkdAGHgCx6co65e Xmts18aa+UDvDJYDlnewPEQ7Tl4sW+efz4USjRQ710i5VJDytJoHMUIrn+UcURq/oj0N 6qpmJnq28klDR1XKU7PGS4I9jmDtS4DmVOJ7I5ZFO/KC1rl9gfF3ngw3boBAT2KqVIiP GBCg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1697551029; x=1698155829; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=o2olN8CS4kwWpq+8wsnt0IT2xZ6oZLNjhXVzv2yHZDk=; b=KTRyl/PuPVplbSKI/YpBeIReeel7OVRNJwoQ0ov70d7MjJOegsAJzumqysL7Y8T9Dm xMj0grw3g2XWnLYLOovANnR1Bn6o3eoSMvf8rhfFzft/3crkIVa19p9Sa9Yrgc83A6i/ VwgIlX0VDfaQYtDaK+RxZ1WPT+g2YaF5xqbH5sU9a1S1gAEISZMyZ52JQgRIDhMMoRGJ /+ZDKLGrd7OrHNFLtNURm+azc5/vX7TnadUzsZ0oAXAvtu4bx0TY/bifI1C3ZhDGE0aq Lc4xpMqxbMw+mJYzdwYCUsyZR6w4Kry9kCp/a2Kh1Eq+vQ+BwZx4fpHJbVcxNE4r/54L IjMQ== X-Gm-Message-State: AOJu0Yyco2yK2I0h1PQwr0QbnEPxmRHKcl832DjW+sHSHZLHNQrT1vLm f+NdDbhr8NOiTRBlSs17l/cxAQ== X-Received: by 2002:a17:902:e887:b0:1c9:ece9:53c6 with SMTP id w7-20020a170902e88700b001c9ece953c6mr2990072plg.29.1697551028775; Tue, 17 Oct 2023 06:57:08 -0700 (PDT) Received: from devz1.bytedance.net ([203.208.167.147]) by smtp.gmail.com with ESMTPSA id b9-20020a170903228900b001b9e9edbf43sm1566634plh.171.2023.10.17.06.57.02 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 17 Oct 2023 06:57:08 -0700 (PDT) From: "wuqiang.matt" To: linux-trace-kernel@vger.kernel.org, mhiramat@kernel.org, davem@davemloft.net, anil.s.keshavamurthy@intel.com, naveen.n.rao@linux.ibm.com, rostedt@goodmis.org, peterz@infradead.org, akpm@linux-foundation.org, sander@svanheule.net, ebiggers@google.com, dan.j.williams@intel.com, jpoimboe@kernel.org Cc: linux-kernel@vger.kernel.org, lkp@intel.com, mattwu@163.com, "wuqiang.matt" Subject: [PATCH v11 0/5] lib,kprobes: kretprobe scalability improvement Date: Tue, 17 Oct 2023 21:56:49 +0800 Message-Id: <20231017135654.82270-1-wuqiang.matt@bytedance.com> X-Mailer: git-send-email 2.40.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-0.8 required=5.0 tests=DKIM_SIGNED,DKIM_VALID, DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI, SPF_HELO_NONE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lipwig.vger.email Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (lipwig.vger.email [0.0.0.0]); Tue, 17 Oct 2023 06:57:45 -0700 (PDT) This patch series introduces a scalable and lockless ring-array based object pool to improve scalability of kretprobed routines. v11: *) patchset rebased to branch probes/core of linux-trace.git *) objpool: objpool_fini optimized for better code readability *) test_objpool: asynchronous releasing of objpool now covered wuqiang.matt (5): lib: objpool added: ring-array based lockless MPMC lib: objpool test module added kprobes: kretprobe scalability improvement with objpool kprobes: freelist.h removed MAINTAINERS: objpool added MAINTAINERS | 7 + include/linux/freelist.h | 129 -------- include/linux/kprobes.h | 11 +- include/linux/objpool.h | 176 ++++++++++ include/linux/rethook.h | 16 +- kernel/kprobes.c | 93 +++--- kernel/trace/fprobe.c | 32 +- kernel/trace/rethook.c | 90 +++-- lib/Kconfig.debug | 11 + lib/Makefile | 4 +- lib/objpool.c | 286 ++++++++++++++++ lib/test_objpool.c | 689 +++++++++++++++++++++++++++++++++++++++ 12 files changed, 1270 insertions(+), 274 deletions(-) delete mode 100644 include/linux/freelist.h create mode 100644 include/linux/objpool.h create mode 100644 lib/objpool.c create mode 100644 lib/test_objpool.c -- 2.40.1