Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:7 as permitted sender) client-ip=2620:137:e000::3:7;
From:   Bixuan Cui <cuibixuan@vivo.com>
To:     rostedt@goodmis.org, mhiramat@kernel.org,
        mathieu.desnoyers@efficios.com, akpm@linux-foundation.org
Cc:     linux-kernel@vger.kernel.org, linux-trace-kernel@vger.kernel.org,
        linux-mm@kvack.org, cuibixuan@vivo.com, opensource.kernel@vivo.com
Subject: [PATCH -next 0/2] Make memory reclamation measurable
Date:   Mon, 11 Dec 2023 19:26:38 -0800
Message-Id: <20231212032640.6968-1-cuibixuan@vivo.com>
Content-Type: text/plain
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?xBs3z3510o0TdFDuiwCt+FSgRHD2RzHltf4Jb+3iKB00ymStJQGTMOHmJS78?=
 =?us-ascii?Q?dnYYfAqCJwIGwEadr1PXPJn+tm04sp3RVN2M+VWfVtETHHDDIEmpGzgakYMF?=
 =?us-ascii?Q?Hyr/+wo2kAuB5to/gn2S+MyuPZ83KMJ2DNv9fksrxmKHoKB5KOAITYRjmjv/?=
 =?us-ascii?Q?gJgR0Ozv/qU1275z98jxUfVUkOLrRs6SxNoRCt4MW655hoJKFQjV6qmfpEJP?=
 =?us-ascii?Q?z7c+6DOu56Vz05ek+kEz4HfwMoEjTGBc6PsRT3oyvyLMml4RhldJXXLut2PL?=
 =?us-ascii?Q?LAUDn4lRJIwsyWYZvSoys9VLHK2l2jWOPgAbbH47JFvScSDpb4JitM9b8F8b?=
 =?us-ascii?Q?CX3w8+Mu2oyGVaA5P3QCAULnbQcrUrCLCgYjpGfArT30SPzIKTHZoUqJQ04+?=
 =?us-ascii?Q?1LnoWay3hH7uQUUew6eQ2jefEucKdYAXDk5yqnrN+2ggmU8dPyIr5HP487E8?=
 =?us-ascii?Q?IBy1wwi2RUen7Bp3SDUNdxluhNbhTYlv58MXfYGnPIvGnJJHMrH/Q85XnEdc?=
 =?us-ascii?Q?PX8ONWnUQdn9V6yd2eo8Nd9jexQdZl+EQaZDbCEciMgyGmmaNyuwxYHv9CC2?=
 =?us-ascii?Q?9PoL77SB/CrTT0PUpTrg3SnfV70UNvIzFWqTjTzFtB+y3Ch7p75K0W4zPHd4?=
 =?us-ascii?Q?flHb1dNu4iyTvQsneMswAJTtGJUUKKMrxp3BKiFzp5tj7f7hcEZg5mi1H2AQ?=
 =?us-ascii?Q?EuqwBqt+ymxbkesPRUsPjuGTfBCclEg7Zck6uxJi4wPG4EoI084y4I8vFPqO?=
 =?us-ascii?Q?C04sgLHjvI9hOvKNx1cR3S4MwaWqw6pXWNPa8pD/qfD2xsesWOi1qkuoCWqz?=
 =?us-ascii?Q?k+PdTAkqClwyBvOhVThQ5FvqknTsAa1vbjAZLDK9TCm2xuBWKBF4IHpfSrqA?=
 =?us-ascii?Q?EDlMuxFzoEYljgBhzOCaq3DCwQA/euTuIPRvLAivg6k+gRAMDgvbU9CeuPd+?=
 =?us-ascii?Q?KmGINgMFqEHOKlFbpU/lkujIP7SSf3fdj640R41Drmd8qs7jPkxm2zbnwPn9?=
 =?us-ascii?Q?0IZiS5t4pH/KmswhJVJN0mJe8kuGTTyBqKXi2gKKTTfBa5ml1MkDsKN2DvQ1?=
 =?us-ascii?Q?P3qhkZNsvFrK6H5jSmYB8pHvZDlEWTVG0RC3FPux/vO9yY3p8VJo0asfDkV0?=
 =?us-ascii?Q?/G881JYOk9m9bTXnWSgxPASx0vaYaXSLii7kkEVN88dRqSwxoINunbJvyBr1?=
 =?us-ascii?Q?4p3cAxZBe9XwMzljTCZRjti5EjwV6S3zkb3f6MWye6+5wl6suaf90MEQwHRn?=
 =?us-ascii?Q?ftLy1Kl07hYVpqNV8xBLAvOjb9+yyqbi6T0VuyWgrBLrbbSEJepjJBCxEkmb?=
 =?us-ascii?Q?ahx3qiJx6dMuDCq/27WXcXk5PSQ2Wa1APVELVcfXWmlT9Nr4o80jEFsJMA4z?=
 =?us-ascii?Q?yRmMEywhgIv1G7krD79JO2xFNfQPjjTm57DqZm+mIuVvE5Qzhn+97ujNPAZE?=
 =?us-ascii?Q?6QVVjfPr6gjeUyQX5CM9coQ2I/suHvbQmdNrqBCMNO8lEBWPQVh7Y8YVBMlQ?=
 =?us-ascii?Q?5+5y9sSOKqZMSEYaKDPh0l4bA/60Aa7R4YqjTUrKUP+GeI0sRnI2EqKjI+is?=
 =?us-ascii?Q?y1OMwJmYOg2fLbyP1Mc/TU5bbwEAlTmUAlbC9ZTO?=
X-OriginatorOrg: vivo.com
X-MS-Exchange-CrossTenant-Network-Message-Id: ed4b0beb-2099-478a-da55-08dbfac23250
X-MS-Exchange-CrossTenant-AuthSource: TYZPR06MB4045.apcprd06.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 12 Dec 2023 03:26:57.9248
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 923e42dc-48d5-4cbe-b582-1a797a6412ed
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: z+waUGiq4mEdIY61ecD0Jn/hIU5jTJ1Xn4y8Cty90PKBT0hzMFbT9ZVrElvqCJMUBNC8BmlPhMpuox8p5pGDxg==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: TY0PR06MB6839
X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIM_SIGNED,
        DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_BLOCKED,
        RCVD_IN_MSPIKE_H2,SPF_HELO_PASS,SPF_PASS,T_SCC_BODY_TEXT_LINE
        autolearn=ham autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org
X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (snail.vger.email [0.0.0.0]); Mon, 11 Dec 2023 19:27:07 -0800 (PST)

From: cuibixuan <cuibixuan@vivo.com>

When the system memory is low, kswapd reclaims the memory. The key steps
of memory reclamation include
1.shrink_lruvec
  * shrink_active_list, moves folios from the active LRU to the inactive LRU
  * shrink_inactive_list, shrink lru from inactive LRU list
2.shrink_slab
  * shrinker->count_objects(), calculates the freeable memory
  * shrinker->scan_objects(), reclaims the slab memory

The existing tracers in the vmscan are as follows:

--do_try_to_free_pages
--shrink_zones
--trace_mm_vmscan_node_reclaim_begin (tracer)
--shrink_node
--shrink_node_memcgs
  --trace_mm_vmscan_memcg_shrink_begin (tracer)
  --shrink_lruvec
    --shrink_list
      --shrink_active_list
	  --trace_mm_vmscan_lru_shrink_active (tracer)
      --shrink_inactive_list
	  --trace_mm_vmscan_lru_shrink_inactive (tracer)
    --shrink_active_list
  --shrink_slab
    --do_shrink_slab
    --shrinker->count_objects()
    --trace_mm_shrink_slab_start (tracer)
    --shrinker->scan_objects()
    --trace_mm_shrink_slab_end (tracer)
  --trace_mm_vmscan_memcg_shrink_end (tracer)
--trace_mm_vmscan_node_reclaim_end (tracer)

If we get the duration and quantity of shrink lru and slab,
then we can measure the memory recycling, as follows

Measuring memory reclamation with bpf:
  LRU FILE:
	CPU COMM 	ShrinkActive(us) ShrinkInactive(us)  Reclaim(page)
	7   kswapd0	 	26		51		32
	7   kswapd0		52		47		13
  SLAB:
	CPU COMM 		OBJ_NAME		Count_Dur(us) Freeable(page) Scan_Dur(us) Reclaim(page)
	 1  kswapd0		super_cache_scan.cfi_jt     2		    341		   3225		128
	 7  kswapd0		super_cache_scan.cfi_jt     0		    2247	   8524		1024
	 7  kswapd0	        super_cache_scan.cfi_jt     2367	    0		   0		0

For this, add the new tracer to shrink_active_list/shrink_inactive_list
and shrinker->count_objects().

cuibixuan (2):
  mm: shrinker: add new event to trace shrink count
  mm: vmscan: add new event to trace shrink lru

 include/trace/events/vmscan.h | 87 ++++++++++++++++++++++++++++++++++-
 mm/shrinker.c                 |  4 ++
 mm/vmscan.c                   |  8 +++-
 3 files changed, 95 insertions(+), 4 deletions(-)

-- 
2.39.0