Received: by 2002:a25:c205:0:0:0:0:0 with SMTP id s5csp3073264ybf; Mon, 2 Mar 2020 22:27:02 -0800 (PST) X-Google-Smtp-Source: ADFU+vuuCFu3U/PuiK4BNHHZuLrOaDMKEQDWB+Gd36aCbeVhyKi1ck0PHjFWRKJ5JCQW+lPzvqBs X-Received: by 2002:a05:6830:14c3:: with SMTP id t3mr2154646otq.213.1583216822058; Mon, 02 Mar 2020 22:27:02 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1583216822; cv=none; d=google.com; s=arc-20160816; b=0D0Robv7dtSzeSVMIbMfGR+lASfDZ8Ply4bdXHf2grE1+Bzib3PRfGaL2dnS6xaqkw vyJ2ckpHmLqUE4y4Fb0zC9/HYxTIcPuu3fOqblodSppaMmoshKfmXPWjby0gypTKVlIB lQpjVHURRRGEFQaQ7AzFJ1+CvpMlsLV9OK4d6zM60D2/t+BzmUxzYxqQZZVdapt0T9A7 fmd3an5tqNUtVkluJKYDFz+yngfvzPhzTaUU6TZOtRESZyD6jK2uZt8O8e9F1MneVk/z 5crvnAi369uqnJFZnF2x0e3G2FaJl7MP3WHcASwo9vfcrIUR0bKFC0PqGmhpGHmrTlPb HumQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:message-id:date:subject:cc:to:from; bh=m2d8bxeyku054h74JhVHsqbotLKnuuxbTN+xE8A44Yg=; b=Dh1c/t8GHBvxYMRdwwAB4sNZEC51VwW6QMSHjRQt9EbnhYNzGu1+FiVa8ilBRpF78M UylgLNs1k8yPNV+UvLgig1yOj2YxiaLQXMwdoac/cx4gfktWl6xSUGln87versRlkG6q IEpYSsO6W3b3vNBcBk7+IbGN653ZnR5g4jPn19R7c9bZJmRZ7LXHLxnfHIa0BdUV2x3v vL2ZmYlCKjr81J9zd8wQbVMymuT9DSdZ6tOcd6m+amkyCG3xqYhjFT40lmA2TNT82Zo3 07cdDOPr6+W5YMz25j4ci/z2MzhVb4/e7ideVkM10+osuEXukLearzKPQ57F8kR9znbq loGw== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id l8si7149674oii.249.2020.03.02.22.26.50; Mon, 02 Mar 2020 22:27:02 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727520AbgCCGZb (ORCPT + 99 others); Tue, 3 Mar 2020 01:25:31 -0500 Received: from out30-131.freemail.mail.aliyun.com ([115.124.30.131]:60462 "EHLO out30-131.freemail.mail.aliyun.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727398AbgCCGZa (ORCPT ); Tue, 3 Mar 2020 01:25:30 -0500 X-Alimail-AntiSpam: AC=PASS;BC=-1|-1;BR=01201311R751e4;CH=green;DM=||false|;DS=||;FP=0|-1|-1|-1|0|-1|-1|-1;HT=e01f04455;MF=teawaterz@linux.alibaba.com;NM=1;PH=DS;RN=4;SR=0;TI=SMTPD_---0TrXLIVw_1583216718; Received: from localhost(mailfrom:teawaterz@linux.alibaba.com fp:SMTPD_---0TrXLIVw_1583216718) by smtp.aliyun-inc.com(127.0.0.1); Tue, 03 Mar 2020 14:25:26 +0800 From: Hui Zhu To: fengguang.wu@qq.com, linux-kernel@vger.kernel.org Cc: Hui Zhu , Hui Zhu Subject: [PATCH for vm-scalability] usemem: Add new option --fragmentation for generating fragmented pages Date: Tue, 3 Mar 2020 14:25:15 +0800 Message-Id: <1583216715-29511-1-git-send-email-teawater@gmail.com> X-Mailer: git-send-email 2.7.4 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org This commit adds new option --fragmentation. usemem will generate size/2/pagesize fragmented pages with this option. Its implementation is to use madvise to release a page every other page. For example: usemem --fragment -s -1 400m Ideally, this command will generate 200m fragmented pages in the system. This command can help test anti-fragmentation function and other features that are affected by fragmentation issues of the Linux kernel. Signed-off-by: Hui Zhu --- usemem.c | 51 ++++++++++++++++++++++++++++++++++++++++++++++++++- 1 file changed, 50 insertions(+), 1 deletion(-) diff --git a/usemem.c b/usemem.c index 9ac36e4..10e8874 100644 --- a/usemem.c +++ b/usemem.c @@ -95,6 +95,7 @@ int opt_sync_free = 0; int opt_bind_interval = 0; unsigned long opt_delay = 0; int opt_read_again = 0; +int opt_fragmentation = 0; int nr_task; int nr_thread; int nr_cpu; @@ -153,6 +154,7 @@ void usage(int ok) " -O|--anonymous mmap with MAP_ANONYMOUS\n" " -U|--hugetlb allocate hugetlbfs page\n" " -Z|--read-again read memory again after access the memory\n" + " --fragmentation generate size/2/pagesize fragmented pages\n" " -h|--help show this message\n" , ourname); @@ -191,6 +193,7 @@ static const struct option opts[] = { { "delay" , 1, NULL, 'e' }, { "hugetlb" , 0, NULL, 'U' }, { "read-again" , 0, NULL, 'Z' }, + { "fragmentation", 0, NULL, 0 }, { "help" , 0, NULL, 'h' }, { NULL , 0, NULL, 0 } }; @@ -655,6 +658,26 @@ static void timing_free(void *ptrs[], unsigned int nptr, static void wait_for_sigusr1(int signal) {} +static void do_fragmentation(void *addr, unsigned long len) +{ + unsigned long offset; + int should_free = 1; + + for (offset = 0; offset <= len - pagesize; offset += pagesize) { + if (should_free) { + if (madvise(addr + offset, pagesize, + MADV_DONTNEED) != 0) { + fprintf(stderr, + "msync failed with error %s\n", + strerror(errno)); + exit(1); + } + should_free = 0; + } else + should_free = 1; + } +} + long do_units(void) { struct drand48_data rand_data; @@ -752,6 +775,15 @@ long do_units(void) } } + if (opt_fragmentation) { + if (prealloc) + do_fragmentation(prealloc, opt_bytes); + else { + for (i = 0; i < nptr; i++) + do_fragmentation(ptrs[i], lens[i]); + } + } + while (sleep_secs) sleep_secs = sleep(sleep_secs); @@ -896,6 +928,7 @@ int do_tasks(void) int main(int argc, char *argv[]) { int c; + int opt_index = 0; #ifdef DBG /* print the command line parameters passed on to main */ @@ -910,9 +943,18 @@ int main(int argc, char *argv[]) pagesize = getpagesize(); while ((c = getopt_long(argc, argv, - "aAB:f:FPp:gqowRMm:n:t:b:ds:T:Sr:u:j:e:EHDNLWyxOUZh", opts, NULL)) != -1) + "aAB:f:FPp:gqowRMm:n:t:b:ds:T:Sr:u:j:e:EHDNLWyxOUZh", + opts, &opt_index)) != -1) { switch (c) { + case 0: + if (strcmp(opts[opt_index].name, + "fragmentation") == 0) { + opt_fragmentation = 1; + } else + usage(1); + break; + case 'a': opt_malloc++; break; @@ -1045,6 +1087,13 @@ int main(int argc, char *argv[]) } } + if (opt_fragmentation && opt_malloc) { + fprintf(stderr, + "%s: malloc options ignored for fragmentation\n", + ourname); + opt_malloc = 0; + } + if (opt_malloc) { if (map_populate|map_anonymous|map_hugetlb) fprintf(stderr, -- 2.7.4