Greeting,
FYI, we noticed a 32.1% improvement of stress-ng.vfork.ops_per_sec due to commit:
commit: 3286222fc609dea27bd16ac02c55d3f1c3190063 ("mm, slub: better heuristic for number of cpus when calculating slab order")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
in testcase: stress-ng
on test machine: 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 512G memory
with following parameters:
nr_threads: 100%
disk: 1HDD
testtime: 60s
sc_pid_max: 4194304
class: scheduler
test: vfork
cpufreq_governor: performance
ucode: 0x5003003
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp split-job --compatible job.yaml
bin/lkp run compatible-job.yaml
=========================================================================================
class/compiler/cpufreq_governor/disk/kconfig/nr_threads/rootfs/sc_pid_max/tbox_group/test/testcase/testtime/ucode:
scheduler/gcc-9/performance/1HDD/x86_64-rhel-8.3/100%/debian-10.4-x86_64-20200603.cgz/4194304/lkp-csl-2sp7/vfork/stress-ng/60s/0x5003003
commit:
e82553c10b ("Revert "mm: memcontrol: avoid workload stalls when lowering memory.high"")
3286222fc6 ("mm, slub: better heuristic for number of cpus when calculating slab order")
e82553c10b089999 3286222fc609dea27bd16ac02c5
---------------- ---------------------------
%stddev %change %stddev
\ | \
6197 +1.5% 6293 stress-ng.time.percent_of_cpu_this_job_got
3264 -15.5% 2758 stress-ng.time.system_time
582.12 +97.1% 1147 stress-ng.time.user_time
7281054 +37.1% 9981837 stress-ng.time.voluntary_context_switches
3773163 +32.1% 4983127 stress-ng.vfork.ops
62885 +32.1% 83052 stress-ng.vfork.ops_per_sec
0.01 ? 82% -82.7% 0.00 ?104% perf-sched.wait_and_delay.avg.ms.__sched_text_start.__sched_text_start.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe
443.97 +2.6% 455.62 pmeter.Average_Active_Power
1614704 ? 29% +55.1% 2503845 ? 23% cpuidle.C1.usage
5051570 ? 6% +31.4% 6638056 ? 10% cpuidle.C1E.usage
1363055 ? 4% +54.5% 2105560 ? 33% cpuidle.POLL.time
19.99 +8.2% 21.63 iostat.cpu.idle
78.85 -2.7% 76.71 iostat.cpu.system
1.17 +42.8% 1.66 ? 3% iostat.cpu.user
0.94 +0.1 1.07 mpstat.cpu.all.irq%
17.26 -3.6 13.68 mpstat.cpu.all.soft%
1.18 +0.5 1.69 ? 3% mpstat.cpu.all.usr%
19.50 ? 2% +8.5% 21.17 vmstat.cpu.id
78.17 -2.8% 76.00 vmstat.cpu.sy
263545 +36.2% 358828 vmstat.system.cs
24006940 -52.9% 11296675 numa-numastat.node0.local_node
36647754 -60.9% 14317264 numa-numastat.node0.numa_hit
12640823 ? 2% -76.1% 3020586 ? 2% numa-numastat.node0.other_node
19883234 -44.7% 10991056 numa-numastat.node1.local_node
41374608 -60.1% 16507684 numa-numastat.node1.numa_hit
21491379 -74.3% 5516630 numa-numastat.node1.other_node
28511 ? 6% -66.0% 9706 ? 5% meminfo.Active
28255 ? 6% -66.5% 9455 ? 5% meminfo.Active(anon)
490721 +10.8% 543665 meminfo.AnonPages
553772 +14.3% 632708 meminfo.Inactive
553625 +14.3% 632555 meminfo.Inactive(anon)
94406 ? 4% +33.5% 126077 ? 3% meminfo.KReclaimable
99415 ? 2% +26.7% 126008 meminfo.Mapped
3892546 ? 2% +17.4% 4569802 ? 2% meminfo.Memused
94406 ? 4% +33.5% 126077 ? 3% meminfo.SReclaimable
958505 ? 10% +55.6% 1491379 ? 8% meminfo.SUnreclaim
1052912 ? 9% +53.6% 1617457 ? 7% meminfo.Slab
36289 ? 9% +14.6% 41575 ? 6% numa-meminfo.node0.KReclaimable
1855429 ? 7% +17.4% 2178089 ? 4% numa-meminfo.node0.MemUsed
36289 ? 9% +14.6% 41575 ? 6% numa-meminfo.node0.SReclaimable
464058 ? 6% +64.5% 763248 ? 4% numa-meminfo.node0.SUnreclaim
500348 ? 6% +60.9% 804824 ? 4% numa-meminfo.node0.Slab
26827 ? 10% -69.2% 8275 ? 7% numa-meminfo.node1.Active
26742 ? 10% -69.2% 8235 ? 6% numa-meminfo.node1.Active(anon)
57263 ? 14% +48.7% 85134 ? 6% numa-meminfo.node1.KReclaimable
62768 ? 4% +35.6% 85112 ? 3% numa-meminfo.node1.Mapped
1989299 ? 6% +20.9% 2405488 ? 5% numa-meminfo.node1.MemUsed
57263 ? 14% +48.7% 85134 ? 6% numa-meminfo.node1.SReclaimable
442761 ? 6% +67.3% 740854 ? 7% numa-meminfo.node1.SUnreclaim
81239 ? 4% +12.5% 91388 ? 4% numa-meminfo.node1.Shmem
500025 ? 6% +65.2% 825988 ? 6% numa-meminfo.node1.Slab
9070 ? 9% +14.6% 10392 ? 6% numa-vmstat.node0.nr_slab_reclaimable
110120 ? 8% +55.2% 170949 ? 8% numa-vmstat.node0.nr_slab_unreclaimable
17025003 -59.9% 6821635 ? 2% numa-vmstat.node0.numa_hit
10661119 -49.0% 5436444 ? 2% numa-vmstat.node0.numa_local
6363921 ? 2% -78.2% 1385206 ? 2% numa-vmstat.node0.numa_other
6266 ? 8% -65.4% 2168 ? 12% numa-vmstat.node1.nr_active_anon
16021 ? 3% +30.6% 20926 ? 3% numa-vmstat.node1.nr_mapped
20212 ? 4% +12.0% 22629 ? 5% numa-vmstat.node1.nr_shmem
13786 ? 13% +50.1% 20692 ? 7% numa-vmstat.node1.nr_slab_reclaimable
106302 ? 8% +54.9% 164633 ? 9% numa-vmstat.node1.nr_slab_unreclaimable
6266 ? 8% -65.4% 2168 ? 12% numa-vmstat.node1.nr_zone_active_anon
19066512 -61.5% 7339034 numa-vmstat.node1.numa_hit
10106674 -47.6% 5297721 numa-vmstat.node1.numa_local
8959866 -77.2% 2041323 numa-vmstat.node1.numa_other
6956 ? 10% -66.0% 2362 ? 5% proc-vmstat.nr_active_anon
122964 +10.5% 135895 proc-vmstat.nr_anon_pages
138837 +13.9% 158135 proc-vmstat.nr_inactive_anon
25197 ? 2% +25.6% 31640 proc-vmstat.nr_mapped
22952 +7.8% 24731 proc-vmstat.nr_shmem
23424 ? 5% +35.3% 31694 ? 3% proc-vmstat.nr_slab_reclaimable
231379 ? 5% +70.0% 393375 ? 8% proc-vmstat.nr_slab_unreclaimable
6956 ? 10% -66.0% 2362 ? 5% proc-vmstat.nr_zone_active_anon
138837 +13.9% 158135 proc-vmstat.nr_zone_inactive_anon
78020715 -60.6% 30720347 proc-vmstat.numa_hit
43905124 -49.4% 22228514 proc-vmstat.numa_local
34115590 -75.1% 8491833 proc-vmstat.numa_other
44003 -98.5% 647.83 ? 7% proc-vmstat.pgactivate
1.271e+08 -10.9% 1.133e+08 proc-vmstat.pgalloc_normal
344646 +9.4% 376940 proc-vmstat.pgfault
1.269e+08 -11.5% 1.123e+08 proc-vmstat.pgfree
21145 ? 99% +558.9% 139323 ?102% sched_debug.cfs_rq:/.MIN_vruntime.avg
130372 ? 79% +176.0% 359820 ? 37% sched_debug.cfs_rq:/.MIN_vruntime.stddev
42066 ? 35% +131.0% 97164 ? 80% sched_debug.cfs_rq:/.load.avg
127396 ? 20% +41.6% 180448 ? 24% sched_debug.cfs_rq:/.load.stddev
66.96 ? 20% +109.4% 140.19 ? 75% sched_debug.cfs_rq:/.load_avg.avg
21145 ? 99% +558.9% 139323 ?102% sched_debug.cfs_rq:/.max_vruntime.avg
130372 ? 79% +176.0% 359820 ? 37% sched_debug.cfs_rq:/.max_vruntime.stddev
1117187 -9.4% 1012431 sched_debug.cfs_rq:/.min_vruntime.min
0.34 ? 8% +25.2% 0.42 ? 4% sched_debug.cfs_rq:/.nr_running.stddev
407.16 ? 2% +31.2% 534.07 ? 26% sched_debug.cfs_rq:/.runnable_avg.avg
277.78 ? 3% +18.8% 329.88 ? 11% sched_debug.cfs_rq:/.runnable_avg.stddev
-38528 -39.5% -23317 sched_debug.cfs_rq:/.spread0.avg
-285776 +33.9% -382551 sched_debug.cfs_rq:/.spread0.min
392.87 +26.3% 496.02 ? 18% sched_debug.cfs_rq:/.util_avg.avg
1230085 ? 7% -89.4% 130120 ? 11% sched_debug.cpu.curr->pid.avg
1799198 -84.9% 271347 ? 3% sched_debug.cpu.curr->pid.max
830221 ? 3% -83.9% 133949 ? 3% sched_debug.cpu.curr->pid.stddev
0.00 ? 5% +99.3% 0.00 ? 47% sched_debug.cpu.next_balance.stddev
0.44 ? 6% +44.5% 0.64 ? 15% sched_debug.cpu.nr_running.stddev
86299 +35.7% 117095 sched_debug.cpu.nr_switches.avg
99076 +32.3% 131048 sched_debug.cpu.nr_switches.max
63543 ? 3% +31.5% 83585 sched_debug.cpu.nr_switches.min
6959 ? 2% +11.5% 7759 ? 5% sched_debug.cpu.nr_switches.stddev
305.08 ? 8% -53.3% 142.33 ? 13% sched_debug.cpu.nr_uninterruptible.max
161.94 ? 4% -53.6% 75.16 ? 8% sched_debug.cpu.nr_uninterruptible.stddev
5181 ? 3% +9.5% 5673 ? 2% interrupts.CPU13.RES:Rescheduling_interrupts
3444 -12.6% 3010 ? 4% interrupts.CPU24.RES:Rescheduling_interrupts
3490 -10.0% 3141 ? 3% interrupts.CPU25.RES:Rescheduling_interrupts
3505 -11.9% 3089 ? 3% interrupts.CPU26.RES:Rescheduling_interrupts
3494 -12.6% 3054 ? 4% interrupts.CPU27.RES:Rescheduling_interrupts
3393 -11.4% 3006 ? 3% interrupts.CPU28.RES:Rescheduling_interrupts
3365 -9.1% 3058 ? 2% interrupts.CPU29.RES:Rescheduling_interrupts
3460 ? 3% -10.3% 3105 ? 2% interrupts.CPU31.RES:Rescheduling_interrupts
3439 -9.4% 3114 ? 2% interrupts.CPU32.RES:Rescheduling_interrupts
3456 ? 2% -12.3% 3032 ? 3% interrupts.CPU33.RES:Rescheduling_interrupts
3459 -11.1% 3074 ? 3% interrupts.CPU35.RES:Rescheduling_interrupts
3445 ? 2% -9.2% 3127 ? 4% interrupts.CPU36.RES:Rescheduling_interrupts
3486 ? 2% -9.9% 3140 ? 3% interrupts.CPU38.RES:Rescheduling_interrupts
3419 -9.1% 3107 ? 2% interrupts.CPU39.RES:Rescheduling_interrupts
3493 ? 3% -9.4% 3166 ? 2% interrupts.CPU45.RES:Rescheduling_interrupts
3461 -9.9% 3117 ? 2% interrupts.CPU46.RES:Rescheduling_interrupts
3626 ? 5% -15.4% 3068 ? 4% interrupts.CPU47.RES:Rescheduling_interrupts
5145 ? 3% +11.7% 5749 ? 4% interrupts.CPU49.RES:Rescheduling_interrupts
5247 ? 3% +8.8% 5709 ? 2% interrupts.CPU57.RES:Rescheduling_interrupts
5149 ? 5% +12.3% 5780 ? 2% interrupts.CPU59.RES:Rescheduling_interrupts
5157 ? 3% +13.5% 5854 ? 3% interrupts.CPU60.RES:Rescheduling_interrupts
5105 ? 2% +14.1% 5825 ? 2% interrupts.CPU61.RES:Rescheduling_interrupts
5167 ? 4% +11.9% 5780 ? 2% interrupts.CPU63.RES:Rescheduling_interrupts
5173 ? 3% +9.5% 5666 ? 4% interrupts.CPU64.RES:Rescheduling_interrupts
4949 ? 2% +13.3% 5607 ? 3% interrupts.CPU65.RES:Rescheduling_interrupts
5277 +9.2% 5763 ? 2% interrupts.CPU66.RES:Rescheduling_interrupts
4959 +16.1% 5756 ? 2% interrupts.CPU67.RES:Rescheduling_interrupts
5169 ? 3% +9.8% 5676 ? 4% interrupts.CPU68.RES:Rescheduling_interrupts
5078 +11.3% 5652 interrupts.CPU69.RES:Rescheduling_interrupts
5038 ? 3% +11.8% 5634 ? 2% interrupts.CPU70.RES:Rescheduling_interrupts
5107 ? 3% +12.1% 5728 ? 2% interrupts.CPU71.RES:Rescheduling_interrupts
4012 ? 2% -14.5% 3429 ? 2% interrupts.CPU95.CAL:Function_call_interrupts
3110 ? 2% -18.2% 2545 ? 4% interrupts.CPU95.RES:Rescheduling_interrupts
20.02 +18.0% 23.63 perf-stat.i.MPKI
6.94e+09 +4.4% 7.244e+09 perf-stat.i.branch-instructions
1.22 +0.1 1.30 perf-stat.i.branch-miss-rate%
77054440 +12.5% 86650925 perf-stat.i.branch-misses
39.19 +1.1 40.25 perf-stat.i.cache-miss-rate%
2.873e+08 +31.3% 3.772e+08 perf-stat.i.cache-misses
7.172e+08 +27.7% 9.16e+08 perf-stat.i.cache-references
268756 +38.3% 371705 perf-stat.i.context-switches
6.19 -9.6% 5.60 perf-stat.i.cpi
2.22e+11 -2.4% 2.166e+11 perf-stat.i.cpu-cycles
48425 +18.5% 57365 perf-stat.i.cpu-migrations
805.41 -22.7% 622.19 perf-stat.i.cycles-between-cache-misses
8.847e+09 +7.5% 9.511e+09 perf-stat.i.dTLB-loads
4.955e+09 +25.0% 6.192e+09 perf-stat.i.dTLB-stores
69.10 -2.3 66.82 perf-stat.i.iTLB-load-miss-rate%
6809771 ? 2% +23.7% 8421621 perf-stat.i.iTLB-load-misses
2978648 +37.3% 4089706 perf-stat.i.iTLB-loads
3.488e+10 +7.7% 3.755e+10 perf-stat.i.instructions
5108 -13.0% 4446 perf-stat.i.instructions-per-iTLB-miss
0.19 +9.2% 0.20 perf-stat.i.ipc
13.55 +5.9% 14.34 perf-stat.i.major-faults
2.31 -2.5% 2.25 perf-stat.i.metric.GHz
0.62 +17.5% 0.73 perf-stat.i.metric.K/sec
225.32 +11.3% 250.76 perf-stat.i.metric.M/sec
4752 ? 2% +9.3% 5194 perf-stat.i.minor-faults
80.15 -1.9 78.21 perf-stat.i.node-load-miss-rate%
76281023 +32.5% 1.011e+08 perf-stat.i.node-load-misses
18860887 +48.9% 28091357 perf-stat.i.node-loads
71.35 -1.7 69.64 perf-stat.i.node-store-miss-rate%
55308593 +27.3% 70421553 perf-stat.i.node-store-misses
21448288 +38.2% 29634708 perf-stat.i.node-stores
4766 ? 2% +9.3% 5208 perf-stat.i.page-faults
20.80 +17.6% 24.46 perf-stat.overall.MPKI
1.10 +0.1 1.17 perf-stat.overall.branch-miss-rate%
39.75 +1.0 40.73 perf-stat.overall.cache-miss-rate%
6.29 -8.6% 5.75 perf-stat.overall.cpi
760.51 -24.2% 576.84 perf-stat.overall.cycles-between-cache-misses
69.86 -2.1 67.75 perf-stat.overall.iTLB-load-miss-rate%
5076 -12.6% 4438 perf-stat.overall.instructions-per-iTLB-miss
0.16 +9.4% 0.17 perf-stat.overall.ipc
79.58 -1.8 77.79 perf-stat.overall.node-load-miss-rate%
71.75 -1.7 70.06 perf-stat.overall.node-store-miss-rate%
6.867e+09 +2.9% 7.063e+09 perf-stat.ps.branch-instructions
75465250 +9.8% 82825350 perf-stat.ps.branch-misses
2.864e+08 +27.6% 3.654e+08 perf-stat.ps.cache-misses
7.206e+08 +24.5% 8.97e+08 perf-stat.ps.cache-references
267460 +34.6% 359916 perf-stat.ps.context-switches
94453 -1.2% 93356 perf-stat.ps.cpu-clock
2.178e+11 -3.3% 2.108e+11 perf-stat.ps.cpu-cycles
46224 +16.5% 53830 perf-stat.ps.cpu-migrations
8.797e+09 +5.7% 9.302e+09 perf-stat.ps.dTLB-loads
4.989e+09 +21.7% 6.073e+09 perf-stat.ps.dTLB-stores
6825344 +21.1% 8262447 perf-stat.ps.iTLB-load-misses
2944291 +33.6% 3933830 perf-stat.ps.iTLB-loads
3.464e+10 +5.9% 3.667e+10 perf-stat.ps.instructions
5032 +9.1% 5491 perf-stat.ps.minor-faults
75431682 +29.2% 97433322 perf-stat.ps.node-load-misses
19351184 +43.7% 27810534 perf-stat.ps.node-loads
55098588 +24.1% 68400552 perf-stat.ps.node-store-misses
21698960 +34.7% 29227882 perf-stat.ps.node-stores
5044 +9.1% 5503 perf-stat.ps.page-faults
94453 -1.2% 93356 perf-stat.ps.task-clock
2.184e+12 +5.5% 2.303e+12 perf-stat.total.instructions
26183 ? 3% +40.8% 36878 ? 2% slabinfo.cred_jar.active_objs
1269 ? 3% -29.3% 897.33 ? 2% slabinfo.cred_jar.active_slabs
26678 ? 3% +41.3% 37707 ? 2% slabinfo.cred_jar.num_objs
1269 ? 3% -29.3% 897.33 ? 2% slabinfo.cred_jar.num_slabs
138424 ? 5% +45.4% 201206 ? 4% slabinfo.dentry.active_objs
6613 ? 5% -27.5% 4796 ? 4% slabinfo.dentry.active_slabs
138888 ? 5% +45.1% 201463 ? 4% slabinfo.dentry.num_objs
6613 ? 5% -27.5% 4796 ? 4% slabinfo.dentry.num_slabs
3325 ? 3% +41.8% 4715 slabinfo.files_cache.active_objs
302.00 ? 3% -66.2% 102.17 slabinfo.files_cache.active_slabs
3326 ? 3% +41.8% 4715 slabinfo.files_cache.num_objs
302.00 ? 3% -66.2% 102.17 slabinfo.files_cache.num_slabs
19695 +49.5% 29437 ? 3% slabinfo.filp.active_objs
1237 -25.2% 925.83 ? 3% slabinfo.filp.active_slabs
19810 +49.6% 29638 ? 3% slabinfo.filp.num_objs
1237 -25.2% 925.83 ? 3% slabinfo.filp.num_slabs
80005 ? 4% +34.5% 107643 ? 3% slabinfo.inode_cache.active_objs
6155 ? 4% -67.6% 1993 ? 3% slabinfo.inode_cache.active_slabs
80025 ? 4% +34.6% 107692 ? 3% slabinfo.inode_cache.num_objs
6155 ? 4% -67.6% 1993 ? 3% slabinfo.inode_cache.num_slabs
14531 ? 3% -63.9% 5246 slabinfo.kmalloc-128.active_objs
455.17 ? 3% -63.6% 165.67 slabinfo.kmalloc-128.active_slabs
14583 ? 3% -63.6% 5311 slabinfo.kmalloc-128.num_objs
455.17 ? 3% -63.6% 165.67 slabinfo.kmalloc-128.num_slabs
13514 ? 2% -58.6% 5601 slabinfo.kmalloc-192.active_objs
644.83 ? 2% -79.2% 133.83 slabinfo.kmalloc-192.active_slabs
13551 ? 2% -58.5% 5621 slabinfo.kmalloc-192.num_objs
644.83 ? 2% -79.2% 133.83 slabinfo.kmalloc-192.num_slabs
19297 ? 11% +58.8% 30644 ? 9% slabinfo.kmalloc-1k.active_objs
2544 ? 10% -58.3% 1061 ? 6% slabinfo.kmalloc-1k.active_slabs
20357 ? 10% +66.8% 33963 ? 6% slabinfo.kmalloc-1k.num_objs
2544 ? 10% -58.3% 1061 ? 6% slabinfo.kmalloc-1k.num_slabs
6300 +60.8% 10133 ? 2% slabinfo.kmalloc-256.active_objs
6308 +63.3% 10304 ? 2% slabinfo.kmalloc-256.num_objs
9069 +38.7% 12576 slabinfo.kmalloc-2k.active_objs
1137 -30.6% 789.33 slabinfo.kmalloc-2k.active_slabs
9102 +38.8% 12636 slabinfo.kmalloc-2k.num_objs
1137 -30.6% 789.33 slabinfo.kmalloc-2k.num_slabs
1379162 ? 15% +51.2% 2085445 ? 13% slabinfo.kmalloc-512.active_objs
173045 ? 15% -61.3% 67052 ? 12% slabinfo.kmalloc-512.active_slabs
1384369 ? 15% +55.0% 2145692 ? 12% slabinfo.kmalloc-512.num_objs
173045 ? 15% -61.3% 67052 ? 12% slabinfo.kmalloc-512.num_slabs
130374 ? 2% +12.1% 146099 ? 3% slabinfo.kmalloc-8.active_objs
131652 ? 2% +11.6% 146901 ? 3% slabinfo.kmalloc-8.num_objs
18832 ? 5% +15.3% 21704 ? 6% slabinfo.kmalloc-96.active_objs
536.33 ? 3% +22.4% 656.33 ? 3% slabinfo.kmalloc-96.active_slabs
22543 ? 3% +22.4% 27582 ? 3% slabinfo.kmalloc-96.num_objs
536.33 ? 3% +22.4% 656.33 ? 3% slabinfo.kmalloc-96.num_slabs
373.50 ? 6% +309.7% 1530 ? 6% slabinfo.kmalloc-rcl-512.active_objs
373.50 ? 6% +309.7% 1530 ? 6% slabinfo.kmalloc-rcl-512.num_objs
224.00 +54.8% 346.67 ? 3% slabinfo.kmem_cache.active_objs
224.00 +54.8% 346.67 ? 3% slabinfo.kmem_cache.num_objs
1733 +82.2% 3159 slabinfo.mm_struct.active_objs
1733 +82.2% 3159 slabinfo.mm_struct.num_objs
361.00 ? 7% +144.6% 883.17 ? 14% slabinfo.mnt_cache.active_objs
361.00 ? 7% +144.6% 883.17 ? 14% slabinfo.mnt_cache.num_objs
741.33 ? 3% +82.1% 1349 ? 7% slabinfo.pool_workqueue.active_objs
744.00 ? 3% +82.8% 1360 ? 7% slabinfo.pool_workqueue.num_objs
2632 +11.2% 2926 slabinfo.proc_dir_entry.active_objs
2632 +11.2% 2926 slabinfo.proc_dir_entry.num_objs
10813 +31.3% 14196 slabinfo.proc_inode_cache.active_objs
901.00 -67.2% 295.17 slabinfo.proc_inode_cache.active_slabs
10817 +31.2% 14196 slabinfo.proc_inode_cache.num_objs
901.00 -67.2% 295.17 slabinfo.proc_inode_cache.num_slabs
14018 +17.0% 16396 slabinfo.radix_tree_node.active_objs
1001 -70.8% 292.33 slabinfo.radix_tree_node.active_slabs
14020 +16.9% 16396 slabinfo.radix_tree_node.num_objs
1001 -70.8% 292.33 slabinfo.radix_tree_node.num_slabs
2659 ? 2% +95.9% 5209 slabinfo.shmem_inode_cache.active_objs
240.83 ? 2% -53.2% 112.67 slabinfo.shmem_inode_cache.active_slabs
2659 ? 2% +95.9% 5209 slabinfo.shmem_inode_cache.num_objs
240.83 ? 2% -53.2% 112.67 slabinfo.shmem_inode_cache.num_slabs
2942 -9.6% 2661 slabinfo.sighand_cache.active_objs
2943 -9.6% 2661 slabinfo.sighand_cache.num_objs
8087 ? 8% +68.1% 13591 ? 7% slabinfo.signal_cache.active_objs
599.67 ? 8% -16.5% 500.50 ? 6% slabinfo.signal_cache.active_slabs
8402 ? 7% +66.9% 14021 ? 6% slabinfo.signal_cache.num_objs
599.67 ? 8% -16.5% 500.50 ? 6% slabinfo.signal_cache.num_slabs
11200 ? 9% +119.3% 24562 ? 4% slabinfo.task_group.active_objs
1087 ? 8% -47.4% 571.50 ? 4% slabinfo.task_group.active_slabs
11962 ? 8% +120.0% 26317 ? 4% slabinfo.task_group.num_objs
1087 ? 8% -47.4% 571.50 ? 4% slabinfo.task_group.num_slabs
36223 ? 3% +75.6% 63619 ? 4% slabinfo.vm_area_struct.active_objs
1813 ? 3% -12.2% 1591 ? 4% slabinfo.vm_area_struct.active_slabs
36276 ? 3% +75.5% 63670 ? 4% slabinfo.vm_area_struct.num_objs
1813 ? 3% -12.2% 1591 ? 4% slabinfo.vm_area_struct.num_slabs
16478 +20.3% 19820 ? 8% softirqs.CPU1.RCU
17464 ? 3% +12.9% 19714 ? 2% softirqs.CPU1.SCHED
16424 ? 3% +14.5% 18803 softirqs.CPU10.RCU
16750 +11.9% 18737 softirqs.CPU10.SCHED
16094 +16.5% 18743 softirqs.CPU11.RCU
16552 ? 3% +11.6% 18467 softirqs.CPU11.SCHED
16423 ? 3% +14.6% 18823 softirqs.CPU12.RCU
16875 ? 2% +9.7% 18508 softirqs.CPU12.SCHED
16139 +16.9% 18870 softirqs.CPU13.RCU
16969 +10.0% 18658 softirqs.CPU13.SCHED
16209 ? 3% +15.6% 18735 softirqs.CPU14.RCU
16538 ? 3% +12.6% 18620 softirqs.CPU14.SCHED
16143 +15.3% 18621 softirqs.CPU15.RCU
16720 +11.2% 18600 softirqs.CPU15.SCHED
16316 +16.0% 18926 softirqs.CPU16.RCU
16720 +11.4% 18623 softirqs.CPU16.SCHED
16320 +15.3% 18820 softirqs.CPU17.RCU
16846 +11.3% 18756 softirqs.CPU17.SCHED
16246 +16.2% 18885 softirqs.CPU18.RCU
16720 +11.6% 18659 softirqs.CPU18.SCHED
16410 +15.6% 18964 softirqs.CPU19.RCU
16738 +11.8% 18713 softirqs.CPU19.SCHED
16475 +16.1% 19121 softirqs.CPU2.RCU
16337 +15.9% 18929 softirqs.CPU20.RCU
16703 +11.2% 18582 softirqs.CPU20.SCHED
16265 +16.3% 18911 softirqs.CPU21.RCU
16760 +11.7% 18721 softirqs.CPU21.SCHED
16237 +15.6% 18775 softirqs.CPU22.RCU
16647 +12.5% 18724 softirqs.CPU22.SCHED
16337 +15.3% 18832 softirqs.CPU23.RCU
16542 +12.7% 18643 softirqs.CPU23.SCHED
16418 ? 3% +15.4% 18943 ? 2% softirqs.CPU25.RCU
16237 +10.5% 17949 ? 2% softirqs.CPU25.SCHED
16179 +16.5% 18851 softirqs.CPU26.RCU
16138 +16.9% 18868 softirqs.CPU27.RCU
16275 +15.2% 18752 softirqs.CPU28.RCU
16262 ? 3% +16.1% 18884 softirqs.CPU29.RCU
16429 +16.1% 19072 softirqs.CPU3.RCU
16785 +10.3% 18509 softirqs.CPU3.SCHED
16140 +16.5% 18808 softirqs.CPU30.RCU
16281 +9.7% 17855 softirqs.CPU30.SCHED
16085 +16.2% 18688 softirqs.CPU31.RCU
16175 ? 2% +16.4% 18835 ? 3% softirqs.CPU32.RCU
16251 +13.8% 18493 softirqs.CPU33.RCU
15947 +15.6% 18427 softirqs.CPU34.RCU
15866 +16.0% 18413 softirqs.CPU35.RCU
15979 ? 2% +15.3% 18431 softirqs.CPU36.RCU
15924 +15.6% 18412 softirqs.CPU37.RCU
15813 +18.0% 18660 ? 3% softirqs.CPU38.RCU
15903 +15.4% 18358 softirqs.CPU39.RCU
16459 ? 2% +15.2% 18963 softirqs.CPU4.RCU
15875 +15.3% 18309 softirqs.CPU40.RCU
15841 +16.5% 18454 ? 2% softirqs.CPU41.RCU
15959 ? 2% +14.6% 18294 softirqs.CPU42.RCU
16309 +9.3% 17826 softirqs.CPU42.SCHED
16020 ? 3% +14.4% 18320 ? 2% softirqs.CPU43.RCU
16302 +9.9% 17914 softirqs.CPU43.SCHED
16049 ? 3% +14.9% 18441 softirqs.CPU44.RCU
15913 ? 2% +14.7% 18256 softirqs.CPU45.RCU
15813 +15.4% 18250 softirqs.CPU46.RCU
15971 +17.5% 18765 ? 2% softirqs.CPU47.RCU
16008 +15.4% 18473 softirqs.CPU48.RCU
16570 +10.9% 18376 ? 2% softirqs.CPU48.SCHED
15938 +15.8% 18451 ? 2% softirqs.CPU49.RCU
16653 +12.4% 18718 softirqs.CPU49.SCHED
16263 ? 3% +17.2% 19061 softirqs.CPU5.RCU
16530 ? 3% +12.1% 18536 softirqs.CPU5.SCHED
16277 ? 2% +14.8% 18680 ? 2% softirqs.CPU50.RCU
16946 ? 2% +9.8% 18611 ? 3% softirqs.CPU50.SCHED
16259 ? 2% +13.7% 18479 softirqs.CPU51.RCU
16651 ? 4% +12.1% 18673 softirqs.CPU51.SCHED
16015 +15.3% 18471 softirqs.CPU52.RCU
16662 +13.0% 18834 softirqs.CPU52.SCHED
15992 +16.1% 18561 softirqs.CPU53.RCU
16661 +12.5% 18737 ? 2% softirqs.CPU53.SCHED
15937 +16.7% 18598 softirqs.CPU54.RCU
16576 +15.0% 19059 softirqs.CPU54.SCHED
16153 ? 2% +13.2% 18282 softirqs.CPU55.RCU
16746 +12.3% 18803 softirqs.CPU55.SCHED
16031 +15.7% 18551 softirqs.CPU56.RCU
16785 +11.6% 18734 ? 2% softirqs.CPU56.SCHED
16009 +14.8% 18374 softirqs.CPU57.RCU
16679 +12.9% 18825 softirqs.CPU57.SCHED
16100 +14.1% 18367 softirqs.CPU58.RCU
16829 +11.7% 18804 softirqs.CPU58.SCHED
15940 +16.7% 18595 softirqs.CPU59.RCU
16567 ? 2% +14.9% 19043 softirqs.CPU59.SCHED
16502 ? 2% +15.3% 19030 softirqs.CPU6.RCU
17015 ? 3% +9.7% 18668 softirqs.CPU6.SCHED
15975 +14.9% 18359 softirqs.CPU60.RCU
16648 ? 2% +13.5% 18895 softirqs.CPU60.SCHED
15892 ? 2% +20.0% 19065 ? 8% softirqs.CPU61.RCU
16810 +12.6% 18935 softirqs.CPU61.SCHED
15888 +15.1% 18282 softirqs.CPU62.RCU
16693 +13.0% 18862 softirqs.CPU62.SCHED
15882 +15.6% 18358 softirqs.CPU63.RCU
16705 +13.2% 18905 softirqs.CPU63.SCHED
16033 +16.2% 18625 ? 2% softirqs.CPU64.RCU
16762 +11.6% 18704 ? 3% softirqs.CPU64.SCHED
16004 +15.2% 18442 softirqs.CPU65.RCU
16789 +12.9% 18950 softirqs.CPU65.SCHED
15910 +16.7% 18566 softirqs.CPU66.RCU
16690 +12.9% 18836 softirqs.CPU66.SCHED
15840 +16.3% 18428 softirqs.CPU67.RCU
16773 +12.8% 18916 softirqs.CPU67.SCHED
15951 +15.3% 18391 softirqs.CPU68.RCU
16824 +12.9% 18988 softirqs.CPU68.SCHED
15741 +16.8% 18380 ? 2% softirqs.CPU69.RCU
16725 +13.7% 19020 softirqs.CPU69.SCHED
16514 ? 2% +13.5% 18738 softirqs.CPU7.RCU
16898 ? 4% +9.9% 18563 softirqs.CPU7.SCHED
16132 +13.7% 18336 softirqs.CPU70.RCU
16733 +13.7% 19018 softirqs.CPU70.SCHED
15994 +15.1% 18401 softirqs.CPU71.RCU
16625 +15.0% 19123 softirqs.CPU71.SCHED
15990 ? 2% +15.1% 18404 softirqs.CPU72.RCU
16281 +10.4% 17976 softirqs.CPU72.SCHED
15897 +17.6% 18697 softirqs.CPU73.RCU
16329 +10.2% 18000 softirqs.CPU73.SCHED
15940 +16.0% 18483 ? 2% softirqs.CPU74.RCU
15843 +15.8% 18339 softirqs.CPU75.RCU
16261 +10.1% 17908 softirqs.CPU75.SCHED
15952 +14.7% 18299 softirqs.CPU76.RCU
16276 +10.8% 18034 softirqs.CPU76.SCHED
15871 +16.4% 18468 ? 2% softirqs.CPU77.RCU
15757 +17.1% 18456 softirqs.CPU78.RCU
16127 ? 2% +11.3% 17948 softirqs.CPU78.SCHED
15780 +15.7% 18255 softirqs.CPU79.RCU
16280 ? 2% +15.5% 18799 softirqs.CPU8.RCU
16919 ? 3% +7.6% 18203 ? 2% softirqs.CPU8.SCHED
15927 +14.9% 18307 ? 2% softirqs.CPU80.RCU
16292 +10.6% 18017 softirqs.CPU80.SCHED
15918 +14.2% 18173 softirqs.CPU81.RCU
16409 +10.0% 18042 softirqs.CPU82.SCHED
16057 ? 2% +12.8% 18112 softirqs.CPU83.RCU
16403 +9.8% 18017 softirqs.CPU83.SCHED
15711 +14.8% 18032 softirqs.CPU84.RCU
16327 +10.7% 18071 softirqs.CPU84.SCHED
15948 ? 2% +13.4% 18087 softirqs.CPU85.RCU
15714 +15.5% 18154 ? 2% softirqs.CPU86.RCU
16467 +10.1% 18128 softirqs.CPU86.SCHED
15965 ? 3% +12.6% 17974 softirqs.CPU87.RCU
16396 +10.8% 18163 softirqs.CPU87.SCHED
15760 +14.4% 18026 softirqs.CPU88.RCU
16306 +11.2% 18135 softirqs.CPU88.SCHED
15911 ? 2% +14.8% 18270 ? 2% softirqs.CPU89.RCU
16377 +11.0% 18186 softirqs.CPU89.SCHED
16268 +15.3% 18763 softirqs.CPU9.RCU
16638 +11.9% 18620 softirqs.CPU9.SCHED
15967 +12.2% 17917 softirqs.CPU90.RCU
16369 +11.1% 18184 softirqs.CPU90.SCHED
15897 ? 2% +12.7% 17921 softirqs.CPU91.RCU
16546 ? 2% +10.1% 18216 softirqs.CPU91.SCHED
15724 +14.5% 18003 softirqs.CPU92.RCU
16477 +10.4% 18195 softirqs.CPU92.SCHED
15848 ? 2% +14.4% 18137 ? 3% softirqs.CPU93.RCU
16428 +10.7% 18183 softirqs.CPU93.SCHED
15740 ? 2% +13.7% 17903 softirqs.CPU94.RCU
16435 +10.8% 18213 softirqs.CPU94.SCHED
1544660 +15.2% 1779480 softirqs.RCU
1585850 +10.7% 1755033 softirqs.SCHED
34.37 -22.8 11.62 ? 4% perf-profile.calltrace.cycles-pp.__slab_alloc.kmem_cache_alloc_node_trace.alloc_fair_sched_group.sched_create_group.sched_autogroup_create_attach
36.47 -21.5 14.95 ? 3% perf-profile.calltrace.cycles-pp.kmem_cache_alloc_node_trace.alloc_fair_sched_group.sched_create_group.sched_autogroup_create_attach.ksys_setsid
53.53 -21.3 32.22 perf-profile.calltrace.cycles-pp.sched_create_group.sched_autogroup_create_attach.ksys_setsid.__x64_sys_setsid.do_syscall_64
30.09 -20.3 9.79 ? 4% perf-profile.calltrace.cycles-pp.___slab_alloc.__slab_alloc.kmem_cache_alloc_node_trace.alloc_fair_sched_group.sched_create_group
39.05 -20.0 19.09 ? 3% perf-profile.calltrace.cycles-pp.alloc_fair_sched_group.sched_create_group.sched_autogroup_create_attach.ksys_setsid.__x64_sys_setsid
60.78 -19.1 41.70 perf-profile.calltrace.cycles-pp.sched_autogroup_create_attach.ksys_setsid.__x64_sys_setsid.do_syscall_64.entry_SYSCALL_64_after_hwframe
23.84 -18.3 5.53 ? 5% perf-profile.calltrace.cycles-pp._raw_spin_lock.get_partial_node.___slab_alloc.__slab_alloc.kmem_cache_alloc_node_trace
23.55 -18.2 5.35 ? 5% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.get_partial_node.___slab_alloc.__slab_alloc
63.57 -17.0 46.55 perf-profile.calltrace.cycles-pp.ksys_setsid.__x64_sys_setsid.do_syscall_64.entry_SYSCALL_64_after_hwframe
63.57 -17.0 46.56 perf-profile.calltrace.cycles-pp.__x64_sys_setsid.do_syscall_64.entry_SYSCALL_64_after_hwframe
21.83 -15.8 6.04 ? 5% perf-profile.calltrace.cycles-pp.get_partial_node.___slab_alloc.__slab_alloc.kmem_cache_alloc_node_trace.alloc_fair_sched_group
9.54 ? 2% -7.6 1.97 ? 5% perf-profile.calltrace.cycles-pp.free_fair_sched_group.sched_free_group.rcu_do_batch.rcu_core.__softirqentry_text_start
7.35 ? 3% -6.3 1.04 ? 19% perf-profile.calltrace.cycles-pp.sched_free_group.rcu_do_batch.rcu_core.__softirqentry_text_start.asm_call_sysvec_on_stack
5.36 ? 8% -5.3 0.09 ?223% perf-profile.calltrace.cycles-pp.put_cpu_partial.free_fair_sched_group.sched_free_group.rcu_do_batch.rcu_core
5.33 ? 8% -5.2 0.08 ?223% perf-profile.calltrace.cycles-pp.unfreeze_partials.put_cpu_partial.free_fair_sched_group.sched_free_group.rcu_do_batch
6.69 -4.4 2.26 ? 5% perf-profile.calltrace.cycles-pp._raw_spin_lock.deactivate_slab.___slab_alloc.__slab_alloc.kmem_cache_alloc_node_trace
6.57 -4.4 2.18 ? 6% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.deactivate_slab.___slab_alloc.__slab_alloc
86.04 -4.0 82.06 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
6.92 ? 2% -4.0 2.96 perf-profile.calltrace.cycles-pp.__slab_alloc.kmem_cache_alloc_node_trace.alloc_rt_sched_group.sched_create_group.sched_autogroup_create_attach
86.13 -4.0 82.18 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
10.73 -3.9 6.82 ? 2% perf-profile.calltrace.cycles-pp.rcu_core.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack.irq_exit_rcu
10.72 -3.9 6.81 ? 2% perf-profile.calltrace.cycles-pp.rcu_do_batch.rcu_core.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack
10.83 -3.9 6.95 perf-profile.calltrace.cycles-pp.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt
10.83 -3.9 6.95 perf-profile.calltrace.cycles-pp.asm_call_sysvec_on_stack.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
5.18 -3.4 1.75 ? 8% perf-profile.calltrace.cycles-pp.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.__slab_alloc.kmem_cache_alloc_node_trace
5.17 ? 2% -3.4 1.74 ? 8% perf-profile.calltrace.cycles-pp.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.__slab_alloc
5.80 -3.3 2.55 perf-profile.calltrace.cycles-pp.___slab_alloc.__slab_alloc.kmem_cache_alloc_node_trace.alloc_rt_sched_group.sched_create_group
5.73 -2.9 2.78 ? 5% perf-profile.calltrace.cycles-pp.deactivate_slab.___slab_alloc.__slab_alloc.kmem_cache_alloc_node_trace.alloc_fair_sched_group
10.96 -2.5 8.41 perf-profile.calltrace.cycles-pp.kmem_cache_alloc_node_trace.alloc_rt_sched_group.sched_create_group.sched_autogroup_create_attach.ksys_setsid
4.23 -2.4 1.79 ? 8% perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.__slab_alloc.kmem_cache_alloc_node_trace.alloc_fair_sched_group.sched_create_group
4.22 -2.4 1.79 ? 8% perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.__slab_alloc.kmem_cache_alloc_node_trace.alloc_fair_sched_group
2.85 -2.2 0.61 ? 3% perf-profile.calltrace.cycles-pp.get_partial_node.___slab_alloc.__slab_alloc.kmem_cache_alloc_node_trace.alloc_rt_sched_group
14.43 -1.4 13.05 perf-profile.calltrace.cycles-pp.alloc_rt_sched_group.sched_create_group.sched_autogroup_create_attach.ksys_setsid.__x64_sys_setsid
2.25 -1.1 1.14 ? 3% perf-profile.calltrace.cycles-pp.sched_free_group.rcu_do_batch.rcu_core.__softirqentry_text_start.run_ksoftirqd
2.59 -0.9 1.72 ? 3% perf-profile.calltrace.cycles-pp.rcu_core.__softirqentry_text_start.run_ksoftirqd.smpboot_thread_fn.kthread
2.59 -0.9 1.72 ? 3% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.run_ksoftirqd.smpboot_thread_fn.kthread.ret_from_fork
2.59 -0.9 1.72 ? 3% perf-profile.calltrace.cycles-pp.run_ksoftirqd.smpboot_thread_fn.kthread.ret_from_fork
2.58 -0.9 1.72 ? 3% perf-profile.calltrace.cycles-pp.rcu_do_batch.rcu_core.__softirqentry_text_start.run_ksoftirqd.smpboot_thread_fn
2.60 -0.9 1.74 ? 3% perf-profile.calltrace.cycles-pp.smpboot_thread_fn.kthread.ret_from_fork
3.31 -0.5 2.78 ? 2% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
3.50 -0.5 3.01 ? 2% perf-profile.calltrace.cycles-pp.ret_from_fork
1.71 -0.5 1.24 perf-profile.calltrace.cycles-pp.deactivate_slab.___slab_alloc.__slab_alloc.kmem_cache_alloc_node_trace.alloc_rt_sched_group
1.94 -0.3 1.62 ? 2% perf-profile.calltrace.cycles-pp.free_rt_sched_group.sched_autogroup_create_attach.ksys_setsid.__x64_sys_setsid.do_syscall_64
1.20 ? 2% +0.1 1.26 ? 3% perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle
0.77 ? 2% +0.1 0.84 ? 3% perf-profile.calltrace.cycles-pp.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.copy_process.kernel_clone
0.77 ? 2% +0.1 0.84 ? 3% perf-profile.calltrace.cycles-pp.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.copy_process
0.78 ? 3% +0.1 0.85 ? 3% perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.copy_process.kernel_clone.__x64_sys_vfork
0.78 ? 3% +0.1 0.86 ? 3% perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.copy_process.kernel_clone.__x64_sys_vfork.do_syscall_64
0.55 ? 6% +0.1 0.68 ? 2% perf-profile.calltrace.cycles-pp.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.online_fair_sched_group.sched_autogroup_create_attach
0.57 ? 5% +0.1 0.71 ? 2% perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.online_fair_sched_group.sched_autogroup_create_attach.ksys_setsid
0.57 ? 6% +0.1 0.72 ? 2% perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.online_fair_sched_group.sched_autogroup_create_attach.ksys_setsid.__x64_sys_setsid
0.53 ? 2% +0.2 0.69 perf-profile.calltrace.cycles-pp.attach_entity_load_avg.attach_entity_cfs_rq.online_fair_sched_group.sched_autogroup_create_attach.ksys_setsid
0.46 ? 45% +0.2 0.68 perf-profile.calltrace.cycles-pp.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.online_fair_sched_group
0.58 ? 2% +0.3 0.85 ? 2% perf-profile.calltrace.cycles-pp.__slab_free.free_rt_sched_group.sched_autogroup_create_attach.ksys_setsid.__x64_sys_setsid
0.63 ? 6% +0.3 0.92 ? 4% perf-profile.calltrace.cycles-pp.__vunmap.free_work.process_one_work.worker_thread.kthread
0.64 ? 6% +0.3 0.94 ? 4% perf-profile.calltrace.cycles-pp.free_work.process_one_work.worker_thread.kthread.ret_from_fork
0.65 ? 6% +0.3 0.95 ? 4% perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
0.71 ? 5% +0.3 1.03 ? 4% perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
0.85 +0.4 1.26 perf-profile.calltrace.cycles-pp.update_load_avg.attach_entity_cfs_rq.online_fair_sched_group.sched_autogroup_create_attach.ksys_setsid
0.97 +0.5 1.44 perf-profile.calltrace.cycles-pp.find_idlest_group.select_task_rq_fair.wake_up_new_task.kernel_clone.__x64_sys_vfork
0.67 ? 2% +0.5 1.17 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.online_fair_sched_group.sched_autogroup_create_attach.ksys_setsid
1.08 +0.5 1.60 perf-profile.calltrace.cycles-pp.select_task_rq_fair.wake_up_new_task.kernel_clone.__x64_sys_vfork.do_syscall_64
1.10 +0.5 1.62 perf-profile.calltrace.cycles-pp.update_rq_clock.online_fair_sched_group.sched_autogroup_create_attach.ksys_setsid.__x64_sys_setsid
0.00 +0.6 0.58 ? 3% perf-profile.calltrace.cycles-pp.kfree.free_rt_sched_group.sched_autogroup_create_attach.ksys_setsid.__x64_sys_setsid
0.00 +0.6 0.59 ? 3% perf-profile.calltrace.cycles-pp.__sched_text_start.schedule_idle.do_idle.cpu_startup_entry.start_secondary
0.00 +0.6 0.59 ? 3% perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
1.49 +0.6 2.12 perf-profile.calltrace.cycles-pp.attach_entity_cfs_rq.online_fair_sched_group.sched_autogroup_create_attach.ksys_setsid.__x64_sys_setsid
1.59 +0.6 2.24 ? 2% perf-profile.calltrace.cycles-pp.wake_up_new_task.kernel_clone.__x64_sys_vfork.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.77 ? 2% +0.7 1.42 ? 5% perf-profile.calltrace.cycles-pp.__put_task_struct.rcu_do_batch.rcu_core.__softirqentry_text_start.asm_call_sysvec_on_stack
1.12 +0.7 1.79 perf-profile.calltrace.cycles-pp.memset_erms.kmem_cache_alloc_node_trace.alloc_fair_sched_group.sched_create_group.sched_autogroup_create_attach
0.72 ? 2% +0.8 1.49 ? 21% perf-profile.calltrace.cycles-pp.unregister_fair_sched_group.sched_offline_group.sched_autogroup_exit.__put_task_struct.rcu_do_batch
0.73 ? 2% +0.8 1.52 ? 21% perf-profile.calltrace.cycles-pp.sched_offline_group.sched_autogroup_exit.__put_task_struct.rcu_do_batch.rcu_core
0.73 ? 2% +0.8 1.53 ? 21% perf-profile.calltrace.cycles-pp.sched_autogroup_exit.__put_task_struct.rcu_do_batch.rcu_core.__softirqentry_text_start
0.00 +0.8 0.81 ? 3% perf-profile.calltrace.cycles-pp.init_tg_cfs_entry.alloc_fair_sched_group.sched_create_group.sched_autogroup_create_attach.ksys_setsid
1.30 ? 3% +0.8 2.12 ? 2% perf-profile.calltrace.cycles-pp.init_entity_runnable_average.alloc_fair_sched_group.sched_create_group.sched_autogroup_create_attach.ksys_setsid
0.55 ? 2% +0.9 1.40 perf-profile.calltrace.cycles-pp._cond_resched.kmem_cache_alloc_node_trace.alloc_fair_sched_group.sched_create_group.sched_autogroup_create_attach
1.54 +1.0 2.50 perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.online_fair_sched_group.sched_autogroup_create_attach.ksys_setsid.__x64_sys_setsid
1.76 ? 4% +1.0 2.73 ? 5% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.alloc_vmap_area.__get_vm_area_node.__vmalloc_node_range
1.77 ? 4% +1.0 2.74 ? 5% perf-profile.calltrace.cycles-pp._raw_spin_lock.alloc_vmap_area.__get_vm_area_node.__vmalloc_node_range.dup_task_struct
2.53 +1.0 3.53 perf-profile.calltrace.cycles-pp.memset_erms.kmem_cache_alloc_node_trace.alloc_rt_sched_group.sched_create_group.sched_autogroup_create_attach
1.93 ? 4% +1.0 2.95 ? 5% perf-profile.calltrace.cycles-pp.alloc_vmap_area.__get_vm_area_node.__vmalloc_node_range.dup_task_struct.copy_process
1.98 ? 4% +1.1 3.06 ? 4% perf-profile.calltrace.cycles-pp.__get_vm_area_node.__vmalloc_node_range.dup_task_struct.copy_process.kernel_clone
2.14 ? 3% +1.2 3.33 ? 4% perf-profile.calltrace.cycles-pp.__vmalloc_node_range.dup_task_struct.copy_process.kernel_clone.__x64_sys_vfork
2.78 ? 2% +1.6 4.37 ? 2% perf-profile.calltrace.cycles-pp.dup_task_struct.copy_process.kernel_clone.__x64_sys_vfork.do_syscall_64
1.94 +1.6 3.56 ? 3% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath.queued_write_lock_slowpath.copy_process.kernel_clone.__x64_sys_vfork
2.00 +1.7 3.67 ? 3% perf-profile.calltrace.cycles-pp.queued_write_lock_slowpath.copy_process.kernel_clone.__x64_sys_vfork.do_syscall_64
2.08 ? 3% +1.7 3.77 ? 2% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath.queued_write_lock_slowpath.release_task.wait_task_zombie.do_wait
2.29 ? 2% +1.7 4.03 ? 3% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath.queued_write_lock_slowpath.__x64_sys_setpgid.do_syscall_64.entry_SYSCALL_64_after_hwframe
2.15 ? 3% +1.8 3.91 ? 2% perf-profile.calltrace.cycles-pp.queued_write_lock_slowpath.release_task.wait_task_zombie.do_wait.kernel_wait4
2.35 ? 2% +1.8 4.15 ? 3% perf-profile.calltrace.cycles-pp.queued_write_lock_slowpath.__x64_sys_setpgid.do_syscall_64.entry_SYSCALL_64_after_hwframe
3.20 ? 2% +1.9 5.06 ? 2% perf-profile.calltrace.cycles-pp.__x64_sys_setpgid.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.97 ? 2% +1.9 3.86 ? 3% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath.queued_write_lock_slowpath.ksys_setsid.__x64_sys_setsid.do_syscall_64
2.41 ? 2% +1.9 4.32 ? 2% perf-profile.calltrace.cycles-pp.queued_read_lock_slowpath.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
2.22 ? 2% +1.9 4.15 ? 2% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath.queued_read_lock_slowpath.do_wait.kernel_wait4.__do_sys_wait4
2.72 ? 2% +2.0 4.68 ? 2% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath.queued_write_lock_slowpath.do_exit.do_group_exit.__x64_sys_exit_group
2.03 +2.0 3.98 ? 3% perf-profile.calltrace.cycles-pp.queued_write_lock_slowpath.ksys_setsid.__x64_sys_setsid.do_syscall_64.entry_SYSCALL_64_after_hwframe
2.79 ? 2% +2.0 4.80 ? 2% perf-profile.calltrace.cycles-pp.queued_write_lock_slowpath.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
3.30 ? 3% +2.0 5.31 ? 2% perf-profile.calltrace.cycles-pp.release_task.wait_task_zombie.do_wait.kernel_wait4.__do_sys_wait4
3.36 ? 3% +2.1 5.41 ? 2% perf-profile.calltrace.cycles-pp.wait_task_zombie.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
4.98 +2.4 7.36 perf-profile.calltrace.cycles-pp.online_fair_sched_group.sched_autogroup_create_attach.ksys_setsid.__x64_sys_setsid.do_syscall_64
4.82 +2.5 7.33 perf-profile.calltrace.cycles-pp.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe
4.82 +2.5 7.34 perf-profile.calltrace.cycles-pp.do_group_exit.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe
4.82 +2.5 7.34 perf-profile.calltrace.cycles-pp.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe
6.51 +3.9 10.36 perf-profile.calltrace.cycles-pp.copy_process.kernel_clone.__x64_sys_vfork.do_syscall_64.entry_SYSCALL_64_after_hwframe
8.18 +3.9 12.07 perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
9.44 +4.0 13.41 perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
9.45 +4.0 13.42 perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
5.83 ? 2% +4.0 9.81 ? 2% perf-profile.calltrace.cycles-pp.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe
5.85 ? 2% +4.0 9.84 ? 2% perf-profile.calltrace.cycles-pp.kernel_wait4.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe
5.85 ? 2% +4.0 9.85 ? 2% perf-profile.calltrace.cycles-pp.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe
9.94 +4.3 14.26 perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
9.94 +4.3 14.26 perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
9.94 +4.3 14.26 perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
10.06 +4.4 14.43 perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
8.45 +4.6 13.03 perf-profile.calltrace.cycles-pp.kernel_clone.__x64_sys_vfork.do_syscall_64.entry_SYSCALL_64_after_hwframe
8.45 +4.6 13.04 perf-profile.calltrace.cycles-pp.__x64_sys_vfork.do_syscall_64.entry_SYSCALL_64_after_hwframe
42.66 -28.0 14.65 ? 4% perf-profile.children.cycles-pp._raw_spin_lock
41.41 -26.7 14.69 ? 3% perf-profile.children.cycles-pp.__slab_alloc
47.96 -23.8 24.14 ? 2% perf-profile.children.cycles-pp.kmem_cache_alloc_node_trace
35.98 -23.5 12.44 ? 3% perf-profile.children.cycles-pp.___slab_alloc
53.53 -21.3 32.22 perf-profile.children.cycles-pp.sched_create_group
39.06 -19.9 19.12 ? 3% perf-profile.children.cycles-pp.alloc_fair_sched_group
60.78 -19.1 41.70 perf-profile.children.cycles-pp.sched_autogroup_create_attach
24.69 -18.0 6.65 ? 4% perf-profile.children.cycles-pp.get_partial_node
57.46 -17.9 39.58 perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
63.57 -17.0 46.56 perf-profile.children.cycles-pp.ksys_setsid
63.57 -17.0 46.56 perf-profile.children.cycles-pp.__x64_sys_setsid
10.45 -8.1 2.38 ? 5% perf-profile.children.cycles-pp.put_cpu_partial
10.27 -7.9 2.33 ? 5% perf-profile.children.cycles-pp.unfreeze_partials
13.21 -6.9 6.28 ? 2% perf-profile.children.cycles-pp.free_fair_sched_group
13.29 -6.9 6.42 ? 2% perf-profile.children.cycles-pp.sched_free_group
17.71 -4.6 13.12 perf-profile.children.cycles-pp.rcu_do_batch
17.73 -4.6 13.15 perf-profile.children.cycles-pp.rcu_core
17.86 -4.5 13.33 perf-profile.children.cycles-pp.__softirqentry_text_start
86.09 -4.0 82.11 perf-profile.children.cycles-pp.do_syscall_64
86.17 -3.9 82.23 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
15.30 -3.7 11.63 perf-profile.children.cycles-pp.irq_exit_rcu
15.27 -3.7 11.60 perf-profile.children.cycles-pp.do_softirq_own_stack
15.66 -3.6 12.05 perf-profile.children.cycles-pp.asm_call_sysvec_on_stack
15.67 -3.6 12.08 perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
15.73 -3.6 12.15 perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
7.44 -3.4 4.02 ? 3% perf-profile.children.cycles-pp.deactivate_slab
2.69 ? 2% -1.9 0.82 perf-profile.children.cycles-pp.allocate_slab
14.44 -1.4 13.06 perf-profile.children.cycles-pp.alloc_rt_sched_group
2.59 -0.9 1.72 ? 3% perf-profile.children.cycles-pp.run_ksoftirqd
2.60 -0.9 1.74 ? 3% perf-profile.children.cycles-pp.smpboot_thread_fn
2.83 -0.6 2.19 perf-profile.children.cycles-pp._raw_spin_lock_irqsave
3.31 -0.5 2.78 ? 2% perf-profile.children.cycles-pp.kthread
3.50 -0.5 3.01 ? 2% perf-profile.children.cycles-pp.ret_from_fork
0.90 -0.3 0.58 ? 2% perf-profile.children.cycles-pp.__alloc_pages_nodemask
2.00 -0.3 1.71 ? 2% perf-profile.children.cycles-pp.free_rt_sched_group
0.61 -0.3 0.34 ? 2% perf-profile.children.cycles-pp.rmqueue
0.78 -0.3 0.53 ? 2% perf-profile.children.cycles-pp.get_page_from_freelist
0.25 ? 3% -0.2 0.07 ? 10% perf-profile.children.cycles-pp.load_balance
0.34 ? 2% -0.2 0.18 ? 4% perf-profile.children.cycles-pp.pick_next_task_fair
0.28 -0.1 0.18 ? 2% perf-profile.children.cycles-pp.do_task_dead
0.45 ? 2% -0.1 0.37 perf-profile.children.cycles-pp.__list_del_entry_valid
0.15 ? 3% -0.0 0.13 ? 3% perf-profile.children.cycles-pp.free_one_page
0.18 ? 2% -0.0 0.17 ? 2% perf-profile.children.cycles-pp.__free_pages_ok
0.13 ? 2% +0.0 0.15 ? 3% perf-profile.children.cycles-pp.schedule_tail
0.05 +0.0 0.07 ? 7% perf-profile.children.cycles-pp.run_rebalance_domains
0.17 ? 4% +0.0 0.18 ? 4% perf-profile.children.cycles-pp.scheduler_tick
0.07 ? 7% +0.0 0.09 ? 5% perf-profile.children.cycles-pp.rcu_all_qs
0.05 +0.0 0.07 ? 8% perf-profile.children.cycles-pp.account_kernel_stack
0.04 ? 44% +0.0 0.07 ? 10% perf-profile.children.cycles-pp.update_cfs_group
0.05 ? 7% +0.0 0.08 ? 27% perf-profile.children.cycles-pp.get_obj_cgroup_from_current
0.05 +0.0 0.08 ? 8% perf-profile.children.cycles-pp.sched_ttwu_pending
0.04 ? 44% +0.0 0.07 perf-profile.children.cycles-pp.__switch_to_asm
0.05 +0.0 0.08 ? 4% perf-profile.children.cycles-pp.rebalance_domains
0.05 +0.0 0.08 ? 4% perf-profile.children.cycles-pp.queue_work_on
0.22 ? 3% +0.0 0.25 ? 2% perf-profile.children.cycles-pp.update_process_times
0.05 ? 9% +0.0 0.09 ? 23% perf-profile.children.cycles-pp.security_cred_free
0.05 +0.0 0.08 ? 4% perf-profile.children.cycles-pp.flush_smp_call_function_from_idle
0.07 ? 5% +0.0 0.10 ? 4% perf-profile.children.cycles-pp.perf_event_task_output
0.03 ? 70% +0.0 0.07 ? 11% perf-profile.children.cycles-pp.cpu_cgroup_fork
0.10 +0.0 0.13 ? 3% perf-profile.children.cycles-pp.native_sched_clock
0.07 ? 7% +0.0 0.10 ? 10% perf-profile.children.cycles-pp.filp_close
0.23 ? 3% +0.0 0.26 ? 2% perf-profile.children.cycles-pp.tick_sched_handle
0.05 +0.0 0.08 ? 5% perf-profile.children.cycles-pp.cgroup_can_fork
0.06 ? 6% +0.0 0.10 ? 7% perf-profile.children.cycles-pp.set_next_entity
0.08 ? 5% +0.0 0.12 ? 3% perf-profile.children.cycles-pp.sched_fork
0.12 ? 4% +0.0 0.15 ? 4% perf-profile.children.cycles-pp.sched_clock_cpu
0.03 ? 70% +0.0 0.07 ? 8% perf-profile.children.cycles-pp.copy_fs_struct
0.10 ? 4% +0.0 0.14 ? 4% perf-profile.children.cycles-pp.sched_clock
0.10 ? 5% +0.0 0.14 ? 3% perf-profile.children.cycles-pp.prep_new_page
0.24 +0.0 0.28 perf-profile.children.cycles-pp.tick_sched_timer
0.29 +0.0 0.33 ? 2% perf-profile.children.cycles-pp.__hrtimer_run_queues
0.08 ? 4% +0.0 0.12 ? 21% perf-profile.children.cycles-pp.put_pid
0.08 ? 8% +0.0 0.12 ? 3% perf-profile.children.cycles-pp.kill_pid_info
0.07 ? 5% +0.0 0.11 ? 3% perf-profile.children.cycles-pp.do_notify_parent
0.03 ? 70% +0.0 0.07 ? 10% perf-profile.children.cycles-pp.ktime_get
0.03 ? 70% +0.0 0.07 ? 6% perf-profile.children.cycles-pp.__queue_work
0.10 ? 3% +0.0 0.14 ? 2% perf-profile.children.cycles-pp.exit_to_user_mode_prepare
0.09 ? 5% +0.0 0.13 ? 15% perf-profile.children.cycles-pp.put_cred_rcu
0.02 ?141% +0.0 0.06 ? 6% perf-profile.children.cycles-pp.__update_load_avg_se
0.08 ? 8% +0.0 0.12 ? 4% perf-profile.children.cycles-pp.cgroup_post_fork
0.09 ? 4% +0.0 0.13 ? 7% perf-profile.children.cycles-pp.prepare_creds
0.09 +0.0 0.13 ? 2% perf-profile.children.cycles-pp.update_irq_load_avg
0.06 ? 8% +0.0 0.10 ? 5% perf-profile.children.cycles-pp.cgroup_release
0.09 ? 5% +0.0 0.13 ? 4% perf-profile.children.cycles-pp.kill_something_info
0.10 ? 4% +0.0 0.14 ? 9% perf-profile.children.cycles-pp.put_files_struct
0.09 ? 4% +0.0 0.14 ? 3% perf-profile.children.cycles-pp.perf_iterate_sb
0.05 ? 7% +0.0 0.10 ? 4% perf-profile.children.cycles-pp._raw_write_lock_irq
0.10 ? 4% +0.0 0.15 ? 2% perf-profile.children.cycles-pp.syscall_exit_to_user_mode
0.09 ? 4% +0.0 0.14 ? 3% perf-profile.children.cycles-pp.perf_event_task
0.15 ? 4% +0.0 0.20 perf-profile.children.cycles-pp.__list_add_valid
0.01 ?223% +0.0 0.06 ? 9% perf-profile.children.cycles-pp.perf_event_fork
0.09 ? 4% +0.0 0.14 ? 7% perf-profile.children.cycles-pp.copy_creds
0.11 ? 4% +0.0 0.16 ? 4% perf-profile.children.cycles-pp.__kmalloc
0.02 ?141% +0.0 0.07 ? 7% perf-profile.children.cycles-pp.task_change_group_fair
0.00 +0.0 0.05 perf-profile.children.cycles-pp.add_device_randomness
0.00 +0.0 0.05 perf-profile.children.cycles-pp.security_prepare_creds
0.00 +0.0 0.05 perf-profile.children.cycles-pp.rcu_cblist_dequeue
0.00 +0.0 0.05 perf-profile.children.cycles-pp.should_failslab
0.00 +0.0 0.05 perf-profile.children.cycles-pp.perf_trace_sched_wakeup_template
0.18 ? 4% +0.1 0.23 ? 2% perf-profile.children.cycles-pp.update_curr
0.06 ? 7% +0.1 0.11 ? 4% perf-profile.children.cycles-pp.clear_page_erms
0.10 ? 4% +0.1 0.15 ? 3% perf-profile.children.cycles-pp.ttwu_do_activate
0.01 ?223% +0.1 0.06 perf-profile.children.cycles-pp.propagate_entity_cfs_rq
0.00 +0.1 0.05 ? 7% perf-profile.children.cycles-pp.free_pid
0.00 +0.1 0.05 ? 7% perf-profile.children.cycles-pp.resched_curr
0.10 ? 4% +0.1 0.15 ? 2% perf-profile.children.cycles-pp.__x64_sys_kill
0.02 ?141% +0.1 0.07 perf-profile.children.cycles-pp.task_rq_lock
0.11 +0.1 0.16 ? 2% perf-profile.children.cycles-pp.select_idle_sibling
0.00 +0.1 0.05 ? 9% perf-profile.children.cycles-pp.__mod_memcg_lruvec_state
0.00 +0.1 0.06 ? 9% perf-profile.children.cycles-pp.__radix_tree_lookup
0.39 +0.1 0.45 ? 2% perf-profile.children.cycles-pp.hrtimer_interrupt
0.11 ? 4% +0.1 0.17 ? 2% perf-profile.children.cycles-pp.available_idle_cpu
0.00 +0.1 0.06 ? 6% perf-profile.children.cycles-pp.switch_mm_irqs_off
0.00 +0.1 0.06 ? 6% perf-profile.children.cycles-pp.__task_pid_nr_ns
0.00 +0.1 0.06 ? 6% perf-profile.children.cycles-pp.do_send_sig_info
0.39 +0.1 0.45 ? 2% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
0.37 ? 2% +0.1 0.43 ? 2% perf-profile.children.cycles-pp.schedule
0.00 +0.1 0.06 perf-profile.children.cycles-pp.group_send_sig_info
0.00 +0.1 0.06 perf-profile.children.cycles-pp.task_fork_fair
0.01 ?223% +0.1 0.07 perf-profile.children.cycles-pp.call_rcu
0.01 ?223% +0.1 0.07 perf-profile.children.cycles-pp.__task_rq_lock
0.20 ? 2% +0.1 0.26 perf-profile.children.cycles-pp._find_next_bit
0.16 ? 2% +0.1 0.23 ? 2% perf-profile.children.cycles-pp.arch_dup_task_struct
0.01 ?223% +0.1 0.07 ? 5% perf-profile.children.cycles-pp.cgroup_exit
0.00 +0.1 0.06 ? 7% perf-profile.children.cycles-pp.insert_vmap_area
0.15 ? 5% +0.1 0.21 ? 3% perf-profile.children.cycles-pp.enqueue_entity
0.10 ? 4% +0.1 0.17 ? 4% perf-profile.children.cycles-pp.alloc_pid
0.01 ?223% +0.1 0.07 ? 6% perf-profile.children.cycles-pp.menu_select
0.04 ? 44% +0.1 0.11 ? 8% perf-profile.children.cycles-pp.find_vm_area
0.00 +0.1 0.07 ? 5% perf-profile.children.cycles-pp.__wake_up_common_lock
0.18 ? 2% +0.1 0.25 ? 2% perf-profile.children.cycles-pp.memcpy_erms
0.13 ? 2% +0.1 0.21 ? 3% perf-profile.children.cycles-pp.dup_fd
0.20 ? 3% +0.1 0.28 ? 3% perf-profile.children.cycles-pp.enqueue_task_fair
0.22 ? 16% +0.1 0.30 ? 3% perf-profile.children.cycles-pp.free_vmap_area_noflush
0.16 ? 2% +0.1 0.25 ? 7% perf-profile.children.cycles-pp.kmem_cache_alloc_node
0.28 ? 2% +0.1 0.38 perf-profile.children.cycles-pp.cpumask_next
0.19 ? 3% +0.1 0.29 perf-profile.children.cycles-pp.dequeue_entity
0.00 +0.1 0.10 ? 27% perf-profile.children.cycles-pp.propagate_protected_usage
0.10 ? 7% +0.1 0.21 ? 11% perf-profile.children.cycles-pp.__memcg_kmem_charge_page
0.23 ? 2% +0.1 0.35 ? 2% perf-profile.children.cycles-pp.dequeue_task_fair
0.11 ? 4% +0.1 0.23 ? 10% perf-profile.children.cycles-pp.__memcg_kmem_uncharge_page
0.27 ? 2% +0.1 0.39 ? 2% perf-profile.children.cycles-pp.autogroup_move_group
0.12 ? 3% +0.1 0.24 ? 9% perf-profile.children.cycles-pp.obj_cgroup_charge
0.24 +0.1 0.37 ? 3% perf-profile.children.cycles-pp.acct_collect
0.33 ? 2% +0.1 0.46 ? 5% perf-profile.children.cycles-pp.__might_sleep
0.29 ? 2% +0.1 0.43 ? 2% perf-profile.children.cycles-pp.swake_up_locked
0.29 ? 12% +0.1 0.43 ? 3% perf-profile.children.cycles-pp.remove_vm_area
0.31 +0.1 0.45 ? 2% perf-profile.children.cycles-pp.complete
0.33 +0.1 0.47 perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
0.25 +0.1 0.39 ? 7% perf-profile.children.cycles-pp.kmem_cache_alloc
0.36 +0.2 0.51 ? 2% perf-profile.children.cycles-pp.mm_release
0.39 ? 3% +0.2 0.55 ? 5% perf-profile.children.cycles-pp.finish_task_switch
0.15 ? 4% +0.2 0.32 ? 19% perf-profile.children.cycles-pp.drain_obj_stock
0.21 ? 2% +0.2 0.37 ? 6% perf-profile.children.cycles-pp.put_task_stack
0.35 ? 6% +0.2 0.52 ? 5% perf-profile.children.cycles-pp.find_vmap_area
0.33 +0.2 0.50 ? 2% perf-profile.children.cycles-pp.sched_move_task
0.36 +0.2 0.53 ? 2% perf-profile.children.cycles-pp.try_to_wake_up
0.53 +0.2 0.71 perf-profile.children.cycles-pp.attach_entity_load_avg
0.23 ? 4% +0.2 0.42 ? 20% perf-profile.children.cycles-pp.refill_obj_stock
0.15 ? 4% +0.2 0.35 ? 12% perf-profile.children.cycles-pp.page_counter_try_charge
0.17 ? 4% +0.2 0.38 ? 13% perf-profile.children.cycles-pp.__memcg_kmem_charge
0.98 +0.2 1.20 perf-profile.children.cycles-pp.__sched_text_start
0.16 ? 5% +0.2 0.40 ? 18% perf-profile.children.cycles-pp.__memcg_kmem_uncharge
0.17 ? 4% +0.2 0.42 ? 17% perf-profile.children.cycles-pp.page_counter_cancel
0.17 ? 4% +0.2 0.42 ? 17% perf-profile.children.cycles-pp.page_counter_uncharge
0.34 ? 2% +0.3 0.60 ? 3% perf-profile.children.cycles-pp.schedule_idle
0.36 ? 2% +0.3 0.63 perf-profile.children.cycles-pp.___might_sleep
0.77 +0.3 1.05 perf-profile.children.cycles-pp._cond_resched
0.47 ? 4% +0.3 0.76 ? 18% perf-profile.children.cycles-pp.kmem_cache_free
0.63 ? 6% +0.3 0.92 ? 4% perf-profile.children.cycles-pp.__vunmap
0.64 ? 6% +0.3 0.94 ? 4% perf-profile.children.cycles-pp.free_work
0.65 ? 6% +0.3 0.95 ? 4% perf-profile.children.cycles-pp.process_one_work
0.60 +0.3 0.91 perf-profile.children.cycles-pp.__update_load_avg_blocked_se
0.71 ? 5% +0.3 1.03 ? 4% perf-profile.children.cycles-pp.worker_thread
0.44 ? 3% +0.4 0.81 ? 3% perf-profile.children.cycles-pp.init_tg_cfs_entry
3.79 +0.5 4.25 ? 2% perf-profile.children.cycles-pp.__slab_free
0.86 +0.5 1.32 ? 2% perf-profile.children.cycles-pp.kfree
0.97 +0.5 1.44 perf-profile.children.cycles-pp.find_idlest_group
1.13 +0.5 1.66 perf-profile.children.cycles-pp.update_load_avg
1.23 +0.6 1.80 perf-profile.children.cycles-pp.update_rq_clock
1.24 +0.6 1.83 perf-profile.children.cycles-pp.select_task_rq_fair
1.53 +0.6 2.17 perf-profile.children.cycles-pp.attach_entity_cfs_rq
1.59 +0.6 2.24 ? 2% perf-profile.children.cycles-pp.wake_up_new_task
1.30 ? 3% +0.8 2.13 ? 2% perf-profile.children.cycles-pp.init_entity_runnable_average
2.34 +1.0 3.34 perf-profile.children.cycles-pp.remove_entity_load_avg
1.93 ? 4% +1.0 2.95 ? 5% perf-profile.children.cycles-pp.alloc_vmap_area
1.98 ? 4% +1.1 3.06 ? 4% perf-profile.children.cycles-pp.__get_vm_area_node
1.73 +1.1 2.83 perf-profile.children.cycles-pp._raw_spin_lock_irq
2.14 ? 3% +1.2 3.33 ? 4% perf-profile.children.cycles-pp.__vmalloc_node_range
2.78 ? 2% +1.6 4.37 ? 2% perf-profile.children.cycles-pp.dup_task_struct
3.88 +1.8 5.66 perf-profile.children.cycles-pp.memset_erms
3.20 ? 2% +1.9 5.06 ? 2% perf-profile.children.cycles-pp.__x64_sys_setpgid
2.41 ? 2% +1.9 4.32 ? 2% perf-profile.children.cycles-pp.queued_read_lock_slowpath
3.77 +1.9 5.67 ? 2% perf-profile.children.cycles-pp.unregister_fair_sched_group
3.82 +1.9 5.75 ? 2% perf-profile.children.cycles-pp.sched_offline_group
3.82 +1.9 5.77 ? 2% perf-profile.children.cycles-pp.sched_autogroup_exit
3.30 ? 3% +2.0 5.32 ? 2% perf-profile.children.cycles-pp.release_task
4.04 +2.0 6.08 perf-profile.children.cycles-pp.__put_task_struct
3.36 ? 3% +2.1 5.41 ? 2% perf-profile.children.cycles-pp.wait_task_zombie
4.99 +2.4 7.39 perf-profile.children.cycles-pp.online_fair_sched_group
4.82 +2.5 7.33 perf-profile.children.cycles-pp.do_exit
4.82 +2.5 7.34 perf-profile.children.cycles-pp.do_group_exit
4.82 +2.5 7.34 perf-profile.children.cycles-pp.__x64_sys_exit_group
6.52 +3.9 10.38 perf-profile.children.cycles-pp.copy_process
8.29 +3.9 12.20 perf-profile.children.cycles-pp.intel_idle
5.83 ? 2% +4.0 9.82 ? 2% perf-profile.children.cycles-pp.do_wait
5.85 ? 2% +4.0 9.85 ? 2% perf-profile.children.cycles-pp.__do_sys_wait4
5.85 ? 2% +4.0 9.85 ? 2% perf-profile.children.cycles-pp.kernel_wait4
9.57 +4.0 13.57 perf-profile.children.cycles-pp.cpuidle_enter
9.57 +4.0 13.57 perf-profile.children.cycles-pp.cpuidle_enter_state
9.94 +4.3 14.26 perf-profile.children.cycles-pp.start_secondary
10.06 +4.4 14.42 perf-profile.children.cycles-pp.do_idle
10.06 +4.4 14.43 perf-profile.children.cycles-pp.secondary_startup_64_no_verify
10.06 +4.4 14.43 perf-profile.children.cycles-pp.cpu_startup_entry
8.45 +4.6 13.04 perf-profile.children.cycles-pp.__x64_sys_vfork
8.45 +4.6 13.04 perf-profile.children.cycles-pp.kernel_clone
11.32 ? 2% +9.2 20.52 ? 2% perf-profile.children.cycles-pp.queued_write_lock_slowpath
57.18 -18.1 39.12 perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
0.60 ? 2% -0.3 0.30 ? 2% perf-profile.self.cycles-pp.allocate_slab
0.45 ? 2% -0.2 0.20 ? 5% perf-profile.self.cycles-pp.unfreeze_partials
1.16 -0.2 0.95 perf-profile.self.cycles-pp.___slab_alloc
0.45 ? 2% -0.1 0.37 perf-profile.self.cycles-pp.__list_del_entry_valid
0.59 -0.0 0.54 perf-profile.self.cycles-pp.get_partial_node
0.07 ? 5% -0.0 0.05 perf-profile.self.cycles-pp.rmqueue
0.06 ? 6% +0.0 0.08 ? 4% perf-profile.self.cycles-pp.cpumask_next
0.04 ? 44% +0.0 0.07 ? 11% perf-profile.self.cycles-pp.update_cfs_group
0.12 ? 3% +0.0 0.15 ? 3% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
0.10 ? 3% +0.0 0.12 ? 4% perf-profile.self.cycles-pp.native_sched_clock
0.04 ? 44% +0.0 0.07 perf-profile.self.cycles-pp.__switch_to_asm
0.11 ? 5% +0.0 0.14 ? 2% perf-profile.self.cycles-pp.update_curr
0.04 ? 45% +0.0 0.07 ? 6% perf-profile.self.cycles-pp.enqueue_entity
0.06 ? 8% +0.0 0.09 ? 7% perf-profile.self.cycles-pp.dup_fd
0.03 ? 99% +0.0 0.06 ? 6% perf-profile.self.cycles-pp.free_fair_sched_group
0.05 ? 9% +0.0 0.09 ? 5% perf-profile.self.cycles-pp.alloc_vmap_area
0.02 ?141% +0.0 0.06 ? 8% perf-profile.self.cycles-pp.__update_load_avg_se
0.15 ? 4% +0.0 0.19 ? 2% perf-profile.self.cycles-pp.__list_add_valid
0.08 ? 5% +0.0 0.13 ? 5% perf-profile.self.cycles-pp.copy_process
0.09 ? 4% +0.0 0.13 ? 2% perf-profile.self.cycles-pp.update_irq_load_avg
0.05 ? 7% +0.0 0.10 ? 4% perf-profile.self.cycles-pp._raw_write_lock_irq
0.09 ? 4% +0.0 0.14 ? 3% perf-profile.self.cycles-pp.select_task_rq_fair
0.08 +0.0 0.13 ? 8% perf-profile.self.cycles-pp.kmem_cache_alloc
0.05 ? 7% +0.0 0.10 ? 5% perf-profile.self.cycles-pp.clear_page_erms
0.01 ?223% +0.0 0.06 ? 8% perf-profile.self.cycles-pp.rcu_all_qs
0.00 +0.0 0.05 perf-profile.self.cycles-pp.insert_vmap_area
0.00 +0.0 0.05 perf-profile.self.cycles-pp.resched_curr
0.00 +0.0 0.05 perf-profile.self.cycles-pp.rcu_cblist_dequeue
0.12 ? 4% +0.1 0.18 ? 2% perf-profile.self.cycles-pp.attach_entity_cfs_rq
0.10 ? 3% +0.1 0.15 ? 3% perf-profile.self.cycles-pp.__sched_text_start
0.00 +0.1 0.05 ? 8% perf-profile.self.cycles-pp.free_vmap_area_noflush
0.00 +0.1 0.05 ? 8% perf-profile.self.cycles-pp.__task_pid_nr_ns
0.11 ? 4% +0.1 0.17 ? 2% perf-profile.self.cycles-pp.available_idle_cpu
0.18 ? 2% +0.1 0.23 ? 2% perf-profile.self.cycles-pp._find_next_bit
0.00 +0.1 0.06 ? 9% perf-profile.self.cycles-pp.__radix_tree_lookup
0.07 ? 7% +0.1 0.12 ? 3% perf-profile.self.cycles-pp.queued_read_lock_slowpath
0.00 +0.1 0.06 ? 8% perf-profile.self.cycles-pp.filp_close
0.00 +0.1 0.06 ? 6% perf-profile.self.cycles-pp.find_vmap_area
0.01 ?223% +0.1 0.07 ? 27% perf-profile.self.cycles-pp.get_obj_cgroup_from_current
0.15 ? 4% +0.1 0.21 ? 2% perf-profile.self.cycles-pp._cond_resched
0.18 ? 4% +0.1 0.25 ? 28% perf-profile.self.cycles-pp.kmem_cache_free
0.15 ? 3% +0.1 0.23 ? 2% perf-profile.self.cycles-pp.memcpy_erms
0.00 +0.1 0.10 ? 28% perf-profile.self.cycles-pp.propagate_protected_usage
0.25 ? 3% +0.1 0.35 ? 4% perf-profile.self.cycles-pp.__might_sleep
0.20 ? 3% +0.1 0.32 ? 3% perf-profile.self.cycles-pp.acct_collect
0.83 +0.1 0.96 perf-profile.self.cycles-pp._raw_spin_lock
0.25 ? 2% +0.1 0.38 ? 2% perf-profile.self.cycles-pp.online_fair_sched_group
0.32 ? 2% +0.1 0.46 perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
0.12 ? 5% +0.2 0.28 ? 12% perf-profile.self.cycles-pp.page_counter_try_charge
0.53 +0.2 0.70 ? 2% perf-profile.self.cycles-pp.attach_entity_load_avg
0.29 ? 3% +0.2 0.47 ? 2% perf-profile.self.cycles-pp.alloc_fair_sched_group
0.71 ? 6% +0.2 0.90 ? 2% perf-profile.self.cycles-pp.remove_entity_load_avg
0.14 ? 3% +0.2 0.34 ? 16% perf-profile.self.cycles-pp.page_counter_cancel
0.32 ? 2% +0.3 0.58 perf-profile.self.cycles-pp.___might_sleep
0.31 ? 2% +0.3 0.60 ? 3% perf-profile.self.cycles-pp.queued_write_lock_slowpath
0.68 +0.3 0.98 perf-profile.self.cycles-pp.update_load_avg
0.60 +0.3 0.90 perf-profile.self.cycles-pp.__update_load_avg_blocked_se
0.37 +0.3 0.71 ? 2% perf-profile.self.cycles-pp.init_tg_cfs_entry
0.79 +0.4 1.23 ? 2% perf-profile.self.cycles-pp.kfree
0.92 +0.4 1.36 perf-profile.self.cycles-pp.find_idlest_group
1.05 +0.5 1.54 perf-profile.self.cycles-pp.update_rq_clock
1.16 +0.5 1.66 perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.99 +0.5 1.52 perf-profile.self.cycles-pp._raw_spin_lock_irq
0.57 ? 2% +0.7 1.23 perf-profile.self.cycles-pp.deactivate_slab
1.11 ? 3% +0.8 1.86 perf-profile.self.cycles-pp.init_entity_runnable_average
1.85 +0.8 2.61 perf-profile.self.cycles-pp.kmem_cache_alloc_node_trace
1.33 ? 3% +0.9 2.22 ? 4% perf-profile.self.cycles-pp.unregister_fair_sched_group
2.86 +1.1 3.92 perf-profile.self.cycles-pp.alloc_rt_sched_group
2.43 +1.5 3.98 ? 2% perf-profile.self.cycles-pp.__slab_free
3.34 +1.7 5.03 perf-profile.self.cycles-pp.memset_erms
8.29 +3.9 12.20 perf-profile.self.cycles-pp.intel_idle
stress-ng.time.user_time
1200 +--------------------------------------------------------------------+
| O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O |
1100 |-+ |
| |
1000 |-+ |
| |
900 |-+ |
| |
800 |-+ |
| |
700 |-+ |
| |
600 |.+.+.+.+.+.+.+.+.+.+.+. .+.+.+..+.+.+.+.+.+.+.+.+.+.+.+.+.+.+. .+.|
| + +.+ + |
500 +--------------------------------------------------------------------+
stress-ng.time.system_time
3400 +--------------------------------------------------------------------+
| |
3300 |-+ .+. .+.+.+. .+. .+.+. .+ |
|.+.+.+ +.+.+.+.+.+ +.+.+..+.+.+.+.+.+.+ +.+.+ +.+.+ +|
3200 |-+ |
| |
3100 |-+ |
| |
3000 |-+ |
| |
2900 |-+ |
| |
2800 |-O O O O O |
| O O O O O O O O O O O O O O O O O O O O O O O O O |
2700 +--------------------------------------------------------------------+
stress-ng.time.voluntary_context_switches
1.05e+07 +----------------------------------------------------------------+
| |
1e+07 |-O O O O OO O O O O O O O O O O O O O O O O O OO O O O O |
| O O O O |
9.5e+06 |-+ |
| |
9e+06 |-+ |
| |
8.5e+06 |-+ |
| |
8e+06 |-+ |
| |
7.5e+06 |-+ |
|.+.+.+.+.++.+.+.+.+.+.+.+.+.+.+.++.+.+.+.+.+.+.+.+.+.++.+.+.+.+.|
7e+06 +----------------------------------------------------------------+
stress-ng.vfork.ops
5.2e+06 +-----------------------------------------------------------------+
| |
5e+06 |-O O O O O O O OO O O O O O O O O O O O O O OO O O O O O O O |
| O O |
4.8e+06 |-+ |
4.6e+06 |-+ |
| |
4.4e+06 |-+ |
| |
4.2e+06 |-+ |
4e+06 |-+ |
| |
3.8e+06 |-+ .+. .+. .+.+ .+. .+.+.+.+.+. .+.+.+. .++.+.+. .+.|
|.+.+ + + + +.+.+.+ + + +.+.+.+ |
3.6e+06 +-----------------------------------------------------------------+
stress-ng.vfork.ops_per_sec
85000 +-------------------------------------------------------------------+
| O O O O O O O O O O O O O O O O O O O O O O O O O O |
| O O O O O O O |
80000 |-+ |
| |
| |
75000 |-+ |
| |
70000 |-+ |
| |
| |
65000 |-+ |
|. .+. .+.+.+.+.+.+. .+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.|
| +.+ + +.+.+ |
60000 +-------------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Oliver Sang