Greeting,
FYI, we noticed a -73.9% regression of stress-ng.dnotify.ops_per_sec due to commit:
commit: 7f835610979ba652213f2a41e60f3e0ad16884bf ("xfs: deferred inode inactivation")
https://git.kernel.org/cgit/linux/kernel/git/djwong/xfs-linux.git vectorized-scrub
in testcase: stress-ng
on test machine: 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 512G memory
with following parameters:
nr_threads: 10%
disk: 1HDD
testtime: 60s
fs: xfs
class: filesystem
test: dnotify
cpufreq_governor: performance
ucode: 0x5003006
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <[email protected]>
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp split-job --compatible job.yaml
bin/lkp run compatible-job.yaml
=========================================================================================
class/compiler/cpufreq_governor/disk/fs/kconfig/nr_threads/rootfs/tbox_group/test/testcase/testtime/ucode:
filesystem/gcc-9/performance/1HDD/xfs/x86_64-rhel-8.3/10%/debian-10.4-x86_64-20200603.cgz/lkp-csl-2sp7/dnotify/stress-ng/60s/0x5003006
commit:
dfe11e96a9 ("xfs: decide if inode needs inactivation")
7f83561097 ("xfs: deferred inode inactivation")
dfe11e96a97bf90e 7f835610979ba652213f2a41e60
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:6 67% 4:6 kmsg.XFS(sda1):xlog_verify_grant_tail:space>BBTOB(tail_blocks)
:6 33% 2:6 kmsg.XFS(sdb1):xlog_verify_grant_tail:space>BBTOB(tail_blocks)
%stddev %change %stddev
\ | \
1237518 ? 3% -73.4% 328562 ? 2% stress-ng.dnotify.ops
20625 ? 3% -73.9% 5386 stress-ng.dnotify.ops_per_sec
62.07 +1.6% 63.09 stress-ng.time.elapsed_time
62.07 +1.6% 63.09 stress-ng.time.elapsed_time.max
49500612 ? 3% -73.5% 13142322 ? 2% stress-ng.time.file_system_outputs
48525 ? 2% -79.0% 10174 ? 3% stress-ng.time.involuntary_context_switches
698.50 -77.1% 160.17 ? 3% stress-ng.time.percent_of_cpu_this_job_got
422.99 -76.8% 98.17 ? 2% stress-ng.time.system_time
10.84 ? 3% -71.3% 3.12 stress-ng.time.user_time
13273998 ? 2% -79.9% 2662800 ? 2% stress-ng.time.voluntary_context_switches
92.03 +4.5% 96.14 iostat.cpu.idle
7.64 -53.2% 3.58 ? 8% iostat.cpu.system
82062533 ? 5% -48.2% 42480684 ? 27% cpuidle.C1.time
10997236 ? 3% -71.7% 3116762 ? 24% cpuidle.C1.usage
7041678 ? 12% -90.8% 645474 ? 64% cpuidle.POLL.time
1604875 ? 17% -96.1% 62665 ? 30% cpuidle.POLL.usage
0.01 ?141% +0.1 0.07 ? 17% mpstat.cpu.all.iowait%
0.70 ? 2% +0.4 1.07 ? 16% mpstat.cpu.all.irq%
6.31 -5.0 1.35 mpstat.cpu.all.sys%
0.30 -0.2 0.13 ? 4% mpstat.cpu.all.usr%
3042003 ? 24% -59.9% 1219129 ? 30% numa-numastat.node0.local_node
3062529 ? 24% -59.2% 1248975 ? 29% numa-numastat.node0.numa_hit
3594498 ? 24% -68.3% 1139998 ? 29% numa-numastat.node1.local_node
3660378 ? 23% -67.3% 1196625 ? 27% numa-numastat.node1.numa_hit
1.75 ? 61% -77.6% 0.39 ? 49% perf-sched.sch_delay.avg.ms.worker_thread.kthread.ret_from_fork
0.04 ? 12% -22.4% 0.03 ? 10% perf-sched.wait_and_delay.avg.ms.pipe_read.new_sync_read.vfs_read.ksys_read
2.83 ? 62% +241.2% 9.67 ? 39% perf-sched.wait_and_delay.count.worker_thread.kthread.ret_from_fork
0.04 ? 13% -20.5% 0.03 ? 8% perf-sched.wait_time.avg.ms.pipe_read.new_sync_read.vfs_read.ksys_read
0.38 ?109% -77.1% 0.09 ? 65% perf-sched.wait_time.max.ms.pipe_read.new_sync_read.vfs_read.ksys_read
92.00 +4.2% 95.83 vmstat.cpu.id
13.33 ?109% +1.7e+05% 23035 ? 2% vmstat.io.bo
1158975 +89.9% 2200794 vmstat.memory.cache
7.00 -71.4% 2.00 vmstat.procs.r
414493 ? 2% -76.8% 96097 vmstat.system.cs
201970 -4.9% 192005 vmstat.system.in
7188 -41.2% 4224 ? 7% meminfo.Active
6782 -43.6% 3827 ? 8% meminfo.Active(anon)
89028 +1160.2% 1121973 ? 2% meminfo.KReclaimable
2810221 +79.1% 5033113 meminfo.Memused
89028 +1160.2% 1121973 ? 2% meminfo.SReclaimable
190545 +396.3% 945621 ? 2% meminfo.SUnreclaim
18608 -16.6% 15525 ? 2% meminfo.Shmem
279573 +639.6% 2067595 ? 2% meminfo.Slab
2918080 +72.8% 5042980 meminfo.max_used_kB
50144 ? 5% +1088.3% 595856 ? 36% numa-meminfo.node0.KReclaimable
1518744 ? 5% +68.7% 2561639 ? 21% numa-meminfo.node0.MemUsed
50144 ? 5% +1088.3% 595856 ? 36% numa-meminfo.node0.SReclaimable
105038 ? 5% +377.2% 501234 ? 36% numa-meminfo.node0.SUnreclaim
155183 ? 3% +607.0% 1097091 ? 36% numa-meminfo.node0.Slab
5720 ? 5% -54.8% 2587 ? 20% numa-meminfo.node1.Active
5479 ? 4% -55.0% 2465 ? 20% numa-meminfo.node1.Active(anon)
38882 ? 7% +1255.0% 526872 ? 37% numa-meminfo.node1.KReclaimable
1291635 ? 6% +91.5% 2473090 ? 20% numa-meminfo.node1.MemUsed
38882 ? 7% +1255.0% 526872 ? 37% numa-meminfo.node1.SReclaimable
85544 ? 6% +419.9% 444766 ? 40% numa-meminfo.node1.SUnreclaim
124427 ? 4% +680.9% 971639 ? 38% numa-meminfo.node1.Slab
1199424 ? 30% -62.0% 455439 ? 39% numa-vmstat.node0.nr_dirtied
12535 ? 5% +1090.1% 149184 ? 36% numa-vmstat.node0.nr_slab_reclaimable
26271 ? 5% +377.4% 125417 ? 36% numa-vmstat.node0.nr_slab_unreclaimable
2100796 ? 17% -34.2% 1382512 ? 17% numa-vmstat.node0.numa_hit
2055576 ? 17% -34.4% 1347695 ? 18% numa-vmstat.node0.numa_local
1369 ? 4% -55.0% 616.17 ? 20% numa-vmstat.node1.nr_active_anon
1767675 ? 25% -76.8% 409372 ? 40% numa-vmstat.node1.nr_dirtied
9720 ? 7% +1257.2% 131925 ? 37% numa-vmstat.node1.nr_slab_reclaimable
21382 ? 6% +420.6% 111314 ? 39% numa-vmstat.node1.nr_slab_unreclaimable
1369 ? 4% -55.0% 616.17 ? 20% numa-vmstat.node1.nr_zone_active_anon
2583006 ? 18% -47.5% 1355326 ? 16% numa-vmstat.node1.numa_hit
2375790 ? 19% -52.1% 1137231 ? 20% numa-vmstat.node1.numa_local
1695 -43.6% 956.33 ? 8% proc-vmstat.nr_active_anon
6187166 ? 3% -73.5% 1642672 ? 2% proc-vmstat.nr_dirtied
4652 -16.6% 3879 ? 2% proc-vmstat.nr_shmem
22256 +1161.4% 280733 ? 2% proc-vmstat.nr_slab_reclaimable
47647 +396.4% 236532 ? 2% proc-vmstat.nr_slab_unreclaimable
1695 -43.6% 956.33 ? 8% proc-vmstat.nr_zone_active_anon
6689446 ? 3% -63.2% 2464182 ? 2% proc-vmstat.numa_hit
6602940 ? 3% -64.0% 2377633 ? 3% proc-vmstat.numa_local
3549 ? 2% -63.5% 1296 ? 20% proc-vmstat.pgactivate
6876740 ? 3% -53.0% 3232013 ? 2% proc-vmstat.pgalloc_normal
6743259 ? 3% -68.8% 2107101 ? 2% proc-vmstat.pgfree
806.50 ?117% +1.8e+05% 1491815 ? 2% proc-vmstat.pgpgout
9.01 ? 7% +102.6% 18.25 ? 85% perf-stat.i.MPKI
3.035e+09 ? 3% -65.1% 1.058e+09 perf-stat.i.branch-instructions
1.22 +1.1 2.31 ? 79% perf-stat.i.branch-miss-rate%
35811212 ? 2% -52.5% 17004880 ? 22% perf-stat.i.branch-misses
40800963 ? 10% -67.7% 13182099 ? 12% perf-stat.i.cache-misses
1.393e+08 ? 10% -61.8% 53257508 ? 31% perf-stat.i.cache-references
428722 ? 2% -76.9% 99004 perf-stat.i.context-switches
1.64 ? 3% +104.9% 3.37 ? 20% perf-stat.i.cpi
2.519e+10 -61.4% 9.729e+09 ? 7% perf-stat.i.cpu-cycles
140.36 ? 2% -11.7% 123.98 perf-stat.i.cpu-migrations
734.66 ? 8% +50.4% 1105 ? 17% perf-stat.i.cycles-between-cache-misses
0.01 ? 21% +0.2 0.17 ?108% perf-stat.i.dTLB-load-miss-rate%
4.277e+09 ? 3% -66.8% 1.419e+09 perf-stat.i.dTLB-loads
0.00 ? 15% +0.0 0.05 ?103% perf-stat.i.dTLB-store-miss-rate%
2.483e+09 ? 3% -68.6% 7.797e+08 perf-stat.i.dTLB-stores
19790920 ? 2% -70.8% 5771607 ? 3% perf-stat.i.iTLB-load-misses
23141891 ? 3% -68.0% 7406149 ? 3% perf-stat.i.iTLB-loads
1.532e+10 ? 3% -65.4% 5.294e+09 perf-stat.i.instructions
0.62 ? 2% -33.7% 0.41 ? 7% perf-stat.i.ipc
0.26 -61.3% 0.10 ? 7% perf-stat.i.metric.GHz
103.96 ? 3% -66.7% 34.66 perf-stat.i.metric.M/sec
3304 ? 2% -2.7% 3216 perf-stat.i.minor-faults
92.84 -19.5 73.36 ? 7% perf-stat.i.node-load-miss-rate%
15780181 ? 14% -77.5% 3554472 ? 15% perf-stat.i.node-load-misses
1057190 ? 9% -31.2% 726824 ? 6% perf-stat.i.node-loads
96.01 -25.9 70.11 ? 8% perf-stat.i.node-store-miss-rate%
5866625 ? 15% -72.3% 1627188 ? 16% perf-stat.i.node-store-misses
102306 ? 18% +502.6% 616466 ? 9% perf-stat.i.node-stores
3315 ? 2% -2.7% 3227 perf-stat.i.page-faults
1.18 +0.4 1.61 ? 22% perf-stat.overall.branch-miss-rate%
1.65 ? 3% +11.6% 1.84 ? 7% perf-stat.overall.cpi
624.78 ? 10% +19.5% 746.52 ? 12% perf-stat.overall.cycles-between-cache-misses
0.01 ? 22% +0.0 0.05 ? 86% perf-stat.overall.dTLB-load-miss-rate%
0.00 ? 11% +0.0 0.01 ? 80% perf-stat.overall.dTLB-store-miss-rate%
46.11 ? 2% -2.3 43.81 ? 2% perf-stat.overall.iTLB-load-miss-rate%
774.22 +18.6% 918.08 ? 3% perf-stat.overall.instructions-per-iTLB-miss
0.61 ? 2% -10.0% 0.55 ? 7% perf-stat.overall.ipc
93.65 -10.9 82.70 ? 3% perf-stat.overall.node-load-miss-rate%
98.26 -26.2 72.10 ? 6% perf-stat.overall.node-store-miss-rate%
2.986e+09 ? 3% -65.0% 1.044e+09 perf-stat.ps.branch-instructions
35265519 ? 2% -52.4% 16769053 ? 22% perf-stat.ps.branch-misses
40134921 ? 10% -67.6% 13000789 ? 11% perf-stat.ps.cache-misses
1.37e+08 ? 10% -61.7% 52528482 ? 31% perf-stat.ps.cache-references
421720 ? 2% -76.8% 97743 perf-stat.ps.context-switches
2.478e+10 -61.3% 9.593e+09 ? 7% perf-stat.ps.cpu-cycles
138.14 ? 2% -11.6% 122.07 perf-stat.ps.cpu-migrations
4.208e+09 ? 3% -66.7% 1.4e+09 perf-stat.ps.dTLB-loads
2.443e+09 ? 3% -68.5% 7.694e+08 perf-stat.ps.dTLB-stores
19468460 ? 2% -70.8% 5693812 ? 3% perf-stat.ps.iTLB-load-misses
22764523 ? 3% -67.9% 7306057 ? 4% perf-stat.ps.iTLB-loads
1.507e+10 ? 3% -65.4% 5.223e+09 perf-stat.ps.instructions
3256 ? 2% -2.8% 3166 perf-stat.ps.minor-faults
15522002 ? 14% -77.4% 3507715 ? 15% perf-stat.ps.node-load-misses
1039975 ? 9% -31.1% 716845 ? 6% perf-stat.ps.node-loads
5770592 ? 14% -72.2% 1605965 ? 15% perf-stat.ps.node-store-misses
100771 ? 18% +503.9% 608590 ? 9% perf-stat.ps.node-stores
3267 ? 2% -2.7% 3178 perf-stat.ps.page-faults
9.535e+11 ? 3% -64.8% 3.357e+11 perf-stat.total.instructions
1189 ? 7% +53.8% 1829 ? 7% slabinfo.Acpi-Parse.active_objs
1189 ? 7% +53.8% 1829 ? 7% slabinfo.Acpi-Parse.num_objs
356.83 ? 6% +28.4% 458.33 ? 11% slabinfo.biovec-64.active_objs
356.83 ? 6% +28.4% 458.33 ? 11% slabinfo.biovec-64.num_objs
2.33 ? 80% +22385.7% 524.67 ? 24% slabinfo.btrfs_ordered_extent.active_objs
2.33 ? 80% +22392.9% 524.83 ? 24% slabinfo.btrfs_ordered_extent.num_objs
1573 ? 9% +63.6% 2574 ? 20% slabinfo.dmaengine-unmap-16.active_objs
1573 ? 9% +66.9% 2626 ? 19% slabinfo.dmaengine-unmap-16.num_objs
5275 +87.9% 9912 ? 5% slabinfo.kmalloc-128.active_objs
166.50 +88.8% 314.33 ? 5% slabinfo.kmalloc-128.active_slabs
5332 +88.9% 10075 ? 5% slabinfo.kmalloc-128.num_objs
166.50 +88.8% 314.33 ? 5% slabinfo.kmalloc-128.num_slabs
35867 +4329.5% 1588746 ? 2% slabinfo.kmalloc-16.active_objs
140.17 +4327.5% 6205 ? 2% slabinfo.kmalloc-16.active_slabs
35882 +4327.8% 1588803 ? 2% slabinfo.kmalloc-16.num_objs
140.17 +4327.5% 6205 ? 2% slabinfo.kmalloc-16.num_slabs
71716 +31.4% 94239 slabinfo.kmalloc-32.active_objs
561.17 ? 2% +31.1% 735.83 slabinfo.kmalloc-32.active_slabs
71885 ? 2% +31.1% 94259 slabinfo.kmalloc-32.num_objs
561.17 ? 2% +31.1% 735.83 slabinfo.kmalloc-32.num_slabs
11784 ? 2% +8994.3% 1071666 ? 3% slabinfo.kmalloc-512.active_objs
368.83 ? 2% +9339.1% 34814 ? 2% slabinfo.kmalloc-512.active_slabs
11819 ? 2% +9325.8% 1114079 ? 2% slabinfo.kmalloc-512.num_objs
368.83 ? 2% +9339.1% 34814 ? 2% slabinfo.kmalloc-512.num_slabs
821.33 +2362.4% 20224 ? 3% slabinfo.kmalloc-8k.active_objs
204.83 +2520.0% 5366 ? 3% slabinfo.kmalloc-8k.active_slabs
821.33 +2513.8% 21468 ? 3% slabinfo.kmalloc-8k.num_objs
204.83 +2520.0% 5366 ? 3% slabinfo.kmalloc-8k.num_slabs
449.67 ? 4% +6105.7% 27905 ? 2% slabinfo.kmalloc-rcl-256.active_objs
13.67 ? 5% +6279.3% 871.83 ? 2% slabinfo.kmalloc-rcl-256.active_slabs
449.67 ? 4% +6105.8% 27905 ? 2% slabinfo.kmalloc-rcl-256.num_objs
13.67 ? 5% +6279.3% 871.83 ? 2% slabinfo.kmalloc-rcl-256.num_slabs
4505 ? 12% +258.4% 16147 ? 3% slabinfo.numa_policy.active_objs
72.17 ? 12% +267.2% 265.00 ? 3% slabinfo.numa_policy.active_slabs
4505 ? 12% +265.3% 16461 ? 3% slabinfo.numa_policy.num_objs
72.17 ? 12% +267.2% 265.00 ? 3% slabinfo.numa_policy.num_slabs
16951 +76.2% 29869 slabinfo.radix_tree_node.active_objs
302.33 +76.3% 533.00 slabinfo.radix_tree_node.active_slabs
16951 +76.2% 29876 slabinfo.radix_tree_node.num_objs
302.33 +76.3% 533.00 slabinfo.radix_tree_node.num_slabs
257.00 ? 7% +10813.9% 28048 ? 2% slabinfo.xfs_buf.active_objs
5.33 ? 8% +12421.9% 667.83 ? 2% slabinfo.xfs_buf.active_slabs
257.00 ? 7% +10818.9% 28061 ? 2% slabinfo.xfs_buf.num_objs
5.33 ? 8% +12421.9% 667.83 ? 2% slabinfo.xfs_buf.num_slabs
1.00 +53550.0% 536.50 ? 24% slabinfo.xfs_efi_item.active_objs
1.00 +53566.7% 536.67 ? 24% slabinfo.xfs_efi_item.num_objs
129.00 +5911.1% 7754 ? 13% slabinfo.xfs_icr.active_objs
2.00 +8366.7% 169.33 ? 13% slabinfo.xfs_icr.active_slabs
129.00 +5964.1% 7822 ? 13% slabinfo.xfs_icr.num_objs
2.00 +8366.7% 169.33 ? 13% slabinfo.xfs_icr.num_slabs
354.00 +2.4e+05% 848335 ? 2% slabinfo.xfs_ili.active_objs
8.00 +2.5e+05% 20210 ? 2% slabinfo.xfs_ili.active_slabs
354.00 +2.4e+05% 848856 ? 2% slabinfo.xfs_ili.num_objs
8.00 +2.5e+05% 20210 ? 2% slabinfo.xfs_ili.num_slabs
302.00 +2.8e+05% 847804 ? 2% slabinfo.xfs_inode.active_objs
9.00 +2.9e+05% 26509 ? 2% slabinfo.xfs_inode.active_slabs
302.00 +2.8e+05% 848315 ? 2% slabinfo.xfs_inode.num_objs
9.00 +2.9e+05% 26509 ? 2% slabinfo.xfs_inode.num_slabs
1554 +970.0% 16634 ? 2% softirqs.BLOCK
21120 ? 11% -44.0% 11836 ? 13% softirqs.CPU0.RCU
19237 ? 11% -51.3% 9370 ? 32% softirqs.CPU1.RCU
15255 ? 25% -54.6% 6926 ? 19% softirqs.CPU10.RCU
15629 ? 26% -56.6% 6788 ? 31% softirqs.CPU11.RCU
14268 ? 29% -54.6% 6473 ? 24% softirqs.CPU13.RCU
14102 ? 18% -50.1% 7040 ? 21% softirqs.CPU14.RCU
13854 ? 32% -53.5% 6444 ? 20% softirqs.CPU15.RCU
14005 ? 21% -48.4% 7231 ? 17% softirqs.CPU16.RCU
10299 ? 7% -13.3% 8929 ? 11% softirqs.CPU16.SCHED
15150 ? 16% -59.9% 6075 ? 17% softirqs.CPU17.RCU
10061 ? 4% -12.6% 8795 ? 13% softirqs.CPU17.SCHED
16886 ? 23% -61.1% 6563 ? 12% softirqs.CPU18.RCU
16459 ? 6% -56.0% 7238 ? 30% softirqs.CPU19.RCU
10118 ? 4% -7.9% 9318 ? 4% softirqs.CPU19.SCHED
19097 ? 18% -57.4% 8137 ? 21% softirqs.CPU2.RCU
14226 ? 16% -41.9% 8270 ? 24% softirqs.CPU20.RCU
17043 ? 25% -62.4% 6407 ? 25% softirqs.CPU21.RCU
17148 ? 11% -63.4% 6280 ? 14% softirqs.CPU22.RCU
17929 ? 21% -61.4% 6921 ? 34% softirqs.CPU23.RCU
10298 ? 3% -8.1% 9467 ? 3% softirqs.CPU23.SCHED
20526 ? 19% -58.7% 8467 ? 29% softirqs.CPU24.RCU
20176 ? 13% -67.8% 6494 ? 16% softirqs.CPU25.RCU
10744 ? 4% -11.6% 9496 ? 3% softirqs.CPU25.SCHED
18899 ? 6% -64.4% 6732 ? 12% softirqs.CPU26.RCU
10509 ? 2% -14.2% 9018 ? 13% softirqs.CPU26.SCHED
21195 ? 14% -64.0% 7637 ? 19% softirqs.CPU27.RCU
11101 ? 8% -12.1% 9756 ? 4% softirqs.CPU27.SCHED
19348 ? 24% -64.5% 6874 ? 20% softirqs.CPU28.RCU
17513 ? 31% -62.1% 6633 ? 19% softirqs.CPU29.RCU
18595 ? 20% -59.7% 7495 ? 29% softirqs.CPU3.RCU
10884 ? 8% -26.1% 8040 ? 19% softirqs.CPU3.SCHED
16140 ? 12% -55.7% 7145 ? 27% softirqs.CPU30.RCU
18129 ? 29% -65.0% 6338 ? 14% softirqs.CPU31.RCU
10353 ? 6% -8.5% 9478 ? 3% softirqs.CPU31.SCHED
19563 ? 31% -66.1% 6638 ? 9% softirqs.CPU32.RCU
18982 ? 25% -63.3% 6959 ? 17% softirqs.CPU33.RCU
18805 ? 27% -63.9% 6795 ? 26% softirqs.CPU34.RCU
16018 ? 34% -63.9% 5777 ? 12% softirqs.CPU35.RCU
15396 ? 19% -54.5% 7011 ? 21% softirqs.CPU36.RCU
18564 ? 23% -65.4% 6424 ? 18% softirqs.CPU37.RCU
18454 ? 22% -68.7% 5776 ? 10% softirqs.CPU38.RCU
19579 ? 20% -61.5% 7530 ? 25% softirqs.CPU39.RCU
16731 ? 26% -53.1% 7852 ? 40% softirqs.CPU4.RCU
16573 ? 12% -59.5% 6712 ? 29% softirqs.CPU40.RCU
18052 ? 21% -56.2% 7910 ? 28% softirqs.CPU41.RCU
18694 ? 13% -65.3% 6487 ? 19% softirqs.CPU42.RCU
16325 ? 9% -53.6% 7573 ? 11% softirqs.CPU43.RCU
18083 ? 15% -64.1% 6483 ? 23% softirqs.CPU44.RCU
10758 ? 6% -16.4% 8997 ? 10% softirqs.CPU44.SCHED
20808 ? 19% -67.8% 6691 ? 26% softirqs.CPU45.RCU
10725 ? 5% -15.4% 9074 ? 11% softirqs.CPU45.SCHED
17044 ? 22% -61.0% 6649 ? 22% softirqs.CPU46.RCU
17817 ? 16% -66.9% 5894 ? 17% softirqs.CPU47.RCU
14312 ? 30% -60.4% 5670 ? 27% softirqs.CPU48.RCU
14880 ? 9% -58.1% 6241 ? 21% softirqs.CPU49.RCU
17117 ? 33% -52.5% 8129 ? 24% softirqs.CPU5.RCU
14530 ? 29% -51.5% 7043 ? 20% softirqs.CPU50.RCU
12832 ? 29% -46.2% 6908 ? 9% softirqs.CPU51.RCU
16355 ? 18% -59.8% 6580 ? 22% softirqs.CPU52.RCU
14136 ? 24% -58.2% 5909 ? 24% softirqs.CPU53.RCU
16432 ? 15% -62.3% 6195 ? 26% softirqs.CPU54.RCU
14701 ? 19% -55.5% 6539 ? 16% softirqs.CPU55.RCU
16125 ? 43% -63.6% 5874 ? 20% softirqs.CPU56.RCU
14335 ? 21% -53.5% 6661 ? 15% softirqs.CPU57.RCU
14374 ? 15% -56.5% 6257 ? 27% softirqs.CPU58.RCU
16381 ? 30% -57.0% 7038 ? 27% softirqs.CPU59.RCU
15884 ? 17% -52.9% 7484 ? 28% softirqs.CPU6.RCU
15020 ? 26% -55.7% 6649 ? 30% softirqs.CPU60.RCU
14556 ? 29% -60.7% 5722 ? 26% softirqs.CPU61.RCU
15214 ? 16% -61.7% 5825 ? 24% softirqs.CPU62.RCU
15253 ? 29% -61.2% 5919 ? 18% softirqs.CPU63.RCU
16039 ? 21% -62.8% 5962 ? 26% softirqs.CPU64.RCU
15525 ? 28% -61.9% 5915 ? 21% softirqs.CPU65.RCU
15185 ? 22% -64.4% 5399 ? 16% softirqs.CPU66.RCU
16461 ? 13% -66.5% 5521 ? 22% softirqs.CPU67.RCU
10286 ? 7% -23.8% 7833 ? 21% softirqs.CPU67.SCHED
14137 ? 23% -59.7% 5701 ? 14% softirqs.CPU68.RCU
14892 ? 20% -57.2% 6368 ? 17% softirqs.CPU69.RCU
17032 ? 23% -61.7% 6527 ? 20% softirqs.CPU7.RCU
16497 ? 24% -64.8% 5809 ? 17% softirqs.CPU70.RCU
14588 ? 26% -57.8% 6162 ? 31% softirqs.CPU71.RCU
20376 ? 22% -69.7% 6176 ? 13% softirqs.CPU72.RCU
16224 ? 21% -64.1% 5829 ? 25% softirqs.CPU73.RCU
16511 ? 18% -64.9% 5796 ? 11% softirqs.CPU74.RCU
17407 ? 25% -63.0% 6443 ? 22% softirqs.CPU75.RCU
16803 ? 24% -55.0% 7556 ? 34% softirqs.CPU76.RCU
17490 ? 24% -66.2% 5911 ? 16% softirqs.CPU77.RCU
18734 ? 23% -68.1% 5973 ? 18% softirqs.CPU78.RCU
17507 ? 24% -61.0% 6829 ? 24% softirqs.CPU79.RCU
14591 ? 19% -52.3% 6954 ? 19% softirqs.CPU8.RCU
17466 ? 40% -63.4% 6391 ? 31% softirqs.CPU80.RCU
16442 ? 20% -58.2% 6874 ? 25% softirqs.CPU81.RCU
15519 ? 18% -61.0% 6046 ? 26% softirqs.CPU82.RCU
18356 ? 16% -66.9% 6078 ? 17% softirqs.CPU83.RCU
17332 ? 19% -64.6% 6129 ? 27% softirqs.CPU84.RCU
15382 ? 24% -57.6% 6523 ? 26% softirqs.CPU85.RCU
12953 ? 12% -49.8% 6507 ? 26% softirqs.CPU86.RCU
17891 ? 29% -67.7% 5784 ? 18% softirqs.CPU87.RCU
15408 ? 23% -64.7% 5445 ? 13% softirqs.CPU88.RCU
17202 ? 15% -61.7% 6580 ? 35% softirqs.CPU89.RCU
14401 ? 24% -52.7% 6807 ? 21% softirqs.CPU9.RCU
14726 ? 24% -58.2% 6154 ? 17% softirqs.CPU90.RCU
17034 ? 21% -62.1% 6462 ? 45% softirqs.CPU91.RCU
18149 ? 14% -65.8% 6211 ? 24% softirqs.CPU92.RCU
10385 ? 5% -7.0% 9661 ? 4% softirqs.CPU92.SCHED
15547 ? 16% -59.7% 6260 ? 18% softirqs.CPU93.RCU
16675 ? 23% -64.3% 5946 ? 20% softirqs.CPU94.RCU
15994 ? 19% -64.1% 5744 ? 24% softirqs.CPU95.RCU
1595836 -60.0% 637995 ? 5% softirqs.RCU
979291 ? 2% -8.7% 893912 ? 2% softirqs.SCHED
32415 -46.7% 17273 ? 5% softirqs.TIMER
97.50 ? 52% +30937.3% 30261 ? 2% interrupts.315:PCI-MSI.376832-edge.ahci[0000:00:17.0]
711540 ? 9% -80.3% 140124 ? 3% interrupts.CAL:Function_call_interrupts
6893 ? 32% -70.4% 2041 ? 54% interrupts.CPU0.CAL:Function_call_interrupts
8805 ? 30% -70.2% 2621 ? 48% interrupts.CPU1.CAL:Function_call_interrupts
854.00 ? 44% -71.9% 239.67 ? 37% interrupts.CPU10.NMI:Non-maskable_interrupts
854.00 ? 44% -71.9% 239.67 ? 37% interrupts.CPU10.PMI:Performance_monitoring_interrupts
258.67 ? 59% -58.1% 108.50 ? 64% interrupts.CPU10.RES:Rescheduling_interrupts
5312 ? 68% -76.3% 1256 ? 50% interrupts.CPU13.CAL:Function_call_interrupts
769.67 ? 43% -65.5% 265.83 ? 41% interrupts.CPU13.NMI:Non-maskable_interrupts
769.67 ? 43% -65.5% 265.83 ? 41% interrupts.CPU13.PMI:Performance_monitoring_interrupts
5349 ? 39% -72.4% 1475 ? 29% interrupts.CPU14.CAL:Function_call_interrupts
897.17 ? 35% -71.4% 257.00 ? 71% interrupts.CPU14.NMI:Non-maskable_interrupts
897.17 ? 35% -71.4% 257.00 ? 71% interrupts.CPU14.PMI:Performance_monitoring_interrupts
5508 ? 63% -70.7% 1612 ? 33% interrupts.CPU16.CAL:Function_call_interrupts
5513 ? 47% -78.9% 1164 ? 45% interrupts.CPU17.CAL:Function_call_interrupts
917.00 ? 66% -79.8% 185.67 ? 37% interrupts.CPU17.NMI:Non-maskable_interrupts
917.00 ? 66% -79.8% 185.67 ? 37% interrupts.CPU17.PMI:Performance_monitoring_interrupts
6835 ? 65% -81.6% 1259 ? 31% interrupts.CPU18.CAL:Function_call_interrupts
1211 ? 47% -76.1% 289.50 ? 62% interrupts.CPU18.NMI:Non-maskable_interrupts
1211 ? 47% -76.1% 289.50 ? 62% interrupts.CPU18.PMI:Performance_monitoring_interrupts
6187 ? 49% -72.0% 1730 ? 66% interrupts.CPU19.CAL:Function_call_interrupts
8204 ? 36% -68.9% 2549 ? 48% interrupts.CPU2.CAL:Function_call_interrupts
320.50 ? 50% -54.4% 146.00 ? 68% interrupts.CPU2.RES:Rescheduling_interrupts
5016 ? 32% -59.6% 2028 ? 51% interrupts.CPU20.CAL:Function_call_interrupts
1072 ? 48% -60.6% 422.50 ? 71% interrupts.CPU20.NMI:Non-maskable_interrupts
1072 ? 48% -60.6% 422.50 ? 71% interrupts.CPU20.PMI:Performance_monitoring_interrupts
6363 ? 48% -79.0% 1334 ? 48% interrupts.CPU21.CAL:Function_call_interrupts
6133 ? 32% -78.7% 1305 ? 40% interrupts.CPU22.CAL:Function_call_interrupts
1064 ? 55% -66.9% 352.33 ? 49% interrupts.CPU22.NMI:Non-maskable_interrupts
1064 ? 55% -66.9% 352.33 ? 49% interrupts.CPU22.PMI:Performance_monitoring_interrupts
7479 ? 56% -81.5% 1384 ? 35% interrupts.CPU23.CAL:Function_call_interrupts
744.50 ? 80% -78.4% 160.67 ? 46% interrupts.CPU23.NMI:Non-maskable_interrupts
744.50 ? 80% -78.4% 160.67 ? 46% interrupts.CPU23.PMI:Performance_monitoring_interrupts
11389 ? 45% -82.7% 1970 ? 43% interrupts.CPU24.CAL:Function_call_interrupts
1234 ? 54% -62.2% 467.17 ? 97% interrupts.CPU24.NMI:Non-maskable_interrupts
1234 ? 54% -62.2% 467.17 ? 97% interrupts.CPU24.PMI:Performance_monitoring_interrupts
10263 ? 35% -88.4% 1191 ? 30% interrupts.CPU25.CAL:Function_call_interrupts
9960 ? 31% -87.0% 1292 ? 22% interrupts.CPU26.CAL:Function_call_interrupts
231.67 ? 34% -64.0% 83.50 ?102% interrupts.CPU26.RES:Rescheduling_interrupts
13470 ? 51% -85.7% 1925 ? 40% interrupts.CPU27.CAL:Function_call_interrupts
9836 ? 55% -86.7% 1303 ? 36% interrupts.CPU28.CAL:Function_call_interrupts
272.17 ? 52% -72.6% 74.67 ? 52% interrupts.CPU28.RES:Rescheduling_interrupts
8560 ? 62% -85.7% 1227 ? 42% interrupts.CPU29.CAL:Function_call_interrupts
8218 ? 46% -75.0% 2053 ? 38% interrupts.CPU3.CAL:Function_call_interrupts
6712 ? 31% -72.0% 1877 ? 48% interrupts.CPU30.CAL:Function_call_interrupts
9525 ? 55% -87.9% 1149 ? 41% interrupts.CPU31.CAL:Function_call_interrupts
189.33 ? 71% -68.4% 59.83 ?103% interrupts.CPU31.RES:Rescheduling_interrupts
11122 ? 57% -90.2% 1092 ? 31% interrupts.CPU32.CAL:Function_call_interrupts
207.00 ? 47% -66.3% 69.67 ? 83% interrupts.CPU32.RES:Rescheduling_interrupts
9576 ? 51% -85.0% 1439 ? 40% interrupts.CPU33.CAL:Function_call_interrupts
269.00 ? 48% -71.2% 77.50 ? 66% interrupts.CPU33.RES:Rescheduling_interrupts
9270 ? 57% -88.1% 1101 ? 39% interrupts.CPU34.CAL:Function_call_interrupts
6919 ? 80% -85.9% 978.00 ? 24% interrupts.CPU35.CAL:Function_call_interrupts
1037 ? 81% -75.3% 255.83 ? 68% interrupts.CPU35.NMI:Non-maskable_interrupts
1037 ? 81% -75.3% 255.83 ? 68% interrupts.CPU35.PMI:Performance_monitoring_interrupts
6139 ? 49% -74.8% 1545 ? 59% interrupts.CPU36.CAL:Function_call_interrupts
211.67 ? 33% -67.6% 68.67 ? 99% interrupts.CPU36.RES:Rescheduling_interrupts
9270 ? 43% -86.8% 1225 ? 41% interrupts.CPU37.CAL:Function_call_interrupts
882.83 ? 33% -72.9% 239.00 ? 63% interrupts.CPU37.NMI:Non-maskable_interrupts
882.83 ? 33% -72.9% 239.00 ? 63% interrupts.CPU37.PMI:Performance_monitoring_interrupts
9776 ? 33% -88.6% 1114 ? 38% interrupts.CPU38.CAL:Function_call_interrupts
1174 ? 37% -78.1% 256.67 ? 98% interrupts.CPU38.NMI:Non-maskable_interrupts
1174 ? 37% -78.1% 256.67 ? 98% interrupts.CPU38.PMI:Performance_monitoring_interrupts
298.00 ? 65% -82.9% 50.83 ? 49% interrupts.CPU38.RES:Rescheduling_interrupts
10075 ? 43% -87.5% 1255 ? 47% interrupts.CPU39.CAL:Function_call_interrupts
262.33 ? 37% -61.5% 101.00 ? 89% interrupts.CPU39.RES:Rescheduling_interrupts
8423 ? 55% -72.9% 2281 ? 73% interrupts.CPU4.CAL:Function_call_interrupts
6552 ? 33% -75.7% 1594 ? 44% interrupts.CPU40.CAL:Function_call_interrupts
1047 ? 67% -85.5% 151.33 ? 39% interrupts.CPU40.NMI:Non-maskable_interrupts
1047 ? 67% -85.5% 151.33 ? 39% interrupts.CPU40.PMI:Performance_monitoring_interrupts
217.00 ? 51% -71.4% 62.17 ?100% interrupts.CPU40.RES:Rescheduling_interrupts
8027 ? 44% -73.1% 2159 ? 81% interrupts.CPU41.CAL:Function_call_interrupts
1055 ? 37% -75.6% 257.17 ? 51% interrupts.CPU41.NMI:Non-maskable_interrupts
1055 ? 37% -75.6% 257.17 ? 51% interrupts.CPU41.PMI:Performance_monitoring_interrupts
217.00 ? 54% -63.1% 80.00 ?102% interrupts.CPU41.RES:Rescheduling_interrupts
9163 ? 32% -83.3% 1530 ? 44% interrupts.CPU42.CAL:Function_call_interrupts
240.33 ? 53% -61.3% 93.00 ? 83% interrupts.CPU42.RES:Rescheduling_interrupts
7210 ? 33% -76.4% 1700 ? 37% interrupts.CPU43.CAL:Function_call_interrupts
10002 ? 50% -87.6% 1243 ? 57% interrupts.CPU44.CAL:Function_call_interrupts
1466 ? 62% -85.9% 207.17 ? 46% interrupts.CPU44.NMI:Non-maskable_interrupts
1466 ? 62% -85.9% 207.17 ? 46% interrupts.CPU44.PMI:Performance_monitoring_interrupts
177.33 ? 47% -66.2% 60.00 ? 86% interrupts.CPU44.RES:Rescheduling_interrupts
10433 ? 39% -85.9% 1467 ? 50% interrupts.CPU45.CAL:Function_call_interrupts
1436 ? 47% -82.5% 251.67 ?127% interrupts.CPU45.NMI:Non-maskable_interrupts
1436 ? 47% -82.5% 251.67 ?127% interrupts.CPU45.PMI:Performance_monitoring_interrupts
292.33 ? 54% -83.8% 47.50 ? 81% interrupts.CPU45.RES:Rescheduling_interrupts
7492 ? 48% -81.9% 1359 ? 51% interrupts.CPU46.CAL:Function_call_interrupts
199.83 ? 42% -78.3% 43.33 ? 95% interrupts.CPU46.RES:Rescheduling_interrupts
8400 ? 38% -84.9% 1265 ? 33% interrupts.CPU47.CAL:Function_call_interrupts
234.83 ? 66% -89.9% 23.83 ? 48% interrupts.CPU47.RES:Rescheduling_interrupts
6680 ? 64% -82.0% 1203 ? 36% interrupts.CPU48.CAL:Function_call_interrupts
138.00 ? 59% -61.4% 53.33 ? 62% interrupts.CPU48.RES:Rescheduling_interrupts
5466 ? 44% -76.0% 1310 ? 41% interrupts.CPU49.CAL:Function_call_interrupts
5247 ? 49% -63.8% 1900 ? 31% interrupts.CPU50.CAL:Function_call_interrupts
3954 ? 50% -58.8% 1628 ? 29% interrupts.CPU51.CAL:Function_call_interrupts
7995 ? 52% -81.6% 1471 ? 28% interrupts.CPU52.CAL:Function_call_interrupts
1120 ? 48% -70.4% 332.00 ? 62% interrupts.CPU52.NMI:Non-maskable_interrupts
1120 ? 48% -70.4% 332.00 ? 62% interrupts.CPU52.PMI:Performance_monitoring_interrupts
237.17 ? 49% -65.8% 81.17 ? 92% interrupts.CPU52.RES:Rescheduling_interrupts
5449 ? 48% -76.7% 1267 ? 46% interrupts.CPU53.CAL:Function_call_interrupts
1126 ? 72% -72.7% 307.50 ? 42% interrupts.CPU53.NMI:Non-maskable_interrupts
1126 ? 72% -72.7% 307.50 ? 42% interrupts.CPU53.PMI:Performance_monitoring_interrupts
6957 ? 39% -80.0% 1389 ? 53% interrupts.CPU54.CAL:Function_call_interrupts
5747 ? 48% -75.1% 1429 ? 35% interrupts.CPU55.CAL:Function_call_interrupts
825.00 ? 70% -73.0% 223.00 ? 59% interrupts.CPU55.NMI:Non-maskable_interrupts
825.00 ? 70% -73.0% 223.00 ? 59% interrupts.CPU55.PMI:Performance_monitoring_interrupts
7399 ? 83% -84.1% 1174 ? 43% interrupts.CPU56.CAL:Function_call_interrupts
5267 ? 56% -74.9% 1321 ? 34% interrupts.CPU57.CAL:Function_call_interrupts
208.83 ? 31% -61.5% 80.50 ? 57% interrupts.CPU57.RES:Rescheduling_interrupts
5624 ? 34% -74.6% 1430 ? 41% interrupts.CPU58.CAL:Function_call_interrupts
888.17 ? 33% -78.6% 190.50 ? 42% interrupts.CPU58.NMI:Non-maskable_interrupts
888.17 ? 33% -78.6% 190.50 ? 42% interrupts.CPU58.PMI:Performance_monitoring_interrupts
208.17 ? 71% -63.4% 76.17 ? 39% interrupts.CPU58.RES:Rescheduling_interrupts
7364 ? 65% -77.1% 1689 ? 55% interrupts.CPU59.CAL:Function_call_interrupts
5509 ? 24% -68.9% 1714 ? 40% interrupts.CPU6.CAL:Function_call_interrupts
6142 ? 60% -72.8% 1670 ? 45% interrupts.CPU60.CAL:Function_call_interrupts
5785 ? 63% -68.1% 1844 ? 72% interrupts.CPU61.CAL:Function_call_interrupts
5382 ? 26% -81.6% 987.67 ? 28% interrupts.CPU62.CAL:Function_call_interrupts
1039 ? 41% -75.8% 251.83 ? 35% interrupts.CPU62.NMI:Non-maskable_interrupts
1039 ? 41% -75.8% 251.83 ? 35% interrupts.CPU62.PMI:Performance_monitoring_interrupts
7007 ? 56% -82.2% 1247 ? 31% interrupts.CPU63.CAL:Function_call_interrupts
216.50 ? 65% -77.8% 48.17 ? 69% interrupts.CPU63.RES:Rescheduling_interrupts
5893 ? 48% -78.3% 1278 ? 60% interrupts.CPU64.CAL:Function_call_interrupts
210.17 ? 45% -73.9% 54.83 ? 62% interrupts.CPU64.RES:Rescheduling_interrupts
6246 ? 87% -80.9% 1190 ? 44% interrupts.CPU65.CAL:Function_call_interrupts
1025 ? 57% -80.8% 197.00 ? 26% interrupts.CPU65.NMI:Non-maskable_interrupts
1025 ? 57% -80.8% 197.00 ? 26% interrupts.CPU65.PMI:Performance_monitoring_interrupts
5079 ? 46% -81.0% 965.67 ? 29% interrupts.CPU66.CAL:Function_call_interrupts
946.17 ? 17% -76.3% 224.50 ? 58% interrupts.CPU66.NMI:Non-maskable_interrupts
946.17 ? 17% -76.3% 224.50 ? 58% interrupts.CPU66.PMI:Performance_monitoring_interrupts
7107 ? 50% -85.6% 1026 ? 47% interrupts.CPU67.CAL:Function_call_interrupts
827.50 ? 58% -67.2% 271.83 ? 66% interrupts.CPU67.NMI:Non-maskable_interrupts
827.50 ? 58% -67.2% 271.83 ? 66% interrupts.CPU67.PMI:Performance_monitoring_interrupts
880.50 ? 43% -70.7% 257.83 ? 36% interrupts.CPU68.NMI:Non-maskable_interrupts
880.50 ? 43% -70.7% 257.83 ? 36% interrupts.CPU68.PMI:Performance_monitoring_interrupts
564.50 ? 73% -65.8% 192.83 ? 36% interrupts.CPU69.NMI:Non-maskable_interrupts
564.50 ? 73% -65.8% 192.83 ? 36% interrupts.CPU69.PMI:Performance_monitoring_interrupts
7747 ? 57% -78.8% 1644 ? 38% interrupts.CPU7.CAL:Function_call_interrupts
6315 ? 44% -83.3% 1054 ? 37% interrupts.CPU70.CAL:Function_call_interrupts
1262 ? 46% -71.1% 364.67 ? 76% interrupts.CPU70.NMI:Non-maskable_interrupts
1262 ? 46% -71.1% 364.67 ? 76% interrupts.CPU70.PMI:Performance_monitoring_interrupts
219.33 ? 84% -74.2% 56.67 ? 97% interrupts.CPU70.RES:Rescheduling_interrupts
5991 ? 59% -81.9% 1082 ? 58% interrupts.CPU71.CAL:Function_call_interrupts
688.17 ? 47% -78.1% 151.00 ? 41% interrupts.CPU71.NMI:Non-maskable_interrupts
688.17 ? 47% -78.1% 151.00 ? 41% interrupts.CPU71.PMI:Performance_monitoring_interrupts
11770 ? 46% -90.7% 1089 ? 31% interrupts.CPU72.CAL:Function_call_interrupts
1531 ? 44% -85.6% 220.67 ? 81% interrupts.CPU72.NMI:Non-maskable_interrupts
1531 ? 44% -85.6% 220.67 ? 81% interrupts.CPU72.PMI:Performance_monitoring_interrupts
193.17 ? 39% -76.3% 45.83 ? 81% interrupts.CPU72.RES:Rescheduling_interrupts
6517 ? 45% -82.2% 1157 ? 71% interrupts.CPU73.CAL:Function_call_interrupts
7510 ? 37% -76.5% 1763 ? 83% interrupts.CPU74.CAL:Function_call_interrupts
8386 ? 52% -82.4% 1474 ? 36% interrupts.CPU75.CAL:Function_call_interrupts
8057 ? 51% -76.9% 1864 ? 75% interrupts.CPU76.CAL:Function_call_interrupts
8828 ? 55% -87.8% 1076 ? 30% interrupts.CPU77.CAL:Function_call_interrupts
186.33 ? 33% -74.6% 47.33 ? 74% interrupts.CPU77.RES:Rescheduling_interrupts
10049 ? 53% -80.2% 1985 ? 95% interrupts.CPU78.CAL:Function_call_interrupts
176.67 ? 31% -72.5% 48.67 ? 51% interrupts.CPU78.RES:Rescheduling_interrupts
7695 ? 52% -83.1% 1297 ? 37% interrupts.CPU79.CAL:Function_call_interrupts
1178 ? 49% -73.6% 311.50 ? 86% interrupts.CPU8.NMI:Non-maskable_interrupts
1178 ? 49% -73.6% 311.50 ? 86% interrupts.CPU8.PMI:Performance_monitoring_interrupts
8394 ? 80% -83.8% 1359 ? 76% interrupts.CPU80.CAL:Function_call_interrupts
8136 ? 48% -82.5% 1427 ? 42% interrupts.CPU81.CAL:Function_call_interrupts
6688 ? 41% -81.1% 1263 ? 36% interrupts.CPU82.CAL:Function_call_interrupts
9699 ? 45% -90.1% 960.83 ? 29% interrupts.CPU83.CAL:Function_call_interrupts
900.67 ? 56% -76.7% 210.00 ? 29% interrupts.CPU83.NMI:Non-maskable_interrupts
900.67 ? 56% -76.7% 210.00 ? 29% interrupts.CPU83.PMI:Performance_monitoring_interrupts
198.17 ? 78% -74.9% 49.83 ? 80% interrupts.CPU83.RES:Rescheduling_interrupts
9055 ? 46% -88.0% 1086 ? 55% interrupts.CPU84.CAL:Function_call_interrupts
6343 ? 48% -76.5% 1491 ? 54% interrupts.CPU85.CAL:Function_call_interrupts
4596 ? 37% -71.4% 1312 ? 52% interrupts.CPU86.CAL:Function_call_interrupts
9733 ? 59% -87.3% 1239 ? 66% interrupts.CPU87.CAL:Function_call_interrupts
753.00 ? 42% -77.4% 170.17 ? 59% interrupts.CPU87.NMI:Non-maskable_interrupts
753.00 ? 42% -77.4% 170.17 ? 59% interrupts.CPU87.PMI:Performance_monitoring_interrupts
193.67 ? 59% -78.1% 42.33 ?112% interrupts.CPU87.RES:Rescheduling_interrupts
7232 ? 52% -85.7% 1037 ? 28% interrupts.CPU88.CAL:Function_call_interrupts
974.67 ? 46% -80.8% 186.83 ? 68% interrupts.CPU88.NMI:Non-maskable_interrupts
974.67 ? 46% -80.8% 186.83 ? 68% interrupts.CPU88.PMI:Performance_monitoring_interrupts
7769 ? 36% -80.2% 1538 ? 76% interrupts.CPU89.CAL:Function_call_interrupts
5783 ? 45% -77.7% 1290 ? 19% interrupts.CPU90.CAL:Function_call_interrupts
815.17 ? 45% -60.2% 324.50 ? 62% interrupts.CPU90.NMI:Non-maskable_interrupts
815.17 ? 45% -60.2% 324.50 ? 62% interrupts.CPU90.PMI:Performance_monitoring_interrupts
8128 ? 55% -80.8% 1562 ? 84% interrupts.CPU91.CAL:Function_call_interrupts
212.00 ? 50% -74.6% 53.83 ?102% interrupts.CPU91.RES:Rescheduling_interrupts
9186 ? 35% -83.8% 1485 ? 42% interrupts.CPU92.CAL:Function_call_interrupts
1485 ? 46% -81.6% 273.33 ? 63% interrupts.CPU92.NMI:Non-maskable_interrupts
1485 ? 46% -81.6% 273.33 ? 63% interrupts.CPU92.PMI:Performance_monitoring_interrupts
6946 ? 35% -79.4% 1427 ? 33% interrupts.CPU93.CAL:Function_call_interrupts
1245 ? 45% -78.4% 269.00 ? 93% interrupts.CPU93.NMI:Non-maskable_interrupts
1245 ? 45% -78.4% 269.00 ? 93% interrupts.CPU93.PMI:Performance_monitoring_interrupts
7836 ? 51% -86.1% 1088 ? 65% interrupts.CPU94.CAL:Function_call_interrupts
7555 ? 47% -87.9% 911.33 ? 53% interrupts.CPU95.CAL:Function_call_interrupts
90841 ? 2% -65.6% 31239 ? 24% interrupts.NMI:Non-maskable_interrupts
90841 ? 2% -65.6% 31239 ? 24% interrupts.PMI:Performance_monitoring_interrupts
18910 ? 18% -61.9% 7206 ? 10% interrupts.RES:Rescheduling_interrupts
55.89 -23.0 32.91 ? 28% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
50.93 -21.3 29.59 ? 29% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
24.70 -15.6 9.06 ? 28% perf-profile.calltrace.cycles-pp.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
15.02 ? 2% -14.5 0.51 ? 45% perf-profile.calltrace.cycles-pp.destroy_inode.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
14.15 ? 2% -14.1 0.00 perf-profile.calltrace.cycles-pp.xfs_fs_destroy_inode.destroy_inode.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
9.17 ? 38% -9.2 0.00 perf-profile.calltrace.cycles-pp.xfs_inactive.xfs_fs_destroy_inode.destroy_inode.do_unlinkat.do_syscall_64
8.01 ? 24% -8.0 0.00 perf-profile.calltrace.cycles-pp.xfs_inactive_ifree.xfs_inactive.xfs_fs_destroy_inode.destroy_inode.do_unlinkat
6.15 ? 6% -6.2 0.00 perf-profile.calltrace.cycles-pp.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_fs_destroy_inode.destroy_inode
4.00 ? 70% -3.0 1.02 ?223% perf-profile.calltrace.cycles-pp.xfs_create_tmpfile.path_openat.do_filp_open.do_sys_openat2.do_sys_open
4.27 ? 70% -3.0 1.29 ?223% perf-profile.calltrace.cycles-pp.xfs_vn_lookup.vfs_unlink.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
4.25 ? 70% -3.0 1.28 ?223% perf-profile.calltrace.cycles-pp.xfs_remove.xfs_vn_lookup.vfs_unlink.do_unlinkat.do_syscall_64
3.85 ? 70% -2.9 0.98 ?223% perf-profile.calltrace.cycles-pp.__xfs_trans_commit.xfs_create_tmpfile.path_openat.do_filp_open.do_sys_openat2
4.11 ? 70% -2.8 1.31 ?223% perf-profile.calltrace.cycles-pp.xfs_create.xfs_create.path_openat.do_filp_open.do_sys_openat2
3.59 ? 70% -2.6 0.95 ?223% perf-profile.calltrace.cycles-pp.xfs_log_commit_cil.__xfs_trans_commit.xfs_create_tmpfile.path_openat.do_filp_open
4.84 ? 2% -1.6 3.25 ? 26% perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe
4.75 ? 2% -1.6 3.17 ? 26% perf-profile.calltrace.cycles-pp.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe
3.70 ? 3% -1.3 2.39 ? 24% perf-profile.calltrace.cycles-pp.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe
3.48 ? 3% -1.2 2.23 ? 24% perf-profile.calltrace.cycles-pp.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe
2.82 ? 3% -1.0 1.83 ? 31% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
2.79 ? 3% -1.0 1.82 ? 31% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
2.47 ? 3% -0.9 1.61 ? 31% perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
2.36 ? 2% -0.8 1.56 ? 31% perf-profile.calltrace.cycles-pp.xfs_file_buffered_write.new_sync_write.vfs_write.ksys_write.do_syscall_64
2.14 ? 2% -0.8 1.38 ? 31% perf-profile.calltrace.cycles-pp.iomap_file_buffered_write.xfs_file_buffered_write.new_sync_write.vfs_write.ksys_write
2.13 ? 2% -0.8 1.37 ? 31% perf-profile.calltrace.cycles-pp.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_write.new_sync_write.vfs_write
1.55 ? 6% -0.6 0.94 ? 47% perf-profile.calltrace.cycles-pp.__x64_sys_close.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.47 ? 5% -0.6 0.89 ? 47% perf-profile.calltrace.cycles-pp.filp_close.__x64_sys_close.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.83 ? 3% -0.5 1.31 ? 29% perf-profile.calltrace.cycles-pp.evict.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.35 ? 3% -0.5 0.84 ? 47% perf-profile.calltrace.cycles-pp.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_write.new_sync_write
1.16 ? 3% -0.5 0.65 ? 49% perf-profile.calltrace.cycles-pp.__x64_sys_rename.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.27 ? 4% -0.5 0.77 ? 46% perf-profile.calltrace.cycles-pp.__x64_sys_fcntl.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.11 ? 3% -0.5 0.62 ? 49% perf-profile.calltrace.cycles-pp.do_renameat2.__x64_sys_rename.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.22 ? 3% -0.5 0.73 ? 46% perf-profile.calltrace.cycles-pp.do_fcntl.__x64_sys_fcntl.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.90 ? 2% -0.5 0.41 ? 73% perf-profile.calltrace.cycles-pp.vfs_rename.do_renameat2.__x64_sys_rename.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.19 ? 3% -0.5 0.72 ? 46% perf-profile.calltrace.cycles-pp.fcntl_dirnotify.do_fcntl.__x64_sys_fcntl.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.33 ? 3% -0.4 0.89 ? 47% perf-profile.calltrace.cycles-pp.truncate_inode_pages_range.evict.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.72 ? 3% -0.4 0.28 ?100% perf-profile.calltrace.cycles-pp.do_fchmodat.__x64_sys_chmod.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.72 ? 3% -0.4 0.28 ?100% perf-profile.calltrace.cycles-pp.__x64_sys_chmod.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.73 ? 8% -0.4 0.30 ?101% perf-profile.calltrace.cycles-pp.do_dentry_open.do_open.path_openat.do_filp_open.do_sys_openat2
1.07 ? 5% -0.4 0.66 ? 49% perf-profile.calltrace.cycles-pp.do_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open
0.79 ? 7% -0.4 0.40 ? 72% perf-profile.calltrace.cycles-pp.dnotify_flush.filp_close.__x64_sys_close.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.88 ? 3% -0.3 0.56 ? 47% perf-profile.calltrace.cycles-pp.arch_do_signal_or_restart.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe
0.87 ? 3% -0.3 0.60 ? 47% perf-profile.calltrace.cycles-pp.__pagevec_release.truncate_inode_pages_range.evict.do_unlinkat.do_syscall_64
0.00 +0.9 0.89 ? 36% perf-profile.calltrace.cycles-pp.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues
0.56 ? 5% +0.9 1.47 ? 32% perf-profile.calltrace.cycles-pp.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
0.52 ? 45% +1.0 1.52 ? 19% perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry
0.18 ?141% +1.0 1.19 ? 25% perf-profile.calltrace.cycles-pp.ktime_get.clockevents_program_event.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt
0.64 ? 7% +1.1 1.74 ? 21% perf-profile.calltrace.cycles-pp.clockevents_program_event.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
0.00 +1.1 1.14 ? 29% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
0.59 ? 45% +1.2 1.79 ? 16% perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary
0.58 ? 7% +1.4 2.02 ? 43% perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt
0.17 ?141% +1.5 1.67 ? 40% perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
0.18 ?141% +1.6 1.77 ? 45% perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt
0.80 ? 7% +2.3 3.08 ? 52% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
0.00 +2.4 2.44 ? 32% perf-profile.calltrace.cycles-pp.xfs_inactive_worker.process_one_work.worker_thread.kthread.ret_from_fork
2.06 ? 7% +3.5 5.52 ? 24% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
0.00 +3.8 3.81 ? 22% perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
0.00 +3.8 3.85 ? 22% perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
0.70 ? 6% +3.9 4.65 ? 17% perf-profile.calltrace.cycles-pp.ret_from_fork
0.70 ? 6% +3.9 4.65 ? 17% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
1.63 ? 6% +4.0 5.64 ? 36% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
1.65 ? 7% +4.1 5.77 ? 37% perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
32.24 ? 2% +5.9 38.13 ? 17% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
2.75 ? 6% +6.2 8.99 ? 37% perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle
3.98 ? 3% +9.2 13.21 ? 30% perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
37.00 +14.1 51.11 ? 19% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
37.61 ? 2% +15.4 52.96 ? 18% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
42.01 +18.4 60.44 ? 16% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
42.03 +18.5 60.49 ? 16% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
42.02 +18.5 60.49 ? 16% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
42.30 +18.8 61.08 ? 16% perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
55.99 -22.8 33.22 ? 28% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
51.01 -21.1 29.89 ? 28% perf-profile.children.cycles-pp.do_syscall_64
24.71 -15.7 9.06 ? 28% perf-profile.children.cycles-pp.do_unlinkat
15.02 ? 2% -14.5 0.55 ? 28% perf-profile.children.cycles-pp.destroy_inode
14.15 ? 2% -14.1 0.06 ? 47% perf-profile.children.cycles-pp.xfs_fs_destroy_inode
11.73 ? 14% -9.5 2.23 ? 30% perf-profile.children.cycles-pp.xfs_inactive
16.98 -6.8 10.19 ? 29% perf-profile.children.cycles-pp.__xfs_trans_commit
16.57 -6.5 10.04 ? 29% perf-profile.children.cycles-pp.xfs_log_commit_cil
8.01 ? 24% -6.4 1.66 ? 33% perf-profile.children.cycles-pp.xfs_inactive_ifree
6.25 ? 5% -5.3 0.99 ? 35% perf-profile.children.cycles-pp.xfs_ifree
4.50 ? 15% -3.8 0.69 ? 79% perf-profile.children.cycles-pp.xfs_difree
4.01 ? 70% -3.0 1.02 ?223% perf-profile.children.cycles-pp.xfs_create_tmpfile
6.21 ? 14% -2.8 3.45 ? 36% perf-profile.children.cycles-pp.xfs_buf_get_map
5.89 ? 3% -2.5 3.37 ? 19% perf-profile.children.cycles-pp._raw_spin_lock
8.79 ? 17% -2.5 6.29 ? 30% perf-profile.children.cycles-pp.xfs_remove
6.88 ? 9% -2.3 4.54 ? 29% perf-profile.children.cycles-pp.xfs_trans_read_buf_map
2.46 ? 10% -2.0 0.44 ? 37% perf-profile.children.cycles-pp.xfs_iunlink_remove
5.88 ? 2% -2.0 3.87 ? 28% perf-profile.children.cycles-pp.xlog_cil_insert_items
3.21 ? 39% -2.0 1.26 ? 58% perf-profile.children.cycles-pp.xfs_ialloc_read_agi
2.19 ? 4% -1.8 0.39 ? 33% perf-profile.children.cycles-pp.xfs_itruncate_extents_flags
3.34 ? 11% -1.8 1.56 ? 36% perf-profile.children.cycles-pp.xfs_release
1.99 ? 4% -1.7 0.27 ? 34% perf-profile.children.cycles-pp.xfs_difree_inobt
4.83 ? 7% -1.7 3.16 ? 29% perf-profile.children.cycles-pp.xfs_buf_read_map
4.51 ? 7% -1.6 2.91 ? 29% perf-profile.children.cycles-pp.xfs_buf_find
4.86 ? 2% -1.6 3.26 ? 26% perf-profile.children.cycles-pp.syscall_exit_to_user_mode
4.76 ? 2% -1.6 3.18 ? 26% perf-profile.children.cycles-pp.exit_to_user_mode_prepare
2.15 ? 11% -1.5 0.66 ? 28% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
3.71 ? 3% -1.3 2.39 ? 25% perf-profile.children.cycles-pp.task_work_run
1.47 ? 6% -1.3 0.18 ? 37% perf-profile.children.cycles-pp.xfs_defer_finish
1.44 ? 6% -1.3 0.15 ? 49% perf-profile.children.cycles-pp.xfs_defer_trans_roll
3.49 ? 3% -1.3 2.23 ? 24% perf-profile.children.cycles-pp.__fput
2.59 ? 2% -1.2 1.37 ? 28% perf-profile.children.cycles-pp.xfs_trans_alloc
3.43 ? 6% -1.1 2.28 ? 29% perf-profile.children.cycles-pp.xfs_btree_lookup
1.36 ? 6% -1.1 0.23 ? 37% perf-profile.children.cycles-pp.xfs_trans_roll
1.51 ? 52% -1.1 0.40 ?136% perf-profile.children.cycles-pp.xfs_trans_add_item
2.83 ? 3% -1.0 1.85 ? 30% perf-profile.children.cycles-pp.ksys_write
1.14 ? 17% -1.0 0.17 ? 35% perf-profile.children.cycles-pp.xfs_difree_finobt
2.80 ? 3% -1.0 1.84 ? 30% perf-profile.children.cycles-pp.vfs_write
2.15 ? 3% -0.9 1.29 ? 24% perf-profile.children.cycles-pp.__schedule
2.10 ? 5% -0.9 1.25 ? 35% perf-profile.children.cycles-pp.up
2.47 ? 3% -0.8 1.62 ? 31% perf-profile.children.cycles-pp.new_sync_write
2.39 ? 3% -0.8 1.57 ? 32% perf-profile.children.cycles-pp.xfs_file_buffered_write
2.14 ? 2% -0.8 1.38 ? 31% perf-profile.children.cycles-pp.iomap_file_buffered_write
2.13 ? 2% -0.8 1.37 ? 31% perf-profile.children.cycles-pp.iomap_apply
1.40 ? 5% -0.7 0.66 ? 28% perf-profile.children.cycles-pp.xfs_log_ticket_ungrant
1.61 ? 7% -0.7 0.93 ? 28% perf-profile.children.cycles-pp.down
1.67 ? 4% -0.7 1.00 ? 30% perf-profile.children.cycles-pp.try_to_wake_up
0.82 ? 16% -0.7 0.16 ? 19% perf-profile.children.cycles-pp.poll_idle
1.57 ? 6% -0.7 0.92 ? 28% perf-profile.children.cycles-pp.__down
1.32 ? 5% -0.6 0.75 ? 29% perf-profile.children.cycles-pp.schedule_timeout
1.54 ? 3% -0.5 1.01 ? 32% perf-profile.children.cycles-pp.__percpu_counter_compare
1.55 ? 6% -0.5 1.02 ? 28% perf-profile.children.cycles-pp.__x64_sys_close
1.36 ? 5% -0.5 0.84 ? 25% perf-profile.children.cycles-pp.schedule
1.83 ? 3% -0.5 1.31 ? 29% perf-profile.children.cycles-pp.evict
1.47 ? 5% -0.5 0.97 ? 27% perf-profile.children.cycles-pp.filp_close
1.42 ? 3% -0.5 0.95 ? 31% perf-profile.children.cycles-pp.__percpu_counter_sum
1.16 ? 3% -0.5 0.69 ? 33% perf-profile.children.cycles-pp.__x64_sys_rename
1.35 ? 3% -0.5 0.90 ? 31% perf-profile.children.cycles-pp.iomap_write_actor
1.11 ? 3% -0.5 0.66 ? 33% perf-profile.children.cycles-pp.do_renameat2
1.28 ? 3% -0.4 0.83 ? 27% perf-profile.children.cycles-pp.__x64_sys_fcntl
1.22 ? 3% -0.4 0.79 ? 27% perf-profile.children.cycles-pp.do_fcntl
1.20 ? 3% -0.4 0.78 ? 26% perf-profile.children.cycles-pp.fcntl_dirnotify
0.88 ? 6% -0.4 0.47 ? 30% perf-profile.children.cycles-pp.down_read
0.91 ? 5% -0.4 0.51 ? 26% perf-profile.children.cycles-pp.schedule_idle
1.33 ? 3% -0.4 0.95 ? 30% perf-profile.children.cycles-pp.truncate_inode_pages_range
0.90 ? 2% -0.4 0.52 ? 33% perf-profile.children.cycles-pp.vfs_rename
1.07 ? 5% -0.4 0.71 ? 33% perf-profile.children.cycles-pp.do_open
0.46 ? 4% -0.4 0.10 ? 47% perf-profile.children.cycles-pp.__xfs_bunmapi
0.91 ? 3% -0.3 0.61 ? 30% perf-profile.children.cycles-pp.kmem_cache_free
0.52 ? 31% -0.3 0.23 ? 23% perf-profile.children.cycles-pp.xfs_btree_check_sblock
0.82 -0.3 0.54 ? 30% perf-profile.children.cycles-pp.xfs_inode_item_format
0.79 ? 7% -0.3 0.51 ? 28% perf-profile.children.cycles-pp.dnotify_flush
0.67 ? 11% -0.3 0.39 ? 26% perf-profile.children.cycles-pp.__radix_tree_lookup
0.88 ? 3% -0.3 0.61 ? 28% perf-profile.children.cycles-pp.arch_do_signal_or_restart
0.73 ? 8% -0.3 0.48 ? 31% perf-profile.children.cycles-pp.do_dentry_open
0.72 ? 3% -0.3 0.47 ? 25% perf-profile.children.cycles-pp.do_fchmodat
0.63 ? 2% -0.3 0.37 ? 31% perf-profile.children.cycles-pp.xfs_rename
0.48 ? 27% -0.3 0.23 ? 51% perf-profile.children.cycles-pp.percpu_counter_add_batch
0.67 ? 6% -0.3 0.41 ? 32% perf-profile.children.cycles-pp.xfs_buffered_write_iomap_begin
0.72 ? 3% -0.3 0.47 ? 25% perf-profile.children.cycles-pp.__x64_sys_chmod
0.64 ? 4% -0.2 0.40 ? 26% perf-profile.children.cycles-pp.chmod_common
0.59 ? 8% -0.2 0.36 ? 29% perf-profile.children.cycles-pp.dequeue_task_fair
0.87 ? 3% -0.2 0.64 ? 31% perf-profile.children.cycles-pp.__pagevec_release
0.62 ? 6% -0.2 0.39 ? 32% perf-profile.children.cycles-pp.xfs_trans_alloc_icreate
0.61 ? 4% -0.2 0.38 ? 28% perf-profile.children.cycles-pp.notify_change
0.74 ? 7% -0.2 0.52 ? 33% perf-profile.children.cycles-pp.fsnotify
0.32 ? 9% -0.2 0.09 ? 47% perf-profile.children.cycles-pp.xfs_btree_increment
0.56 ? 14% -0.2 0.34 ? 28% perf-profile.children.cycles-pp.ttwu_do_activate
0.55 ? 14% -0.2 0.33 ? 27% perf-profile.children.cycles-pp.enqueue_task_fair
0.40 ? 29% -0.2 0.19 ? 59% perf-profile.children.cycles-pp.xfs_mod_fdblocks
0.53 ? 9% -0.2 0.32 ? 29% perf-profile.children.cycles-pp.dequeue_entity
0.51 ? 5% -0.2 0.30 ? 31% perf-profile.children.cycles-pp.__list_add_valid
0.34 ? 5% -0.2 0.14 ? 18% perf-profile.children.cycles-pp.up_read
0.63 ? 2% -0.2 0.43 ? 30% perf-profile.children.cycles-pp.iomap_write_begin
0.56 ? 8% -0.2 0.37 ? 34% perf-profile.children.cycles-pp.__fsnotify_parent
0.45 ? 4% -0.2 0.26 ? 24% perf-profile.children.cycles-pp.xfs_setattr_nonsize
0.58 ? 4% -0.2 0.40 ? 31% perf-profile.children.cycles-pp.fsnotify_put_mark
0.59 ? 3% -0.2 0.41 ? 29% perf-profile.children.cycles-pp.grab_cache_page_write_begin
0.58 ? 3% -0.2 0.40 ? 30% perf-profile.children.cycles-pp.pagecache_get_page
0.43 ? 11% -0.2 0.25 ? 28% perf-profile.children.cycles-pp.enqueue_entity
0.47 ? 7% -0.2 0.30 ? 33% perf-profile.children.cycles-pp.iomap_write_end
0.49 ? 12% -0.2 0.32 ? 23% perf-profile.children.cycles-pp.pick_next_task_fair
0.39 ? 8% -0.2 0.23 ? 39% perf-profile.children.cycles-pp.xfs_dir2_sf_addname
0.27 ? 4% -0.2 0.11 ? 29% perf-profile.children.cycles-pp.down_write
0.23 ? 11% -0.2 0.07 ? 50% perf-profile.children.cycles-pp.queue_delayed_work_on
0.35 ? 10% -0.2 0.20 ? 42% perf-profile.children.cycles-pp.xfs_bmapi_reserve_delalloc
0.51 ? 4% -0.1 0.37 ? 16% perf-profile.children.cycles-pp.link_path_walk
0.37 ? 4% -0.1 0.23 ? 22% perf-profile.children.cycles-pp.fsnotify_add_mark_locked
0.33 ? 5% -0.1 0.19 ? 39% perf-profile.children.cycles-pp.xfs_trans_log_buf
0.42 ? 5% -0.1 0.28 ? 28% perf-profile.children.cycles-pp.__x64_sys_rt_sigreturn
0.41 ? 5% -0.1 0.29 ? 23% perf-profile.children.cycles-pp.filename_parentat
0.45 ? 5% -0.1 0.32 ? 27% perf-profile.children.cycles-pp.__setup_rt_frame
0.35 ? 9% -0.1 0.23 ? 34% perf-profile.children.cycles-pp.iomap_set_page_dirty
0.28 ? 6% -0.1 0.16 ? 34% perf-profile.children.cycles-pp.update_curr
0.38 ? 5% -0.1 0.26 ? 22% perf-profile.children.cycles-pp.path_parentat
0.26 ? 11% -0.1 0.15 ? 31% perf-profile.children.cycles-pp.xfs_agino_range
0.33 ? 10% -0.1 0.21 ? 26% perf-profile.children.cycles-pp.update_load_avg
0.36 ? 6% -0.1 0.25 ? 32% perf-profile.children.cycles-pp.dput
0.24 ? 4% -0.1 0.13 ? 35% perf-profile.children.cycles-pp.xfs_inobt_init_cursor
0.28 ? 4% -0.1 0.17 ? 33% perf-profile.children.cycles-pp.xfs_dir2_sf_removename
0.22 ? 5% -0.1 0.11 ? 33% perf-profile.children.cycles-pp.xfs_droplink
0.32 ? 9% -0.1 0.21 ? 31% perf-profile.children.cycles-pp.security_file_free
0.33 ? 8% -0.1 0.23 ? 37% perf-profile.children.cycles-pp.lru_add_drain
0.22 ? 10% -0.1 0.11 ? 35% perf-profile.children.cycles-pp.up_write
0.32 ? 8% -0.1 0.22 ? 38% perf-profile.children.cycles-pp.lru_add_drain_cpu
0.31 ? 7% -0.1 0.20 ? 37% perf-profile.children.cycles-pp.inode_permission
0.31 ? 10% -0.1 0.21 ? 31% perf-profile.children.cycles-pp.apparmor_file_free_security
0.37 ? 16% -0.1 0.27 ? 9% perf-profile.children.cycles-pp._raw_spin_lock_irq
0.26 ? 10% -0.1 0.16 ? 32% perf-profile.children.cycles-pp.mutex_lock
0.23 ? 13% -0.1 0.14 ? 34% perf-profile.children.cycles-pp.__mnt_want_write
0.20 ? 11% -0.1 0.10 ? 30% perf-profile.children.cycles-pp.__switch_to
0.37 ? 9% -0.1 0.28 ? 27% perf-profile.children.cycles-pp.security_file_alloc
0.15 ? 10% -0.1 0.06 ? 73% perf-profile.children.cycles-pp.finish_task_switch
0.20 ? 7% -0.1 0.11 ? 54% perf-profile.children.cycles-pp.delete_from_page_cache_batch
0.30 ? 10% -0.1 0.21 ? 38% perf-profile.children.cycles-pp.__pagevec_lru_add
0.35 ? 9% -0.1 0.26 ? 20% perf-profile.children.cycles-pp.___might_sleep
0.27 ? 10% -0.1 0.18 ? 25% perf-profile.children.cycles-pp.mnt_want_write
0.33 ? 3% -0.1 0.25 ? 29% perf-profile.children.cycles-pp.cpumask_next
0.20 ? 11% -0.1 0.11 ? 45% perf-profile.children.cycles-pp.locked_inode_to_wb_and_lock_list
0.27 ? 5% -0.1 0.19 ? 37% perf-profile.children.cycles-pp.memset_erms
0.22 ? 10% -0.1 0.13 ? 43% perf-profile.children.cycles-pp.errseq_sample
0.30 ? 8% -0.1 0.22 ? 30% perf-profile.children.cycles-pp.copy_fpstate_to_sigframe
0.21 ? 3% -0.1 0.13 ? 48% perf-profile.children.cycles-pp.__cond_resched
0.33 ? 8% -0.1 0.25 ? 32% perf-profile.children.cycles-pp.send_sigio
0.28 ? 5% -0.1 0.19 ? 29% perf-profile.children.cycles-pp.restore_sigcontext
0.30 ? 6% -0.1 0.22 ? 33% perf-profile.children.cycles-pp.add_to_page_cache_lru
0.26 ? 3% -0.1 0.18 ? 45% perf-profile.children.cycles-pp.__might_sleep
0.28 ? 6% -0.1 0.20 ? 32% perf-profile.children.cycles-pp.__add_to_page_cache_locked
0.29 ? 8% -0.1 0.21 ? 25% perf-profile.children.cycles-pp.apparmor_file_alloc_security
0.13 ? 17% -0.1 0.06 ? 54% perf-profile.children.cycles-pp.xfs_lock_two_inodes
0.11 ? 15% -0.1 0.04 ?100% perf-profile.children.cycles-pp.mutex_unlock
0.14 ? 6% -0.1 0.07 ? 50% perf-profile.children.cycles-pp.drop_nlink
0.11 ? 29% -0.1 0.04 ? 71% perf-profile.children.cycles-pp.xfs_inobt_get_maxrecs
0.17 ? 7% -0.1 0.10 ? 49% perf-profile.children.cycles-pp.__switch_to_asm
0.17 ? 5% -0.1 0.10 ? 27% perf-profile.children.cycles-pp.fsnotify_init_mark
0.21 ? 5% -0.1 0.15 ? 26% perf-profile.children.cycles-pp.__fpu__restore_sig
0.18 ? 11% -0.1 0.12 ? 51% perf-profile.children.cycles-pp.__x64_sys_unlink
0.23 ? 7% -0.1 0.16 ? 25% perf-profile.children.cycles-pp.get_signal
0.14 ? 13% -0.1 0.08 ? 49% perf-profile.children.cycles-pp.fsnotify_mark_destroy_workfn
0.19 ? 10% -0.1 0.12 ? 46% perf-profile.children.cycles-pp.down_trylock
0.22 ? 4% -0.1 0.15 ? 31% perf-profile.children.cycles-pp.syscall_return_via_sysret
0.18 ? 5% -0.1 0.12 ? 46% perf-profile.children.cycles-pp.generic_permission
0.10 ? 16% -0.1 0.04 ? 72% perf-profile.children.cycles-pp.update_cfs_group
0.19 ? 8% -0.1 0.13 ? 29% perf-profile.children.cycles-pp.inode_io_list_del
0.15 ? 13% -0.1 0.09 ? 49% perf-profile.children.cycles-pp.xfs_bmap_add_extent_hole_delay
0.15 ? 7% -0.1 0.09 ? 27% perf-profile.children.cycles-pp.fsnotify_get_group
0.15 ? 9% -0.1 0.09 ? 50% perf-profile.children.cycles-pp.__lookup_hash
0.15 ? 9% -0.1 0.10 ? 49% perf-profile.children.cycles-pp.make_kuid
0.15 ? 14% -0.1 0.09 ? 45% perf-profile.children.cycles-pp.queue_work_on
0.18 ? 11% -0.1 0.13 ? 30% perf-profile.children.cycles-pp.xfs_ialloc_ag_select
0.13 ? 20% -0.1 0.08 ? 51% perf-profile.children.cycles-pp.iov_iter_copy_from_user_atomic
0.10 -0.1 0.05 ? 73% perf-profile.children.cycles-pp.rcu_all_qs
0.13 ? 2% -0.1 0.08 ? 51% perf-profile.children.cycles-pp.fpu__clear
0.11 ? 18% -0.1 0.06 ? 49% perf-profile.children.cycles-pp.ttwu_do_wakeup
0.09 ? 14% -0.1 0.03 ?100% perf-profile.children.cycles-pp.asm_sysvec_call_function_single
0.15 ? 8% -0.1 0.10 ? 20% perf-profile.children.cycles-pp.map_id_up
0.14 ? 13% -0.1 0.09 ? 28% perf-profile.children.cycles-pp.fsnotify_find_mark
0.20 ? 13% -0.0 0.15 ? 29% perf-profile.children.cycles-pp.__mutex_lock
0.10 ? 9% -0.0 0.06 ? 52% perf-profile.children.cycles-pp.fsnotify_final_mark_destroy
0.14 ? 5% -0.0 0.10 ? 46% perf-profile.children.cycles-pp.__entry_text_start
0.10 ? 9% -0.0 0.05 ? 71% perf-profile.children.cycles-pp.lock_page_lruvec_irqsave
0.15 ? 9% -0.0 0.10 ? 26% perf-profile.children.cycles-pp.dequeue_signal
0.08 ? 19% -0.0 0.04 ? 73% perf-profile.children.cycles-pp.task_work_add
0.16 ? 11% -0.0 0.12 ? 30% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
0.10 ? 17% -0.0 0.06 ? 49% perf-profile.children.cycles-pp.check_preempt_curr
0.10 ? 17% -0.0 0.06 ? 51% perf-profile.children.cycles-pp.xfs_iext_insert_raw
0.14 ? 5% -0.0 0.09 ? 46% perf-profile.children.cycles-pp.refcount_dec_and_lock
0.11 ? 11% -0.0 0.07 ? 48% perf-profile.children.cycles-pp.alloc_fd
0.11 ? 6% -0.0 0.07 ? 48% perf-profile.children.cycles-pp.lockref_put_return
0.07 ? 10% -0.0 0.03 ?102% perf-profile.children.cycles-pp.d_lookup
0.11 ? 11% -0.0 0.07 ? 47% perf-profile.children.cycles-pp.xfs_trans_alloc_ichange
0.10 ? 19% -0.0 0.07 ? 24% perf-profile.children.cycles-pp.fput_many
0.07 ? 11% -0.0 0.05 ? 45% perf-profile.children.cycles-pp.___perf_sw_event
0.06 ? 14% +0.1 0.12 ? 20% perf-profile.children.cycles-pp.page_counter_try_charge
0.00 +0.1 0.06 ? 11% perf-profile.children.cycles-pp.crc32c_pcl_intel_update
0.06 ? 13% +0.1 0.12 ? 16% perf-profile.children.cycles-pp.__memcg_kmem_charge
0.12 ? 4% +0.1 0.19 ? 15% perf-profile.children.cycles-pp.__slab_free
0.04 ? 71% +0.1 0.11 ? 30% perf-profile.children.cycles-pp.call_cpuidle
0.00 +0.1 0.07 ? 31% perf-profile.children.cycles-pp.trigger_load_balance
0.00 +0.1 0.08 ? 24% perf-profile.children.cycles-pp.execve
0.00 +0.1 0.08 ? 24% perf-profile.children.cycles-pp.__x64_sys_execve
0.00 +0.1 0.08 ? 24% perf-profile.children.cycles-pp.do_execveat_common
0.00 +0.1 0.09 ? 35% perf-profile.children.cycles-pp.rcu_dynticks_eqs_exit
0.00 +0.1 0.09 ? 42% perf-profile.children.cycles-pp.exc_page_fault
0.00 +0.1 0.09 ? 40% perf-profile.children.cycles-pp.asm_exc_page_fault
0.00 +0.1 0.10 ? 48% perf-profile.children.cycles-pp.memcpy_toio
0.07 ? 5% +0.1 0.17 ? 88% perf-profile.children.cycles-pp.cpuidle_governor_latency_req
0.03 ?102% +0.1 0.13 ? 49% perf-profile.children.cycles-pp.rcu_eqs_enter
0.11 ? 13% +0.1 0.21 ? 33% perf-profile.children.cycles-pp.tsc_verify_tsc_adjust
0.11 ? 13% +0.1 0.22 ? 31% perf-profile.children.cycles-pp.arch_cpu_idle_enter
0.04 ? 71% +0.1 0.15 ? 26% perf-profile.children.cycles-pp.xfs_cil_prepare_item
0.07 ? 7% +0.1 0.18 ? 67% perf-profile.children.cycles-pp.rcu_eqs_exit
0.06 ? 13% +0.1 0.18 ? 29% perf-profile.children.cycles-pp.__intel_pmu_enable_all
0.07 ? 12% +0.1 0.20 ? 51% perf-profile.children.cycles-pp.update_blocked_averages
0.15 ? 13% +0.1 0.28 ? 22% perf-profile.children.cycles-pp._raw_spin_trylock
0.13 ? 10% +0.1 0.27 ? 26% perf-profile.children.cycles-pp.update_sd_lb_stats
0.08 ? 8% +0.1 0.21 ? 57% perf-profile.children.cycles-pp.run_rebalance_domains
0.02 ?142% +0.1 0.16 ? 60% perf-profile.children.cycles-pp.update_irq_load_avg
0.14 ? 10% +0.1 0.28 ? 26% perf-profile.children.cycles-pp.find_busiest_group
0.09 ? 7% +0.1 0.23 ? 67% perf-profile.children.cycles-pp.rcu_idle_exit
0.04 ? 45% +0.1 0.19 ? 39% perf-profile.children.cycles-pp.arch_scale_freq_tick
0.00 +0.2 0.16 ? 92% perf-profile.children.cycles-pp.timerqueue_del
0.11 ? 15% +0.2 0.27 ? 27% perf-profile.children.cycles-pp.calc_global_load_tick
0.04 ? 73% +0.2 0.20 ? 44% perf-profile.children.cycles-pp.hrtimer_next_event_without
0.08 ? 8% +0.2 0.25 ? 69% perf-profile.children.cycles-pp.rcu_sched_clock_irq
0.00 +0.2 0.17 ? 33% perf-profile.children.cycles-pp.xfs_buf_offset
0.04 ? 72% +0.2 0.21 ? 42% perf-profile.children.cycles-pp.get_next_timer_interrupt
0.11 ? 69% +0.2 0.29 ? 35% perf-profile.children.cycles-pp.xfs_next_bit
0.01 ?223% +0.2 0.20 ?101% perf-profile.children.cycles-pp.__remove_hrtimer
0.00 +0.2 0.20 ? 38% perf-profile.children.cycles-pp.kmem_alloc_large
0.01 ?223% +0.2 0.22 ? 66% perf-profile.children.cycles-pp.__hrtimer_next_event_base
0.00 +0.2 0.21 ? 30% perf-profile.children.cycles-pp.xfs_iunlink_insert_backref
0.16 ? 11% +0.2 0.37 ? 33% perf-profile.children.cycles-pp.load_balance
0.00 +0.2 0.21 ? 41% perf-profile.children.cycles-pp.xfs_inode_set_inactive_tag
0.20 ? 3% +0.2 0.44 ? 30% perf-profile.children.cycles-pp.native_sched_clock
0.06 ? 11% +0.3 0.31 ? 51% perf-profile.children.cycles-pp.io_serial_in
0.21 ? 4% +0.3 0.47 ? 30% perf-profile.children.cycles-pp.sched_clock
0.00 +0.3 0.27 ? 51% perf-profile.children.cycles-pp.xfs_trans_committed_bulk
0.34 ? 6% +0.3 0.63 ? 23% perf-profile.children.cycles-pp.native_irq_return_iret
0.23 ? 4% +0.3 0.53 ? 29% perf-profile.children.cycles-pp.sched_clock_cpu
0.19 ? 5% +0.3 0.48 ? 36% perf-profile.children.cycles-pp.read_tsc
0.09 ? 5% +0.3 0.38 ? 51% perf-profile.children.cycles-pp.serial8250_console_putchar
0.09 ? 5% +0.3 0.39 ? 49% perf-profile.children.cycles-pp.wait_for_xmitr
0.11 ? 6% +0.3 0.42 ? 37% perf-profile.children.cycles-pp.ktime_get_update_offsets_now
0.09 ? 4% +0.3 0.40 ? 51% perf-profile.children.cycles-pp.uart_console_write
0.00 +0.3 0.32 ? 37% perf-profile.children.cycles-pp.xlog_write
0.09 +0.3 0.40 ? 49% perf-profile.children.cycles-pp.serial8250_console_write
0.00 +0.3 0.32 ? 25% perf-profile.children.cycles-pp.allocate_slab
0.18 ? 6% +0.3 0.50 ? 39% perf-profile.children.cycles-pp.irqtime_account_irq
0.27 ? 53% +0.3 0.59 ? 50% perf-profile.children.cycles-pp.start_kernel
0.09 ? 5% +0.3 0.43 ? 49% perf-profile.children.cycles-pp.asm_sysvec_irq_work
0.09 ? 5% +0.3 0.43 ? 49% perf-profile.children.cycles-pp.sysvec_irq_work
0.09 ? 5% +0.3 0.43 ? 49% perf-profile.children.cycles-pp.__sysvec_irq_work
0.09 ? 5% +0.3 0.43 ? 49% perf-profile.children.cycles-pp.irq_work_run
0.09 ? 5% +0.3 0.43 ? 49% perf-profile.children.cycles-pp.irq_work_single
0.09 ? 5% +0.3 0.43 ? 49% perf-profile.children.cycles-pp.printk
0.09 ? 5% +0.3 0.43 ? 49% perf-profile.children.cycles-pp.vprintk_emit
0.09 ? 5% +0.3 0.43 ? 49% perf-profile.children.cycles-pp.console_unlock
0.23 ? 12% +0.3 0.57 ? 24% perf-profile.children.cycles-pp.tick_nohz_irq_exit
0.06 ? 14% +0.3 0.41 ? 27% perf-profile.children.cycles-pp.___slab_alloc
0.06 ? 11% +0.3 0.41 ? 27% perf-profile.children.cycles-pp.__slab_alloc
0.10 ? 5% +0.4 0.45 ? 51% perf-profile.children.cycles-pp.irq_work_run_list
0.17 ? 14% +0.4 0.53 ? 27% perf-profile.children.cycles-pp.lapic_next_deadline
0.00 +0.4 0.37 ? 23% perf-profile.children.cycles-pp.xfs_inode_alloc
0.25 ? 10% +0.4 0.64 ? 28% perf-profile.children.cycles-pp.rebalance_domains
0.15 ? 7% +0.4 0.55 ? 49% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
0.00 +0.4 0.44 ? 35% perf-profile.children.cycles-pp.xlog_cil_push_work
0.00 +0.5 0.51 ? 55% perf-profile.children.cycles-pp.xfsaild
0.00 +0.5 0.51 ? 55% perf-profile.children.cycles-pp.xfsaild_push
1.04 ? 2% +0.5 1.58 ? 13% perf-profile.children.cycles-pp.__softirqentry_text_start
0.24 ? 16% +0.5 0.79 ? 67% perf-profile.children.cycles-pp.tick_irq_enter
0.25 ? 16% +0.6 0.81 ? 66% perf-profile.children.cycles-pp.irq_enter_rcu
0.31 ? 4% +0.6 0.95 ? 34% perf-profile.children.cycles-pp.scheduler_tick
0.86 ? 4% +0.8 1.71 ? 25% perf-profile.children.cycles-pp.irq_exit_rcu
0.60 ? 12% +0.9 1.55 ? 19% perf-profile.children.cycles-pp.tick_nohz_next_event
0.71 ? 7% +1.1 1.81 ? 20% perf-profile.children.cycles-pp.clockevents_program_event
0.68 ? 12% +1.1 1.82 ? 16% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
0.20 ? 25% +1.1 1.34 ? 29% perf-profile.children.cycles-pp.xfs_dialloc_ag_update_inobt
0.58 ? 7% +1.2 1.78 ? 38% perf-profile.children.cycles-pp.update_process_times
0.59 ? 7% +1.3 1.87 ? 42% perf-profile.children.cycles-pp.tick_sched_handle
0.69 ? 7% +1.4 2.13 ? 41% perf-profile.children.cycles-pp.tick_sched_timer
1.13 ? 9% +1.5 2.67 ? 19% perf-profile.children.cycles-pp.ktime_get
0.96 ? 6% +2.3 3.24 ? 50% perf-profile.children.cycles-pp.__hrtimer_run_queues
0.00 +2.4 2.42 ? 31% perf-profile.children.cycles-pp.xfs_inactive_inode
0.00 +2.4 2.44 ? 32% perf-profile.children.cycles-pp.xfs_inactive_worker
0.00 +2.4 2.44 ? 32% perf-profile.children.cycles-pp.xfs_inode_walk_ag
2.06 ?141% +3.0 5.01 ? 56% perf-profile.children.cycles-pp.xfs_dir_ialloc
2.09 ? 7% +3.5 5.59 ? 24% perf-profile.children.cycles-pp.menu_select
0.33 ? 8% +3.5 3.85 ? 22% perf-profile.children.cycles-pp.worker_thread
0.28 ? 6% +3.5 3.81 ? 22% perf-profile.children.cycles-pp.process_one_work
0.70 ? 6% +3.9 4.65 ? 17% perf-profile.children.cycles-pp.kthread
0.70 ? 6% +4.0 4.65 ? 17% perf-profile.children.cycles-pp.ret_from_fork
1.89 ? 6% +4.0 5.90 ? 35% perf-profile.children.cycles-pp.hrtimer_interrupt
1.91 ? 6% +4.1 6.03 ? 36% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
32.41 ? 2% +5.8 38.23 ? 17% perf-profile.children.cycles-pp.intel_idle
3.33 ? 5% +6.1 9.48 ? 35% perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
4.01 ? 4% +7.7 11.73 ? 30% perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
37.84 +15.6 53.46 ? 18% perf-profile.children.cycles-pp.cpuidle_enter_state
37.84 +15.6 53.48 ? 18% perf-profile.children.cycles-pp.cpuidle_enter
42.03 +18.5 60.49 ? 16% perf-profile.children.cycles-pp.start_secondary
42.30 +18.8 61.08 ? 16% perf-profile.children.cycles-pp.secondary_startup_64_no_verify
42.30 +18.8 61.08 ? 16% perf-profile.children.cycles-pp.cpu_startup_entry
42.29 +18.8 61.08 ? 16% perf-profile.children.cycles-pp.do_idle
2.11 ? 10% -1.5 0.65 ? 28% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
3.84 ? 3% -1.1 2.78 ? 19% perf-profile.self.cycles-pp._raw_spin_lock
1.82 ? 3% -1.0 0.84 ? 30% perf-profile.self.cycles-pp.xfs_log_commit_cil
1.35 ? 3% -0.8 0.53 ? 25% perf-profile.self.cycles-pp.xfs_log_ticket_ungrant
0.78 ? 16% -0.7 0.12 ? 21% perf-profile.self.cycles-pp.poll_idle
1.03 ? 5% -0.6 0.45 ? 24% perf-profile.self.cycles-pp.xlog_cil_insert_items
0.81 ? 6% -0.4 0.42 ? 31% perf-profile.self.cycles-pp.down_read
0.89 ? 4% -0.3 0.56 ? 31% perf-profile.self.cycles-pp.__percpu_counter_sum
0.50 ? 7% -0.3 0.19 ? 37% perf-profile.self.cycles-pp.xfs_trans_log_inode
0.39 ? 48% -0.3 0.09 ?156% perf-profile.self.cycles-pp.__xfs_trans_commit
0.66 ? 11% -0.3 0.39 ? 26% perf-profile.self.cycles-pp.__radix_tree_lookup
0.81 ? 4% -0.3 0.56 ? 24% perf-profile.self.cycles-pp.xfs_buf_find
0.47 ? 26% -0.2 0.22 ? 51% perf-profile.self.cycles-pp.percpu_counter_add_batch
0.34 ? 26% -0.2 0.13 ? 34% perf-profile.self.cycles-pp.xfs_trans_alloc
0.27 ? 39% -0.2 0.06 ? 90% perf-profile.self.cycles-pp.xfs_log_reserve
0.34 ? 6% -0.2 0.14 ? 17% perf-profile.self.cycles-pp.up_read
0.64 ? 3% -0.2 0.44 ? 31% perf-profile.self.cycles-pp.xfs_inode_item_format
0.57 ? 3% -0.2 0.37 ? 25% perf-profile.self.cycles-pp.kmem_cache_free
0.50 ? 5% -0.2 0.30 ? 32% perf-profile.self.cycles-pp.__list_add_valid
0.34 ? 8% -0.2 0.15 ? 27% perf-profile.self.cycles-pp.xfs_trans_add_item
0.59 ? 5% -0.2 0.40 ? 26% perf-profile.self.cycles-pp.kmem_cache_alloc
0.23 ? 9% -0.2 0.07 ? 48% perf-profile.self.cycles-pp.queue_delayed_work_on
0.35 ? 3% -0.2 0.20 ? 30% perf-profile.self.cycles-pp.__schedule
0.36 ? 5% -0.2 0.21 ? 30% perf-profile.self.cycles-pp.xfs_btree_lookup
0.19 ? 6% -0.1 0.05 ? 71% perf-profile.self.cycles-pp.down_write
0.22 ? 48% -0.1 0.10 ? 24% perf-profile.self.cycles-pp.__xfs_btree_check_sblock
0.32 ? 7% -0.1 0.20 ? 36% perf-profile.self.cycles-pp.fsnotify
0.13 ? 5% -0.1 0.03 ?102% perf-profile.self.cycles-pp.__xfs_bunmapi
0.21 ? 9% -0.1 0.11 ? 35% perf-profile.self.cycles-pp.up_write
0.36 ? 16% -0.1 0.26 ? 11% perf-profile.self.cycles-pp._raw_spin_lock_irq
0.30 ? 10% -0.1 0.21 ? 32% perf-profile.self.cycles-pp.apparmor_file_free_security
0.24 ? 11% -0.1 0.14 ? 35% perf-profile.self.cycles-pp.mutex_lock
0.19 ? 14% -0.1 0.09 ? 46% perf-profile.self.cycles-pp.xfs_agino_range
0.34 ? 9% -0.1 0.24 ? 19% perf-profile.self.cycles-pp.___might_sleep
0.23 ? 12% -0.1 0.14 ? 34% perf-profile.self.cycles-pp.__mnt_want_write
0.18 ? 7% -0.1 0.09 ? 51% perf-profile.self.cycles-pp.xfs_create
0.19 ? 8% -0.1 0.10 ? 28% perf-profile.self.cycles-pp.xfs_trans_read_buf_map
0.19 ? 10% -0.1 0.10 ? 28% perf-profile.self.cycles-pp.__switch_to
0.21 ? 10% -0.1 0.13 ? 43% perf-profile.self.cycles-pp.errseq_sample
0.27 ? 8% -0.1 0.19 ? 25% perf-profile.self.cycles-pp.apparmor_file_alloc_security
0.11 ? 21% -0.1 0.03 ?106% perf-profile.self.cycles-pp.xfs_read_agi
0.22 ? 2% -0.1 0.14 ? 18% perf-profile.self.cycles-pp.link_path_walk
0.11 ? 15% -0.1 0.04 ?100% perf-profile.self.cycles-pp.mutex_unlock
0.12 ? 19% -0.1 0.05 ? 76% perf-profile.self.cycles-pp.__percpu_counter_compare
0.14 ? 7% -0.1 0.07 ? 52% perf-profile.self.cycles-pp.drop_nlink
0.11 ? 25% -0.1 0.04 ? 70% perf-profile.self.cycles-pp.xfs_inobt_get_maxrecs
0.17 ? 7% -0.1 0.10 ? 49% perf-profile.self.cycles-pp.__switch_to_asm
0.22 ? 3% -0.1 0.15 ? 31% perf-profile.self.cycles-pp.syscall_return_via_sysret
0.11 ? 6% -0.1 0.05 ? 74% perf-profile.self.cycles-pp.pagecache_get_page
0.14 ? 12% -0.1 0.08 ? 45% perf-profile.self.cycles-pp.try_to_wake_up
0.15 ? 7% -0.1 0.09 ? 27% perf-profile.self.cycles-pp.fsnotify_get_group
0.10 ? 13% -0.1 0.04 ? 72% perf-profile.self.cycles-pp.update_cfs_group
0.08 ? 17% -0.1 0.03 ?100% perf-profile.self.cycles-pp.schedule
0.15 ? 7% -0.1 0.10 ? 51% perf-profile.self.cycles-pp.map_id_range_down
0.14 ? 16% -0.1 0.08 ? 46% perf-profile.self.cycles-pp.queue_work_on
0.08 ? 22% -0.1 0.03 ?100% perf-profile.self.cycles-pp.__fsnotify_parent
0.12 ? 11% -0.1 0.07 ? 45% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
0.14 ? 18% -0.1 0.09 ? 28% perf-profile.self.cycles-pp.enqueue_entity
0.10 ? 6% -0.0 0.05 ? 46% perf-profile.self.cycles-pp.xfs_remove
0.12 ? 11% -0.0 0.08 ? 20% perf-profile.self.cycles-pp.xfs_buffered_write_iomap_begin
0.14 ? 5% -0.0 0.10 ? 47% perf-profile.self.cycles-pp.__entry_text_start
0.08 ? 20% -0.0 0.04 ? 71% perf-profile.self.cycles-pp.task_work_add
0.10 ? 18% -0.0 0.06 ? 56% perf-profile.self.cycles-pp.xfs_dir2_sf_addname
0.12 ? 11% -0.0 0.08 ? 33% perf-profile.self.cycles-pp.do_dentry_open
0.14 ? 5% -0.0 0.09 ? 20% perf-profile.self.cycles-pp.map_id_up
0.10 ? 13% -0.0 0.05 ? 49% perf-profile.self.cycles-pp.fsnotify_add_mark_locked
0.14 ? 9% -0.0 0.10 ? 27% perf-profile.self.cycles-pp.__fpu__restore_sig
0.16 ? 10% -0.0 0.11 ? 31% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
0.10 ? 9% -0.0 0.06 ? 47% perf-profile.self.cycles-pp.lockref_put_return
0.09 ? 10% -0.0 0.06 ? 47% perf-profile.self.cycles-pp.generic_permission
0.06 ? 17% +0.0 0.10 ? 20% perf-profile.self.cycles-pp.page_counter_try_charge
0.12 ? 4% +0.1 0.18 ? 14% perf-profile.self.cycles-pp.__slab_free
0.03 ?100% +0.1 0.11 ? 30% perf-profile.self.cycles-pp.call_cpuidle
0.00 +0.1 0.08 ? 38% perf-profile.self.cycles-pp.rcu_dynticks_eqs_exit
0.10 ? 12% +0.1 0.19 ? 20% perf-profile.self.cycles-pp.tsc_verify_tsc_adjust
0.23 ? 5% +0.1 0.32 ? 22% perf-profile.self.cycles-pp.do_idle
0.03 ? 99% +0.1 0.12 ? 24% perf-profile.self.cycles-pp.xfs_cil_prepare_item
0.00 +0.1 0.10 ? 48% perf-profile.self.cycles-pp.memcpy_toio
0.09 ? 12% +0.1 0.19 ? 28% perf-profile.self.cycles-pp.update_sd_lb_stats
0.00 +0.1 0.10 ? 33% perf-profile.self.cycles-pp.asm_sysvec_apic_timer_interrupt
0.00 +0.1 0.12 ? 27% perf-profile.self.cycles-pp.allocate_slab
0.06 ? 13% +0.1 0.18 ? 29% perf-profile.self.cycles-pp.__intel_pmu_enable_all
0.00 +0.1 0.12 ? 62% perf-profile.self.cycles-pp.perf_mux_hrtimer_handler
0.15 ? 13% +0.1 0.28 ? 22% perf-profile.self.cycles-pp._raw_spin_trylock
0.00 +0.1 0.13 ? 55% perf-profile.self.cycles-pp.hrtimer_interrupt
0.00 +0.1 0.13 ? 83% perf-profile.self.cycles-pp.__hrtimer_run_queues
0.02 ?142% +0.1 0.15 ? 62% perf-profile.self.cycles-pp.update_irq_load_avg
0.00 +0.1 0.14 ? 38% perf-profile.self.cycles-pp.xfs_buf_offset
0.07 ? 10% +0.1 0.22 ? 72% perf-profile.self.cycles-pp.rcu_sched_clock_irq
0.04 ? 45% +0.1 0.19 ? 39% perf-profile.self.cycles-pp.arch_scale_freq_tick
0.11 ? 15% +0.2 0.26 ? 28% perf-profile.self.cycles-pp.calc_global_load_tick
0.10 ? 67% +0.2 0.27 ? 35% perf-profile.self.cycles-pp.xfs_next_bit
0.12 ? 7% +0.2 0.30 ? 42% perf-profile.self.cycles-pp.irqtime_account_irq
0.00 +0.2 0.19 ? 37% perf-profile.self.cycles-pp.xlog_write
0.01 ?223% +0.2 0.20 ? 74% perf-profile.self.cycles-pp.__hrtimer_next_event_base
0.00 +0.2 0.20 ? 32% perf-profile.self.cycles-pp.xfs_iunlink_insert_backref
0.12 ? 19% +0.2 0.33 ? 24% perf-profile.self.cycles-pp.update_process_times
0.15 ? 11% +0.2 0.36 ? 13% perf-profile.self.cycles-pp.tick_nohz_next_event
0.19 ? 3% +0.2 0.42 ? 29% perf-profile.self.cycles-pp.native_sched_clock
0.06 ? 11% +0.3 0.31 ? 51% perf-profile.self.cycles-pp.io_serial_in
0.09 ? 10% +0.3 0.35 ? 34% perf-profile.self.cycles-pp.ktime_get_update_offsets_now
0.19 ? 6% +0.3 0.46 ? 36% perf-profile.self.cycles-pp.read_tsc
0.34 ? 6% +0.3 0.62 ? 22% perf-profile.self.cycles-pp.native_irq_return_iret
0.16 ? 13% +0.4 0.53 ? 27% perf-profile.self.cycles-pp.lapic_next_deadline
0.97 ? 10% +1.3 2.25 ? 19% perf-profile.self.cycles-pp.ktime_get
1.30 ? 9% +2.2 3.55 ? 31% perf-profile.self.cycles-pp.menu_select
1.36 ? 9% +3.0 4.33 ? 38% perf-profile.self.cycles-pp.cpuidle_enter_state
32.41 ? 2% +5.8 38.22 ? 17% perf-profile.self.cycles-pp.intel_idle
stress-ng.time.user_time
12 +----------------------------------------------------------------------+
11 |-+:: +. +. .+. +. +. .+.++. + : + + .+.+. +.+. +. .|
| : : + + +.+ ++. + + + + +.+ +.+ ++ +.+ +.+ + |
10 |.+ +.+ + + |
9 |-+ |
| |
8 |-+ |
7 |-+ |
6 |-+ |
| |
5 |-+ |
4 |-+ |
| O O O O OO O |
3 |-O O O O OO O O O OO O O OO O O O OO O O O O |
2 +----------------------------------------------------------------------+
stress-ng.time.system_time
450 +---------------------------------------------------------------------+
|.+.++ +.++.+.+.++.+.+.++.+.+.++.+.+.++.+.+.++.+.+.++.+.+.++.+.+.++.|
400 |-+ |
350 |-+ |
| |
300 |-+ |
| |
250 |-+ |
| |
200 |-+ |
150 |-+ |
| |
100 |-+ OO O O OO O O OO |
| O O O OO O O OO O O OO O O OO O O OO |
50 +---------------------------------------------------------------------+
stress-ng.time.percent_of_cpu_this_job_got
800 +---------------------------------------------------------------------+
| |
700 |.+.++.+.+.++.+.+.++.+.+.++.+.+.++.+.+.++.+.+.++.+.+.++.+.+.++.+.+.++.|
| |
600 |-+ |
| |
500 |-+ |
| |
400 |-+ |
| |
300 |-+ |
| |
200 |-+ |
| O OO O O OO O O OO O O OO O O OO O O OO O O OO O O OO |
100 +---------------------------------------------------------------------+
stress-ng.time.voluntary_context_switches
1.6e+07 +-----------------------------------------------------------------+
| |
1.4e+07 |-+ .+ .+ .+. +. .+ .++. .++. .+ |
|.++.+.++.+ :.+ +.++.+.++ + + +.+ + +.++.++.+ +.+.++.|
1.2e+07 |-+ + |
| |
1e+07 |-+ |
| |
8e+06 |-+ |
| |
6e+06 |-+ |
| |
4e+06 |-+ |
| OO O OO O OO O OO OO O OO O OO O OO O O OO O OO |
2e+06 +-----------------------------------------------------------------+
stress-ng.time.involuntary_context_switches
55000 +-------------------------------------------------------------------+
50000 |.+:+ .+. .+.+ .+. .+.+.+ +. + :.+. .++. .++. +. |
| + + ++ + ++ +.+.+ + + + + +.++.+.+.+ +.++.|
45000 |-+ |
40000 |-+ |
| |
35000 |-+ |
30000 |-+ |
25000 |-+ |
| |
20000 |-+ |
15000 |-+ |
| OO O O |
10000 |-OO O O OO O OO O OO O O OO O OO O OO O O O O O |
5000 +-------------------------------------------------------------------+
stress-ng.time.file_system_outputs
5.5e+07 +-----------------------------------------------------------------+
|. .++. .+ .+.+ .+ .+. .+. +. .+ .+ .+ .+. +.+.+ .+ |
5e+07 |-++.+ + + + + ++ + + +.+ +.+ + ++.+ +.+ :+|
4.5e+07 |-+ + |
| |
4e+07 |-+ |
3.5e+07 |-+ |
| |
3e+07 |-+ |
2.5e+07 |-+ |
| |
2e+07 |-+ |
1.5e+07 |-+ |
| O O O O O OO O OO O OO |
1e+07 +-----------------------------------------------------------------+
stress-ng.dnotify.ops
1.4e+06 +-----------------------------------------------------------------+
|. .++. .+ .+ .+. .+. +. .+ .+ .+ +. .+ |
1.2e+06 |-++.+ + +.+ +.++ ++ + + +.+ +.+ +.+.++.+ + +.+.+ +|
| + |
| |
1e+06 |-+ |
| |
800000 |-+ |
| |
600000 |-+ |
| |
| |
400000 |-+ OO O O O |
| OO O OO O OO O OO OO O OO O OO O OO O O O O |
200000 +-----------------------------------------------------------------+
stress-ng.dnotify.ops_per_sec
24000 +-------------------------------------------------------------------+
22000 |-+ +. + + |
|. +. .+.+ + ++.+. +. .+. .+. +. .++. + + + + +.+. .+.+.+ .+.+ .|
20000 |-+ + + + + ++ + + + ++ + ++ + + |
18000 |-+ |
| |
16000 |-+ |
14000 |-+ |
12000 |-+ |
| |
10000 |-+ |
8000 |-+ |
| |
6000 |-+O O O O O O OO O OO O O |
4000 +-------------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
---
0DAY/LKP+ Test Infrastructure Open Source Technology Center
https://lists.01.org/hyperkitty/list/[email protected] Intel Corporation
Thanks,
Oliver Sang