2021-06-22 12:37:53

by kernel test robot

[permalink] [raw]

Subject: [xfs] 752d5513e6: stress-ng.dentry.ops_per_sec -26.1% regression

---

Greeting,

FYI, we noticed a -26.1% regression of stress-ng.dentry.ops_per_sec due to commit:


commit: 752d5513e6e9f5128d3176e7d780f6b06bbb56f0 ("xfs: defer inode inactivation to a workqueue")
https://git.kernel.org/cgit/linux/kernel/git/djwong/xfs-linux.git vectorized-scrub


in testcase: stress-ng
on test machine: 48 threads 2 sockets Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz with 112G memory
with following parameters:

nr_threads: 10%
disk: 1HDD
testtime: 60s
fs: xfs
class: filesystem
test: dentry
cpufreq_governor: performance
ucode: 0x42e


In addition to that, the commit also has significant impact on the following tests:

+------------------+---------------------------------------------------------------------------------+
| testcase: change | stress-ng: stress-ng.chattr.ops_per_sec 413.4% improvement |
| test machine | 48 threads 2 sockets Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz with 112G memory |
| test parameters | class=filesystem |
| | cpufreq_governor=performance |
| | disk=1HDD |
| | fs=xfs |
| | nr_threads=10% |
| | test=chattr |
| | testtime=60s |
| | ucode=0x42e |
+------------------+---------------------------------------------------------------------------------+
| testcase: change | stress-ng: stress-ng.dnotify.ops_per_sec -72.5% regression |
| test machine | 48 threads 2 sockets Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz with 112G memory |
| test parameters | class=filesystem |
| | cpufreq_governor=performance |
| | disk=1HDD |
| | fs=xfs |
| | nr_threads=10% |
| | test=dnotify |
| | testtime=60s |
| | ucode=0x42e |
+------------------+---------------------------------------------------------------------------------+
| testcase: change | stress-ng: stress-ng.dir.ops_per_sec -29.1% regression |
| test machine | 48 threads 2 sockets Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz with 112G memory |
| test parameters | class=filesystem |
| | cpufreq_governor=performance |
| | disk=1HDD |
| | fs=xfs |
| | nr_threads=10% |
| | test=dir |
| | testtime=60s |
| | ucode=0x42e |
+------------------+---------------------------------------------------------------------------------+


If you fix the issue, kindly add following tag
Reported-by: kernel test robot <[email protected]>


Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run
bin/lkp run generated-yaml-file

=========================================================================================
class/compiler/cpufreq_governor/disk/fs/kconfig/nr_threads/rootfs/tbox_group/test/testcase/testtime/ucode:
filesystem/gcc-9/performance/1HDD/xfs/x86_64-rhel-8.3/10%/debian-10.4-x86_64-20200603.cgz/lkp-ivb-2ep1/dentry/stress-ng/60s/0x42e

commit:
ae8eb51386 ("xfs: separate primary inode selection criteria in xfs_iget_cache_hit")
752d5513e6 ("xfs: defer inode inactivation to a workqueue")

ae8eb51386366771 752d5513e6e9f5128d3176e7d78
---------------- ---------------------------
%stddev %change %stddev
\ | \
1443226 -24.7% 1087366 ? 2% stress-ng.dentry.ops
23873 -26.1% 17630 ? 2% stress-ng.dentry.ops_per_sec
6279 ? 4% -52.7% 2969 ? 12% stress-ng.time.involuntary_context_switches
182.50 -26.6% 134.00 ? 5% stress-ng.time.percent_of_cpu_this_job_got
101.44 -23.9% 77.22 ? 6% stress-ng.time.system_time
2845 ? 2% +9422.7% 270984 ? 8% stress-ng.time.voluntary_context_switches
0.00 ? 49% +0.3 0.28 ? 19% mpstat.cpu.all.iowait%
0.64 ? 3% -0.1 0.50 ? 6% mpstat.cpu.all.usr%
12270 ? 48% -55.0% 5520 ? 29% softirqs.CPU10.RCU
336454 ? 14% -23.2% 258444 ? 13% softirqs.RCU
43228 ? 23% +1266.3% 590625 ? 6% turbostat.C1
0.07 ? 16% +0.3 0.34 ? 10% turbostat.C1%
2424846 ? 6% +344.0% 10765180 ? 10% cpuidle.C1.time
56275 ? 6% +959.5% 596260 ? 7% cpuidle.C1.usage
2196 ? 18% +281.5% 8380 ? 18% cpuidle.POLL.usage
0.46 ? 13% +54.4% 0.72 ? 28% perf-sched.total_wait_and_delay.average.ms
0.42 ? 11% +64.3% 0.69 ? 30% perf-sched.total_wait_time.average.ms
1.79 ?102% +492.3% 10.61 ? 82% perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
1.79 ?102% +492.3% 10.61 ? 82% perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
11365 ? 3% +47.7% 16787 vmstat.io.bo
1290368 +24.7% 1609253 ? 2% vmstat.memory.cache
2482 ? 2% +686.7% 19529 ? 8% vmstat.system.cs
95877 +0.9% 96697 vmstat.system.in
217992 +144.6% 533199 ? 8% meminfo.KReclaimable
2269047 +29.7% 2942056 ? 2% meminfo.Memused
217992 +144.6% 533199 ? 8% meminfo.SReclaimable
115859 ? 4% +193.4% 339987 ? 6% meminfo.SUnreclaim
333852 ? 2% +161.5% 873187 ? 7% meminfo.Slab
2286823 +30.2% 2978379 ? 2% meminfo.max_used_kB
54557 +144.4% 133335 ? 8% proc-vmstat.nr_slab_reclaimable
28961 ? 4% +193.4% 84985 ? 6% proc-vmstat.nr_slab_unreclaimable
8.83 ?135% +32252.8% 2857 ? 93% proc-vmstat.numa_hint_faults
5.67 ?129% +45432.4% 2580 ? 96% proc-vmstat.numa_hint_faults_local
545645 +6.5% 581207 proc-vmstat.numa_hit
501967 +7.1% 537522 proc-vmstat.numa_local
2.83 ?223% +9670.6% 276.83 ?194% proc-vmstat.numa_pages_migrated
1713 ?197% +935.2% 17736 ? 51% proc-vmstat.numa_pte_updates
662756 +70.1% 1127661 proc-vmstat.pgalloc_normal
221293 +2.8% 227500 proc-vmstat.pgfault
567188 ? 6% +37.9% 782168 ? 3% proc-vmstat.pgfree
2.83 ?223% +9670.6% 276.83 ?194% proc-vmstat.pgmigrate_success
753556 ? 3% +47.6% 1112216 proc-vmstat.pgpgout
43966 ? 12% +78.0% 78263 ? 11% interrupts.CAL:Function_call_interrupts
188.17 ? 12% +99.5% 375.33 ? 67% interrupts.CPU15.NMI:Non-maskable_interrupts
188.17 ? 12% +99.5% 375.33 ? 67% interrupts.CPU15.PMI:Performance_monitoring_interrupts
190.33 ? 18% +266.6% 697.83 ? 80% interrupts.CPU18.NMI:Non-maskable_interrupts
190.33 ? 18% +266.6% 697.83 ? 80% interrupts.CPU18.PMI:Performance_monitoring_interrupts
803.67 ? 2% +68.5% 1354 ? 42% interrupts.CPU2.CAL:Function_call_interrupts
168.50 ? 12% +122.6% 375.00 ? 38% interrupts.CPU20.NMI:Non-maskable_interrupts
168.50 ? 12% +122.6% 375.00 ? 38% interrupts.CPU20.PMI:Performance_monitoring_interrupts
792.00 +47.7% 1169 ? 20% interrupts.CPU25.CAL:Function_call_interrupts
239.33 ? 31% +147.7% 592.83 ? 77% interrupts.CPU32.NMI:Non-maskable_interrupts
239.33 ? 31% +147.7% 592.83 ? 77% interrupts.CPU32.PMI:Performance_monitoring_interrupts
811.50 ? 3% +140.5% 1951 ? 70% interrupts.CPU33.CAL:Function_call_interrupts
795.00 ? 2% +194.9% 2344 ?124% interrupts.CPU4.CAL:Function_call_interrupts
778.00 ? 4% +225.1% 2529 ? 82% interrupts.CPU7.CAL:Function_call_interrupts
571.83 ? 15% +489.2% 3369 ? 15% interrupts.RES:Rescheduling_interrupts
11.14 ? 12% +185.2% 31.77 ? 10% perf-stat.i.MPKI
1.406e+09 ? 3% -25.8% 1.044e+09 ? 3% perf-stat.i.branch-instructions
2.27 ? 5% +3.6 5.88 ? 7% perf-stat.i.branch-miss-rate%
32230030 ? 3% -15.4% 27274261 ? 7% perf-stat.i.branch-misses
13.19 ? 13% +5.9 19.09 ? 7% perf-stat.i.cache-miss-rate%
2380 ? 2% +746.4% 20150 ? 8% perf-stat.i.context-switches
1.43 ? 6% +175.5% 3.93 ? 5% perf-stat.i.cpi
1033 ? 18% -29.1% 732.43 ? 13% perf-stat.i.cycles-between-cache-misses
34965733 ? 3% -19.5% 28145504 ? 2% perf-stat.i.dTLB-load-misses
1.871e+09 -26.1% 1.384e+09 ? 4% perf-stat.i.dTLB-loads
0.12 ? 9% +0.0 0.16 ? 5% perf-stat.i.dTLB-store-miss-rate%
1.233e+09 ? 3% -20.9% 9.756e+08 ? 5% perf-stat.i.dTLB-stores
48.62 ? 7% +9.0 57.62 ? 3% perf-stat.i.iTLB-load-miss-rate%
7.226e+09 ? 3% -26.4% 5.318e+09 ? 3% perf-stat.i.instructions
4253 ? 13% -29.9% 2981 ? 4% perf-stat.i.instructions-per-iTLB-miss
0.71 ? 5% -35.6% 0.46 ? 4% perf-stat.i.ipc
134.63 ? 18% +222.4% 434.05 ? 13% perf-stat.i.metric.K/sec
95.58 -24.3% 72.32 ? 4% perf-stat.i.metric.M/sec
302514 ?126% +259.2% 1086769 ? 57% perf-stat.i.node-load-misses
770854 ? 41% +179.1% 2151403 ? 25% perf-stat.i.node-loads
812280 ? 19% +87.1% 1520019 ? 20% perf-stat.i.node-stores
10.96 ? 11% +37.2% 15.05 ? 5% perf-stat.overall.MPKI
2.29 ? 4% +0.3 2.61 ? 7% perf-stat.overall.branch-miss-rate%
1.41 ? 5% +26.6% 1.78 ? 5% perf-stat.overall.cpi
1030 ? 18% -27.2% 750.20 ? 13% perf-stat.overall.cycles-between-cache-misses
1.83 ? 3% +0.2 2.00 ? 3% perf-stat.overall.dTLB-load-miss-rate%
0.12 ? 9% +0.0 0.14 ? 7% perf-stat.overall.dTLB-store-miss-rate%
0.71 ? 5% -21.1% 0.56 ? 5% perf-stat.overall.ipc
1.384e+09 ? 3% -25.6% 1.029e+09 ? 3% perf-stat.ps.branch-instructions
31703659 ? 3% -15.3% 26857528 ? 7% perf-stat.ps.branch-misses
2342 ? 2% +747.6% 19852 ? 8% perf-stat.ps.context-switches
34418379 ? 3% -19.4% 27751346 ? 2% perf-stat.ps.dTLB-load-misses
1.842e+09 -25.9% 1.364e+09 ? 4% perf-stat.ps.dTLB-loads
1.214e+09 ? 3% -20.8% 9.615e+08 ? 5% perf-stat.ps.dTLB-stores
7.111e+09 ? 3% -26.3% 5.243e+09 ? 3% perf-stat.ps.instructions
297721 ?126% +259.7% 1070841 ? 57% perf-stat.ps.node-load-misses
758624 ? 41% +179.3% 2119119 ? 25% perf-stat.ps.node-loads
798769 ? 19% +87.5% 1497519 ? 20% perf-stat.ps.node-stores
4.541e+11 ? 2% -24.8% 3.415e+11 ? 3% perf-stat.total.instructions
1498 ? 27% +47.5% 2208 ? 13% slabinfo.Acpi-Parse.active_objs
1498 ? 27% +47.5% 2208 ? 13% slabinfo.Acpi-Parse.num_objs
399.50 ? 29% +121.4% 884.67 ? 14% slabinfo.bfq_io_cq.active_objs
399.50 ? 29% +121.4% 884.67 ? 14% slabinfo.bfq_io_cq.num_objs
762006 -14.5% 651709 slabinfo.dentry.active_objs
18145 -14.5% 15519 slabinfo.dentry.active_slabs
762146 -14.5% 651830 slabinfo.dentry.num_objs
18145 -14.5% 15519 slabinfo.dentry.num_slabs
1306 ? 10% +57.7% 2059 ? 16% slabinfo.dmaengine-unmap-16.active_objs
1306 ? 10% +59.6% 2085 ? 16% slabinfo.dmaengine-unmap-16.num_objs
979.33 ? 15% +22.3% 1197 ? 11% slabinfo.file_lock_cache.active_objs
979.33 ? 15% +22.3% 1197 ? 11% slabinfo.file_lock_cache.num_objs
733.17 ? 35% +65.5% 1213 ? 11% slabinfo.ip6-frags.active_objs
733.17 ? 35% +65.5% 1213 ? 11% slabinfo.ip6-frags.num_objs
18981 +1462.1% 296503 ? 11% slabinfo.kmalloc-16.active_objs
74.17 +1464.9% 1160 ? 11% slabinfo.kmalloc-16.active_slabs
18986 +1465.8% 297289 ? 11% slabinfo.kmalloc-16.num_objs
74.17 +1464.9% 1160 ? 11% slabinfo.kmalloc-16.num_slabs
3579 ? 2% +69.6% 6068 ? 5% slabinfo.kmalloc-1k.active_objs
3682 +65.8% 6106 ? 5% slabinfo.kmalloc-1k.num_objs
55221 +21.2% 66933 ? 2% slabinfo.kmalloc-32.active_objs
55411 +21.5% 67351 ? 2% slabinfo.kmalloc-32.num_objs
1453 ? 5% +29.5% 1882 ? 2% slabinfo.kmalloc-4k.active_objs
1475 ? 6% +32.6% 1956 ? 2% slabinfo.kmalloc-4k.num_objs
25533 ? 4% +1058.0% 295666 ? 12% slabinfo.kmalloc-512.active_objs
952.83 ? 4% +876.7% 9306 ? 12% slabinfo.kmalloc-512.active_slabs
30507 ? 4% +876.2% 297822 ? 12% slabinfo.kmalloc-512.num_objs
952.83 ? 4% +876.7% 9306 ? 12% slabinfo.kmalloc-512.num_slabs
656.50 ? 7% +1113.4% 7966 ? 2% slabinfo.kmalloc-8k.active_objs
169.33 ? 7% +1232.0% 2255 ? 2% slabinfo.kmalloc-8k.active_slabs
678.83 ? 7% +1229.3% 9023 ? 2% slabinfo.kmalloc-8k.num_objs
169.33 ? 7% +1232.0% 2255 ? 2% slabinfo.kmalloc-8k.num_slabs
19104 +30.4% 24908 ? 5% slabinfo.kmalloc-rcl-512.active_objs
598.17 +31.7% 787.83 ? 4% slabinfo.kmalloc-rcl-512.active_slabs
19153 +31.7% 25222 ? 4% slabinfo.kmalloc-rcl-512.num_objs
598.17 +31.7% 787.83 ? 4% slabinfo.kmalloc-rcl-512.num_slabs
2078 ? 77% +208.8% 6416 slabinfo.numa_policy.active_objs
67.50 ? 77% +249.4% 235.83 slabinfo.numa_policy.active_slabs
2108 ? 76% +247.4% 7324 slabinfo.numa_policy.num_objs
67.50 ? 77% +249.4% 235.83 slabinfo.numa_policy.num_slabs
1280 ? 12% +17.8% 1508 ? 7% slabinfo.pool_workqueue.active_objs
1346 ? 12% +20.9% 1627 ? 6% slabinfo.pool_workqueue.num_objs
13414 +33.8% 17947 ? 4% slabinfo.radix_tree_node.active_objs
479.17 +34.6% 645.00 ? 3% slabinfo.radix_tree_node.active_slabs
13424 +34.6% 18074 ? 3% slabinfo.radix_tree_node.num_objs
479.17 +34.6% 645.00 ? 3% slabinfo.radix_tree_node.num_slabs
491.50 ? 28% +94.0% 953.33 ? 13% slabinfo.xfs_btree_cur.active_objs
491.50 ? 28% +94.0% 953.33 ? 13% slabinfo.xfs_btree_cur.num_objs
2465 ? 82% +331.2% 10631 ? 10% slabinfo.xfs_buf.active_objs
59.33 ? 82% +350.0% 267.00 ? 9% slabinfo.xfs_buf.active_slabs
2511 ? 81% +347.3% 11231 ? 9% slabinfo.xfs_buf.num_objs
59.33 ? 82% +350.0% 267.00 ? 9% slabinfo.xfs_buf.num_slabs
390.50 ? 29% +93.8% 756.83 ? 13% slabinfo.xfs_da_state.active_objs
390.50 ? 29% +93.8% 756.83 ? 13% slabinfo.xfs_da_state.num_objs
890.83 ? 7% +328.6% 3818 ? 19% slabinfo.xfs_icr.active_objs
890.83 ? 7% +334.5% 3870 ? 19% slabinfo.xfs_icr.num_objs
9665 +2975.4% 297261 ? 12% slabinfo.xfs_ili.active_objs
231.17 +2974.6% 7107 ? 12% slabinfo.xfs_ili.active_slabs
9718 +2971.8% 298530 ? 12% slabinfo.xfs_ili.num_objs
231.17 +2974.6% 7107 ? 12% slabinfo.xfs_ili.num_slabs
9482 +3033.0% 297095 ? 12% slabinfo.xfs_inode.active_objs
279.67 +3035.2% 8768 ? 12% slabinfo.xfs_inode.active_slabs
9523 +3030.7% 298140 ? 12% slabinfo.xfs_inode.num_objs
279.67 +3035.2% 8768 ? 12% slabinfo.xfs_inode.num_slabs
36.39 ? 10% -9.0 27.40 ? 11% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
36.30 ? 10% -9.0 27.32 ? 11% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
6.47 ? 12% -6.5 0.00 perf-profile.calltrace.cycles-pp.destroy_inode.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
6.39 ? 12% -6.4 0.00 perf-profile.calltrace.cycles-pp.xfs_inode_mark_reclaimable.destroy_inode.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
6.26 ? 12% -6.3 0.00 perf-profile.calltrace.cycles-pp.xfs_inactive.xfs_inode_mark_reclaimable.destroy_inode.do_unlinkat.do_syscall_64
6.23 ? 12% -6.2 0.00 perf-profile.calltrace.cycles-pp.xfs_inactive_ifree.xfs_inactive.xfs_inode_mark_reclaimable.destroy_inode.do_unlinkat
12.36 ? 10% -6.0 6.38 ? 10% perf-profile.calltrace.cycles-pp.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
5.01 ? 12% -5.0 0.00 perf-profile.calltrace.cycles-pp.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_inode_mark_reclaimable.destroy_inode
11.23 ? 10% -2.4 8.79 ? 11% perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
11.22 ? 10% -2.4 8.78 ? 11% perf-profile.calltrace.cycles-pp.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
11.01 ? 11% -2.4 8.60 ? 11% perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
10.98 ? 11% -2.4 8.58 ? 11% perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64
2.67 ? 9% -2.4 0.28 ?101% perf-profile.calltrace.cycles-pp.xfs_check_agi_freecount.xfs_dialloc_ag.xfs_dir_ialloc.xfs_create.xfs_generic_create
9.71 ? 11% -2.1 7.57 ? 11% perf-profile.calltrace.cycles-pp.xfs_generic_create.path_openat.do_filp_open.do_sys_openat2.do_sys_open
9.49 ? 11% -2.1 7.36 ? 11% perf-profile.calltrace.cycles-pp.xfs_create.xfs_generic_create.path_openat.do_filp_open.do_sys_openat2
3.46 ? 9% -2.0 1.48 ? 14% perf-profile.calltrace.cycles-pp.xfs_dialloc_ag.xfs_dir_ialloc.xfs_create.xfs_generic_create.path_openat
4.90 ? 9% -1.7 3.20 ? 12% perf-profile.calltrace.cycles-pp.xfs_dir_ialloc.xfs_create.xfs_generic_create.path_openat.do_filp_open
2.41 ? 7% -0.5 1.91 ? 9% perf-profile.calltrace.cycles-pp.xfs_dir_removename.xfs_remove.xfs_vn_unlink.vfs_unlink.do_unlinkat
1.91 ? 7% -0.4 1.54 ? 10% perf-profile.calltrace.cycles-pp.xfs_dir2_node_removename.xfs_dir_removename.xfs_remove.xfs_vn_unlink.vfs_unlink
0.68 ? 3% -0.3 0.38 ? 72% perf-profile.calltrace.cycles-pp.xfs_dir2_leafn_lookup_for_entry.xfs_da3_node_lookup_int.xfs_dir2_node_removename.xfs_dir_removename.xfs_remove
1.09 ? 6% -0.3 0.82 ? 9% perf-profile.calltrace.cycles-pp.xfs_da3_node_lookup_int.xfs_dir2_node_removename.xfs_dir_removename.xfs_remove.xfs_vn_unlink
0.00 +0.7 0.68 ? 26% perf-profile.calltrace.cycles-pp.xfs_iunlink_remove.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag
0.00 +0.7 0.72 ? 26% perf-profile.calltrace.cycles-pp.xfs_difree.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag
0.00 +0.7 0.74 ? 15% perf-profile.calltrace.cycles-pp.xfs_iunlink.xfs_remove.xfs_vn_unlink.vfs_unlink.do_unlinkat
0.38 ? 71% +0.8 1.17 ? 31% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__percpu_counter_sum.xfs_fs_statfs.statfs_by_dentry.vfs_statfs
0.00 +1.2 1.20 ? 28% perf-profile.calltrace.cycles-pp.xfs_log_commit_cil.__xfs_trans_commit.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag
0.00 +1.3 1.27 ? 29% perf-profile.calltrace.cycles-pp.__xfs_trans_commit.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag.xfs_icwalk
0.00 +1.5 1.53 ? 26% perf-profile.calltrace.cycles-pp.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag.xfs_icwalk
0.00 +3.0 2.98 ? 27% perf-profile.calltrace.cycles-pp.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag.xfs_icwalk.xfs_inodegc_worker
0.00 +3.0 3.03 ? 27% perf-profile.calltrace.cycles-pp.xfs_inactive.xfs_icwalk_ag.xfs_icwalk.xfs_inodegc_worker.process_one_work
0.00 +3.1 3.12 ? 27% perf-profile.calltrace.cycles-pp.xfs_icwalk.xfs_inodegc_worker.process_one_work.worker_thread.kthread
0.00 +3.1 3.12 ? 27% perf-profile.calltrace.cycles-pp.xfs_icwalk_ag.xfs_icwalk.xfs_inodegc_worker.process_one_work.worker_thread
0.00 +3.1 3.12 ? 27% perf-profile.calltrace.cycles-pp.xfs_inodegc_worker.process_one_work.worker_thread.kthread.ret_from_fork
1.23 ? 28% +3.8 5.06 ? 15% perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
1.20 ? 28% +3.8 5.04 ? 16% perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
1.34 ? 27% +4.3 5.64 ? 13% perf-profile.calltrace.cycles-pp.ret_from_fork
1.34 ? 27% +4.3 5.64 ? 13% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
36.70 ? 10% -9.0 27.68 ? 11% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
36.61 ? 10% -9.0 27.61 ? 11% perf-profile.children.cycles-pp.do_syscall_64
6.47 ? 12% -6.3 0.16 ? 25% perf-profile.children.cycles-pp.destroy_inode
6.39 ? 12% -6.3 0.09 ? 22% perf-profile.children.cycles-pp.xfs_inode_mark_reclaimable
12.36 ? 10% -6.0 6.39 ? 11% perf-profile.children.cycles-pp.do_unlinkat
6.42 ? 11% -5.8 0.62 ? 13% perf-profile.children.cycles-pp.xfs_check_agi_freecount
4.51 ? 13% -3.8 0.72 ? 26% perf-profile.children.cycles-pp.xfs_difree
5.01 ? 12% -3.5 1.53 ? 26% perf-profile.children.cycles-pp.xfs_ifree
6.23 ? 12% -3.3 2.98 ? 27% perf-profile.children.cycles-pp.xfs_inactive_ifree
6.26 ? 12% -3.2 3.03 ? 27% perf-profile.children.cycles-pp.xfs_inactive
3.41 ? 13% -3.0 0.44 ? 30% perf-profile.children.cycles-pp.xfs_difree_inobt
3.24 ? 11% -3.0 0.28 ? 15% perf-profile.children.cycles-pp.xfs_inobt_get_rec
2.85 ? 13% -2.6 0.27 ? 15% perf-profile.children.cycles-pp.xfs_btree_check_sblock
11.26 ? 10% -2.4 8.81 ? 11% perf-profile.children.cycles-pp.do_sys_open
11.24 ? 10% -2.4 8.80 ? 11% perf-profile.children.cycles-pp.do_sys_openat2
11.04 ? 11% -2.4 8.62 ? 11% perf-profile.children.cycles-pp.do_filp_open
11.02 ? 10% -2.4 8.60 ? 11% perf-profile.children.cycles-pp.path_openat
9.72 ? 11% -2.2 7.57 ? 11% perf-profile.children.cycles-pp.xfs_generic_create
9.50 ? 11% -2.1 7.37 ? 11% perf-profile.children.cycles-pp.xfs_create
2.18 ? 12% -2.0 0.14 ? 32% perf-profile.children.cycles-pp.xfs_btree_increment
3.46 ? 9% -2.0 1.48 ? 14% perf-profile.children.cycles-pp.xfs_dialloc_ag
2.03 ? 13% -1.8 0.21 ? 20% perf-profile.children.cycles-pp.xfs_btree_get_rec
1.90 ? 13% -1.7 0.17 ? 15% perf-profile.children.cycles-pp.__xfs_btree_check_sblock
4.90 ? 9% -1.7 3.20 ? 12% perf-profile.children.cycles-pp.xfs_dir_ialloc
0.92 ? 18% -0.8 0.08 ? 13% perf-profile.children.cycles-pp.xfs_inobt_get_maxrecs
1.06 ? 11% -0.8 0.25 ? 31% perf-profile.children.cycles-pp.xfs_difree_finobt
2.41 ? 7% -0.5 1.91 ? 9% perf-profile.children.cycles-pp.xfs_dir_removename
0.64 ? 16% -0.5 0.18 ? 15% perf-profile.children.cycles-pp.xfs_errortag_test
1.56 ? 11% -0.4 1.16 ? 11% perf-profile.children.cycles-pp.xfs_btree_lookup
1.91 ? 7% -0.4 1.54 ? 10% perf-profile.children.cycles-pp.xfs_dir2_node_removename
1.01 ? 12% -0.3 0.71 ? 19% perf-profile.children.cycles-pp.xfs_inode_item_format
0.30 ? 30% -0.3 0.03 ?100% perf-profile.children.cycles-pp.xfs_btree_rec_offset
1.14 ? 7% -0.2 0.94 ? 12% perf-profile.children.cycles-pp.xfs_dir3_data_check
1.13 ? 6% -0.2 0.93 ? 11% perf-profile.children.cycles-pp.__xfs_dir3_data_check
0.32 ? 15% -0.2 0.15 ? 13% perf-profile.children.cycles-pp.xfs_next_bit
0.68 ? 12% -0.2 0.52 ? 13% perf-profile.children.cycles-pp.syscall_return_via_sysret
0.72 ? 2% -0.2 0.56 ? 14% perf-profile.children.cycles-pp.xfs_dir2_leafn_lookup_for_entry
0.49 ? 10% -0.2 0.34 ? 11% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax
0.46 ? 11% -0.2 0.31 ? 17% perf-profile.children.cycles-pp.xfs_inode_item_format_data_fork
0.36 ? 10% -0.1 0.22 ? 13% perf-profile.children.cycles-pp.xfs_inobt_update
0.34 ? 12% -0.1 0.20 ? 14% perf-profile.children.cycles-pp.xfs_btree_update
0.42 ? 10% -0.1 0.29 ? 17% perf-profile.children.cycles-pp.xfs_iextents_copy
0.24 ? 14% -0.1 0.13 ? 18% perf-profile.children.cycles-pp.xfs_lookup_get_search_key
0.18 ? 14% -0.1 0.08 ? 25% perf-profile.children.cycles-pp.xfs_inobt_key_diff
0.11 ? 18% -0.1 0.03 ?101% perf-profile.children.cycles-pp.xfs_ilock
0.24 ? 9% -0.1 0.16 ? 13% perf-profile.children.cycles-pp.xfs_bmap_last_offset
0.21 ? 17% -0.1 0.14 ? 23% perf-profile.children.cycles-pp.xfs_iext_lookup_extent
0.17 ? 12% -0.1 0.10 ? 14% perf-profile.children.cycles-pp.xfs_inobt_init_cursor
0.16 ? 11% -0.1 0.10 ? 9% perf-profile.children.cycles-pp.xfs_inobt_init_common
0.12 ? 20% -0.1 0.06 ? 45% perf-profile.children.cycles-pp.xfs_dir2_data_entry_tag_p
0.19 ? 11% -0.1 0.13 ? 18% perf-profile.children.cycles-pp.xfs_bmap_last_extent
0.13 ? 13% -0.1 0.07 ? 18% perf-profile.children.cycles-pp.xfs_inobt_init_key_from_rec
0.19 ? 9% -0.1 0.13 ? 15% perf-profile.children.cycles-pp.xfs_dir2_isblock
0.15 ? 24% -0.1 0.10 ? 17% perf-profile.children.cycles-pp.xfs_btree_ptr_to_daddr
0.15 ? 8% -0.0 0.10 ? 14% perf-profile.children.cycles-pp.xfs_bmap_validate_extent
0.11 ? 18% -0.0 0.06 ? 50% perf-profile.children.cycles-pp.xfs_iext_get_extent
0.08 ? 14% -0.0 0.05 ? 7% perf-profile.children.cycles-pp.xfs_bmapi_update_map
0.09 ? 11% -0.0 0.07 ? 14% perf-profile.children.cycles-pp.xfs_verify_fsbext
0.08 ? 28% +0.0 0.12 ? 19% perf-profile.children.cycles-pp.xfs_bmapi_write
0.08 ? 32% +0.0 0.13 ? 16% perf-profile.children.cycles-pp.xfs_da_grow_inode_int
0.07 ? 53% +0.0 0.12 ? 18% perf-profile.children.cycles-pp.xfs_bmapi_allocate
0.08 ? 18% +0.1 0.13 ? 22% perf-profile.children.cycles-pp.rcu_do_batch
0.02 ?146% +0.1 0.08 ? 23% perf-profile.children.cycles-pp.pick_next_task_fair
0.02 ? 99% +0.1 0.08 ? 17% perf-profile.children.cycles-pp.xfs_btree_del_cursor
0.05 ? 46% +0.1 0.11 ? 20% perf-profile.children.cycles-pp.smpboot_thread_fn
0.00 +0.1 0.06 ? 17% perf-profile.children.cycles-pp.xfs_inode_item_init
0.00 +0.1 0.07 ? 21% perf-profile.children.cycles-pp.xfs_alloc_cur_check
0.07 ? 57% +0.1 0.14 ? 16% perf-profile.children.cycles-pp.xfs_inode_item_committed
0.09 ? 20% +0.1 0.16 ? 15% perf-profile.children.cycles-pp.__intel_pmu_disable_all
0.10 ? 15% +0.1 0.18 ? 18% perf-profile.children.cycles-pp.intel_pmu_disable_all
0.08 ? 35% +0.1 0.16 ? 14% perf-profile.children.cycles-pp.xfs_alloc_ag_vextent_near
0.13 ? 26% +0.1 0.21 ? 9% perf-profile.children.cycles-pp.xfs_alloc_vextent
0.00 +0.1 0.08 ? 20% perf-profile.children.cycles-pp.xfs_alloc_walk_iter
0.31 ? 10% +0.1 0.40 ? 12% perf-profile.children.cycles-pp.__legitimize_path
0.01 ?223% +0.1 0.10 ? 25% perf-profile.children.cycles-pp.run_ksoftirqd
0.23 ? 16% +0.1 0.32 ? 17% perf-profile.children.cycles-pp.xfs_ialloc_read_agi
0.00 +0.1 0.09 ? 26% perf-profile.children.cycles-pp.__perf_event_task_sched_out
0.20 ? 8% +0.1 0.29 ? 13% perf-profile.children.cycles-pp.lockref_get_not_dead
0.00 +0.1 0.10 ? 29% perf-profile.children.cycles-pp.dequeue_entity
0.00 +0.1 0.10 ? 30% perf-profile.children.cycles-pp.xfs_iunlink_map_prev
0.00 +0.1 0.10 ? 25% perf-profile.children.cycles-pp.xfs_buf_ioend
0.13 ? 17% +0.1 0.24 ? 6% perf-profile.children.cycles-pp.kmem_alloc_large
0.00 +0.1 0.11 ? 20% perf-profile.children.cycles-pp.__perf_pmu_sched_task
0.00 +0.1 0.11 ? 15% perf-profile.children.cycles-pp.xfs_iunlink_insert_backref
0.00 +0.1 0.12 ? 39% perf-profile.children.cycles-pp.xfs_reclaim_worker
0.00 +0.1 0.12 ? 30% perf-profile.children.cycles-pp.dequeue_task_fair
0.32 ? 14% +0.1 0.44 ? 14% perf-profile.children.cycles-pp.__kmalloc
0.16 ? 20% +0.1 0.28 ? 23% perf-profile.children.cycles-pp.__list_del_entry_valid
0.22 ? 15% +0.1 0.34 ? 15% perf-profile.children.cycles-pp.xfs_imap_to_bp
0.26 ? 19% +0.1 0.39 ? 11% perf-profile.children.cycles-pp.kmem_alloc
0.00 +0.1 0.13 ? 25% perf-profile.children.cycles-pp.perf_pmu_sched_task
0.00 +0.1 0.14 ? 26% perf-profile.children.cycles-pp.rhashtable_rehash_table
0.00 +0.1 0.14 ? 25% perf-profile.children.cycles-pp.xfs_fs_inode_init_once
0.00 +0.1 0.15 ? 26% perf-profile.children.cycles-pp.rht_deferred_worker
0.00 +0.2 0.16 ? 31% perf-profile.children.cycles-pp.finish_task_switch
0.07 ? 18% +0.2 0.23 ? 21% perf-profile.children.cycles-pp.xfs_contig_bits
0.15 ? 16% +0.2 0.32 ? 21% perf-profile.children.cycles-pp.up
0.19 ? 15% +0.2 0.37 ? 17% perf-profile.children.cycles-pp.xfs_buf_unlock
0.00 +0.2 0.18 ? 25% perf-profile.children.cycles-pp.xfs_iflush
0.00 +0.2 0.20 ? 12% perf-profile.children.cycles-pp.xfs_iunlink_update_dinode
0.03 ?103% +0.2 0.24 ? 24% perf-profile.children.cycles-pp.crc32c_pcl_intel_update
0.04 ?102% +0.2 0.25 ? 30% perf-profile.children.cycles-pp.try_to_wake_up
0.04 ? 75% +0.2 0.27 ? 25% perf-profile.children.cycles-pp.crc32c
0.02 ?141% +0.2 0.26 ? 24% perf-profile.children.cycles-pp.xfs_dinode_calc_crc
0.03 ?102% +0.2 0.28 ? 29% perf-profile.children.cycles-pp.schedule_idle
0.18 ? 24% +0.2 0.42 ? 13% perf-profile.children.cycles-pp.xfs_iunlink_update_inode
0.19 ? 13% +0.3 0.45 ? 17% perf-profile.children.cycles-pp.xfs_dialloc_ag_update_inobt
0.11 ? 13% +0.3 0.40 ? 14% perf-profile.children.cycles-pp.allocate_slab
0.00 +0.3 0.29 ? 24% perf-profile.children.cycles-pp.xfs_inode_alloc
0.56 ? 10% +0.3 0.86 ? 16% perf-profile.children.cycles-pp.xfs_read_agi
0.00 +0.3 0.30 ? 23% perf-profile.children.cycles-pp.schedule_timeout
0.08 ? 32% +0.3 0.38 ? 22% perf-profile.children.cycles-pp.schedule
0.62 ? 13% +0.3 0.92 ? 12% perf-profile.children.cycles-pp.memcpy_erms
0.38 ? 17% +0.3 0.68 ? 26% perf-profile.children.cycles-pp.xfs_iunlink_remove
0.14 ? 14% +0.3 0.45 ? 12% perf-profile.children.cycles-pp.__slab_alloc
0.14 ? 13% +0.3 0.44 ? 12% perf-profile.children.cycles-pp.___slab_alloc
0.00 +0.3 0.31 ? 23% perf-profile.children.cycles-pp.__down
0.00 +0.3 0.31 ? 24% perf-profile.children.cycles-pp.down
0.00 +0.3 0.32 ? 24% perf-profile.children.cycles-pp.xfs_buf_lock
0.00 +0.3 0.32 ? 30% perf-profile.children.cycles-pp.xfs_iflush_cluster
0.00 +0.3 0.34 ? 31% perf-profile.children.cycles-pp.xfs_inode_item_push
0.00 +0.4 0.40 ? 26% perf-profile.children.cycles-pp.xfsaild
0.00 +0.4 0.40 ? 26% perf-profile.children.cycles-pp.xfsaild_push
0.18 ? 24% +0.4 0.61 ? 38% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
0.13 ? 23% +0.5 0.64 ? 24% perf-profile.children.cycles-pp.__schedule
0.23 ? 18% +0.5 0.74 ? 15% perf-profile.children.cycles-pp.xfs_iunlink
0.77 ? 12% +0.5 1.31 ? 11% perf-profile.children.cycles-pp.xfs_buf_item_format_segment
0.88 ? 12% +0.6 1.43 ? 9% perf-profile.children.cycles-pp.xfs_buf_item_format
0.99 ? 8% +0.7 1.66 ? 22% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
0.00 +3.1 3.12 ? 27% perf-profile.children.cycles-pp.xfs_inodegc_worker
0.00 +3.2 3.24 ? 26% perf-profile.children.cycles-pp.xfs_icwalk
0.00 +3.2 3.24 ? 26% perf-profile.children.cycles-pp.xfs_icwalk_ag
1.23 ? 28% +3.8 5.06 ? 15% perf-profile.children.cycles-pp.worker_thread
1.20 ? 28% +3.8 5.04 ? 16% perf-profile.children.cycles-pp.process_one_work
1.34 ? 27% +4.3 5.64 ? 13% perf-profile.children.cycles-pp.kthread
1.35 ? 27% +4.3 5.64 ? 13% perf-profile.children.cycles-pp.ret_from_fork
0.92 ? 11% -0.8 0.08 ? 46% perf-profile.self.cycles-pp.__xfs_btree_check_sblock
0.82 ? 13% -0.8 0.06 ? 45% perf-profile.self.cycles-pp.xfs_inobt_get_maxrecs
0.50 ? 13% -0.3 0.16 ? 14% perf-profile.self.cycles-pp.xfs_errortag_test
0.24 ? 15% -0.2 0.03 ?100% perf-profile.self.cycles-pp.xfs_btree_rec_offset
0.30 ? 14% -0.2 0.14 ? 16% perf-profile.self.cycles-pp.xfs_next_bit
0.67 ? 12% -0.2 0.52 ? 14% perf-profile.self.cycles-pp.syscall_return_via_sysret
0.36 ? 18% -0.2 0.21 ? 23% perf-profile.self.cycles-pp.xfs_btree_lookup
0.71 ? 10% -0.1 0.58 ? 13% perf-profile.self.cycles-pp.__xfs_dir3_data_check
0.38 ? 18% -0.1 0.27 ? 22% perf-profile.self.cycles-pp.xfs_inode_item_format
0.42 ? 11% -0.1 0.32 ? 11% perf-profile.self.cycles-pp.__x86_indirect_thunk_rax
0.12 ? 23% -0.1 0.04 ? 71% perf-profile.self.cycles-pp.xfs_iget
0.13 ? 21% -0.1 0.06 ? 50% perf-profile.self.cycles-pp.xfs_inobt_key_diff
0.15 ? 20% -0.1 0.08 ? 45% perf-profile.self.cycles-pp.do_syscall_64
0.20 ? 16% -0.1 0.14 ? 23% perf-profile.self.cycles-pp.xfs_iext_lookup_extent
0.14 ? 21% -0.1 0.08 ? 52% perf-profile.self.cycles-pp.xfs_da3_node_lookup_int
0.12 ? 10% -0.1 0.07 ? 24% perf-profile.self.cycles-pp.xfs_inobt_init_key_from_rec
0.09 ? 14% -0.0 0.05 ? 45% perf-profile.self.cycles-pp.xfs_dir2_data_entry_tag_p
0.14 ? 14% -0.0 0.10 ? 13% perf-profile.self.cycles-pp.strncpy_from_user
0.08 ? 13% -0.0 0.05 ? 7% perf-profile.self.cycles-pp.xfs_bmapi_update_map
0.09 ? 11% -0.0 0.06 ? 14% perf-profile.self.cycles-pp.xfs_verify_fsbext
0.01 ?223% +0.1 0.06 ? 16% perf-profile.self.cycles-pp.xfs_cil_prepare_item
0.08 ? 21% +0.1 0.16 ? 14% perf-profile.self.cycles-pp.__intel_pmu_disable_all
0.00 +0.1 0.08 ? 27% perf-profile.self.cycles-pp.__schedule
0.00 +0.1 0.08 ? 15% perf-profile.self.cycles-pp.xfs_fs_inode_init_once
0.20 ? 7% +0.1 0.29 ? 13% perf-profile.self.cycles-pp.lockref_get_not_dead
0.00 +0.1 0.10 ? 10% perf-profile.self.cycles-pp.xfs_iunlink_insert_backref
0.17 ? 23% +0.1 0.28 ? 15% perf-profile.self.cycles-pp.xfs_buf_item_format_segment
0.08 ? 19% +0.1 0.19 ? 14% perf-profile.self.cycles-pp.allocate_slab
0.00 +0.1 0.12 ? 26% perf-profile.self.cycles-pp.rhashtable_rehash_table
0.14 ? 19% +0.1 0.27 ? 26% perf-profile.self.cycles-pp.__list_del_entry_valid
0.06 ? 17% +0.1 0.21 ? 14% perf-profile.self.cycles-pp.xfs_contig_bits
0.82 ? 9% +0.3 1.08 ? 15% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.60 ? 14% +0.3 0.90 ? 12% perf-profile.self.cycles-pp.memcpy_erms
0.18 ? 24% +0.4 0.61 ? 39% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath



stress-ng.dentry.ops

1.5e+06 +----------------------------------------------------------------+
1.45e+06 |.+.++.+.+ + ++.+.+. +.+.+.+ .+.+.++.+.+.+ ++.+ |
| + + +.+. + |
1.4e+06 |-+ + |
1.35e+06 |-+ |
| |
1.3e+06 |-+ O O O O O O |
1.25e+06 |-O O OO O O O O O O O O |
1.2e+06 |-+ O O O O O O |
| O O O |
1.15e+06 |-+ O |
1.1e+06 |-+ O O O OO O |
| O |
1.05e+06 |-+ O |
1e+06 +----------------------------------------------------------------+


stress-ng.dentry.ops_per_sec

25000 +-------------------------------------------------------------------+
|.+.+.++.+.+.+.+.++.+.+. .++.+.+. .+.++.+.+. .+. +.+.+ |
24000 |-+ +.+ + + ++. + |
23000 |-+ + |
| |
22000 |-+ |
21000 |-O OO O O O O OO O O O |
| O O O O O OO O OO |
20000 |-+ O O O O |
19000 |-+ O O |
| O O |
18000 |-+ O O O |
17000 |-+ O O O |
| |
16000 +-------------------------------------------------------------------+


[*] bisect-good sample
[O] bisect-bad sample

***************************************************************************************************
lkp-ivb-2ep1: 48 threads 2 sockets Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz with 112G memory
=========================================================================================
class/compiler/cpufreq_governor/disk/fs/kconfig/nr_threads/rootfs/tbox_group/test/testcase/testtime/ucode:
filesystem/gcc-9/performance/1HDD/xfs/x86_64-rhel-8.3/10%/debian-10.4-x86_64-20200603.cgz/lkp-ivb-2ep1/chattr/stress-ng/60s/0x42e

commit:
ae8eb51386 ("xfs: separate primary inode selection criteria in xfs_iget_cache_hit")
752d5513e6 ("xfs: defer inode inactivation to a workqueue")

ae8eb51386366771 752d5513e6e9f5128d3176e7d78
---------------- ---------------------------
%stddev %change %stddev
\ | \
6652 ? 6% +413.4% 34154 ? 26% stress-ng.chattr.ops
110.84 ? 6% +413.4% 569.02 ? 26% stress-ng.chattr.ops_per_sec
358525 -23.5% 274162 ? 6% stress-ng.time.file_system_outputs
11.33 ? 6% +255.9% 40.33 ? 22% stress-ng.time.percent_of_cpu_this_job_got
6.93 ? 5% +244.1% 23.86 ? 22% stress-ng.time.system_time
152024 ? 6% +598.2% 1061460 ? 27% stress-ng.time.voluntary_context_switches
0.31 ? 3% +0.5 0.80 ? 19% mpstat.cpu.all.sys%
15656 ? 2% +8.6% 17008 ? 4% slabinfo.filp.active_objs
13317 -37.1% 8376 ? 45% softirqs.CPU8.TASKLET
13532 -25.0% 10143 ? 7% softirqs.TASKLET
456.67 -24.3% 345.83 ? 8% vmstat.io.bo
7100 ? 4% +622.3% 51286 ? 25% vmstat.system.cs
9784354 ? 75% +808.9% 88926742 ? 74% cpuidle.C1.time
295397 ?107% +737.5% 2473882 ? 54% cpuidle.C1.usage
4050936 ? 27% -25.9% 3003642 cpuidle.C6.usage
1893108 ?107% -64.0% 681464 ? 23% cpuidle.POLL.time
102.67 ? 2% +20.3% 123.50 ? 5% turbostat.Avg_MHz
286621 ?110% +759.3% 2462825 ? 54% turbostat.C1
0.31 ? 76% +2.6 2.91 ? 74% turbostat.C1%
4044781 ? 27% -25.8% 2999808 turbostat.C6
23919 -51.3% 11656 ? 71% interrupts.73:PCI-MSI.2097152-edge.isci-msix
50082 ? 3% +62.2% 81218 ? 14% interrupts.CAL:Function_call_interrupts
11.67 ?156% +1428.6% 178.33 ? 98% interrupts.CPU26.RES:Rescheduling_interrupts
984.67 ? 28% +200.5% 2959 ? 67% interrupts.CPU28.CAL:Function_call_interrupts
9.17 ? 89% +1638.2% 159.33 ? 74% interrupts.CPU30.RES:Rescheduling_interrupts
23919 -51.3% 11656 ? 71% interrupts.CPU8.73:PCI-MSI.2097152-edge.isci-msix
1343 ? 19% +326.0% 5722 ? 16% interrupts.RES:Rescheduling_interrupts
44614 -23.4% 34159 ? 6% proc-vmstat.nr_dirtied
5133 -29.0% 3646 ? 10% proc-vmstat.nr_written
323981 -3.2% 313681 proc-vmstat.numa_hit
280278 -3.6% 270120 proc-vmstat.numa_local
333778 -2.0% 327011 proc-vmstat.pgalloc_normal
267308 -2.6% 260285 proc-vmstat.pgfree
29766 -24.7% 22424 ? 8% proc-vmstat.pgpgout
52.18 ? 15% -40.7% 30.96 ? 9% perf-stat.i.MPKI
2.518e+08 ? 4% +53.4% 3.862e+08 ? 11% perf-stat.i.branch-instructions
10.21 ? 11% -4.4 5.79 ? 15% perf-stat.i.branch-miss-rate%
22.48 ? 8% -6.5 16.00 ? 12% perf-stat.i.cache-miss-rate%
8833462 ? 22% -21.3% 6948121 ? 4% perf-stat.i.cache-misses
7161 ? 4% +638.0% 52852 ? 25% perf-stat.i.context-switches
6.55 ? 8% -39.8% 3.94 ? 12% perf-stat.i.cpi
5.208e+09 ? 6% +14.0% 5.939e+09 ? 5% perf-stat.i.cpu-cycles
608.00 ? 16% +41.3% 858.99 ? 8% perf-stat.i.cycles-between-cache-misses
1.06 ? 11% -0.3 0.76 ? 14% perf-stat.i.dTLB-load-miss-rate%
2.964e+08 ? 2% +61.3% 4.781e+08 ? 11% perf-stat.i.dTLB-loads
0.19 ? 4% -0.0 0.17 ? 4% perf-stat.i.dTLB-store-miss-rate%
80.42 ? 2% -28.0 52.45 ? 10% perf-stat.i.iTLB-load-miss-rate%
1069939 ? 12% +29.2% 1382654 ? 4% perf-stat.i.iTLB-load-misses
260420 ? 8% +441.5% 1410231 ? 24% perf-stat.i.iTLB-loads
1.204e+09 ? 3% +55.3% 1.869e+09 ? 11% perf-stat.i.instructions
0.19 ? 7% +48.6% 0.29 ? 8% perf-stat.i.ipc
0.11 ? 6% +14.1% 0.12 ? 5% perf-stat.i.metric.GHz
18.16 ? 6% +43.7% 26.10 ? 11% perf-stat.i.metric.M/sec
32.33 ? 16% -25.7% 24.04 ? 4% perf-stat.overall.MPKI
8.32 ? 9% -2.8 5.57 ? 11% perf-stat.overall.branch-miss-rate%
22.51 ? 8% -6.8 15.69 ? 13% perf-stat.overall.cache-miss-rate%
4.34 ? 9% -26.2% 3.20 ? 7% perf-stat.overall.cpi
611.45 ? 16% +40.3% 857.89 ? 9% perf-stat.overall.cycles-between-cache-misses
0.83 ? 11% -0.2 0.66 ? 11% perf-stat.overall.dTLB-load-miss-rate%
0.18 ? 5% -0.0 0.16 ? 3% perf-stat.overall.dTLB-store-miss-rate%
80.23 ? 2% -29.9 50.35 ? 11% perf-stat.overall.iTLB-load-miss-rate%
0.23 ? 10% +34.9% 0.31 ? 6% perf-stat.overall.ipc
2.478e+08 ? 4% +53.4% 3.801e+08 ? 11% perf-stat.ps.branch-instructions
8693373 ? 22% -21.3% 6837732 ? 4% perf-stat.ps.cache-misses
7048 ? 4% +637.9% 52009 ? 25% perf-stat.ps.context-switches
5.126e+09 ? 6% +14.0% 5.845e+09 ? 5% perf-stat.ps.cpu-cycles
2.917e+08 ? 2% +61.3% 4.705e+08 ? 11% perf-stat.ps.dTLB-loads
1052992 ? 12% +29.2% 1360682 ? 4% perf-stat.ps.iTLB-load-misses
256297 ? 8% +441.5% 1387757 ? 24% perf-stat.ps.iTLB-loads
1.185e+09 ? 3% +55.3% 1.84e+09 ? 11% perf-stat.ps.instructions
7.509e+10 ? 3% +54.9% 1.163e+11 ? 11% perf-stat.total.instructions
91.20 -5.0 86.21 perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
82.04 -4.7 77.30 perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
89.41 -4.7 84.72 perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
89.40 -4.7 84.72 perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
89.26 -4.7 84.59 perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
80.93 -4.5 76.38 perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
2.19 ? 7% -0.4 1.80 ? 7% perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary
1.17 ? 23% -0.3 0.85 ? 9% perf-profile.calltrace.cycles-pp.perf_mux_hrtimer_handler.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt
0.84 ? 12% -0.3 0.52 ? 46% perf-profile.calltrace.cycles-pp.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64
1.50 ? 9% -0.3 1.19 ? 15% perf-profile.calltrace.cycles-pp.asm_sysvec_irq_work.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
1.50 ? 9% -0.3 1.19 ? 15% perf-profile.calltrace.cycles-pp.sysvec_irq_work.asm_sysvec_irq_work.cpuidle_enter_state.cpuidle_enter.do_idle
1.50 ? 9% -0.3 1.19 ? 15% perf-profile.calltrace.cycles-pp.__sysvec_irq_work.sysvec_irq_work.asm_sysvec_irq_work.cpuidle_enter_state.cpuidle_enter
1.50 ? 8% -0.3 1.19 ? 15% perf-profile.calltrace.cycles-pp.irq_work_run.__sysvec_irq_work.sysvec_irq_work.asm_sysvec_irq_work.cpuidle_enter_state
1.41 ? 8% -0.3 1.14 ? 6% perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry
0.78 ? 8% +0.2 0.97 ? 9% perf-profile.calltrace.cycles-pp.xfs_file_buffered_write.new_sync_write.vfs_write.ksys_write.do_syscall_64
0.79 ? 8% +0.2 0.99 ? 9% perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.81 ? 8% +0.2 1.03 ? 10% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.81 ? 8% +0.2 1.04 ? 10% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.85 ? 18% +0.4 1.27 ? 8% perf-profile.calltrace.cycles-pp.vfs_fileattr_set.do_vfs_ioctl.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.09 ?223% +0.5 0.62 ? 7% perf-profile.calltrace.cycles-pp.xfs_fileattr_set.vfs_fileattr_set.do_vfs_ioctl.__x64_sys_ioctl.do_syscall_64
0.93 ? 19% +0.5 1.48 ? 9% perf-profile.calltrace.cycles-pp.do_vfs_ioctl.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.95 ? 19% +0.6 1.51 ? 9% perf-profile.calltrace.cycles-pp.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +0.7 0.68 ? 14% perf-profile.calltrace.cycles-pp.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag.xfs_icwalk
0.00 +0.7 0.74 ? 16% perf-profile.calltrace.cycles-pp.xfs_dir_ialloc.xfs_create.xfs_generic_create.path_openat.do_filp_open
0.00 +0.8 0.79 ? 8% perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +0.8 0.84 ? 12% perf-profile.calltrace.cycles-pp.__schedule.schedule_idle.do_idle.cpu_startup_entry.start_secondary
0.00 +0.9 0.86 ? 11% perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
0.00 +1.0 0.96 ? 22% perf-profile.calltrace.cycles-pp.xfs_remove.xfs_vn_unlink.vfs_unlink.do_unlinkat.do_syscall_64
0.18 ?141% +1.0 1.14 ? 21% perf-profile.calltrace.cycles-pp.vfs_unlink.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +1.0 0.96 ? 21% perf-profile.calltrace.cycles-pp.xfs_vn_unlink.vfs_unlink.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.28 ?100% +1.1 1.36 ? 17% perf-profile.calltrace.cycles-pp.xfs_create.xfs_generic_create.path_openat.do_filp_open.do_sys_openat2
0.00 +1.1 1.12 ? 9% perf-profile.calltrace.cycles-pp.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag.xfs_icwalk.xfs_inodegc_worker
0.30 ?100% +1.1 1.44 ? 17% perf-profile.calltrace.cycles-pp.xfs_generic_create.path_openat.do_filp_open.do_sys_openat2.do_sys_open
1.08 ? 10% +1.2 2.24 ? 13% perf-profile.calltrace.cycles-pp.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +1.4 1.36 ? 6% perf-profile.calltrace.cycles-pp.xfs_inactive.xfs_icwalk_ag.xfs_icwalk.xfs_inodegc_worker.process_one_work
1.14 ? 14% +1.4 2.57 ? 14% perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64
0.00 +1.4 1.43 ? 5% perf-profile.calltrace.cycles-pp.xfs_icwalk_ag.xfs_icwalk.xfs_inodegc_worker.process_one_work.worker_thread
1.15 ? 14% +1.4 2.59 ? 14% perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +1.4 1.45 ? 5% perf-profile.calltrace.cycles-pp.xfs_icwalk.xfs_inodegc_worker.process_one_work.worker_thread.kthread
0.00 +1.5 1.46 ? 5% perf-profile.calltrace.cycles-pp.xfs_inodegc_worker.process_one_work.worker_thread.kthread.ret_from_fork
1.72 ? 27% +1.5 3.18 ? 13% perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
2.01 ? 23% +1.5 3.55 ? 11% perf-profile.calltrace.cycles-pp.ret_from_fork
1.24 ? 14% +1.5 2.78 ? 13% perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
2.01 ? 23% +1.5 3.55 ? 11% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
1.23 ? 14% +1.5 2.78 ? 13% perf-profile.calltrace.cycles-pp.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.80 ? 26% +1.6 3.39 ? 12% perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
5.42 ? 9% +3.3 8.74 ? 10% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
5.43 ? 9% +3.3 8.77 ? 10% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
83.71 -5.1 78.64 ? 2% perf-profile.children.cycles-pp.cpuidle_enter
83.58 -5.1 78.52 ? 2% perf-profile.children.cycles-pp.cpuidle_enter_state
91.20 -5.0 86.20 perf-profile.children.cycles-pp.do_idle
91.20 -5.0 86.21 perf-profile.children.cycles-pp.secondary_startup_64_no_verify
91.20 -5.0 86.21 perf-profile.children.cycles-pp.cpu_startup_entry
89.41 -4.7 84.72 perf-profile.children.cycles-pp.start_secondary
7.83 ? 8% -0.7 7.12 ? 6% perf-profile.children.cycles-pp.__hrtimer_run_queues
0.73 ? 12% -0.5 0.23 ? 25% perf-profile.children.cycles-pp.xfs_inode_mark_reclaimable
0.74 ? 12% -0.5 0.26 ? 21% perf-profile.children.cycles-pp.destroy_inode
2.25 ? 6% -0.4 1.86 ? 7% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
1.24 ? 24% -0.3 0.91 ? 8% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
0.74 ? 14% -0.3 0.43 ? 10% perf-profile.children.cycles-pp.__dentry_kill
0.78 ? 13% -0.3 0.50 ? 10% perf-profile.children.cycles-pp.dput
1.47 ? 8% -0.3 1.21 ? 6% perf-profile.children.cycles-pp.tick_nohz_next_event
0.84 ? 12% -0.2 0.62 ? 13% perf-profile.children.cycles-pp.__fput
0.87 ? 12% -0.2 0.65 ? 16% perf-profile.children.cycles-pp.task_work_run
0.53 ? 7% -0.1 0.45 ? 11% perf-profile.children.cycles-pp.get_next_timer_interrupt
0.18 ? 21% -0.1 0.11 ? 18% perf-profile.children.cycles-pp.can_stop_idle_tick
0.60 ? 8% -0.1 0.53 ? 8% perf-profile.children.cycles-pp.irqtime_account_irq
0.19 ? 24% -0.1 0.12 ? 16% perf-profile.children.cycles-pp.rcu_nmi_exit
0.02 ?142% +0.0 0.07 ? 18% perf-profile.children.cycles-pp.new_sync_read
0.01 ?223% +0.1 0.06 ? 15% perf-profile.children.cycles-pp.__switch_to_asm
0.10 ? 20% +0.1 0.15 ? 15% perf-profile.children.cycles-pp.evict
0.01 ?223% +0.1 0.06 ? 16% perf-profile.children.cycles-pp.security_capable
0.04 ? 71% +0.1 0.10 ? 18% perf-profile.children.cycles-pp.xfs_buf_item_format_segment
0.03 ?100% +0.1 0.09 ? 34% perf-profile.children.cycles-pp.xfs_btree_check_sblock
0.01 ?223% +0.1 0.07 ? 18% perf-profile.children.cycles-pp.ns_capable_common
0.06 ? 49% +0.1 0.12 ? 15% perf-profile.children.cycles-pp.xfs_buffered_write_iomap_begin
0.04 ? 71% +0.1 0.10 ? 27% perf-profile.children.cycles-pp.xfs_log_ticket_ungrant
0.04 ? 72% +0.1 0.10 ? 29% perf-profile.children.cycles-pp.down_write
0.11 ? 27% +0.1 0.17 ? 20% perf-profile.children.cycles-pp.__intel_pmu_enable_all
0.05 ? 46% +0.1 0.11 ? 42% perf-profile.children.cycles-pp.rcu_do_batch
0.00 +0.1 0.06 ? 29% perf-profile.children.cycles-pp.xfs_btree_increment
0.00 +0.1 0.07 ? 16% perf-profile.children.cycles-pp.xfs_trans_alloc_icreate
0.04 ? 75% +0.1 0.11 ? 23% perf-profile.children.cycles-pp.xfs_buf_item_format
0.02 ?142% +0.1 0.09 ? 23% perf-profile.children.cycles-pp.xfs_btree_update
0.07 ? 25% +0.1 0.14 ? 13% perf-profile.children.cycles-pp._xfs_trans_bjoin
0.04 ? 71% +0.1 0.11 ? 20% perf-profile.children.cycles-pp.xfs_inobt_update
0.03 ?100% +0.1 0.10 ? 20% perf-profile.children.cycles-pp.xfs_iget
0.02 ?141% +0.1 0.09 ? 31% perf-profile.children.cycles-pp.xfs_dir_removename
0.02 ?149% +0.1 0.10 ? 17% perf-profile.children.cycles-pp.select_task_rq_fair
0.03 ?103% +0.1 0.11 ? 29% perf-profile.children.cycles-pp.xfs_inobt_get_rec
0.09 ? 36% +0.1 0.18 ? 21% perf-profile.children.cycles-pp.alloc_empty_file
0.08 ? 40% +0.1 0.17 ? 23% perf-profile.children.cycles-pp.__alloc_file
0.06 ? 21% +0.1 0.15 ? 32% perf-profile.children.cycles-pp.xfs_trans_log_inode
0.01 ?223% +0.1 0.10 ? 17% perf-profile.children.cycles-pp.__sysvec_call_function_single
0.21 ? 23% +0.1 0.30 ? 8% perf-profile.children.cycles-pp.osq_lock
0.01 ?223% +0.1 0.11 ? 51% perf-profile.children.cycles-pp.sched_ttwu_pending
0.02 ?142% +0.1 0.12 ? 43% perf-profile.children.cycles-pp.xfs_dialloc_select_ag
0.01 ?223% +0.1 0.12 ? 13% perf-profile.children.cycles-pp.rwsem_down_read_slowpath
0.03 ?102% +0.1 0.14 ? 25% perf-profile.children.cycles-pp.set_next_entity
0.13 ? 9% +0.1 0.24 ? 20% perf-profile.children.cycles-pp.xfs_log_reserve
0.12 ? 23% +0.1 0.23 ? 12% perf-profile.children.cycles-pp.xfs_inode_item_format
0.11 ? 34% +0.1 0.22 ? 13% perf-profile.children.cycles-pp.xfs_difree_inobt
0.03 ?103% +0.1 0.15 ? 26% perf-profile.children.cycles-pp.update_curr
0.08 ? 12% +0.1 0.20 ? 21% perf-profile.children.cycles-pp.xfs_fileattr_get
0.00 +0.1 0.12 ? 38% perf-profile.children.cycles-pp.xfs_perag_get
0.01 ?223% +0.1 0.13 ? 14% perf-profile.children.cycles-pp.sysvec_call_function_single
0.10 ? 29% +0.1 0.22 ? 24% perf-profile.children.cycles-pp.xfs_btree_read_buf_block
0.15 ? 11% +0.1 0.28 ? 19% perf-profile.children.cycles-pp.xfs_trans_reserve
0.04 ? 72% +0.1 0.17 ? 28% perf-profile.children.cycles-pp.up
0.11 ? 35% +0.1 0.24 ? 25% perf-profile.children.cycles-pp.enqueue_entity
0.01 ?223% +0.1 0.14 ? 61% perf-profile.children.cycles-pp.memcpy_erms
0.08 ? 32% +0.1 0.21 ? 25% perf-profile.children.cycles-pp.xfs_buf_item_release
0.19 ? 21% +0.1 0.33 ? 8% perf-profile.children.cycles-pp.kmem_cache_alloc
0.06 ? 51% +0.1 0.19 ? 18% perf-profile.children.cycles-pp.__queue_work
0.05 ? 73% +0.1 0.19 ? 25% perf-profile.children.cycles-pp.xfs_buf_unlock
0.00 +0.2 0.15 ? 27% perf-profile.children.cycles-pp.queue_delayed_work_on
0.00 +0.2 0.16 ? 23% perf-profile.children.cycles-pp.xfs_inodegc_queue
0.16 ? 25% +0.2 0.32 ? 29% perf-profile.children.cycles-pp.schedule_timeout
0.13 ? 29% +0.2 0.29 ? 21% perf-profile.children.cycles-pp.xfs_iunlink_remove
0.20 ? 16% +0.2 0.36 ? 15% perf-profile.children.cycles-pp.xfs_difree
0.16 ? 20% +0.2 0.32 ? 18% perf-profile.children.cycles-pp.pick_next_task_fair
0.02 ?146% +0.2 0.19 ? 13% perf-profile.children.cycles-pp.asm_sysvec_call_function_single
0.13 ? 19% +0.2 0.30 ? 21% perf-profile.children.cycles-pp.xfs_btree_lookup_get_block
0.02 ?144% +0.2 0.19 ? 15% perf-profile.children.cycles-pp.__perf_event_task_sched_in
0.08 ? 46% +0.2 0.25 ? 37% perf-profile.children.cycles-pp.down
0.13 ? 35% +0.2 0.30 ? 21% perf-profile.children.cycles-pp.enqueue_task_fair
0.08 ? 49% +0.2 0.25 ? 37% perf-profile.children.cycles-pp.__down
0.20 ? 15% +0.2 0.37 ? 18% perf-profile.children.cycles-pp.xfs_trans_alloc
0.13 ? 34% +0.2 0.30 ? 19% perf-profile.children.cycles-pp.ttwu_do_activate
0.08 ? 49% +0.2 0.26 ? 35% perf-profile.children.cycles-pp.xfs_buf_lock
0.08 ? 55% +0.2 0.27 ? 15% perf-profile.children.cycles-pp.dequeue_entity
0.78 ? 8% +0.2 0.97 ? 9% perf-profile.children.cycles-pp.xfs_file_buffered_write
0.08 ? 32% +0.2 0.27 ? 27% perf-profile.children.cycles-pp.wake_up_q
0.81 ? 7% +0.2 1.01 ? 10% perf-profile.children.cycles-pp.new_sync_write
0.06 ? 50% +0.2 0.25 ? 10% perf-profile.children.cycles-pp.__perf_event_task_sched_out
0.00 +0.2 0.20 ? 31% perf-profile.children.cycles-pp.xfs_perag_set_inode_tag
0.59 ? 12% +0.2 0.79 ? 7% perf-profile.children.cycles-pp._raw_spin_lock
0.12 ? 37% +0.2 0.33 ? 18% perf-profile.children.cycles-pp.dequeue_task_fair
0.84 ? 6% +0.2 1.05 ? 10% perf-profile.children.cycles-pp.vfs_write
0.19 ? 21% +0.2 0.41 ? 17% perf-profile.children.cycles-pp.xfs_btree_lookup
0.10 ? 29% +0.2 0.32 ? 28% perf-profile.children.cycles-pp.rwsem_wake
0.40 ? 14% +0.2 0.63 ? 8% perf-profile.children.cycles-pp.xfs_fileattr_set
0.05 ? 74% +0.2 0.27 ? 30% perf-profile.children.cycles-pp.xfs_iunlink
0.84 ? 7% +0.2 1.07 ? 10% perf-profile.children.cycles-pp.ksys_write
0.06 ? 53% +0.3 0.34 ? 9% perf-profile.children.cycles-pp.__perf_pmu_sched_task
0.19 ? 16% +0.3 0.47 ? 18% perf-profile.children.cycles-pp.xfs_check_agi_freecount
0.26 ? 17% +0.3 0.54 ? 11% perf-profile.children.cycles-pp.xlog_cil_insert_items
0.16 ? 34% +0.3 0.46 ? 19% perf-profile.children.cycles-pp.xfs_dialloc_ag
0.16 ? 52% +0.3 0.46 ? 12% perf-profile.children.cycles-pp.finish_task_switch
0.08 ? 25% +0.3 0.39 ? 8% perf-profile.children.cycles-pp.perf_pmu_sched_task
0.31 ? 22% +0.3 0.63 ? 12% perf-profile.children.cycles-pp.try_to_wake_up
0.17 ? 23% +0.3 0.50 ? 23% perf-profile.children.cycles-pp.xfs_buf_find
0.89 ? 14% +0.3 1.22 ? 8% perf-profile.children.cycles-pp.rwsem_spin_on_owner
0.18 ? 17% +0.3 0.52 ? 24% perf-profile.children.cycles-pp.xfs_buf_get_map
0.34 ? 17% +0.3 0.68 ? 14% perf-profile.children.cycles-pp.xfs_ifree
0.20 ? 18% +0.4 0.55 ? 23% perf-profile.children.cycles-pp.xfs_buf_read_map
0.16 ? 19% +0.4 0.52 ? 29% perf-profile.children.cycles-pp.xfs_read_agi
0.85 ? 18% +0.4 1.27 ? 8% perf-profile.children.cycles-pp.vfs_fileattr_set
0.29 ? 16% +0.5 0.74 ? 18% perf-profile.children.cycles-pp.xfs_trans_read_buf_map
0.27 ? 20% +0.5 0.74 ? 16% perf-profile.children.cycles-pp.xfs_dir_ialloc
0.94 ? 19% +0.5 1.48 ? 9% perf-profile.children.cycles-pp.do_vfs_ioctl
0.33 ? 25% +0.5 0.87 ? 10% perf-profile.children.cycles-pp.schedule_idle
0.95 ? 19% +0.6 1.51 ? 9% perf-profile.children.cycles-pp.__x64_sys_ioctl
0.41 ? 17% +0.6 1.00 ? 12% perf-profile.children.cycles-pp.schedule
0.37 ? 14% +0.6 0.96 ? 22% perf-profile.children.cycles-pp.xfs_remove
0.37 ? 14% +0.6 0.96 ? 21% perf-profile.children.cycles-pp.xfs_vn_unlink
0.52 ? 14% +0.6 1.12 ? 9% perf-profile.children.cycles-pp.xfs_inactive_ifree
0.72 ? 13% +0.6 1.36 ? 6% perf-profile.children.cycles-pp.xfs_inactive
0.47 ? 9% +0.7 1.14 ? 21% perf-profile.children.cycles-pp.vfs_unlink
0.62 ? 12% +0.7 1.35 ? 13% perf-profile.children.cycles-pp.xfs_log_commit_cil
0.70 ? 12% +0.8 1.48 ? 11% perf-profile.children.cycles-pp.__xfs_trans_commit
1.22 ? 14% +0.8 2.02 ? 6% perf-profile.children.cycles-pp.rwsem_down_write_slowpath
0.49 ? 16% +0.9 1.36 ? 17% perf-profile.children.cycles-pp.xfs_create
0.51 ? 18% +0.9 1.44 ? 17% perf-profile.children.cycles-pp.xfs_generic_create
0.74 ? 13% +1.1 1.84 ? 9% perf-profile.children.cycles-pp.__schedule
1.09 ? 10% +1.2 2.24 ? 13% perf-profile.children.cycles-pp.do_unlinkat
1.18 ? 13% +1.4 2.60 ? 14% perf-profile.children.cycles-pp.path_openat
0.00 +1.4 1.43 ? 5% perf-profile.children.cycles-pp.xfs_icwalk_ag
1.19 ? 13% +1.4 2.62 ? 14% perf-profile.children.cycles-pp.do_filp_open
0.00 +1.4 1.45 ? 5% perf-profile.children.cycles-pp.xfs_icwalk
0.00 +1.5 1.46 ? 5% perf-profile.children.cycles-pp.xfs_inodegc_worker
1.72 ? 27% +1.5 3.18 ? 13% perf-profile.children.cycles-pp.process_one_work
1.28 ? 13% +1.5 2.81 ? 13% perf-profile.children.cycles-pp.do_sys_open
1.27 ? 13% +1.5 2.80 ? 13% perf-profile.children.cycles-pp.do_sys_openat2
2.03 ? 23% +1.5 3.56 ? 11% perf-profile.children.cycles-pp.ret_from_fork
2.01 ? 23% +1.5 3.55 ? 11% perf-profile.children.cycles-pp.kthread
1.80 ? 26% +1.6 3.39 ? 12% perf-profile.children.cycles-pp.worker_thread
5.96 ? 9% +3.3 9.28 ? 9% perf-profile.children.cycles-pp.do_syscall_64
5.98 ? 9% +3.3 9.30 ? 9% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
0.19 ? 19% -0.1 0.12 ? 27% perf-profile.self.cycles-pp.tick_nohz_get_sleep_length
0.18 ? 22% -0.1 0.10 ? 17% perf-profile.self.cycles-pp.can_stop_idle_tick
0.16 ? 21% -0.1 0.10 ? 14% perf-profile.self.cycles-pp.rcu_nmi_exit
0.16 ? 13% -0.1 0.10 ? 27% perf-profile.self.cycles-pp.__remove_hrtimer
0.22 ? 15% -0.1 0.16 ? 13% perf-profile.self.cycles-pp.irq_exit_rcu
0.14 ? 12% -0.1 0.08 ? 18% perf-profile.self.cycles-pp.hrtimer_update_next_event
0.02 ?141% +0.1 0.08 ? 8% perf-profile.self.cycles-pp.xfs_buf_find
0.11 ? 27% +0.1 0.17 ? 20% perf-profile.self.cycles-pp.__intel_pmu_enable_all
0.10 ? 14% +0.1 0.17 ? 14% perf-profile.self.cycles-pp.kmem_cache_alloc
0.03 ?100% +0.1 0.10 ? 27% perf-profile.self.cycles-pp.xlog_cil_insert_items
0.04 ? 72% +0.1 0.12 ? 33% perf-profile.self.cycles-pp.xfs_log_commit_cil
0.01 ?223% +0.1 0.09 ? 32% perf-profile.self.cycles-pp.memcpy_erms
0.07 ? 51% +0.1 0.16 ? 18% perf-profile.self.cycles-pp.xfs_inode_item_format
0.01 ?223% +0.1 0.10 ? 38% perf-profile.self.cycles-pp.enqueue_entity
0.01 ?223% +0.1 0.11 ? 38% perf-profile.self.cycles-pp.update_load_avg
0.21 ? 24% +0.1 0.30 ? 7% perf-profile.self.cycles-pp.osq_lock
0.08 ? 36% +0.1 0.21 ? 17% perf-profile.self.cycles-pp.__schedule
0.55 ? 11% +0.2 0.75 ? 7% perf-profile.self.cycles-pp._raw_spin_lock
0.88 ? 14% +0.3 1.21 ? 8% perf-profile.self.cycles-pp.rwsem_spin_on_owner



***************************************************************************************************
lkp-ivb-2ep1: 48 threads 2 sockets Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz with 112G memory
=========================================================================================
class/compiler/cpufreq_governor/disk/fs/kconfig/nr_threads/rootfs/tbox_group/test/testcase/testtime/ucode:
filesystem/gcc-9/performance/1HDD/xfs/x86_64-rhel-8.3/10%/debian-10.4-x86_64-20200603.cgz/lkp-ivb-2ep1/dnotify/stress-ng/60s/0x42e

commit:
ae8eb51386 ("xfs: separate primary inode selection criteria in xfs_iget_cache_hit")
752d5513e6 ("xfs: defer inode inactivation to a workqueue")

ae8eb51386366771 752d5513e6e9f5128d3176e7d78
---------------- ---------------------------
%stddev %change %stddev
\ | \
716513 ? 4% -72.4% 197697 ? 6% stress-ng.dnotify.ops
11941 ? 4% -72.5% 3280 ? 6% stress-ng.dnotify.ops_per_sec
28660457 ? 4% -72.4% 7907804 ? 6% stress-ng.time.file_system_outputs
379.00 -68.5% 119.50 ? 6% stress-ng.time.percent_of_cpu_this_job_got
219.75 -68.0% 70.35 ? 6% stress-ng.time.system_time
15.73 ? 27% -72.0% 4.40 ? 25% stress-ng.time.user_time
288.67 ? 14% +1.3e+05% 363311 ? 5% stress-ng.time.voluntary_context_switches
2149 ? 19% +467.0% 12186 ? 21% cpuidle.POLL.usage
89.93 +4.4% 93.85 iostat.cpu.idle
9.29 ? 2% -42.0% 5.39 ? 7% iostat.cpu.system
2826008 ? 44% -79.4% 582267 ? 34% numa-numastat.node1.local_node
2837040 ? 44% -78.8% 601547 ? 31% numa-numastat.node1.numa_hit
0.08 ? 18% -20.5% 0.06 ? 12% perf-sched.wait_and_delay.avg.ms.pipe_read.new_sync_read.vfs_read.ksys_read
6.00 ? 54% +180.6% 16.83 ? 27% perf-sched.wait_and_delay.count.worker_thread.kthread.ret_from_fork
0.00 ?223% +0.3 0.34 ? 7% mpstat.cpu.all.iowait%
6.78 -3.9 2.90 ? 5% mpstat.cpu.all.sys%
0.72 ? 18% -0.3 0.37 ? 11% mpstat.cpu.all.usr%
322.50 -41.0% 190.33 ? 3% turbostat.Avg_MHz
11.15 ? 5% -3.7 7.41 ? 5% turbostat.Busy%
2906 ? 5% -11.2% 2580 ? 4% turbostat.Bzy_MHz
3.00 +5.3e+05% 15876 ? 6% vmstat.io.bo
1146773 +29.2% 1481606 vmstat.memory.cache
4.00 -66.7% 1.33 ? 35% vmstat.procs.r
5055 ? 4% +459.9% 28309 ? 6% vmstat.system.cs
96267 +0.9% 97179 vmstat.system.in
4421 ? 8% -16.5% 3690 ? 10% meminfo.Active
4198 ? 5% -20.9% 3322 meminfo.Active(anon)
70801 +467.9% 402075 ? 3% meminfo.KReclaimable
2115687 +35.2% 2860204 meminfo.Memused
70801 +467.9% 402075 ? 3% meminfo.SReclaimable
105243 +268.1% 387360 ? 2% meminfo.SUnreclaim
176045 +348.4% 789436 ? 3% meminfo.Slab
2156637 +33.6% 2881017 meminfo.max_used_kB
13792 ? 2% +352.7% 62446 ? 16% numa-vmstat.node0.nr_slab_reclaimable
15508 ? 3% +270.6% 57474 ? 18% numa-vmstat.node0.nr_slab_unreclaimable
809.33 ? 11% -34.1% 533.50 ? 13% numa-vmstat.node1.nr_active_anon
1199392 ? 47% -82.5% 209467 ? 42% numa-vmstat.node1.nr_dirtied
406.17 ? 72% -51.6% 196.67 ?105% numa-vmstat.node1.nr_mapped
1191 ? 26% -44.3% 663.00 ? 32% numa-vmstat.node1.nr_shmem
3906 ? 11% +878.8% 38236 ? 31% numa-vmstat.node1.nr_slab_reclaimable
10763 ? 5% +266.6% 39463 ? 29% numa-vmstat.node1.nr_slab_unreclaimable
809.33 ? 11% -34.1% 533.50 ? 13% numa-vmstat.node1.nr_zone_active_anon
1561754 ? 38% -63.8% 566013 ? 18% numa-vmstat.node1.numa_hit
1536181 ? 39% -65.4% 531807 ? 20% numa-vmstat.node1.numa_local
1250 +1141.4% 15528 ? 4% softirqs.BLOCK
5617 ? 33% +79.7% 10095 ? 24% softirqs.CPU2.RCU
4150 ? 49% +139.2% 9927 ? 48% softirqs.CPU26.RCU
3642 ? 32% +112.3% 7734 ? 25% softirqs.CPU31.RCU
8807 ? 19% -41.8% 5124 ? 27% softirqs.CPU32.SCHED
4658 ? 43% +89.6% 8833 ? 25% softirqs.CPU4.RCU
846.33 ? 4% +981.6% 9154 ? 41% softirqs.CPU8.BLOCK
3898 ? 31% +138.4% 9295 ? 33% softirqs.CPU8.RCU
1407 +1176.0% 17957 ? 4% softirqs.CPU8.TASKLET
1623 +1019.2% 18174 ? 4% softirqs.TASKLET
33825 ? 6% -39.3% 20516 ? 8% softirqs.TIMER
1049 ? 5% -20.8% 831.00 proc-vmstat.nr_active_anon
3582507 ? 4% -72.4% 988405 ? 6% proc-vmstat.nr_dirtied
4624 -6.1% 4340 proc-vmstat.nr_shmem
17700 +468.3% 100596 ? 3% proc-vmstat.nr_slab_reclaimable
26284 +268.6% 96872 ? 2% proc-vmstat.nr_slab_unreclaimable
1049 ? 5% -20.8% 831.00 proc-vmstat.nr_zone_active_anon
4085111 ? 3% -63.1% 1508141 ? 4% proc-vmstat.numa_hit
4041490 ? 3% -63.8% 1464583 ? 4% proc-vmstat.numa_local
1585 ? 9% -29.2% 1122 ? 7% proc-vmstat.pgactivate
4301589 ? 3% -56.4% 1873579 ? 4% proc-vmstat.pgalloc_normal
4233247 ? 3% -64.4% 1507771 ? 5% proc-vmstat.pgfree
135.50 ? 4% +7.4e+05% 1009454 ? 5% proc-vmstat.pgpgout
55173 ? 2% +352.1% 249427 ? 16% numa-meminfo.node0.KReclaimable
1796218 +22.6% 2202221 ? 4% numa-meminfo.node0.MemUsed
55173 ? 2% +352.1% 249427 ? 16% numa-meminfo.node0.SReclaimable
62123 ? 3% +269.8% 229723 ? 18% numa-meminfo.node0.SUnreclaim
117297 ? 3% +308.5% 479150 ? 16% numa-meminfo.node0.Slab
3412 ? 17% -36.9% 2152 ? 12% numa-meminfo.node1.Active
3232 ? 11% -34.1% 2131 ? 13% numa-meminfo.node1.Active(anon)
15628 ? 11% +878.4% 152905 ? 31% numa-meminfo.node1.KReclaimable
1621 ? 72% -56.4% 706.17 ?114% numa-meminfo.node1.Mapped
319477 ? 3% +106.1% 658570 ? 14% numa-meminfo.node1.MemUsed
15628 ? 11% +878.4% 152905 ? 31% numa-meminfo.node1.SReclaimable
43066 ? 5% +266.2% 157700 ? 29% numa-meminfo.node1.SUnreclaim
4760 ? 26% -44.3% 2649 ? 32% numa-meminfo.node1.Shmem
58695 ? 6% +429.2% 310606 ? 30% numa-meminfo.node1.Slab
59.83 ? 16% +55370.2% 33189 ? 5% interrupts.73:PCI-MSI.2097152-edge.isci-msix
43587 ? 2% +188.6% 125790 ? 4% interrupts.CAL:Function_call_interrupts
494.83 ? 6% +465.8% 2799 ? 61% interrupts.CPU0.CAL:Function_call_interrupts
821.00 ? 3% +219.7% 2624 ? 28% interrupts.CPU1.CAL:Function_call_interrupts
771.83 ? 3% +259.1% 2772 ? 48% interrupts.CPU10.CAL:Function_call_interrupts
852.50 ? 7% +353.1% 3862 ? 72% interrupts.CPU11.CAL:Function_call_interrupts
77.33 ?131% +453.7% 428.17 ? 67% interrupts.CPU11.RES:Rescheduling_interrupts
817.50 ? 4% +526.4% 5120 ? 44% interrupts.CPU12.CAL:Function_call_interrupts
917.67 ? 5% +212.3% 2865 ? 68% interrupts.CPU13.CAL:Function_call_interrupts
960.67 ? 14% +232.1% 3190 ? 44% interrupts.CPU15.CAL:Function_call_interrupts
909.17 ? 17% +136.9% 2153 ? 67% interrupts.CPU16.CAL:Function_call_interrupts
941.67 ? 19% +252.5% 3319 ? 60% interrupts.CPU2.CAL:Function_call_interrupts
810.33 ? 2% +126.4% 1834 ? 54% interrupts.CPU25.CAL:Function_call_interrupts
230.67 ? 30% +70.0% 392.17 ? 21% interrupts.CPU25.NMI:Non-maskable_interrupts
230.67 ? 30% +70.0% 392.17 ? 21% interrupts.CPU25.PMI:Performance_monitoring_interrupts
246.17 ? 27% +112.0% 521.83 ? 48% interrupts.CPU26.NMI:Non-maskable_interrupts
246.17 ? 27% +112.0% 521.83 ? 48% interrupts.CPU26.PMI:Performance_monitoring_interrupts
17.17 ?113% +766.0% 148.67 ? 75% interrupts.CPU26.RES:Rescheduling_interrupts
927.33 ? 22% +193.8% 2724 ? 47% interrupts.CPU27.CAL:Function_call_interrupts
194.83 ? 31% +144.1% 475.50 ? 72% interrupts.CPU3.NMI:Non-maskable_interrupts
194.83 ? 31% +144.1% 475.50 ? 72% interrupts.CPU3.PMI:Performance_monitoring_interrupts
835.00 ? 9% +352.7% 3779 ? 68% interrupts.CPU31.CAL:Function_call_interrupts
185.83 ? 25% +340.4% 818.50 ? 67% interrupts.CPU31.NMI:Non-maskable_interrupts
185.83 ? 25% +340.4% 818.50 ? 67% interrupts.CPU31.PMI:Performance_monitoring_interrupts
813.67 ? 4% +438.3% 4379 ? 71% interrupts.CPU32.CAL:Function_call_interrupts
238.50 ? 41% +198.3% 711.50 ? 58% interrupts.CPU32.NMI:Non-maskable_interrupts
238.50 ? 41% +198.3% 711.50 ? 58% interrupts.CPU32.PMI:Performance_monitoring_interrupts
852.17 ? 13% +93.8% 1651 ? 30% interrupts.CPU34.CAL:Function_call_interrupts
838.33 ? 7% +261.0% 3026 ? 82% interrupts.CPU35.CAL:Function_call_interrupts
889.83 ? 19% +183.0% 2518 ? 51% interrupts.CPU37.CAL:Function_call_interrupts
939.50 ? 20% +287.9% 3644 ? 82% interrupts.CPU4.CAL:Function_call_interrupts
198.33 ? 39% +161.8% 519.17 ? 42% interrupts.CPU4.NMI:Non-maskable_interrupts
198.33 ? 39% +161.8% 519.17 ? 42% interrupts.CPU4.PMI:Performance_monitoring_interrupts
830.00 ? 10% +130.7% 1915 ? 53% interrupts.CPU45.CAL:Function_call_interrupts
1138 ? 40% +158.8% 2945 ? 58% interrupts.CPU5.CAL:Function_call_interrupts
174.50 ? 19% +376.2% 831.00 ? 63% interrupts.CPU5.NMI:Non-maskable_interrupts
174.50 ? 19% +376.2% 831.00 ? 63% interrupts.CPU5.PMI:Performance_monitoring_interrupts
701.00 ? 21% +578.1% 4753 ? 59% interrupts.CPU6.CAL:Function_call_interrupts
42.50 ?152% +520.0% 263.50 ? 69% interrupts.CPU6.RES:Rescheduling_interrupts
872.67 ? 10% +471.6% 4988 ? 52% interrupts.CPU7.CAL:Function_call_interrupts
196.00 ? 40% +229.6% 646.00 ? 55% interrupts.CPU7.NMI:Non-maskable_interrupts
196.00 ? 40% +229.6% 646.00 ? 55% interrupts.CPU7.PMI:Performance_monitoring_interrupts
73.67 ?138% +387.6% 359.17 ? 88% interrupts.CPU7.RES:Rescheduling_interrupts
59.83 ? 16% +55370.2% 33189 ? 5% interrupts.CPU8.73:PCI-MSI.2097152-edge.isci-msix
817.00 ? 7% +180.7% 2293 ? 56% interrupts.CPU8.CAL:Function_call_interrupts
14.17 ?130% +805.9% 128.33 ? 50% interrupts.CPU8.RES:Rescheduling_interrupts
41765 ? 10% -40.1% 25016 ? 4% interrupts.NMI:Non-maskable_interrupts
41765 ? 10% -40.1% 25016 ? 4% interrupts.PMI:Performance_monitoring_interrupts
4650 ? 10% +53.1% 7119 ? 18% interrupts.RES:Rescheduling_interrupts
26.20 ? 3% +81.5% 47.56 ? 10% perf-stat.i.MPKI
1.589e+09 ? 4% -54.5% 7.233e+08 ? 2% perf-stat.i.branch-instructions
2.01 ? 3% +5.5 7.54 ? 11% perf-stat.i.branch-miss-rate%
32120648 -16.1% 26936027 ? 6% perf-stat.i.branch-misses
5.53 ? 25% +12.5 18.03 ? 4% perf-stat.i.cache-miss-rate%
2.119e+08 ? 2% -48.3% 1.096e+08 ? 3% perf-stat.i.cache-references
5019 ? 4% +480.3% 29125 ? 6% perf-stat.i.context-switches
1.92 ? 4% +165.2% 5.09 ? 7% perf-stat.i.cpi
1.55e+10 -38.8% 9.484e+09 ? 3% perf-stat.i.cpu-cycles
57.32 ? 2% +7.8% 61.81 perf-stat.i.cpu-migrations
1736 ? 32% -62.1% 658.28 ? 8% perf-stat.i.cycles-between-cache-misses
0.67 ? 14% +0.4 1.08 ? 4% perf-stat.i.dTLB-load-miss-rate%
15915472 ? 13% -42.5% 9152352 ? 7% perf-stat.i.dTLB-load-misses
2.33e+09 ? 3% -53.7% 1.078e+09 ? 3% perf-stat.i.dTLB-loads
2971804 ? 7% -46.5% 1590106 ? 4% perf-stat.i.dTLB-store-misses
1.628e+09 ? 2% -47.6% 8.528e+08 ? 4% perf-stat.i.dTLB-stores
49.39 ? 4% +12.4 61.78 ? 3% perf-stat.i.iTLB-load-miss-rate%
2759418 ? 9% -41.2% 1623723 ? 4% perf-stat.i.iTLB-load-misses
2978816 ? 10% -38.1% 1844222 ? 7% perf-stat.i.iTLB-loads
8.124e+09 ? 4% -54.3% 3.715e+09 ? 2% perf-stat.i.instructions
3057 ? 9% -37.1% 1922 ? 3% perf-stat.i.instructions-per-iTLB-miss
0.53 ? 4% -41.3% 0.31 ? 3% perf-stat.i.ipc
10.44 +6.8% 11.15 ? 5% perf-stat.i.major-faults
0.32 -38.8% 0.20 ? 3% perf-stat.i.metric.GHz
277.49 ? 43% +81.1% 502.53 ? 3% perf-stat.i.metric.K/sec
119.93 ? 3% -52.2% 57.30 ? 3% perf-stat.i.metric.M/sec
46.95 ? 3% -8.4 38.51 ? 6% perf-stat.i.node-load-miss-rate%
26.12 ? 3% +12.9% 29.50 ? 4% perf-stat.overall.MPKI
2.02 ? 3% +1.7 3.72 ? 8% perf-stat.overall.branch-miss-rate%
4.77 ? 31% +8.0 12.81 ? 7% perf-stat.overall.cache-miss-rate%
1.91 ? 4% +33.4% 2.55 ? 3% perf-stat.overall.cpi
1701 ? 32% -60.1% 679.71 ? 8% perf-stat.overall.cycles-between-cache-misses
0.68 ? 14% +0.2 0.84 ? 5% perf-stat.overall.dTLB-load-miss-rate%
2970 ? 10% -22.8% 2293 ? 2% perf-stat.overall.instructions-per-iTLB-miss
0.52 ? 4% -25.1% 0.39 ? 4% perf-stat.overall.ipc
47.40 ? 4% -5.8 41.57 ? 5% perf-stat.overall.node-load-miss-rate%
1.564e+09 ? 4% -54.4% 7.135e+08 ? 2% perf-stat.ps.branch-instructions
31592135 -16.1% 26519684 ? 6% perf-stat.ps.branch-misses
2.085e+08 ? 2% -48.2% 1.081e+08 ? 3% perf-stat.ps.cache-references
4939 ? 4% +481.8% 28734 ? 6% perf-stat.ps.context-switches
1.526e+10 -38.7% 9.346e+09 ? 3% perf-stat.ps.cpu-cycles
56.42 ? 2% +8.0% 60.90 perf-stat.ps.cpu-migrations
15663464 ? 13% -42.4% 9025938 ? 7% perf-stat.ps.dTLB-load-misses
2.293e+09 ? 3% -53.6% 1.063e+09 ? 3% perf-stat.ps.dTLB-loads
2924860 ? 7% -46.4% 1567613 ? 4% perf-stat.ps.dTLB-store-misses
1.602e+09 ? 2% -47.5% 8.408e+08 ? 4% perf-stat.ps.dTLB-stores
2715568 ? 9% -41.1% 1599431 ? 4% perf-stat.ps.iTLB-load-misses
2931718 ? 10% -37.9% 1819937 ? 7% perf-stat.ps.iTLB-loads
7.993e+09 ? 4% -54.2% 3.665e+09 ? 2% perf-stat.ps.instructions
10.26 +6.7% 10.95 ? 5% perf-stat.ps.major-faults
5.031e+11 ? 3% -54.0% 2.314e+11 ? 2% perf-stat.total.instructions
1081 ? 4% +54.4% 1669 ? 6% slabinfo.Acpi-Parse.active_objs
1081 ? 4% +54.4% 1669 ? 6% slabinfo.Acpi-Parse.num_objs
561.33 ? 9% +132.5% 1305 ? 7% slabinfo.bfq_io_cq.active_objs
561.33 ? 9% +132.5% 1305 ? 7% slabinfo.bfq_io_cq.num_objs
388.67 ? 11% +37.9% 535.83 ? 11% slabinfo.biovec-64.active_objs
388.67 ? 11% +37.9% 535.83 ? 11% slabinfo.biovec-64.num_objs
1201 ? 11% +119.0% 2631 ? 36% slabinfo.dmaengine-unmap-16.active_objs
1201 ? 11% +121.2% 2658 ? 35% slabinfo.dmaengine-unmap-16.num_objs
2055 ? 9% +108.8% 4291 ? 6% slabinfo.dnotify_struct.active_objs
2055 ? 9% +108.8% 4291 ? 6% slabinfo.dnotify_struct.num_objs
23858 ? 13% -31.6% 16307 ? 4% slabinfo.filp.active_objs
756.17 ? 13% -28.9% 537.50 ? 3% slabinfo.filp.active_slabs
24210 ? 13% -28.9% 17214 ? 3% slabinfo.filp.num_objs
756.17 ? 13% -28.9% 537.50 ? 3% slabinfo.filp.num_slabs
792.83 ? 9% +114.8% 1703 ? 6% slabinfo.ip6-frags.active_objs
792.83 ? 9% +114.8% 1703 ? 6% slabinfo.ip6-frags.num_objs
2844 +142.5% 6896 ? 14% slabinfo.kmalloc-128.active_objs
90.67 ? 2% +141.0% 218.50 ? 14% slabinfo.kmalloc-128.active_slabs
2911 ? 2% +141.0% 7015 ? 14% slabinfo.kmalloc-128.num_objs
90.67 ? 2% +141.0% 218.50 ? 14% slabinfo.kmalloc-128.num_slabs
18896 +2493.2% 490004 ? 5% slabinfo.kmalloc-16.active_objs
73.83 +2492.8% 1914 ? 5% slabinfo.kmalloc-16.active_slabs
18901 +2493.4% 490195 ? 5% slabinfo.kmalloc-16.num_objs
73.83 +2492.8% 1914 ? 5% slabinfo.kmalloc-16.num_slabs
7292 ? 5% +14.5% 8353 ? 5% slabinfo.kmalloc-256.active_objs
7343 ? 5% +14.1% 8379 ? 5% slabinfo.kmalloc-256.num_objs
54440 ? 2% +21.9% 66345 ? 3% slabinfo.kmalloc-32.active_objs
54716 ? 2% +21.7% 66577 ? 2% slabinfo.kmalloc-32.num_objs
10611 ? 5% +3325.7% 363499 ? 3% slabinfo.kmalloc-512.active_objs
332.83 ? 5% +3648.3% 12475 ? 3% slabinfo.kmalloc-512.active_slabs
10664 ? 5% +3643.5% 399231 ? 3% slabinfo.kmalloc-512.num_objs
332.83 ? 5% +3648.3% 12475 ? 3% slabinfo.kmalloc-512.num_slabs
438.33 +1627.5% 7572 slabinfo.kmalloc-8k.active_objs
109.33 +1894.7% 2180 slabinfo.kmalloc-8k.active_slabs
438.33 +1890.5% 8725 slabinfo.kmalloc-8k.num_objs
109.33 +1894.7% 2180 slabinfo.kmalloc-8k.num_slabs
2722 +308.5% 11121 ? 3% slabinfo.kmalloc-rcl-512.active_objs
84.50 +321.7% 356.33 ? 3% slabinfo.kmalloc-rcl-512.active_slabs
2722 +319.4% 11417 ? 3% slabinfo.kmalloc-rcl-512.num_objs
84.50 +321.7% 356.33 ? 3% slabinfo.kmalloc-rcl-512.num_slabs
442.50 ? 10% +1340.9% 6376 ? 6% slabinfo.numa_policy.active_objs
13.67 ? 11% +1501.2% 218.83 ? 5% slabinfo.numa_policy.active_slabs
442.50 ? 10% +1435.4% 6794 ? 5% slabinfo.numa_policy.num_objs
13.67 ? 11% +1501.2% 218.83 ? 5% slabinfo.numa_policy.num_slabs
1172 ? 8% +27.8% 1499 ? 7% slabinfo.pool_workqueue.active_objs
1224 ? 8% +31.3% 1607 ? 5% slabinfo.pool_workqueue.num_objs
13130 +32.8% 17438 slabinfo.radix_tree_node.active_objs
468.83 +34.1% 628.83 slabinfo.radix_tree_node.active_slabs
13137 +34.1% 17621 slabinfo.radix_tree_node.num_objs
468.83 +34.1% 628.83 slabinfo.radix_tree_node.num_slabs
383.50 ? 10% +41.3% 542.00 ? 14% slabinfo.skbuff_fclone_cache.active_objs
383.50 ? 10% +41.3% 542.00 ? 14% slabinfo.skbuff_fclone_cache.num_objs
657.67 ? 9% +105.3% 1350 ? 6% slabinfo.xfs_btree_cur.active_objs
657.67 ? 9% +105.3% 1350 ? 6% slabinfo.xfs_btree_cur.num_objs
396.50 ? 7% +2477.0% 10217 ? 6% slabinfo.xfs_buf.active_objs
8.67 ? 8% +2757.7% 247.67 ? 6% slabinfo.xfs_buf.active_slabs
396.50 ? 7% +2528.8% 10423 ? 6% slabinfo.xfs_buf.num_objs
8.67 ? 8% +2757.7% 247.67 ? 6% slabinfo.xfs_buf.num_slabs
39.00 +5183.8% 2060 ? 26% slabinfo.xfs_efi_item.active_objs
39.00 +5251.3% 2087 ? 26% slabinfo.xfs_efi_item.num_objs
129.00 +4297.2% 5672 ? 24% slabinfo.xfs_icr.active_objs
2.00 +6108.3% 124.17 ? 24% slabinfo.xfs_icr.active_slabs
129.00 +4344.7% 5733 ? 24% slabinfo.xfs_icr.num_objs
2.00 +6108.3% 124.17 ? 24% slabinfo.xfs_icr.num_slabs
157.00 +1.8e+05% 281652 ? 4% slabinfo.xfs_ili.active_objs
3.00 +2.3e+05% 6773 ? 4% slabinfo.xfs_ili.active_slabs
157.00 +1.8e+05% 284506 ? 4% slabinfo.xfs_ili.num_objs
3.00 +2.3e+05% 6773 ? 4% slabinfo.xfs_ili.num_slabs
246.33 ? 10% +1.1e+05% 281353 ? 4% slabinfo.xfs_inode.active_objs
6.50 ? 11% +1.3e+05% 8339 ? 4% slabinfo.xfs_inode.active_slabs
246.33 ? 10% +1.2e+05% 283577 ? 4% slabinfo.xfs_inode.num_objs
6.50 ? 11% +1.3e+05% 8339 ? 4% slabinfo.xfs_inode.num_slabs
49.47 ? 14% -23.3 26.14 ? 11% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
49.33 ? 14% -23.2 26.08 ? 11% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
17.61 ? 14% -11.2 6.42 ? 13% perf-profile.calltrace.cycles-pp.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
9.28 ? 14% -9.3 0.00 perf-profile.calltrace.cycles-pp.destroy_inode.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
9.03 ? 15% -9.0 0.00 perf-profile.calltrace.cycles-pp.xfs_inode_mark_reclaimable.destroy_inode.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
8.65 ? 15% -8.7 0.00 perf-profile.calltrace.cycles-pp.xfs_inactive.xfs_inode_mark_reclaimable.destroy_inode.do_unlinkat.do_syscall_64
6.12 ? 16% -6.1 0.00 perf-profile.calltrace.cycles-pp.xfs_inactive_ifree.xfs_inactive.xfs_inode_mark_reclaimable.destroy_inode.do_unlinkat
14.08 ? 14% -3.9 10.14 ? 11% perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
14.01 ? 14% -3.9 10.11 ? 11% perf-profile.calltrace.cycles-pp.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
12.93 ? 14% -3.3 9.59 ? 11% perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
12.83 ? 14% -3.3 9.54 ? 11% perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64
6.63 ? 15% -3.0 3.61 ? 10% perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
4.89 ? 16% -2.3 2.60 ? 12% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
4.84 ? 16% -2.3 2.57 ? 12% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
4.84 ? 13% -2.1 2.75 ? 10% perf-profile.calltrace.cycles-pp.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
4.27 ? 17% -2.0 2.25 ? 12% perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
4.15 ? 17% -1.9 2.21 ? 12% perf-profile.calltrace.cycles-pp.xfs_file_buffered_write.new_sync_write.vfs_write.ksys_write.do_syscall_64
3.68 ? 16% -1.7 1.97 ? 12% perf-profile.calltrace.cycles-pp.iomap_file_buffered_write.xfs_file_buffered_write.new_sync_write.vfs_write.ksys_write
3.66 ? 16% -1.7 1.95 ? 12% perf-profile.calltrace.cycles-pp.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_write.new_sync_write.vfs_write
2.06 ? 17% -1.6 0.42 ? 72% perf-profile.calltrace.cycles-pp.xfs_difree_inobt.xfs_difree.xfs_ifree.xfs_inactive_ifree.xfs_inactive
8.65 ? 15% -1.4 7.20 ? 11% perf-profile.calltrace.cycles-pp.xfs_generic_create.path_openat.do_filp_open.do_sys_openat2.do_sys_open
3.46 ? 12% -1.4 2.08 ? 10% perf-profile.calltrace.cycles-pp.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
3.24 ? 12% -1.3 1.96 ? 10% perf-profile.calltrace.cycles-pp.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64
2.62 ? 16% -1.2 1.40 ? 11% perf-profile.calltrace.cycles-pp.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_write.new_sync_write
2.27 ? 13% -1.0 1.27 ? 16% perf-profile.calltrace.cycles-pp.evict.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.91 ? 15% -0.9 1.03 ? 18% perf-profile.calltrace.cycles-pp.truncate_inode_pages_range.evict.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
2.44 ? 12% -0.9 1.56 ? 7% perf-profile.calltrace.cycles-pp.xfs_release.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode
1.44 ? 17% -0.8 0.63 ? 48% perf-profile.calltrace.cycles-pp.xfs_check_agi_freecount.xfs_dialloc_ag.xfs_dir_ialloc.xfs_create.xfs_generic_create
1.50 ? 17% -0.7 0.77 ? 13% perf-profile.calltrace.cycles-pp.iomap_write_begin.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_write
1.18 ? 16% -0.7 0.48 ? 46% perf-profile.calltrace.cycles-pp.arch_do_signal_or_restart.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.98 ? 16% -0.7 0.30 ?100% perf-profile.calltrace.cycles-pp.__pagevec_release.truncate_inode_pages_range.evict.do_unlinkat.do_syscall_64
1.28 ? 15% -0.6 0.64 ? 16% perf-profile.calltrace.cycles-pp.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor.iomap_apply
1.31 ? 14% -0.6 0.67 ? 13% perf-profile.calltrace.cycles-pp.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor.iomap_apply.iomap_file_buffered_write
1.92 ? 12% -0.6 1.29 ? 6% perf-profile.calltrace.cycles-pp.xfs_free_eofblocks.xfs_release.__fput.task_work_run.exit_to_user_mode_prepare
1.17 ? 12% -0.6 0.57 ? 45% perf-profile.calltrace.cycles-pp.filp_close.__x64_sys_close.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.42 ? 11% -0.6 0.82 ? 9% perf-profile.calltrace.cycles-pp.do_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open
1.32 ? 9% -0.6 0.74 ? 15% perf-profile.calltrace.cycles-pp.__x64_sys_fcntl.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.29 ? 12% -0.6 0.72 ? 12% perf-profile.calltrace.cycles-pp.__x64_sys_close.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.28 ? 13% -0.6 0.70 ? 10% perf-profile.calltrace.cycles-pp.__x64_sys_rename.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.95 ? 12% -0.6 0.38 ? 71% perf-profile.calltrace.cycles-pp.vfs_rename.do_renameat2.__x64_sys_rename.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.23 ? 12% -0.6 0.68 ? 11% perf-profile.calltrace.cycles-pp.do_renameat2.__x64_sys_rename.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.12 ? 8% -0.5 0.57 ? 47% perf-profile.calltrace.cycles-pp.alloc_empty_file.path_openat.do_filp_open.do_sys_openat2.do_sys_open
1.22 ? 9% -0.5 0.68 ? 15% perf-profile.calltrace.cycles-pp.do_fcntl.__x64_sys_fcntl.do_syscall_64.entry_SYSCALL_64_after_hwframe
2.55 ? 15% -0.5 2.02 ? 13% perf-profile.calltrace.cycles-pp.xfs_dialloc_ag.xfs_dir_ialloc.xfs_create.xfs_generic_create.path_openat
1.07 ? 8% -0.5 0.55 ? 47% perf-profile.calltrace.cycles-pp.__alloc_file.alloc_empty_file.path_openat.do_filp_open.do_sys_openat2
1.14 ? 9% -0.5 0.63 ? 16% perf-profile.calltrace.cycles-pp.fcntl_dirnotify.do_fcntl.__x64_sys_fcntl.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.72 ? 13% -0.4 0.36 ? 71% perf-profile.calltrace.cycles-pp.__xfs_trans_commit.xfs_free_eofblocks.xfs_release.__fput.task_work_run
2.18 ? 13% -0.3 1.86 ? 13% perf-profile.calltrace.cycles-pp.__xfs_trans_commit.xfs_create.xfs_generic_create.path_openat.do_filp_open
0.70 ? 10% +0.2 0.93 ? 11% perf-profile.calltrace.cycles-pp.xlog_cil_insert_items.xfs_log_commit_cil.__xfs_trans_commit.xfs_remove.xfs_vn_unlink
0.26 ?100% +0.5 0.75 ? 14% perf-profile.calltrace.cycles-pp.xfs_dialloc_select_ag.xfs_dir_ialloc.xfs_create.xfs_generic_create.path_openat
0.69 ? 16% +0.6 1.31 ? 17% perf-profile.calltrace.cycles-pp.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
0.09 ?223% +0.6 0.73 ? 16% perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry
0.30 ?101% +0.7 0.98 ? 20% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
0.33 ?104% +0.7 1.02 ? 11% perf-profile.calltrace.cycles-pp.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues
0.46 ? 71% +0.7 1.16 ? 14% perf-profile.calltrace.cycles-pp.xfs_iunlink.xfs_remove.xfs_vn_unlink.vfs_unlink.do_unlinkat
0.00 +0.8 0.77 ? 16% perf-profile.calltrace.cycles-pp.tick_irq_enter.irq_enter_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
0.00 +0.8 0.78 ? 16% perf-profile.calltrace.cycles-pp.irq_enter_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
0.24 ?143% +0.9 1.16 ? 16% perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary
0.00 +0.9 0.93 ? 26% perf-profile.calltrace.cycles-pp.xfs_iunlink_remove.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag
0.00 +0.9 0.93 ? 22% perf-profile.calltrace.cycles-pp.xfs_difree.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag
1.00 ? 22% +1.0 1.96 ? 10% perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
1.07 ? 23% +1.0 2.09 ? 10% perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt
0.00 +1.0 1.04 ? 24% perf-profile.calltrace.cycles-pp.xfs_inactive_truncate.xfs_inactive.xfs_icwalk_ag.xfs_icwalk.xfs_inodegc_worker
1.24 ? 21% +1.1 2.38 ? 10% perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt
0.00 +1.4 1.41 ? 25% perf-profile.calltrace.cycles-pp.xfs_log_commit_cil.__xfs_trans_commit.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag
0.00 +1.5 1.47 ? 24% perf-profile.calltrace.cycles-pp.__xfs_trans_commit.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag.xfs_icwalk
1.31 ? 27% +1.5 2.82 ? 19% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
0.00 +1.9 1.94 ? 24% perf-profile.calltrace.cycles-pp.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag.xfs_icwalk
2.04 ? 19% +2.0 4.03 ? 10% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
2.82 ? 20% +2.8 5.58 ? 10% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
2.94 ? 20% +2.9 5.85 ? 10% perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
0.00 +3.6 3.56 ? 24% perf-profile.calltrace.cycles-pp.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag.xfs_icwalk.xfs_inodegc_worker
4.32 ? 19% +4.3 8.60 ? 11% perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle
0.00 +4.7 4.67 ? 24% perf-profile.calltrace.cycles-pp.xfs_inactive.xfs_icwalk_ag.xfs_icwalk.xfs_inodegc_worker.process_one_work
0.00 +4.8 4.81 ? 24% perf-profile.calltrace.cycles-pp.xfs_icwalk.xfs_inodegc_worker.process_one_work.worker_thread.kthread
0.00 +4.8 4.81 ? 24% perf-profile.calltrace.cycles-pp.xfs_icwalk_ag.xfs_icwalk.xfs_inodegc_worker.process_one_work.worker_thread
0.00 +4.8 4.81 ? 24% perf-profile.calltrace.cycles-pp.xfs_inodegc_worker.process_one_work.worker_thread.kthread.ret_from_fork
4.69 ? 19% +4.9 9.62 ? 14% perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
0.72 ? 15% +6.3 7.06 ? 21% perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
0.54 ? 47% +6.4 6.97 ? 21% perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
0.93 ? 16% +6.9 7.87 ? 20% perf-profile.calltrace.cycles-pp.ret_from_fork
0.93 ? 16% +6.9 7.87 ? 20% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
43.77 ? 16% +14.2 57.96 ? 6% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
44.08 ? 16% +14.5 58.56 ? 6% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
47.05 ? 15% +17.1 64.19 ? 6% perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
45.98 ? 16% +17.2 63.17 ? 6% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
46.01 ? 16% +17.2 63.24 ? 6% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
46.01 ? 16% +17.2 63.24 ? 6% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
49.66 ? 14% -23.2 26.48 ? 11% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
49.52 ? 14% -23.1 26.42 ? 11% perf-profile.children.cycles-pp.do_syscall_64
17.63 ? 14% -11.2 6.42 ? 13% perf-profile.children.cycles-pp.do_unlinkat
9.28 ? 14% -9.0 0.28 ? 15% perf-profile.children.cycles-pp.destroy_inode
9.05 ? 15% -8.9 0.13 ? 19% perf-profile.children.cycles-pp.xfs_inode_mark_reclaimable
8.65 ? 15% -4.0 4.67 ? 23% perf-profile.children.cycles-pp.xfs_inactive
14.10 ? 13% -3.9 10.17 ? 11% perf-profile.children.cycles-pp.do_sys_open
14.04 ? 13% -3.9 10.14 ? 11% perf-profile.children.cycles-pp.do_sys_openat2
12.95 ? 14% -3.3 9.63 ? 11% perf-profile.children.cycles-pp.do_filp_open
12.86 ? 14% -3.3 9.58 ? 11% perf-profile.children.cycles-pp.path_openat
6.65 ? 14% -3.0 3.63 ? 10% perf-profile.children.cycles-pp.syscall_exit_to_user_mode
6.13 ? 16% -2.6 3.56 ? 24% perf-profile.children.cycles-pp.xfs_inactive_ifree
4.91 ? 16% -2.3 2.61 ? 12% perf-profile.children.cycles-pp.ksys_write
4.86 ? 16% -2.3 2.58 ? 12% perf-profile.children.cycles-pp.vfs_write
4.12 ? 18% -2.2 1.94 ? 24% perf-profile.children.cycles-pp.xfs_ifree
3.09 ? 17% -2.2 0.93 ? 22% perf-profile.children.cycles-pp.xfs_difree
4.88 ? 13% -2.1 2.78 ? 10% perf-profile.children.cycles-pp.exit_to_user_mode_prepare
2.90 ? 17% -2.1 0.84 ? 18% perf-profile.children.cycles-pp.xfs_check_agi_freecount
4.28 ? 17% -2.0 2.26 ? 12% perf-profile.children.cycles-pp.new_sync_write
4.15 ? 17% -1.9 2.21 ? 12% perf-profile.children.cycles-pp.xfs_file_buffered_write
3.68 ? 16% -1.7 1.97 ? 12% perf-profile.children.cycles-pp.iomap_file_buffered_write
3.67 ? 16% -1.7 1.96 ? 12% perf-profile.children.cycles-pp.iomap_apply
2.06 ? 17% -1.5 0.56 ? 23% perf-profile.children.cycles-pp.xfs_difree_inobt
8.67 ? 15% -1.5 7.21 ? 11% perf-profile.children.cycles-pp.xfs_generic_create
2.43 ? 12% -1.4 1.04 ? 24% perf-profile.children.cycles-pp.xfs_inactive_truncate
3.47 ? 12% -1.4 2.08 ? 10% perf-profile.children.cycles-pp.task_work_run
3.26 ? 12% -1.3 1.98 ? 10% perf-profile.children.cycles-pp.__fput
2.63 ? 16% -1.2 1.40 ? 11% perf-profile.children.cycles-pp.iomap_write_actor
2.03 ? 11% -1.2 0.81 ? 16% perf-profile.children.cycles-pp.xfs_itruncate_extents_flags
2.28 ? 13% -1.0 1.27 ? 16% perf-profile.children.cycles-pp.evict
2.06 ? 11% -0.9 1.17 ? 8% perf-profile.children.cycles-pp.xfs_trans_alloc
2.45 ? 12% -0.9 1.56 ? 7% perf-profile.children.cycles-pp.xfs_release
1.91 ? 15% -0.9 1.03 ? 17% perf-profile.children.cycles-pp.truncate_inode_pages_range
1.50 ? 17% -0.7 0.77 ? 13% perf-profile.children.cycles-pp.iomap_write_begin
1.07 ? 18% -0.7 0.37 ? 13% perf-profile.children.cycles-pp.xfs_inobt_get_rec
2.20 ? 16% -0.7 1.50 ? 16% perf-profile.children.cycles-pp.xfs_btree_lookup
1.63 ? 10% -0.6 0.98 ? 9% perf-profile.children.cycles-pp.xfs_trans_reserve
1.31 ? 15% -0.6 0.67 ? 13% perf-profile.children.cycles-pp.grab_cache_page_write_begin
1.28 ? 15% -0.6 0.64 ? 15% perf-profile.children.cycles-pp.pagecache_get_page
1.92 ? 12% -0.6 1.30 ? 6% perf-profile.children.cycles-pp.xfs_free_eofblocks
2.00 ? 13% -0.6 1.37 ? 13% perf-profile.children.cycles-pp.kmem_cache_alloc
1.19 ? 15% -0.6 0.57 ? 11% perf-profile.children.cycles-pp.arch_do_signal_or_restart
1.44 ? 11% -0.6 0.84 ? 9% perf-profile.children.cycles-pp.do_open
1.23 ? 14% -0.6 0.63 ? 13% perf-profile.children.cycles-pp.fsnotify
0.96 ? 12% -0.6 0.37 ? 20% perf-profile.children.cycles-pp.xfs_defer_finish
1.32 ? 9% -0.6 0.74 ? 15% perf-profile.children.cycles-pp.__x64_sys_fcntl
0.91 ? 18% -0.6 0.33 ? 24% perf-profile.children.cycles-pp.xfs_difree_finobt
1.30 ? 12% -0.6 0.72 ? 12% perf-profile.children.cycles-pp.__x64_sys_close
1.28 ? 13% -0.6 0.70 ? 10% perf-profile.children.cycles-pp.__x64_sys_rename
1.24 ? 12% -0.6 0.68 ? 10% perf-profile.children.cycles-pp.do_renameat2
1.22 ? 9% -0.5 0.68 ? 15% perf-profile.children.cycles-pp.do_fcntl
2.56 ? 16% -0.5 2.03 ? 13% perf-profile.children.cycles-pp.xfs_dialloc_ag
0.89 ? 11% -0.5 0.36 ? 22% perf-profile.children.cycles-pp.xfs_defer_trans_roll
1.18 ? 13% -0.5 0.65 ? 12% perf-profile.children.cycles-pp.filp_close
1.37 ? 10% -0.5 0.85 ? 8% perf-profile.children.cycles-pp.xfs_log_reserve
1.14 ? 9% -0.5 0.64 ? 16% perf-profile.children.cycles-pp.fcntl_dirnotify
0.76 ? 16% -0.5 0.27 ? 17% perf-profile.children.cycles-pp.__xfs_bunmapi
1.12 ? 7% -0.5 0.65 ? 18% perf-profile.children.cycles-pp.alloc_empty_file
0.89 ? 17% -0.5 0.43 ? 16% perf-profile.children.cycles-pp.__entry_text_start
0.77 ? 12% -0.5 0.32 ? 19% perf-profile.children.cycles-pp.xfs_inobt_update
1.08 ? 7% -0.4 0.64 ? 19% perf-profile.children.cycles-pp.__alloc_file
0.85 ? 19% -0.4 0.41 ? 15% perf-profile.children.cycles-pp.link_path_walk
0.98 ? 16% -0.4 0.54 ? 15% perf-profile.children.cycles-pp.__pagevec_release
0.90 ? 17% -0.4 0.46 ? 6% perf-profile.children.cycles-pp.syscall_return_via_sysret
0.72 ? 19% -0.4 0.28 ? 22% perf-profile.children.cycles-pp.xfs_btree_check_sblock
0.92 ? 17% -0.4 0.50 ? 14% perf-profile.children.cycles-pp.xfs_buffered_write_iomap_begin
0.95 ? 12% -0.4 0.54 ? 10% perf-profile.children.cycles-pp.vfs_rename
0.70 ? 11% -0.4 0.29 ? 17% perf-profile.children.cycles-pp.xfs_btree_update
0.86 ? 15% -0.4 0.46 ? 15% perf-profile.children.cycles-pp.__fsnotify_parent
0.81 ? 15% -0.4 0.40 ? 13% perf-profile.children.cycles-pp.getname_flags
0.78 ? 13% -0.4 0.37 ? 19% perf-profile.children.cycles-pp.xfs_trans_roll
0.69 ? 15% -0.4 0.31 ? 16% perf-profile.children.cycles-pp.add_to_page_cache_lru
0.86 ? 17% -0.4 0.50 ? 5% perf-profile.children.cycles-pp.xfs_dir_createname
1.28 ? 14% -0.4 0.91 ? 12% perf-profile.children.cycles-pp.xfs_btree_lookup_get_block
0.77 ? 12% -0.4 0.41 ? 19% perf-profile.children.cycles-pp.__x64_sys_chmod
0.76 ? 16% -0.4 0.40 ? 14% perf-profile.children.cycles-pp.dnotify_handle_event
0.63 ? 18% -0.4 0.27 ? 19% perf-profile.children.cycles-pp.xfs_btree_get_rec
0.76 ? 13% -0.4 0.40 ? 19% perf-profile.children.cycles-pp.do_fchmodat
0.67 ? 16% -0.4 0.31 ? 14% perf-profile.children.cycles-pp.filename_parentat
0.64 ? 16% -0.4 0.28 ? 14% perf-profile.children.cycles-pp.__add_to_page_cache_locked
0.63 ? 19% -0.3 0.29 ? 14% perf-profile.children.cycles-pp.xfs_log_ticket_ungrant
0.60 ? 11% -0.3 0.26 ? 16% perf-profile.children.cycles-pp.__setup_rt_frame
0.61 ? 17% -0.3 0.28 ? 16% perf-profile.children.cycles-pp.path_parentat
0.61 ? 17% -0.3 0.28 ? 25% perf-profile.children.cycles-pp.xfs_dir_removename
0.83 ? 15% -0.3 0.51 ? 17% perf-profile.children.cycles-pp.do_dentry_open
0.68 ? 16% -0.3 0.36 ? 16% perf-profile.children.cycles-pp.send_sigio
0.92 ? 12% -0.3 0.60 ? 12% perf-profile.children.cycles-pp.kmem_cache_free
0.70 ? 15% -0.3 0.38 ? 11% perf-profile.children.cycles-pp.release_pages
0.44 ? 21% -0.3 0.13 ? 23% perf-profile.children.cycles-pp.xfs_btree_increment
0.94 ? 15% -0.3 0.63 ? 11% perf-profile.children.cycles-pp.xfs_inode_item_format
0.66 ? 12% -0.3 0.35 ? 20% perf-profile.children.cycles-pp.chmod_common
0.71 ? 14% -0.3 0.41 ? 15% perf-profile.children.cycles-pp.iomap_write_end
0.50 ? 18% -0.3 0.20 ? 22% perf-profile.children.cycles-pp.__xfs_btree_check_sblock
0.61 ? 16% -0.3 0.32 ? 17% perf-profile.children.cycles-pp.send_sigio_to_task
0.61 ? 13% -0.3 0.32 ? 20% perf-profile.children.cycles-pp.notify_change
0.59 ? 19% -0.3 0.31 ? 10% perf-profile.children.cycles-pp.xfs_dir2_sf_addname
0.61 ? 12% -0.3 0.34 ? 15% perf-profile.children.cycles-pp.dnotify_flush
0.59 ? 15% -0.3 0.34 ? 14% perf-profile.children.cycles-pp.iomap_set_page_dirty
0.52 ? 17% -0.3 0.27 ? 15% perf-profile.children.cycles-pp.do_send_sig_info
0.46 ? 17% -0.3 0.20 ? 16% perf-profile.children.cycles-pp.inode_permission
0.53 ? 11% -0.2 0.28 ? 12% perf-profile.children.cycles-pp.strncpy_from_user
0.32 ? 15% -0.2 0.08 ? 32% perf-profile.children.cycles-pp.xfs_bmap_del_extent_delay
0.62 ? 12% -0.2 0.38 ? 15% perf-profile.children.cycles-pp.xfs_vn_rename
0.61 ? 12% -0.2 0.38 ? 16% perf-profile.children.cycles-pp.xfs_rename
0.48 ? 14% -0.2 0.26 ? 13% perf-profile.children.cycles-pp.fsnotify_put_mark
0.40 ? 19% -0.2 0.18 ? 14% perf-profile.children.cycles-pp.xlog_grant_add_space
0.42 ? 22% -0.2 0.20 ? 11% perf-profile.children.cycles-pp.dput
0.38 ? 10% -0.2 0.16 ? 25% perf-profile.children.cycles-pp.xlog_ticket_alloc
0.40 ? 20% -0.2 0.19 ? 9% perf-profile.children.cycles-pp.___might_sleep
0.46 ? 17% -0.2 0.26 ? 8% perf-profile.children.cycles-pp.xfs_bmapi_reserve_delalloc
0.39 ? 15% -0.2 0.20 ? 17% perf-profile.children.cycles-pp.__send_signal
0.34 ? 21% -0.2 0.16 ? 27% perf-profile.children.cycles-pp.xfs_mod_fdblocks
0.51 ? 14% -0.2 0.33 ? 8% perf-profile.children.cycles-pp.xfs_trans_alloc_icreate
0.37 ? 14% -0.2 0.19 ? 17% perf-profile.children.cycles-pp.__x64_sys_rt_sigreturn
0.36 ? 22% -0.2 0.18 ? 27% perf-profile.children.cycles-pp.delete_from_page_cache_batch
0.35 ? 10% -0.2 0.17 ? 24% perf-profile.children.cycles-pp.fsnotify_add_mark_locked
0.43 ? 19% -0.2 0.26 ? 10% perf-profile.children.cycles-pp.ksys_read
0.80 ? 12% -0.2 0.62 ? 10% perf-profile.children.cycles-pp.xfs_trans_log_inode
0.40 ? 19% -0.2 0.23 ? 26% perf-profile.children.cycles-pp.lru_add_drain
0.42 ? 19% -0.2 0.25 ? 11% perf-profile.children.cycles-pp.vfs_read
0.39 ? 16% -0.2 0.22 ? 10% perf-profile.children.cycles-pp.mem_cgroup_uncharge_list
0.32 ? 19% -0.2 0.16 ? 27% perf-profile.children.cycles-pp.xfs_file_write_checks
0.32 ? 21% -0.2 0.15 ? 15% perf-profile.children.cycles-pp.get_signal
0.28 ? 25% -0.2 0.12 ? 15% perf-profile.children.cycles-pp.__raw_callee_save___native_queued_spin_unlock
0.23 ? 17% -0.2 0.07 ? 24% perf-profile.children.cycles-pp.xfs_perag_set_inode_tag
0.34 ? 7% -0.2 0.18 ? 14% perf-profile.children.cycles-pp.__check_object_size
0.37 ? 21% -0.2 0.21 ? 25% perf-profile.children.cycles-pp.lru_add_drain_cpu
0.34 ? 9% -0.2 0.19 ? 21% perf-profile.children.cycles-pp.xfs_vn_setattr
0.28 ? 20% -0.2 0.12 ? 23% perf-profile.children.cycles-pp.copy_fpstate_to_sigframe
0.22 ? 22% -0.2 0.06 ? 55% perf-profile.children.cycles-pp.alloc_fd
0.18 ? 19% -0.1 0.03 ?103% perf-profile.children.cycles-pp.xfs_btree_update_keys
0.22 ? 21% -0.1 0.08 ? 8% perf-profile.children.cycles-pp.xfs_inode_item_size
0.41 ? 12% -0.1 0.27 ? 10% perf-profile.children.cycles-pp.__alloc_pages
0.27 ? 19% -0.1 0.13 ? 20% perf-profile.children.cycles-pp.__x64_sys_unlink
0.24 ? 19% -0.1 0.10 ? 23% perf-profile.children.cycles-pp.map_id_range_down
0.32 ? 18% -0.1 0.19 ? 26% perf-profile.children.cycles-pp.xfs_dir2_sf_removename
0.31 ? 10% -0.1 0.17 ? 20% perf-profile.children.cycles-pp.xfs_setattr_nonsize
0.33 ? 13% -0.1 0.19 ? 26% perf-profile.children.cycles-pp.security_file_alloc
0.26 ? 9% -0.1 0.12 ? 13% perf-profile.children.cycles-pp.complete_walk
0.28 ? 29% -0.1 0.14 ? 22% perf-profile.children.cycles-pp.xfs_trans_add_item
0.26 ? 19% -0.1 0.13 ? 29% perf-profile.children.cycles-pp.xas_store
0.27 ? 20% -0.1 0.14 ? 10% perf-profile.children.cycles-pp.xfs_ilock
0.26 ? 16% -0.1 0.13 ? 11% perf-profile.children.cycles-pp.memset_erms
0.24 ? 21% -0.1 0.11 ? 15% perf-profile.children.cycles-pp.xfs_trans_log_buf
0.24 ? 15% -0.1 0.11 ? 26% perf-profile.children.cycles-pp.xfs_errortag_test
0.32 ? 18% -0.1 0.19 ? 12% perf-profile.children.cycles-pp.uncharge_batch
0.22 ? 13% -0.1 0.10 ? 18% perf-profile.children.cycles-pp.restore_sigcontext
0.30 ? 15% -0.1 0.18 ? 15% perf-profile.children.cycles-pp.xfs_can_free_eofblocks
0.25 ? 7% -0.1 0.13 ? 10% perf-profile.children.cycles-pp.try_to_unlazy
0.23 ? 17% -0.1 0.10 ? 11% perf-profile.children.cycles-pp.generic_permission
0.22 ? 19% -0.1 0.09 ? 7% perf-profile.children.cycles-pp.make_kuid
0.25 ? 16% -0.1 0.13 ? 8% perf-profile.children.cycles-pp.xfs_btree_ptr_to_daddr
0.22 ? 29% -0.1 0.10 ? 6% perf-profile.children.cycles-pp.iov_iter_copy_from_user_atomic
0.27 ? 25% -0.1 0.15 ? 27% perf-profile.children.cycles-pp.xfs_inobt_init_cursor
0.20 ? 20% -0.1 0.08 ? 26% perf-profile.children.cycles-pp.xfs_inobt_get_maxrecs
0.18 ? 19% -0.1 0.06 ? 17% perf-profile.children.cycles-pp.xfs_btree_rec_offset
0.30 ? 19% -0.1 0.18 ? 16% perf-profile.children.cycles-pp.__might_sleep
0.27 ? 15% -0.1 0.16 ? 13% perf-profile.children.cycles-pp.__set_page_dirty
0.23 ? 19% -0.1 0.12 ? 9% perf-profile.children.cycles-pp.__lookup_hash
0.20 ? 26% -0.1 0.08 ? 13% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
0.15 ? 21% -0.1 0.04 ? 75% perf-profile.children.cycles-pp.xfs_file_buffered_read
0.20 ? 21% -0.1 0.08 ? 23% perf-profile.children.cycles-pp.xfs_trans_free
0.31 ? 17% -0.1 0.20 ? 11% perf-profile.children.cycles-pp.page_counter_uncharge
0.15 ? 59% -0.1 0.04 ? 73% perf-profile.children.cycles-pp.may_delete
0.26 ? 20% -0.1 0.15 ? 19% perf-profile.children.cycles-pp.xfs_iunlock
0.16 ? 21% -0.1 0.06 ? 48% perf-profile.children.cycles-pp.up_read
0.20 ? 10% -0.1 0.10 ? 18% perf-profile.children.cycles-pp.__virt_addr_valid
0.20 ? 15% -0.1 0.09 ? 27% perf-profile.children.cycles-pp.fsnotify_grab_connector
0.18 ? 29% -0.1 0.08 ? 11% perf-profile.children.cycles-pp.copyin
0.18 ? 19% -0.1 0.08 ? 17% perf-profile.children.cycles-pp.xfs_trans_dirty_buf
0.16 ? 24% -0.1 0.06 ? 20% perf-profile.children.cycles-pp.xfs_file_read_iter
0.21 ? 18% -0.1 0.12 ? 13% perf-profile.children.cycles-pp.down_write
0.13 ? 19% -0.1 0.03 ?102% perf-profile.children.cycles-pp.security_path_unlink
0.27 ? 15% -0.1 0.17 ? 11% perf-profile.children.cycles-pp.page_counter_cancel
0.25 ? 15% -0.1 0.15 ? 29% perf-profile.children.cycles-pp.xfs_perag_clear_inode_tag
0.26 ? 21% -0.1 0.17 ? 13% perf-profile.children.cycles-pp.xfs_bmap_add_extent_hole_delay
0.22 ? 27% -0.1 0.12 ? 13% perf-profile.children.cycles-pp.xfs_trans_del_item
0.23 ? 23% -0.1 0.13 ? 21% perf-profile.children.cycles-pp.xfs_inobt_init_common
0.12 ? 19% -0.1 0.03 ?105% perf-profile.children.cycles-pp.filemap_read
0.14 ? 12% -0.1 0.04 ? 73% perf-profile.children.cycles-pp.xfs_iext_lookup_extent_before
0.17 ? 11% -0.1 0.08 ? 12% perf-profile.children.cycles-pp.xfs_ialloc_log_agi
0.18 ? 16% -0.1 0.09 ? 18% perf-profile.children.cycles-pp.__fsnotify_update_child_dentry_flags
0.20 ? 16% -0.1 0.11 ? 13% perf-profile.children.cycles-pp.iput
0.19 ? 7% -0.1 0.10 ? 25% perf-profile.children.cycles-pp.__mod_lruvec_page_state
0.19 ? 13% -0.1 0.10 ? 11% perf-profile.children.cycles-pp.mem_cgroup_charge
0.19 ? 16% -0.1 0.10 ? 20% perf-profile.children.cycles-pp.new_sync_read
0.19 ? 22% -0.1 0.10 ? 33% perf-profile.children.cycles-pp.__cancel_dirty_page
0.16 ? 21% -0.1 0.07 ? 48% perf-profile.children.cycles-pp.entry_SYSCALL_64_safe_stack
0.14 ? 10% -0.1 0.05 ? 74% perf-profile.children.cycles-pp.xfs_dir2_sf_lookup
0.23 ? 14% -0.1 0.15 ? 18% perf-profile.children.cycles-pp.__cond_resched
0.22 ? 16% -0.1 0.14 ? 24% perf-profile.children.cycles-pp.get_obj_cgroup_from_current
0.13 ? 14% -0.1 0.04 ? 75% perf-profile.children.cycles-pp.fsnotify_find_mark
0.15 ? 12% -0.1 0.06 ? 19% perf-profile.children.cycles-pp.__fpu__restore_sig
0.20 ? 12% -0.1 0.12 ? 19% perf-profile.children.cycles-pp.ima_file_check
0.22 ? 22% -0.1 0.14 ? 28% perf-profile.children.cycles-pp.apparmor_file_alloc_security
0.11 ? 25% -0.1 0.04 ?105% perf-profile.children.cycles-pp.xfs_dir_open
0.17 ? 17% -0.1 0.09 ? 16% perf-profile.children.cycles-pp.may_open
0.16 ? 20% -0.1 0.08 ? 19% perf-profile.children.cycles-pp.dequeue_signal
0.17 ? 19% -0.1 0.10 ? 10% perf-profile.children.cycles-pp.xfs_droplink
0.16 ? 14% -0.1 0.09 ? 8% perf-profile.children.cycles-pp.inode_io_list_del
0.12 ? 14% -0.1 0.04 ? 74% perf-profile.children.cycles-pp.rcu_all_qs
0.10 ? 15% -0.1 0.03 ?105% perf-profile.children.cycles-pp.fsnotify_destroy_marks
0.15 ? 14% -0.1 0.08 ? 20% perf-profile.children.cycles-pp.security_file_permission
0.12 ? 19% -0.1 0.05 ? 73% perf-profile.children.cycles-pp.__d_lookup_rcu
0.13 ? 27% -0.1 0.06 ? 52% perf-profile.children.cycles-pp.__might_fault
0.12 ? 22% -0.1 0.04 ? 72% perf-profile.children.cycles-pp.xfs_buf_item_put
0.17 ? 24% -0.1 0.10 ? 25% perf-profile.children.cycles-pp.xfs_idata_realloc
0.14 ? 5% -0.1 0.07 ? 9% perf-profile.children.cycles-pp.__legitimize_path
0.14 ? 17% -0.1 0.08 ? 27% perf-profile.children.cycles-pp.__srcu_read_lock
0.13 ? 16% -0.1 0.06 ? 49% perf-profile.children.cycles-pp.current_time
0.15 ? 13% -0.1 0.09 ? 34% perf-profile.children.cycles-pp.find_lock_entries
0.12 ? 15% -0.1 0.06 ? 47% perf-profile.children.cycles-pp.dentry_unlink_inode
0.13 ? 18% -0.1 0.07 ? 53% perf-profile.children.cycles-pp.d_instantiate
0.18 ? 13% -0.1 0.11 ? 6% perf-profile.children.cycles-pp.__mod_memcg_lruvec_state
0.15 ? 14% -0.1 0.08 ? 14% perf-profile.children.cycles-pp.security_task_getsecid_subj
0.16 ? 19% -0.1 0.10 ? 10% perf-profile.children.cycles-pp.xfs_iext_insert
0.14 ? 14% -0.1 0.08 ? 14% perf-profile.children.cycles-pp.free_unref_page_list
0.09 ? 27% -0.1 0.03 ?100% perf-profile.children.cycles-pp.xfs_break_layouts
0.13 ? 14% -0.1 0.06 ? 45% perf-profile.children.cycles-pp.fsnotify_mark_destroy_workfn
0.10 ? 18% -0.1 0.04 ? 75% perf-profile.children.cycles-pp.fput_many
0.11 ? 16% -0.1 0.05 ? 45% perf-profile.children.cycles-pp.refcount_dec_and_lock
0.15 ? 21% -0.1 0.09 ? 16% perf-profile.children.cycles-pp.up_write
0.13 ? 13% -0.1 0.07 ? 11% perf-profile.children.cycles-pp.apparmor_task_getsecid
0.12 ? 29% -0.1 0.06 ? 23% perf-profile.children.cycles-pp.inode_init_always
0.09 ? 15% -0.1 0.03 ?100% perf-profile.children.cycles-pp.fsnotify_final_mark_destroy
0.11 ? 13% -0.1 0.06 ? 47% perf-profile.children.cycles-pp.fpu__clear
0.14 ? 16% -0.1 0.08 ? 13% perf-profile.children.cycles-pp.xfs_btree_check_ptr
0.11 ? 18% -0.1 0.05 ? 71% perf-profile.children.cycles-pp.percpu_counter_add_batch
0.14 ? 18% -0.1 0.08 ? 21% perf-profile.children.cycles-pp.xfs_iext_lookup_extent
0.10 ? 26% -0.1 0.04 ? 72% perf-profile.children.cycles-pp.d_lookup
0.14 ? 26% -0.1 0.08 ? 16% perf-profile.children.cycles-pp.xfs_trans_unreserve_and_mod_sb
0.13 ? 23% -0.1 0.07 ? 33% perf-profile.children.cycles-pp.account_page_cleaned
0.11 ? 21% -0.1 0.06 ? 11% perf-profile.children.cycles-pp.__mem_cgroup_charge
0.13 ? 17% -0.1 0.08 ? 8% perf-profile.children.cycles-pp.__irqentry_text_end
0.14 ? 12% -0.1 0.09 ? 20% perf-profile.children.cycles-pp.account_page_dirtied
0.08 ? 16% -0.1 0.03 ?100% perf-profile.children.cycles-pp.file_update_time
0.10 ? 21% -0.1 0.05 ? 47% perf-profile.children.cycles-pp.xfs_lock_two_inodes
0.16 ? 16% -0.1 0.11 ? 11% perf-profile.children.cycles-pp.xfs_bmapi_read
0.10 ? 13% -0.0 0.05 ? 49% perf-profile.children.cycles-pp.security_path_mknod
0.11 ? 18% -0.0 0.06 ? 6% perf-profile.children.cycles-pp.xfs_ialloc_ag_select
0.14 ? 22% -0.0 0.09 ? 25% perf-profile.children.cycles-pp.xfs_perag_put
0.08 ? 19% -0.0 0.03 ?100% perf-profile.children.cycles-pp.common_file_perm
0.14 ? 22% -0.0 0.10 ? 22% perf-profile.children.cycles-pp.map_id_up
0.09 ? 13% -0.0 0.04 ? 71% perf-profile.children.cycles-pp.rcu_read_unlock_strict
0.13 ? 18% -0.0 0.09 ? 15% perf-profile.children.cycles-pp._atomic_dec_and_lock
0.08 ? 13% -0.0 0.05 ? 46% perf-profile.children.cycles-pp.xfs_isilocked
0.06 ? 17% +0.0 0.10 ? 11% perf-profile.children.cycles-pp.handle_mm_fault
0.07 ? 20% +0.0 0.10 ? 9% perf-profile.children.cycles-pp.do_user_addr_fault
0.07 ? 17% +0.0 0.11 ? 11% perf-profile.children.cycles-pp.exc_page_fault
0.05 ? 49% +0.0 0.09 ? 11% perf-profile.children.cycles-pp.__handle_mm_fault
0.08 ? 19% +0.0 0.12 ? 8% perf-profile.children.cycles-pp.asm_exc_page_fault
0.08 ? 22% +0.0 0.12 ? 12% perf-profile.children.cycles-pp.xfs_btree_del_cursor
0.03 ?100% +0.0 0.08 ? 16% perf-profile.children.cycles-pp.call_cpuidle
0.04 ? 72% +0.0 0.09 ? 14% perf-profile.children.cycles-pp.tick_nohz_tick_stopped
0.00 +0.1 0.05 perf-profile.children.cycles-pp.rcu_is_cpu_rrupt_from_idle
0.04 ? 75% +0.1 0.09 ? 17% perf-profile.children.cycles-pp.__x64_sys_execve
0.04 ? 75% +0.1 0.09 ? 17% perf-profile.children.cycles-pp.execve
0.02 ?144% +0.1 0.08 ? 20% perf-profile.children.cycles-pp.bprm_execve
0.00 +0.1 0.06 ? 13% perf-profile.children.cycles-pp.inode_init_once
0.00 +0.1 0.06 ? 18% perf-profile.children.cycles-pp.rcu_segcblist_ready_cbs
0.06 ? 48% +0.1 0.12 ? 19% perf-profile.children.cycles-pp.trigger_load_balance
0.04 ? 73% +0.1 0.10 ? 11% perf-profile.children.cycles-pp.hrtimer_get_next_event
0.18 ? 23% +0.1 0.24 ? 13% perf-profile.children.cycles-pp.update_sd_lb_stats
0.07 ? 53% +0.1 0.13 ? 9% perf-profile.children.cycles-pp.irqtime_account_process_tick
0.03 ?103% +0.1 0.09 ? 17% perf-profile.children.cycles-pp.do_execveat_common
0.07 ? 22% +0.1 0.13 ? 9% perf-profile.children.cycles-pp.menu_reflect
0.08 ? 21% +0.1 0.15 ? 10% perf-profile.children.cycles-pp.tick_nohz_irq_exit
0.00 +0.1 0.06 ? 11% perf-profile.children.cycles-pp.tsc_verify_tsc_adjust
0.01 ?223% +0.1 0.07 ? 18% perf-profile.children.cycles-pp.rcu_nocb_flush_deferred_wakeup
0.00 +0.1 0.06 ? 11% perf-profile.children.cycles-pp.xfs_alloc_ag_vextent_near
0.03 ?100% +0.1 0.10 ? 10% perf-profile.children.cycles-pp.arch_cpu_idle_enter
0.06 ? 21% +0.1 0.14 ? 22% perf-profile.children.cycles-pp.xfs_cil_prepare_item
0.00 +0.1 0.07 ? 16% perf-profile.children.cycles-pp.xfs_inode_item_init
0.03 ?103% +0.1 0.10 ? 23% perf-profile.children.cycles-pp.tick_check_broadcast_expired
0.00 +0.1 0.07 ? 18% perf-profile.children.cycles-pp.__libc_fork
0.02 ?144% +0.1 0.09 ? 29% perf-profile.children.cycles-pp.rcu_nmi_exit
0.00 +0.1 0.07 ? 14% perf-profile.children.cycles-pp.select_task_rq_fair
0.03 ?101% +0.1 0.10 ? 21% perf-profile.children.cycles-pp.cpuidle_not_available
0.00 +0.1 0.08 ? 16% perf-profile.children.cycles-pp.read
0.02 ?141% +0.1 0.09 ? 13% perf-profile.children.cycles-pp.tick_program_event
0.03 ?102% +0.1 0.10 ? 18% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
0.19 ? 22% +0.1 0.27 ? 13% perf-profile.children.cycles-pp.find_busiest_group
0.00 +0.1 0.08 ? 24% perf-profile.children.cycles-pp.cpuidle_reflect
0.02 ?142% +0.1 0.10 ? 29% perf-profile.children.cycles-pp.can_stop_idle_tick
0.00 +0.1 0.08 ? 16% perf-profile.children.cycles-pp.__intel_pmu_enable_all
0.20 ? 22% +0.1 0.28 ? 17% perf-profile.children.cycles-pp.xfs_dialloc_ag_finobt_near
0.00 +0.1 0.08 ? 23% perf-profile.children.cycles-pp.irq_work_needs_cpu
0.00 +0.1 0.08 ? 17% perf-profile.children.cycles-pp.x86_pmu_disable
0.02 ?146% +0.1 0.10 ? 31% perf-profile.children.cycles-pp.rcu_nmi_enter
0.05 ? 77% +0.1 0.13 ? 15% perf-profile.children.cycles-pp.perf_event_task_tick
0.05 ? 48% +0.1 0.14 ? 22% perf-profile.children.cycles-pp.native_apic_mem_write
0.00 +0.1 0.08 ? 25% perf-profile.children.cycles-pp.asm_common_interrupt
0.00 +0.1 0.08 ? 25% perf-profile.children.cycles-pp.common_interrupt
0.01 ?223% +0.1 0.09 ? 15% perf-profile.children.cycles-pp.update_curr
0.00 +0.1 0.08 ? 27% perf-profile.children.cycles-pp.xfs_btree_dup_cursor
0.06 ? 46% +0.1 0.14 ? 22% perf-profile.children.cycles-pp.rb_next
0.04 ?110% +0.1 0.13 ? 16% perf-profile.children.cycles-pp.rcu_eqs_enter
0.06 ? 46% +0.1 0.15 ? 16% perf-profile.children.cycles-pp.irqentry_exit
0.00 +0.1 0.09 ? 15% perf-profile.children.cycles-pp.xfs_alloc_ag_vextent
0.09 ? 28% +0.1 0.18 ? 16% perf-profile.children.cycles-pp.pick_next_task_fair
0.08 ? 34% +0.1 0.17 ? 24% perf-profile.children.cycles-pp.irqentry_enter
0.00 +0.1 0.09 ? 22% perf-profile.children.cycles-pp.crc_21
0.06 ? 52% +0.1 0.16 ? 19% perf-profile.children.cycles-pp.tick_check_oneshot_broadcast_this_cpu
0.13 ? 34% +0.1 0.22 ? 18% perf-profile.children.cycles-pp.arch_scale_freq_tick
0.09 ? 14% +0.1 0.18 ? 12% perf-profile.children.cycles-pp.__hrtimer_get_next_event
0.15 ? 26% +0.1 0.24 ? 11% perf-profile.children.cycles-pp.ktime_get_update_offsets_now
0.02 ?141% +0.1 0.12 ? 10% perf-profile.children.cycles-pp.get_cpu_device
0.04 ?104% +0.1 0.13 ? 20% perf-profile.children.cycles-pp.pm_qos_read_value
0.06 ? 50% +0.1 0.15 ? 23% perf-profile.children.cycles-pp._xfs_buf_obj_cmp
0.06 ? 51% +0.1 0.16 ? 23% perf-profile.children.cycles-pp.nr_iowait_cpu
0.06 ? 17% +0.1 0.16 ? 14% perf-profile.children.cycles-pp.rb_erase
0.00 +0.1 0.10 ? 11% perf-profile.children.cycles-pp.enqueue_entity
0.00 +0.1 0.10 ? 32% perf-profile.children.cycles-pp.xfs_inode_free_callback
0.07 ? 59% +0.1 0.17 ? 14% perf-profile.children.cycles-pp.rcu_eqs_exit
0.00 +0.1 0.10 ? 22% perf-profile.children.cycles-pp.__perf_event_task_sched_in
0.00 +0.1 0.10 ? 17% perf-profile.children.cycles-pp.xfs_ialloc_inode_init
0.00 +0.1 0.11 ? 13% perf-profile.children.cycles-pp.xfs_alloc_vextent
0.03 ?102% +0.1 0.14 ? 26% perf-profile.children.cycles-pp.update_load_avg
0.00 +0.1 0.12 ? 41% perf-profile.children.cycles-pp.__sysvec_call_function_single
0.15 ? 18% +0.1 0.27 ? 15% perf-profile.children.cycles-pp.timerqueue_add
0.16 ? 29% +0.1 0.28 ? 18% perf-profile.children.cycles-pp.run_ksoftirqd
0.17 ? 29% +0.1 0.30 ? 19% perf-profile.children.cycles-pp.smpboot_thread_fn
0.10 ? 28% +0.1 0.22 ? 23% perf-profile.children.cycles-pp.update_ts_time_stats
0.00 +0.1 0.13 ? 21% perf-profile.children.cycles-pp.__perf_event_task_sched_out
0.06 ? 11% +0.1 0.19 ? 12% perf-profile.children.cycles-pp.__intel_pmu_disable_all
0.00 +0.1 0.13 ? 17% perf-profile.children.cycles-pp.xfs_fs_inode_init_once
0.18 ? 17% +0.1 0.31 ? 16% perf-profile.children.cycles-pp.enqueue_hrtimer
0.13 ? 17% +0.1 0.27 ? 14% perf-profile.children.cycles-pp.update_irq_load_avg
0.00 +0.1 0.14 ? 40% perf-profile.children.cycles-pp.sched_ttwu_pending
0.16 ? 14% +0.1 0.30 ? 13% perf-profile.children.cycles-pp.update_blocked_averages
0.06 ? 11% +0.1 0.20 ? 15% perf-profile.children.cycles-pp.intel_pmu_disable_all
0.00 +0.1 0.14 ? 14% perf-profile.children.cycles-pp.xfs_iunlink_insert_backref
0.00 +0.1 0.14 ? 11% perf-profile.children.cycles-pp.enqueue_task_fair
0.12 ? 35% +0.1 0.27 ? 14% perf-profile.children.cycles-pp.rcu_idle_exit
0.00 +0.1 0.14 ? 13% perf-profile.children.cycles-pp.ttwu_do_activate
0.12 ? 26% +0.1 0.26 ? 15% perf-profile.children.cycles-pp.hrtimer_next_event_without
0.00 +0.1 0.15 ? 21% perf-profile.children.cycles-pp.xfs_iunlink_map_prev
0.00 +0.2 0.15 ? 39% perf-profile.children.cycles-pp.sysvec_call_function_single
0.13 ? 34% +0.2 0.28 ? 17% perf-profile.children.cycles-pp.get_next_timer_interrupt
0.16 ? 14% +0.2 0.31 ? 12% perf-profile.children.cycles-pp.run_rebalance_domains
0.10 ? 23% +0.2 0.25 ? 20% perf-profile.children.cycles-pp.__slab_free
0.00 +0.2 0.16 ? 21% perf-profile.children.cycles-pp.dequeue_entity
0.44 ? 21% +0.2 0.60 ? 12% perf-profile.children.cycles-pp.xfs_iunlink_update_inode
0.09 ? 34% +0.2 0.25 ? 24% perf-profile.children.cycles-pp.xfs_contig_bits
0.00 +0.2 0.16 ? 58% perf-profile.children.cycles-pp.xfs_inode_item_committed
0.00 +0.2 0.16 ? 40% perf-profile.children.cycles-pp.xfs_buf_ioend
0.00 +0.2 0.16 ? 19% perf-profile.children.cycles-pp.__perf_pmu_sched_task
0.33 ? 14% +0.2 0.50 ? 18% perf-profile.children.cycles-pp.rcu_core
0.26 ? 24% +0.2 0.43 ? 16% perf-profile.children.cycles-pp.rebalance_domains
0.18 ? 24% +0.2 0.35 ? 10% perf-profile.children.cycles-pp.lapic_next_deadline
0.16 ? 28% +0.2 0.33 ? 13% perf-profile.children.cycles-pp.__hrtimer_next_event_base
0.11 ? 12% +0.2 0.28 ? 20% perf-profile.children.cycles-pp.allocate_slab
0.16 ? 20% +0.2 0.33 ? 14% perf-profile.children.cycles-pp.native_sched_clock
0.00 +0.2 0.18 ? 17% perf-profile.children.cycles-pp.dequeue_task_fair
0.17 ? 11% +0.2 0.35 ? 15% perf-profile.children.cycles-pp.irqtime_account_irq
0.18 ? 16% +0.2 0.37 ? 9% perf-profile.children.cycles-pp.hrtimer_update_next_event
0.23 ? 15% +0.2 0.42 ? 11% perf-profile.children.cycles-pp.read_tsc
0.00 +0.2 0.19 ? 28% perf-profile.children.cycles-pp.xfs_iflush
0.14 ? 28% +0.2 0.34 ? 14% perf-profile.children.cycles-pp.cpuidle_governor_latency_req
0.00 +0.2 0.20 ? 23% perf-profile.children.cycles-pp.perf_pmu_sched_task
0.00 +0.2 0.20 ? 38% perf-profile.children.cycles-pp.asm_sysvec_call_function_single
0.00 +0.2 0.21 ? 31% perf-profile.children.cycles-pp.xfs_reclaim_worker
0.28 ? 24% +0.2 0.49 ? 15% perf-profile.children.cycles-pp.xfs_imap_to_bp
0.00 +0.2 0.22 ? 35% perf-profile.children.cycles-pp.xfs_buf_inode_iodone
0.18 ? 18% +0.2 0.40 ? 11% perf-profile.children.cycles-pp.timerqueue_del
0.27 ? 18% +0.2 0.50 ? 16% perf-profile.children.cycles-pp.io_serial_in
0.00 +0.2 0.22 ? 17% perf-profile.children.cycles-pp.kmem_alloc_large
0.22 ? 17% +0.2 0.44 ? 10% perf-profile.children.cycles-pp.update_rq_clock
0.14 ? 20% +0.2 0.37 ? 15% perf-profile.children.cycles-pp.___slab_alloc
0.22 ? 20% +0.2 0.44 ? 13% perf-profile.children.cycles-pp.sched_clock_cpu
0.15 ? 19% +0.2 0.38 ? 15% perf-profile.children.cycles-pp.__slab_alloc
0.00 +0.2 0.24 ? 11% perf-profile.children.cycles-pp.xfs_ialloc_ag_alloc
0.29 ? 10% +0.2 0.53 ? 9% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
0.15 ? 31% +0.2 0.40 ? 22% perf-profile.children.cycles-pp.up
0.32 ? 14% +0.3 0.57 ? 8% perf-profile.children.cycles-pp.xfs_dialloc_ag_update_inobt
0.20 ? 30% +0.3 0.46 ? 21% perf-profile.children.cycles-pp.xfs_buf_unlock
0.20 ? 15% +0.3 0.46 ? 18% perf-profile.children.cycles-pp.rcu_sched_clock_irq
0.41 ? 23% +0.3 0.69 ? 13% perf-profile.children.cycles-pp.serial8250_console_write
0.22 ? 18% +0.3 0.50 ? 15% perf-profile.children.cycles-pp.__remove_hrtimer
0.40 ? 23% +0.3 0.68 ? 13% perf-profile.children.cycles-pp.uart_console_write
0.39 ? 24% +0.3 0.68 ? 14% perf-profile.children.cycles-pp.serial8250_console_putchar
0.40 ? 25% +0.3 0.68 ? 14% perf-profile.children.cycles-pp.wait_for_xmitr
0.47 ? 16% +0.3 0.75 ? 13% perf-profile.children.cycles-pp.xfs_dialloc_select_ag
0.32 ? 21% +0.3 0.61 ? 8% perf-profile.children.cycles-pp.clockevents_program_event
0.12 ? 13% +0.3 0.41 ? 11% perf-profile.children.cycles-pp.try_to_wake_up
0.42 ? 20% +0.3 0.72 ? 11% perf-profile.children.cycles-pp.asm_sysvec_irq_work
0.42 ? 20% +0.3 0.72 ? 11% perf-profile.children.cycles-pp.sysvec_irq_work
0.42 ? 20% +0.3 0.72 ? 11% perf-profile.children.cycles-pp.__sysvec_irq_work
0.42 ? 20% +0.3 0.72 ? 11% perf-profile.children.cycles-pp.irq_work_run
0.42 ? 20% +0.3 0.72 ? 11% perf-profile.children.cycles-pp.irq_work_single
0.42 ? 20% +0.3 0.72 ? 11% perf-profile.children.cycles-pp.printk
0.42 ? 20% +0.3 0.72 ? 11% perf-profile.children.cycles-pp.vprintk_emit
0.42 ? 20% +0.3 0.72 ? 11% perf-profile.children.cycles-pp.console_unlock
0.44 ? 20% +0.3 0.75 ? 10% perf-profile.children.cycles-pp.irq_work_run_list
0.00 +0.3 0.31 ? 19% perf-profile.children.cycles-pp.xlog_write
0.00 +0.3 0.33 ? 16% perf-profile.children.cycles-pp.xfs_iunlink_update_dinode
0.00 +0.3 0.33 ? 30% perf-profile.children.cycles-pp.xfs_iflush_cluster
0.00 +0.3 0.34 ? 13% perf-profile.children.cycles-pp.crc32c_pcl_intel_update
0.00 +0.3 0.35 ? 23% perf-profile.children.cycles-pp.finish_task_switch
0.00 +0.4 0.36 ? 30% perf-profile.children.cycles-pp.xfs_inode_item_push
0.00 +0.4 0.37 ? 49% perf-profile.children.cycles-pp.xfs_trans_committed_bulk
0.00 +0.4 0.37 ? 12% perf-profile.children.cycles-pp.xfs_inode_alloc
0.40 ? 16% +0.4 0.78 ? 5% perf-profile.children.cycles-pp.ktime_get
0.00 +0.4 0.40 ? 13% perf-profile.children.cycles-pp.xfs_dinode_calc_crc
0.00 +0.4 0.40 ? 13% perf-profile.children.cycles-pp.crc32c
0.00 +0.4 0.40 ? 21% perf-profile.children.cycles-pp.xlog_cil_push_work
0.35 ? 26% +0.4 0.78 ? 16% perf-profile.children.cycles-pp.tick_nohz_next_event
0.36 ? 19% +0.4 0.79 ? 15% perf-profile.children.cycles-pp.tick_irq_enter
0.00 +0.4 0.44 ? 29% perf-profile.children.cycles-pp.xfsaild_push
0.00 +0.4 0.44 ? 29% perf-profile.children.cycles-pp.xfsaild
0.36 ? 20% +0.4 0.81 ? 15% perf-profile.children.cycles-pp.irq_enter_rcu
0.67 ? 23% +0.5 1.13 ? 11% perf-profile.children.cycles-pp.scheduler_tick
0.03 ?100% +0.5 0.49 ? 18% perf-profile.children.cycles-pp.schedule_timeout
0.15 ? 20% +0.5 0.62 ? 12% perf-profile.children.cycles-pp.schedule
0.04 ? 45% +0.5 0.54 ? 22% perf-profile.children.cycles-pp.schedule_idle
0.00 +0.5 0.52 ? 23% perf-profile.children.cycles-pp.__down
0.00 +0.5 0.52 ? 22% perf-profile.children.cycles-pp.down
0.00 +0.5 0.53 ? 47% perf-profile.children.cycles-pp.xlog_cil_process_committed
0.00 +0.5 0.53 ? 47% perf-profile.children.cycles-pp.xlog_cil_committed
0.00 +0.5 0.53 ? 24% perf-profile.children.cycles-pp.xfs_buf_lock
0.00 +0.5 0.54 ? 48% perf-profile.children.cycles-pp.xlog_state_do_callback
0.63 ? 17% +0.5 1.16 ? 14% perf-profile.children.cycles-pp.xfs_iunlink
0.00 +0.5 0.54 ? 48% perf-profile.children.cycles-pp.xlog_ioend_work
0.25 ? 17% +0.6 0.87 ? 11% perf-profile.children.cycles-pp.memcpy_erms
0.87 ? 10% +0.6 1.50 ? 14% perf-profile.children.cycles-pp.__softirqentry_text_start
0.62 ? 18% +0.7 1.27 ? 15% perf-profile.children.cycles-pp.xfs_buf_item_format
0.56 ? 26% +0.7 1.22 ? 15% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
0.89 ? 12% +0.7 1.55 ? 14% perf-profile.children.cycles-pp.irq_exit_rcu
0.46 ? 19% +0.7 1.20 ? 14% perf-profile.children.cycles-pp.xfs_buf_item_format_segment
0.21 ? 15% +0.9 1.13 ? 15% perf-profile.children.cycles-pp.__schedule
1.17 ? 18% +1.0 2.13 ? 10% perf-profile.children.cycles-pp.update_process_times
1.24 ? 19% +1.0 2.25 ? 10% perf-profile.children.cycles-pp.tick_sched_handle
1.42 ? 18% +1.1 2.57 ? 9% perf-profile.children.cycles-pp.tick_sched_timer
1.34 ? 27% +1.6 2.92 ? 18% perf-profile.children.cycles-pp.menu_select
2.29 ? 16% +2.0 4.32 ? 10% perf-profile.children.cycles-pp.__hrtimer_run_queues
3.15 ? 17% +2.8 5.95 ? 9% perf-profile.children.cycles-pp.hrtimer_interrupt
3.28 ? 16% +2.9 6.21 ? 10% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
4.87 ? 16% +4.3 9.19 ? 10% perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
5.31 ? 16% +4.7 10.00 ? 10% perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
0.00 +4.8 4.81 ? 24% perf-profile.children.cycles-pp.xfs_inodegc_worker
0.00 +5.0 5.02 ? 23% perf-profile.children.cycles-pp.xfs_icwalk
0.00 +5.0 5.02 ? 23% perf-profile.children.cycles-pp.xfs_icwalk_ag
0.72 ? 15% +6.3 7.06 ? 21% perf-profile.children.cycles-pp.worker_thread
0.62 ? 15% +6.4 6.97 ? 21% perf-profile.children.cycles-pp.process_one_work
0.94 ? 16% +6.9 7.87 ? 20% perf-profile.children.cycles-pp.ret_from_fork
0.93 ? 16% +6.9 7.87 ? 20% perf-profile.children.cycles-pp.kthread
45.05 ? 16% +14.3 59.33 ? 6% perf-profile.children.cycles-pp.cpuidle_enter_state
45.09 ? 16% +14.3 59.40 ? 6% perf-profile.children.cycles-pp.cpuidle_enter
47.05 ? 15% +17.1 64.19 ? 6% perf-profile.children.cycles-pp.do_idle
47.05 ? 15% +17.1 64.19 ? 6% perf-profile.children.cycles-pp.secondary_startup_64_no_verify
47.05 ? 15% +17.1 64.19 ? 6% perf-profile.children.cycles-pp.cpu_startup_entry
46.01 ? 16% +17.2 63.24 ? 6% perf-profile.children.cycles-pp.start_secondary
1.74 ? 20% -0.9 0.84 ? 13% perf-profile.self.cycles-pp.syscall_exit_to_user_mode
0.89 ? 17% -0.5 0.43 ? 15% perf-profile.self.cycles-pp.__entry_text_start
0.90 ? 17% -0.4 0.46 ? 6% perf-profile.self.cycles-pp.syscall_return_via_sysret
0.97 ? 13% -0.4 0.57 ? 10% perf-profile.self.cycles-pp.kmem_cache_alloc
0.58 ? 20% -0.4 0.21 ? 13% perf-profile.self.cycles-pp.xfs_log_ticket_ungrant
0.66 ? 15% -0.3 0.39 ? 13% perf-profile.self.cycles-pp.kmem_cache_free
0.60 ? 15% -0.2 0.36 ? 12% perf-profile.self.cycles-pp.xfs_inode_item_format
0.50 ? 17% -0.2 0.27 ? 9% perf-profile.self.cycles-pp.xfs_trans_log_inode
0.40 ? 20% -0.2 0.18 ? 15% perf-profile.self.cycles-pp.xlog_grant_add_space
0.39 ? 21% -0.2 0.19 ? 10% perf-profile.self.cycles-pp.___might_sleep
0.44 ? 19% -0.2 0.24 ? 21% perf-profile.self.cycles-pp.xfs_btree_lookup
0.39 ? 13% -0.2 0.19 ? 13% perf-profile.self.cycles-pp.fsnotify
0.29 ? 16% -0.2 0.11 ? 34% perf-profile.self.cycles-pp.__xfs_btree_check_sblock
0.31 ? 25% -0.2 0.13 ? 19% perf-profile.self.cycles-pp.link_path_walk
0.49 ? 14% -0.2 0.33 ? 20% perf-profile.self.cycles-pp.xlog_cil_insert_items
0.25 ? 31% -0.2 0.10 ? 28% perf-profile.self.cycles-pp.xfs_mod_fdblocks
0.24 ? 22% -0.1 0.09 ? 47% perf-profile.self.cycles-pp.xfs_buffered_write_iomap_begin
0.22 ? 15% -0.1 0.09 ? 15% perf-profile.self.cycles-pp.map_id_range_down
0.18 ? 21% -0.1 0.06 ? 79% perf-profile.self.cycles-pp.xfs_inobt_get_maxrecs
0.21 ? 23% -0.1 0.09 ? 14% perf-profile.self.cycles-pp.__raw_callee_save___native_queued_spin_unlock
0.25 ? 16% -0.1 0.12 ? 14% perf-profile.self.cycles-pp.memset_erms
0.23 ? 27% -0.1 0.11 ? 26% perf-profile.self.cycles-pp.__xfs_bunmapi
0.22 ? 15% -0.1 0.10 ? 17% perf-profile.self.cycles-pp.do_syscall_64
0.20 ? 13% -0.1 0.08 ? 30% perf-profile.self.cycles-pp.__setup_rt_frame
0.22 ? 17% -0.1 0.10 ? 27% perf-profile.self.cycles-pp.xfs_errortag_test
0.26 ? 15% -0.1 0.15 ? 15% perf-profile.self.cycles-pp.__might_sleep
0.19 ? 25% -0.1 0.08 ? 13% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
0.19 ? 14% -0.1 0.08 ? 20% perf-profile.self.cycles-pp.xfs_buf_item_size
0.20 ? 11% -0.1 0.10 ? 15% perf-profile.self.cycles-pp.__virt_addr_valid
0.17 ? 19% -0.1 0.06 ? 14% perf-profile.self.cycles-pp.xfs_btree_rec_offset
0.24 ? 24% -0.1 0.14 ? 20% perf-profile.self.cycles-pp.xfs_trans_add_item
0.15 ? 20% -0.1 0.05 ? 73% perf-profile.self.cycles-pp.copy_fpstate_to_sigframe
0.16 ? 21% -0.1 0.06 ? 48% perf-profile.self.cycles-pp.up_read
0.18 ? 18% -0.1 0.08 ? 17% perf-profile.self.cycles-pp.xfs_trans_dirty_buf
0.17 ? 25% -0.1 0.08 ? 17% perf-profile.self.cycles-pp.xfs_iget
0.26 ? 16% -0.1 0.16 ? 13% perf-profile.self.cycles-pp.page_counter_cancel
0.18 ? 20% -0.1 0.08 ? 49% perf-profile.self.cycles-pp.exit_to_user_mode_prepare
0.15 ? 30% -0.1 0.06 ? 46% perf-profile.self.cycles-pp.xfs_create
0.16 ? 26% -0.1 0.07 ? 46% perf-profile.self.cycles-pp.xfs_trans_alloc
0.16 ? 22% -0.1 0.06 ? 7% perf-profile.self.cycles-pp.xfs_inode_item_size
0.14 ? 18% -0.1 0.05 ? 77% perf-profile.self.cycles-pp.__fput
0.14 ? 20% -0.1 0.06 ? 13% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
0.19 ? 18% -0.1 0.11 ? 17% perf-profile.self.cycles-pp.path_openat
0.15 ? 14% -0.1 0.07 ? 47% perf-profile.self.cycles-pp.xfs_buf_item_format
0.13 ? 22% -0.1 0.05 ? 46% perf-profile.self.cycles-pp.do_dentry_open
0.10 ? 25% -0.1 0.02 ? 99% perf-profile.self.cycles-pp.xfs_check_agi_freecount
0.18 ? 18% -0.1 0.10 ? 21% perf-profile.self.cycles-pp.xfs_trans_read_buf_map
0.11 ? 24% -0.1 0.04 ? 71% perf-profile.self.cycles-pp.xfs_btree_check_sblock
0.12 ? 27% -0.1 0.05 ? 81% perf-profile.self.cycles-pp.__xfs_trans_commit
0.11 ? 20% -0.1 0.03 ?100% perf-profile.self.cycles-pp.__fsnotify_parent
0.20 ? 25% -0.1 0.12 ? 13% perf-profile.self.cycles-pp.xfs_trans_del_item
0.11 ? 20% -0.1 0.03 ?103% perf-profile.self.cycles-pp.xfs_dir2_sf_check
0.14 ? 17% -0.1 0.06 ? 21% perf-profile.self.cycles-pp.strncpy_from_user
0.11 ? 29% -0.1 0.04 ? 71% perf-profile.self.cycles-pp.xfs_dir2_sf_removename
0.11 ? 31% -0.1 0.04 ? 75% perf-profile.self.cycles-pp.lockref_put_return
0.11 ? 33% -0.1 0.04 ? 73% perf-profile.self.cycles-pp.xfs_ilock
0.10 ? 19% -0.1 0.03 ?100% perf-profile.self.cycles-pp.xfs_buf_item_release
0.10 ? 21% -0.1 0.03 ?101% perf-profile.self.cycles-pp.__add_to_page_cache_locked
0.13 ? 22% -0.1 0.06 ? 58% perf-profile.self.cycles-pp.xas_store
0.10 ? 11% -0.1 0.03 ?100% perf-profile.self.cycles-pp.fpu__clear
0.17 ? 14% -0.1 0.10 ? 22% perf-profile.self.cycles-pp.get_obj_cgroup_from_current
0.15 ? 24% -0.1 0.08 ? 13% perf-profile.self.cycles-pp.xfs_log_reserve
0.12 ? 21% -0.1 0.05 ? 73% perf-profile.self.cycles-pp.__d_lookup_rcu
0.14 ? 19% -0.1 0.08 ? 21% perf-profile.self.cycles-pp.inode_permission
0.18 ? 18% -0.1 0.11 ? 12% perf-profile.self.cycles-pp.xfs_dir2_sf_addname
0.10 ? 13% -0.1 0.04 ? 71% perf-profile.self.cycles-pp.generic_permission
0.14 ? 17% -0.1 0.08 ? 27% perf-profile.self.cycles-pp.__srcu_read_lock
0.11 ? 12% -0.1 0.05 ? 74% perf-profile.self.cycles-pp.do_open
0.10 ? 18% -0.1 0.04 ? 71% perf-profile.self.cycles-pp.percpu_counter_add_batch
0.13 ? 10% -0.1 0.07 ? 48% perf-profile.self.cycles-pp.do_sys_openat2
0.10 ? 32% -0.1 0.04 ? 45% perf-profile.self.cycles-pp.xfs_btree_get_rec
0.12 ? 20% -0.1 0.06 ? 50% perf-profile.self.cycles-pp.xfs_iunlock
0.11 ? 20% -0.1 0.05 ? 46% perf-profile.self.cycles-pp.xfs_btree_ptr_to_daddr
0.12 ? 22% -0.1 0.06 ? 19% perf-profile.self.cycles-pp.xfs_dir_ialloc
0.10 ? 19% -0.1 0.05 ? 47% perf-profile.self.cycles-pp.__fsnotify_update_child_dentry_flags
0.13 ? 17% -0.1 0.08 ? 8% perf-profile.self.cycles-pp.__irqentry_text_end
0.09 ? 22% -0.1 0.04 ? 72% perf-profile.self.cycles-pp.xfs_buf_read_map
0.13 ? 22% -0.1 0.08 ? 14% perf-profile.self.cycles-pp.up_write
0.08 ? 21% -0.1 0.03 ?100% perf-profile.self.cycles-pp.do_fcntl
0.14 ? 13% -0.0 0.09 ? 31% perf-profile.self.cycles-pp.xfs_btree_lookup_get_block
0.11 ? 19% -0.0 0.06 ? 14% perf-profile.self.cycles-pp.iput
0.14 ? 20% -0.0 0.09 ? 24% perf-profile.self.cycles-pp.map_id_up
0.07 ? 11% -0.0 0.03 ?100% perf-profile.self.cycles-pp.xfs_isilocked
0.02 ?141% +0.1 0.07 ? 16% perf-profile.self.cycles-pp.call_cpuidle
0.04 ? 71% +0.1 0.09 ? 19% perf-profile.self.cycles-pp.irq_exit_rcu
0.06 ? 47% +0.1 0.11 ? 21% perf-profile.self.cycles-pp.trigger_load_balance
0.06 ? 17% +0.1 0.12 ? 14% perf-profile.self.cycles-pp.clockevents_program_event
0.06 ? 9% +0.1 0.11 ? 26% perf-profile.self.cycles-pp.allocate_slab
0.00 +0.1 0.06 ? 9% perf-profile.self.cycles-pp.inode_init_once
0.02 ?141% +0.1 0.07 ? 21% perf-profile.self.cycles-pp.rcu_eqs_enter
0.02 ?141% +0.1 0.07 ? 21% perf-profile.self.cycles-pp.radix_tree_tag_clear
0.01 ?223% +0.1 0.07 ? 16% perf-profile.self.cycles-pp.rcu_nocb_flush_deferred_wakeup
0.00 +0.1 0.06 ? 13% perf-profile.self.cycles-pp.tsc_verify_tsc_adjust
0.07 ? 53% +0.1 0.13 ? 9% perf-profile.self.cycles-pp.irqtime_account_process_tick
0.02 ?141% +0.1 0.08 ? 28% perf-profile.self.cycles-pp.rcu_nmi_exit
0.01 ?223% +0.1 0.07 ? 21% perf-profile.self.cycles-pp.rebalance_domains
0.08 ? 20% +0.1 0.14 ? 18% perf-profile.self.cycles-pp.perf_mux_hrtimer_handler
0.06 ? 28% +0.1 0.13 ? 33% perf-profile.self.cycles-pp.__sysvec_apic_timer_interrupt
0.08 ? 17% +0.1 0.14 ? 17% perf-profile.self.cycles-pp.update_process_times
0.03 ?105% +0.1 0.10 ? 20% perf-profile.self.cycles-pp.update_ts_time_stats
0.03 ?102% +0.1 0.10 ? 21% perf-profile.self.cycles-pp.rcu_idle_exit
0.02 ?141% +0.1 0.09 ? 15% perf-profile.self.cycles-pp.tick_program_event
0.02 ?146% +0.1 0.09 ? 22% perf-profile.self.cycles-pp.tick_check_broadcast_expired
0.00 +0.1 0.07 ? 23% perf-profile.self.cycles-pp.irq_work_needs_cpu
0.06 ? 11% +0.1 0.13 ? 15% perf-profile.self.cycles-pp.__hrtimer_get_next_event
0.00 +0.1 0.08 ? 26% perf-profile.self.cycles-pp.xfs_fs_inode_init_once
0.09 ? 12% +0.1 0.16 ? 9% perf-profile.self.cycles-pp.timerqueue_add
0.02 ?142% +0.1 0.10 ? 28% perf-profile.self.cycles-pp.can_stop_idle_tick
0.00 +0.1 0.08 ? 54% perf-profile.self.cycles-pp.xfs_trans_committed_bulk
0.03 ?106% +0.1 0.11 ? 20% perf-profile.self.cycles-pp.rcu_eqs_exit
0.02 ?142% +0.1 0.10 ? 29% perf-profile.self.cycles-pp.__remove_hrtimer
0.10 ? 25% +0.1 0.18 ? 16% perf-profile.self.cycles-pp.scheduler_tick
0.09 ? 27% +0.1 0.17 ? 18% perf-profile.self.cycles-pp.sysvec_apic_timer_interrupt
0.02 ?144% +0.1 0.10 ? 23% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
0.00 +0.1 0.08 ? 16% perf-profile.self.cycles-pp.x86_pmu_disable
0.00 +0.1 0.08 ? 16% perf-profile.self.cycles-pp.__intel_pmu_enable_all
0.06 ? 46% +0.1 0.14 ? 23% perf-profile.self.cycles-pp.rb_next
0.06 ? 47% +0.1 0.14 ? 18% perf-profile.self.cycles-pp.timerqueue_del
0.02 ?142% +0.1 0.10 ? 21% perf-profile.self.cycles-pp.cpuidle_not_available
0.01 ?223% +0.1 0.09 ? 24% perf-profile.self.cycles-pp.cpuidle_governor_latency_req
0.05 ? 50% +0.1 0.13 ? 20% perf-profile.self.cycles-pp.native_apic_mem_write
0.08 ? 12% +0.1 0.16 ? 13% perf-profile.self.cycles-pp.update_rq_clock
0.04 ? 79% +0.1 0.13 ? 15% perf-profile.self.cycles-pp.perf_event_task_tick
0.04 ?109% +0.1 0.12 ? 19% perf-profile.self.cycles-pp.pm_qos_read_value
0.06 ? 52% +0.1 0.15 ? 19% perf-profile.self.cycles-pp.tick_check_oneshot_broadcast_this_cpu
0.13 ? 34% +0.1 0.22 ? 18% perf-profile.self.cycles-pp.arch_scale_freq_tick
0.02 ?141% +0.1 0.12 ? 10% perf-profile.self.cycles-pp.get_cpu_device
0.06 ? 17% +0.1 0.16 ? 12% perf-profile.self.cycles-pp.rb_erase
0.06 ? 51% +0.1 0.16 ? 24% perf-profile.self.cycles-pp.nr_iowait_cpu
0.04 ? 77% +0.1 0.15 ? 22% perf-profile.self.cycles-pp._xfs_buf_obj_cmp
0.12 ? 25% +0.1 0.22 ? 13% perf-profile.self.cycles-pp.hrtimer_interrupt
0.00 +0.1 0.12 ? 16% perf-profile.self.cycles-pp.xfs_iunlink_insert_backref
0.00 +0.1 0.12 ? 17% perf-profile.self.cycles-pp.__schedule
0.09 ? 20% +0.1 0.22 ? 19% perf-profile.self.cycles-pp.irqtime_account_irq
0.05 ? 8% +0.1 0.18 ? 11% perf-profile.self.cycles-pp.__intel_pmu_disable_all
0.13 ? 18% +0.1 0.26 ? 13% perf-profile.self.cycles-pp.update_irq_load_avg
0.14 ? 30% +0.1 0.28 ? 13% perf-profile.self.cycles-pp.__hrtimer_next_event_base
0.00 +0.2 0.15 ? 20% perf-profile.self.cycles-pp.xlog_write
0.12 ? 17% +0.2 0.28 ? 19% perf-profile.self.cycles-pp.tick_nohz_next_event
0.08 ? 38% +0.2 0.24 ? 26% perf-profile.self.cycles-pp.xfs_contig_bits
0.09 ? 25% +0.2 0.25 ? 20% perf-profile.self.cycles-pp.__slab_free
0.18 ? 24% +0.2 0.34 ? 9% perf-profile.self.cycles-pp.lapic_next_deadline
0.15 ? 19% +0.2 0.31 ? 14% perf-profile.self.cycles-pp.native_sched_clock
0.20 ? 16% +0.2 0.36 ? 12% perf-profile.self.cycles-pp.read_tsc
0.13 ? 23% +0.2 0.30 ? 15% perf-profile.self.cycles-pp.__hrtimer_run_queues
0.18 ? 24% +0.2 0.37 ? 10% perf-profile.self.cycles-pp.ktime_get
0.18 ? 17% +0.2 0.37 ? 9% perf-profile.self.cycles-pp.do_idle
0.20 ? 40% +0.2 0.41 ? 16% perf-profile.self.cycles-pp.memcpy_toio
0.15 ? 24% +0.2 0.36 ? 22% perf-profile.self.cycles-pp.rcu_sched_clock_irq
0.26 ? 19% +0.2 0.48 ? 14% perf-profile.self.cycles-pp.io_serial_in
0.49 ? 21% +0.5 0.97 ? 14% perf-profile.self.cycles-pp.cpuidle_enter_state
0.24 ? 18% +0.6 0.85 ? 11% perf-profile.self.cycles-pp.memcpy_erms
0.60 ? 30% +0.7 1.28 ? 25% perf-profile.self.cycles-pp.menu_select



***************************************************************************************************
lkp-ivb-2ep1: 48 threads 2 sockets Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz with 112G memory
=========================================================================================
class/compiler/cpufreq_governor/disk/fs/kconfig/nr_threads/rootfs/tbox_group/test/testcase/testtime/ucode:
filesystem/gcc-9/performance/1HDD/xfs/x86_64-rhel-8.3/10%/debian-10.4-x86_64-20200603.cgz/lkp-ivb-2ep1/dir/stress-ng/60s/0x42e

commit:
ae8eb51386 ("xfs: separate primary inode selection criteria in xfs_iget_cache_hit")
752d5513e6 ("xfs: defer inode inactivation to a workqueue")

ae8eb51386366771 752d5513e6e9f5128d3176e7d78
---------------- ---------------------------
%stddev %change %stddev
\ | \
1168842 ? 2% -28.6% 834743 stress-ng.dir.ops
19377 ? 2% -29.1% 13742 stress-ng.dir.ops_per_sec
866.33 ? 4% +56.8% 1358 ? 2% stress-ng.time.involuntary_context_switches
172.17 -45.8% 93.33 ? 2% stress-ng.time.percent_of_cpu_this_job_got
100.98 -46.5% 54.02 ? 3% stress-ng.time.system_time
1020437 -60.4% 404018 stress-ng.time.voluntary_context_switches
2934462 +51.7% 4450935 ? 25% cpuidle.C6.usage
93.18 +1.5% 94.56 iostat.cpu.idle
6.35 ? 3% -21.0% 5.02 ? 6% iostat.cpu.system
3.17 -0.7 2.42 mpstat.cpu.all.sys%
0.43 ? 3% -0.1 0.37 ? 5% mpstat.cpu.all.usr%
1.60 ? 84% +501.9% 9.66 ? 73% perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
1.60 ? 84% +501.9% 9.66 ? 73% perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
57.33 ? 53% +311.3% 235.83 ? 76% interrupts.37:PCI-MSI.2621443-edge.eth0-TxRx-2
95585 ? 5% -16.1% 80192 ? 3% interrupts.CAL:Function_call_interrupts
57.33 ? 53% +311.3% 235.83 ? 76% interrupts.CPU28.37:PCI-MSI.2621443-edge.eth0-TxRx-2
198.67 -12.2% 174.33 ? 2% turbostat.Avg_MHz
8.55 ? 3% -1.4 7.12 ? 5% turbostat.Busy%
2928562 +51.8% 4445863 ? 25% turbostat.C6
4869 ? 3% +56.3% 7612 vmstat.io.bo
2.00 -50.0% 1.00 vmstat.procs.r
32756 ? 2% -46.1% 17640 vmstat.system.cs
7545 ? 2% +47.1% 11098 softirqs.BLOCK
9013 ? 2% +47.3% 13274 softirqs.CPU8.TASKLET
9229 ? 2% +46.2% 13491 softirqs.TASKLET
10011 ? 3% +20.7% 12088 ? 5% softirqs.TIMER
35680 +7.5% 38348 ? 2% proc-vmstat.nr_slab_unreclaimable
477412 -2.2% 467123 proc-vmstat.numa_hit
433741 -2.4% 423448 proc-vmstat.numa_local
609441 ? 3% +28.4% 782412 proc-vmstat.pgalloc_normal
515904 ? 4% +33.3% 687913 proc-vmstat.pgfree
318440 ? 2% +57.0% 499795 proc-vmstat.pgpgout
18944 +139.7% 45407 ? 7% slabinfo.kmalloc-16.active_objs
74.00 +156.3% 189.67 ? 6% slabinfo.kmalloc-16.active_slabs
18944 +156.9% 48661 ? 6% slabinfo.kmalloc-16.num_objs
74.00 +156.3% 189.67 ? 6% slabinfo.kmalloc-16.num_slabs
2549 ? 5% +17.8% 3003 ? 8% slabinfo.kmalloc-2k.active_objs
2631 ? 5% +17.5% 3092 ? 8% slabinfo.kmalloc-2k.num_objs
2176 ? 2% -14.8% 1853 slabinfo.kmalloc-512.active_slabs
69665 ? 2% -14.8% 59328 slabinfo.kmalloc-512.num_objs
2176 ? 2% -14.8% 1853 slabinfo.kmalloc-512.num_slabs
135099 ? 11% -31.3% 92781 ? 8% slabinfo.kmalloc-8.active_objs
135373 ? 11% -28.2% 97194 ? 7% slabinfo.kmalloc-8.num_objs
1149 +134.4% 2695 slabinfo.kmalloc-8k.active_objs
288.67 +155.8% 738.50 slabinfo.kmalloc-8k.active_slabs
1156 +155.6% 2955 slabinfo.kmalloc-8k.num_objs
288.67 +155.8% 738.50 slabinfo.kmalloc-8k.num_slabs
11.63 ? 2% +49.2% 17.35 ? 10% perf-stat.i.MPKI
1.408e+09 -21.3% 1.108e+09 perf-stat.i.branch-instructions
2.65 +1.6 4.25 ? 6% perf-stat.i.branch-miss-rate%
12.30 ? 9% +6.6 18.93 ? 7% perf-stat.i.cache-miss-rate%
8844435 ? 9% +29.8% 11477739 ? 19% perf-stat.i.cache-misses
33497 ? 2% -45.6% 18238 perf-stat.i.context-switches
1.45 ? 2% +56.1% 2.27 ? 5% perf-stat.i.cpi
9.709e+09 -9.5% 8.79e+09 ? 5% perf-stat.i.cpu-cycles
1106 ? 7% -29.5% 780.09 ? 14% perf-stat.i.cycles-between-cache-misses
16804031 -18.6% 13673237 ? 5% perf-stat.i.dTLB-load-misses
1.989e+09 -21.3% 1.564e+09 perf-stat.i.dTLB-loads
0.08 ? 4% +0.0 0.11 ? 7% perf-stat.i.dTLB-store-miss-rate%
1.226e+09 -14.2% 1.052e+09 ? 4% perf-stat.i.dTLB-stores
40.00 ? 6% +18.5 58.47 ? 3% perf-stat.i.iTLB-load-miss-rate%
2471083 ? 6% -35.0% 1606327 ? 4% perf-stat.i.iTLB-loads
7.446e+09 -21.4% 5.852e+09 perf-stat.i.instructions
5070 ? 6% -25.6% 3774 ? 10% perf-stat.i.instructions-per-iTLB-miss
0.73 ? 2% -17.8% 0.60 ? 4% perf-stat.i.ipc
0.20 -9.5% 0.18 ? 5% perf-stat.i.metric.GHz
188.78 ? 19% +100.7% 378.78 ? 13% perf-stat.i.metric.K/sec
97.88 -19.6% 78.74 ? 2% perf-stat.i.metric.M/sec
1065297 ? 30% -19.7% 855431 ? 2% perf-stat.i.node-stores
2.51 +0.5 3.01 ? 6% perf-stat.overall.branch-miss-rate%
11.47 ? 10% +5.0 16.44 ? 10% perf-stat.overall.cache-miss-rate%
1.30 ? 2% +15.1% 1.50 ? 4% perf-stat.overall.cpi
1106 ? 7% -28.8% 787.97 ? 14% perf-stat.overall.cycles-between-cache-misses
0.08 ? 5% +0.0 0.10 ? 8% perf-stat.overall.dTLB-store-miss-rate%
36.84 ? 6% +10.7 47.55 ? 4% perf-stat.overall.iTLB-load-miss-rate%
5193 ? 6% -22.1% 4048 ? 10% perf-stat.overall.instructions-per-iTLB-miss
0.77 ? 2% -13.0% 0.67 ? 5% perf-stat.overall.ipc
1.386e+09 -21.3% 1.091e+09 perf-stat.ps.branch-instructions
8703834 ? 9% +29.8% 11296182 ? 19% perf-stat.ps.cache-misses
32998 ? 2% -45.6% 17962 perf-stat.ps.context-switches
9.558e+09 -9.5% 8.654e+09 ? 5% perf-stat.ps.cpu-cycles
16542050 -18.6% 13461636 ? 5% perf-stat.ps.dTLB-load-misses
1.958e+09 -21.3% 1.54e+09 perf-stat.ps.dTLB-loads
1.207e+09 -14.2% 1.036e+09 ? 4% perf-stat.ps.dTLB-stores
2433257 ? 6% -35.0% 1581700 ? 4% perf-stat.ps.iTLB-loads
7.331e+09 -21.4% 5.762e+09 perf-stat.ps.instructions
1048161 ? 30% -19.7% 841811 ? 2% perf-stat.ps.node-stores
4.643e+11 -21.0% 3.668e+11 perf-stat.total.instructions
39.51 ? 6% -15.6 23.94 ? 13% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
39.56 ? 6% -15.6 24.00 ? 13% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
11.32 ? 7% -11.3 0.00 perf-profile.calltrace.cycles-pp.destroy_inode.vfs_rmdir.do_rmdir.do_syscall_64.entry_SYSCALL_64_after_hwframe
18.17 ? 7% -11.3 6.90 ? 16% perf-profile.calltrace.cycles-pp.do_rmdir.do_syscall_64.entry_SYSCALL_64_after_hwframe
11.22 ? 6% -11.2 0.00 perf-profile.calltrace.cycles-pp.xfs_inode_mark_reclaimable.destroy_inode.vfs_rmdir.do_rmdir.do_syscall_64
17.68 ? 7% -11.2 6.46 ? 15% perf-profile.calltrace.cycles-pp.vfs_rmdir.do_rmdir.do_syscall_64.entry_SYSCALL_64_after_hwframe
11.08 ? 6% -11.1 0.00 perf-profile.calltrace.cycles-pp.xfs_inactive.xfs_inode_mark_reclaimable.destroy_inode.vfs_rmdir.do_rmdir
11.05 ? 6% -11.0 0.00 perf-profile.calltrace.cycles-pp.xfs_inactive_ifree.xfs_inactive.xfs_inode_mark_reclaimable.destroy_inode.vfs_rmdir
9.47 ? 6% -9.5 0.00 perf-profile.calltrace.cycles-pp.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_inode_mark_reclaimable.destroy_inode
8.43 ? 6% -8.4 0.00 perf-profile.calltrace.cycles-pp.xfs_difree.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_inode_mark_reclaimable
15.42 ? 6% -3.1 12.36 ? 12% perf-profile.calltrace.cycles-pp.do_mkdirat.do_syscall_64.entry_SYSCALL_64_after_hwframe
14.86 ? 6% -3.0 11.88 ? 12% perf-profile.calltrace.cycles-pp.vfs_mkdir.do_mkdirat.do_syscall_64.entry_SYSCALL_64_after_hwframe
14.77 ? 6% -3.0 11.80 ? 12% perf-profile.calltrace.cycles-pp.xfs_generic_create.vfs_mkdir.do_mkdirat.do_syscall_64.entry_SYSCALL_64_after_hwframe
14.56 ? 6% -2.9 11.68 ? 12% perf-profile.calltrace.cycles-pp.xfs_create.xfs_generic_create.vfs_mkdir.do_mkdirat.do_syscall_64
9.95 ? 5% -2.0 7.91 ? 12% perf-profile.calltrace.cycles-pp.xfs_dir_ialloc.xfs_create.xfs_generic_create.vfs_mkdir.do_mkdirat
7.58 ? 6% -1.8 5.73 ? 15% perf-profile.calltrace.cycles-pp.xfs_difree_inobt.xfs_difree.xfs_ifree.xfs_inactive_ifree.xfs_inactive
8.19 ? 5% -1.7 6.46 ? 11% perf-profile.calltrace.cycles-pp.xfs_dialloc_ag.xfs_dir_ialloc.xfs_create.xfs_generic_create.vfs_mkdir
7.16 ? 6% -1.7 5.45 ? 15% perf-profile.calltrace.cycles-pp.xfs_check_agi_freecount.xfs_difree_inobt.xfs_difree.xfs_ifree.xfs_inactive_ifree
7.54 ? 5% -1.6 5.91 ? 12% perf-profile.calltrace.cycles-pp.xfs_check_agi_freecount.xfs_dialloc_ag.xfs_dir_ialloc.xfs_create.xfs_generic_create
4.50 ? 9% -1.0 3.46 ? 12% perf-profile.calltrace.cycles-pp.__do_sys_statfs.do_syscall_64.entry_SYSCALL_64_after_hwframe
4.40 ? 9% -1.0 3.39 ? 12% perf-profile.calltrace.cycles-pp.user_statfs.__do_sys_statfs.do_syscall_64.entry_SYSCALL_64_after_hwframe
3.97 ? 5% -0.9 3.09 ? 12% perf-profile.calltrace.cycles-pp.xfs_inobt_get_rec.xfs_check_agi_freecount.xfs_dialloc_ag.xfs_dir_ialloc.xfs_create
3.33 ? 10% -0.8 2.49 ? 13% perf-profile.calltrace.cycles-pp.vfs_statfs.user_statfs.__do_sys_statfs.do_syscall_64.entry_SYSCALL_64_after_hwframe
3.31 ? 10% -0.8 2.47 ? 13% perf-profile.calltrace.cycles-pp.statfs_by_dentry.vfs_statfs.user_statfs.__do_sys_statfs.do_syscall_64
3.24 ? 10% -0.8 2.42 ? 13% perf-profile.calltrace.cycles-pp.xfs_fs_statfs.statfs_by_dentry.vfs_statfs.user_statfs.__do_sys_statfs
3.10 ? 10% -0.8 2.31 ? 13% perf-profile.calltrace.cycles-pp.__percpu_counter_sum.xfs_fs_statfs.statfs_by_dentry.vfs_statfs.user_statfs
3.79 ? 5% -0.8 3.04 ? 15% perf-profile.calltrace.cycles-pp.xfs_inobt_get_rec.xfs_check_agi_freecount.xfs_difree_inobt.xfs_difree.xfs_ifree
2.69 ? 8% -0.7 2.01 ? 17% perf-profile.calltrace.cycles-pp.xfs_btree_increment.xfs_check_agi_freecount.xfs_difree_inobt.xfs_difree.xfs_ifree
2.73 ? 7% -0.6 2.10 ? 12% perf-profile.calltrace.cycles-pp.xfs_btree_increment.xfs_check_agi_freecount.xfs_dialloc_ag.xfs_dir_ialloc.xfs_create
2.42 ? 5% -0.6 1.85 ? 12% perf-profile.calltrace.cycles-pp.xfs_btree_get_rec.xfs_inobt_get_rec.xfs_check_agi_freecount.xfs_dialloc_ag.xfs_dir_ialloc
2.39 ? 5% -0.5 1.89 ? 15% perf-profile.calltrace.cycles-pp.xfs_btree_get_rec.xfs_inobt_get_rec.xfs_check_agi_freecount.xfs_difree_inobt.xfs_difree
1.04 ? 28% -0.5 0.57 ? 56% perf-profile.calltrace.cycles-pp.xfs_inobt_get_maxrecs.__xfs_btree_check_sblock.xfs_btree_check_sblock.xfs_btree_increment.xfs_check_agi_freecount
2.21 ? 5% -0.4 1.77 ? 7% perf-profile.calltrace.cycles-pp.__xfs_btree_check_sblock.xfs_btree_check_sblock.xfs_btree_get_rec.xfs_inobt_get_rec.xfs_check_agi_freecount
1.73 ? 9% -0.4 1.31 ? 17% perf-profile.calltrace.cycles-pp.xfs_btree_check_sblock.xfs_btree_increment.xfs_check_agi_freecount.xfs_difree_inobt.xfs_difree
1.62 ? 5% -0.4 1.20 ? 9% perf-profile.calltrace.cycles-pp.xfs_btree_check_sblock.xfs_btree_get_rec.xfs_inobt_get_rec.xfs_check_agi_freecount.xfs_dialloc_ag
1.74 ? 7% -0.4 1.37 ? 12% perf-profile.calltrace.cycles-pp.xfs_btree_check_sblock.xfs_btree_increment.xfs_check_agi_freecount.xfs_dialloc_ag.xfs_dir_ialloc
0.65 ? 6% -0.4 0.29 ?100% perf-profile.calltrace.cycles-pp.cpumask_next.__percpu_counter_sum.xfs_fs_statfs.statfs_by_dentry.vfs_statfs
1.43 ? 7% -0.3 1.11 ? 15% perf-profile.calltrace.cycles-pp.xfs_dir2_node_addname.xfs_dir_createname.xfs_create.xfs_generic_create.vfs_mkdir
1.54 ? 6% -0.3 1.26 ? 15% perf-profile.calltrace.cycles-pp.xfs_btree_check_sblock.xfs_btree_get_rec.xfs_inobt_get_rec.xfs_check_agi_freecount.xfs_difree_inobt
1.17 ? 10% -0.3 0.91 ? 16% perf-profile.calltrace.cycles-pp.__xfs_btree_check_sblock.xfs_btree_check_sblock.xfs_btree_increment.xfs_check_agi_freecount.xfs_difree_inobt
1.20 ? 7% -0.2 0.96 ? 10% perf-profile.calltrace.cycles-pp.__xfs_btree_check_sblock.xfs_btree_check_sblock.xfs_btree_increment.xfs_check_agi_freecount.xfs_dialloc_ag
0.84 ? 7% +0.2 1.03 ? 10% perf-profile.calltrace.cycles-pp.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues
0.36 ? 70% +0.2 0.60 ? 11% perf-profile.calltrace.cycles-pp.clockevents_program_event.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
0.53 ? 45% +0.2 0.78 ? 14% perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry
0.98 ? 12% +0.3 1.26 ? 11% perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary
0.47 ? 46% +0.3 0.77 ? 9% perf-profile.calltrace.cycles-pp.irq_enter_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
1.57 ? 9% +0.3 1.92 ? 10% perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
1.67 ? 10% +0.4 2.04 ? 10% perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt
0.68 ? 10% +0.4 1.10 ? 13% perf-profile.calltrace.cycles-pp.xfs_iunlink.xfs_remove.xfs_vn_unlink.vfs_rmdir.do_rmdir
1.91 ? 12% +0.4 2.35 ? 9% perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt
0.21 ?141% +0.5 0.75 ? 10% perf-profile.calltrace.cycles-pp.tick_irq_enter.irq_enter_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
0.00 +0.7 0.75 ? 16% perf-profile.calltrace.cycles-pp.xfs_buf_item_format.xlog_cil_insert_items.xfs_log_commit_cil.__xfs_trans_commit.xfs_inactive_ifree
2.46 ? 11% +0.8 3.21 ? 12% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
3.24 ? 7% +0.8 4.06 ? 5% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
0.18 ?141% +0.8 1.02 ? 18% perf-profile.calltrace.cycles-pp.xlog_cil_insert_items.xfs_log_commit_cil.__xfs_trans_commit.xfs_inactive_ifree.xfs_inactive
0.00 +1.2 1.18 ? 36% perf-profile.calltrace.cycles-pp.xfs_buf_item_format_segment.xfs_buf_item_format.xlog_cil_insert_items.xfs_log_commit_cil.__xfs_trans_commit
4.53 ? 7% +1.2 5.71 ? 5% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
4.71 ? 7% +1.3 5.97 ? 5% perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
0.00 +1.6 1.60 ? 16% perf-profile.calltrace.cycles-pp.xfs_log_commit_cil.__xfs_trans_commit.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag
0.00 +1.7 1.67 ? 16% perf-profile.calltrace.cycles-pp.__xfs_trans_commit.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag.xfs_icwalk
6.86 ? 7% +2.0 8.84 ? 7% perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle
7.43 ? 7% +2.5 9.96 ? 6% perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
52.84 ? 5% +5.0 57.80 ? 5% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
56.80 ? 4% +5.8 62.62 ? 5% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
56.85 ? 4% +5.9 62.73 ? 5% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
56.85 ? 4% +5.9 62.73 ? 5% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
0.00 +6.2 6.18 ? 14% perf-profile.calltrace.cycles-pp.xfs_difree.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag
57.70 ? 4% +6.5 64.16 ? 5% perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
0.00 +6.9 6.92 ? 15% perf-profile.calltrace.cycles-pp.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag.xfs_icwalk
0.00 +8.8 8.80 ? 15% perf-profile.calltrace.cycles-pp.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag.xfs_icwalk.xfs_inodegc_worker
0.00 +8.8 8.84 ? 15% perf-profile.calltrace.cycles-pp.xfs_inactive.xfs_icwalk_ag.xfs_icwalk.xfs_inodegc_worker.process_one_work
0.00 +8.9 8.92 ? 15% perf-profile.calltrace.cycles-pp.xfs_icwalk.xfs_inodegc_worker.process_one_work.worker_thread.kthread
0.00 +8.9 8.92 ? 15% perf-profile.calltrace.cycles-pp.xfs_icwalk_ag.xfs_icwalk.xfs_inodegc_worker.process_one_work.worker_thread
0.00 +8.9 8.92 ? 15% perf-profile.calltrace.cycles-pp.xfs_inodegc_worker.process_one_work.worker_thread.kthread.ret_from_fork
1.37 ? 10% +9.1 10.48 ? 15% perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
1.39 ? 10% +9.1 10.50 ? 15% perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
1.45 ? 9% +9.1 10.59 ? 15% perf-profile.calltrace.cycles-pp.ret_from_fork
1.45 ? 9% +9.1 10.59 ? 15% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
39.78 ? 6% -15.5 24.24 ? 13% perf-profile.children.cycles-pp.do_syscall_64
39.84 ? 6% -15.5 24.31 ? 13% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
18.18 ? 7% -11.3 6.90 ? 16% perf-profile.children.cycles-pp.do_rmdir
17.68 ? 7% -11.2 6.46 ? 15% perf-profile.children.cycles-pp.vfs_rmdir
11.32 ? 7% -11.2 0.16 ? 35% perf-profile.children.cycles-pp.destroy_inode
11.22 ? 6% -11.1 0.10 ? 34% perf-profile.children.cycles-pp.xfs_inode_mark_reclaimable
15.18 ? 5% -3.6 11.61 ? 6% perf-profile.children.cycles-pp.xfs_check_agi_freecount
15.42 ? 6% -3.1 12.37 ? 12% perf-profile.children.cycles-pp.do_mkdirat
14.86 ? 6% -3.0 11.88 ? 12% perf-profile.children.cycles-pp.vfs_mkdir
14.77 ? 6% -3.0 11.80 ? 12% perf-profile.children.cycles-pp.xfs_generic_create
14.56 ? 6% -2.9 11.68 ? 12% perf-profile.children.cycles-pp.xfs_create
9.48 ? 6% -2.6 6.93 ? 15% perf-profile.children.cycles-pp.xfs_ifree
8.43 ? 6% -2.2 6.18 ? 14% perf-profile.children.cycles-pp.xfs_difree
9.95 ? 5% -2.0 7.91 ? 12% perf-profile.children.cycles-pp.xfs_dir_ialloc
7.59 ? 6% -1.9 5.74 ? 15% perf-profile.children.cycles-pp.xfs_difree_inobt
7.41 ? 5% -1.8 5.62 ? 7% perf-profile.children.cycles-pp.xfs_btree_check_sblock
8.20 ? 4% -1.8 6.42 ? 6% perf-profile.children.cycles-pp.xfs_inobt_get_rec
8.19 ? 5% -1.7 6.47 ? 11% perf-profile.children.cycles-pp.xfs_dialloc_ag
5.68 ? 5% -1.4 4.25 ? 8% perf-profile.children.cycles-pp.xfs_btree_increment
5.14 ? 3% -1.2 3.96 ? 8% perf-profile.children.cycles-pp.xfs_btree_get_rec
4.92 ? 5% -1.1 3.84 ? 6% perf-profile.children.cycles-pp.__xfs_btree_check_sblock
4.50 ? 9% -1.0 3.46 ? 12% perf-profile.children.cycles-pp.__do_sys_statfs
4.40 ? 9% -1.0 3.39 ? 12% perf-profile.children.cycles-pp.user_statfs
3.33 ? 10% -0.8 2.49 ? 13% perf-profile.children.cycles-pp.vfs_statfs
3.31 ? 10% -0.8 2.47 ? 13% perf-profile.children.cycles-pp.statfs_by_dentry
3.24 ? 10% -0.8 2.42 ? 13% perf-profile.children.cycles-pp.xfs_fs_statfs
3.12 ? 10% -0.8 2.32 ? 13% perf-profile.children.cycles-pp.__percpu_counter_sum
3.14 ? 11% -0.8 2.39 ? 11% perf-profile.children.cycles-pp.xfs_trans_read_buf_map
2.32 ? 9% -0.6 1.76 ? 11% perf-profile.children.cycles-pp.xfs_buf_read_map
2.29 ? 10% -0.6 1.73 ? 11% perf-profile.children.cycles-pp.xfs_buf_get_map
1.76 ? 9% -0.5 1.23 ? 8% perf-profile.children.cycles-pp.xfs_btree_lookup
2.07 ? 10% -0.5 1.56 ? 11% perf-profile.children.cycles-pp.xfs_buf_find
2.41 ? 6% -0.5 1.91 ? 6% perf-profile.children.cycles-pp.xfs_inobt_get_maxrecs
1.26 ? 6% -0.4 0.85 ? 17% perf-profile.children.cycles-pp.__schedule
1.47 ? 7% -0.4 1.07 ? 13% perf-profile.children.cycles-pp.xfs_read_agi
0.80 ? 8% -0.4 0.42 ? 10% perf-profile.children.cycles-pp.xfs_difree_finobt
1.54 ? 7% -0.4 1.17 ? 11% perf-profile.children.cycles-pp.xfs_errortag_test
0.78 ? 6% -0.3 0.46 ? 16% perf-profile.children.cycles-pp.xfs_buf_lock
0.78 ? 6% -0.3 0.46 ? 17% perf-profile.children.cycles-pp.down
1.43 ? 7% -0.3 1.11 ? 15% perf-profile.children.cycles-pp.xfs_dir2_node_addname
0.77 ? 7% -0.3 0.46 ? 17% perf-profile.children.cycles-pp.__down
1.49 ? 9% -0.3 1.18 ? 12% perf-profile.children.cycles-pp.xfs_da_read_buf
0.86 ? 16% -0.3 0.57 ? 13% perf-profile.children.cycles-pp.xfs_btree_lookup_get_block
0.74 ? 6% -0.3 0.46 ? 18% perf-profile.children.cycles-pp.schedule_timeout
0.87 ? 12% -0.3 0.60 ? 18% perf-profile.children.cycles-pp.xfs_iunlink_remove
0.75 ? 5% -0.2 0.50 ? 16% perf-profile.children.cycles-pp.schedule
0.68 ? 8% -0.2 0.44 ? 18% perf-profile.children.cycles-pp.xfs_buf_unlock
0.64 ? 8% -0.2 0.40 ? 16% perf-profile.children.cycles-pp.up
0.63 ? 19% -0.2 0.41 ? 13% perf-profile.children.cycles-pp.xfs_btree_read_buf_block
0.80 ? 5% -0.2 0.58 ? 17% perf-profile.children.cycles-pp.xfs_buf_item_release
0.58 ? 18% -0.2 0.39 ? 15% perf-profile.children.cycles-pp._xfs_trans_bjoin
0.65 ? 6% -0.2 0.47 ? 8% perf-profile.children.cycles-pp.xfs_verify_agino
0.49 ? 7% -0.2 0.31 ? 13% perf-profile.children.cycles-pp.try_to_wake_up
0.52 ? 11% -0.2 0.35 ? 19% perf-profile.children.cycles-pp.schedule_idle
0.86 ? 8% -0.2 0.70 ? 11% perf-profile.children.cycles-pp.xfs_da3_node_read
0.55 ? 6% -0.2 0.39 ? 9% perf-profile.children.cycles-pp.xfs_btree_rec_offset
0.80 ? 6% -0.2 0.65 ? 12% perf-profile.children.cycles-pp.cpumask_next
0.58 ? 11% -0.2 0.42 ? 11% perf-profile.children.cycles-pp.xfs_inobt_btrec_to_irec
0.54 ? 9% -0.1 0.40 ? 17% perf-profile.children.cycles-pp.xfs_btree_check_block
0.62 ? 11% -0.1 0.50 ? 12% perf-profile.children.cycles-pp.xfs_trans_alloc
0.29 ? 8% -0.1 0.18 ? 16% perf-profile.children.cycles-pp.xfs_lookup_get_search_key
0.42 ? 16% -0.1 0.32 ? 21% perf-profile.children.cycles-pp.xfs_btree_get_block
0.57 ? 8% -0.1 0.47 ? 13% perf-profile.children.cycles-pp._find_next_bit
0.24 ? 8% -0.1 0.15 ? 21% perf-profile.children.cycles-pp.perf_pmu_sched_task
0.21 ? 8% -0.1 0.12 ? 23% perf-profile.children.cycles-pp.__perf_pmu_sched_task
0.17 ? 11% -0.1 0.09 ? 32% perf-profile.children.cycles-pp.xfs_dir2_isblock
0.21 ? 11% -0.1 0.13 ? 14% perf-profile.children.cycles-pp.ttwu_do_activate
0.19 ? 11% -0.1 0.12 ? 25% perf-profile.children.cycles-pp.xfs_bmap_last_offset
0.26 ? 11% -0.1 0.18 ? 16% perf-profile.children.cycles-pp.dequeue_task_fair
0.20 ? 11% -0.1 0.13 ? 14% perf-profile.children.cycles-pp.enqueue_task_fair
0.42 ? 5% -0.1 0.34 ? 15% perf-profile.children.cycles-pp.__do_sys_newstat
0.17 ? 16% -0.1 0.10 ? 20% perf-profile.children.cycles-pp.xfs_bmap_last_extent
0.22 ? 9% -0.1 0.16 ? 18% perf-profile.children.cycles-pp.dequeue_entity
0.16 ? 13% -0.1 0.09 ? 25% perf-profile.children.cycles-pp.__perf_event_task_sched_out
0.23 ? 12% -0.1 0.17 ? 18% perf-profile.children.cycles-pp.xfs_defer_finish_noroll
0.18 ? 12% -0.1 0.11 ? 17% perf-profile.children.cycles-pp.xfs_inobt_init_key_from_rec
0.17 ? 13% -0.1 0.12 ? 14% perf-profile.children.cycles-pp.update_load_avg
0.16 ? 14% -0.1 0.10 ? 14% perf-profile.children.cycles-pp.enqueue_entity
0.13 ? 22% -0.1 0.07 ? 12% perf-profile.children.cycles-pp.xfs_trans_free
0.20 ? 15% -0.1 0.14 ? 19% perf-profile.children.cycles-pp.pick_next_task_fair
0.21 ? 14% -0.1 0.16 ? 15% perf-profile.children.cycles-pp.xfs_log_ticket_ungrant
0.20 ? 13% -0.1 0.15 ? 16% perf-profile.children.cycles-pp.__intel_pmu_disable_all
0.33 ? 5% -0.0 0.28 ? 7% perf-profile.children.cycles-pp.xfs_buf_rele
0.08 ? 14% -0.0 0.03 ?101% perf-profile.children.cycles-pp.xfs_buf_allocate_memory
0.09 ? 26% -0.0 0.05 ? 48% perf-profile.children.cycles-pp.set_next_entity
0.13 ? 8% -0.0 0.08 ? 11% perf-profile.children.cycles-pp.update_curr
0.11 ? 13% -0.0 0.07 ? 46% perf-profile.children.cycles-pp.__raw_callee_save___native_queued_spin_unlock
0.20 ? 8% -0.0 0.16 ? 11% perf-profile.children.cycles-pp.xfs_btree_readahead
0.11 ? 13% -0.0 0.08 ? 13% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
0.10 ? 23% -0.0 0.07 ? 20% perf-profile.children.cycles-pp.evict
0.08 ? 6% -0.0 0.05 ? 45% perf-profile.children.cycles-pp.map_id_up
0.03 ? 70% +0.0 0.07 ? 15% perf-profile.children.cycles-pp.rcu_dynticks_eqs_enter
0.10 ? 16% +0.0 0.14 ? 16% perf-profile.children.cycles-pp.rcu_eqs_enter
0.04 ? 73% +0.0 0.09 ? 15% perf-profile.children.cycles-pp.hrtimer_forward
0.12 ? 14% +0.1 0.17 ? 9% perf-profile.children.cycles-pp.nr_iowait_cpu
0.14 ? 11% +0.1 0.19 ? 14% perf-profile.children.cycles-pp.irqentry_enter
0.12 ? 14% +0.1 0.18 ? 8% perf-profile.children.cycles-pp.rcu_eqs_exit
0.29 ? 12% +0.1 0.35 ? 11% perf-profile.children.cycles-pp.lapic_next_deadline
0.26 ? 17% +0.1 0.33 ? 14% perf-profile.children.cycles-pp.irqtime_account_irq
0.07 ? 47% +0.1 0.14 ? 26% perf-profile.children.cycles-pp.__slab_free
0.28 ? 13% +0.1 0.35 ? 8% perf-profile.children.cycles-pp.__hrtimer_next_event_base
0.24 ? 12% +0.1 0.30 ? 8% perf-profile.children.cycles-pp.get_next_timer_interrupt
0.19 ? 12% +0.1 0.26 ? 4% perf-profile.children.cycles-pp.rcu_idle_exit
0.04 ? 76% +0.1 0.12 ? 18% perf-profile.children.cycles-pp.allocate_slab
0.06 ? 52% +0.1 0.14 ? 14% perf-profile.children.cycles-pp.___slab_alloc
0.06 ? 52% +0.1 0.14 ? 15% perf-profile.children.cycles-pp.__slab_alloc
0.13 ? 19% +0.1 0.21 ? 16% perf-profile.children.cycles-pp.kmem_alloc_large
0.00 +0.1 0.08 ? 17% perf-profile.children.cycles-pp.xfs_iunlink_map_ino
0.19 ? 16% +0.1 0.28 ? 15% perf-profile.children.cycles-pp.timerqueue_add
0.14 ? 21% +0.1 0.23 ? 17% perf-profile.children.cycles-pp.update_ts_time_stats
0.56 ? 10% +0.1 0.65 ? 11% perf-profile.children.cycles-pp.clockevents_program_event
0.29 ? 20% +0.1 0.39 ? 11% perf-profile.children.cycles-pp.hrtimer_update_next_event
0.12 ? 15% +0.1 0.23 ? 25% perf-profile.children.cycles-pp.xlog_write
0.22 ? 17% +0.1 0.32 ? 14% perf-profile.children.cycles-pp.enqueue_hrtimer
0.00 +0.1 0.11 ? 11% perf-profile.children.cycles-pp.xfs_iunlink_map_prev
0.16 ? 18% +0.1 0.28 ? 27% perf-profile.children.cycles-pp.xlog_cil_push_work
0.00 +0.1 0.12 ? 27% perf-profile.children.cycles-pp.rhashtable_rehash_table
0.00 +0.1 0.14 ? 26% perf-profile.children.cycles-pp.rht_deferred_worker
0.22 ? 13% +0.2 0.39 ? 13% perf-profile.children.cycles-pp.xfs_buf_item_size_segment
0.02 ?142% +0.2 0.20 ? 21% perf-profile.children.cycles-pp.crc32c_pcl_intel_update
0.63 ? 14% +0.2 0.82 ? 15% perf-profile.children.cycles-pp.tick_nohz_next_event
0.35 ? 9% +0.2 0.56 ? 13% perf-profile.children.cycles-pp.xfs_buf_item_size
0.92 ? 7% +0.2 1.13 ? 9% perf-profile.children.cycles-pp.scheduler_tick
0.04 ? 75% +0.2 0.26 ? 13% perf-profile.children.cycles-pp.xfs_contig_bits
0.55 ? 13% +0.2 0.78 ? 9% perf-profile.children.cycles-pp.tick_irq_enter
0.57 ? 13% +0.2 0.80 ? 9% perf-profile.children.cycles-pp.irq_enter_rcu
0.02 ?142% +0.2 0.25 ? 23% perf-profile.children.cycles-pp.crc32c
0.00 +0.2 0.24 ? 22% perf-profile.children.cycles-pp.xfs_iunlink_update_dinode
0.01 ?223% +0.2 0.25 ? 23% perf-profile.children.cycles-pp.xfs_dinode_calc_crc
0.25 ? 14% +0.2 0.50 ? 14% perf-profile.children.cycles-pp.xfs_iunlink_update_inode
1.01 ? 12% +0.3 1.30 ? 11% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
1.18 ? 7% +0.3 1.51 ? 19% perf-profile.children.cycles-pp.irq_exit_rcu
1.71 ? 8% +0.3 2.05 ? 9% perf-profile.children.cycles-pp.update_process_times
1.81 ? 9% +0.4 2.17 ? 9% perf-profile.children.cycles-pp.tick_sched_handle
0.75 ? 11% +0.4 1.11 ? 15% perf-profile.children.cycles-pp.memcpy_erms
0.68 ? 10% +0.4 1.10 ? 13% perf-profile.children.cycles-pp.xfs_iunlink
0.90 ? 9% +0.7 1.62 ? 13% perf-profile.children.cycles-pp.xfs_buf_item_format_segment
0.98 ? 9% +0.7 1.71 ? 13% perf-profile.children.cycles-pp.xfs_buf_item_format
2.52 ? 11% +0.8 3.30 ? 12% perf-profile.children.cycles-pp.menu_select
3.47 ? 7% +0.8 4.31 ? 5% perf-profile.children.cycles-pp.__hrtimer_run_queues
4.83 ? 7% +1.2 6.04 ? 5% perf-profile.children.cycles-pp.hrtimer_interrupt
5.02 ? 7% +1.3 6.29 ? 5% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
7.27 ? 6% +2.0 9.29 ? 6% perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
7.93 ? 6% +2.2 10.12 ? 6% perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
53.56 ? 5% +5.5 59.06 ? 6% perf-profile.children.cycles-pp.cpuidle_enter_state
53.61 ? 5% +5.5 59.14 ? 6% perf-profile.children.cycles-pp.cpuidle_enter
56.85 ? 4% +5.9 62.73 ? 5% perf-profile.children.cycles-pp.start_secondary
57.70 ? 4% +6.5 64.16 ? 5% perf-profile.children.cycles-pp.secondary_startup_64_no_verify
57.70 ? 4% +6.5 64.16 ? 5% perf-profile.children.cycles-pp.cpu_startup_entry
57.70 ? 4% +6.5 64.16 ? 5% perf-profile.children.cycles-pp.do_idle
0.00 +8.9 8.92 ? 15% perf-profile.children.cycles-pp.xfs_inodegc_worker
0.03 ?103% +9.0 9.00 ? 15% perf-profile.children.cycles-pp.xfs_icwalk
0.03 ?103% +9.0 9.00 ? 15% perf-profile.children.cycles-pp.xfs_icwalk_ag
1.37 ? 10% +9.1 10.48 ? 15% perf-profile.children.cycles-pp.process_one_work
1.39 ? 10% +9.1 10.50 ? 15% perf-profile.children.cycles-pp.worker_thread
1.45 ? 9% +9.1 10.59 ? 15% perf-profile.children.cycles-pp.kthread
1.45 ? 10% +9.1 10.59 ? 15% perf-profile.children.cycles-pp.ret_from_fork
2.34 ? 6% -0.6 1.78 ? 6% perf-profile.self.cycles-pp.__xfs_btree_check_sblock
2.23 ? 6% -0.5 1.72 ? 8% perf-profile.self.cycles-pp.xfs_inobt_get_maxrecs
1.40 ? 5% -0.5 0.94 ? 5% perf-profile.self.cycles-pp.xfs_btree_check_sblock
1.84 ? 12% -0.5 1.38 ? 12% perf-profile.self.cycles-pp.__percpu_counter_sum
1.16 ? 4% -0.4 0.81 ? 13% perf-profile.self.cycles-pp.xfs_btree_increment
1.21 ? 8% -0.3 0.94 ? 10% perf-profile.self.cycles-pp.xfs_errortag_test
0.99 ? 5% -0.2 0.77 ? 10% perf-profile.self.cycles-pp.xfs_inobt_get_rec
0.55 ? 11% -0.2 0.38 ? 12% perf-profile.self.cycles-pp.xfs_inobt_btrec_to_irec
0.60 ? 9% -0.2 0.44 ? 9% perf-profile.self.cycles-pp.xfs_verify_agino
0.49 ? 8% -0.2 0.34 ? 11% perf-profile.self.cycles-pp.xfs_btree_rec_offset
0.89 ? 3% -0.1 0.75 ? 10% perf-profile.self.cycles-pp.xfs_btree_get_rec
0.58 ? 8% -0.1 0.45 ? 17% perf-profile.self.cycles-pp.syscall_exit_to_user_mode
0.50 ? 8% -0.1 0.39 ? 16% perf-profile.self.cycles-pp._find_next_bit
0.27 ? 16% -0.1 0.18 ? 19% perf-profile.self.cycles-pp._xfs_trans_bjoin
0.43 ? 10% -0.1 0.34 ? 13% perf-profile.self.cycles-pp.xfs_btree_check_block
0.37 ? 9% -0.1 0.29 ? 3% perf-profile.self.cycles-pp.xfs_btree_lookup
0.36 ? 14% -0.1 0.29 ? 9% perf-profile.self.cycles-pp.xfs_perag_get
0.17 ? 10% -0.1 0.10 ? 23% perf-profile.self.cycles-pp.xfs_inobt_init_key_from_rec
0.10 ? 24% -0.1 0.05 ? 74% perf-profile.self.cycles-pp.xfs_da3_node_lookup_int
0.20 ? 14% -0.0 0.14 ? 15% perf-profile.self.cycles-pp.__intel_pmu_disable_all
0.10 ? 24% -0.0 0.06 ? 13% perf-profile.self.cycles-pp.xfs_btree_lookup_get_block
0.09 ? 25% -0.0 0.06 ? 19% perf-profile.self.cycles-pp.down_read
0.10 ? 13% -0.0 0.08 ? 13% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
0.08 ? 20% +0.0 0.12 ? 13% perf-profile.self.cycles-pp.rcu_eqs_exit
0.11 ? 16% +0.0 0.15 ? 13% perf-profile.self.cycles-pp.rb_next
0.07 ? 23% +0.0 0.11 ? 17% perf-profile.self.cycles-pp.__sysvec_apic_timer_interrupt
0.12 ? 25% +0.0 0.16 ? 20% perf-profile.self.cycles-pp.xfs_buf_item_size_segment
0.07 ? 47% +0.0 0.12 ? 17% perf-profile.self.cycles-pp.cpuidle_not_available
0.04 ? 73% +0.0 0.08 ? 16% perf-profile.self.cycles-pp.hrtimer_forward
0.11 ? 14% +0.0 0.16 ? 11% perf-profile.self.cycles-pp.nr_iowait_cpu
0.13 ? 19% +0.1 0.18 ? 11% perf-profile.self.cycles-pp.timerqueue_add
0.13 ? 16% +0.1 0.18 ? 19% perf-profile.self.cycles-pp.sysvec_apic_timer_interrupt
0.24 ? 14% +0.1 0.30 ? 7% perf-profile.self.cycles-pp.__hrtimer_next_event_base
0.03 ?101% +0.1 0.09 ? 25% perf-profile.self.cycles-pp.xlog_write
0.01 ?223% +0.1 0.07 ? 23% perf-profile.self.cycles-pp.allocate_slab
0.08 ? 51% +0.1 0.14 ? 22% perf-profile.self.cycles-pp.sched_clock_cpu
0.00 +0.1 0.10 ? 28% perf-profile.self.cycles-pp.rhashtable_rehash_table
0.20 ? 13% +0.1 0.30 ? 17% perf-profile.self.cycles-pp.__hrtimer_run_queues
0.18 ? 14% +0.2 0.34 ? 16% perf-profile.self.cycles-pp.xfs_buf_item_format_segment
0.03 ?101% +0.2 0.25 ? 14% perf-profile.self.cycles-pp.xfs_contig_bits
0.77 ? 9% +0.2 1.01 ? 6% perf-profile.self.cycles-pp.cpuidle_enter_state
0.74 ? 11% +0.3 1.06 ? 12% perf-profile.self.cycles-pp.memcpy_erms





Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


---
0DAY/LKP+ Test Infrastructure Open Source Technology Center
https://lists.01.org/hyperkitty/list/[email protected] Intel Corporation

Thanks,
Oliver Sang

---

Attachments:

(No filename) (200.10 kB)
config-5.13.0-rc6-00030-g752d5513e6e9 (176.85 kB)
job-script (8.47 kB)
job.yaml (5.97 kB)
reproduce (557.00 B)
Download all attachments