Greeting,
FYI, we noticed a -71.2% improvement of fsmark.app_overhead due to commit:
commit: 610125ab1e4b1b48dcffe74d9d82b0606bf1b923 ("xfs: speed up directory bestfree block scanning")
https://kernel.googlesource.com/pub/scm/fs/xfs/xfs-linux.git xfs-5.4-merge
in testcase: fsmark
on test machine: 72 threads Intel(R) Xeon(R) Gold 6139 CPU @ 2.30GHz with 128G memory
with following parameters:
iterations: 1x
nr_threads: 1t
disk: 1BRD_32G
fs: xfs
filesize: 4K
test_size: 4G
sync_method: fsyncBeforeClose
nr_files_per_directory: 1fpd
cpufreq_governor: performance
ucode: 0x200005e
test-description: The fsmark is a file system benchmark to test synchronous write workloads, for example, mail servers workload.
test-url: https://sourceforge.net/projects/fsmark/
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/disk/filesize/fs/iterations/kconfig/nr_files_per_directory/nr_threads/rootfs/sync_method/tbox_group/test_size/testcase/ucode:
gcc-7/performance/1BRD_32G/4K/xfs/1x/x86_64-rhel-7.6/1fpd/1t/debian-x86_64-2019-05-14.cgz/fsyncBeforeClose/lkp-skl-2sp7/4G/fsmark/0x200005e
commit:
0e822255f9 ("xfs: factor free block index lookup from xfs_dir2_node_addname_int()")
610125ab1e ("xfs: speed up directory bestfree block scanning")
0e822255f95db400 610125ab1e4b1b48dcffe74d9d8
---------------- ---------------------------
%stddev %change %stddev
\ | \
1.095e+08 -71.2% 31557568 fsmark.app_overhead
6157 +95.5% 12034 fsmark.files_per_sec
167.31 -47.3% 88.25 fsmark.time.elapsed_time
167.31 -47.3% 88.25 fsmark.time.elapsed_time.max
91.00 -8.8% 83.00 fsmark.time.percent_of_cpu_this_job_got
148.15 -53.2% 69.38 fsmark.time.system_time
1458 +1.9% 1486 boot-time.idle
0.07 ± 3% +0.1 0.12 ± 4% mpstat.cpu.all.usr%
23038251 ± 10% -43.7% 12973669 turbostat.IRQ
1969578 ±152% -90.4% 189726 cpuidle.POLL.time
110709 ±105% -74.3% 28436 cpuidle.POLL.usage
124071 +87.1% 232161 vmstat.io.bo
4894717 -9.5% 4427627 vmstat.memory.cache
49434 +84.5% 91224 vmstat.system.cs
234459 ± 9% -24.4% 177214 meminfo.AnonHugePages
2320891 -12.7% 2027075 meminfo.Inactive
2303727 -12.8% 2009922 meminfo.Inactive(file)
1523980 -10.6% 1362149 meminfo.KReclaimable
1523980 -10.6% 1362149 meminfo.SReclaimable
2897760 -10.1% 2605999 meminfo.Slab
99131 +87.0% 185384 meminfo.max_used_kB
89186 -5.6% 84175 proc-vmstat.nr_active_anon
87992 -5.7% 82994 proc-vmstat.nr_anon_pages
114.25 ± 9% -24.7% 86.00 proc-vmstat.nr_anon_transparent_hugepages
848819 -8.8% 774504 proc-vmstat.nr_file_pages
576244 -12.9% 502074 proc-vmstat.nr_inactive_file
5661 -5.3% 5362 proc-vmstat.nr_shmem
380808 -10.6% 340328 proc-vmstat.nr_slab_reclaimable
343272 -9.5% 310812 proc-vmstat.nr_slab_unreclaimable
89186 -5.6% 84175 proc-vmstat.nr_zone_active_anon
576244 -12.9% 502074 proc-vmstat.nr_zone_inactive_file
3255223 -5.1% 3089747 proc-vmstat.numa_hit
3231815 -5.1% 3066299 proc-vmstat.numa_local
4209793 -4.3% 4027510 proc-vmstat.pgalloc_normal
459994 -43.9% 258220 proc-vmstat.pgfault
7.199e+08 +27.9% 9.21e+08 perf-stat.i.branch-instructions
6.44 ± 5% -4.7 1.71 ± 16% perf-stat.i.branch-miss-rate%
45296402 ± 5% -63.9% 16346177 ± 14% perf-stat.i.branch-misses
3285889 ± 17% +51.8% 4988808 ± 6% perf-stat.i.cache-misses
50440 +88.1% 94880 perf-stat.i.context-switches
1.67 ± 6% -24.0% 1.27 ± 5% perf-stat.i.cpi
12011 +90.8% 22912 perf-stat.i.cpu-migrations
2310 ± 15% -32.9% 1549 ± 6% perf-stat.i.cycles-between-cache-misses
9.371e+08 +23.3% 1.155e+09 perf-stat.i.dTLB-loads
5.335e+08 +15.0% 6.136e+08 perf-stat.i.dTLB-stores
2160962 ± 10% +55.5% 3360517 ± 3% perf-stat.i.iTLB-loads
3.307e+09 +34.0% 4.429e+09 perf-stat.i.instructions
0.61 ± 6% +32.3% 0.81 ± 5% perf-stat.i.ipc
2610 +3.8% 2709 perf-stat.i.minor-faults
63.65 ± 9% -14.6 49.01 ± 2% perf-stat.i.node-load-miss-rate%
363143 ± 10% +43.5% 521003 ± 5% perf-stat.i.node-load-misses
174677 ± 8% +81.8% 317608 ± 6% perf-stat.i.node-loads
23.59 ± 50% -13.6 9.98 ± 10% perf-stat.i.node-store-miss-rate%
314463 ± 14% +110.6% 662185 perf-stat.i.node-stores
2610 +3.8% 2709 perf-stat.i.page-faults
6.29 ± 5% -4.5 1.78 ± 14% perf-stat.overall.branch-miss-rate%
1.63 ± 6% -24.3% 1.24 ± 5% perf-stat.overall.cpi
1677 ± 12% -34.4% 1099 ± 3% perf-stat.overall.cycles-between-cache-misses
0.61 ± 6% +32.0% 0.81 ± 5% perf-stat.overall.ipc
7.157e+08 +27.2% 9.106e+08 perf-stat.ps.branch-instructions
45024667 ± 5% -64.1% 16162000 ± 14% perf-stat.ps.branch-misses
3266153 ± 17% +51.0% 4931578 ± 6% perf-stat.ps.cache-misses
50139 +87.1% 93800 perf-stat.ps.context-switches
11939 +89.7% 22651 perf-stat.ps.cpu-migrations
9.316e+08 +22.6% 1.142e+09 perf-stat.ps.dTLB-loads
5.303e+08 +14.4% 6.066e+08 perf-stat.ps.dTLB-stores
2148043 ± 10% +54.7% 3322297 ± 3% perf-stat.ps.iTLB-loads
3.287e+09 +33.2% 4.379e+09 perf-stat.ps.instructions
2595 +3.2% 2679 perf-stat.ps.minor-faults
360953 ± 10% +42.7% 515006 ± 5% perf-stat.ps.node-load-misses
173629 ± 8% +80.8% 313978 ± 6% perf-stat.ps.node-loads
312582 ± 14% +109.4% 654639 perf-stat.ps.node-stores
2595 +3.2% 2679 perf-stat.ps.page-faults
5.508e+11 -29.8% 3.868e+11 perf-stat.total.instructions
1225325 -12.0% 1078389 slabinfo.Acpi-Parse.active_objs
16786 -12.0% 14774 slabinfo.Acpi-Parse.active_slabs
1225458 -12.0% 1078525 slabinfo.Acpi-Parse.num_objs
16786 -12.0% 14774 slabinfo.Acpi-Parse.num_slabs
1207809 -14.3% 1034830 slabinfo.dentry.active_objs
28843 -13.7% 24877 slabinfo.dentry.active_slabs
1211435 -13.7% 1044864 slabinfo.dentry.num_objs
28843 -13.7% 24877 slabinfo.dentry.num_slabs
1174298 -10.9% 1046324 slabinfo.dmaengine-unmap-16.active_objs
28125 -10.3% 25227 slabinfo.dmaengine-unmap-16.active_slabs
1181287 -10.3% 1059571 slabinfo.dmaengine-unmap-16.num_objs
28125 -10.3% 25227 slabinfo.dmaengine-unmap-16.num_slabs
610992 -10.4% 547361 slabinfo.kmalloc-16.active_objs
2400 -9.9% 2163 slabinfo.kmalloc-16.active_slabs
614491 -9.8% 553990 slabinfo.kmalloc-16.num_objs
2400 -9.9% 2163 slabinfo.kmalloc-16.num_slabs
590336 -10.9% 526133 slabinfo.kmalloc-1k.active_objs
18557 -10.3% 16649 slabinfo.kmalloc-1k.active_slabs
593850 -10.3% 532789 slabinfo.kmalloc-1k.num_objs
18557 -10.3% 16649 slabinfo.kmalloc-1k.num_slabs
593092 -10.8% 528897 slabinfo.kmalloc-512.active_objs
18643 -10.2% 16736 slabinfo.kmalloc-512.active_slabs
596596 -10.2% 535564 slabinfo.kmalloc-512.num_objs
18643 -10.2% 16736 slabinfo.kmalloc-512.num_slabs
630847 -10.2% 566617 slabinfo.kmalloc-64.active_objs
9912 -9.6% 8957 slabinfo.kmalloc-64.active_slabs
634394 -9.6% 573316 slabinfo.kmalloc-64.num_objs
9912 -9.6% 8957 slabinfo.kmalloc-64.num_slabs
567224 -15.6% 478901 slabinfo.kmalloc-rcl-64.active_objs
8863 -15.6% 7483 slabinfo.kmalloc-rcl-64.active_slabs
567265 -15.6% 478992 slabinfo.kmalloc-rcl-64.num_objs
8863 -15.6% 7483 slabinfo.kmalloc-rcl-64.num_slabs
11286 -14.7% 9631 slabinfo.vmap_area.active_objs
11286 -14.6% 9633 slabinfo.vmap_area.num_objs
45177 -13.4% 39132 slabinfo.xfs_buf.active_objs
1075 -13.3% 931.50 slabinfo.xfs_buf.active_slabs
45178 -13.4% 39134 slabinfo.xfs_buf.num_objs
1075 -13.3% 931.50 slabinfo.xfs_buf.num_slabs
1173565 -10.9% 1045662 slabinfo.xfs_inode.active_objs
36891 -10.3% 33088 slabinfo.xfs_inode.active_slabs
1180533 -10.3% 1058834 slabinfo.xfs_inode.num_objs
36891 -10.3% 33088 slabinfo.xfs_inode.num_slabs
129.15 ±140% -100.0% 0.00 sched_debug.cfs_rq:/.MIN_vruntime.avg
1120 ± 14% -100.0% 0.00 ±100% sched_debug.cfs_rq:/.exec_clock.avg
6891 ± 14% -100.0% 0.19 ±100% sched_debug.cfs_rq:/.exec_clock.max
5.15 ± 40% -100.0% 0.00 sched_debug.cfs_rq:/.exec_clock.min
1619 ± 10% -100.0% 0.02 ±100% sched_debug.cfs_rq:/.exec_clock.stddev
40258 ± 23% -91.8% 3286 ± 25% sched_debug.cfs_rq:/.load.avg
513659 ± 40% -93.9% 31226 ± 25% sched_debug.cfs_rq:/.load.max
114530 ± 25% -93.5% 7431 ± 15% sched_debug.cfs_rq:/.load.stddev
140.06 ± 16% -50.3% 69.56 ± 26% sched_debug.cfs_rq:/.load_avg.avg
2506 -59.4% 1017 sched_debug.cfs_rq:/.load_avg.max
513.22 ± 8% -57.1% 220.03 ± 16% sched_debug.cfs_rq:/.load_avg.stddev
129.15 ±140% -100.0% 0.00 sched_debug.cfs_rq:/.max_vruntime.avg
5244 ± 11% -34.5% 3432 ± 8% sched_debug.cfs_rq:/.min_vruntime.stddev
341.33 +197.3% 1014 sched_debug.cfs_rq:/.removed.load_avg.max
65.65 ± 23% +155.1% 167.45 ± 30% sched_debug.cfs_rq:/.removed.load_avg.stddev
15860 +193.6% 46568 sched_debug.cfs_rq:/.removed.runnable_sum.max
3033 ± 23% +153.2% 7682 ± 30% sched_debug.cfs_rq:/.removed.runnable_sum.stddev
5.29 ± 44% +155.7% 13.53 ± 48% sched_debug.cfs_rq:/.removed.util_avg.avg
150.58 ± 22% +241.0% 513.50 sched_debug.cfs_rq:/.removed.util_avg.max
24.80 ± 33% +206.1% 75.89 ± 21% sched_debug.cfs_rq:/.removed.util_avg.stddev
19.51 ± 16% -87.8% 2.38 ± 20% sched_debug.cfs_rq:/.runnable_load_avg.avg
258.08 ± 7% -93.3% 17.25 ± 4% sched_debug.cfs_rq:/.runnable_load_avg.max
64.31 ± 10% -91.8% 5.27 ± 8% sched_debug.cfs_rq:/.runnable_load_avg.stddev
40193 ± 23% -93.0% 2808 ± 19% sched_debug.cfs_rq:/.runnable_weight.avg
512372 ± 40% -96.1% 19760 ± 6% sched_debug.cfs_rq:/.runnable_weight.max
114425 ± 25% -94.7% 6060 ± 6% sched_debug.cfs_rq:/.runnable_weight.stddev
5250 ± 11% -34.6% 3433 ± 8% sched_debug.cfs_rq:/.spread0.stddev
226.16 ± 7% +87.7% 424.41 ± 2% sched_debug.cfs_rq:/.util_avg.avg
306.13 ± 10% -13.4% 265.03 ± 6% sched_debug.cfs_rq:/.util_avg.stddev
801745 ± 2% -25.2% 599562 ± 4% sched_debug.cpu.avg_idle.avg
89241 -67.0% 29493 sched_debug.cpu.clock.avg
89243 -66.9% 29496 sched_debug.cpu.clock.max
89238 -67.0% 29488 sched_debug.cpu.clock.min
1.40 ± 3% +21.3% 1.69 ± 6% sched_debug.cpu.clock.stddev
89241 -67.0% 29493 sched_debug.cpu.clock_task.avg
89243 -66.9% 29496 sched_debug.cpu.clock_task.max
89238 -67.0% 29488 sched_debug.cpu.clock_task.min
1.40 ± 3% +21.3% 1.69 ± 6% sched_debug.cpu.clock_task.stddev
3443 -46.8% 1831 sched_debug.cpu.curr->pid.max
0.00 ± 10% +35.7% 0.00 ± 4% sched_debug.cpu.next_balance.stddev
0.10 ± 3% +76.5% 0.17 ± 25% sched_debug.cpu.nr_running.avg
0.27 ± 2% +36.2% 0.37 ± 10% sched_debug.cpu.nr_running.stddev
52142 -97.0% 1560 sched_debug.cpu.nr_switches.avg
342144 ± 24% -97.9% 7120 ± 10% sched_debug.cpu.nr_switches.max
877.83 ± 4% -31.0% 605.50 ± 7% sched_debug.cpu.nr_switches.min
82546 ± 14% -98.6% 1147 ± 7% sched_debug.cpu.nr_switches.stddev
50698 -100.0% 4.01 ±170% sched_debug.cpu.sched_count.avg
339992 ± 24% -100.0% 36.00 ±171% sched_debug.cpu.sched_count.max
82.50 ± 39% -100.0% 0.00 sched_debug.cpu.sched_count.min
82285 ± 14% -100.0% 11.33 ±171% sched_debug.cpu.sched_count.stddev
12702 -100.0% 2.07 ±168% sched_debug.cpu.sched_goidle.avg
79446 ± 18% -100.0% 18.50 ±170% sched_debug.cpu.sched_goidle.max
32.83 ± 29% -100.0% 0.00 sched_debug.cpu.sched_goidle.min
20121 ± 13% -100.0% 5.83 ±169% sched_debug.cpu.sched_goidle.stddev
31319 -100.0% 0.00 sched_debug.cpu.ttwu_count.avg
206185 ± 23% -100.0% 0.00 sched_debug.cpu.ttwu_count.max
56.17 ± 31% -100.0% 0.00 sched_debug.cpu.ttwu_count.min
51045 ± 14% -100.0% 0.00 sched_debug.cpu.ttwu_count.stddev
18916 -100.0% 0.00 sched_debug.cpu.ttwu_local.avg
131935 ± 25% -100.0% 0.00 sched_debug.cpu.ttwu_local.max
29.17 ± 32% -100.0% 0.00 sched_debug.cpu.ttwu_local.min
31305 ± 14% -100.0% 0.00 sched_debug.cpu.ttwu_local.stddev
89239 -67.0% 29491 sched_debug.cpu_clk
86525 -69.1% 26779 ± 2% sched_debug.ktime
89588 -66.7% 29845 sched_debug.sched_clk
130961 ± 2% -37.3% 82053 interrupts.CAL:Function_call_interrupts
1876 ± 2% -38.2% 1159 interrupts.CPU0.CAL:Function_call_interrupts
298448 ± 22% -40.3% 178093 interrupts.CPU0.LOC:Local_timer_interrupts
1861 ± 2% -37.6% 1161 interrupts.CPU1.CAL:Function_call_interrupts
297911 ± 22% -40.4% 177407 interrupts.CPU1.LOC:Local_timer_interrupts
1849 ± 2% -37.4% 1158 interrupts.CPU10.CAL:Function_call_interrupts
298345 ± 22% -40.4% 177854 interrupts.CPU10.LOC:Local_timer_interrupts
298329 ± 22% -40.3% 178050 interrupts.CPU11.LOC:Local_timer_interrupts
1847 ± 2% -39.3% 1120 ± 5% interrupts.CPU12.CAL:Function_call_interrupts
298206 ± 22% -40.4% 177830 interrupts.CPU12.LOC:Local_timer_interrupts
1865 ± 2% -38.0% 1156 interrupts.CPU13.CAL:Function_call_interrupts
298205 ± 22% -40.4% 177816 interrupts.CPU13.LOC:Local_timer_interrupts
1845 ± 2% -36.3% 1175 ± 3% interrupts.CPU14.CAL:Function_call_interrupts
298413 ± 22% -40.5% 177584 interrupts.CPU14.LOC:Local_timer_interrupts
1843 ± 2% -37.1% 1159 interrupts.CPU15.CAL:Function_call_interrupts
298297 ± 22% -40.5% 177602 interrupts.CPU15.LOC:Local_timer_interrupts
1847 ± 2% -47.6% 967.50 ± 34% interrupts.CPU16.CAL:Function_call_interrupts
298288 ± 22% -40.4% 177717 interrupts.CPU16.LOC:Local_timer_interrupts
1849 ± 2% -40.2% 1105 ± 8% interrupts.CPU17.CAL:Function_call_interrupts
298301 ± 22% -40.3% 177979 interrupts.CPU17.LOC:Local_timer_interrupts
1826 ± 2% -37.0% 1151 interrupts.CPU18.CAL:Function_call_interrupts
334281 -46.9% 177508 interrupts.CPU18.LOC:Local_timer_interrupts
1843 ± 2% -37.4% 1154 interrupts.CPU19.CAL:Function_call_interrupts
334646 -46.9% 177846 interrupts.CPU19.LOC:Local_timer_interrupts
1862 ± 2% -37.9% 1155 interrupts.CPU2.CAL:Function_call_interrupts
298202 ± 22% -40.4% 177729 interrupts.CPU2.LOC:Local_timer_interrupts
1842 ± 2% -37.4% 1154 interrupts.CPU20.CAL:Function_call_interrupts
334659 -46.9% 177869 interrupts.CPU20.LOC:Local_timer_interrupts
1839 ± 2% -37.0% 1158 interrupts.CPU21.CAL:Function_call_interrupts
334086 -46.8% 177808 interrupts.CPU21.LOC:Local_timer_interrupts
1841 ± 2% -39.4% 1115 ± 6% interrupts.CPU22.CAL:Function_call_interrupts
334799 -47.0% 177365 interrupts.CPU22.LOC:Local_timer_interrupts
334131 -47.1% 176872 interrupts.CPU23.LOC:Local_timer_interrupts
1836 ± 3% -37.2% 1153 interrupts.CPU24.CAL:Function_call_interrupts
334736 -47.0% 177319 interrupts.CPU24.LOC:Local_timer_interrupts
333998 -47.0% 177085 interrupts.CPU25.LOC:Local_timer_interrupts
1798 ± 6% -35.7% 1157 interrupts.CPU26.CAL:Function_call_interrupts
334028 -47.1% 176616 interrupts.CPU26.LOC:Local_timer_interrupts
1795 ± 6% -39.8% 1081 ± 11% interrupts.CPU27.CAL:Function_call_interrupts
334764 -46.8% 178012 interrupts.CPU27.LOC:Local_timer_interrupts
1838 ± 2% -38.1% 1138 interrupts.CPU28.CAL:Function_call_interrupts
333965 -46.7% 177894 interrupts.CPU28.LOC:Local_timer_interrupts
1838 ± 2% -43.1% 1046 ± 15% interrupts.CPU29.CAL:Function_call_interrupts
334696 -46.9% 177578 interrupts.CPU29.LOC:Local_timer_interrupts
1860 ± 2% -37.8% 1156 interrupts.CPU3.CAL:Function_call_interrupts
298245 ± 22% -40.5% 177558 interrupts.CPU3.LOC:Local_timer_interrupts
1838 ± 2% -46.1% 991.00 ± 22% interrupts.CPU30.CAL:Function_call_interrupts
334744 -47.0% 177459 interrupts.CPU30.LOC:Local_timer_interrupts
1837 ± 2% -38.5% 1129 ± 3% interrupts.CPU31.CAL:Function_call_interrupts
334691 -47.0% 177363 interrupts.CPU31.LOC:Local_timer_interrupts
1835 ± 2% -38.1% 1137 ± 3% interrupts.CPU32.CAL:Function_call_interrupts
334881 -47.0% 177343 interrupts.CPU32.LOC:Local_timer_interrupts
1835 ± 2% -38.3% 1132 ± 3% interrupts.CPU33.CAL:Function_call_interrupts
334485 -46.8% 177826 interrupts.CPU33.LOC:Local_timer_interrupts
1839 ± 3% -39.2% 1118 ± 7% interrupts.CPU34.CAL:Function_call_interrupts
333942 -46.9% 177322 interrupts.CPU34.LOC:Local_timer_interrupts
1823 ± 2% -39.1% 1110 ± 6% interrupts.CPU35.CAL:Function_call_interrupts
334697 -47.1% 177091 interrupts.CPU35.LOC:Local_timer_interrupts
1834 ± 3% -37.3% 1150 interrupts.CPU36.CAL:Function_call_interrupts
298352 ± 22% -40.5% 177449 interrupts.CPU36.LOC:Local_timer_interrupts
1840 ± 3% -36.5% 1169 ± 2% interrupts.CPU37.CAL:Function_call_interrupts
297803 ± 22% -40.3% 177920 interrupts.CPU37.LOC:Local_timer_interrupts
1840 ± 3% -37.4% 1152 interrupts.CPU38.CAL:Function_call_interrupts
298231 ± 22% -40.6% 177238 interrupts.CPU38.LOC:Local_timer_interrupts
1840 ± 3% -37.5% 1150 interrupts.CPU39.CAL:Function_call_interrupts
298199 ± 22% -40.3% 177897 interrupts.CPU39.LOC:Local_timer_interrupts
1856 ± 2% -36.7% 1175 ± 3% interrupts.CPU4.CAL:Function_call_interrupts
298236 ± 22% -40.4% 177852 interrupts.CPU4.LOC:Local_timer_interrupts
1849 ± 2% -37.7% 1152 interrupts.CPU40.CAL:Function_call_interrupts
298299 ± 22% -40.4% 177931 interrupts.CPU40.LOC:Local_timer_interrupts
1834 ± 2% -37.2% 1151 interrupts.CPU41.CAL:Function_call_interrupts
298088 ± 22% -40.3% 177823 interrupts.CPU41.LOC:Local_timer_interrupts
1857 -38.0% 1152 interrupts.CPU42.CAL:Function_call_interrupts
298311 ± 22% -40.5% 177553 interrupts.CPU42.LOC:Local_timer_interrupts
1834 ± 2% -50.6% 906.25 ± 46% interrupts.CPU43.CAL:Function_call_interrupts
299772 ± 21% -40.7% 177842 interrupts.CPU43.LOC:Local_timer_interrupts
1826 ± 2% -36.7% 1156 interrupts.CPU44.CAL:Function_call_interrupts
298276 ± 22% -40.4% 177649 interrupts.CPU44.LOC:Local_timer_interrupts
1834 ± 2% -37.1% 1153 interrupts.CPU45.CAL:Function_call_interrupts
298009 ± 22% -40.8% 176523 interrupts.CPU45.LOC:Local_timer_interrupts
1798 ± 4% -35.8% 1154 interrupts.CPU46.CAL:Function_call_interrupts
298135 ± 22% -40.4% 177796 interrupts.CPU46.LOC:Local_timer_interrupts
1836 ± 2% -36.8% 1159 interrupts.CPU47.CAL:Function_call_interrupts
298390 ± 22% -40.5% 177610 interrupts.CPU47.LOC:Local_timer_interrupts
1834 ± 2% -35.9% 1176 ± 2% interrupts.CPU48.CAL:Function_call_interrupts
297983 ± 22% -40.3% 177906 interrupts.CPU48.LOC:Local_timer_interrupts
1834 ± 2% -36.8% 1160 interrupts.CPU49.CAL:Function_call_interrupts
297780 ± 22% -40.2% 177933 interrupts.CPU49.LOC:Local_timer_interrupts
1846 -37.1% 1161 interrupts.CPU5.CAL:Function_call_interrupts
298332 ± 22% -40.4% 177853 interrupts.CPU5.LOC:Local_timer_interrupts
298082 ± 22% -40.3% 177963 interrupts.CPU50.LOC:Local_timer_interrupts
1833 ± 2% -36.9% 1157 interrupts.CPU51.CAL:Function_call_interrupts
298197 ± 22% -40.4% 177784 interrupts.CPU51.LOC:Local_timer_interrupts
1829 ± 2% -36.8% 1157 interrupts.CPU52.CAL:Function_call_interrupts
297924 ± 22% -40.4% 177669 interrupts.CPU52.LOC:Local_timer_interrupts
1834 ± 2% -38.8% 1121 ± 6% interrupts.CPU53.CAL:Function_call_interrupts
298022 ± 22% -40.4% 177532 interrupts.CPU53.LOC:Local_timer_interrupts
1845 ± 3% -37.6% 1151 interrupts.CPU54.CAL:Function_call_interrupts
334653 -46.8% 177926 interrupts.CPU54.LOC:Local_timer_interrupts
1833 ± 2% -37.4% 1148 ± 2% interrupts.CPU55.CAL:Function_call_interrupts
334703 -47.0% 177550 interrupts.CPU55.LOC:Local_timer_interrupts
1830 ± 2% -37.1% 1151 interrupts.CPU56.CAL:Function_call_interrupts
334671 -46.9% 177807 interrupts.CPU56.LOC:Local_timer_interrupts
1829 ± 2% -36.8% 1155 interrupts.CPU57.CAL:Function_call_interrupts
334245 -46.9% 177398 interrupts.CPU57.LOC:Local_timer_interrupts
1847 ± 2% -37.6% 1152 interrupts.CPU58.CAL:Function_call_interrupts
334753 -47.0% 177354 interrupts.CPU58.LOC:Local_timer_interrupts
1830 ± 2% -37.0% 1153 interrupts.CPU59.CAL:Function_call_interrupts
334077 -46.9% 177294 interrupts.CPU59.LOC:Local_timer_interrupts
1860 ± 2% -37.9% 1155 interrupts.CPU6.CAL:Function_call_interrupts
298163 ± 22% -40.4% 177574 interrupts.CPU6.LOC:Local_timer_interrupts
1801 ± 6% -36.1% 1150 ± 2% interrupts.CPU60.CAL:Function_call_interrupts
334294 -47.0% 177312 interrupts.CPU60.LOC:Local_timer_interrupts
1830 ± 2% -36.9% 1154 interrupts.CPU61.CAL:Function_call_interrupts
333969 -46.8% 177800 interrupts.CPU61.LOC:Local_timer_interrupts
1855 -38.0% 1151 ± 2% interrupts.CPU62.CAL:Function_call_interrupts
333877 -47.0% 176853 interrupts.CPU62.LOC:Local_timer_interrupts
1853 -38.1% 1148 ± 2% interrupts.CPU63.CAL:Function_call_interrupts
334786 -46.9% 177619 interrupts.CPU63.LOC:Local_timer_interrupts
1853 -37.8% 1152 interrupts.CPU64.CAL:Function_call_interrupts
333959 -46.8% 177811 interrupts.CPU64.LOC:Local_timer_interrupts
1816 ± 2% -36.6% 1150 ± 2% interrupts.CPU65.CAL:Function_call_interrupts
333969 -46.8% 177795 interrupts.CPU65.LOC:Local_timer_interrupts
1853 -37.9% 1150 ± 2% interrupts.CPU66.CAL:Function_call_interrupts
333935 -46.9% 177389 interrupts.CPU66.LOC:Local_timer_interrupts
1854 -38.1% 1148 interrupts.CPU67.CAL:Function_call_interrupts
334692 -47.1% 176938 interrupts.CPU67.LOC:Local_timer_interrupts
1853 -38.0% 1148 ± 2% interrupts.CPU68.CAL:Function_call_interrupts
334727 -46.9% 177891 interrupts.CPU68.LOC:Local_timer_interrupts
1854 -38.2% 1147 ± 2% interrupts.CPU69.CAL:Function_call_interrupts
334693 -47.0% 177419 interrupts.CPU69.LOC:Local_timer_interrupts
1854 ± 2% -37.5% 1159 interrupts.CPU7.CAL:Function_call_interrupts
299761 ± 21% -40.7% 177868 interrupts.CPU7.LOC:Local_timer_interrupts
1854 -39.9% 1114 ± 3% interrupts.CPU70.CAL:Function_call_interrupts
334651 -47.1% 176865 interrupts.CPU70.LOC:Local_timer_interrupts
1831 -37.2% 1150 ± 2% interrupts.CPU71.CAL:Function_call_interrupts
333963 -46.9% 177495 interrupts.CPU71.LOC:Local_timer_interrupts
1828 ± 3% -36.6% 1159 interrupts.CPU8.CAL:Function_call_interrupts
298354 ± 22% -40.5% 177494 interrupts.CPU8.LOC:Local_timer_interrupts
1851 ± 2% -37.6% 1155 interrupts.CPU9.CAL:Function_call_interrupts
298428 ± 22% -40.4% 177796 interrupts.CPU9.LOC:Local_timer_interrupts
22777195 ± 11% -43.9% 12786394 interrupts.LOC:Local_timer_interrupts
54209 ± 6% -43.7% 30528 ± 9% softirqs.CPU0.RCU
27877 ± 4% -38.6% 17118 ± 10% softirqs.CPU0.SCHED
58068 ± 14% -35.6% 37377 ± 23% softirqs.CPU0.TIMER
60711 ± 6% -46.9% 32237 ± 14% softirqs.CPU1.RCU
24357 ± 4% -43.1% 13854 ± 6% softirqs.CPU1.SCHED
59549 ± 3% -48.8% 30511 ± 8% softirqs.CPU10.RCU
67034 ± 22% -46.2% 36078 ± 24% softirqs.CPU10.TIMER
56388 ± 7% -45.1% 30950 ± 9% softirqs.CPU11.RCU
23837 ± 3% -48.7% 12228 ± 4% softirqs.CPU11.SCHED
58817 ± 15% -39.1% 35827 ± 25% softirqs.CPU11.TIMER
58286 ± 4% -46.7% 31043 ± 9% softirqs.CPU12.RCU
23918 ± 5% -44.2% 13336 ± 7% softirqs.CPU12.SCHED
65991 ± 21% -45.3% 36065 ± 24% softirqs.CPU12.TIMER
59965 ± 3% -46.4% 32167 ± 15% softirqs.CPU13.RCU
24565 ± 6% -45.9% 13294 ± 10% softirqs.CPU13.SCHED
59966 ± 11% -40.8% 35509 ± 25% softirqs.CPU13.TIMER
54831 ± 12% -46.7% 29222 ± 8% softirqs.CPU14.RCU
24140 ± 6% -48.3% 12490 ± 4% softirqs.CPU14.SCHED
57748 ± 11% -38.4% 35595 ± 25% softirqs.CPU14.TIMER
43504 ± 2% -50.7% 21441 ± 5% softirqs.CPU15.RCU
60025 ± 10% -40.2% 35911 ± 25% softirqs.CPU15.TIMER
43023 ± 2% -53.2% 20128 ± 30% softirqs.CPU16.RCU
24043 ± 6% -46.5% 12853 ± 6% softirqs.CPU16.SCHED
59514 ± 11% -40.3% 35545 ± 25% softirqs.CPU16.TIMER
43746 -48.6% 22492 ± 7% softirqs.CPU17.RCU
23561 ± 4% -45.2% 12915 ± 4% softirqs.CPU17.SCHED
63540 ± 3% -51.0% 31119 ± 4% softirqs.CPU18.RCU
24341 ± 7% -44.6% 13480 ± 4% softirqs.CPU18.SCHED
90114 -46.4% 48260 ± 3% softirqs.CPU18.TIMER
61842 ± 3% -53.1% 28999 ± 7% softirqs.CPU19.RCU
23742 -42.6% 13635 ± 2% softirqs.CPU19.SCHED
89467 -47.3% 47179 ± 9% softirqs.CPU19.TIMER
58870 ± 2% -47.2% 31087 ± 9% softirqs.CPU2.RCU
21315 ± 21% -38.7% 13075 ± 7% softirqs.CPU2.SCHED
60956 ± 13% -30.3% 42468 ± 22% softirqs.CPU2.TIMER
63022 ± 4% -51.7% 30411 ± 2% softirqs.CPU20.RCU
23176 ± 9% -42.5% 13324 ± 2% softirqs.CPU20.SCHED
89127 -45.0% 49004 ± 2% softirqs.CPU20.TIMER
59624 ± 12% -46.6% 31810 softirqs.CPU21.RCU
36968 ± 60% -63.2% 13586 ± 3% softirqs.CPU21.SCHED
88586 -45.0% 48717 ± 2% softirqs.CPU21.TIMER
61745 ± 4% -53.7% 28593 ± 11% softirqs.CPU22.RCU
24353 ± 3% -49.3% 12344 ± 12% softirqs.CPU22.SCHED
89098 -46.1% 48051 ± 4% softirqs.CPU22.TIMER
57573 ± 7% -49.3% 29174 ± 5% softirqs.CPU23.RCU
23875 -44.9% 13166 softirqs.CPU23.SCHED
88353 -49.0% 45088 ± 15% softirqs.CPU23.TIMER
59875 ± 8% -51.0% 29356 ± 9% softirqs.CPU24.RCU
25654 ± 6% -39.9% 15430 ± 40% softirqs.CPU24.SCHED
89079 -48.4% 45921 ± 13% softirqs.CPU24.TIMER
23800 ± 2% -44.9% 13111 ± 2% softirqs.CPU25.SCHED
88540 -46.0% 47779 ± 8% softirqs.CPU25.TIMER
24394 ± 2% -44.9% 13430 ± 3% softirqs.CPU26.SCHED
88406 -45.5% 48198 ± 3% softirqs.CPU26.TIMER
55400 ± 10% -44.2% 30899 ± 11% softirqs.CPU27.RCU
23649 ± 8% -41.7% 13794 ± 3% softirqs.CPU27.SCHED
88583 -48.4% 45702 ± 17% softirqs.CPU27.TIMER
61076 ± 5% -47.6% 31975 softirqs.CPU28.RCU
24801 ± 7% -44.4% 13790 ± 3% softirqs.CPU28.SCHED
88270 -46.1% 47538 ± 7% softirqs.CPU28.TIMER
62589 ± 5% -49.1% 31861 ± 12% softirqs.CPU29.RCU
22344 ± 15% -39.7% 13465 ± 9% softirqs.CPU29.SCHED
88571 -48.6% 45494 ± 13% softirqs.CPU29.TIMER
59158 ± 3% -51.4% 28739 ± 9% softirqs.CPU3.RCU
23256 ± 4% -43.6% 13120 ± 5% softirqs.CPU3.SCHED
51817 ± 9% -48.4% 26759 ± 5% softirqs.CPU30.RCU
24876 ± 4% -49.9% 12455 ± 14% softirqs.CPU30.SCHED
88641 -44.5% 49180 softirqs.CPU30.TIMER
53284 ± 3% -50.5% 26371 ± 4% softirqs.CPU31.RCU
25595 ± 11% -48.0% 13317 softirqs.CPU31.SCHED
88517 -45.4% 48371 ± 3% softirqs.CPU31.TIMER
50257 ± 2% -49.9% 25185 ± 8% softirqs.CPU32.RCU
24804 ± 3% -41.0% 14646 ± 17% softirqs.CPU32.SCHED
88909 -45.9% 48111 ± 16% softirqs.CPU32.TIMER
52557 ± 5% -51.6% 25429 ± 6% softirqs.CPU33.RCU
24982 ± 10% -46.9% 13269 softirqs.CPU33.SCHED
88651 -45.6% 48201 ± 4% softirqs.CPU33.TIMER
52083 ± 4% -48.5% 26825 ± 6% softirqs.CPU34.RCU
24250 ± 5% -44.1% 13555 ± 4% softirqs.CPU34.SCHED
88094 -47.5% 46212 ± 11% softirqs.CPU34.TIMER
54414 ± 4% -51.0% 26688 ± 3% softirqs.CPU35.RCU
23430 ± 19% -42.7% 13434 ± 3% softirqs.CPU35.SCHED
88413 -47.0% 46879 ± 8% softirqs.CPU35.TIMER
21444 ± 15% -42.9% 12251 ± 7% softirqs.CPU36.SCHED
63391 ± 26% -45.0% 34882 ± 26% softirqs.CPU36.TIMER
50652 ± 2% -46.2% 27253 ± 7% softirqs.CPU37.RCU
22122 ± 3% -43.2% 12572 ± 3% softirqs.CPU37.SCHED
56142 ± 10% -35.5% 36219 ± 23% softirqs.CPU37.TIMER
51707 ± 2% -47.8% 26966 ± 2% softirqs.CPU38.RCU
22642 ± 2% -45.7% 12291 ± 9% softirqs.CPU38.SCHED
57468 ± 8% -37.1% 36175 ± 23% softirqs.CPU38.TIMER
52008 ± 3% -48.3% 26892 ± 5% softirqs.CPU39.RCU
22626 ± 4% -46.4% 12119 ± 2% softirqs.CPU39.SCHED
56604 ± 6% -39.1% 34465 ± 22% softirqs.CPU39.TIMER
56855 ± 6% -44.6% 31487 ± 7% softirqs.CPU4.RCU
23920 ± 4% -44.0% 13407 ± 5% softirqs.CPU4.SCHED
58578 ± 13% -38.2% 36222 ± 23% softirqs.CPU4.TIMER
52364 ± 7% -49.7% 26331 ± 3% softirqs.CPU40.RCU
22321 ± 4% -43.5% 12605 ± 5% softirqs.CPU40.SCHED
58028 ± 4% -38.9% 35469 ± 25% softirqs.CPU40.TIMER
51016 ± 2% -49.6% 25717 softirqs.CPU41.RCU
21001 ± 10% -41.7% 12253 ± 4% softirqs.CPU41.SCHED
53330 ± 7% -33.4% 35502 ± 25% softirqs.CPU41.TIMER
50075 ± 5% -46.9% 26589 ± 5% softirqs.CPU42.RCU
21727 ± 6% -42.9% 12414 ± 3% softirqs.CPU42.SCHED
56367 ± 16% -37.6% 35152 ± 26% softirqs.CPU42.TIMER
51297 ± 5% -48.5% 26393 ± 5% softirqs.CPU43.RCU
21310 ± 9% -42.4% 12265 ± 4% softirqs.CPU43.SCHED
51204 ± 7% -49.4% 25897 ± 2% softirqs.CPU44.RCU
21921 ± 9% -45.1% 12032 ± 3% softirqs.CPU44.SCHED
57559 ± 7% -38.5% 35403 ± 24% softirqs.CPU44.TIMER
50926 ± 7% -47.1% 26927 ± 6% softirqs.CPU45.RCU
22361 ± 3% -51.2% 10908 ± 20% softirqs.CPU45.SCHED
52729 ± 7% -33.9% 34866 ± 27% softirqs.CPU45.TIMER
51134 ± 6% -46.7% 27231 ± 4% softirqs.CPU46.RCU
21394 ± 8% -45.2% 11717 ± 8% softirqs.CPU46.SCHED
55168 ± 6% -36.3% 35147 ± 25% softirqs.CPU46.TIMER
51129 ± 6% -47.5% 26866 ± 5% softirqs.CPU47.RCU
22067 ± 4% -46.8% 11731 ± 8% softirqs.CPU47.SCHED
56573 ± 15% -38.0% 35062 ± 25% softirqs.CPU47.TIMER
51671 ± 4% -47.6% 27065 ± 4% softirqs.CPU48.RCU
22484 ± 4% -47.1% 11888 ± 4% softirqs.CPU48.SCHED
58561 ± 12% -39.8% 35240 ± 24% softirqs.CPU48.TIMER
53232 ± 2% -55.6% 23630 ± 30% softirqs.CPU49.RCU
22228 ± 2% -51.1% 10873 ± 19% softirqs.CPU49.SCHED
57658 ± 8% -38.2% 35650 ± 25% softirqs.CPU49.TIMER
58872 ± 3% -49.8% 29578 ± 5% softirqs.CPU5.RCU
24052 ± 7% -45.7% 13054 ± 5% softirqs.CPU5.SCHED
55224 ± 11% -35.1% 35857 ± 24% softirqs.CPU5.TIMER
42482 ± 83% -70.7% 12428 ± 8% softirqs.CPU50.SCHED
70678 ± 24% -49.3% 35855 ± 24% softirqs.CPU50.TIMER
52835 ± 2% -48.9% 26979 ± 4% softirqs.CPU51.RCU
21980 ± 4% -43.6% 12388 ± 3% softirqs.CPU51.SCHED
56773 ± 7% -37.5% 35469 ± 24% softirqs.CPU51.TIMER
52464 ± 2% -48.9% 26812 ± 4% softirqs.CPU52.RCU
23131 ± 3% -46.9% 12275 ± 3% softirqs.CPU52.SCHED
55622 ± 9% -37.0% 35054 ± 26% softirqs.CPU52.TIMER
51387 ± 6% -49.1% 26168 ± 5% softirqs.CPU53.RCU
22182 ± 6% -43.4% 12559 ± 7% softirqs.CPU53.SCHED
58565 ± 12% -40.5% 34841 ± 27% softirqs.CPU53.TIMER
53529 ± 4% -48.7% 27453 ± 2% softirqs.CPU54.RCU
23768 -43.4% 13455 softirqs.CPU54.SCHED
88492 -41.7% 51611 ± 7% softirqs.CPU54.TIMER
53399 ± 2% -47.6% 27982 ± 10% softirqs.CPU55.RCU
23761 -43.0% 13535 ± 2% softirqs.CPU55.SCHED
88058 -47.3% 46403 ± 10% softirqs.CPU55.TIMER
54407 ± 4% -57.5% 23106 ± 29% softirqs.CPU56.RCU
23252 ± 3% -47.6% 12186 ± 11% softirqs.CPU56.SCHED
88127 -45.1% 48396 ± 2% softirqs.CPU56.TIMER
54038 ± 6% -50.8% 26611 ± 4% softirqs.CPU57.RCU
22815 ± 4% -45.4% 12447 ± 6% softirqs.CPU57.SCHED
88053 -45.1% 48354 ± 3% softirqs.CPU57.TIMER
52967 ± 6% -49.9% 26515 ± 3% softirqs.CPU58.RCU
22423 ± 10% -43.0% 12785 ± 4% softirqs.CPU58.SCHED
88072 -45.1% 48363 ± 6% softirqs.CPU58.TIMER
49189 ± 4% -50.5% 24366 ± 6% softirqs.CPU59.RCU
22559 ± 7% -43.1% 12843 ± 3% softirqs.CPU59.SCHED
87584 ± 2% -48.7% 44961 ± 16% softirqs.CPU59.TIMER
56427 ± 7% -46.3% 30325 ± 10% softirqs.CPU6.RCU
24292 ± 7% -45.0% 13362 ± 5% softirqs.CPU6.SCHED
58722 ± 15% -38.2% 36319 ± 24% softirqs.CPU6.TIMER
59290 -49.8% 29772 ± 7% softirqs.CPU60.RCU
23158 ± 4% -42.3% 13373 ± 2% softirqs.CPU60.SCHED
87956 -49.1% 44784 ± 17% softirqs.CPU60.TIMER
59842 ± 4% -50.6% 29551 ± 5% softirqs.CPU61.RCU
23617 -47.6% 12367 ± 13% softirqs.CPU61.SCHED
87914 -46.5% 47007 ± 8% softirqs.CPU61.TIMER
60511 ± 5% -50.8% 29757 ± 5% softirqs.CPU62.RCU
23759 ± 2% -46.5% 12719 ± 5% softirqs.CPU62.SCHED
87916 ± 2% -45.5% 47873 ± 2% softirqs.CPU62.TIMER
57371 -51.7% 27703 ± 7% softirqs.CPU63.RCU
23728 -44.7% 13115 softirqs.CPU63.SCHED
87929 -49.3% 44539 ± 18% softirqs.CPU63.TIMER
59716 ± 4% -50.0% 29879 ± 4% softirqs.CPU64.RCU
22868 ± 6% -41.9% 13290 softirqs.CPU64.SCHED
88069 -46.3% 47282 ± 6% softirqs.CPU64.TIMER
60190 ± 6% -51.4% 29224 ± 5% softirqs.CPU65.RCU
23928 -45.6% 13017 softirqs.CPU65.SCHED
87666 ± 2% -48.6% 45053 ± 15% softirqs.CPU65.TIMER
60185 ± 7% -50.5% 29798 ± 5% softirqs.CPU66.RCU
22217 ± 6% -41.9% 12898 ± 2% softirqs.CPU66.SCHED
87772 ± 2% -45.5% 47793 ± 2% softirqs.CPU66.TIMER
61622 ± 5% -50.6% 30452 ± 3% softirqs.CPU67.RCU
23487 ± 3% -45.1% 12901 softirqs.CPU67.SCHED
89315 ± 3% -46.8% 47559 ± 4% softirqs.CPU67.TIMER
55707 ± 4% -50.4% 27645 ± 6% softirqs.CPU68.RCU
23621 ± 2% -44.5% 13105 softirqs.CPU68.SCHED
88412 -48.8% 45264 ± 14% softirqs.CPU68.TIMER
58554 ± 7% -54.3% 26731 ± 9% softirqs.CPU69.RCU
88123 ± 2% -45.9% 47680 ± 4% softirqs.CPU69.TIMER
57962 ± 3% -47.2% 30609 ± 7% softirqs.CPU7.RCU
24363 ± 5% -45.3% 13330 ± 10% softirqs.CPU7.SCHED
60985 ± 14% -38.8% 37305 ± 22% softirqs.CPU7.TIMER
61598 ± 7% -52.5% 29242 ± 3% softirqs.CPU70.RCU
22981 ± 3% -43.8% 12911 ± 3% softirqs.CPU70.SCHED
89549 ± 4% -48.9% 45756 ± 11% softirqs.CPU70.TIMER
60772 ± 6% -52.2% 29062 ± 2% softirqs.CPU71.RCU
23554 ± 2% -44.3% 13126 softirqs.CPU71.SCHED
87724 -46.8% 46691 ± 8% softirqs.CPU71.TIMER
57043 ± 6% -46.7% 30377 ± 8% softirqs.CPU8.RCU
23768 ± 4% -45.2% 13016 ± 6% softirqs.CPU8.SCHED
61683 ± 11% -41.7% 35992 ± 24% softirqs.CPU8.TIMER
57296 ± 6% -48.2% 29661 ± 7% softirqs.CPU9.RCU
24029 ± 5% -48.1% 12479 ± 6% softirqs.CPU9.SCHED
56125 ± 13% -36.7% 35534 ± 24% softirqs.CPU9.TIMER
3967379 ± 3% -48.9% 2028493 ± 3% softirqs.RCU
1715302 ± 3% -44.6% 949923 ± 3% softirqs.SCHED
5295164 ± 2% -43.3% 3002602 ± 6% softirqs.TIMER
8.40 ± 3% -6.3 2.14 ± 4% perf-profile.calltrace.cycles-pp.xfs_dir2_node_addname.xfs_dir_createname.xfs_create.xfs_generic_create.vfs_mkdir
8.49 ± 3% -6.2 2.25 ± 4% perf-profile.calltrace.cycles-pp.xfs_dir_createname.xfs_create.xfs_generic_create.vfs_mkdir.do_mkdirat
14.51 ± 2% -4.7 9.76 ± 3% perf-profile.calltrace.cycles-pp.mkdir
12.04 ± 3% -4.6 7.46 ± 3% perf-profile.calltrace.cycles-pp.xfs_create.xfs_generic_create.vfs_mkdir.do_mkdirat.do_syscall_64
12.16 ± 3% -4.6 7.60 ± 3% perf-profile.calltrace.cycles-pp.xfs_generic_create.vfs_mkdir.do_mkdirat.do_syscall_64.entry_SYSCALL_64_after_hwframe
12.26 ± 3% -4.5 7.72 ± 3% perf-profile.calltrace.cycles-pp.vfs_mkdir.do_mkdirat.do_syscall_64.entry_SYSCALL_64_after_hwframe.mkdir
13.51 ± 3% -4.1 9.44 ± 3% perf-profile.calltrace.cycles-pp.do_mkdirat.do_syscall_64.entry_SYSCALL_64_after_hwframe.mkdir
13.57 ± 3% -4.0 9.54 ± 3% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.mkdir
13.57 ± 3% -4.0 9.54 ± 3% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.mkdir
0.95 +0.2 1.10 ± 5% perf-profile.calltrace.cycles-pp.xfs_trans_committed_bulk.xlog_cil_committed.xlog_cil_process_committed.xlog_state_do_callback.xlog_ioend_work
0.61 ± 8% +0.2 0.78 ± 9% perf-profile.calltrace.cycles-pp.__wake_up_common_lock.xlog_state_do_callback.xlog_ioend_work.process_one_work.worker_thread
0.59 ± 9% +0.2 0.77 ± 10% perf-profile.calltrace.cycles-pp.try_to_wake_up.__wake_up_common.__wake_up_common_lock.xlog_state_do_callback.xlog_ioend_work
0.59 ± 9% +0.2 0.77 ± 10% perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.xlog_state_do_callback.xlog_ioend_work.process_one_work
1.14 ± 3% +0.2 1.34 ± 3% perf-profile.calltrace.cycles-pp.xlog_cil_committed.xlog_cil_process_committed.xlog_state_do_callback.xlog_ioend_work.process_one_work
0.58 ± 12% +0.2 0.78 ± 11% perf-profile.calltrace.cycles-pp.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write.new_sync_write
1.15 ± 3% +0.2 1.35 ± 3% perf-profile.calltrace.cycles-pp.xlog_cil_process_committed.xlog_state_do_callback.xlog_ioend_work.process_one_work.worker_thread
0.67 ± 6% +0.2 0.89 ± 4% perf-profile.calltrace.cycles-pp.xlog_write.xlog_cil_push.process_one_work.worker_thread.kthread
0.57 ± 2% +0.2 0.81 ± 6% perf-profile.calltrace.cycles-pp.xfs_da3_node_lookup_int.xfs_dir2_node_lookup.xfs_dir_lookup.xfs_lookup.xfs_vn_lookup
0.72 ± 6% +0.2 0.96 ± 4% perf-profile.calltrace.cycles-pp.xfs_dir2_node_lookup.xfs_dir_lookup.xfs_lookup.xfs_vn_lookup.__lookup_hash
0.56 ± 7% +0.3 0.82 ± 6% perf-profile.calltrace.cycles-pp.wake_up_page_bit.xfs_destroy_ioend.xfs_end_ioend.xfs_end_io.process_one_work
0.84 ± 3% +0.3 1.10 ± 6% perf-profile.calltrace.cycles-pp.xfs_dir_lookup.xfs_lookup.xfs_vn_lookup.__lookup_hash.filename_create
0.84 ± 3% +0.3 1.11 ± 6% perf-profile.calltrace.cycles-pp.xfs_lookup.xfs_vn_lookup.__lookup_hash.filename_create.do_mkdirat
0.86 ± 4% +0.3 1.14 ± 5% perf-profile.calltrace.cycles-pp.xfs_vn_lookup.__lookup_hash.filename_create.do_mkdirat.do_syscall_64
0.66 ± 5% +0.3 0.96 ± 5% perf-profile.calltrace.cycles-pp.xfs_destroy_ioend.xfs_end_ioend.xfs_end_io.process_one_work.worker_thread
0.80 ± 4% +0.3 1.11 ± 13% perf-profile.calltrace.cycles-pp.xfs_log_commit_cil.__xfs_trans_commit.xfs_create.xfs_generic_create.path_openat
0.78 ± 13% +0.3 1.10 ± 11% perf-profile.calltrace.cycles-pp.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write.new_sync_write.vfs_write
0.97 ± 2% +0.3 1.30 ± 7% perf-profile.calltrace.cycles-pp.__lookup_hash.filename_create.do_mkdirat.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.78 ± 13% +0.3 1.11 ± 11% perf-profile.calltrace.cycles-pp.iomap_file_buffered_write.xfs_file_buffered_aio_write.new_sync_write.vfs_write.ksys_write
0.81 ± 15% +0.3 1.14 ± 7% perf-profile.calltrace.cycles-pp.brd_make_request.generic_make_request.submit_bio.xfs_submit_ioend.xfs_vm_writepages
0.42 ± 57% +0.3 0.76 ± 6% perf-profile.calltrace.cycles-pp.try_to_wake_up.autoremove_wake_function.__wake_up_common.wake_up_page_bit.xfs_destroy_ioend
0.90 ± 11% +0.3 1.24 ± 9% perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.84 ± 12% +0.3 1.19 ± 10% perf-profile.calltrace.cycles-pp.xfs_file_buffered_aio_write.new_sync_write.vfs_write.ksys_write.do_syscall_64
0.95 ± 12% +0.3 1.30 ± 8% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
0.42 ± 57% +0.4 0.77 ± 6% perf-profile.calltrace.cycles-pp.autoremove_wake_function.__wake_up_common.wake_up_page_bit.xfs_destroy_ioend.xfs_end_ioend
0.26 ±100% +0.4 0.61 ± 9% perf-profile.calltrace.cycles-pp.__xfs_trans_commit.xfs_bmapi_convert_delalloc.xfs_map_blocks.xfs_do_writepage.write_cache_pages
0.82 ± 5% +0.4 1.18 ± 14% perf-profile.calltrace.cycles-pp.__xfs_trans_commit.xfs_create.xfs_generic_create.path_openat.do_filp_open
0.43 ± 57% +0.4 0.79 ± 7% perf-profile.calltrace.cycles-pp.__wake_up_common.wake_up_page_bit.xfs_destroy_ioend.xfs_end_ioend.xfs_end_io
0.96 ± 12% +0.4 1.33 ± 9% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
1.01 ± 7% +0.4 1.38 ± 3% perf-profile.calltrace.cycles-pp.xfs_dir_ialloc.xfs_create.xfs_generic_create.path_openat.do_filp_open
1.03 ± 10% +0.4 1.40 ± 8% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write
1.01 ± 7% +0.4 1.38 ± 3% perf-profile.calltrace.cycles-pp.xfs_ialloc.xfs_dir_ialloc.xfs_create.xfs_generic_create.path_openat
0.86 ± 14% +0.4 1.24 ± 8% perf-profile.calltrace.cycles-pp.generic_make_request.submit_bio.xfs_submit_ioend.xfs_vm_writepages.do_writepages
0.67 ± 13% +0.4 1.04 ± 10% perf-profile.calltrace.cycles-pp.xfs_alloc_ag_vextent_near.xfs_alloc_ag_vextent.xfs_alloc_vextent.xfs_bmap_btalloc.xfs_bmapi_allocate
1.03 ± 11% +0.4 1.40 ± 8% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
0.86 ± 14% +0.4 1.24 ± 8% perf-profile.calltrace.cycles-pp.submit_bio.xfs_submit_ioend.xfs_vm_writepages.do_writepages.__filemap_fdatawrite_range
1.11 ± 10% +0.4 1.50 ± 8% perf-profile.calltrace.cycles-pp.write
1.81 ± 4% +0.4 2.20 perf-profile.calltrace.cycles-pp.xlog_state_do_callback.xlog_ioend_work.process_one_work.worker_thread.kthread
0.93 ± 12% +0.4 1.32 ± 8% perf-profile.calltrace.cycles-pp.xfs_submit_ioend.xfs_vm_writepages.do_writepages.__filemap_fdatawrite_range.file_write_and_wait_range
0.71 ± 13% +0.4 1.11 ± 8% perf-profile.calltrace.cycles-pp.xfs_alloc_ag_vextent.xfs_alloc_vextent.xfs_bmap_btalloc.xfs_bmapi_allocate.xfs_bmapi_convert_delalloc
1.83 ± 4% +0.4 2.24 perf-profile.calltrace.cycles-pp.xlog_ioend_work.process_one_work.worker_thread.kthread.ret_from_fork
0.86 ± 7% +0.4 1.27 ± 5% perf-profile.calltrace.cycles-pp.xfs_end_io.process_one_work.worker_thread.kthread.ret_from_fork
0.84 ± 6% +0.4 1.25 ± 5% perf-profile.calltrace.cycles-pp.xfs_end_ioend.xfs_end_io.process_one_work.worker_thread.kthread
1.19 ± 2% +0.4 1.61 ± 7% perf-profile.calltrace.cycles-pp.filename_create.do_mkdirat.do_syscall_64.entry_SYSCALL_64_after_hwframe.mkdir
1.32 ± 3% +0.4 1.75 ± 6% perf-profile.calltrace.cycles-pp.xlog_cil_push.process_one_work.worker_thread.kthread.ret_from_fork
0.13 ±173% +0.5 0.58 ± 11% perf-profile.calltrace.cycles-pp.xfs_log_commit_cil.__xfs_trans_commit.xfs_bmapi_convert_delalloc.xfs_map_blocks.xfs_do_writepage
0.28 ±100% +0.5 0.74 ± 7% perf-profile.calltrace.cycles-pp.xfs_da3_node_lookup_int.xfs_dir2_node_addname.xfs_dir_createname.xfs_create.xfs_generic_create
0.12 ±173% +0.5 0.60 ± 8% perf-profile.calltrace.cycles-pp.xlog_cil_force_lsn.xfs_log_force_lsn.xfs_file_fsync.do_fsync.__x64_sys_fsync
0.95 ± 12% +0.5 1.47 ± 5% perf-profile.calltrace.cycles-pp.xfs_alloc_vextent.xfs_bmap_btalloc.xfs_bmapi_allocate.xfs_bmapi_convert_delalloc.xfs_map_blocks
0.00 +0.5 0.53 ± 3% perf-profile.calltrace.cycles-pp.__queue_work.queue_work_on.xfs_end_bio.brd_make_request.generic_make_request
0.00 +0.5 0.54 ± 2% perf-profile.calltrace.cycles-pp.queue_work_on.xfs_end_bio.brd_make_request.generic_make_request.submit_bio
1.03 ± 12% +0.5 1.58 ± 4% perf-profile.calltrace.cycles-pp.xfs_bmap_btalloc.xfs_bmapi_allocate.xfs_bmapi_convert_delalloc.xfs_map_blocks.xfs_do_writepage
0.00 +0.6 0.55 ± 7% perf-profile.calltrace.cycles-pp.xfs_buf_item_unpin.xfs_trans_committed_bulk.xlog_cil_committed.xlog_cil_process_committed.xlog_state_do_callback
0.00 +0.6 0.55 ± 7% perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
0.00 +0.6 0.55 ± 4% perf-profile.calltrace.cycles-pp.xfs_end_bio.brd_make_request.generic_make_request.submit_bio.xfs_submit_ioend
1.14 ± 13% +0.6 1.71 ± 4% perf-profile.calltrace.cycles-pp.xfs_bmapi_allocate.xfs_bmapi_convert_delalloc.xfs_map_blocks.xfs_do_writepage.write_cache_pages
0.00 +0.6 0.58 ± 6% perf-profile.calltrace.cycles-pp.memcpy_erms.xlog_write.xlog_cil_push.process_one_work.worker_thread
0.00 +0.6 0.59 ± 4% perf-profile.calltrace.cycles-pp.xfs_buf_item_format.xfs_log_commit_cil.__xfs_trans_commit.xfs_create.xfs_generic_create
0.00 +0.6 0.65 ± 5% perf-profile.calltrace.cycles-pp.xfsaild.kthread.ret_from_fork
1.52 ± 3% +0.7 2.17 ± 5% perf-profile.calltrace.cycles-pp.xfs_dialloc_ag.xfs_dialloc.xfs_ialloc.xfs_dir_ialloc.xfs_create
1.64 ± 7% +0.7 2.36 ± 5% perf-profile.calltrace.cycles-pp.xfs_dir_ialloc.xfs_create.xfs_generic_create.vfs_mkdir.do_mkdirat
1.59 ± 6% +0.7 2.30 ± 6% perf-profile.calltrace.cycles-pp.xfs_ialloc.xfs_dir_ialloc.xfs_create.xfs_generic_create.vfs_mkdir
1.78 ± 8% +0.7 2.51 ± 3% perf-profile.calltrace.cycles-pp.xfs_map_blocks.xfs_do_writepage.write_cache_pages.xfs_vm_writepages.do_writepages
1.74 ± 8% +0.7 2.48 ± 3% perf-profile.calltrace.cycles-pp.xfs_bmapi_convert_delalloc.xfs_map_blocks.xfs_do_writepage.write_cache_pages.xfs_vm_writepages
1.96 ± 8% +0.8 2.72 ± 3% perf-profile.calltrace.cycles-pp.xfs_do_writepage.write_cache_pages.xfs_vm_writepages.do_writepages.__filemap_fdatawrite_range
2.14 ± 8% +0.8 2.94 ± 3% perf-profile.calltrace.cycles-pp.write_cache_pages.xfs_vm_writepages.do_writepages.__filemap_fdatawrite_range.file_write_and_wait_range
1.58 +0.8 2.40 ± 4% perf-profile.calltrace.cycles-pp.xfs_log_commit_cil.__xfs_trans_commit.xfs_create.xfs_generic_create.vfs_mkdir
1.60 +0.8 2.44 ± 4% perf-profile.calltrace.cycles-pp.__xfs_trans_commit.xfs_create.xfs_generic_create.vfs_mkdir.do_mkdirat
1.93 ± 4% +0.8 2.78 ± 4% perf-profile.calltrace.cycles-pp.xfs_dialloc.xfs_ialloc.xfs_dir_ialloc.xfs_create.xfs_generic_create
2.09 ± 5% +0.9 2.95 ± 8% perf-profile.calltrace.cycles-pp.xfs_create.xfs_generic_create.path_openat.do_filp_open.do_sys_open
2.18 ± 4% +0.9 3.06 ± 8% perf-profile.calltrace.cycles-pp.xfs_generic_create.path_openat.do_filp_open.do_sys_open.do_syscall_64
2.88 ± 2% +1.2 4.03 ± 7% perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.open64
2.86 ± 2% +1.2 4.01 ± 7% perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
2.97 ± 2% +1.2 4.14 ± 7% perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.open64
3.09 ± 9% +1.2 4.28 ± 4% perf-profile.calltrace.cycles-pp.xfs_vm_writepages.do_writepages.__filemap_fdatawrite_range.file_write_and_wait_range.xfs_file_fsync
3.09 ± 9% +1.2 4.29 ± 4% perf-profile.calltrace.cycles-pp.do_writepages.__filemap_fdatawrite_range.file_write_and_wait_range.xfs_file_fsync.do_fsync
3.02 ± 2% +1.2 4.22 ± 7% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.open64
3.02 ± 2% +1.2 4.23 ± 7% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.open64
3.11 ± 9% +1.2 4.32 ± 4% perf-profile.calltrace.cycles-pp.__filemap_fdatawrite_range.file_write_and_wait_range.xfs_file_fsync.do_fsync.__x64_sys_fsync
3.11 ± 2% +1.2 4.35 ± 6% perf-profile.calltrace.cycles-pp.open64
4.33 ± 3% +1.3 5.61 ± 2% perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
4.79 ± 3% +1.4 6.15 ± 2% perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
3.60 ± 8% +1.4 4.97 ± 4% perf-profile.calltrace.cycles-pp.file_write_and_wait_range.xfs_file_fsync.do_fsync.__x64_sys_fsync.do_syscall_64
5.37 ± 3% +1.5 6.89 ± 2% perf-profile.calltrace.cycles-pp.ret_from_fork
5.37 ± 3% +1.5 6.89 ± 2% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
6.52 ± 6% +1.6 8.08 ± 4% perf-profile.calltrace.cycles-pp.xfs_file_fsync.do_fsync.__x64_sys_fsync.do_syscall_64.entry_SYSCALL_64_after_hwframe
6.53 ± 6% +1.6 8.10 ± 4% perf-profile.calltrace.cycles-pp.do_fsync.__x64_sys_fsync.do_syscall_64.entry_SYSCALL_64_after_hwframe.fsync
6.54 ± 6% +1.6 8.11 ± 4% perf-profile.calltrace.cycles-pp.__x64_sys_fsync.do_syscall_64.entry_SYSCALL_64_after_hwframe.fsync
6.60 ± 5% +1.6 8.20 ± 4% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.fsync
6.60 ± 5% +1.6 8.21 ± 4% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.fsync
7.02 ± 5% +1.7 8.75 ± 4% perf-profile.calltrace.cycles-pp.fsync
8.41 ± 3% -6.3 2.15 ± 4% perf-profile.children.cycles-pp.xfs_dir2_node_addname
8.66 ± 3% -6.2 2.51 ± 5% perf-profile.children.cycles-pp.xfs_dir_createname
14.51 ± 2% -4.7 9.77 ± 3% perf-profile.children.cycles-pp.mkdir
12.26 ± 3% -4.5 7.72 ± 3% perf-profile.children.cycles-pp.vfs_mkdir
13.51 ± 3% -4.1 9.44 ± 3% perf-profile.children.cycles-pp.do_mkdirat
14.13 ± 2% -3.7 10.42 ± 4% perf-profile.children.cycles-pp.xfs_create
14.35 ± 2% -3.7 10.66 ± 4% perf-profile.children.cycles-pp.xfs_generic_create
2.35 ± 3% -1.9 0.47 ± 7% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax
0.07 ± 6% +0.0 0.08 ± 10% perf-profile.children.cycles-pp.xfs_inobt_init_cursor
0.08 ± 8% +0.0 0.10 ± 8% perf-profile.children.cycles-pp.__module_address
0.06 +0.0 0.08 ± 5% perf-profile.children.cycles-pp.xlog_verify_iclog
0.05 ± 8% +0.0 0.08 ± 10% perf-profile.children.cycles-pp.xfs_buf_iodone_callbacks
0.05 ± 8% +0.0 0.08 ± 10% perf-profile.children.cycles-pp.xfs_buf_do_callbacks
0.08 ± 8% +0.0 0.11 ± 12% perf-profile.children.cycles-pp.put_prev_entity
0.09 ± 11% +0.0 0.12 ± 10% perf-profile.children.cycles-pp.xfs_errortag_test
0.06 ± 11% +0.0 0.09 ± 7% perf-profile.children.cycles-pp.xfs_trans_del_item
0.07 ± 7% +0.0 0.10 ± 11% perf-profile.children.cycles-pp.__module_text_address
0.04 ± 57% +0.0 0.07 ± 12% perf-profile.children.cycles-pp.xfs_ail_check
0.06 ± 7% +0.0 0.09 ± 16% perf-profile.children.cycles-pp.lookup_dcache
0.11 ± 15% +0.0 0.15 ± 7% perf-profile.children.cycles-pp.__pagevec_release
0.06 ± 14% +0.0 0.09 ± 7% perf-profile.children.cycles-pp.check_preempt_wakeup
0.06 ± 11% +0.0 0.09 ± 24% perf-profile.children.cycles-pp.down_write
0.06 ± 17% +0.0 0.10 ± 22% perf-profile.children.cycles-pp.test_clear_page_writeback
0.08 ± 11% +0.0 0.11 ± 19% perf-profile.children.cycles-pp.__add_to_page_cache_locked
0.24 ± 5% +0.0 0.27 ± 7% perf-profile.children.cycles-pp.rcu_idle_exit
0.10 ± 21% +0.0 0.14 ± 8% perf-profile.children.cycles-pp.kmem_cache_free
0.04 ± 57% +0.0 0.07 ± 22% perf-profile.children.cycles-pp.xfs_iext_last
0.11 ± 9% +0.0 0.15 ± 8% perf-profile.children.cycles-pp.xfs_perag_put
0.08 ± 20% +0.0 0.11 ± 19% perf-profile.children.cycles-pp.lookup_fast
0.07 ± 7% +0.0 0.10 ± 12% perf-profile.children.cycles-pp.is_module_text_address
0.16 ± 7% +0.0 0.20 ± 13% perf-profile.children.cycles-pp.orc_find
0.09 ± 17% +0.0 0.12 ± 8% perf-profile.children.cycles-pp.walk_component
0.08 ± 14% +0.0 0.12 ± 25% perf-profile.children.cycles-pp.getname_flags
0.05 ± 60% +0.0 0.09 ± 17% perf-profile.children.cycles-pp.xlog_verify_dest_ptr
0.15 ± 10% +0.0 0.19 ± 12% perf-profile.children.cycles-pp.update_curr
0.11 ± 6% +0.0 0.15 ± 11% perf-profile.children.cycles-pp.kfree
0.13 ± 17% +0.0 0.17 ± 4% perf-profile.children.cycles-pp.__slab_free
0.10 ± 15% +0.0 0.14 ± 7% perf-profile.children.cycles-pp.check_preempt_curr
0.10 ± 15% +0.0 0.14 ± 12% perf-profile.children.cycles-pp.__might_sleep
0.03 ±100% +0.0 0.07 ± 10% perf-profile.children.cycles-pp.pick_next_entity
0.10 ± 18% +0.0 0.15 ± 12% perf-profile.children.cycles-pp.xlog_ticket_alloc
0.01 ±173% +0.0 0.06 ± 14% perf-profile.children.cycles-pp.xlog_grant_add_space
0.06 ± 16% +0.0 0.11 ± 8% perf-profile.children.cycles-pp.up
0.07 ± 17% +0.0 0.11 ± 20% perf-profile.children.cycles-pp.__d_alloc
0.03 ±100% +0.0 0.07 ± 15% perf-profile.children.cycles-pp.xfs_inode_item_pin
0.12 ± 6% +0.0 0.17 ± 14% perf-profile.children.cycles-pp.xfs_trans_brelse
0.05 ± 61% +0.0 0.10 ± 19% perf-profile.children.cycles-pp.xfs_trans_buf_item_match
0.03 ±100% +0.0 0.08 ± 10% perf-profile.children.cycles-pp.file_check_and_advance_wb_err
0.01 ±173% +0.0 0.06 ± 11% perf-profile.children.cycles-pp.xfs_buf_item_log
0.03 ±100% +0.0 0.07 ± 11% perf-profile.children.cycles-pp.read
0.12 ± 10% +0.0 0.17 ± 10% perf-profile.children.cycles-pp.xfs_iext_lookup_extent
0.03 ±100% +0.0 0.08 ± 14% perf-profile.children.cycles-pp.xfs_iflush_done
0.15 ± 16% +0.0 0.20 ± 14% perf-profile.children.cycles-pp.vfprintf
0.20 ± 12% +0.0 0.25 ± 12% perf-profile.children.cycles-pp.dequeue_entity
0.07 ± 61% +0.1 0.12 ± 11% perf-profile.children.cycles-pp.generic_make_request_checks
0.01 ±173% +0.1 0.06 ± 26% perf-profile.children.cycles-pp.inode_permission
0.21 ± 5% +0.1 0.27 ± 10% perf-profile.children.cycles-pp.__flush_work
0.10 ± 10% +0.1 0.15 ± 12% perf-profile.children.cycles-pp.kernel_text_address
0.07 ± 59% +0.1 0.12 ± 14% perf-profile.children.cycles-pp.xfs_dialloc_ag_finobt_near
0.10 ± 36% +0.1 0.15 ± 14% perf-profile.children.cycles-pp.xfs_alloc_read_agf
0.03 ±100% +0.1 0.08 ± 19% perf-profile.children.cycles-pp.strncpy_from_user
0.11 ± 15% +0.1 0.17 ± 16% perf-profile.children.cycles-pp.ttwu_do_wakeup
0.15 ± 12% +0.1 0.20 ± 10% perf-profile.children.cycles-pp.xfs_btree_insert
0.01 ±173% +0.1 0.07 ± 12% perf-profile.children.cycles-pp.xfs_ialloc_ag_select
0.03 ±100% +0.1 0.08 ± 10% perf-profile.children.cycles-pp.tick_nohz_idle_exit
0.10 ± 8% +0.1 0.15 ± 19% perf-profile.children.cycles-pp.xfs_iunlock
0.12 ± 10% +0.1 0.18 ± 10% perf-profile.children.cycles-pp.xfs_btree_insrec
0.22 ± 20% +0.1 0.28 ± 13% perf-profile.children.cycles-pp.xfs_trans_reserve
0.14 ± 16% +0.1 0.19 ± 8% perf-profile.children.cycles-pp.xfs_buf_unlock
0.09 ± 10% +0.1 0.14 ± 30% perf-profile.children.cycles-pp.xfs_da_grow_inode_int
0.14 ± 8% +0.1 0.20 ± 10% perf-profile.children.cycles-pp.stack_trace_consume_entry_nosched
0.14 ± 13% +0.1 0.20 ± 16% perf-profile.children.cycles-pp.xfs_fs_inode_init_once
0.14 ± 12% +0.1 0.20 ± 7% perf-profile.children.cycles-pp.xfs_dir2_sf_addname
0.01 ±173% +0.1 0.07 ± 24% perf-profile.children.cycles-pp.xfs_mod_fdblocks
0.11 ± 13% +0.1 0.17 ± 32% perf-profile.children.cycles-pp.xfs_bmapi_reserve_delalloc
0.01 ±173% +0.1 0.07 ± 31% perf-profile.children.cycles-pp.xfs_inode_verify_forks
0.22 ± 17% +0.1 0.28 ± 6% perf-profile.children.cycles-pp.set_next_entity
0.15 ± 11% +0.1 0.21 ± 3% perf-profile.children.cycles-pp._xfs_buf_ioapply
0.13 ± 9% +0.1 0.19 ± 5% perf-profile.children.cycles-pp.__xfs_dir3_free_read
0.11 ± 7% +0.1 0.18 ± 20% perf-profile.children.cycles-pp.d_alloc
0.00 +0.1 0.06 ± 26% perf-profile.children.cycles-pp.__sb_start_write
0.23 ± 9% +0.1 0.29 ± 6% perf-profile.children.cycles-pp.xfs_bmapi_read
0.14 ± 12% +0.1 0.20 ± 10% perf-profile.children.cycles-pp.xfs_buf_offset
0.12 ± 14% +0.1 0.18 ± 20% perf-profile.children.cycles-pp.__kernel_text_address
0.19 ± 13% +0.1 0.25 ± 5% perf-profile.children.cycles-pp.xfs_next_bit
0.20 ± 9% +0.1 0.27 ± 9% perf-profile.children.cycles-pp.__radix_tree_lookup
0.11 ± 19% +0.1 0.17 ± 12% perf-profile.children.cycles-pp.xfs_trans_log_inode
0.13 ± 13% +0.1 0.20 ± 18% perf-profile.children.cycles-pp.unwind_get_return_address
0.10 ± 20% +0.1 0.16 ± 24% perf-profile.children.cycles-pp._xfs_buf_obj_cmp
0.01 ±173% +0.1 0.08 ± 14% perf-profile.children.cycles-pp.__x64_sys_close
0.08 ± 10% +0.1 0.14 ± 7% perf-profile.children.cycles-pp.xfs_inobt_key_diff
0.18 ± 12% +0.1 0.24 ± 13% perf-profile.children.cycles-pp.__orc_find
0.22 ± 7% +0.1 0.28 ± 7% perf-profile.children.cycles-pp.xfs_dir2_leafn_lookup_for_entry
0.18 ± 15% +0.1 0.25 ± 13% perf-profile.children.cycles-pp.xfs_buf_item_release
0.48 ± 3% +0.1 0.55 ± 7% perf-profile.children.cycles-pp.xfs_buf_item_unpin
0.10 ± 19% +0.1 0.18 ± 6% perf-profile.children.cycles-pp.__unwind_start
0.16 ± 7% +0.1 0.24 ± 3% perf-profile.children.cycles-pp.__xfs_buf_submit
0.03 ±100% +0.1 0.10 ± 50% perf-profile.children.cycles-pp.xfs_bmapi_write
0.27 ± 8% +0.1 0.34 ± 6% perf-profile.children.cycles-pp.xfs_dabuf_map
0.19 ± 5% +0.1 0.27 ± 11% perf-profile.children.cycles-pp.filename_parentat
0.19 ± 13% +0.1 0.27 ± 4% perf-profile.children.cycles-pp.xfs_dir2_leafn_lookup_for_addname
0.19 ± 7% +0.1 0.26 ± 13% perf-profile.children.cycles-pp.pagecache_get_page
0.13 ± 12% +0.1 0.21 ± 12% perf-profile.children.cycles-pp.xfs_btree_get_rec
0.17 ± 11% +0.1 0.24 ± 11% perf-profile.children.cycles-pp.entry_SYSCALL_64
0.14 ± 5% +0.1 0.22 ± 16% perf-profile.children.cycles-pp.down_trylock
0.16 ± 7% +0.1 0.24 ± 4% perf-profile.children.cycles-pp.xfs_buf_delwri_submit_buffers
0.01 ±173% +0.1 0.09 ± 59% perf-profile.children.cycles-pp.xfs_bmap_add_extent_hole_real
0.17 ± 6% +0.1 0.25 ± 11% perf-profile.children.cycles-pp.path_parentat
0.19 ± 7% +0.1 0.27 ± 12% perf-profile.children.cycles-pp.grab_cache_page_write_begin
0.17 ± 12% +0.1 0.24 ± 10% perf-profile.children.cycles-pp.xfs_log_reserve
0.20 ± 4% +0.1 0.27 ± 8% perf-profile.children.cycles-pp.xfs_iflush_int
0.32 ± 11% +0.1 0.40 ± 11% perf-profile.children.cycles-pp.update_load_avg
0.16 ± 15% +0.1 0.24 ± 16% perf-profile.children.cycles-pp.xfs_read_agi
0.15 ± 21% +0.1 0.23 ± 9% perf-profile.children.cycles-pp.xfs_ialloc_ag_alloc
0.15 ± 26% +0.1 0.24 ± 9% perf-profile.children.cycles-pp.__xfs_btree_check_sblock
0.15 ± 13% +0.1 0.24 ± 12% perf-profile.children.cycles-pp.copyin
0.16 ± 11% +0.1 0.24 ± 19% perf-profile.children.cycles-pp.xfs_inobt_get_rec
0.14 ± 22% +0.1 0.22 ± 12% perf-profile.children.cycles-pp.security_inode_permission
0.13 ± 18% +0.1 0.21 ± 13% perf-profile.children.cycles-pp.selinux_inode_permission
0.01 ±173% +0.1 0.10 ± 45% perf-profile.children.cycles-pp.xfs_dir2_leafn_split
0.16 ± 12% +0.1 0.24 ± 5% perf-profile.children.cycles-pp.xfs_inobt_update
0.17 ± 14% +0.1 0.26 ± 10% perf-profile.children.cycles-pp.iov_iter_copy_from_user_atomic
0.01 ±173% +0.1 0.10 ± 43% perf-profile.children.cycles-pp.xfs_da3_split
0.17 ± 15% +0.1 0.25 ± 22% perf-profile.children.cycles-pp.xfs_file_iomap_begin_delay
0.15 ± 14% +0.1 0.24 ± 12% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
0.00 +0.1 0.09 ± 48% perf-profile.children.cycles-pp.xfs_da_grow_inode
0.15 ± 4% +0.1 0.24 ± 12% perf-profile.children.cycles-pp.xfs_buf_trylock
0.13 ± 15% +0.1 0.22 ± 6% perf-profile.children.cycles-pp.xfs_buf_item_init
0.28 ± 3% +0.1 0.37 ± 9% perf-profile.children.cycles-pp.xfs_inode_alloc
0.20 ± 9% +0.1 0.29 ± 11% perf-profile.children.cycles-pp.__vsprintf_chk
0.25 ± 15% +0.1 0.35 ± 4% perf-profile.children.cycles-pp.xfs_buf_item_pin
0.21 ± 20% +0.1 0.31 ± 6% perf-profile.children.cycles-pp.xfs_btree_check_sblock
0.18 ± 20% +0.1 0.27 ± 16% perf-profile.children.cycles-pp.xfs_file_iomap_begin
0.29 ± 11% +0.1 0.38 ± 5% perf-profile.children.cycles-pp.xfs_buf_item_size_segment
0.19 ± 14% +0.1 0.29 ± 16% perf-profile.children.cycles-pp.xfs_ialloc_read_agi
0.22 ± 8% +0.1 0.32 ± 22% perf-profile.children.cycles-pp.get_page_from_freelist
0.30 ± 14% +0.1 0.40 ± 4% perf-profile.children.cycles-pp.xfs_trans_alloc
0.23 ± 4% +0.1 0.33 ± 6% perf-profile.children.cycles-pp.xfs_iflush_cluster
0.29 ± 2% +0.1 0.40 ± 14% perf-profile.children.cycles-pp.io_schedule
0.24 ± 4% +0.1 0.35 ± 19% perf-profile.children.cycles-pp.__alloc_pages_nodemask
0.35 ± 2% +0.1 0.47 ± 15% perf-profile.children.cycles-pp.wait_on_page_bit
0.25 ± 5% +0.1 0.36 ± 7% perf-profile.children.cycles-pp.xfs_iflush
0.18 ± 16% +0.1 0.29 ± 23% perf-profile.children.cycles-pp.xfs_inode_item_format
0.15 ± 12% +0.1 0.26 ± 30% perf-profile.children.cycles-pp.memset_erms
0.33 ± 9% +0.1 0.45 ± 7% perf-profile.children.cycles-pp.xfs_buf_item_size
0.43 ± 11% +0.1 0.55 ± 6% perf-profile.children.cycles-pp.schedule_idle
0.18 ± 4% +0.1 0.30 ± 5% perf-profile.children.cycles-pp.xfs_btree_update
0.23 ± 24% +0.1 0.35 ± 10% perf-profile.children.cycles-pp.xfs_alloc_fix_freelist
0.23 ± 9% +0.1 0.35 ± 13% perf-profile.children.cycles-pp.__list_del_entry_valid
0.20 ± 6% +0.1 0.33 ± 15% perf-profile.children.cycles-pp.iomap_write_begin
0.30 ± 14% +0.1 0.42 ± 18% perf-profile.children.cycles-pp.__percpu_counter_sum
0.18 ± 8% +0.1 0.31 ± 12% perf-profile.children.cycles-pp.xfs_perag_get
0.28 ± 2% +0.1 0.41 ± 13% perf-profile.children.cycles-pp.new_slab
0.27 ± 4% +0.1 0.40 ± 7% perf-profile.children.cycles-pp.xfs_inode_item_push
0.22 ± 12% +0.1 0.35 ± 9% perf-profile.children.cycles-pp.link_path_walk
0.47 ± 6% +0.1 0.60 ± 8% perf-profile.children.cycles-pp.xlog_cil_force_lsn
0.43 ± 3% +0.1 0.57 ± 14% perf-profile.children.cycles-pp.__filemap_fdatawait_range
0.36 ± 9% +0.1 0.50 ± 11% perf-profile.children.cycles-pp.brd_insert_page
0.31 ± 12% +0.1 0.45 ± 18% perf-profile.children.cycles-pp.xfs_mod_ifree
0.33 ± 14% +0.1 0.47 ± 3% perf-profile.children.cycles-pp.xfs_cil_prepare_item
0.32 ± 16% +0.1 0.46 ± 18% perf-profile.children.cycles-pp.__percpu_counter_compare
0.48 ± 8% +0.1 0.62 ± 9% perf-profile.children.cycles-pp.xfs_iget
0.95 +0.2 1.10 ± 5% perf-profile.children.cycles-pp.xfs_trans_committed_bulk
0.32 ± 15% +0.2 0.47 ± 16% perf-profile.children.cycles-pp.xfs_trans_unreserve_and_mod_sb
0.37 ± 4% +0.2 0.53 ± 14% perf-profile.children.cycles-pp.___slab_alloc
0.39 ± 8% +0.2 0.55 ± 8% perf-profile.children.cycles-pp.close
0.41 ± 2% +0.2 0.57 ± 5% perf-profile.children.cycles-pp.xfs_dir3_leaf_check_int
0.32 ± 2% +0.2 0.49 ± 14% perf-profile.children.cycles-pp.kmem_alloc_large
0.38 ± 3% +0.2 0.55 ± 14% perf-profile.children.cycles-pp.__slab_alloc
0.39 ± 15% +0.2 0.57 ± 5% perf-profile.children.cycles-pp.xfs_alloc_fixup_trees
0.37 ± 20% +0.2 0.55 ± 4% perf-profile.children.cycles-pp.xfs_end_bio
0.49 ± 11% +0.2 0.67 ± 8% perf-profile.children.cycles-pp.unwind_next_frame
0.47 ± 2% +0.2 0.66 ± 8% perf-profile.children.cycles-pp.xfs_check_agi_freecount
0.34 ± 11% +0.2 0.54 ± 11% perf-profile.children.cycles-pp._xfs_trans_bjoin
0.41 ± 5% +0.2 0.60 ± 5% perf-profile.children.cycles-pp.__kmalloc
0.45 ± 3% +0.2 0.65 ± 5% perf-profile.children.cycles-pp.xfsaild
1.15 ± 3% +0.2 1.35 ± 3% perf-profile.children.cycles-pp.xlog_cil_committed
0.58 ± 12% +0.2 0.78 ± 11% perf-profile.children.cycles-pp.iomap_write_actor
1.15 ± 3% +0.2 1.35 ± 3% perf-profile.children.cycles-pp.xlog_cil_process_committed
0.87 ± 5% +0.2 1.09 ± 5% perf-profile.children.cycles-pp.__wake_up_common_lock
1.10 ± 5% +0.2 1.32 ± 2% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
0.43 ± 5% +0.2 0.65 ± 4% perf-profile.children.cycles-pp.kmem_alloc
0.48 ± 6% +0.2 0.72 ± 12% perf-profile.children.cycles-pp.kmem_zone_alloc
0.55 ± 7% +0.2 0.79 ± 7% perf-profile.children.cycles-pp.autoremove_wake_function
1.57 ± 2% +0.2 1.81 ± 5% perf-profile.children.cycles-pp.__sched_text_start
0.72 ± 6% +0.2 0.96 ± 4% perf-profile.children.cycles-pp.xfs_dir2_node_lookup
0.69 ± 7% +0.2 0.94 ± 4% perf-profile.children.cycles-pp.xlog_write
0.57 ± 8% +0.3 0.83 ± 7% perf-profile.children.cycles-pp.wake_up_page_bit
0.57 ± 4% +0.3 0.83 ± 9% perf-profile.children.cycles-pp.xfs_da3_node_read
0.56 ± 2% +0.3 0.83 ± 12% perf-profile.children.cycles-pp.kmem_cache_alloc
0.63 ± 8% +0.3 0.90 ± 2% perf-profile.children.cycles-pp.xfs_dialloc_ag_update_inobt
0.62 ± 7% +0.3 0.90 ± 3% perf-profile.children.cycles-pp.xfs_buf_item_format
0.77 ± 8% +0.3 1.06 ± 2% perf-profile.children.cycles-pp.memcpy_erms
0.83 ± 17% +0.3 1.12 ± 4% perf-profile.children.cycles-pp.__queue_work
0.66 ± 5% +0.3 0.96 ± 5% perf-profile.children.cycles-pp.xfs_destroy_ioend
0.89 ± 4% +0.3 1.19 ± 5% perf-profile.children.cycles-pp.xfs_dir_lookup
0.89 ± 5% +0.3 1.20 ± 6% perf-profile.children.cycles-pp.xfs_lookup
0.96 ± 6% +0.3 1.27 ± 5% perf-profile.children.cycles-pp.xfs_vn_lookup
0.84 ± 17% +0.3 1.16 ± 4% perf-profile.children.cycles-pp.queue_work_on
0.78 ± 13% +0.3 1.10 ± 11% perf-profile.children.cycles-pp.iomap_apply
0.97 ± 2% +0.3 1.30 ± 7% perf-profile.children.cycles-pp.__lookup_hash
0.78 ± 13% +0.3 1.11 ± 11% perf-profile.children.cycles-pp.iomap_file_buffered_write
0.56 ± 6% +0.3 0.90 ± 5% perf-profile.children.cycles-pp.xfs_btree_read_buf_block
0.83 ± 6% +0.3 1.17 ± 6% perf-profile.children.cycles-pp.xfs_da_read_buf
0.90 ± 11% +0.3 1.24 ± 9% perf-profile.children.cycles-pp.new_sync_write
0.84 ± 12% +0.3 1.19 ± 10% perf-profile.children.cycles-pp.xfs_file_buffered_aio_write
0.81 ± 11% +0.4 1.16 ± 5% perf-profile.children.cycles-pp.arch_stack_walk
0.95 ± 12% +0.4 1.30 ± 8% perf-profile.children.cycles-pp.vfs_write
0.86 ± 10% +0.4 1.22 ± 5% perf-profile.children.cycles-pp.stack_trace_save_tsk
0.69 ± 6% +0.4 1.05 ± 6% perf-profile.children.cycles-pp.xfs_btree_lookup_get_block
0.96 ± 12% +0.4 1.33 ± 8% perf-profile.children.cycles-pp.ksys_write
0.70 ± 12% +0.4 1.08 ± 10% perf-profile.children.cycles-pp.xfs_alloc_ag_vextent_near
0.93 ± 12% +0.4 1.32 ± 8% perf-profile.children.cycles-pp.xfs_submit_ioend
1.81 ± 4% +0.4 2.21 perf-profile.children.cycles-pp.xlog_state_do_callback
1.01 ± 10% +0.4 1.41 ± 4% perf-profile.children.cycles-pp.__account_scheduler_latency
1.11 ± 10% +0.4 1.51 ± 8% perf-profile.children.cycles-pp.write
1.54 ± 4% +0.4 1.94 ± 3% perf-profile.children.cycles-pp._raw_spin_lock
1.84 ± 4% +0.4 2.24 perf-profile.children.cycles-pp.xlog_ioend_work
0.86 ± 7% +0.4 1.27 ± 5% perf-profile.children.cycles-pp.xfs_end_io
0.84 ± 6% +0.4 1.25 ± 5% perf-profile.children.cycles-pp.xfs_end_ioend
0.74 ± 11% +0.4 1.16 ± 8% perf-profile.children.cycles-pp.xfs_alloc_ag_vextent
1.19 ± 2% +0.4 1.61 ± 7% perf-profile.children.cycles-pp.filename_create
1.16 ± 7% +0.4 1.58 ± 7% perf-profile.children.cycles-pp.__wake_up_common
0.73 ± 6% +0.4 1.16 ± 4% perf-profile.children.cycles-pp.xfs_buf_find
1.33 ± 3% +0.4 1.76 ± 6% perf-profile.children.cycles-pp.xlog_cil_push
0.87 ± 7% +0.5 1.32 perf-profile.children.cycles-pp.xfs_buf_read_map
0.81 ± 7% +0.5 1.27 ± 2% perf-profile.children.cycles-pp.xfs_buf_get_map
1.09 ± 3% +0.5 1.55 ± 6% perf-profile.children.cycles-pp.xfs_da3_node_lookup_int
1.38 ± 10% +0.5 1.85 ± 4% perf-profile.children.cycles-pp.enqueue_entity
1.45 ± 11% +0.5 1.95 ± 4% perf-profile.children.cycles-pp.ttwu_do_activate
1.44 ± 11% +0.5 1.95 ± 3% perf-profile.children.cycles-pp.enqueue_task_fair
1.44 ± 11% +0.5 1.95 ± 4% perf-profile.children.cycles-pp.activate_task
1.04 ± 12% +0.5 1.58 ± 5% perf-profile.children.cycles-pp.xfs_bmap_btalloc
1.00 ± 11% +0.5 1.54 ± 6% perf-profile.children.cycles-pp.xfs_alloc_vextent
1.13 ± 4% +0.6 1.68 ± 2% perf-profile.children.cycles-pp.xfs_btree_lookup
1.19 ± 13% +0.6 1.81 ± 4% perf-profile.children.cycles-pp.xfs_bmapi_allocate
1.52 ± 3% +0.6 2.17 ± 5% perf-profile.children.cycles-pp.xfs_dialloc_ag
1.94 ± 10% +0.7 2.63 ± 3% perf-profile.children.cycles-pp.try_to_wake_up
1.31 ± 6% +0.7 2.02 ± 3% perf-profile.children.cycles-pp.xfs_trans_read_buf_map
1.78 ± 8% +0.7 2.51 ± 3% perf-profile.children.cycles-pp.xfs_map_blocks
1.75 ± 8% +0.7 2.48 ± 3% perf-profile.children.cycles-pp.xfs_bmapi_convert_delalloc
1.96 ± 8% +0.8 2.72 ± 3% perf-profile.children.cycles-pp.xfs_do_writepage
2.14 ± 8% +0.8 2.94 ± 3% perf-profile.children.cycles-pp.write_cache_pages
1.93 ± 4% +0.9 2.79 ± 4% perf-profile.children.cycles-pp.xfs_dialloc
2.65 ± 3% +1.1 3.74 ± 4% perf-profile.children.cycles-pp.xfs_dir_ialloc
2.59 ± 2% +1.1 3.68 ± 5% perf-profile.children.cycles-pp.xfs_ialloc
2.89 ± 2% +1.2 4.04 ± 7% perf-profile.children.cycles-pp.path_openat
2.90 ± 2% +1.2 4.05 ± 7% perf-profile.children.cycles-pp.do_filp_open
2.98 +1.2 4.17 ± 7% perf-profile.children.cycles-pp.do_sys_open
3.09 ± 9% +1.2 4.28 ± 4% perf-profile.children.cycles-pp.xfs_vm_writepages
3.09 ± 9% +1.2 4.29 ± 4% perf-profile.children.cycles-pp.do_writepages
3.11 ± 9% +1.2 4.32 ± 4% perf-profile.children.cycles-pp.__filemap_fdatawrite_range
3.12 ± 2% +1.2 4.35 ± 6% perf-profile.children.cycles-pp.open64
4.34 ± 3% +1.3 5.61 ± 2% perf-profile.children.cycles-pp.process_one_work
4.79 ± 3% +1.4 6.15 ± 2% perf-profile.children.cycles-pp.worker_thread
3.04 ± 2% +1.4 4.40 ± 3% perf-profile.children.cycles-pp.xfs_log_commit_cil
3.61 ± 8% +1.4 4.98 ± 4% perf-profile.children.cycles-pp.file_write_and_wait_range
3.08 ± 2% +1.4 4.51 ± 4% perf-profile.children.cycles-pp.__xfs_trans_commit
5.38 ± 3% +1.5 6.89 ± 2% perf-profile.children.cycles-pp.ret_from_fork
5.37 ± 3% +1.5 6.89 ± 2% perf-profile.children.cycles-pp.kthread
6.52 ± 6% +1.6 8.08 ± 4% perf-profile.children.cycles-pp.xfs_file_fsync
6.53 ± 6% +1.6 8.10 ± 4% perf-profile.children.cycles-pp.do_fsync
6.54 ± 6% +1.6 8.11 ± 4% perf-profile.children.cycles-pp.__x64_sys_fsync
7.03 ± 5% +1.7 8.75 ± 4% perf-profile.children.cycles-pp.fsync
2.31 ± 3% -1.9 0.43 ± 8% perf-profile.self.cycles-pp.__x86_indirect_thunk_rax
1.39 ± 3% -1.0 0.35 ± 5% perf-profile.self.cycles-pp.xfs_dir2_node_addname
0.06 ± 7% +0.0 0.08 ± 8% perf-profile.self.cycles-pp.xlog_verify_iclog
0.08 ± 6% +0.0 0.10 ± 8% perf-profile.self.cycles-pp.__module_address
0.04 ± 57% +0.0 0.07 ± 17% perf-profile.self.cycles-pp.xfs_iext_last
0.09 ± 17% +0.0 0.13 ± 12% perf-profile.self.cycles-pp._xfs_buf_obj_cmp
0.05 ± 62% +0.0 0.09 ± 19% perf-profile.self.cycles-pp.xlog_verify_dest_ptr
0.04 ± 58% +0.0 0.08 ± 8% perf-profile.self.cycles-pp.xfs_trans_del_item
0.11 ± 11% +0.0 0.15 ± 8% perf-profile.self.cycles-pp.xfs_perag_put
0.08 ± 19% +0.0 0.12 ± 15% perf-profile.self.cycles-pp.kmem_cache_free
0.09 ± 13% +0.0 0.13 ± 12% perf-profile.self.cycles-pp.__might_sleep
0.11 ± 6% +0.0 0.15 ± 12% perf-profile.self.cycles-pp.kfree
0.12 ± 7% +0.0 0.16 ± 8% perf-profile.self.cycles-pp.xfs_buf_offset
0.18 ± 13% +0.0 0.23 ± 4% perf-profile.self.cycles-pp.__percpu_counter_sum
0.13 ± 17% +0.0 0.17 ± 4% perf-profile.self.cycles-pp.__slab_free
0.11 ± 6% +0.0 0.15 ± 9% perf-profile.self.cycles-pp.new_slab
0.07 ± 12% +0.0 0.11 ± 7% perf-profile.self.cycles-pp.xfs_inobt_key_diff
0.01 ±173% +0.0 0.06 ± 7% perf-profile.self.cycles-pp.xfs_btree_ptr_to_daddr
0.05 ± 62% +0.0 0.09 ± 24% perf-profile.self.cycles-pp.xfs_trans_buf_item_match
0.15 ± 16% +0.0 0.20 ± 14% perf-profile.self.cycles-pp.vfprintf
0.11 ± 9% +0.0 0.16 ± 15% perf-profile.self.cycles-pp.down_read
0.09 ± 16% +0.0 0.14 ± 23% perf-profile.self.cycles-pp.stack_trace_consume_entry_nosched
0.01 ±173% +0.0 0.06 ± 11% perf-profile.self.cycles-pp.xfs_buf_item_log
0.10 ± 15% +0.0 0.14 ± 5% perf-profile.self.cycles-pp.xfs_inode_item_format
0.08 ± 15% +0.1 0.13 ± 3% perf-profile.self.cycles-pp.xfs_buf_item_init
0.01 ±173% +0.1 0.07 ± 13% perf-profile.self.cycles-pp.xfs_inode_item_pin
0.12 ± 7% +0.1 0.17 ± 10% perf-profile.self.cycles-pp.xfs_iext_lookup_extent
0.08 ± 19% +0.1 0.13 ± 16% perf-profile.self.cycles-pp.__xfs_btree_check_sblock
0.00 +0.1 0.05 ± 9% perf-profile.self.cycles-pp.check_preempt_wakeup
0.01 ±173% +0.1 0.07 ± 16% perf-profile.self.cycles-pp.xfs_buf_item_size
0.00 +0.1 0.06 ± 15% perf-profile.self.cycles-pp.xlog_grant_add_space
0.17 ± 4% +0.1 0.22 ± 9% perf-profile.self.cycles-pp.xlog_write
0.15 ± 7% +0.1 0.21 ± 8% perf-profile.self.cycles-pp.__kmalloc
0.10 ± 23% +0.1 0.16 ± 12% perf-profile.self.cycles-pp.xfs_trans_log_inode
0.15 ± 13% +0.1 0.21 ± 8% perf-profile.self.cycles-pp.entry_SYSCALL_64
0.18 ± 8% +0.1 0.25 ± 10% perf-profile.self.cycles-pp.xfs_btree_lookup
0.18 ± 11% +0.1 0.25 ± 5% perf-profile.self.cycles-pp.xfs_next_bit
0.20 ± 8% +0.1 0.26 ± 11% perf-profile.self.cycles-pp.__radix_tree_lookup
0.30 ± 9% +0.1 0.37 ± 11% perf-profile.self.cycles-pp.__sched_text_start
0.17 ± 9% +0.1 0.24 ± 3% perf-profile.self.cycles-pp.xfs_trans_dirty_buf
0.07 ± 63% +0.1 0.14 ± 13% perf-profile.self.cycles-pp.selinux_inode_permission
0.17 ± 11% +0.1 0.24 ± 13% perf-profile.self.cycles-pp.__orc_find
0.13 ± 14% +0.1 0.21 ± 17% perf-profile.self.cycles-pp.___might_sleep
0.14 ± 9% +0.1 0.22 ± 17% perf-profile.self.cycles-pp.memset_erms
0.12 ± 21% +0.1 0.20 ± 10% perf-profile.self.cycles-pp.xfs_buf_item_size_segment
0.19 ± 21% +0.1 0.27 ± 8% perf-profile.self.cycles-pp.xfs_buf_item_format
0.15 ± 14% +0.1 0.24 ± 12% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
0.25 ± 14% +0.1 0.34 ± 3% perf-profile.self.cycles-pp.xfs_buf_item_pin
0.18 ± 15% +0.1 0.28 ± 10% perf-profile.self.cycles-pp.unwind_next_frame
0.15 ± 7% +0.1 0.24 ± 6% perf-profile.self.cycles-pp.xfs_log_commit_cil
0.12 ± 7% +0.1 0.21 ± 14% perf-profile.self.cycles-pp.xfs_perag_get
0.27 ± 11% +0.1 0.38 ± 5% perf-profile.self.cycles-pp.do_syscall_64
0.22 ± 9% +0.1 0.34 ± 14% perf-profile.self.cycles-pp.__list_del_entry_valid
0.38 ± 3% +0.2 0.54 ± 4% perf-profile.self.cycles-pp.xfs_dir3_leaf_check_int
0.30 ± 12% +0.2 0.48 ± 2% perf-profile.self.cycles-pp.xfs_buf_find
0.94 ± 3% +0.2 1.14 perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.76 ± 8% +0.3 1.04 ± 3% perf-profile.self.cycles-pp.memcpy_erms
1.51 ± 4% +0.4 1.90 ± 4% perf-profile.self.cycles-pp._raw_spin_lock
fsmark.time.system_time
160 +-+-------------------------------------------------------------------+
| +..+.+.+ + + + + +.+.+. .+.+.+.+.. .+.+.+.+..+.+.|
140 +-+ : : : : : : : +..+ +.+ |
120 +-+ : : : : : : : |
| : : :: : : :: : |
100 +-+: : : : : : : : : : : |
| : : : : : : : : : : : |
80 +-+: : : : : : : : : : : |
O O: O O: :O : :O: :O: :O : :O O O O O O O O O O O O |
60 +-+: : : : : : : : : : : |
40 +-+: : : : : : : : : : : |
| : : :: : : :: |
20 +-+ : : : : : |
| : : : : : : |
0 +-+-O----O---O----O---O---O----O--------------------------------------+
fsmark.time.percent_of_cpu_this_job_got
100 +-+-------------------------------------------------------------------+
90 +-+ +..+.+.+ + + + + +.+.+.+..+.+.+.+.+..+.+.+.+.+.+..+.+.|
| O : : O O O O : O O O O |
80 O-+ : O O : : : : O O O O O O O O |
70 +-+ : : :: : : :: : |
| : : : : : : : : : : : |
60 +-+: : : : : : : : : : : |
50 +-+: : : : : : : : : : : |
40 +-+: : : : : : : : : : : |
| : : : : : : : : : : : |
30 +-+: : : : : : : : : : : |
20 +-+ : :: : : :: |
| : : : : : : |
10 +-+ : : : : : |
0 +-+-O----O---O----O---O---O----O--------------------------------------+
fsmark.time.elapsed_time
180 +-+-------------------------------------------------------------------+
| +..+.+.+ + + + + +.+.+. .+.+.+.+.. .+.+.+.+..+.+.|
160 +-+ : : : : : : : +..+ +.+ |
140 +-+ : : : : : : : |
| : : :: : : :: : |
120 +-+: : : : : : : : : : : |
100 +-+: : : : : : : : : : : |
O O: O O: :O: :O: :O: :O: :O O O O O O O O O O O O |
80 +-+: : : : : : : : : : : |
60 +-+: : : : : : : : : : : |
| : : : : : : : : : : : |
40 +-+ : :: : : :: |
20 +-+ : : : : : |
| : : : : : : |
0 +-+-O----O---O----O---O---O----O--------------------------------------+
fsmark.time.elapsed_time.max
180 +-+-------------------------------------------------------------------+
| +..+.+.+ + + + + +.+.+. .+.+.+.+.. .+.+.+.+..+.+.|
160 +-+ : : : : : : : +..+ +.+ |
140 +-+ : : : : : : : |
| : : :: : : :: : |
120 +-+: : : : : : : : : : : |
100 +-+: : : : : : : : : : : |
O O: O O: :O: :O: :O: :O: :O O O O O O O O O O O O |
80 +-+: : : : : : : : : : : |
60 +-+: : : : : : : : : : : |
| : : : : : : : : : : : |
40 +-+ : :: : : :: |
20 +-+ : : : : : |
| : : : : : : |
0 +-+-O----O---O----O---O---O----O--------------------------------------+
fsmark.files_per_sec
14000 +-+-----------------------------------------------------------------+
| |
12000 O-O O O O O O O O O O O O O O O O O O O |
| |
10000 +-+ |
| |
8000 +-+ |
| |
6000 +-+ +.+..+.+ + + + + +.+.+.+.+..+.+.+.+.+.+.+.+..+.+.+.+.|
| : : : : :: : : |
4000 +-+: : : : : : : : : : : |
| : : : : : : : : : : : |
2000 +-+: : : : : : : : : : : |
| : : : : : : |
0 +-+-O----O---O---O---O----O---O-------------------------------------+
fsmark.app_overhead
1.2e+08 +-+---------------------------------------------------------------+
| +.+.+.+ + + + + +.+. .+.+.+. .+.+.+.+.+.+.|
1e+08 +-+ : : : : : : : +.+.+ +..+.+ |
| : : : : : : : |
| : : :: : : : : |
8e+07 +-+: : : : : : : : : : : |
| : : : : : : : : : : : |
6e+07 +-+: : : : : : : : : : : |
| : : : : : : : : : : : |
4e+07 +-+: : : : : : : : : : : |
O : O O: : : :O: :O: :O: : O O O O O O O |
| O : O :: : : : O O O O O |
2e+07 +-+ : : : : : |
| : : : : : : |
0 +-+-O---O---O----O---O---O---O------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
On Mon, Sep 09, 2019 at 02:06:54PM +0800, Rong Chen wrote:
> Hi Dave,
>
> On 9/9/19 1:32 PM, Dave Chinner wrote:
> > On Mon, Sep 09, 2019 at 09:58:49AM +0800, kernel test robot wrote:
> > > Greeting,
> > >
> > > FYI, we noticed a -71.2% improvement of fsmark.app_overhead due to commit:
> > A negative improvement? That's somewhat ambiguous...
>
> Sorry for causing the misunderstanding, it's a improvement not a regression.
>
>
> >
> > > 0e822255f95db400 610125ab1e4b1b48dcffe74d9d8
> > > ---------------- ---------------------------
> > > %stddev %change %stddev
> > > \ | \
> > > 1.095e+08 -71.2% 31557568 fsmark.app_overhead
> > > 6157 +95.5% 12034 fsmark.files_per_sec
> > So, the files/s rate doubled, and the amount of time spent in
> > userspace by the fsmark app dropped by 70%.
> >
> > > 167.31 -47.3% 88.25 fsmark.time.elapsed_time
> > > 167.31 -47.3% 88.25 fsmark.time.elapsed_time.max
> > Wall time went down by 50%.
> >
> > > 91.00 -8.8% 83.00 fsmark.time.percent_of_cpu_this_job_got
> > > 148.15 -53.2% 69.38 fsmark.time.system_time
> > As did system CPU.
> >
> > IOWs, this change has changed create performance by a factor of 4 -
> > the file create is 2x faster for half the CPU spent.
> >
> > I don't think this is a negative improvement - it's a large positive
> > improvement. I suspect that you need to change the metric
> > classifications for this workload...
> To avoid misunderstanding, we'll use fsmark.files_per_sec instead of
> fsmark.app_overhead in the subject.
Well, the two are separate ways of measuring improvement. A change
in one without a change in the other is just as significant as
a change in both...
Cheers,
Dave.
--
Dave Chinner
[email protected]
On Mon, Sep 09, 2019 at 09:58:49AM +0800, kernel test robot wrote:
> Greeting,
>
> FYI, we noticed a -71.2% improvement of fsmark.app_overhead due to commit:
A negative improvement? That's somewhat ambiguous...
> 0e822255f95db400 610125ab1e4b1b48dcffe74d9d8
> ---------------- ---------------------------
> %stddev %change %stddev
> \ | \
> 1.095e+08 -71.2% 31557568 fsmark.app_overhead
> 6157 +95.5% 12034 fsmark.files_per_sec
So, the files/s rate doubled, and the amount of time spent in
userspace by the fsmark app dropped by 70%.
> 167.31 -47.3% 88.25 fsmark.time.elapsed_time
> 167.31 -47.3% 88.25 fsmark.time.elapsed_time.max
Wall time went down by 50%.
> 91.00 -8.8% 83.00 fsmark.time.percent_of_cpu_this_job_got
> 148.15 -53.2% 69.38 fsmark.time.system_time
As did system CPU.
IOWs, this change has changed create performance by a factor of 4 -
the file create is 2x faster for half the CPU spent.
I don't think this is a negative improvement - it's a large positive
improvement. I suspect that you need to change the metric
classifications for this workload...
Cheers,
Dave.
--
Dave Chinner
[email protected]
Hi Dave,
On 9/9/19 1:32 PM, Dave Chinner wrote:
> On Mon, Sep 09, 2019 at 09:58:49AM +0800, kernel test robot wrote:
>> Greeting,
>>
>> FYI, we noticed a -71.2% improvement of fsmark.app_overhead due to commit:
> A negative improvement? That's somewhat ambiguous...
Sorry for causing the misunderstanding, it's a improvement not a regression.
>
>> 0e822255f95db400 610125ab1e4b1b48dcffe74d9d8
>> ---------------- ---------------------------
>> %stddev %change %stddev
>> \ | \
>> 1.095e+08 -71.2% 31557568 fsmark.app_overhead
>> 6157 +95.5% 12034 fsmark.files_per_sec
> So, the files/s rate doubled, and the amount of time spent in
> userspace by the fsmark app dropped by 70%.
>
>> 167.31 -47.3% 88.25 fsmark.time.elapsed_time
>> 167.31 -47.3% 88.25 fsmark.time.elapsed_time.max
> Wall time went down by 50%.
>
>> 91.00 -8.8% 83.00 fsmark.time.percent_of_cpu_this_job_got
>> 148.15 -53.2% 69.38 fsmark.time.system_time
> As did system CPU.
>
> IOWs, this change has changed create performance by a factor of 4 -
> the file create is 2x faster for half the CPU spent.
>
> I don't think this is a negative improvement - it's a large positive
> improvement. I suspect that you need to change the metric
> classifications for this workload...
To avoid misunderstanding, we'll use fsmark.files_per_sec instead of
fsmark.app_overhead in the subject.
Best Regards,
Rong Chen