Greeting,
FYI, we noticed a 101263.6% improvement of stress-ng.loop.ops_per_sec due to commit:
commit: 990e78116d38059c9306cf0560c1c4ed1cf358d3 ("block: loop: fix deadlock between open and remove")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
in testcase: stress-ng
on test machine: 96 threads 2 sockets Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 192G memory
with following parameters:
nr_threads: 10%
disk: 1HDD
testtime: 60s
fs: ext4
class: os
test: loop
cpufreq_governor: performance
ucode: 0x5003006
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run
bin/lkp run generated-yaml-file
=========================================================================================
class/compiler/cpufreq_governor/disk/fs/kconfig/nr_threads/rootfs/tbox_group/test/testcase/testtime/ucode:
os/gcc-9/performance/1HDD/ext4/x86_64-rhel-8.3/10%/debian-10.4-x86_64-20200603.cgz/lkp-csl-2sp5/loop/stress-ng/60s/0x5003006
commit:
41fe8d088e ("bcache: avoid oversized read request in cache missing code path")
990e78116d ("block: loop: fix deadlock between open and remove")
41fe8d088e96472f 990e78116d38059c9306cf0560c
---------------- ---------------------------
%stddev %change %stddev
\ | \
10.50 ? 8% +15879.4% 1677 ? 2% stress-ng.loop.ops
0.03 ? 15% +1e+05% 27.88 ? 2% stress-ng.loop.ops_per_sec
421.64 ? 21% -85.2% 62.34 stress-ng.time.elapsed_time
421.64 ? 21% -85.2% 62.34 stress-ng.time.elapsed_time.max
29.25 ? 32% +14917.7% 4392 ? 2% stress-ng.time.involuntary_context_switches
0.23 ? 16% +10099.3% 23.71 ? 3% stress-ng.time.system_time
1292 ? 41% +4115.3% 54482 ? 10% stress-ng.time.voluntary_context_switches
3.839e+10 ? 19% -87.3% 4.862e+09 ? 31% cpuidle.C1E.time
67842972 ? 28% -83.9% 10938644 ? 17% cpuidle.C1E.usage
98.10 -1.3% 96.86 iostat.cpu.idle
1.86 ? 10% +18.2% 2.20 ? 4% iostat.cpu.system
472.47 ? 19% -76.0% 113.40 uptime.boot
44128 ? 19% -76.8% 10219 uptime.idle
0.03 ? 11% +0.8 0.78 ? 4% mpstat.cpu.all.iowait%
1.70 ? 10% -0.5 1.25 ? 6% mpstat.cpu.all.irq%
0.03 ? 7% +0.7 0.69 ? 3% mpstat.cpu.all.sys%
0.01 ? 8% +0.1 0.09 ? 13% mpstat.cpu.all.usr%
584857 ? 17% -62.2% 220863 ? 10% numa-numastat.node0.local_node
629771 ? 15% -56.8% 271964 ? 10% numa-numastat.node0.numa_hit
408608 ? 37% -53.4% 190442 ? 10% numa-numastat.node1.local_node
450459 ? 37% -49.4% 227935 ? 12% numa-numastat.node1.numa_hit
2.25 ? 57% +1.3e+05% 3013 ? 2% vmstat.io.bi
8528 ? 10% -26.3% 6289 ? 8% vmstat.io.bo
1593 ? 3% +318.1% 6662 vmstat.memory.buff
0.00 +1e+102% 1.00 vmstat.procs.r
1402 ? 2% +722.0% 11530 vmstat.system.cs
9194 ? 2% +13.2% 10405 ? 4% numa-vmstat.node0.nr_kernel_stack
204.00 ? 51% -98.6% 2.83 ?137% numa-vmstat.node0.nr_mlock
2139 ? 15% -78.7% 455.33 ? 17% numa-vmstat.node1.nr_active_anon
3050 ? 31% +267.0% 11194 ? 88% numa-vmstat.node1.nr_anon_pages
3674 ? 37% +226.9% 12012 ? 88% numa-vmstat.node1.nr_inactive_anon
7211 +15.2% 8307 ? 6% numa-vmstat.node1.nr_kernel_stack
185.25 ? 54% -99.0% 1.83 ?115% numa-vmstat.node1.nr_mlock
2139 ? 15% -78.7% 455.33 ? 17% numa-vmstat.node1.nr_zone_active_anon
3674 ? 37% +226.9% 12012 ? 88% numa-vmstat.node1.nr_zone_inactive_anon
184219 ? 2% -59.7% 74250 ? 32% numa-meminfo.node0.AnonHugePages
9192 ? 2% +13.0% 10390 ? 4% numa-meminfo.node0.KernelStack
818.00 ? 51% -98.6% 11.17 ? 82% numa-meminfo.node0.Mlocked
9091 ? 19% -55.0% 4094 ? 53% numa-meminfo.node1.Active
8562 ? 15% -78.7% 1821 ? 17% numa-meminfo.node1.Active(anon)
1535 ? 84% +1211.0% 20133 ?129% numa-meminfo.node1.AnonHugePages
12188 ? 31% +266.8% 44712 ? 88% numa-meminfo.node1.AnonPages
15019 ? 37% +222.3% 48406 ? 88% numa-meminfo.node1.Inactive
14670 ? 37% +227.1% 47983 ? 88% numa-meminfo.node1.Inactive(anon)
7209 +15.1% 8299 ? 6% numa-meminfo.node1.KernelStack
741.75 ? 54% -98.8% 9.00 ? 66% numa-meminfo.node1.Mlocked
12763 ? 9% -13.8% 11005 meminfo.Active
10830 ? 11% -69.4% 3315 ? 2% meminfo.Active(anon)
1933 ? 2% +297.7% 7689 meminfo.Active(file)
185774 -49.2% 94341 ? 3% meminfo.AnonHugePages
1592 ? 3% +312.3% 6567 ? 2% meminfo.Buffers
110028 +10.2% 121276 meminfo.KReclaimable
16410 ? 2% +13.8% 18682 meminfo.KernelStack
3773538 +12.2% 4234609 meminfo.Memused
1559 ? 50% -98.7% 20.83 ? 69% meminfo.Mlocked
4595 ? 2% +13.6% 5221 meminfo.PageTables
110028 +10.2% 121276 meminfo.SReclaimable
22698 ? 5% -34.0% 14985 meminfo.Shmem
2705 ? 11% -69.4% 828.50 ? 2% proc-vmstat.nr_active_anon
483.00 ? 2% +299.4% 1929 ? 2% proc-vmstat.nr_active_file
63107 +7.5% 67854 proc-vmstat.nr_anon_pages
65904 +7.4% 70753 proc-vmstat.nr_inactive_anon
16406 ? 2% +13.9% 18694 proc-vmstat.nr_kernel_stack
9187 +2.9% 9456 proc-vmstat.nr_mapped
389.25 ? 50% -98.8% 4.50 ? 80% proc-vmstat.nr_mlock
1148 ? 3% +13.6% 1304 proc-vmstat.nr_page_table_pages
5673 ? 5% -34.0% 3746 proc-vmstat.nr_shmem
27506 +10.2% 30316 proc-vmstat.nr_slab_reclaimable
45236 ? 2% +8.2% 48940 ? 2% proc-vmstat.nr_slab_unreclaimable
102.50 ? 22% -41.5% 60.00 proc-vmstat.nr_written
2705 ? 11% -69.4% 828.50 ? 2% proc-vmstat.nr_zone_active_anon
483.00 ? 2% +299.4% 1929 ? 2% proc-vmstat.nr_zone_active_file
65904 +7.4% 70753 proc-vmstat.nr_zone_inactive_anon
64.25 ? 31% +1223.0% 850.00 ? 19% proc-vmstat.numa_hint_faults
1114352 ? 16% -52.2% 532291 proc-vmstat.numa_hit
1027570 ? 18% -56.8% 443690 proc-vmstat.numa_local
86782 +2.1% 88601 proc-vmstat.numa_other
17073 ? 52% -88.7% 1934 ? 75% proc-vmstat.numa_pte_updates
3161 ? 10% +619.3% 22741 proc-vmstat.pgactivate
1172556 ? 16% -43.2% 666390 proc-vmstat.pgalloc_normal
1236265 ? 20% -81.9% 223851 proc-vmstat.pgfault
1158989 ? 16% -54.6% 526117 ? 2% proc-vmstat.pgfree
886.00 ? 32% +22052.9% 196274 ? 2% proc-vmstat.pgpgin
3526825 ? 10% -88.6% 403253 ? 8% proc-vmstat.pgpgout
81389 ? 21% -82.8% 13960 ? 2% proc-vmstat.pgreuse
1.673e+08 ? 4% +149.2% 4.17e+08 perf-stat.i.branch-instructions
2447828 ? 17% +144.3% 5980343 ? 37% perf-stat.i.branch-misses
382962 ? 4% +481.2% 2225660 ? 16% perf-stat.i.cache-misses
4720794 ? 29% +323.9% 20013784 ? 55% perf-stat.i.cache-references
1367 +751.4% 11644 ? 2% perf-stat.i.context-switches
2.753e+09 ? 8% +103.5% 5.601e+09 ? 9% perf-stat.i.cpu-cycles
98.31 +74.2% 171.23 perf-stat.i.cpu-migrations
7687 ? 9% -65.6% 2640 ? 8% perf-stat.i.cycles-between-cache-misses
2.237e+08 +129.2% 5.128e+08 perf-stat.i.dTLB-loads
0.01 ? 55% +0.0 0.02 ? 59% perf-stat.i.dTLB-store-miss-rate%
10902 ? 52% +497.5% 65141 ? 60% perf-stat.i.dTLB-store-misses
1.193e+08 +118.9% 2.611e+08 perf-stat.i.dTLB-stores
28.66 ? 3% +11.2 39.84 ? 4% perf-stat.i.iTLB-load-miss-rate%
566718 ? 2% +86.8% 1058849 perf-stat.i.iTLB-load-misses
8.183e+08 ? 4% +144.3% 1.999e+09 perf-stat.i.instructions
1438 ? 3% +33.0% 1913 perf-stat.i.instructions-per-iTLB-miss
2.34 ? 20% +385.3% 11.36 perf-stat.i.major-faults
0.03 ? 8% +103.4% 0.06 ? 9% perf-stat.i.metric.GHz
63.99 ? 21% +266.7% 234.64 ? 49% perf-stat.i.metric.K/sec
5.32 ? 2% +133.3% 12.40 perf-stat.i.metric.M/sec
2828 +11.9% 3164 perf-stat.i.minor-faults
91.33 -7.3 84.00 perf-stat.i.node-load-miss-rate%
71303 ? 5% +598.0% 497678 ? 5% perf-stat.i.node-load-misses
8437 ? 9% +1022.0% 94668 ? 4% perf-stat.i.node-loads
30965 ? 10% +945.7% 323793 ? 9% perf-stat.i.node-store-misses
5133 ? 52% +1590.4% 86774 ? 15% perf-stat.i.node-stores
2831 +13.5% 3214 perf-stat.i.page-faults
7198 ? 8% -64.7% 2543 ? 6% perf-stat.overall.cycles-between-cache-misses
0.01 ? 53% +0.0 0.02 ? 58% perf-stat.overall.dTLB-store-miss-rate%
28.67 ? 3% +11.2 39.91 ? 4% perf-stat.overall.iTLB-load-miss-rate%
1443 ? 3% +30.8% 1887 perf-stat.overall.instructions-per-iTLB-miss
89.43 -5.4 83.98 perf-stat.overall.node-load-miss-rate%
1.669e+08 ? 4% +145.8% 4.102e+08 perf-stat.ps.branch-instructions
2441733 ? 17% +140.9% 5883223 ? 37% perf-stat.ps.branch-misses
382016 ? 5% +473.2% 2189781 ? 16% perf-stat.ps.cache-misses
4709674 ? 29% +318.1% 19691192 ? 55% perf-stat.ps.cache-references
1364 +739.9% 11458 ? 2% perf-stat.ps.context-switches
95763 -1.3% 94480 perf-stat.ps.cpu-clock
2.746e+09 ? 8% +100.7% 5.511e+09 ? 9% perf-stat.ps.cpu-cycles
98.06 +71.9% 168.55 perf-stat.ps.cpu-migrations
2.232e+08 +126.0% 5.045e+08 perf-stat.ps.dTLB-loads
10877 ? 52% +489.1% 64076 ? 60% perf-stat.ps.dTLB-store-misses
1.19e+08 +115.9% 2.569e+08 perf-stat.ps.dTLB-stores
565306 ? 2% +84.3% 1041890 perf-stat.ps.iTLB-load-misses
8.162e+08 ? 4% +141.0% 1.967e+09 perf-stat.ps.instructions
2.34 ? 20% +377.0% 11.14 perf-stat.ps.major-faults
2821 +10.3% 3112 perf-stat.ps.minor-faults
71124 ? 5% +588.5% 489696 ? 5% perf-stat.ps.node-load-misses
8415 ? 9% +1006.9% 93154 ? 4% perf-stat.ps.node-loads
30885 ? 10% +931.6% 318608 ? 9% perf-stat.ps.node-store-misses
5119 ? 52% +1567.1% 85354 ? 15% perf-stat.ps.node-stores
2824 +11.9% 3161 perf-stat.ps.page-faults
95763 -1.3% 94480 perf-stat.ps.task-clock
3.424e+11 ? 18% -63.8% 1.241e+11 perf-stat.total.instructions
1528 ? 7% +155.0% 3898 ? 7% slabinfo.Acpi-Parse.active_objs
1528 ? 7% +155.0% 3898 ? 7% slabinfo.Acpi-Parse.num_objs
218.50 ? 16% +609.7% 1550 ? 3% slabinfo.bdev_cache.active_objs
218.50 ? 16% +609.7% 1550 ? 3% slabinfo.bdev_cache.num_objs
1413 +105.4% 2903 ? 6% slabinfo.buffer_head.active_objs
1414 +105.7% 2908 ? 6% slabinfo.buffer_head.num_objs
3065 ? 5% +31.3% 4024 ? 6% slabinfo.dmaengine-unmap-16.active_objs
3065 ? 5% +31.4% 4028 ? 6% slabinfo.dmaengine-unmap-16.num_objs
186.50 ? 32% +1190.9% 2407 ? 4% slabinfo.dquot.active_objs
186.50 ? 32% +1190.9% 2407 ? 4% slabinfo.dquot.num_objs
1541 ? 14% +246.0% 5332 ? 17% slabinfo.ext4_extent_status.active_objs
1541 ? 14% +246.0% 5332 ? 17% slabinfo.ext4_extent_status.num_objs
148.00 ? 98% -99.1% 1.33 ? 70% slabinfo.ext4_pending_reservation.active_objs
148.00 ? 98% -99.1% 1.33 ? 70% slabinfo.ext4_pending_reservation.num_objs
1178 ? 13% +117.0% 2556 ? 4% slabinfo.file_lock_cache.active_objs
1178 ? 13% +117.0% 2556 ? 4% slabinfo.file_lock_cache.num_objs
3349 ? 4% +127.4% 7617 ? 7% slabinfo.fsnotify_mark_connector.active_objs
3349 ? 4% +127.4% 7617 ? 7% slabinfo.fsnotify_mark_connector.num_objs
87142 +15.9% 101023 ? 2% slabinfo.inode_cache.active_objs
1618 +16.0% 1877 ? 2% slabinfo.inode_cache.active_slabs
87437 +16.0% 101412 ? 2% slabinfo.inode_cache.num_objs
1618 +16.0% 1877 ? 2% slabinfo.inode_cache.num_slabs
85667 +17.4% 100538 slabinfo.kernfs_node_cache.active_objs
2676 +18.1% 3161 ? 2% slabinfo.kernfs_node_cache.active_slabs
85667 +18.1% 101166 ? 2% slabinfo.kernfs_node_cache.num_objs
2676 +18.1% 3161 ? 2% slabinfo.kernfs_node_cache.num_slabs
35512 +26.3% 44836 ? 2% slabinfo.kmalloc-16.num_objs
5607 +24.3% 6968 ? 2% slabinfo.kmalloc-192.num_objs
5688 ? 3% +10.8% 6305 slabinfo.kmalloc-1k.active_objs
5823 ? 3% +26.7% 7380 ? 2% slabinfo.kmalloc-1k.num_objs
9169 ? 4% +18.0% 10817 ? 2% slabinfo.kmalloc-256.active_objs
9201 ? 4% +18.9% 10936 ? 2% slabinfo.kmalloc-256.num_objs
1963 +13.3% 2223 slabinfo.kmalloc-4k.num_objs
55212 +18.9% 65659 ? 5% slabinfo.kmalloc-8.active_objs
56063 +18.0% 66164 ? 4% slabinfo.kmalloc-8.num_objs
7350 ? 3% -17.8% 6039 ? 2% slabinfo.kmalloc-96.active_objs
449.00 ? 20% +624.6% 3253 ? 4% slabinfo.kmalloc-rcl-192.active_objs
449.00 ? 20% +624.6% 3253 ? 3% slabinfo.kmalloc-rcl-192.num_objs
5599 +18.6% 6643 ? 3% slabinfo.kmalloc-rcl-512.active_objs
5600 +18.9% 6659 ? 3% slabinfo.kmalloc-rcl-512.num_objs
7882 ? 2% +15.9% 9136 ? 3% slabinfo.kmalloc-rcl-64.active_objs
7882 ? 2% +15.9% 9136 ? 3% slabinfo.kmalloc-rcl-64.num_objs
2708 ? 4% +12.2% 3039 ? 4% slabinfo.kmalloc-rcl-96.active_objs
2708 ? 4% +12.2% 3039 ? 4% slabinfo.kmalloc-rcl-96.num_objs
1349 ? 11% +352.6% 6108 ? 2% slabinfo.mbcache.active_objs
1349 ? 11% +352.6% 6108 ? 2% slabinfo.mbcache.num_objs
1376 ? 14% +30.6% 1797 ? 11% slabinfo.pool_workqueue.active_objs
1381 ? 13% +30.2% 1797 ? 11% slabinfo.pool_workqueue.num_objs
15006 -10.6% 13408 slabinfo.proc_inode_cache.active_objs
15032 -10.8% 13408 slabinfo.proc_inode_cache.num_objs
102.75 ? 17% +1101.5% 1234 ? 3% slabinfo.request_queue.active_objs
102.75 ? 17% +1101.5% 1234 ? 3% slabinfo.request_queue.num_objs
336.00 ? 4% +68.3% 565.50 ? 10% slabinfo.skbuff_fclone_cache.active_objs
336.00 ? 4% +68.3% 565.50 ? 10% slabinfo.skbuff_fclone_cache.num_objs
1253 ? 2% +10.2% 1381 slabinfo.task_struct.active_objs
3612 ? 4% +36.0% 4913 ? 5% slabinfo.trace_event_file.active_objs
3612 ? 4% +36.0% 4913 ? 5% slabinfo.trace_event_file.num_objs
17657 ? 2% -29.1% 12513 ? 2% slabinfo.vmap_area.active_objs
17774 -29.4% 12549 ? 2% slabinfo.vmap_area.num_objs
0.01 -100.0% 0.00 perf-sched.sch_delay.avg.ms.__x64_sys_pause.do_syscall_64.entry_SYSCALL_64_after_hwframe.[unknown]
0.01 ? 24% -100.0% 0.00 perf-sched.sch_delay.avg.ms.cleaner_kthread.kthread.ret_from_fork
0.01 ? 4% -91.5% 0.00 ?223% perf-sched.sch_delay.avg.ms.do_nanosleep.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64
0.01 ? 7% -68.1% 0.00 ? 37% perf-sched.sch_delay.avg.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
0.01 ? 8% -100.0% 0.00 perf-sched.sch_delay.avg.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
0.01 ? 12% -50.3% 0.01 ? 32% perf-sched.sch_delay.avg.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 ? 9% -100.0% 0.00 perf-sched.sch_delay.avg.ms.io_schedule.bit_wait_io.__wait_on_bit.out_of_line_wait_on_bit
0.01 -100.0% 0.00 perf-sched.sch_delay.avg.ms.kjournald2.kthread.ret_from_fork
0.00 +116.7% 0.00 ? 21% perf-sched.sch_delay.avg.ms.pipe_read.new_sync_read.vfs_read.ksys_read
0.01 ? 4% -100.0% 0.00 perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.jbd2_journal_commit_transaction.kjournald2.kthread
0.01 ? 5% -100.0% 0.00 perf-sched.sch_delay.avg.ms.rcu_gp_kthread.kthread.ret_from_fork
0.01 ? 8% -100.0% 0.00 perf-sched.sch_delay.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
0.01 ? 11% -100.0% 0.00 perf-sched.sch_delay.avg.ms.schedule_timeout.ext4_lazyinit_thread.part.0.kthread
0.01 ? 4% -90.2% 0.00 ?223% perf-sched.sch_delay.avg.ms.schedule_timeout.kcompactd.kthread.ret_from_fork
0.01 ? 36% -60.6% 0.00 ? 17% perf-sched.sch_delay.avg.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
0.01 ? 39% -100.0% 0.00 perf-sched.sch_delay.avg.ms.schedule_timeout.transaction_kthread.kthread.ret_from_fork
0.01 ? 20% -100.0% 0.00 perf-sched.sch_delay.avg.ms.schedule_timeout.wait_for_completion.__flush_work.lru_add_drain_all
0.01 -14.3% 0.01 perf-sched.sch_delay.avg.ms.smpboot_thread_fn.kthread.ret_from_fork
0.00 -100.0% 0.00 perf-sched.sch_delay.avg.ms.wait_for_partner.fifo_open.do_dentry_open.do_open.isra
0.01 ? 5% +4162.5% 0.51 ? 29% perf-sched.sch_delay.avg.ms.worker_thread.kthread.ret_from_fork
0.02 ? 24% -100.0% 0.00 perf-sched.sch_delay.max.ms.__x64_sys_pause.do_syscall_64.entry_SYSCALL_64_after_hwframe.[unknown]
0.01 ? 24% -100.0% 0.00 perf-sched.sch_delay.max.ms.cleaner_kthread.kthread.ret_from_fork
0.01 ? 24% -93.5% 0.00 ?223% perf-sched.sch_delay.max.ms.do_nanosleep.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64
0.03 ? 3% -76.7% 0.01 ? 25% perf-sched.sch_delay.max.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
0.01 ? 18% -100.0% 0.00 perf-sched.sch_delay.max.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
0.01 ? 5% -48.8% 0.01 ? 9% perf-sched.sch_delay.max.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.01 ? 10% -100.0% 0.00 perf-sched.sch_delay.max.ms.io_schedule.bit_wait_io.__wait_on_bit.out_of_line_wait_on_bit
0.01 -100.0% 0.00 perf-sched.sch_delay.max.ms.kjournald2.kthread.ret_from_fork
0.05 ? 35% +711.8% 0.38 ?178% perf-sched.sch_delay.max.ms.pipe_read.new_sync_read.vfs_read.ksys_read
0.01 ? 4% -100.0% 0.00 perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.jbd2_journal_commit_transaction.kjournald2.kthread
0.02 ? 22% -100.0% 0.00 perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
0.02 ? 31% -100.0% 0.00 perf-sched.sch_delay.max.ms.rcu_gp_kthread.kthread.ret_from_fork
0.01 ? 3% -28.3% 0.01 ? 5% perf-sched.sch_delay.max.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_select
0.02 ? 5% -100.0% 0.00 perf-sched.sch_delay.max.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
0.02 ? 34% -100.0% 0.00 perf-sched.sch_delay.max.ms.schedule_timeout.ext4_lazyinit_thread.part.0.kthread
0.02 ? 11% -92.2% 0.00 ?223% perf-sched.sch_delay.max.ms.schedule_timeout.kcompactd.kthread.ret_from_fork
1.27 ?168% -99.3% 0.01 ? 21% perf-sched.sch_delay.max.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
0.01 ? 39% -100.0% 0.00 perf-sched.sch_delay.max.ms.schedule_timeout.transaction_kthread.kthread.ret_from_fork
0.01 ? 20% -100.0% 0.00 perf-sched.sch_delay.max.ms.schedule_timeout.wait_for_completion.__flush_work.lru_add_drain_all
0.01 ? 42% -100.0% 0.00 perf-sched.sch_delay.max.ms.wait_for_partner.fifo_open.do_dentry_open.do_open.isra
2.53 +11.2% 2.81 ? 2% perf-sched.sch_delay.max.ms.worker_thread.kthread.ret_from_fork
0.00 ? 11% +155.6% 0.01 ? 14% perf-sched.total_sch_delay.average.ms
217.81 -99.9% 0.12 ? 24% perf-sched.total_wait_and_delay.average.ms
6704 ? 2% -93.0% 468.67 ? 18% perf-sched.total_wait_and_delay.count.ms
9992 -99.9% 10.39 ? 38% perf-sched.total_wait_and_delay.max.ms
217.80 -100.0% 0.11 ? 25% perf-sched.total_wait_time.average.ms
9992 -99.9% 10.38 ? 38% perf-sched.total_wait_time.max.ms
899.59 -100.0% 0.00 perf-sched.wait_and_delay.avg.ms.__x64_sys_pause.do_syscall_64.entry_SYSCALL_64_after_hwframe.[unknown]
818.24 -100.0% 0.00 perf-sched.wait_and_delay.avg.ms.do_nanosleep.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64
266.47 ? 3% -100.0% 0.12 ?171% perf-sched.wait_and_delay.avg.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
0.80 ? 5% -98.6% 0.01 ?223% perf-sched.wait_and_delay.avg.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
1317 -100.0% 0.00 perf-sched.wait_and_delay.avg.ms.io_schedule.bit_wait_io.__wait_on_bit.out_of_line_wait_on_bit
66.01 ? 3% -99.9% 0.05 ? 20% perf-sched.wait_and_delay.avg.ms.pipe_read.new_sync_read.vfs_read.ksys_read
18.00 -99.9% 0.02 ?223% perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
4.47 ? 2% -100.0% 0.00 perf-sched.wait_and_delay.avg.ms.rcu_gp_kthread.kthread.ret_from_fork
428.98 -100.0% 0.00 perf-sched.wait_and_delay.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
5.58 -100.0% 0.00 perf-sched.wait_and_delay.avg.ms.schedule_timeout.ext4_lazyinit_thread.part.0.kthread
229.82 ? 11% -100.0% 0.00 perf-sched.wait_and_delay.avg.ms.schedule_timeout.io_schedule_timeout.wait_for_completion_io.submit_bio_wait
478.80 -100.0% 0.00 ?223% perf-sched.wait_and_delay.avg.ms.schedule_timeout.kcompactd.kthread.ret_from_fork
22.09 ? 22% -87.1% 2.85 ? 16% perf-sched.wait_and_delay.avg.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
707.29 -100.0% 0.01 perf-sched.wait_and_delay.avg.ms.smpboot_thread_fn.kthread.ret_from_fork
0.00 -100.0% 0.00 perf-sched.wait_and_delay.avg.ms.wait_for_partner.fifo_open.do_dentry_open.do_open.isra
418.96 ? 3% -99.8% 0.96 ? 65% perf-sched.wait_and_delay.avg.ms.worker_thread.kthread.ret_from_fork
20.00 -100.0% 0.00 perf-sched.wait_and_delay.count.__x64_sys_pause.do_syscall_64.entry_SYSCALL_64_after_hwframe.[unknown]
11.00 -100.0% 0.00 perf-sched.wait_and_delay.count.do_nanosleep.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64
243.00 -97.3% 6.50 ? 43% perf-sched.wait_and_delay.count.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
242.00 -99.7% 0.67 ?223% perf-sched.wait_and_delay.count.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
4.00 -100.0% 0.00 perf-sched.wait_and_delay.count.io_schedule.bit_wait_io.__wait_on_bit.out_of_line_wait_on_bit
2432 ? 4% -90.0% 243.00 ? 32% perf-sched.wait_and_delay.count.pipe_read.new_sync_read.vfs_read.ksys_read
1056 -90.9% 96.17 perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
162.00 ? 23% -100.0% 0.00 perf-sched.wait_and_delay.count.rcu_gp_kthread.kthread.ret_from_fork
21.00 -100.0% 0.00 perf-sched.wait_and_delay.count.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
42.00 ? 11% -100.0% 0.00 perf-sched.wait_and_delay.count.schedule_timeout.ext4_lazyinit_thread.part.0.kthread
42.00 ? 11% -100.0% 0.00 perf-sched.wait_and_delay.count.schedule_timeout.io_schedule_timeout.wait_for_completion_io.submit_bio_wait
40.00 -99.2% 0.33 ?223% perf-sched.wait_and_delay.count.schedule_timeout.kcompactd.kthread.ret_from_fork
439.00 ? 19% -98.9% 4.83 ? 22% perf-sched.wait_and_delay.count.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
1249 -92.3% 96.50 perf-sched.wait_and_delay.count.smpboot_thread_fn.kthread.ret_from_fork
71.00 -100.0% 0.00 perf-sched.wait_and_delay.count.wait_for_partner.fifo_open.do_dentry_open.do_open.isra
593.75 ? 3% -99.0% 6.17 ? 35% perf-sched.wait_and_delay.count.worker_thread.kthread.ret_from_fork
999.74 -100.0% 0.00 perf-sched.wait_and_delay.max.ms.__x64_sys_pause.do_syscall_64.entry_SYSCALL_64_after_hwframe.[unknown]
1000 -100.0% 0.00 perf-sched.wait_and_delay.max.ms.do_nanosleep.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64
2999 ? 66% -100.0% 0.76 ?193% perf-sched.wait_and_delay.max.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
16.48 ? 2% -99.9% 0.02 ?223% perf-sched.wait_and_delay.max.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
5271 -100.0% 0.00 perf-sched.wait_and_delay.max.ms.io_schedule.bit_wait_io.__wait_on_bit.out_of_line_wait_on_bit
1006 -99.8% 1.59 ?114% perf-sched.wait_and_delay.max.ms.pipe_read.new_sync_read.vfs_read.ksys_read
9992 -100.0% 2.38 ?223% perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
5.01 -100.0% 0.00 perf-sched.wait_and_delay.max.ms.rcu_gp_kthread.kthread.ret_from_fork
1000 -100.0% 0.00 perf-sched.wait_and_delay.max.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
8.68 ? 7% -100.0% 0.00 perf-sched.wait_and_delay.max.ms.schedule_timeout.ext4_lazyinit_thread.part.0.kthread
238.33 ? 10% -100.0% 0.00 perf-sched.wait_and_delay.max.ms.schedule_timeout.io_schedule_timeout.wait_for_completion_io.submit_bio_wait
505.01 -100.0% 0.00 ?223% perf-sched.wait_and_delay.max.ms.schedule_timeout.kcompactd.kthread.ret_from_fork
427.25 -98.9% 4.65 ? 10% perf-sched.wait_and_delay.max.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
1006 -100.0% 0.06 ? 53% perf-sched.wait_and_delay.max.ms.smpboot_thread_fn.kthread.ret_from_fork
0.01 ? 42% -100.0% 0.00 perf-sched.wait_and_delay.max.ms.wait_for_partner.fifo_open.do_dentry_open.do_open.isra
8986 ? 3% -99.9% 4.94 ? 80% perf-sched.wait_and_delay.max.ms.worker_thread.kthread.ret_from_fork
899.58 -100.0% 0.00 perf-sched.wait_time.avg.ms.__x64_sys_pause.do_syscall_64.entry_SYSCALL_64_after_hwframe.[unknown]
818.23 -100.0% 0.00 perf-sched.wait_time.avg.ms.do_nanosleep.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64
266.46 ? 3% -100.0% 0.12 ?174% perf-sched.wait_time.avg.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
0.79 ? 5% -98.6% 0.01 ?223% perf-sched.wait_time.avg.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
1317 -100.0% 0.00 perf-sched.wait_time.avg.ms.io_schedule.bit_wait_io.__wait_on_bit.out_of_line_wait_on_bit
37.61 ? 4% -100.0% 0.00 perf-sched.wait_time.avg.ms.kjournald2.kthread.ret_from_fork
66.00 ? 3% -99.9% 0.04 ? 23% perf-sched.wait_time.avg.ms.pipe_read.new_sync_read.vfs_read.ksys_read
0.31 ? 23% -100.0% 0.00 perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.jbd2_journal_commit_transaction.kjournald2.kthread
18.00 -99.9% 0.02 ?223% perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
4.46 ? 2% -100.0% 0.00 perf-sched.wait_time.avg.ms.rcu_gp_kthread.kthread.ret_from_fork
130.40 ? 91% -98.6% 1.88 ? 29% perf-sched.wait_time.avg.ms.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait
428.97 -100.0% 0.00 perf-sched.wait_time.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
5.58 -100.0% 0.00 perf-sched.wait_time.avg.ms.schedule_timeout.ext4_lazyinit_thread.part.0.kthread
229.81 ? 11% -100.0% 0.00 perf-sched.wait_time.avg.ms.schedule_timeout.io_schedule_timeout.wait_for_completion_io.submit_bio_wait
478.79 -100.0% 0.00 perf-sched.wait_time.avg.ms.schedule_timeout.kcompactd.kthread.ret_from_fork
0.01 ? 50% -100.0% 0.00 perf-sched.wait_time.avg.ms.schedule_timeout.khugepaged.kthread.ret_from_fork
22.08 ? 22% -87.1% 2.84 ? 16% perf-sched.wait_time.avg.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
707.28 -100.0% 0.00 perf-sched.wait_time.avg.ms.smpboot_thread_fn.kthread.ret_from_fork
418.95 ? 3% -99.9% 0.44 ?149% perf-sched.wait_time.avg.ms.worker_thread.kthread.ret_from_fork
999.73 -100.0% 0.00 perf-sched.wait_time.max.ms.__x64_sys_pause.do_syscall_64.entry_SYSCALL_64_after_hwframe.[unknown]
1000 -100.0% 0.00 perf-sched.wait_time.max.ms.do_nanosleep.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64
2999 ? 66% -100.0% 0.76 ?194% perf-sched.wait_time.max.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
16.48 ? 2% -99.9% 0.02 ?223% perf-sched.wait_time.max.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
5271 -100.0% 0.00 perf-sched.wait_time.max.ms.io_schedule.bit_wait_io.__wait_on_bit.out_of_line_wait_on_bit
40.68 ? 5% -100.0% 0.00 perf-sched.wait_time.max.ms.kjournald2.kthread.ret_from_fork
1006 -99.9% 1.38 ?130% perf-sched.wait_time.max.ms.pipe_read.new_sync_read.vfs_read.ksys_read
0.44 ? 32% -100.0% 0.00 perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.jbd2_journal_commit_transaction.kjournald2.kthread
9992 -100.0% 2.38 ?223% perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
5.00 -100.0% 0.00 perf-sched.wait_time.max.ms.rcu_gp_kthread.kthread.ret_from_fork
380.84 ? 20% -97.9% 8.14 ? 48% perf-sched.wait_time.max.ms.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait
1000 -100.0% 0.00 perf-sched.wait_time.max.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
8.67 ? 8% -100.0% 0.00 perf-sched.wait_time.max.ms.schedule_timeout.ext4_lazyinit_thread.part.0.kthread
238.32 ? 10% -100.0% 0.00 perf-sched.wait_time.max.ms.schedule_timeout.io_schedule_timeout.wait_for_completion_io.submit_bio_wait
505.00 -100.0% 0.00 perf-sched.wait_time.max.ms.schedule_timeout.kcompactd.kthread.ret_from_fork
0.01 ? 50% -100.0% 0.00 perf-sched.wait_time.max.ms.schedule_timeout.khugepaged.kthread.ret_from_fork
427.24 -98.9% 4.65 ? 10% perf-sched.wait_time.max.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
1006 -100.0% 0.00 perf-sched.wait_time.max.ms.smpboot_thread_fn.kthread.ret_from_fork
8986 ? 3% -100.0% 3.07 ?164% perf-sched.wait_time.max.ms.worker_thread.kthread.ret_from_fork
6039 ? 6% +421.2% 31478 ? 2% softirqs.BLOCK
29138 ? 16% -36.1% 18612 ? 13% softirqs.CPU0.RCU
58040 ? 17% -75.7% 14102 ? 9% softirqs.CPU0.SCHED
24110 ? 20% -56.0% 10620 ? 4% softirqs.CPU1.RCU
56327 ? 20% -80.6% 10933 ? 9% softirqs.CPU1.SCHED
20895 ? 15% -54.6% 9495 ? 8% softirqs.CPU10.RCU
54081 ? 19% -84.2% 8566 ? 10% softirqs.CPU10.SCHED
21199 ? 17% -56.8% 9158 ? 5% softirqs.CPU11.RCU
54781 ? 20% -84.9% 8272 ? 18% softirqs.CPU11.SCHED
18953 ? 22% -47.6% 9923 ? 6% softirqs.CPU12.RCU
54238 ? 19% -85.0% 8159 ? 22% softirqs.CPU12.SCHED
20880 ? 12% -55.9% 9198 ? 9% softirqs.CPU13.RCU
54341 ? 19% -83.5% 8983 ? 11% softirqs.CPU13.SCHED
21483 ? 15% -58.4% 8944 ? 6% softirqs.CPU14.RCU
54459 ? 19% -84.8% 8298 ? 10% softirqs.CPU14.SCHED
19535 ? 15% -56.0% 8603 ? 6% softirqs.CPU15.RCU
54471 ? 20% -83.4% 9043 ? 5% softirqs.CPU15.SCHED
21573 ? 12% -57.7% 9122 ? 10% softirqs.CPU16.RCU
49880 ? 34% -81.5% 9206 ? 20% softirqs.CPU16.SCHED
21552 ? 18% -59.1% 8806 ? 5% softirqs.CPU17.RCU
54462 ? 19% -83.5% 8971 ? 7% softirqs.CPU17.SCHED
21287 ? 16% -55.6% 9453 ? 3% softirqs.CPU18.RCU
49917 ? 34% -81.2% 9386 ? 3% softirqs.CPU18.SCHED
21142 ? 16% -55.2% 9466 ? 5% softirqs.CPU19.RCU
54765 ? 19% -84.2% 8664 ? 7% softirqs.CPU19.SCHED
20613 ? 21% -52.9% 9711 ? 4% softirqs.CPU2.RCU
55530 ? 18% -82.7% 9622 ? 4% softirqs.CPU2.SCHED
21120 ? 15% -55.4% 9428 ? 6% softirqs.CPU20.RCU
54707 ? 19% -82.9% 9329 ? 11% softirqs.CPU20.SCHED
21016 ? 15% -57.3% 8973 ? 4% softirqs.CPU21.RCU
54613 ? 19% -83.5% 8996 ? 8% softirqs.CPU21.SCHED
21917 ? 15% -58.8% 9035 ? 5% softirqs.CPU22.RCU
49554 ? 34% -81.7% 9053 ? 6% softirqs.CPU22.SCHED
21111 ? 16% -57.6% 8952 ? 3% softirqs.CPU23.RCU
54435 ? 19% -84.6% 8400 ? 9% softirqs.CPU23.SCHED
21207 ? 16% -59.7% 8546 ? 4% softirqs.CPU24.RCU
54520 ? 20% -83.1% 9205 ? 4% softirqs.CPU24.SCHED
20732 ? 16% -58.9% 8516 ? 7% softirqs.CPU25.RCU
54161 ? 19% -83.3% 9069 ? 14% softirqs.CPU25.SCHED
21187 ? 16% -61.6% 8126 ? 4% softirqs.CPU26.RCU
54238 ? 20% -83.2% 9133 ? 5% softirqs.CPU26.SCHED
19552 ? 13% -57.5% 8316 ? 6% softirqs.CPU27.RCU
53962 ? 20% -82.8% 9278 ? 3% softirqs.CPU27.SCHED
21012 ? 17% -60.5% 8300 ? 6% softirqs.CPU28.RCU
53864 ? 20% -83.1% 9092 ? 6% softirqs.CPU28.SCHED
21272 ? 16% -59.6% 8588 ? 5% softirqs.CPU29.RCU
54389 ? 20% -84.3% 8543 ? 10% softirqs.CPU29.SCHED
20936 ? 17% -51.8% 10086 ? 7% softirqs.CPU3.RCU
55866 ? 21% -83.8% 9038 ? 14% softirqs.CPU3.SCHED
20929 ? 17% -60.4% 8278 ? 4% softirqs.CPU30.RCU
54210 ? 20% -84.3% 8501 ? 14% softirqs.CPU30.SCHED
20543 ? 16% -60.9% 8026 ? 3% softirqs.CPU31.RCU
53859 ? 20% -83.9% 8648 ? 11% softirqs.CPU31.SCHED
21006 ? 16% -58.0% 8832 ? 11% softirqs.CPU32.RCU
53990 ? 20% -83.4% 8938 ? 10% softirqs.CPU32.SCHED
20981 ? 16% -55.8% 9275 ? 18% softirqs.CPU33.RCU
54016 ? 20% -83.6% 8884 ? 4% softirqs.CPU33.SCHED
21071 ? 16% -57.8% 8883 ? 11% softirqs.CPU34.RCU
54261 ? 20% -83.8% 8780 ? 9% softirqs.CPU34.SCHED
21132 ? 17% -59.3% 8608 ? 13% softirqs.CPU35.RCU
53809 ? 20% -83.1% 9082 ? 4% softirqs.CPU35.SCHED
20021 ? 20% -56.1% 8795 ? 6% softirqs.CPU36.RCU
53860 ? 20% -83.8% 8736 ? 13% softirqs.CPU36.SCHED
21108 ? 17% -58.0% 8871 ? 7% softirqs.CPU37.RCU
54360 ? 19% -82.7% 9393 softirqs.CPU37.SCHED
20920 ? 17% -57.5% 8885 ? 8% softirqs.CPU38.RCU
54059 ? 20% -83.8% 8777 ? 14% softirqs.CPU38.SCHED
21112 ? 17% -57.2% 9037 ? 12% softirqs.CPU39.RCU
53938 ? 20% -82.1% 9631 ? 6% softirqs.CPU39.SCHED
21156 ? 16% -56.9% 9120 ? 12% softirqs.CPU4.RCU
54765 ? 19% -82.5% 9608 softirqs.CPU4.SCHED
21442 ? 17% -59.8% 8617 ? 12% softirqs.CPU40.RCU
53974 ? 20% -83.5% 8910 ? 10% softirqs.CPU40.SCHED
21394 ? 17% -56.8% 9241 ? 11% softirqs.CPU41.RCU
54078 ? 20% -83.6% 8842 ? 10% softirqs.CPU41.SCHED
21069 ? 16% -60.2% 8387 ? 3% softirqs.CPU42.RCU
54480 ? 19% -84.6% 8393 ? 13% softirqs.CPU42.SCHED
19041 ? 25% -53.4% 8881 ? 10% softirqs.CPU43.RCU
53962 ? 20% -84.4% 8434 ? 13% softirqs.CPU43.SCHED
20011 ? 17% -55.8% 8848 ? 6% softirqs.CPU44.RCU
54413 ? 20% -83.8% 8789 ? 10% softirqs.CPU44.SCHED
20908 ? 17% -52.1% 10024 ? 29% softirqs.CPU45.RCU
47378 ? 23% -78.2% 10346 ? 21% softirqs.CPU45.SCHED
21126 ? 16% -55.8% 9339 ? 9% softirqs.CPU46.RCU
54632 ? 20% -83.8% 8852 ? 11% softirqs.CPU46.SCHED
21548 ? 17% -56.9% 9290 ? 15% softirqs.CPU47.RCU
41071 ? 42% -81.0% 7818 ? 18% softirqs.CPU47.SCHED
20981 ? 14% -57.1% 9001 ? 7% softirqs.CPU48.RCU
47343 ? 39% -82.2% 8443 ? 10% softirqs.CPU48.SCHED
21328 ? 19% -58.5% 8842 ? 11% softirqs.CPU49.RCU
53739 ? 20% -81.9% 9700 ? 11% softirqs.CPU49.SCHED
21400 ? 16% -55.5% 9517 ? 5% softirqs.CPU5.RCU
47327 ? 44% -83.6% 7756 ? 23% softirqs.CPU5.SCHED
21749 ? 16% -54.7% 9859 ? 6% softirqs.CPU50.RCU
46551 ? 19% -81.2% 8734 ? 14% softirqs.CPU50.SCHED
21785 ? 12% -56.8% 9400 ? 6% softirqs.CPU51.RCU
55290 ? 19% -83.7% 9003 ? 13% softirqs.CPU51.SCHED
21770 ? 16% -57.0% 9358 ? 6% softirqs.CPU52.RCU
54921 ? 20% -84.1% 8710 ? 6% softirqs.CPU52.SCHED
21839 ? 16% -49.9% 10933 ? 17% softirqs.CPU53.RCU
54659 ? 19% -80.6% 10602 ? 20% softirqs.CPU53.SCHED
21867 ? 16% -56.1% 9607 ? 7% softirqs.CPU54.RCU
54908 ? 19% -83.3% 9144 ? 6% softirqs.CPU54.SCHED
21365 ? 16% -56.1% 9380 ? 7% softirqs.CPU55.RCU
53563 ? 19% -82.7% 9245 ? 4% softirqs.CPU55.SCHED
21218 ? 15% -57.8% 8949 ? 4% softirqs.CPU56.RCU
53328 ? 19% -84.3% 8391 ? 7% softirqs.CPU56.SCHED
20965 ? 16% -55.2% 9398 ? 6% softirqs.CPU57.RCU
54464 ? 17% -84.4% 8484 ? 8% softirqs.CPU57.SCHED
21753 ? 17% -57.3% 9279 ? 6% softirqs.CPU58.RCU
47270 ? 19% -81.5% 8756 ? 11% softirqs.CPU58.SCHED
22030 ? 11% -51.1% 10774 ? 19% softirqs.CPU59.RCU
54053 ? 19% -81.2% 10186 ? 19% softirqs.CPU59.SCHED
21201 ? 15% -56.1% 9303 ? 4% softirqs.CPU6.RCU
54704 ? 19% -84.2% 8644 ? 15% softirqs.CPU6.SCHED
22059 ? 15% -56.0% 9707 ? 6% softirqs.CPU60.RCU
54376 ? 19% -84.5% 8438 ? 25% softirqs.CPU60.SCHED
21450 ? 16% -54.7% 9710 ? 9% softirqs.CPU61.RCU
54013 ? 20% -83.0% 9203 ? 4% softirqs.CPU61.SCHED
20747 ? 16% -54.3% 9478 ? 6% softirqs.CPU62.RCU
53698 ? 19% -83.9% 8630 ? 12% softirqs.CPU62.SCHED
20819 ? 15% -53.1% 9760 ? 8% softirqs.CPU63.RCU
53931 ? 19% -83.2% 9046 ? 5% softirqs.CPU63.SCHED
19480 ? 13% -53.7% 9027 ? 13% softirqs.CPU64.RCU
54934 ? 20% -83.5% 9064 ? 17% softirqs.CPU64.SCHED
22099 ? 14% -55.4% 9854 ? 20% softirqs.CPU65.RCU
47328 ? 19% -79.1% 9872 ? 20% softirqs.CPU65.SCHED
22764 ? 16% -61.0% 8889 ? 4% softirqs.CPU66.RCU
47453 ? 21% -86.6% 6364 ? 27% softirqs.CPU66.SCHED
21969 ? 15% -59.5% 8888 ? 6% softirqs.CPU67.RCU
54661 ? 19% -84.5% 8476 ? 9% softirqs.CPU67.SCHED
21956 ? 16% -59.2% 8961 ? 7% softirqs.CPU68.RCU
54895 ? 19% -85.1% 8161 ? 20% softirqs.CPU68.SCHED
21521 ? 16% -59.1% 8804 ? 6% softirqs.CPU69.RCU
54451 ? 19% -82.8% 9360 ? 9% softirqs.CPU69.SCHED
20982 ? 16% -56.8% 9062 ? 5% softirqs.CPU7.RCU
54333 ? 18% -83.9% 8769 ? 4% softirqs.CPU7.SCHED
21882 ? 14% -59.8% 8802 ? 2% softirqs.CPU70.RCU
54718 ? 19% -84.0% 8781 ? 7% softirqs.CPU70.SCHED
21467 ? 15% -60.3% 8521 ? 6% softirqs.CPU71.RCU
54365 ? 19% -83.2% 9118 ? 6% softirqs.CPU71.SCHED
21166 ? 17% -60.3% 8402 softirqs.CPU72.RCU
55023 ? 20% -84.0% 8800 ? 7% softirqs.CPU72.SCHED
20447 ? 17% -53.4% 9535 ? 32% softirqs.CPU73.RCU
54138 ? 20% -83.7% 8807 ? 6% softirqs.CPU73.SCHED
20784 ? 17% -60.0% 8306 ? 6% softirqs.CPU74.RCU
54493 ? 20% -85.1% 8098 ? 14% softirqs.CPU74.SCHED
20782 ? 17% -59.9% 8337 ? 4% softirqs.CPU75.RCU
55712 ? 21% -83.9% 8972 ? 9% softirqs.CPU75.SCHED
54976 ? 20% -83.8% 8888 ? 6% softirqs.CPU76.SCHED
20818 ? 21% -57.3% 8887 ? 9% softirqs.CPU77.RCU
47325 ? 21% -80.7% 9141 ? 9% softirqs.CPU77.SCHED
20800 ? 17% -59.9% 8336 ? 7% softirqs.CPU78.RCU
54709 ? 20% -82.8% 9393 softirqs.CPU78.SCHED
20834 ? 16% -59.0% 8546 ? 10% softirqs.CPU79.RCU
54506 ? 20% -83.8% 8832 ? 24% softirqs.CPU79.SCHED
20966 ? 13% -56.7% 9072 ? 6% softirqs.CPU8.RCU
53701 ? 19% -83.8% 8678 ? 9% softirqs.CPU8.SCHED
21194 ? 16% -59.1% 8671 ? 11% softirqs.CPU80.RCU
54632 ? 20% -84.2% 8643 ? 10% softirqs.CPU80.SCHED
20947 ? 17% -57.2% 8972 ? 14% softirqs.CPU81.RCU
54366 ? 19% -83.1% 9161 ? 4% softirqs.CPU81.SCHED
21117 ? 17% -60.3% 8380 ? 12% softirqs.CPU82.RCU
54637 ? 20% -83.9% 8809 ? 6% softirqs.CPU82.SCHED
20965 ? 17% -57.7% 8863 ? 12% softirqs.CPU83.RCU
54464 ? 20% -83.4% 9027 ? 4% softirqs.CPU83.SCHED
21258 ? 17% -57.7% 8995 ? 12% softirqs.CPU84.RCU
54927 ? 19% -84.8% 8328 ? 14% softirqs.CPU84.SCHED
21166 ? 18% -57.2% 9069 ? 11% softirqs.CPU85.RCU
54355 ? 20% -83.6% 8920 ? 5% softirqs.CPU85.SCHED
21492 ? 19% -59.1% 8783 ? 12% softirqs.CPU86.RCU
54756 ? 20% -84.2% 8658 ? 14% softirqs.CPU86.SCHED
21255 ? 17% -59.2% 8678 ? 8% softirqs.CPU87.RCU
54448 ? 20% -85.0% 8165 ? 8% softirqs.CPU87.SCHED
21370 ? 17% -58.4% 8890 ? 13% softirqs.CPU88.RCU
54777 ? 20% -83.6% 8983 ? 13% softirqs.CPU88.SCHED
21197 ? 17% -58.6% 8783 ? 11% softirqs.CPU89.RCU
54858 ? 20% -83.8% 8891 ? 5% softirqs.CPU89.SCHED
19670 ? 22% -54.1% 9019 ? 8% softirqs.CPU9.RCU
47246 ? 24% -80.7% 9113 ? 4% softirqs.CPU9.SCHED
20784 ? 18% -60.5% 8210 ? 6% softirqs.CPU90.RCU
54168 ? 20% -82.5% 9495 ? 7% softirqs.CPU90.SCHED
21222 ? 18% -59.2% 8648 ? 8% softirqs.CPU91.RCU
54583 ? 20% -84.2% 8618 ? 11% softirqs.CPU91.SCHED
20734 ? 17% -57.7% 8778 ? 10% softirqs.CPU92.RCU
54505 ? 20% -84.4% 8507 ? 8% softirqs.CPU92.SCHED
20945 ? 17% -57.4% 8922 ? 9% softirqs.CPU93.RCU
54481 ? 20% -84.4% 8519 ? 12% softirqs.CPU93.SCHED
21227 ? 17% -58.8% 8745 ? 10% softirqs.CPU94.RCU
55544 ? 21% -84.2% 8750 ? 8% softirqs.CPU94.SCHED
21333 ? 17% -60.0% 8543 ? 18% softirqs.CPU95.RCU
48288 ? 23% -81.0% 9161 ? 7% softirqs.CPU95.SCHED
2034389 ? 16% -56.9% 877030 ? 3% softirqs.RCU
5133667 ? 19% -83.3% 859201 softirqs.SCHED
31405 ? 13% -26.5% 23077 ? 3% softirqs.TIMER
76043 ? 2% -7.7% 70215 interrupts.CAL:Function_call_interrupts
842953 ? 21% -84.9% 127370 interrupts.CPU0.LOC:Local_timer_interrupts
101.00 ? 14% +169.6% 272.33 ? 43% interrupts.CPU0.NMI:Non-maskable_interrupts
101.00 ? 14% +169.6% 272.33 ? 43% interrupts.CPU0.PMI:Performance_monitoring_interrupts
840340 ? 20% -84.9% 127037 interrupts.CPU1.LOC:Local_timer_interrupts
843395 ? 21% -84.9% 127257 interrupts.CPU10.LOC:Local_timer_interrupts
83.75 ? 11% +140.2% 201.17 ? 34% interrupts.CPU10.NMI:Non-maskable_interrupts
83.75 ? 11% +140.2% 201.17 ? 34% interrupts.CPU10.PMI:Performance_monitoring_interrupts
842273 ? 20% -84.9% 127166 interrupts.CPU11.LOC:Local_timer_interrupts
87.00 ? 15% +213.4% 272.67 ? 39% interrupts.CPU11.NMI:Non-maskable_interrupts
87.00 ? 15% +213.4% 272.67 ? 39% interrupts.CPU11.PMI:Performance_monitoring_interrupts
839908 ? 20% -84.8% 127364 interrupts.CPU12.LOC:Local_timer_interrupts
843850 ? 21% -84.9% 127095 interrupts.CPU13.LOC:Local_timer_interrupts
614.50 +13.1% 695.00 ? 5% interrupts.CPU14.CAL:Function_call_interrupts
844030 ? 21% -84.9% 127130 interrupts.CPU14.LOC:Local_timer_interrupts
91.00 ? 19% +152.2% 229.50 ? 37% interrupts.CPU14.NMI:Non-maskable_interrupts
91.00 ? 19% +152.2% 229.50 ? 37% interrupts.CPU14.PMI:Performance_monitoring_interrupts
844705 ? 21% -84.9% 127478 interrupts.CPU15.LOC:Local_timer_interrupts
843860 ? 21% -84.9% 127257 interrupts.CPU16.LOC:Local_timer_interrupts
613.75 +38.1% 847.33 ? 18% interrupts.CPU17.CAL:Function_call_interrupts
844885 ? 21% -85.0% 126951 interrupts.CPU17.LOC:Local_timer_interrupts
842280 ? 20% -84.9% 127136 interrupts.CPU18.LOC:Local_timer_interrupts
89.75 ? 16% +225.9% 292.50 ? 37% interrupts.CPU18.NMI:Non-maskable_interrupts
89.75 ? 16% +225.9% 292.50 ? 37% interrupts.CPU18.PMI:Performance_monitoring_interrupts
641.50 ? 3% +30.2% 835.50 ? 7% interrupts.CPU19.CAL:Function_call_interrupts
843812 ? 21% -84.9% 127092 interrupts.CPU19.LOC:Local_timer_interrupts
88.50 ? 15% +262.5% 320.83 ? 5% interrupts.CPU19.NMI:Non-maskable_interrupts
88.50 ? 15% +262.5% 320.83 ? 5% interrupts.CPU19.PMI:Performance_monitoring_interrupts
843241 ? 21% -84.9% 127018 interrupts.CPU2.LOC:Local_timer_interrupts
88.75 ? 21% +171.7% 241.17 ? 25% interrupts.CPU2.NMI:Non-maskable_interrupts
88.75 ? 21% +171.7% 241.17 ? 25% interrupts.CPU2.PMI:Performance_monitoring_interrupts
614.75 +26.8% 779.50 ? 15% interrupts.CPU20.CAL:Function_call_interrupts
844073 ? 21% -84.9% 127115 interrupts.CPU20.LOC:Local_timer_interrupts
93.50 ? 18% +166.8% 249.50 ? 14% interrupts.CPU20.NMI:Non-maskable_interrupts
93.50 ? 18% +166.8% 249.50 ? 14% interrupts.CPU20.PMI:Performance_monitoring_interrupts
621.25 +32.6% 824.00 ? 16% interrupts.CPU21.CAL:Function_call_interrupts
839248 ? 20% -84.8% 127242 interrupts.CPU21.LOC:Local_timer_interrupts
88.75 ? 18% +105.8% 182.67 ? 23% interrupts.CPU21.NMI:Non-maskable_interrupts
88.75 ? 18% +105.8% 182.67 ? 23% interrupts.CPU21.PMI:Performance_monitoring_interrupts
843394 ? 21% -84.9% 127086 interrupts.CPU22.LOC:Local_timer_interrupts
91.00 ? 17% +213.6% 285.33 ? 13% interrupts.CPU22.NMI:Non-maskable_interrupts
91.00 ? 17% +213.6% 285.33 ? 13% interrupts.CPU22.PMI:Performance_monitoring_interrupts
843836 ? 21% -84.9% 127554 interrupts.CPU23.LOC:Local_timer_interrupts
843834 ? 21% -84.9% 127259 interrupts.CPU24.LOC:Local_timer_interrupts
845168 ? 21% -85.0% 127044 interrupts.CPU25.LOC:Local_timer_interrupts
844826 ? 21% -84.9% 127277 interrupts.CPU26.LOC:Local_timer_interrupts
844846 ? 21% -85.0% 127110 interrupts.CPU27.LOC:Local_timer_interrupts
86.25 ? 7% +92.9% 166.33 ? 45% interrupts.CPU27.NMI:Non-maskable_interrupts
86.25 ? 7% +92.9% 166.33 ? 45% interrupts.CPU27.PMI:Performance_monitoring_interrupts
844885 ? 21% -85.0% 127049 interrupts.CPU28.LOC:Local_timer_interrupts
842909 ? 21% -84.9% 127225 interrupts.CPU29.LOC:Local_timer_interrupts
86.25 ? 13% +128.2% 196.83 ? 44% interrupts.CPU29.NMI:Non-maskable_interrupts
86.25 ? 13% +128.2% 196.83 ? 44% interrupts.CPU29.PMI:Performance_monitoring_interrupts
843705 ? 21% -84.9% 127175 interrupts.CPU3.LOC:Local_timer_interrupts
91.25 ? 7% +165.4% 242.17 ? 27% interrupts.CPU3.NMI:Non-maskable_interrupts
91.25 ? 7% +165.4% 242.17 ? 27% interrupts.CPU3.PMI:Performance_monitoring_interrupts
843544 ? 21% -84.9% 127110 interrupts.CPU30.LOC:Local_timer_interrupts
844641 ? 21% -84.9% 127253 interrupts.CPU31.LOC:Local_timer_interrupts
843257 ? 21% -84.9% 127176 interrupts.CPU32.LOC:Local_timer_interrupts
844438 ? 21% -84.9% 127240 interrupts.CPU33.LOC:Local_timer_interrupts
844457 ? 21% -84.9% 127190 interrupts.CPU34.LOC:Local_timer_interrupts
844194 ? 21% -84.9% 127145 interrupts.CPU35.LOC:Local_timer_interrupts
611.75 +16.1% 710.17 ? 12% interrupts.CPU36.CAL:Function_call_interrupts
842877 ? 21% -84.9% 127222 interrupts.CPU36.LOC:Local_timer_interrupts
842203 ? 20% -84.9% 127220 interrupts.CPU37.LOC:Local_timer_interrupts
842075 ? 20% -84.9% 127094 interrupts.CPU38.LOC:Local_timer_interrupts
842850 ? 21% -84.9% 127248 interrupts.CPU39.LOC:Local_timer_interrupts
624.00 ? 2% +31.7% 821.67 ? 20% interrupts.CPU4.CAL:Function_call_interrupts
840682 ? 20% -84.9% 127053 interrupts.CPU4.LOC:Local_timer_interrupts
68.50 ? 30% +227.0% 224.00 ? 28% interrupts.CPU4.NMI:Non-maskable_interrupts
68.50 ? 30% +227.0% 224.00 ? 28% interrupts.CPU4.PMI:Performance_monitoring_interrupts
838695 ? 20% -84.8% 127225 interrupts.CPU40.LOC:Local_timer_interrupts
839157 ? 20% -84.9% 127052 interrupts.CPU41.LOC:Local_timer_interrupts
820417 ? 19% -84.5% 127094 interrupts.CPU42.LOC:Local_timer_interrupts
812471 ? 19% -84.3% 127199 interrupts.CPU43.LOC:Local_timer_interrupts
808700 ? 18% -84.3% 127000 interrupts.CPU44.LOC:Local_timer_interrupts
84.00 ? 34% +169.4% 226.33 ? 32% interrupts.CPU44.NMI:Non-maskable_interrupts
84.00 ? 34% +169.4% 226.33 ? 32% interrupts.CPU44.PMI:Performance_monitoring_interrupts
842336 ? 20% -84.9% 127128 interrupts.CPU45.LOC:Local_timer_interrupts
76.50 ? 27% +236.8% 257.67 ? 32% interrupts.CPU45.NMI:Non-maskable_interrupts
76.50 ? 27% +236.8% 257.67 ? 32% interrupts.CPU45.PMI:Performance_monitoring_interrupts
800644 ? 18% -84.1% 127154 interrupts.CPU46.LOC:Local_timer_interrupts
69.25 ? 46% +166.9% 184.83 ? 36% interrupts.CPU46.NMI:Non-maskable_interrupts
69.25 ? 46% +166.9% 184.83 ? 36% interrupts.CPU46.PMI:Performance_monitoring_interrupts
839952 ? 20% -84.8% 127330 interrupts.CPU47.LOC:Local_timer_interrupts
842954 ? 21% -84.9% 126906 interrupts.CPU48.LOC:Local_timer_interrupts
74.00 ? 36% +281.3% 282.17 ? 40% interrupts.CPU48.NMI:Non-maskable_interrupts
74.00 ? 36% +281.3% 282.17 ? 40% interrupts.CPU48.PMI:Performance_monitoring_interrupts
840194 ? 20% -84.9% 127283 interrupts.CPU49.LOC:Local_timer_interrupts
84.50 ? 39% +175.7% 233.00 ? 23% interrupts.CPU49.NMI:Non-maskable_interrupts
84.50 ? 39% +175.7% 233.00 ? 23% interrupts.CPU49.PMI:Performance_monitoring_interrupts
844078 ? 21% -84.9% 127304 interrupts.CPU5.LOC:Local_timer_interrupts
83.00 ? 13% +172.9% 226.50 ? 40% interrupts.CPU5.NMI:Non-maskable_interrupts
83.00 ? 13% +172.9% 226.50 ? 40% interrupts.CPU5.PMI:Performance_monitoring_interrupts
843200 ? 21% -84.9% 127032 interrupts.CPU50.LOC:Local_timer_interrupts
112.50 ? 51% +136.4% 266.00 ? 28% interrupts.CPU50.NMI:Non-maskable_interrupts
112.50 ? 51% +136.4% 266.00 ? 28% interrupts.CPU50.PMI:Performance_monitoring_interrupts
843472 ? 21% -84.9% 127266 interrupts.CPU51.LOC:Local_timer_interrupts
841010 ? 20% -84.9% 127312 interrupts.CPU52.LOC:Local_timer_interrupts
94.75 ? 45% +145.9% 233.00 ? 31% interrupts.CPU52.NMI:Non-maskable_interrupts
94.75 ? 45% +145.9% 233.00 ? 31% interrupts.CPU52.PMI:Performance_monitoring_interrupts
844061 ? 21% -84.9% 127350 interrupts.CPU53.LOC:Local_timer_interrupts
55.50 ? 50% +289.8% 216.33 ? 38% interrupts.CPU53.NMI:Non-maskable_interrupts
55.50 ? 50% +289.8% 216.33 ? 38% interrupts.CPU53.PMI:Performance_monitoring_interrupts
615.00 +17.6% 723.00 ? 9% interrupts.CPU54.CAL:Function_call_interrupts
843353 ? 21% -84.9% 127413 interrupts.CPU54.LOC:Local_timer_interrupts
75.25 ? 31% +138.1% 179.17 ? 42% interrupts.CPU54.NMI:Non-maskable_interrupts
75.25 ? 31% +138.1% 179.17 ? 42% interrupts.CPU54.PMI:Performance_monitoring_interrupts
624.00 ? 2% +17.1% 730.50 ? 8% interrupts.CPU55.CAL:Function_call_interrupts
842745 ? 21% -84.9% 127363 interrupts.CPU55.LOC:Local_timer_interrupts
68.00 ? 44% +242.2% 232.67 ? 26% interrupts.CPU55.NMI:Non-maskable_interrupts
68.00 ? 44% +242.2% 232.67 ? 26% interrupts.CPU55.PMI:Performance_monitoring_interrupts
844904 ? 21% -84.9% 127212 interrupts.CPU56.LOC:Local_timer_interrupts
844373 ? 21% -84.9% 127362 interrupts.CPU57.LOC:Local_timer_interrupts
843136 ? 21% -84.9% 127392 interrupts.CPU58.LOC:Local_timer_interrupts
90.50 ? 23% +113.6% 193.33 ? 34% interrupts.CPU58.NMI:Non-maskable_interrupts
90.50 ? 23% +113.6% 193.33 ? 34% interrupts.CPU58.PMI:Performance_monitoring_interrupts
842321 ? 20% -84.9% 127396 interrupts.CPU59.LOC:Local_timer_interrupts
90.00 ? 18% +144.8% 220.33 ? 40% interrupts.CPU59.NMI:Non-maskable_interrupts
90.00 ? 18% +144.8% 220.33 ? 40% interrupts.CPU59.PMI:Performance_monitoring_interrupts
843664 ? 21% -84.9% 127260 interrupts.CPU6.LOC:Local_timer_interrupts
86.25 ? 14% +131.5% 199.67 ? 42% interrupts.CPU6.NMI:Non-maskable_interrupts
86.25 ? 14% +131.5% 199.67 ? 42% interrupts.CPU6.PMI:Performance_monitoring_interrupts
839857 ? 20% -84.8% 127281 interrupts.CPU60.LOC:Local_timer_interrupts
843804 ? 21% -84.9% 127192 interrupts.CPU61.LOC:Local_timer_interrupts
79.50 ? 37% +117.4% 172.83 ? 36% interrupts.CPU61.NMI:Non-maskable_interrupts
79.50 ? 37% +117.4% 172.83 ? 36% interrupts.CPU61.PMI:Performance_monitoring_interrupts
619.25 +23.2% 762.83 ? 11% interrupts.CPU62.CAL:Function_call_interrupts
844003 ? 21% -84.9% 127191 interrupts.CPU62.LOC:Local_timer_interrupts
844768 ? 21% -84.9% 127409 interrupts.CPU63.LOC:Local_timer_interrupts
100.25 ? 10% +99.2% 199.67 ? 25% interrupts.CPU63.NMI:Non-maskable_interrupts
100.25 ? 10% +99.2% 199.67 ? 25% interrupts.CPU63.PMI:Performance_monitoring_interrupts
843942 ? 21% -84.9% 127142 interrupts.CPU64.LOC:Local_timer_interrupts
100.25 ? 23% +159.9% 260.50 ? 27% interrupts.CPU64.NMI:Non-maskable_interrupts
100.25 ? 23% +159.9% 260.50 ? 27% interrupts.CPU64.PMI:Performance_monitoring_interrupts
844911 ? 21% -85.0% 126957 interrupts.CPU65.LOC:Local_timer_interrupts
842339 ? 20% -84.9% 127332 interrupts.CPU66.LOC:Local_timer_interrupts
84.75 ? 37% +155.7% 216.67 ? 34% interrupts.CPU66.NMI:Non-maskable_interrupts
84.75 ? 37% +155.7% 216.67 ? 34% interrupts.CPU66.PMI:Performance_monitoring_interrupts
843842 ? 21% -84.9% 127319 interrupts.CPU67.LOC:Local_timer_interrupts
85.25 ? 40% +161.0% 222.50 ? 27% interrupts.CPU67.NMI:Non-maskable_interrupts
85.25 ? 40% +161.0% 222.50 ? 27% interrupts.CPU67.PMI:Performance_monitoring_interrupts
844217 ? 21% -84.9% 127191 interrupts.CPU68.LOC:Local_timer_interrupts
86.25 ? 32% +119.7% 189.50 ? 36% interrupts.CPU68.NMI:Non-maskable_interrupts
86.25 ? 32% +119.7% 189.50 ? 36% interrupts.CPU68.PMI:Performance_monitoring_interrupts
839417 ? 20% -84.8% 127551 interrupts.CPU69.LOC:Local_timer_interrupts
80.75 ? 33% +140.0% 193.83 ? 32% interrupts.CPU69.NMI:Non-maskable_interrupts
80.75 ? 33% +140.0% 193.83 ? 32% interrupts.CPU69.PMI:Performance_monitoring_interrupts
842748 ? 21% -84.9% 127382 interrupts.CPU7.LOC:Local_timer_interrupts
843475 ? 21% -84.9% 127061 interrupts.CPU70.LOC:Local_timer_interrupts
86.75 ? 36% +197.8% 258.33 ? 16% interrupts.CPU70.NMI:Non-maskable_interrupts
86.75 ? 36% +197.8% 258.33 ? 16% interrupts.CPU70.PMI:Performance_monitoring_interrupts
607.25 ? 2% +11.8% 678.67 ? 5% interrupts.CPU71.CAL:Function_call_interrupts
843809 ? 21% -85.0% 126993 interrupts.CPU71.LOC:Local_timer_interrupts
92.75 ? 17% +176.2% 256.17 ? 33% interrupts.CPU71.NMI:Non-maskable_interrupts
92.75 ? 17% +176.2% 256.17 ? 33% interrupts.CPU71.PMI:Performance_monitoring_interrupts
843819 ? 21% -84.9% 127186 interrupts.CPU72.LOC:Local_timer_interrupts
845122 ? 21% -84.9% 127296 interrupts.CPU73.LOC:Local_timer_interrupts
844830 ? 21% -85.0% 127117 interrupts.CPU74.LOC:Local_timer_interrupts
844971 ? 21% -85.0% 127141 interrupts.CPU75.LOC:Local_timer_interrupts
844907 ? 21% -85.0% 127095 interrupts.CPU76.LOC:Local_timer_interrupts
74.00 ? 29% +209.2% 228.83 ? 35% interrupts.CPU76.NMI:Non-maskable_interrupts
74.00 ? 29% +209.2% 228.83 ? 35% interrupts.CPU76.PMI:Performance_monitoring_interrupts
842923 ? 21% -84.9% 127258 interrupts.CPU77.LOC:Local_timer_interrupts
68.00 ? 43% +163.0% 178.83 ? 37% interrupts.CPU77.NMI:Non-maskable_interrupts
68.00 ? 43% +163.0% 178.83 ? 37% interrupts.CPU77.PMI:Performance_monitoring_interrupts
843553 ? 21% -84.9% 127140 interrupts.CPU78.LOC:Local_timer_interrupts
844808 ? 21% -84.9% 127198 interrupts.CPU79.LOC:Local_timer_interrupts
844984 ? 21% -85.0% 127143 interrupts.CPU8.LOC:Local_timer_interrupts
85.25 ? 10% +112.9% 181.50 ? 35% interrupts.CPU8.NMI:Non-maskable_interrupts
85.25 ? 10% +112.9% 181.50 ? 35% interrupts.CPU8.PMI:Performance_monitoring_interrupts
843268 ? 21% -84.9% 127179 interrupts.CPU80.LOC:Local_timer_interrupts
844192 ? 21% -84.9% 127351 interrupts.CPU81.LOC:Local_timer_interrupts
844452 ? 21% -84.9% 127190 interrupts.CPU82.LOC:Local_timer_interrupts
844200 ? 21% -84.9% 127268 interrupts.CPU83.LOC:Local_timer_interrupts
842977 ? 21% -84.9% 127353 interrupts.CPU84.LOC:Local_timer_interrupts
842215 ? 20% -84.9% 127210 interrupts.CPU85.LOC:Local_timer_interrupts
842417 ? 20% -84.9% 127221 interrupts.CPU86.LOC:Local_timer_interrupts
842872 ? 21% -84.9% 127134 interrupts.CPU87.LOC:Local_timer_interrupts
606.75 +22.2% 741.17 ? 18% interrupts.CPU88.CAL:Function_call_interrupts
838462 ? 20% -84.8% 127253 interrupts.CPU88.LOC:Local_timer_interrupts
839301 ? 20% -84.8% 127165 interrupts.CPU89.LOC:Local_timer_interrupts
844556 ? 21% -84.9% 127228 interrupts.CPU9.LOC:Local_timer_interrupts
82.25 ? 36% +117.8% 179.17 ? 37% interrupts.CPU9.NMI:Non-maskable_interrupts
82.25 ? 36% +117.8% 179.17 ? 37% interrupts.CPU9.PMI:Performance_monitoring_interrupts
820468 ? 19% -84.5% 127151 interrupts.CPU90.LOC:Local_timer_interrupts
612.50 +17.3% 718.17 ? 10% interrupts.CPU91.CAL:Function_call_interrupts
812463 ? 19% -84.4% 127135 interrupts.CPU91.LOC:Local_timer_interrupts
808629 ? 18% -84.3% 127079 interrupts.CPU92.LOC:Local_timer_interrupts
82.00 ? 32% +98.4% 162.67 ? 30% interrupts.CPU92.NMI:Non-maskable_interrupts
82.00 ? 32% +98.4% 162.67 ? 30% interrupts.CPU92.PMI:Performance_monitoring_interrupts
842454 ? 21% -84.9% 127038 interrupts.CPU93.LOC:Local_timer_interrupts
95.25 ? 15% +109.3% 199.33 ? 36% interrupts.CPU93.NMI:Non-maskable_interrupts
95.25 ? 15% +109.3% 199.33 ? 36% interrupts.CPU93.PMI:Performance_monitoring_interrupts
800628 ? 18% -84.1% 127087 interrupts.CPU94.LOC:Local_timer_interrupts
839969 ? 20% -84.9% 127209 interrupts.CPU95.LOC:Local_timer_interrupts
80675915 ? 20% -84.9% 12211336 interrupts.LOC:Local_timer_interrupts
7823 ? 19% +137.8% 18606 ? 7% interrupts.NMI:Non-maskable_interrupts
7823 ? 19% +137.8% 18606 ? 7% interrupts.PMI:Performance_monitoring_interrupts
1217 ? 35% +53.7% 1871 ? 7% interrupts.RES:Rescheduling_interrupts
545.50 ? 35% -48.4% 281.67 ? 56% interrupts.TLB:TLB_shootdowns
97.10 -37.7 59.38 ? 2% perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
95.80 -37.1 58.68 ? 2% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
95.80 -37.1 58.68 ? 2% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
95.74 -37.1 58.65 ? 2% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
84.61 -30.7 53.95 ? 3% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
83.35 -30.0 53.30 ? 3% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
39.53 ? 13% -23.9 15.61 ? 6% perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
32.33 ? 13% -19.7 12.63 ? 5% perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle
23.41 ? 16% -14.9 8.49 ? 5% perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
23.17 ? 16% -14.8 8.37 ? 5% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
9.46 ? 26% -6.5 2.97 ? 13% perf-profile.calltrace.cycles-pp.clockevents_program_event.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
10.41 ? 6% -6.2 4.22 ? 5% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
42.73 ? 9% -5.5 37.20 ? 6% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
8.98 ? 14% -5.4 3.61 ? 5% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
7.38 ? 30% -5.3 2.05 ? 16% perf-profile.calltrace.cycles-pp.ktime_get.clockevents_program_event.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt
7.19 ? 10% -4.3 2.88 ? 3% perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt
6.31 ? 9% -3.7 2.64 ? 5% perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt
6.14 ? 11% -3.6 2.56 ? 5% perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
5.12 ? 11% -3.4 1.69 ? 7% perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary
4.36 ? 14% -3.0 1.36 ? 10% perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry
4.60 ? 7% -2.3 2.32 ? 9% perf-profile.calltrace.cycles-pp.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
3.32 ? 8% -2.0 1.33 ? 7% perf-profile.calltrace.cycles-pp.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues
2.50 ? 19% -1.9 0.62 ? 45% perf-profile.calltrace.cycles-pp.timekeeping_max_deferment.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle
3.61 ? 9% -1.7 1.90 ? 8% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
2.10 ? 13% -1.3 0.80 ? 9% perf-profile.calltrace.cycles-pp.rebalance_domains.__softirqentry_text_start.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
1.61 ? 29% -1.2 0.38 ? 72% perf-profile.calltrace.cycles-pp.ktime_get_update_offsets_now.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
1.92 ? 16% -1.1 0.85 ? 12% perf-profile.calltrace.cycles-pp.lapic_next_deadline.clockevents_program_event.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt
1.82 ? 17% -1.0 0.84 ? 16% perf-profile.calltrace.cycles-pp.tick_nohz_irq_exit.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
1.75 ? 17% -0.9 0.81 ? 17% perf-profile.calltrace.cycles-pp.ktime_get.tick_nohz_irq_exit.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
1.52 ? 7% -0.9 0.63 ? 9% perf-profile.calltrace.cycles-pp.perf_mux_hrtimer_handler.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt
1.22 ? 15% -0.8 0.40 ? 74% perf-profile.calltrace.cycles-pp.irq_enter_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
1.19 ? 24% -0.7 0.51 ? 75% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_kernel.secondary_startup_64_no_verify
1.30 ? 21% -0.7 0.63 ? 52% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_kernel.secondary_startup_64_no_verify
1.30 ? 21% -0.7 0.63 ? 52% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_kernel.secondary_startup_64_no_verify
1.30 ? 21% -0.7 0.63 ? 52% perf-profile.calltrace.cycles-pp.start_kernel.secondary_startup_64_no_verify
1.14 ? 25% -0.6 0.50 ? 76% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_kernel
0.00 +0.8 0.82 ? 16% perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +0.8 0.82 ? 16% perf-profile.calltrace.cycles-pp.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +0.9 0.88 ? 30% perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +0.9 0.88 ? 30% perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64
0.00 +0.9 0.88 ? 7% perf-profile.calltrace.cycles-pp.simple_recursive_removal.debugfs_remove.blk_mq_debugfs_unregister_hctx.blk_mq_exit_queue.blk_cleanup_queue
0.00 +0.9 0.89 ? 7% perf-profile.calltrace.cycles-pp.debugfs_remove.blk_mq_debugfs_unregister_hctx.blk_mq_exit_queue.blk_cleanup_queue.loop_remove
0.00 +0.9 0.89 ? 7% perf-profile.calltrace.cycles-pp.blk_mq_debugfs_unregister_hctx.blk_mq_exit_queue.blk_cleanup_queue.loop_remove.loop_control_ioctl
0.00 +0.9 0.89 ? 7% perf-profile.calltrace.cycles-pp.blk_mq_exit_queue.blk_cleanup_queue.loop_remove.loop_control_ioctl.__x64_sys_ioctl
0.00 +0.9 0.90 ? 8% perf-profile.calltrace.cycles-pp.blk_cleanup_queue.loop_remove.loop_control_ioctl.__x64_sys_ioctl.do_syscall_64
0.00 +1.0 1.03 ? 8% perf-profile.calltrace.cycles-pp.loop_remove.loop_control_ioctl.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +1.0 1.04 ? 15% perf-profile.calltrace.cycles-pp.__mutex_lock.loop_control_ioctl.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +1.3 1.35 ? 24% perf-profile.calltrace.cycles-pp.delay_tsc.wait_for_xmitr.serial8250_console_putchar.uart_console_write.serial8250_console_write
0.00 +2.6 2.62 ? 8% perf-profile.calltrace.cycles-pp.loop_control_ioctl.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +4.1 4.14 ? 6% perf-profile.calltrace.cycles-pp.mutex_spin_on_owner.__mutex_lock.lo_release.__blkdev_put.blkdev_put
0.00 +4.2 4.18 ? 13% perf-profile.calltrace.cycles-pp.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +4.2 4.22 ? 13% perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +4.3 4.26 ? 7% perf-profile.calltrace.cycles-pp.__mutex_lock.lo_release.__blkdev_put.blkdev_put.blkdev_close
0.00 +4.3 4.26 ? 7% perf-profile.calltrace.cycles-pp.lo_release.__blkdev_put.blkdev_put.blkdev_close.__fput
0.00 +4.3 4.34 ? 7% perf-profile.calltrace.cycles-pp.blkdev_close.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode
0.00 +4.3 4.34 ? 7% perf-profile.calltrace.cycles-pp.blkdev_put.blkdev_close.__fput.task_work_run.exit_to_user_mode_prepare
0.00 +4.3 4.34 ? 7% perf-profile.calltrace.cycles-pp.__blkdev_put.blkdev_put.blkdev_close.__fput.task_work_run
0.00 +4.4 4.40 ? 7% perf-profile.calltrace.cycles-pp.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64
0.00 +4.5 4.51 ? 7% perf-profile.calltrace.cycles-pp.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +5.9 5.86 ? 9% perf-profile.calltrace.cycles-pp.printk.set_capacity_and_notify.cold.loop_set_size.lo_ioctl.blkdev_ioctl
0.00 +5.9 5.86 ? 9% perf-profile.calltrace.cycles-pp.vprintk_emit.printk.set_capacity_and_notify.cold.loop_set_size.lo_ioctl
0.00 +5.9 5.87 ? 9% perf-profile.calltrace.cycles-pp.loop_set_size.lo_ioctl.blkdev_ioctl.block_ioctl.__x64_sys_ioctl
0.00 +5.9 5.87 ? 9% perf-profile.calltrace.cycles-pp.set_capacity_and_notify.cold.loop_set_size.lo_ioctl.blkdev_ioctl.block_ioctl
0.00 +6.0 6.02 ? 9% perf-profile.calltrace.cycles-pp.printk.set_capacity_and_notify.cold.loop_set_size.loop_configure.lo_ioctl
0.00 +6.0 6.02 ? 9% perf-profile.calltrace.cycles-pp.vprintk_emit.printk.set_capacity_and_notify.cold.loop_set_size.loop_configure
0.00 +6.0 6.02 ? 9% perf-profile.calltrace.cycles-pp.loop_set_size.loop_configure.lo_ioctl.blkdev_ioctl.block_ioctl
0.00 +6.0 6.02 ? 9% perf-profile.calltrace.cycles-pp.set_capacity_and_notify.cold.loop_set_size.loop_configure.lo_ioctl.blkdev_ioctl
0.00 +6.0 6.04 ? 9% perf-profile.calltrace.cycles-pp.loop_configure.lo_ioctl.blkdev_ioctl.block_ioctl.__x64_sys_ioctl
0.32 ?100% +6.8 7.11 ? 9% perf-profile.calltrace.cycles-pp.io_serial_in.wait_for_xmitr.serial8250_console_putchar.uart_console_write.serial8250_console_write
0.34 ?100% +8.2 8.54 ? 7% perf-profile.calltrace.cycles-pp.wait_for_xmitr.serial8250_console_putchar.uart_console_write.serial8250_console_write.console_unlock
0.34 ?100% +8.2 8.55 ? 7% perf-profile.calltrace.cycles-pp.serial8250_console_putchar.uart_console_write.serial8250_console_write.console_unlock.vprintk_emit
0.36 ?100% +8.8 9.13 ? 7% perf-profile.calltrace.cycles-pp.uart_console_write.serial8250_console_write.console_unlock.vprintk_emit.printk
0.00 +9.6 9.56 ? 7% perf-profile.calltrace.cycles-pp.serial8250_console_write.console_unlock.vprintk_emit.printk.set_capacity_and_notify.cold
0.00 +10.3 10.35 ? 7% perf-profile.calltrace.cycles-pp.console_unlock.vprintk_emit.printk.set_capacity_and_notify.cold.loop_set_size
0.00 +12.4 12.38 ? 5% perf-profile.calltrace.cycles-pp.lo_ioctl.blkdev_ioctl.block_ioctl.__x64_sys_ioctl.do_syscall_64
0.00 +12.4 12.38 ? 5% perf-profile.calltrace.cycles-pp.block_ioctl.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +12.4 12.38 ? 5% perf-profile.calltrace.cycles-pp.blkdev_ioctl.block_ioctl.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +13.1 13.12 ? 5% perf-profile.calltrace.cycles-pp.memcpy_toio.drm_fb_helper_damage_work.process_one_work.worker_thread.kthread
0.00 +13.5 13.50 ? 5% perf-profile.calltrace.cycles-pp.drm_fb_helper_damage_work.process_one_work.worker_thread.kthread.ret_from_fork
0.00 +14.1 14.12 ? 5% perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
0.00 +14.2 14.21 ? 5% perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
0.13 ?173% +14.7 14.82 ? 5% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
0.13 ?173% +14.7 14.84 ? 5% perf-profile.calltrace.cycles-pp.ret_from_fork
0.00 +15.0 15.00 ? 4% perf-profile.calltrace.cycles-pp.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.31 ?102% +20.6 20.89 ? 5% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.32 ?102% +20.6 20.90 ? 5% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
97.10 -37.7 59.37 ? 2% perf-profile.children.cycles-pp.do_idle
97.10 -37.7 59.38 ? 2% perf-profile.children.cycles-pp.secondary_startup_64_no_verify
97.10 -37.7 59.38 ? 2% perf-profile.children.cycles-pp.cpu_startup_entry
95.80 -37.1 58.68 ? 2% perf-profile.children.cycles-pp.start_secondary
85.82 -31.2 54.60 ? 2% perf-profile.children.cycles-pp.cpuidle_enter
85.76 -31.2 54.58 ? 2% perf-profile.children.cycles-pp.cpuidle_enter_state
36.71 ? 12% -21.8 14.91 ? 5% perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
32.82 ? 12% -19.9 12.91 ? 5% perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
23.84 ? 15% -15.1 8.70 ? 5% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
23.60 ? 15% -15.0 8.58 ? 5% perf-profile.children.cycles-pp.hrtimer_interrupt
10.74 ? 23% -7.3 3.49 ? 13% perf-profile.children.cycles-pp.ktime_get
9.65 ? 25% -6.6 3.02 ? 13% perf-profile.children.cycles-pp.clockevents_program_event
10.68 ? 5% -6.3 4.38 ? 4% perf-profile.children.cycles-pp.__hrtimer_run_queues
9.10 ? 14% -5.5 3.65 ? 5% perf-profile.children.cycles-pp.menu_select
7.37 ? 9% -4.4 2.98 ? 3% perf-profile.children.cycles-pp.tick_sched_timer
6.45 ? 8% -3.7 2.73 ? 5% perf-profile.children.cycles-pp.tick_sched_handle
6.29 ? 10% -3.6 2.66 ? 5% perf-profile.children.cycles-pp.update_process_times
5.18 ? 11% -3.5 1.71 ? 7% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
4.42 ? 13% -3.0 1.38 ? 10% perf-profile.children.cycles-pp.tick_nohz_next_event
4.74 ? 7% -2.3 2.40 ? 9% perf-profile.children.cycles-pp.irq_exit_rcu
3.43 ? 7% -2.0 1.38 ? 6% perf-profile.children.cycles-pp.scheduler_tick
2.52 ? 20% -1.8 0.70 ? 19% perf-profile.children.cycles-pp.timekeeping_max_deferment
3.73 ? 8% -1.7 2.05 ? 7% perf-profile.children.cycles-pp.__softirqentry_text_start
2.16 ? 12% -1.3 0.82 ? 9% perf-profile.children.cycles-pp.rebalance_domains
2.11 ? 16% -1.3 0.83 ? 2% perf-profile.children.cycles-pp.native_irq_return_iret
1.77 ? 13% -1.2 0.60 ? 13% perf-profile.children.cycles-pp.irqtime_account_irq
2.03 ? 15% -1.1 0.89 ? 12% perf-profile.children.cycles-pp.lapic_next_deadline
1.64 ? 28% -1.1 0.53 ? 19% perf-profile.children.cycles-pp.ktime_get_update_offsets_now
1.86 ? 16% -1.0 0.85 ? 16% perf-profile.children.cycles-pp.tick_nohz_irq_exit
1.57 ? 6% -0.9 0.66 ? 8% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
1.36 ? 22% -0.9 0.45 ? 20% perf-profile.children.cycles-pp.calc_global_load_tick
1.39 ? 6% -0.8 0.58 ? 13% perf-profile.children.cycles-pp.sched_clock_cpu
1.22 ? 8% -0.7 0.50 ? 14% perf-profile.children.cycles-pp.native_sched_clock
1.25 ? 16% -0.7 0.54 ? 26% perf-profile.children.cycles-pp.irq_enter_rcu
1.26 ? 20% -0.7 0.56 ? 10% perf-profile.children.cycles-pp.read_tsc
1.18 ? 15% -0.7 0.52 ? 26% perf-profile.children.cycles-pp.tick_irq_enter
1.30 ? 21% -0.6 0.69 ? 33% perf-profile.children.cycles-pp.start_kernel
0.97 ? 31% -0.6 0.38 ? 22% perf-profile.children.cycles-pp._raw_spin_trylock
0.94 ? 14% -0.5 0.46 ? 5% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
0.83 ? 28% -0.5 0.36 ? 20% perf-profile.children.cycles-pp.update_rq_clock
0.72 ? 13% -0.4 0.28 ? 12% perf-profile.children.cycles-pp.get_next_timer_interrupt
0.74 ? 15% -0.4 0.30 ? 20% perf-profile.children.cycles-pp.hrtimer_update_next_event
0.70 ? 6% -0.4 0.26 ? 21% perf-profile.children.cycles-pp.__intel_pmu_enable_all
0.87 ? 17% -0.4 0.45 ? 22% perf-profile.children.cycles-pp.asm_sysvec_irq_work
0.87 ? 17% -0.4 0.45 ? 22% perf-profile.children.cycles-pp.sysvec_irq_work
0.87 ? 17% -0.4 0.45 ? 22% perf-profile.children.cycles-pp.__sysvec_irq_work
0.87 ? 17% -0.4 0.45 ? 22% perf-profile.children.cycles-pp.irq_work_run
0.90 ? 18% -0.4 0.49 ? 19% perf-profile.children.cycles-pp.irq_work_run_list
0.87 ? 17% -0.4 0.46 ? 21% perf-profile.children.cycles-pp.irq_work_single
0.65 ? 8% -0.4 0.27 ? 26% perf-profile.children.cycles-pp.__remove_hrtimer
0.60 ? 12% -0.4 0.23 ? 13% perf-profile.children.cycles-pp.__hrtimer_next_event_base
0.65 ? 11% -0.4 0.28 ? 10% perf-profile.children.cycles-pp.arch_scale_freq_tick
0.68 ? 8% -0.4 0.32 ? 9% perf-profile.children.cycles-pp.run_rebalance_domains
0.50 ? 36% -0.4 0.13 ? 30% perf-profile.children.cycles-pp.do_user_addr_fault
0.52 ? 35% -0.4 0.15 ? 25% perf-profile.children.cycles-pp.asm_exc_page_fault
0.50 ? 36% -0.4 0.14 ? 28% perf-profile.children.cycles-pp.exc_page_fault
0.66 ? 10% -0.3 0.32 ? 9% perf-profile.children.cycles-pp.update_blocked_averages
0.46 ? 38% -0.3 0.12 ? 29% perf-profile.children.cycles-pp.handle_mm_fault
0.60 ? 9% -0.3 0.26 ? 12% perf-profile.children.cycles-pp.hrtimer_next_event_without
0.44 ? 39% -0.3 0.11 ? 29% perf-profile.children.cycles-pp.__handle_mm_fault
1.11 ? 8% -0.3 0.78 ? 5% perf-profile.children.cycles-pp.load_balance
0.48 ? 34% -0.3 0.17 ? 23% perf-profile.children.cycles-pp.arch_cpu_idle_enter
0.43 ? 14% -0.3 0.13 ? 16% perf-profile.children.cycles-pp.call_cpuidle
0.40 ? 20% -0.3 0.10 ? 8% perf-profile.children.cycles-pp.__x64_sys_execve
0.40 ? 20% -0.3 0.10 ? 8% perf-profile.children.cycles-pp.do_execveat_common
0.51 ? 31% -0.3 0.21 ? 22% perf-profile.children.cycles-pp.update_irq_load_avg
0.40 ? 20% -0.3 0.10 ? 8% perf-profile.children.cycles-pp.execve
0.46 ? 36% -0.3 0.17 ? 24% perf-profile.children.cycles-pp.tsc_verify_tsc_adjust
0.34 ? 45% -0.3 0.05 ? 80% perf-profile.children.cycles-pp.do_fault
0.31 ? 48% -0.3 0.03 ?108% perf-profile.children.cycles-pp.filemap_map_pages
0.48 ? 11% -0.3 0.20 ? 26% perf-profile.children.cycles-pp.timerqueue_del
0.56 ? 18% -0.3 0.29 ? 16% perf-profile.children.cycles-pp.rcu_idle_exit
0.41 ? 6% -0.3 0.15 ? 21% perf-profile.children.cycles-pp.enqueue_hrtimer
0.32 ? 19% -0.2 0.08 ? 22% perf-profile.children.cycles-pp.bprm_execve
0.38 ? 6% -0.2 0.14 ? 25% perf-profile.children.cycles-pp.timerqueue_add
0.29 ? 21% -0.2 0.07 ? 30% perf-profile.children.cycles-pp.mmput
0.29 ? 22% -0.2 0.07 ? 30% perf-profile.children.cycles-pp.exit_mmap
0.28 ? 21% -0.2 0.06 ? 51% perf-profile.children.cycles-pp.exec_binprm
0.27 ? 20% -0.2 0.05 ? 73% perf-profile.children.cycles-pp.load_elf_binary
0.34 ? 19% -0.2 0.13 ? 11% perf-profile.children.cycles-pp.trigger_load_balance
0.33 ? 21% -0.2 0.12 ? 13% perf-profile.children.cycles-pp.hrtimer_get_next_event
0.36 ? 13% -0.2 0.15 ? 16% perf-profile.children.cycles-pp.__hrtimer_get_next_event
0.40 ? 22% -0.2 0.20 ? 18% perf-profile.children.cycles-pp.rcu_eqs_exit
0.32 ? 28% -0.2 0.14 ? 28% perf-profile.children.cycles-pp.cpuidle_governor_latency_req
0.19 ? 24% -0.1 0.04 ? 73% perf-profile.children.cycles-pp.tick_sched_do_timer
0.21 ? 23% -0.1 0.07 ? 55% perf-profile.children.cycles-pp.perf_event_task_tick
0.19 ? 25% -0.1 0.05 ? 52% perf-profile.children.cycles-pp.__x64_sys_exit_group
0.19 ? 25% -0.1 0.05 ? 52% perf-profile.children.cycles-pp.do_group_exit
0.26 ? 21% -0.1 0.12 ? 18% perf-profile.children.cycles-pp.rcu_eqs_enter
0.16 ? 29% -0.1 0.03 ?101% perf-profile.children.cycles-pp.timekeeping_advance
0.19 ? 25% -0.1 0.06 ? 50% perf-profile.children.cycles-pp.do_exit
0.16 ? 13% -0.1 0.03 ?100% perf-profile.children.cycles-pp.menu_reflect
0.74 ? 3% -0.1 0.62 ? 7% perf-profile.children.cycles-pp.update_sd_lb_stats
0.22 ? 10% -0.1 0.10 ? 28% perf-profile.children.cycles-pp.rb_next
0.24 ? 27% -0.1 0.12 ? 11% perf-profile.children.cycles-pp.cpumask_next_and
0.24 ? 15% -0.1 0.12 ? 21% perf-profile.children.cycles-pp.nr_iowait_cpu
0.76 ? 3% -0.1 0.65 ? 6% perf-profile.children.cycles-pp.find_busiest_group
0.21 ? 32% -0.1 0.10 ? 40% perf-profile.children.cycles-pp.update_ts_time_stats
0.17 ? 19% -0.1 0.06 ? 47% perf-profile.children.cycles-pp.tick_nohz_tick_stopped
0.16 ? 21% -0.1 0.06 ? 17% perf-profile.children.cycles-pp.__libc_fork
0.14 ? 27% -0.1 0.05 ? 72% perf-profile.children.cycles-pp.get_cpu_device
0.12 ? 25% -0.1 0.03 ?101% perf-profile.children.cycles-pp.do_mmap
0.13 ? 25% -0.1 0.04 ?102% perf-profile.children.cycles-pp.vm_mmap_pgoff
0.12 ? 17% -0.1 0.03 ?101% perf-profile.children.cycles-pp.__do_sys_clone
0.17 ? 28% -0.1 0.08 ? 23% perf-profile.children.cycles-pp.rb_erase
0.18 ? 20% -0.1 0.10 ? 22% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
0.17 ? 29% -0.1 0.09 ? 17% perf-profile.children.cycles-pp.rcu_dynticks_eqs_enter
0.16 ? 9% -0.1 0.08 ? 19% perf-profile.children.cycles-pp.read_counters
0.16 ? 9% -0.1 0.08 ? 19% perf-profile.children.cycles-pp.cmd_stat
0.16 ? 9% -0.1 0.08 ? 19% perf-profile.children.cycles-pp.dispatch_events
0.16 ? 9% -0.1 0.08 ? 19% perf-profile.children.cycles-pp.process_interval
0.16 ? 9% -0.1 0.08 ? 18% perf-profile.children.cycles-pp.__libc_start_main
0.16 ? 9% -0.1 0.08 ? 18% perf-profile.children.cycles-pp.main
0.16 ? 9% -0.1 0.08 ? 18% perf-profile.children.cycles-pp.run_builtin
0.10 ? 17% -0.1 0.03 ?102% perf-profile.children.cycles-pp.copy_process
0.11 ? 27% -0.1 0.04 ? 75% perf-profile.children.cycles-pp.irqentry_exit
0.11 ? 22% -0.1 0.04 ? 73% perf-profile.children.cycles-pp.update_rt_rq_load_avg
0.12 ? 15% -0.1 0.06 ? 48% perf-profile.children.cycles-pp.tick_program_event
0.11 ? 21% -0.1 0.04 ? 78% perf-profile.children.cycles-pp.rb_insert_color
0.24 ? 12% -0.1 0.18 ? 27% perf-profile.children.cycles-pp._raw_spin_lock_irq
0.16 ? 32% -0.1 0.09 ? 16% perf-profile.children.cycles-pp.rcu_dynticks_eqs_exit
0.08 ? 23% -0.1 0.03 ?100% perf-profile.children.cycles-pp.write
0.00 +0.1 0.05 perf-profile.children.cycles-pp.malloc
0.02 ?100% +0.1 0.08 ? 16% perf-profile.children.cycles-pp.enqueue_task_fair
0.00 +0.1 0.06 ? 14% perf-profile.children.cycles-pp.refill_obj_stock
0.00 +0.1 0.06 ? 17% perf-profile.children.cycles-pp.sd_event_run
0.01 ?173% +0.1 0.08 ? 19% perf-profile.children.cycles-pp.obj_cgroup_charge
0.01 ?173% +0.1 0.08 ? 11% perf-profile.children.cycles-pp.update_load_avg
0.00 +0.1 0.07 ? 14% perf-profile.children.cycles-pp.d_add
0.00 +0.1 0.07 ? 26% perf-profile.children.cycles-pp.blk_complete_reqs
0.00 +0.1 0.07 ? 13% perf-profile.children.cycles-pp.simple_lookup
0.00 +0.1 0.07 ? 23% perf-profile.children.cycles-pp.__check_object_size
0.01 ?173% +0.1 0.08 ? 29% perf-profile.children.cycles-pp.try_to_unlazy
0.00 +0.1 0.07 ? 11% perf-profile.children.cycles-pp.blk_mq_init_queue_data
0.00 +0.1 0.07 ? 14% perf-profile.children.cycles-pp.apparmor_file_alloc_security
0.00 +0.1 0.07 ? 16% perf-profile.children.cycles-pp.ep_poll_callback
0.00 +0.1 0.07 ? 21% perf-profile.children.cycles-pp.cp_new_stat
0.00 +0.1 0.07 ? 29% perf-profile.children.cycles-pp.__legitimize_path
0.00 +0.1 0.07 ? 12% perf-profile.children.cycles-pp.recvmsg
0.00 +0.1 0.07 ? 6% perf-profile.children.cycles-pp.pcpu_alloc
0.00 +0.1 0.08 ? 25% perf-profile.children.cycles-pp.path_init
0.01 ?173% +0.1 0.09 ? 16% perf-profile.children.cycles-pp.__cond_resched
0.00 +0.1 0.08 ? 18% perf-profile.children.cycles-pp.ttwu_do_activate
0.00 +0.1 0.08 ? 26% perf-profile.children.cycles-pp.__mod_memcg_lruvec_state
0.00 +0.1 0.08 ? 21% perf-profile.children.cycles-pp.del_gendisk
0.00 +0.1 0.08 ? 21% perf-profile.children.cycles-pp.____sys_recvmsg
0.00 +0.1 0.08 ? 28% perf-profile.children.cycles-pp.lookup_dcache
0.02 ?173% +0.1 0.10 ? 23% perf-profile.children.cycles-pp.__slab_free
0.00 +0.1 0.08 ? 27% perf-profile.children.cycles-pp.d_lookup
0.00 +0.1 0.08 ? 22% perf-profile.children.cycles-pp.schedule_hrtimeout_range_clock
0.00 +0.1 0.08 ? 62% perf-profile.children.cycles-pp.allocate_slab
0.00 +0.1 0.09 ? 28% perf-profile.children.cycles-pp.ahci_single_level_irq_intr
0.00 +0.1 0.09 ? 12% perf-profile.children.cycles-pp.autoremove_wake_function
0.00 +0.1 0.09 ? 26% perf-profile.children.cycles-pp.handle_irq_event_percpu
0.00 +0.1 0.09 ? 26% perf-profile.children.cycles-pp.__handle_irq_event_percpu
0.00 +0.1 0.09 ? 30% perf-profile.children.cycles-pp.___sys_recvmsg
0.00 +0.1 0.09 ? 27% perf-profile.children.cycles-pp.handle_irq_event
0.00 +0.1 0.09 ? 29% perf-profile.children.cycles-pp.handle_edge_irq
0.00 +0.1 0.10 ? 23% perf-profile.children.cycles-pp.__x64_sys_close
0.00 +0.1 0.10 ? 8% perf-profile.children.cycles-pp.memset_erms
0.00 +0.1 0.10 ? 23% perf-profile.children.cycles-pp.call_rcu
0.00 +0.1 0.10 ? 30% perf-profile.children.cycles-pp.__common_interrupt
0.00 +0.1 0.10 ? 57% perf-profile.children.cycles-pp.___d_drop
0.00 +0.1 0.10 ? 27% perf-profile.children.cycles-pp.__sys_recvmsg
0.00 +0.1 0.10 ? 21% perf-profile.children.cycles-pp.ep_poll
0.00 +0.1 0.10 ? 21% perf-profile.children.cycles-pp.read_pages
0.00 +0.1 0.10 ? 14% perf-profile.children.cycles-pp.syscall_return_via_sysret
0.00 +0.1 0.10 ? 58% perf-profile.children.cycles-pp.__d_drop
0.00 +0.1 0.10 ? 22% perf-profile.children.cycles-pp.do_epoll_wait
0.02 ?173% +0.1 0.12 ? 28% perf-profile.children.cycles-pp.mutex_lock
0.00 +0.1 0.11 ? 21% perf-profile.children.cycles-pp.__x64_sys_epoll_wait
0.00 +0.1 0.11 ? 12% perf-profile.children.cycles-pp.blkdev_get_no_open
0.00 +0.1 0.11 ? 12% perf-profile.children.cycles-pp.blk_request_module
0.00 +0.1 0.11 ? 12% perf-profile.children.cycles-pp.loop_probe
0.00 +0.1 0.11 ? 27% perf-profile.children.cycles-pp.__d_alloc
0.00 +0.1 0.11 ? 65% perf-profile.children.cycles-pp.kernfs_iop_lookup
0.00 +0.1 0.11 ? 53% perf-profile.children.cycles-pp.___slab_alloc
0.01 ?173% +0.1 0.12 ? 32% perf-profile.children.cycles-pp.___might_sleep
0.00 +0.1 0.11 ? 14% perf-profile.children.cycles-pp.__entry_text_start
0.00 +0.1 0.11 ? 51% perf-profile.children.cycles-pp.__slab_alloc
0.00 +0.1 0.12 ? 27% perf-profile.children.cycles-pp.asm_common_interrupt
0.00 +0.1 0.12 ? 27% perf-profile.children.cycles-pp.common_interrupt
0.00 +0.1 0.12 ? 14% perf-profile.children.cycles-pp.epoll_wait
0.00 +0.1 0.12 ? 23% perf-profile.children.cycles-pp.evict
0.00 +0.1 0.12 ? 33% perf-profile.children.cycles-pp.vfs_fstat
0.00 +0.1 0.12 ? 15% perf-profile.children.cycles-pp.security_file_alloc
0.00 +0.1 0.13 ? 20% perf-profile.children.cycles-pp.page_cache_ra_unbounded
0.00 +0.1 0.13 ? 26% perf-profile.children.cycles-pp.____sys_sendmsg
0.00 +0.1 0.13 ? 46% perf-profile.children.cycles-pp.alloc_inode
0.00 +0.1 0.13 ? 15% perf-profile.children.cycles-pp.strncpy_from_user
0.00 +0.1 0.14 ? 14% perf-profile.children.cycles-pp.new_inode_pseudo
0.00 +0.1 0.14 ? 19% perf-profile.children.cycles-pp.inode_permission
0.00 +0.1 0.14 ? 26% perf-profile.children.cycles-pp.___sys_sendmsg
0.02 ?173% +0.1 0.15 ? 9% perf-profile.children.cycles-pp.step_into
0.00 +0.1 0.14 ? 11% perf-profile.children.cycles-pp.debugfs_get_inode
0.00 +0.1 0.14 ? 22% perf-profile.children.cycles-pp.sock_sendmsg
0.00 +0.1 0.14 ? 28% perf-profile.children.cycles-pp.__sys_sendmsg
0.00 +0.1 0.14 ? 15% perf-profile.children.cycles-pp.__wake_up_common_lock
0.02 ?173% +0.1 0.16 ? 18% perf-profile.children.cycles-pp.d_alloc
0.00 +0.1 0.14 ? 11% perf-profile.children.cycles-pp.__wake_up_common
0.00 +0.1 0.14 ? 10% perf-profile.children.cycles-pp.new_inode
0.04 ?103% +0.1 0.18 ? 16% perf-profile.children.cycles-pp.d_alloc_parallel
0.00 +0.1 0.15 ? 9% perf-profile.children.cycles-pp.__d_lookup
0.14 ? 25% +0.2 0.30 ? 13% perf-profile.children.cycles-pp.new_sync_read
0.24 ? 13% +0.2 0.40 ? 6% perf-profile.children.cycles-pp.vfs_read
0.24 ? 13% +0.2 0.41 ? 6% perf-profile.children.cycles-pp.ksys_read
0.02 ?100% +0.2 0.20 ? 6% perf-profile.children.cycles-pp.getname_flags
0.02 ?173% +0.2 0.20 ? 38% perf-profile.children.cycles-pp.schedule_idle
0.02 ?100% +0.2 0.21 ? 19% perf-profile.children.cycles-pp.try_to_wake_up
0.00 +0.2 0.19 ? 18% perf-profile.children.cycles-pp.filemap_get_pages
0.00 +0.2 0.20 ? 13% perf-profile.children.cycles-pp.transfer_xor
0.00 +0.2 0.20 ? 14% perf-profile.children.cycles-pp.blkdev_read_iter
0.00 +0.2 0.20 ? 25% perf-profile.children.cycles-pp.__do_sys_newfstat
0.00 +0.2 0.20 ? 14% perf-profile.children.cycles-pp.cpumask_next
0.00 +0.2 0.20 ? 21% perf-profile.children.cycles-pp.d_invalidate
0.00 +0.2 0.22 ? 8% perf-profile.children.cycles-pp.access
0.04 ?100% +0.2 0.28 ? 16% perf-profile.children.cycles-pp.filename_lookup
0.00 +0.2 0.24 ? 16% perf-profile.children.cycles-pp.lookup_one_len
0.02 ?173% +0.2 0.26 ? 18% perf-profile.children.cycles-pp.lookup_fast
0.00 +0.3 0.25 ? 13% perf-profile.children.cycles-pp.filemap_read
0.00 +0.3 0.26 ? 16% perf-profile.children.cycles-pp.start_creating
0.00 +0.3 0.26 ? 11% perf-profile.children.cycles-pp.do_faccessat
0.06 ? 58% +0.3 0.33 ? 13% perf-profile.children.cycles-pp.kmem_cache_free
0.00 +0.3 0.30 ? 14% perf-profile.children.cycles-pp.loop_queue_work
0.00 +0.3 0.30 ? 20% perf-profile.children.cycles-pp.__dentry_kill
0.01 ?173% +0.3 0.31 ? 11% perf-profile.children.cycles-pp.rcu_do_batch
0.04 ?101% +0.3 0.35 ? 20% perf-profile.children.cycles-pp.__lookup_slow
0.03 ?105% +0.3 0.36 ? 12% perf-profile.children.cycles-pp.newidle_balance
0.20 ? 50% +0.3 0.52 ? 14% perf-profile.children.cycles-pp.rcu_core
0.00 +0.3 0.33 ? 29% perf-profile.children.cycles-pp.__fxstat64
0.13 ? 32% +0.3 0.47 ? 10% perf-profile.children.cycles-pp.link_path_walk
0.00 +0.3 0.35 ? 14% perf-profile.children.cycles-pp.kthread_worker_fn
0.00 +0.4 0.36 ? 13% perf-profile.children.cycles-pp.pick_next_task_fair
0.00 +0.4 0.36 ? 13% perf-profile.children.cycles-pp.debugfs_create_files
0.00 +0.4 0.36 ? 13% perf-profile.children.cycles-pp.__debugfs_create_file
0.00 +0.4 0.38 ? 27% perf-profile.children.cycles-pp.open64
0.02 ?173% +0.4 0.41 ? 19% perf-profile.children.cycles-pp.__alloc_file
0.00 +0.4 0.40 ? 6% perf-profile.children.cycles-pp.mnt_get_count
0.02 ?173% +0.4 0.42 ? 19% perf-profile.children.cycles-pp.alloc_empty_file
0.10 ? 24% +0.4 0.50 ? 12% perf-profile.children.cycles-pp.schedule
0.00 +0.4 0.40 ? 12% perf-profile.children.cycles-pp.blk_mq_debugfs_register_hctx
0.00 +0.4 0.41 ? 14% perf-profile.children.cycles-pp.invalidate_bdev
0.00 +0.4 0.41 ? 12% perf-profile.children.cycles-pp.blk_mq_debugfs_register
0.02 ?173% +0.4 0.44 ? 12% perf-profile.children.cycles-pp.dput
0.00 +0.4 0.43 ? 7% perf-profile.children.cycles-pp.mntput_no_expire
0.00 +0.5 0.47 ? 19% perf-profile.children.cycles-pp.__blkdev_get
0.00 +0.5 0.47 ? 19% perf-profile.children.cycles-pp.lo_open
0.00 +0.5 0.47 ? 7% perf-profile.children.cycles-pp.on_each_cpu_cond_mask
0.00 +0.5 0.47 ? 7% perf-profile.children.cycles-pp.smp_call_function_many_cond
0.08 ? 72% +0.5 0.55 ? 14% perf-profile.children.cycles-pp.kmem_cache_alloc
0.00 +0.5 0.49 ? 13% perf-profile.children.cycles-pp.blk_register_queue
0.00 +0.5 0.50 ? 21% perf-profile.children.cycles-pp.osq_lock
0.12 ? 40% +0.5 0.62 ? 13% perf-profile.children.cycles-pp.walk_component
0.01 ?173% +0.5 0.52 ? 17% perf-profile.children.cycles-pp.smp_call_function_single
0.00 +0.5 0.52 ? 16% perf-profile.children.cycles-pp.sync_rcu_exp_select_node_cpus
0.00 +0.5 0.54 ? 14% perf-profile.children.cycles-pp.__device_add_disk
0.15 ? 23% +0.6 0.71 ? 15% perf-profile.children.cycles-pp.__schedule
0.00 +0.6 0.58 ? 15% perf-profile.children.cycles-pp.blkdev_get_by_dev
0.00 +0.6 0.58 ? 15% perf-profile.children.cycles-pp.blkdev_open
0.02 ?173% +0.6 0.64 ? 10% perf-profile.children.cycles-pp.io_serial_out
0.02 ?173% +0.6 0.64 ? 15% perf-profile.children.cycles-pp.do_open
0.02 ?173% +0.6 0.64 ? 13% perf-profile.children.cycles-pp.do_dentry_open
0.03 ?100% +0.6 0.66 ? 10% perf-profile.children.cycles-pp.sys_imageblit
0.03 ?100% +0.6 0.67 ? 10% perf-profile.children.cycles-pp.drm_fb_helper_sys_imageblit
0.00 +0.6 0.64 ? 12% perf-profile.children.cycles-pp.loop_add
0.04 ?100% +0.7 0.70 ? 16% perf-profile.children.cycles-pp.path_lookupat
0.00 +0.7 0.70 ? 16% perf-profile.children.cycles-pp.unit_file_find_dropin_paths
0.03 ?100% +0.7 0.73 ? 8% perf-profile.children.cycles-pp.bit_putcs
0.03 ?100% +0.7 0.74 ? 8% perf-profile.children.cycles-pp.fbcon_putcs
0.02 ?173% +0.7 0.73 ? 8% perf-profile.children.cycles-pp.fbcon_redraw
0.02 ?173% +0.7 0.74 ? 8% perf-profile.children.cycles-pp.lf
0.02 ?173% +0.7 0.74 ? 8% perf-profile.children.cycles-pp.con_scroll
0.02 ?173% +0.7 0.74 ? 8% perf-profile.children.cycles-pp.fbcon_scroll
0.03 ?100% +0.8 0.79 ? 9% perf-profile.children.cycles-pp.vt_console_print
0.00 +0.8 0.83 ? 54% perf-profile.children.cycles-pp.__close
0.00 +0.9 0.89 ? 7% perf-profile.children.cycles-pp.blk_mq_debugfs_unregister_hctx
0.00 +0.9 0.89 ? 7% perf-profile.children.cycles-pp.blk_mq_exit_queue
0.00 +0.9 0.90 ? 8% perf-profile.children.cycles-pp.blk_cleanup_queue
0.00 +0.9 0.91 ? 7% perf-profile.children.cycles-pp.debugfs_remove
0.00 +0.9 0.91 ? 7% perf-profile.children.cycles-pp.simple_recursive_removal
0.00 +1.0 1.03 ? 8% perf-profile.children.cycles-pp.loop_remove
0.00 +1.1 1.14 ? 13% perf-profile.children.cycles-pp.openat64
0.14 ? 63% +1.5 1.61 ? 16% perf-profile.children.cycles-pp.delay_tsc
0.22 ? 24% +1.7 1.88 ? 8% perf-profile.children.cycles-pp.path_openat
0.22 ? 23% +1.7 1.90 ? 8% perf-profile.children.cycles-pp.do_filp_open
0.25 ? 26% +2.0 2.24 ? 8% perf-profile.children.cycles-pp.do_sys_openat2
0.25 ? 26% +2.0 2.24 ? 8% perf-profile.children.cycles-pp.do_sys_open
0.00 +2.6 2.62 ? 8% perf-profile.children.cycles-pp.loop_control_ioctl
0.00 +4.4 4.40 ? 6% perf-profile.children.cycles-pp.lo_release
0.00 +4.5 4.49 ? 6% perf-profile.children.cycles-pp.__blkdev_put
0.00 +4.5 4.49 ? 6% perf-profile.children.cycles-pp.blkdev_close
0.00 +4.5 4.49 ? 6% perf-profile.children.cycles-pp.blkdev_put
0.00 +4.7 4.70 ? 6% perf-profile.children.cycles-pp.__fput
0.00 +4.8 4.79 ? 6% perf-profile.children.cycles-pp.task_work_run
0.01 ?173% +4.8 4.84 ? 6% perf-profile.children.cycles-pp.exit_to_user_mode_prepare
0.01 ?173% +5.0 5.03 ? 4% perf-profile.children.cycles-pp.syscall_exit_to_user_mode
0.00 +5.4 5.41 ? 2% perf-profile.children.cycles-pp.mutex_spin_on_owner
0.00 +6.0 5.95 ? 3% perf-profile.children.cycles-pp.__mutex_lock
0.00 +6.0 6.04 ? 9% perf-profile.children.cycles-pp.loop_configure
0.64 ? 22% +7.1 7.69 ? 8% perf-profile.children.cycles-pp.io_serial_in
0.76 ? 15% +8.1 8.89 ? 7% perf-profile.children.cycles-pp.serial8250_console_putchar
0.79 ? 16% +8.5 9.31 ? 7% perf-profile.children.cycles-pp.wait_for_xmitr
0.80 ? 16% +8.7 9.51 ? 7% perf-profile.children.cycles-pp.uart_console_write
0.82 ? 17% +9.1 9.95 ? 7% perf-profile.children.cycles-pp.serial8250_console_write
0.87 ? 17% +9.9 10.76 ? 7% perf-profile.children.cycles-pp.console_unlock
0.87 ? 17% +11.5 12.34 ? 6% perf-profile.children.cycles-pp.printk
0.87 ? 17% +11.5 12.34 ? 6% perf-profile.children.cycles-pp.vprintk_emit
0.00 +11.9 11.89 ? 6% perf-profile.children.cycles-pp.loop_set_size
0.00 +11.9 11.89 ? 6% perf-profile.children.cycles-pp.set_capacity_and_notify.cold
0.00 +12.4 12.38 ? 5% perf-profile.children.cycles-pp.lo_ioctl
0.00 +12.4 12.38 ? 5% perf-profile.children.cycles-pp.blkdev_ioctl
0.00 +12.4 12.38 ? 5% perf-profile.children.cycles-pp.block_ioctl
0.20 ? 23% +13.3 13.48 ? 5% perf-profile.children.cycles-pp.memcpy_toio
0.20 ? 23% +13.3 13.50 ? 5% perf-profile.children.cycles-pp.drm_fb_helper_damage_work
0.24 ? 15% +13.9 14.12 ? 5% perf-profile.children.cycles-pp.process_one_work
0.24 ? 13% +14.0 14.21 ? 5% perf-profile.children.cycles-pp.worker_thread
0.46 ? 5% +14.4 14.85 ? 5% perf-profile.children.cycles-pp.ret_from_fork
0.43 ? 10% +14.4 14.82 ? 5% perf-profile.children.cycles-pp.kthread
0.00 +15.0 15.00 ? 4% perf-profile.children.cycles-pp.__x64_sys_ioctl
1.63 ? 15% +22.8 24.44 ? 4% perf-profile.children.cycles-pp.do_syscall_64
1.65 ? 15% +22.8 24.49 ? 4% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
9.74 ? 24% -6.7 3.05 ? 14% perf-profile.self.cycles-pp.ktime_get
4.76 ? 13% -2.7 2.02 ? 9% perf-profile.self.cycles-pp.cpuidle_enter_state
2.50 ? 20% -1.8 0.70 ? 18% perf-profile.self.cycles-pp.timekeeping_max_deferment
3.42 ? 34% -1.7 1.70 ? 7% perf-profile.self.cycles-pp.menu_select
2.11 ? 16% -1.3 0.82 ? 2% perf-profile.self.cycles-pp.native_irq_return_iret
1.72 ? 29% -1.2 0.48 ? 21% perf-profile.self.cycles-pp.update_process_times
2.03 ? 15% -1.1 0.89 ? 12% perf-profile.self.cycles-pp.lapic_next_deadline
1.41 ? 27% -1.0 0.41 ? 22% perf-profile.self.cycles-pp.ktime_get_update_offsets_now
1.35 ? 22% -0.9 0.45 ? 20% perf-profile.self.cycles-pp.calc_global_load_tick
1.17 ? 14% -0.8 0.36 ? 18% perf-profile.self.cycles-pp.irqtime_account_irq
1.07 ? 17% -0.8 0.32 ? 19% perf-profile.self.cycles-pp.tick_nohz_next_event
1.19 ? 8% -0.7 0.48 ? 14% perf-profile.self.cycles-pp.native_sched_clock
1.22 ? 20% -0.7 0.54 ? 9% perf-profile.self.cycles-pp.read_tsc
0.97 ? 31% -0.6 0.37 ? 22% perf-profile.self.cycles-pp._raw_spin_trylock
0.94 ? 14% -0.5 0.44 ? 6% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.70 ? 6% -0.4 0.26 ? 21% perf-profile.self.cycles-pp.__intel_pmu_enable_all
0.65 ? 11% -0.4 0.28 ? 10% perf-profile.self.cycles-pp.arch_scale_freq_tick
0.66 ? 10% -0.3 0.32 ? 14% perf-profile.self.cycles-pp.do_idle
0.52 ? 13% -0.3 0.18 ? 14% perf-profile.self.cycles-pp.__hrtimer_next_event_base
0.50 ? 32% -0.3 0.21 ? 22% perf-profile.self.cycles-pp.update_irq_load_avg
0.42 ? 16% -0.3 0.13 ? 16% perf-profile.self.cycles-pp.call_cpuidle
0.43 ? 30% -0.3 0.16 ? 25% perf-profile.self.cycles-pp.tsc_verify_tsc_adjust
0.42 ? 16% -0.2 0.17 ? 14% perf-profile.self.cycles-pp.__hrtimer_run_queues
0.40 ? 23% -0.2 0.16 ? 13% perf-profile.self.cycles-pp.hrtimer_interrupt
0.39 ? 29% -0.2 0.16 ? 29% perf-profile.self.cycles-pp.asm_sysvec_apic_timer_interrupt
0.31 ? 20% -0.2 0.12 ? 12% perf-profile.self.cycles-pp.trigger_load_balance
0.29 ? 17% -0.2 0.11 ? 19% perf-profile.self.cycles-pp.perf_mux_hrtimer_handler
0.26 ? 7% -0.2 0.09 ? 29% perf-profile.self.cycles-pp.timerqueue_add
0.26 ? 11% -0.1 0.12 ? 16% perf-profile.self.cycles-pp.__hrtimer_get_next_event
0.20 ? 25% -0.1 0.07 ? 56% perf-profile.self.cycles-pp.perf_event_task_tick
0.26 ? 10% -0.1 0.12 ? 30% perf-profile.self.cycles-pp.scheduler_tick
0.20 ? 14% -0.1 0.08 ? 24% perf-profile.self.cycles-pp.load_balance
0.15 ? 12% -0.1 0.03 ?100% perf-profile.self.cycles-pp.tick_sched_timer
0.22 ? 8% -0.1 0.10 ? 28% perf-profile.self.cycles-pp.rb_next
0.22 ? 25% -0.1 0.10 ? 27% perf-profile.self.cycles-pp.rcu_eqs_exit
0.23 ? 14% -0.1 0.12 ? 23% perf-profile.self.cycles-pp.nr_iowait_cpu
0.16 ? 13% -0.1 0.05 ? 76% perf-profile.self.cycles-pp.__remove_hrtimer
0.19 ? 35% -0.1 0.08 ? 16% perf-profile.self.cycles-pp.rebalance_domains
0.14 ? 35% -0.1 0.04 ? 75% perf-profile.self.cycles-pp.clockevents_program_event
0.14 ? 28% -0.1 0.04 ? 76% perf-profile.self.cycles-pp.get_cpu_device
0.20 ? 13% -0.1 0.10 ? 21% perf-profile.self.cycles-pp.__softirqentry_text_start
0.16 ? 15% -0.1 0.07 ? 60% perf-profile.self.cycles-pp.timerqueue_del
0.14 ? 23% -0.1 0.05 ? 46% perf-profile.self.cycles-pp.tick_nohz_tick_stopped
0.17 ? 29% -0.1 0.09 ? 21% perf-profile.self.cycles-pp.rcu_dynticks_eqs_enter
0.13 ? 22% -0.1 0.05 ? 78% perf-profile.self.cycles-pp.sched_clock_cpu
0.51 ? 9% -0.1 0.43 ? 8% perf-profile.self.cycles-pp.update_sd_lb_stats
0.13 ? 26% -0.1 0.06 ? 47% perf-profile.self.cycles-pp.get_next_timer_interrupt
0.16 ? 23% -0.1 0.08 ? 20% perf-profile.self.cycles-pp.update_blocked_averages
0.15 ? 36% -0.1 0.08 ? 25% perf-profile.self.cycles-pp.rb_erase
0.15 ? 19% -0.1 0.08 ? 50% perf-profile.self.cycles-pp.sysvec_apic_timer_interrupt
0.14 ? 21% -0.1 0.07 ? 23% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
0.15 ? 32% -0.1 0.08 ? 14% perf-profile.self.cycles-pp.rcu_idle_exit
0.14 ? 31% -0.1 0.07 ? 18% perf-profile.self.cycles-pp.__sysvec_apic_timer_interrupt
0.12 ? 15% -0.1 0.05 ? 49% perf-profile.self.cycles-pp.tick_program_event
0.11 ? 22% -0.1 0.04 ? 73% perf-profile.self.cycles-pp.update_rt_rq_load_avg
0.11 ? 17% -0.1 0.04 ? 80% perf-profile.self.cycles-pp.rb_insert_color
0.15 ? 36% -0.1 0.09 ? 19% perf-profile.self.cycles-pp.rcu_dynticks_eqs_exit
0.10 ? 15% -0.0 0.04 ? 47% perf-profile.self.cycles-pp.tick_nohz_get_sleep_length
0.00 +0.1 0.06 ? 25% perf-profile.self.cycles-pp.apparmor_file_alloc_security
0.00 +0.1 0.07 ? 20% perf-profile.self.cycles-pp.call_rcu
0.00 +0.1 0.07 ? 20% perf-profile.self.cycles-pp.___d_drop
0.01 ?173% +0.1 0.09 ? 28% perf-profile.self.cycles-pp.mutex_lock
0.00 +0.1 0.08 ? 29% perf-profile.self.cycles-pp.cpumask_next
0.02 ?173% +0.1 0.10 ? 23% perf-profile.self.cycles-pp.__slab_free
0.00 +0.1 0.09 ? 7% perf-profile.self.cycles-pp.memset_erms
0.00 +0.1 0.10 ? 14% perf-profile.self.cycles-pp.syscall_return_via_sysret
0.01 ?173% +0.1 0.12 ? 33% perf-profile.self.cycles-pp.___might_sleep
0.00 +0.1 0.12 ? 12% perf-profile.self.cycles-pp.__d_lookup
0.01 ?173% +0.2 0.17 ? 12% perf-profile.self.cycles-pp.kmem_cache_alloc
0.00 +0.2 0.16 ? 17% perf-profile.self.cycles-pp.kmem_cache_free
0.00 +0.2 0.19 ? 13% perf-profile.self.cycles-pp.transfer_xor
0.00 +0.2 0.23 ? 11% perf-profile.self.cycles-pp.mnt_get_count
0.00 +0.5 0.46 ? 8% perf-profile.self.cycles-pp.smp_call_function_many_cond
0.00 +0.5 0.49 ? 21% perf-profile.self.cycles-pp.osq_lock
0.00 +0.5 0.52 ? 17% perf-profile.self.cycles-pp.smp_call_function_single
0.02 ?173% +0.6 0.64 ? 10% perf-profile.self.cycles-pp.io_serial_out
0.03 ?100% +0.6 0.66 ? 10% perf-profile.self.cycles-pp.sys_imageblit
0.14 ? 63% +1.5 1.61 ? 16% perf-profile.self.cycles-pp.delay_tsc
0.00 +1.6 1.57 ? 10% perf-profile.self.cycles-pp.vprintk_emit
0.00 +5.4 5.36 perf-profile.self.cycles-pp.mutex_spin_on_owner
0.64 ? 22% +7.1 7.69 ? 8% perf-profile.self.cycles-pp.io_serial_in
0.20 ? 23% +13.2 13.41 ? 5% perf-profile.self.cycles-pp.memcpy_toio
stress-ng.loop.ops_per_sec
30 +----------------------------------------------------------------------+
| O O O O O O O |
25 |..+. .+. O |
| +. +..+.+..+ |
| : |
20 |-+ : |
| : |
15 |-+ : |
| : |
10 |-+ : |
| : |
| : |
5 |-+ : |
| : |
0 +----------------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
---
0DAY/LKP+ Test Infrastructure Open Source Technology Center
https://lists.01.org/hyperkitty/list/[email protected] Intel Corporation
Thanks,
Oliver Sang