Hello,
kernel test robot noticed a -5.0% regression of unixbench.throughput on:
commit: 3d2f07d039b863082bbc4c9c541ea2b8fa9a5b1a ("sched/rt: Remove default bandwidth control")
git://git.kernel.org/cgit/linux/kernel/git/bristot/linux dl_server_v6_try9
testcase: unixbench
test machine: 36 threads 1 sockets Intel(R) Core(TM) i9-10980XE CPU @ 3.00GHz (Cascade Lake) with 128G memory
parameters:
runtime: 300s
nr_task: 1
test: context1
cpufreq_governor: performance
In addition to that, the commit also has significant impact on the following tests:
+------------------+-------------------------------------------------------------------------------------------+
| testcase: change | stress-ng: stress-ng.mutex.ops_per_sec 142.6% improvement |
| test machine | 64 threads 2 sockets Intel(R) Xeon(R) Gold 6346 CPU @ 3.10GHz (Ice Lake) with 256G memory |
| test parameters | cpufreq_governor=performance |
| | nr_threads=100% |
| | test=mutex |
| | testtime=60s |
+------------------+-------------------------------------------------------------------------------------------+
If you fix the issue in a separate patch/commit (i.e. not just a new version of
the same patch/commit), kindly add following tags
| Reported-by: kernel test robot <[email protected]>
| Closes: https://lore.kernel.org/oe-lkp/[email protected]
Details are as below:
-------------------------------------------------------------------------------------------------->
The kernel config and materials to reproduce are available at:
https://download.01.org/0day-ci/archive/20240408/[email protected]
=========================================================================================
compiler/cpufreq_governor/kconfig/nr_task/rootfs/runtime/tbox_group/test/testcase:
gcc-13/performance/x86_64-rhel-8.3/1/debian-12-x86_64-20240206.cgz/300s/lkp-csl-d02/context1/unixbench
commit:
f8ff3b9eab ("sched/core: Fix picking of tasks for core scheduling with DL server")
3d2f07d039 ("sched/rt: Remove default bandwidth control")
f8ff3b9eab15a5a9 3d2f07d039b863082bbc4c9c541
---------------- ---------------------------
%stddev %change %stddev
\ | \
12.87 -1.0% 12.74 boot-time.dhcp
0.05 ? 2% -0.0 0.04 mpstat.cpu.all.irq%
825446 -5.1% 783024 vmstat.system.cs
10625 ? 9% -54.1% 4873 vmstat.system.in
0.60 ? 74% -71.1% 0.17 ? 86% sched_debug.cfs_rq:/.util_avg.min
950.00 -100.0% 0.00 sched_debug.rt_rq:.rt_runtime.avg
950.00 -100.0% 0.00 sched_debug.rt_rq:.rt_runtime.max
950.00 -100.0% 0.00 sched_debug.rt_rq:.rt_runtime.min
691.03 -5.0% 656.18 unixbench.score
276414 -5.0% 262482 unixbench.throughput
81128149 -5.1% 77020343 unixbench.time.voluntary_context_switches
1.079e+08 -5.1% 1.024e+08 unixbench.workload
1.003e+09 +4.6% 1.05e+09 perf-stat.i.branch-instructions
15693493 -2.1% 15357187 perf-stat.i.branch-misses
829525 -5.0% 788190 perf-stat.i.context-switches
1.86 -6.5% 1.74 perf-stat.i.cpi
7.301e+09 -1.4% 7.199e+09 perf-stat.i.cpu-cycles
4.821e+09 +5.0% 5.064e+09 perf-stat.i.instructions
0.61 +6.3% 0.65 perf-stat.i.ipc
23.04 -5.0% 21.89 perf-stat.i.metric.K/sec
0.12 -4.6% 0.12 perf-stat.overall.MPKI
1.57 -0.1 1.46 perf-stat.overall.branch-miss-rate%
1.51 -6.1% 1.42 perf-stat.overall.cpi
12354 -1.6% 12157 perf-stat.overall.cycles-between-cache-misses
0.66 +6.5% 0.70 perf-stat.overall.ipc
17446 +10.8% 19325 perf-stat.overall.path-length
1.001e+09 +4.6% 1.047e+09 perf-stat.ps.branch-instructions
15661288 -2.2% 15323663 perf-stat.ps.branch-misses
827195 -5.0% 785930 perf-stat.ps.context-switches
7.282e+09 -1.4% 7.179e+09 perf-stat.ps.cpu-cycles
4.808e+09 +5.0% 5.05e+09 perf-stat.ps.instructions
1.882e+12 +5.1% 1.979e+12 perf-stat.total.instructions
10.56 -0.4 10.21 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
10.41 ? 2% -0.3 10.06 perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
10.64 -0.3 10.30 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write
10.17 ? 2% -0.3 9.85 perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
0.84 ? 4% -0.2 0.66 ? 8% perf-profile.calltrace.cycles-pp.update_load_avg.dequeue_entity.dequeue_task_fair.__schedule.schedule
1.60 ? 2% -0.2 1.45 ? 4% perf-profile.calltrace.cycles-pp.llist_add_batch.__smp_call_single_queue.ttwu_queue_wakelist.try_to_wake_up.autoremove_wake_function
1.14 ? 2% +0.1 1.24 ? 5% perf-profile.calltrace.cycles-pp.select_idle_sibling.select_task_rq_fair.select_task_rq.try_to_wake_up.autoremove_wake_function
0.54 ? 3% +0.1 0.67 ? 10% perf-profile.calltrace.cycles-pp.update_curr.dequeue_entity.dequeue_task_fair.__schedule.schedule
1.44 ? 2% +0.2 1.64 ? 4% perf-profile.calltrace.cycles-pp.select_task_rq_fair.select_task_rq.try_to_wake_up.autoremove_wake_function.__wake_up_common
0.00 +0.7 0.72 ? 6% perf-profile.calltrace.cycles-pp.hrtimer_start_range_ns.dl_server_stop.dequeue_task_fair.__schedule.schedule
14.75 ? 2% +0.8 15.59 ? 2% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.read
14.66 ? 2% +0.9 15.52 ? 2% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
11.63 +0.9 12.54 ? 2% perf-profile.calltrace.cycles-pp.pipe_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
12.88 +0.9 13.79 ? 3% perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
12.66 +0.9 13.58 ? 2% perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
5.52 ? 4% +1.2 6.76 ? 6% perf-profile.calltrace.cycles-pp.__schedule.schedule.pipe_read.vfs_read.ksys_read
5.67 ? 4% +1.3 6.93 ? 7% perf-profile.calltrace.cycles-pp.schedule.pipe_read.vfs_read.ksys_read.do_syscall_64
3.07 ? 3% +1.3 4.35 ? 7% perf-profile.calltrace.cycles-pp.dequeue_task_fair.__schedule.schedule.pipe_read.vfs_read
0.00 +1.4 1.35 ? 8% perf-profile.calltrace.cycles-pp.dl_server_stop.dequeue_task_fair.__schedule.schedule.pipe_read
0.00 +1.5 1.48 ? 16% perf-profile.calltrace.cycles-pp.enqueue_dl_entity.dl_server_start.enqueue_task_fair.activate_task.ttwu_do_activate
0.00 +1.5 1.54 ? 15% perf-profile.calltrace.cycles-pp.dl_server_start.enqueue_task_fair.activate_task.ttwu_do_activate.sched_ttwu_pending
4.28 ? 4% +1.7 6.01 ? 5% perf-profile.calltrace.cycles-pp.sched_ttwu_pending.__flush_smp_call_function_queue.flush_smp_call_function_queue.do_idle.cpu_startup_entry
2.19 ? 9% +1.8 4.01 ? 7% perf-profile.calltrace.cycles-pp.enqueue_task_fair.activate_task.ttwu_do_activate.sched_ttwu_pending.__flush_smp_call_function_queue
2.42 ? 9% +1.8 4.24 ? 8% perf-profile.calltrace.cycles-pp.ttwu_do_activate.sched_ttwu_pending.__flush_smp_call_function_queue.flush_smp_call_function_queue.do_idle
2.28 ? 9% +1.8 4.12 ? 7% perf-profile.calltrace.cycles-pp.activate_task.ttwu_do_activate.sched_ttwu_pending.__flush_smp_call_function_queue.flush_smp_call_function_queue
23.30 -1.3 22.03 ? 3% perf-profile.children.cycles-pp.poll_idle
1.82 ? 3% -0.4 1.41 ? 10% perf-profile.children.cycles-pp.update_load_avg
2.90 ? 5% -0.3 2.56 ? 6% perf-profile.children.cycles-pp.schedule_idle
10.42 ? 2% -0.3 10.08 perf-profile.children.cycles-pp.ksys_write
11.48 -0.3 11.14 perf-profile.children.cycles-pp.write
10.20 ? 2% -0.3 9.87 perf-profile.children.cycles-pp.vfs_write
0.67 ? 8% -0.3 0.38 ? 11% perf-profile.children.cycles-pp.__update_load_avg_se
0.68 ? 9% -0.2 0.45 ? 15% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
1.60 ? 2% -0.2 1.45 ? 4% perf-profile.children.cycles-pp.llist_add_batch
0.37 ? 6% -0.1 0.30 ? 12% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
0.25 ? 7% -0.0 0.20 ? 12% perf-profile.children.cycles-pp.perf_rotate_context
0.30 ? 3% -0.0 0.26 ? 6% perf-profile.children.cycles-pp.main
0.20 ? 5% -0.0 0.16 ? 15% perf-profile.children.cycles-pp.tick_nohz_stop_idle
0.12 ? 7% -0.0 0.09 ? 17% perf-profile.children.cycles-pp.__intel_pmu_enable_all
0.10 ? 7% -0.0 0.07 ? 12% perf-profile.children.cycles-pp.entry_SYSCALL_64_safe_stack
0.10 ? 23% +0.0 0.14 ? 15% perf-profile.children.cycles-pp.run_rebalance_domains
0.14 ? 16% +0.1 0.20 ? 6% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
0.09 ? 24% +0.1 0.15 ? 15% perf-profile.children.cycles-pp.update_blocked_averages
0.07 ? 21% +0.1 0.13 ? 20% perf-profile.children.cycles-pp.wake_affine
0.00 +0.1 0.08 ? 29% perf-profile.children.cycles-pp.update_curr_dl_se
0.03 ?100% +0.1 0.12 ? 18% perf-profile.children.cycles-pp.rb_erase
0.02 ?141% +0.1 0.12 ? 18% perf-profile.children.cycles-pp.rb_insert_color
1.16 ? 2% +0.1 1.26 ? 5% perf-profile.children.cycles-pp.select_idle_sibling
0.12 ? 8% +0.2 0.28 ? 14% perf-profile.children.cycles-pp.timerqueue_del
0.00 +0.2 0.17 ? 17% perf-profile.children.cycles-pp.hrtimer_active
0.00 +0.2 0.18 ? 19% perf-profile.children.cycles-pp.get_nohz_timer_target
0.10 ? 13% +0.2 0.28 ? 15% perf-profile.children.cycles-pp.timerqueue_add
1.46 ? 2% +0.2 1.65 ? 4% perf-profile.children.cycles-pp.select_task_rq_fair
0.00 +0.2 0.23 ? 21% perf-profile.children.cycles-pp.__remove_hrtimer
0.47 ? 4% +0.2 0.72 ? 6% perf-profile.children.cycles-pp.update_rq_clock
0.11 ? 12% +0.2 0.36 ? 13% perf-profile.children.cycles-pp.enqueue_hrtimer
0.00 +0.3 0.27 ? 6% perf-profile.children.cycles-pp.task_non_contending
0.40 ? 8% +0.3 0.70 ? 2% perf-profile.children.cycles-pp.read_tsc
0.72 ? 5% +0.5 1.24 ? 4% perf-profile.children.cycles-pp.ktime_get
0.00 +0.7 0.67 ? 13% perf-profile.children.cycles-pp.task_contending
2.11 ? 6% +0.7 2.84 ? 2% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
17.16 ? 2% +0.8 17.94 ? 3% perf-profile.children.cycles-pp.read
0.00 +0.9 0.86 ? 8% perf-profile.children.cycles-pp.__hrtimer_start_range_ns
0.00 +0.9 0.88 ? 8% perf-profile.children.cycles-pp.start_dl_timer
11.70 +0.9 12.60 ? 2% perf-profile.children.cycles-pp.pipe_read
12.88 +0.9 13.80 ? 3% perf-profile.children.cycles-pp.ksys_read
12.67 +0.9 13.59 ? 2% perf-profile.children.cycles-pp.vfs_read
8.25 ? 4% +0.9 9.18 ? 6% perf-profile.children.cycles-pp.__schedule
0.00 +1.0 0.96 ? 13% perf-profile.children.cycles-pp.hrtimer_try_to_cancel
5.69 ? 4% +1.3 6.95 ? 7% perf-profile.children.cycles-pp.schedule
3.08 ? 3% +1.3 4.38 ? 7% perf-profile.children.cycles-pp.dequeue_task_fair
0.00 +1.3 1.33 ? 4% perf-profile.children.cycles-pp.hrtimer_start_range_ns
0.00 +1.4 1.37 ? 8% perf-profile.children.cycles-pp.dl_server_stop
6.78 ? 2% +1.5 8.30 ? 3% perf-profile.children.cycles-pp.flush_smp_call_function_queue
6.08 +1.5 7.62 ? 3% perf-profile.children.cycles-pp.__flush_smp_call_function_queue
0.13 ? 18% +1.6 1.68 ? 8% perf-profile.children.cycles-pp.dl_server_start
4.44 ? 2% +1.6 6.05 ? 4% perf-profile.children.cycles-pp.sched_ttwu_pending
0.00 +1.6 1.62 ? 8% perf-profile.children.cycles-pp.enqueue_dl_entity
2.66 ? 3% +1.6 4.28 ? 7% perf-profile.children.cycles-pp.ttwu_do_activate
2.42 ? 4% +1.6 4.07 ? 6% perf-profile.children.cycles-pp.enqueue_task_fair
2.50 ? 4% +1.6 4.14 ? 7% perf-profile.children.cycles-pp.activate_task
0.65 ? 8% -0.3 0.37 ? 12% perf-profile.self.cycles-pp.__update_load_avg_se
0.73 ? 4% -0.2 0.50 ? 5% perf-profile.self.cycles-pp.sched_ttwu_pending
0.67 ? 10% -0.2 0.44 ? 14% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
1.60 ? 2% -0.1 1.45 ? 4% perf-profile.self.cycles-pp.llist_add_batch
0.62 ? 5% -0.1 0.52 ? 6% perf-profile.self.cycles-pp.do_idle
1.16 ? 4% -0.1 1.08 ? 5% perf-profile.self.cycles-pp.menu_select
0.34 ? 8% -0.1 0.25 ? 9% perf-profile.self.cycles-pp.prepare_task_switch
0.12 ? 19% -0.1 0.05 ? 52% perf-profile.self.cycles-pp.dl_server_start
0.09 ? 9% -0.0 0.06 ? 13% perf-profile.self.cycles-pp.menu_reflect
0.12 ? 7% -0.0 0.09 ? 17% perf-profile.self.cycles-pp.__intel_pmu_enable_all
0.10 ? 7% -0.0 0.07 ? 12% perf-profile.self.cycles-pp.entry_SYSCALL_64_safe_stack
0.12 ? 13% +0.0 0.16 ? 6% perf-profile.self.cycles-pp.cpu_startup_entry
0.13 ? 18% +0.0 0.17 ? 9% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
0.09 ? 26% +0.0 0.14 ? 9% perf-profile.self.cycles-pp.get_jiffies_update
0.05 ? 47% +0.1 0.11 ? 24% perf-profile.self.cycles-pp.wake_affine
0.00 +0.1 0.07 ? 16% perf-profile.self.cycles-pp.enqueue_hrtimer
0.00 +0.1 0.08 ? 37% perf-profile.self.cycles-pp.enqueue_dl_entity
0.02 ? 99% +0.1 0.11 ? 19% perf-profile.self.cycles-pp.rb_erase
0.02 ?142% +0.1 0.11 ? 17% perf-profile.self.cycles-pp.rb_insert_color
0.00 +0.1 0.10 ? 7% perf-profile.self.cycles-pp.hrtimer_start_range_ns
0.49 ? 6% +0.1 0.60 ? 9% perf-profile.self.cycles-pp.update_load_avg
0.06 ? 11% +0.1 0.17 ? 16% perf-profile.self.cycles-pp.timerqueue_add
0.00 +0.1 0.13 ? 14% perf-profile.self.cycles-pp.timerqueue_del
0.00 +0.2 0.15 ? 15% perf-profile.self.cycles-pp.hrtimer_try_to_cancel
0.00 +0.2 0.16 ? 22% perf-profile.self.cycles-pp.get_nohz_timer_target
0.00 +0.2 0.16 ? 21% perf-profile.self.cycles-pp.hrtimer_active
0.00 +0.2 0.21 ? 15% perf-profile.self.cycles-pp.__hrtimer_start_range_ns
0.33 ? 13% +0.2 0.56 ? 11% perf-profile.self.cycles-pp.ktime_get
0.00 +0.2 0.24 ? 6% perf-profile.self.cycles-pp.task_non_contending
0.10 ? 6% +0.3 0.36 ? 11% perf-profile.self.cycles-pp.update_rq_clock
0.23 ? 3% +0.3 0.51 ? 10% perf-profile.self.cycles-pp.enqueue_task_fair
0.40 ? 6% +0.3 0.68 ? 2% perf-profile.self.cycles-pp.read_tsc
2.09 ? 6% +0.7 2.82 ? 2% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
***************************************************************************************************
lkp-icl-2sp7: 64 threads 2 sockets Intel(R) Xeon(R) Gold 6346 CPU @ 3.10GHz (Ice Lake) with 256G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/nr_threads/rootfs/tbox_group/test/testcase/testtime:
gcc-13/performance/x86_64-rhel-8.3/100%/debian-12-x86_64-20240206.cgz/lkp-icl-2sp7/mutex/stress-ng/60s
commit:
f8ff3b9eab ("sched/core: Fix picking of tasks for core scheduling with DL server")
3d2f07d039 ("sched/rt: Remove default bandwidth control")
f8ff3b9eab15a5a9 3d2f07d039b863082bbc4c9c541
---------------- ---------------------------
%stddev %change %stddev
\ | \
4534514 +186.0% 12969011 ? 5% cpuidle..usage
18411 ? 5% +81.5% 33415 ? 11% meminfo.Active
18362 ? 5% +81.7% 33367 ? 11% meminfo.Active(anon)
22481 ? 4% -36.4% 14294 ? 12% perf-c2c.DRAM.remote
30250 ? 4% +56.2% 47240 ? 9% perf-c2c.HITM.local
16753 ? 4% -37.0% 10551 ? 12% perf-c2c.HITM.remote
950.00 -100.0% 0.00 sched_debug.rt_rq:.rt_runtime.avg
950.00 -100.0% 0.00 sched_debug.rt_rq:.rt_runtime.max
950.00 -100.0% 0.00 sched_debug.rt_rq:.rt_runtime.min
39.43 +111.3% 83.32 vmstat.procs.r
408134 +193.9% 1199488 ? 3% vmstat.system.cs
284439 +112.5% 604483 ? 3% vmstat.system.in
6.19 +1.1 7.31 ? 10% mpstat.cpu.all.idle%
9.99 -4.2 5.77 ? 2% mpstat.cpu.all.irq%
0.12 +0.0 0.17 ? 2% mpstat.cpu.all.soft%
0.98 +1.4 2.38 ? 3% mpstat.cpu.all.usr%
9864 ? 15% -69.5% 3010 ? 27% numa-meminfo.node0.Active
9832 ? 15% -69.6% 2985 ? 27% numa-meminfo.node0.Active(anon)
11389 ? 17% +161.9% 29832 ? 11% numa-meminfo.node1.Active
11373 ? 17% +162.1% 29808 ? 11% numa-meminfo.node1.Active(anon)
2314 ? 13% -67.9% 742.93 ? 27% numa-vmstat.node0.nr_active_anon
2314 ? 13% -67.9% 742.93 ? 27% numa-vmstat.node0.nr_zone_active_anon
2592 ? 21% +189.7% 7509 ? 9% numa-vmstat.node1.nr_active_anon
2592 ? 21% +189.7% 7509 ? 9% numa-vmstat.node1.nr_zone_active_anon
4672 ? 5% +74.3% 8146 ? 13% proc-vmstat.nr_active_anon
96076 -3.2% 93034 ? 2% proc-vmstat.nr_mapped
3358 +2.8% 3452 proc-vmstat.nr_page_table_pages
4672 ? 5% +74.3% 8146 ? 13% proc-vmstat.nr_zone_active_anon
15725 ? 3% -8.3% 14426 ? 5% proc-vmstat.pgreuse
184888 ? 4% -54.7% 83747 ? 6% stress-ng.mutex.nanosecs_per_mutex
17960524 +142.6% 43574575 ? 7% stress-ng.mutex.ops
299337 +142.6% 726235 ? 7% stress-ng.mutex.ops_per_sec
11685849 +202.9% 35396491 ? 3% stress-ng.time.involuntary_context_switches
5167 +2.8% 5310 stress-ng.time.percent_of_cpu_this_job_got
3093 +1.2% 3131 stress-ng.time.system_time
21.40 +232.5% 71.14 ? 2% stress-ng.time.user_time
9213570 +196.1% 27278654 ? 4% stress-ng.time.voluntary_context_switches
1.31 +45.0% 1.90 ? 10% perf-stat.i.MPKI
4.026e+09 -22.0% 3.142e+09 perf-stat.i.branch-instructions
0.31 +0.6 0.89 perf-stat.i.branch-miss-rate%
12656494 +96.8% 24903211 ? 2% perf-stat.i.branch-misses
36.65 -15.2 21.46 ? 9% perf-stat.i.cache-miss-rate%
58740401 +88.4% 1.107e+08 ? 3% perf-stat.i.cache-references
419916 +195.4% 1240313 ? 4% perf-stat.i.context-switches
11.28 +37.6% 15.53 ? 2% perf-stat.i.cpi
1.873e+11 +1.3% 1.898e+11 perf-stat.i.cpu-cycles
117555 +126.6% 266333 ? 4% perf-stat.i.cpu-migrations
1.71e+10 -13.4% 1.481e+10 ? 2% perf-stat.i.instructions
0.10 -12.9% 0.08 perf-stat.i.ipc
8.42 +179.7% 23.55 ? 4% perf-stat.i.metric.K/sec
1.26 +26.3% 1.59 ? 9% perf-stat.overall.MPKI
0.31 +0.5 0.79 perf-stat.overall.branch-miss-rate%
36.76 -15.5 21.27 ? 10% perf-stat.overall.cache-miss-rate%
10.96 +17.4% 12.86 perf-stat.overall.cpi
0.09 -14.8% 0.08 perf-stat.overall.ipc
3.958e+09 -22.3% 3.077e+09 perf-stat.ps.branch-instructions
12430945 +96.5% 24425332 ? 2% perf-stat.ps.branch-misses
57673349 +88.5% 1.087e+08 ? 3% perf-stat.ps.cache-references
412967 +195.2% 1219069 ? 4% perf-stat.ps.context-switches
1.842e+11 +1.2% 1.864e+11 perf-stat.ps.cpu-cycles
115616 +126.4% 261770 ? 4% perf-stat.ps.cpu-migrations
1.68e+10 -13.7% 1.45e+10 perf-stat.ps.instructions
1.034e+12 -13.9% 8.899e+11 ? 2% perf-stat.total.instructions
46.30 -46.3 0.00 perf-profile.calltrace.cycles-pp._raw_spin_lock.enqueue_task_rt.__sched_setscheduler._sched_setscheduler.do_sched_setscheduler
45.94 -45.9 0.00 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.enqueue_task_rt.__sched_setscheduler._sched_setscheduler
47.64 -36.8 10.89 perf-profile.calltrace.cycles-pp.enqueue_task_rt.__sched_setscheduler._sched_setscheduler.do_sched_setscheduler.__x64_sys_sched_setscheduler
59.48 -26.2 33.25 perf-profile.calltrace.cycles-pp.__sched_setscheduler._sched_setscheduler.do_sched_setscheduler.__x64_sys_sched_setscheduler.do_syscall_64
59.66 -26.2 33.42 perf-profile.calltrace.cycles-pp._sched_setscheduler.do_sched_setscheduler.__x64_sys_sched_setscheduler.do_syscall_64.entry_SYSCALL_64_after_hwframe
59.77 -25.7 34.03 perf-profile.calltrace.cycles-pp.do_sched_setscheduler.__x64_sys_sched_setscheduler.do_syscall_64.entry_SYSCALL_64_after_hwframe.__sched_setscheduler
59.78 -25.7 34.04 perf-profile.calltrace.cycles-pp.__x64_sys_sched_setscheduler.do_syscall_64.entry_SYSCALL_64_after_hwframe.__sched_setscheduler
64.15 -25.4 38.79 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__sched_setscheduler
64.16 -25.4 38.80 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__sched_setscheduler
64.25 -25.2 39.01 perf-profile.calltrace.cycles-pp.__sched_setscheduler
10.09 -10.1 0.00 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.enqueue_task_rt.activate_task.ttwu_do_activate
9.38 -9.4 0.00 perf-profile.calltrace.cycles-pp._raw_spin_lock.enqueue_task_rt.activate_task.push_rt_task.push_rt_tasks
9.30 -9.3 0.00 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.enqueue_task_rt.activate_task.push_rt_task
8.35 -8.4 0.00 perf-profile.calltrace.cycles-pp.enqueue_task_rt.activate_task.ttwu_do_activate.sched_ttwu_pending.__flush_smp_call_function_queue
8.16 -8.2 0.00 perf-profile.calltrace.cycles-pp._raw_spin_lock.enqueue_task_rt.activate_task.ttwu_do_activate.sched_ttwu_pending
9.69 -7.4 2.31 ? 3% perf-profile.calltrace.cycles-pp.enqueue_task_rt.activate_task.push_rt_task.push_rt_tasks.finish_task_switch
9.99 -6.2 3.77 ? 2% perf-profile.calltrace.cycles-pp.activate_task.push_rt_task.push_rt_tasks.finish_task_switch.__schedule
6.21 ? 3% -4.8 1.41 ? 7% perf-profile.calltrace.cycles-pp.ttwu_do_activate.sched_ttwu_pending.__flush_smp_call_function_queue.__sysvec_call_function_single.sysvec_call_function_single
6.17 -4.8 1.42 ? 5% perf-profile.calltrace.cycles-pp.flush_smp_call_function_queue.do_idle.cpu_startup_entry.start_secondary.common_startup_64
5.38 -4.6 0.78 ? 8% perf-profile.calltrace.cycles-pp.activate_task.ttwu_do_activate.sched_ttwu_pending.__flush_smp_call_function_queue.__sysvec_call_function_single
6.79 -4.2 2.58 ? 2% perf-profile.calltrace.cycles-pp.sched_ttwu_pending.__flush_smp_call_function_queue.__sysvec_call_function_single.sysvec_call_function_single.asm_sysvec_call_function_single
5.25 -3.9 1.32 ? 5% perf-profile.calltrace.cycles-pp.sched_ttwu_pending.__flush_smp_call_function_queue.flush_smp_call_function_queue.do_idle.cpu_startup_entry
5.27 -3.9 1.36 ? 5% perf-profile.calltrace.cycles-pp.__flush_smp_call_function_queue.flush_smp_call_function_queue.do_idle.cpu_startup_entry.start_secondary
5.80 -3.8 2.00 ? 7% perf-profile.calltrace.cycles-pp.asm_sysvec_call_function_single.__sched_setscheduler._sched_setscheduler.do_sched_setscheduler.__x64_sys_sched_setscheduler
5.72 -3.8 1.94 ? 7% perf-profile.calltrace.cycles-pp.__flush_smp_call_function_queue.__sysvec_call_function_single.sysvec_call_function_single.asm_sysvec_call_function_single.__sched_setscheduler
5.72 -3.8 1.94 ? 7% perf-profile.calltrace.cycles-pp.__sysvec_call_function_single.sysvec_call_function_single.asm_sysvec_call_function_single.__sched_setscheduler._sched_setscheduler
5.72 -3.8 1.95 ? 7% perf-profile.calltrace.cycles-pp.sysvec_call_function_single.asm_sysvec_call_function_single.__sched_setscheduler._sched_setscheduler.do_sched_setscheduler
3.10 -2.7 0.45 ? 44% perf-profile.calltrace.cycles-pp.ttwu_do_activate.sched_ttwu_pending.__flush_smp_call_function_queue.flush_smp_call_function_queue.do_idle
3.06 -2.6 0.44 ? 44% perf-profile.calltrace.cycles-pp.activate_task.ttwu_do_activate.sched_ttwu_pending.__flush_smp_call_function_queue.flush_smp_call_function_queue
8.48 -1.8 6.70 ? 3% perf-profile.calltrace.cycles-pp.common_startup_64
8.33 -1.8 6.58 ? 3% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.common_startup_64
8.33 -1.7 6.58 ? 3% perf-profile.calltrace.cycles-pp.start_secondary.common_startup_64
8.33 -1.7 6.58 ? 3% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.common_startup_64
2.12 -1.4 0.74 ? 5% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.sched_ttwu_pending.__flush_smp_call_function_queue.flush_smp_call_function_queue
2.13 -1.4 0.76 ? 5% perf-profile.calltrace.cycles-pp._raw_spin_lock.sched_ttwu_pending.__flush_smp_call_function_queue.flush_smp_call_function_queue.do_idle
2.06 -1.4 0.70 ? 6% perf-profile.calltrace.cycles-pp.enqueue_task_rt.activate_task.ttwu_do_activate.try_to_wake_up.wake_up_q
2.28 -1.0 1.30 ? 3% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.__sched_setscheduler._sched_setscheduler.do_sched_setscheduler
2.28 -0.9 1.41 ? 3% perf-profile.calltrace.cycles-pp._raw_spin_lock.__sched_setscheduler._sched_setscheduler.do_sched_setscheduler.__x64_sys_sched_setscheduler
2.09 -0.7 1.38 ? 4% perf-profile.calltrace.cycles-pp.activate_task.ttwu_do_activate.try_to_wake_up.wake_up_q.futex_wake
2.26 -0.2 2.07 ? 4% perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.wake_up_q.futex_wake.do_futex
0.98 -0.1 0.89 ? 2% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.task_rq_lock.__sched_setscheduler._sched_setscheduler
1.00 +0.0 1.04 perf-profile.calltrace.cycles-pp._raw_spin_lock.task_rq_lock.__sched_setscheduler._sched_setscheduler.do_sched_setscheduler
0.58 +0.0 0.63 ? 4% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.rt_mutex_adjust_pi.__sched_setscheduler._sched_setscheduler.do_sched_setscheduler
0.58 +0.1 0.64 ? 3% perf-profile.calltrace.cycles-pp.rt_mutex_adjust_pi.__sched_setscheduler._sched_setscheduler.do_sched_setscheduler.__x64_sys_sched_setscheduler
0.64 ? 2% +0.1 0.78 ? 21% perf-profile.calltrace.cycles-pp.sysvec_call_function_single.asm_sysvec_call_function_single.finish_task_switch.__schedule.schedule
3.88 +0.2 4.06 perf-profile.calltrace.cycles-pp.finish_task_switch.__schedule.schedule.syscall_exit_to_user_mode.do_syscall_64
1.07 +0.2 1.29 perf-profile.calltrace.cycles-pp.task_rq_lock.__sched_setscheduler._sched_setscheduler.do_sched_setscheduler.__x64_sys_sched_setscheduler
4.25 +0.3 4.52 perf-profile.calltrace.cycles-pp.schedule.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.__sched_setscheduler
0.55 +0.3 0.85 ? 2% perf-profile.calltrace.cycles-pp.schedule.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
4.36 +0.4 4.72 perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.__sched_setscheduler
4.62 ? 3% +0.5 5.14 ? 3% perf-profile.calltrace.cycles-pp.raw_spin_rq_lock_nested.find_lock_lowest_rq.push_rt_task.push_rt_tasks.finish_task_switch
4.62 ? 3% +0.5 5.14 ? 3% perf-profile.calltrace.cycles-pp._raw_spin_lock.raw_spin_rq_lock_nested.find_lock_lowest_rq.push_rt_task.push_rt_tasks
0.00 +0.6 0.56 ? 2% perf-profile.calltrace.cycles-pp.cpupri_find_fitness.find_lowest_rq.select_task_rq_rt.select_task_rq.try_to_wake_up
4.78 +0.6 5.35 perf-profile.calltrace.cycles-pp.__schedule.schedule.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +0.6 0.58 ? 2% perf-profile.calltrace.cycles-pp.find_lowest_rq.select_task_rq_rt.select_task_rq.try_to_wake_up.wake_up_q
0.00 +0.6 0.60 ? 7% perf-profile.calltrace.cycles-pp.push_rt_task.task_woken_rt.ttwu_do_activate.sched_ttwu_pending.__flush_smp_call_function_queue
0.00 +0.6 0.60 ? 7% perf-profile.calltrace.cycles-pp.task_woken_rt.ttwu_do_activate.sched_ttwu_pending.__flush_smp_call_function_queue.__sysvec_call_function_single
0.00 +0.6 0.61 ? 4% perf-profile.calltrace.cycles-pp.push_rt_task.task_woken_rt.ttwu_do_activate.try_to_wake_up.wake_up_q
0.00 +0.6 0.62 ? 4% perf-profile.calltrace.cycles-pp.task_woken_rt.ttwu_do_activate.try_to_wake_up.wake_up_q.futex_wake
0.70 +0.7 1.36 perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +0.7 0.66 ? 3% perf-profile.calltrace.cycles-pp.enqueue_pushable_task.activate_task.ttwu_do_activate.try_to_wake_up.wake_up_q
0.00 +0.7 0.68 ? 2% perf-profile.calltrace.cycles-pp.pick_next_task_rt.__schedule.schedule_idle.do_idle.cpu_startup_entry
2.88 +0.7 3.56 ? 2% perf-profile.calltrace.cycles-pp.push_rt_tasks.finish_task_switch.__schedule.schedule.syscall_exit_to_user_mode
0.00 +0.7 0.71 ? 2% perf-profile.calltrace.cycles-pp.select_task_rq_rt.select_task_rq.try_to_wake_up.wake_up_q.futex_wake
0.62 +0.8 1.42 ? 4% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.try_to_wake_up.wake_up_q.futex_wake
0.62 +0.8 1.44 ? 4% perf-profile.calltrace.cycles-pp._raw_spin_lock.try_to_wake_up.wake_up_q.futex_wake.do_futex
0.00 +0.8 0.82 ? 2% perf-profile.calltrace.cycles-pp.select_task_rq.try_to_wake_up.wake_up_q.futex_wake.do_futex
0.00 +0.9 0.95 ? 2% perf-profile.calltrace.cycles-pp.dequeue_task_rt.push_rt_task.push_rt_tasks.finish_task_switch.__schedule
0.00 +1.0 0.95 ? 17% perf-profile.calltrace.cycles-pp.sysvec_call_function_single.asm_sysvec_call_function_single.finish_task_switch.__schedule.schedule_idle
0.00 +1.0 0.97 ? 17% perf-profile.calltrace.cycles-pp.asm_sysvec_call_function_single.finish_task_switch.__schedule.schedule_idle.do_idle
0.00 +1.0 1.02 ? 2% perf-profile.calltrace.cycles-pp.enqueue_pushable_task.activate_task.push_rt_task.push_rt_tasks.finish_task_switch
0.00 +1.0 1.05 ? 16% perf-profile.calltrace.cycles-pp.finish_task_switch.__schedule.schedule_idle.do_idle.cpu_startup_entry
0.64 ? 2% +1.1 1.72 ? 19% perf-profile.calltrace.cycles-pp.__flush_smp_call_function_queue.__sysvec_call_function_single.sysvec_call_function_single.asm_sysvec_call_function_single.finish_task_switch
0.64 ? 2% +1.1 1.72 ? 19% perf-profile.calltrace.cycles-pp.__sysvec_call_function_single.sysvec_call_function_single.asm_sysvec_call_function_single.finish_task_switch.__schedule
4.92 +1.2 6.12 ? 3% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.double_rq_lock.find_lock_lowest_rq.push_rt_task
1.19 +1.3 2.50 ? 6% perf-profile.calltrace.cycles-pp.__schedule.schedule_idle.do_idle.cpu_startup_entry.start_secondary
1.20 +1.3 2.50 ? 6% perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.common_startup_64
0.00 +1.4 1.36 ? 5% perf-profile.calltrace.cycles-pp.pick_next_task_rt.__schedule.schedule.futex_wait_queue.__futex_wait
4.94 +1.4 6.38 ? 3% perf-profile.calltrace.cycles-pp._raw_spin_lock.double_rq_lock.find_lock_lowest_rq.push_rt_task.push_rt_tasks
4.95 +1.5 6.41 ? 3% perf-profile.calltrace.cycles-pp.double_rq_lock.find_lock_lowest_rq.push_rt_task.push_rt_tasks.finish_task_switch
0.78 +1.6 2.36 ? 4% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle.cpu_startup_entry
0.78 +1.6 2.38 ? 5% perf-profile.calltrace.cycles-pp.cpuidle_enter.cpuidle_idle_call.do_idle.cpu_startup_entry.start_secondary
0.86 +1.7 2.52 ? 4% perf-profile.calltrace.cycles-pp.cpuidle_idle_call.do_idle.cpu_startup_entry.start_secondary.common_startup_64
3.64 +2.0 5.63 ? 3% perf-profile.calltrace.cycles-pp.try_to_wake_up.wake_up_q.futex_wake.do_futex.__x64_sys_futex
3.66 +2.1 5.77 ? 3% perf-profile.calltrace.cycles-pp.wake_up_q.futex_wake.do_futex.__x64_sys_futex.do_syscall_64
0.00 +2.1 2.12 ? 6% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle
0.00 +2.1 2.14 ? 3% perf-profile.calltrace.cycles-pp.cpupri_set.enqueue_task_rt.activate_task.push_rt_task.push_rt_tasks
0.00 +2.3 2.32 ? 4% perf-profile.calltrace.cycles-pp.pick_next_task_rt.__schedule.schedule.__x64_sys_sched_yield.do_syscall_64
0.00 +2.6 2.61 ? 4% perf-profile.calltrace.cycles-pp.enqueue_pushable_task.__schedule.schedule.__x64_sys_sched_yield.do_syscall_64
3.86 +2.7 6.56 ? 2% perf-profile.calltrace.cycles-pp.futex_wake.do_futex.__x64_sys_futex.do_syscall_64.entry_SYSCALL_64_after_hwframe
14.88 +3.0 17.91 perf-profile.calltrace.cycles-pp.push_rt_tasks.finish_task_switch.__schedule.schedule.futex_wait_queue
15.63 +3.1 18.77 perf-profile.calltrace.cycles-pp.finish_task_switch.__schedule.schedule.futex_wait_queue.__futex_wait
0.00 +3.2 3.18 ? 7% perf-profile.calltrace.cycles-pp.pull_rt_task.balance_rt.__schedule.schedule.futex_wait_queue
0.00 +3.2 3.20 ? 7% perf-profile.calltrace.cycles-pp.balance_rt.__schedule.schedule.futex_wait_queue.__futex_wait
0.00 +3.2 3.21 ? 2% perf-profile.calltrace.cycles-pp.cpupri_set.dequeue_rt_stack.dequeue_task_rt.__schedule.schedule
0.00 +3.3 3.26 ? 2% perf-profile.calltrace.cycles-pp.dequeue_rt_stack.dequeue_task_rt.__schedule.schedule.futex_wait_queue
0.00 +3.3 3.34 ? 2% perf-profile.calltrace.cycles-pp.dequeue_task_rt.__schedule.schedule.futex_wait_queue.__futex_wait
0.00 +5.1 5.12 ? 5% perf-profile.calltrace.cycles-pp.pull_rt_task.__sched_setscheduler._sched_setscheduler.do_sched_setscheduler.__x64_sys_sched_setscheduler
2.66 ? 2% +5.1 7.81 ? 2% perf-profile.calltrace.cycles-pp.push_rt_tasks.finish_task_switch.__schedule.schedule.__x64_sys_sched_yield
2.96 ? 2% +5.3 8.28 ? 2% perf-profile.calltrace.cycles-pp.finish_task_switch.__schedule.schedule.__x64_sys_sched_yield.do_syscall_64
20.42 +8.9 29.28 perf-profile.calltrace.cycles-pp.push_rt_task.push_rt_tasks.finish_task_switch.__schedule.schedule
0.91 ? 3% +9.3 10.21 perf-profile.calltrace.cycles-pp.cpupri_set.enqueue_task_rt.__sched_setscheduler._sched_setscheduler.do_sched_setscheduler
1.24 ? 3% +9.4 10.68 perf-profile.calltrace.cycles-pp.dequeue_task_rt.__sched_setscheduler._sched_setscheduler.do_sched_setscheduler.__x64_sys_sched_setscheduler
0.70 ? 5% +9.7 10.40 perf-profile.calltrace.cycles-pp.cpupri_set.dequeue_rt_stack.dequeue_task_rt.__sched_setscheduler._sched_setscheduler
0.72 ? 5% +9.8 10.48 perf-profile.calltrace.cycles-pp.dequeue_rt_stack.dequeue_task_rt.__sched_setscheduler._sched_setscheduler.do_sched_setscheduler
3.72 +10.5 14.22 ? 2% perf-profile.calltrace.cycles-pp.__schedule.schedule.__x64_sys_sched_yield.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +10.5 10.50 ? 2% perf-profile.calltrace.cycles-pp.cpupri_find_fitness.find_lowest_rq.find_lock_lowest_rq.push_rt_task.push_rt_tasks
3.72 ? 2% +10.5 14.24 ? 2% perf-profile.calltrace.cycles-pp.schedule.__x64_sys_sched_yield.do_syscall_64.entry_SYSCALL_64_after_hwframe.__sched_yield
0.00 +10.6 10.56 ? 2% perf-profile.calltrace.cycles-pp.find_lowest_rq.find_lock_lowest_rq.push_rt_task.push_rt_tasks.finish_task_switch
3.98 +10.6 14.58 ? 2% perf-profile.calltrace.cycles-pp.__x64_sys_sched_yield.do_syscall_64.entry_SYSCALL_64_after_hwframe.__sched_yield
4.09 +10.8 14.92 ? 2% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__sched_yield
4.09 +10.8 14.92 ? 2% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__sched_yield
4.15 +10.9 15.08 ? 2% perf-profile.calltrace.cycles-pp.__sched_yield
17.03 +11.3 28.32 perf-profile.calltrace.cycles-pp.__schedule.schedule.futex_wait_queue.__futex_wait.futex_wait
17.04 +11.3 28.35 perf-profile.calltrace.cycles-pp.schedule.futex_wait_queue.__futex_wait.futex_wait.do_futex
17.08 +11.4 28.52 perf-profile.calltrace.cycles-pp.futex_wait_queue.__futex_wait.futex_wait.do_futex.__x64_sys_futex
17.25 +11.9 29.18 perf-profile.calltrace.cycles-pp.__futex_wait.futex_wait.do_futex.__x64_sys_futex.do_syscall_64
17.27 +11.9 29.21 perf-profile.calltrace.cycles-pp.futex_wait.do_futex.__x64_sys_futex.do_syscall_64.entry_SYSCALL_64_after_hwframe
10.08 +12.9 22.99 perf-profile.calltrace.cycles-pp.find_lock_lowest_rq.push_rt_task.push_rt_tasks.finish_task_switch.__schedule
21.13 +14.7 35.78 perf-profile.calltrace.cycles-pp.do_futex.__x64_sys_futex.do_syscall_64.entry_SYSCALL_64_after_hwframe
21.15 +14.7 35.81 perf-profile.calltrace.cycles-pp.__x64_sys_futex.do_syscall_64.entry_SYSCALL_64_after_hwframe
21.90 +15.3 37.24 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
21.91 +15.3 37.25 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
87.96 -68.6 19.31 perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
88.72 -67.6 21.11 perf-profile.children.cycles-pp._raw_spin_lock
70.93 -55.0 15.97 ? 2% perf-profile.children.cycles-pp.enqueue_task_rt
123.91 -51.5 72.44 perf-profile.children.cycles-pp.__sched_setscheduler
59.66 -26.2 33.42 perf-profile.children.cycles-pp._sched_setscheduler
59.78 -25.7 34.03 perf-profile.children.cycles-pp.do_sched_setscheduler
59.78 -25.7 34.04 perf-profile.children.cycles-pp.__x64_sys_sched_setscheduler
23.78 -15.0 8.79 ? 2% perf-profile.children.cycles-pp.activate_task
14.20 -8.7 5.48 ? 2% perf-profile.children.cycles-pp.sched_ttwu_pending
14.74 -8.0 6.78 perf-profile.children.cycles-pp.__flush_smp_call_function_queue
13.57 -7.9 5.67 perf-profile.children.cycles-pp.ttwu_do_activate
6.28 -4.8 1.45 ? 5% perf-profile.children.cycles-pp.flush_smp_call_function_queue
9.38 -4.0 5.40 ? 2% perf-profile.children.cycles-pp.__sysvec_call_function_single
9.40 -4.0 5.44 ? 2% perf-profile.children.cycles-pp.sysvec_call_function_single
9.55 -3.9 5.67 ? 2% perf-profile.children.cycles-pp.asm_sysvec_call_function_single
8.48 -1.8 6.70 ? 3% perf-profile.children.cycles-pp.do_idle
8.48 -1.8 6.70 ? 3% perf-profile.children.cycles-pp.common_startup_64
8.48 -1.8 6.70 ? 3% perf-profile.children.cycles-pp.cpu_startup_entry
8.33 -1.7 6.58 ? 3% perf-profile.children.cycles-pp.start_secondary
0.95 -0.4 0.55 ? 4% perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
0.89 -0.4 0.51 ? 3% perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
0.59 -0.4 0.21 ? 4% perf-profile.children.cycles-pp.update_process_times
0.60 -0.4 0.22 ? 5% perf-profile.children.cycles-pp.tick_nohz_handler
0.61 -0.4 0.24 ? 5% perf-profile.children.cycles-pp.__hrtimer_run_queues
0.64 -0.3 0.30 ? 4% perf-profile.children.cycles-pp.hrtimer_interrupt
0.64 -0.3 0.30 ? 4% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
0.50 -0.3 0.17 ? 5% perf-profile.children.cycles-pp.scheduler_tick
0.42 -0.2 0.18 ? 3% perf-profile.children.cycles-pp.put_prev_task_rt
0.22 ? 10% -0.1 0.15 ? 29% perf-profile.children.cycles-pp.load_balance
0.25 -0.0 0.20 ? 3% perf-profile.children.cycles-pp.__do_softirq
0.32 ? 4% -0.0 0.27 ? 4% perf-profile.children.cycles-pp.__cmd_record
0.21 ? 5% -0.0 0.16 ? 3% perf-profile.children.cycles-pp.perf_session__process_events
0.20 ? 6% -0.0 0.15 perf-profile.children.cycles-pp.process_simple
0.21 ? 5% -0.0 0.16 ? 3% perf-profile.children.cycles-pp.reader__read_event
0.21 ? 5% -0.0 0.16 ? 3% perf-profile.children.cycles-pp.record__finish_output
0.18 ? 5% -0.0 0.14 perf-profile.children.cycles-pp.ordered_events__queue
0.18 ? 5% -0.0 0.14 perf-profile.children.cycles-pp.queue_event
0.26 -0.0 0.23 ? 2% perf-profile.children.cycles-pp.irq_exit_rcu
0.06 ? 6% +0.0 0.09 ? 5% perf-profile.children.cycles-pp.rebalance_domains
0.07 ? 8% +0.0 0.10 ? 8% perf-profile.children.cycles-pp.rseq_get_rseq_cs
0.06 ? 7% +0.0 0.10 ? 5% perf-profile.children.cycles-pp.__get_user_8
0.06 +0.0 0.10 ? 5% perf-profile.children.cycles-pp.___perf_sw_event
0.00 +0.1 0.05 perf-profile.children.cycles-pp.deactivate_task
0.05 +0.1 0.10 ? 8% perf-profile.children.cycles-pp.find_task_by_vpid
0.00 +0.1 0.05 ? 7% perf-profile.children.cycles-pp.blkcg_maybe_throttle_current
0.01 ?223% +0.1 0.06 ? 9% perf-profile.children.cycles-pp.menu_select
0.00 +0.1 0.05 ? 7% perf-profile.children.cycles-pp.os_xsave
0.00 +0.1 0.05 ? 7% perf-profile.children.cycles-pp.plist_add
0.59 +0.1 0.64 ? 3% perf-profile.children.cycles-pp.rt_mutex_adjust_pi
0.00 +0.1 0.06 ? 8% perf-profile.children.cycles-pp.stress_mwc32modn
0.00 +0.1 0.06 ? 6% perf-profile.children.cycles-pp.ct_kernel_exit_state
0.09 ? 8% +0.1 0.14 ? 5% perf-profile.children.cycles-pp.rseq_ip_fixup
0.00 +0.1 0.06 ? 9% perf-profile.children.cycles-pp.cpuacct_charge
0.00 +0.1 0.06 perf-profile.children.cycles-pp.wake_q_add_safe
0.00 +0.1 0.06 ? 6% perf-profile.children.cycles-pp.__radix_tree_lookup
0.09 +0.1 0.15 ? 3% perf-profile.children.cycles-pp.wakeup_preempt
0.07 ? 5% +0.1 0.14 ? 3% perf-profile.children.cycles-pp.__switch_to_asm
0.05 +0.1 0.12 ? 4% perf-profile.children.cycles-pp.native_irq_return_iret
0.05 +0.1 0.12 ? 7% perf-profile.children.cycles-pp.llist_reverse_order
0.00 +0.1 0.07 ? 5% perf-profile.children.cycles-pp.plist_del
0.08 ? 5% +0.1 0.16 ? 3% perf-profile.children.cycles-pp.restore_fpregs_from_fpstate
0.00 +0.1 0.08 ? 6% perf-profile.children.cycles-pp._copy_from_user
0.08 ? 5% +0.1 0.16 ? 5% perf-profile.children.cycles-pp.mutex_exercise
0.00 +0.1 0.08 ? 6% perf-profile.children.cycles-pp.raw_spin_rq_trylock
0.26 +0.1 0.33 ? 3% perf-profile.children.cycles-pp.do_sched_yield
0.05 +0.1 0.13 ? 10% perf-profile.children.cycles-pp.native_sched_clock
0.06 ? 6% +0.1 0.14 ? 5% perf-profile.children.cycles-pp.sched_mm_cid_migrate_to
0.00 +0.1 0.08 ? 8% perf-profile.children.cycles-pp.entry_SYSRETQ_unsafe_stack
0.00 +0.1 0.08 ? 14% perf-profile.children.cycles-pp.syscall_return_via_sysret
0.00 +0.1 0.08 ? 4% perf-profile.children.cycles-pp.pick_task_rt
0.05 +0.1 0.13 ? 8% perf-profile.children.cycles-pp.sched_clock_cpu
0.00 +0.1 0.08 ? 5% perf-profile.children.cycles-pp.__futex_unqueue
0.10 ? 4% +0.1 0.20 ? 4% perf-profile.children.cycles-pp.__rseq_handle_notify_resume
0.13 ? 3% +0.1 0.22 ? 3% perf-profile.children.cycles-pp.update_rq_clock_task
0.02 ?141% +0.1 0.12 ? 9% perf-profile.children.cycles-pp.sched_clock
0.00 +0.1 0.10 ? 14% perf-profile.children.cycles-pp.entry_SYSCALL_64
0.06 +0.1 0.18 ? 4% perf-profile.children.cycles-pp.perf_trace_sched_wakeup_template
0.00 +0.1 0.12 ? 12% perf-profile.children.cycles-pp.irq_work_claim
0.00 +0.1 0.12 ? 4% perf-profile.children.cycles-pp._raw_spin_trylock
0.06 +0.1 0.18 ? 5% perf-profile.children.cycles-pp.update_rq_clock
0.06 ? 7% +0.1 0.18 ? 5% perf-profile.children.cycles-pp.futex_unqueue
0.00 +0.1 0.12 ? 12% perf-profile.children.cycles-pp.irq_work_queue_on
0.06 ? 7% +0.1 0.20 ? 8% perf-profile.children.cycles-pp.__smp_call_single_queue
0.06 +0.1 0.19 ? 4% perf-profile.children.cycles-pp.pthread_mutex_lock
0.10 ? 5% +0.1 0.23 ? 4% perf-profile.children.cycles-pp.update_curr_common
0.01 ?223% +0.1 0.15 ? 9% perf-profile.children.cycles-pp.llist_add_batch
0.01 ?223% +0.1 0.15 ? 6% perf-profile.children.cycles-pp.set_task_cpu
0.00 +0.1 0.14 ? 4% perf-profile.children.cycles-pp.get_futex_key
0.12 ? 4% +0.2 0.28 ? 3% perf-profile.children.cycles-pp.prepare_task_switch
0.20 ? 5% +0.2 0.36 ? 4% perf-profile.children.cycles-pp.irqentry_exit_to_user_mode
0.00 +0.2 0.18 ? 5% perf-profile.children.cycles-pp.resched_curr
0.16 ? 2% +0.2 0.35 ? 3% perf-profile.children.cycles-pp.asm_sysvec_reschedule_ipi
0.08 +0.2 0.27 ? 3% perf-profile.children.cycles-pp.__switch_to
0.42 +0.2 0.62 perf-profile.children.cycles-pp.rto_push_irq_work_func
1.08 +0.2 1.30 perf-profile.children.cycles-pp.task_rq_lock
0.11 ? 4% +0.2 0.34 ? 7% perf-profile.children.cycles-pp.ttwu_queue_wakelist
0.06 ? 7% +0.2 0.30 ? 2% perf-profile.children.cycles-pp.futex_wake_mark
0.05 +0.2 0.29 ? 2% perf-profile.children.cycles-pp.futex_q_lock
0.66 +0.3 0.92 ? 3% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
0.14 ? 3% +0.3 0.44 perf-profile.children.cycles-pp.switch_fpu_return
0.12 ? 5% +0.3 0.43 ? 5% perf-profile.children.cycles-pp.apparmor_capable
0.12 ? 4% +0.3 0.45 ? 5% perf-profile.children.cycles-pp.security_capable
0.13 ? 6% +0.3 0.46 ? 4% perf-profile.children.cycles-pp.capable
0.10 ? 4% +0.4 0.46 ? 2% perf-profile.children.cycles-pp.futex_wait_setup
0.12 ? 4% +0.4 0.50 ? 2% perf-profile.children.cycles-pp.pthread_setschedparam
0.46 +0.4 0.90 ? 3% perf-profile.children.cycles-pp.irq_work_single
5.62 ? 3% +0.5 6.07 ? 3% perf-profile.children.cycles-pp.raw_spin_rq_lock_nested
0.14 ? 3% +0.5 0.69 perf-profile.children.cycles-pp.switch_mm_irqs_off
0.09 ? 4% +0.6 0.71 ? 2% perf-profile.children.cycles-pp.select_task_rq_rt
0.80 ? 2% +0.6 1.44 ? 4% perf-profile.children.cycles-pp.task_woken_rt
0.13 ? 2% +0.7 0.83 ? 2% perf-profile.children.cycles-pp.select_task_rq
90.33 +0.8 91.13 perf-profile.children.cycles-pp.do_syscall_64
90.35 +0.8 91.18 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
0.00 +0.8 0.85 ? 15% perf-profile.children.cycles-pp.__bitmap_and
0.11 ? 4% +1.0 1.08 ? 11% perf-profile.children.cycles-pp._find_first_and_bit
5.16 +1.3 6.42 perf-profile.children.cycles-pp.syscall_exit_to_user_mode
1.22 +1.3 2.55 ? 6% perf-profile.children.cycles-pp.schedule_idle
0.79 +1.6 2.41 ? 4% perf-profile.children.cycles-pp.cpuidle_enter_state
0.80 +1.6 2.42 ? 4% perf-profile.children.cycles-pp.cpuidle_enter
0.88 +1.7 2.57 ? 4% perf-profile.children.cycles-pp.cpuidle_idle_call
5.50 +1.7 7.22 ? 2% perf-profile.children.cycles-pp.double_rq_lock
0.42 +1.7 2.16 ? 5% perf-profile.children.cycles-pp.intel_idle
3.66 +2.0 5.66 ? 3% perf-profile.children.cycles-pp.try_to_wake_up
3.67 +2.1 5.78 ? 3% perf-profile.children.cycles-pp.wake_up_q
3.86 +2.7 6.56 ? 2% perf-profile.children.cycles-pp.futex_wake
0.12 ? 9% +3.1 3.22 ? 7% perf-profile.children.cycles-pp.balance_rt
0.30 ? 4% +4.2 4.49 ? 2% perf-profile.children.cycles-pp.pick_next_task_rt
0.55 ? 3% +5.6 6.12 ? 2% perf-profile.children.cycles-pp.enqueue_pushable_task
0.32 ? 8% +8.0 8.31 ? 5% perf-profile.children.cycles-pp.pull_rt_task
21.52 +8.6 30.08 perf-profile.children.cycles-pp.push_rt_tasks
22.71 +9.3 31.98 perf-profile.children.cycles-pp.push_rt_task
22.84 +9.7 32.50 perf-profile.children.cycles-pp.finish_task_switch
3.98 +10.6 14.58 ? 2% perf-profile.children.cycles-pp.__x64_sys_sched_yield
4.17 +11.0 15.12 ? 2% perf-profile.children.cycles-pp.__sched_yield
17.08 +11.4 28.52 perf-profile.children.cycles-pp.futex_wait_queue
0.45 ? 7% +11.7 12.12 ? 2% perf-profile.children.cycles-pp.cpupri_find_fitness
0.48 ? 6% +11.7 12.18 ? 2% perf-profile.children.cycles-pp.find_lowest_rq
17.26 +11.9 29.18 perf-profile.children.cycles-pp.__futex_wait
17.27 +11.9 29.21 perf-profile.children.cycles-pp.futex_wait
0.92 ? 5% +12.9 13.81 perf-profile.children.cycles-pp.dequeue_rt_stack
11.20 +13.7 24.92 perf-profile.children.cycles-pp.find_lock_lowest_rq
1.80 ? 2% +13.9 15.65 perf-profile.children.cycles-pp.dequeue_task_rt
21.13 +14.7 35.78 perf-profile.children.cycles-pp.do_futex
21.15 +14.7 35.81 perf-profile.children.cycles-pp.__x64_sys_futex
25.78 +22.6 48.33 perf-profile.children.cycles-pp.schedule
27.00 +23.9 50.88 perf-profile.children.cycles-pp.__schedule
2.17 ? 4% +26.0 28.18 perf-profile.children.cycles-pp.cpupri_set
87.95 -68.6 19.31 perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
0.06 -0.0 0.04 ? 44% perf-profile.self.cycles-pp.update_rt_rq_load_avg
0.05 ? 8% +0.0 0.08 ? 5% perf-profile.self.cycles-pp.___perf_sw_event
0.05 ? 8% +0.0 0.09 ? 10% perf-profile.self.cycles-pp.__get_user_8
0.00 +0.1 0.05 perf-profile.self.cycles-pp.blkcg_maybe_throttle_current
0.00 +0.1 0.05 perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
0.00 +0.1 0.05 perf-profile.self.cycles-pp.put_prev_task_rt
0.00 +0.1 0.05 ? 7% perf-profile.self.cycles-pp.os_xsave
0.00 +0.1 0.05 ? 7% perf-profile.self.cycles-pp.stress_mwc32modn
0.00 +0.1 0.05 ? 8% perf-profile.self.cycles-pp.cpuacct_charge
0.00 +0.1 0.06 ? 8% perf-profile.self.cycles-pp.plist_del
0.00 +0.1 0.06 ? 8% perf-profile.self.cycles-pp.wake_q_add_safe
0.00 +0.1 0.06 ? 11% perf-profile.self.cycles-pp.__radix_tree_lookup
0.00 +0.1 0.06 ? 6% perf-profile.self.cycles-pp.ct_kernel_exit_state
0.05 +0.1 0.11 ? 8% perf-profile.self.cycles-pp.llist_reverse_order
0.06 ? 6% +0.1 0.12 ? 5% perf-profile.self.cycles-pp.mutex_exercise
0.07 ? 5% +0.1 0.13 ? 6% perf-profile.self.cycles-pp.__switch_to_asm
0.00 +0.1 0.06 ? 7% perf-profile.self.cycles-pp.do_syscall_64
0.05 +0.1 0.12 ? 4% perf-profile.self.cycles-pp.native_irq_return_iret
0.00 +0.1 0.06 ? 7% perf-profile.self.cycles-pp.update_curr_common
0.00 +0.1 0.07 ? 10% perf-profile.self.cycles-pp._copy_from_user
0.08 ? 4% +0.1 0.15 ? 4% perf-profile.self.cycles-pp.restore_fpregs_from_fpstate
0.05 +0.1 0.12 ? 8% perf-profile.self.cycles-pp.native_sched_clock
0.00 +0.1 0.07 ? 6% perf-profile.self.cycles-pp.entry_SYSRETQ_unsafe_stack
0.00 +0.1 0.07 ? 6% perf-profile.self.cycles-pp.update_rq_clock
0.00 +0.1 0.08 ? 6% perf-profile.self.cycles-pp.__futex_unqueue
0.06 ? 6% +0.1 0.14 ? 5% perf-profile.self.cycles-pp.sched_mm_cid_migrate_to
0.11 +0.1 0.19 ? 4% perf-profile.self.cycles-pp.update_rq_clock_task
0.00 +0.1 0.08 ? 4% perf-profile.self.cycles-pp.pick_task_rt
0.00 +0.1 0.08 ? 8% perf-profile.self.cycles-pp.sched_ttwu_pending
0.02 ? 99% +0.1 0.13 ? 5% perf-profile.self.cycles-pp.perf_trace_sched_wakeup_template
0.01 ?223% +0.1 0.12 ? 8% perf-profile.self.cycles-pp.select_task_rq
0.00 +0.1 0.11 ? 4% perf-profile.self.cycles-pp.wake_up_q
0.04 ? 44% +0.1 0.16 ? 6% perf-profile.self.cycles-pp.pthread_mutex_lock
0.00 +0.1 0.12 ? 8% perf-profile.self.cycles-pp.set_task_cpu
0.00 +0.1 0.12 ? 5% perf-profile.self.cycles-pp._raw_spin_trylock
0.00 +0.1 0.12 ? 12% perf-profile.self.cycles-pp.irq_work_claim
0.00 +0.1 0.12 ? 5% perf-profile.self.cycles-pp.ttwu_queue_wakelist
0.06 ? 6% +0.1 0.18 ? 5% perf-profile.self.cycles-pp.futex_unqueue
0.00 +0.1 0.13 ? 7% perf-profile.self.cycles-pp.select_task_rq_rt
0.07 ? 6% +0.1 0.20 ? 3% perf-profile.self.cycles-pp.prepare_task_switch
0.05 +0.1 0.18 ? 2% perf-profile.self.cycles-pp.finish_task_switch
0.00 +0.1 0.14 ? 6% perf-profile.self.cycles-pp.get_futex_key
0.01 ?223% +0.1 0.15 ? 9% perf-profile.self.cycles-pp.llist_add_batch
0.00 +0.2 0.15 ? 4% perf-profile.self.cycles-pp.futex_wait_queue
0.00 +0.2 0.15 ? 12% perf-profile.self.cycles-pp.irq_work_single
0.05 +0.2 0.20 ? 3% perf-profile.self.cycles-pp.futex_wake_mark
0.11 ? 4% +0.2 0.27 ? 3% perf-profile.self.cycles-pp.find_lock_lowest_rq
0.00 +0.2 0.17 ? 4% perf-profile.self.cycles-pp.resched_curr
0.00 +0.2 0.18 ? 2% perf-profile.self.cycles-pp.dequeue_rt_stack
0.08 ? 4% +0.2 0.26 ? 3% perf-profile.self.cycles-pp.__switch_to
0.00 +0.2 0.20 ? 11% perf-profile.self.cycles-pp.newidle_balance
0.00 +0.2 0.20 perf-profile.self.cycles-pp.futex_q_lock
0.64 +0.2 0.85 ? 3% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.09 ? 4% +0.2 0.30 ? 5% perf-profile.self.cycles-pp.futex_wake
0.05 +0.2 0.29 ? 3% perf-profile.self.cycles-pp.switch_fpu_return
0.01 ?223% +0.3 0.26 ? 3% perf-profile.self.cycles-pp.syscall_exit_to_user_mode
0.05 +0.3 0.31 perf-profile.self.cycles-pp.__flush_smp_call_function_queue
0.11 ? 4% +0.3 0.42 ? 4% perf-profile.self.cycles-pp.apparmor_capable
0.24 ? 2% +0.3 0.57 ? 5% perf-profile.self.cycles-pp.__sched_setscheduler
0.08 +0.3 0.42 ? 3% perf-profile.self.cycles-pp.pthread_setschedparam
0.07 ? 6% +0.4 0.43 ? 4% perf-profile.self.cycles-pp.push_rt_task
0.00 +0.4 0.40 ? 5% perf-profile.self.cycles-pp.try_to_wake_up
0.00 +0.4 0.41 ? 2% perf-profile.self.cycles-pp.do_sched_setscheduler
0.14 ? 4% +0.5 0.68 perf-profile.self.cycles-pp.switch_mm_irqs_off
0.19 +0.7 0.90 perf-profile.self.cycles-pp.__schedule
0.59 +0.8 1.36 ? 9% perf-profile.self.cycles-pp.enqueue_task_rt
0.00 +0.8 0.85 ? 15% perf-profile.self.cycles-pp.__bitmap_and
0.11 ? 5% +1.0 1.07 ? 11% perf-profile.self.cycles-pp._find_first_and_bit
0.76 +1.1 1.84 perf-profile.self.cycles-pp._raw_spin_lock
0.10 ? 4% +1.6 1.73 ? 2% perf-profile.self.cycles-pp.dequeue_task_rt
0.42 +1.7 2.16 ? 5% perf-profile.self.cycles-pp.intel_idle
0.26 ? 5% +4.1 4.36 ? 2% perf-profile.self.cycles-pp.pick_next_task_rt
0.53 ? 3% +5.5 6.06 ? 2% perf-profile.self.cycles-pp.enqueue_pushable_task
0.31 ? 8% +7.4 7.68 ? 5% perf-profile.self.cycles-pp.pull_rt_task
0.31 ? 9% +9.9 10.20 ? 2% perf-profile.self.cycles-pp.cpupri_find_fitness
2.16 ? 4% +26.0 28.17 perf-profile.self.cycles-pp.cpupri_set
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
--
0-DAY CI Kernel Test Service
https://github.com/intel/lkp-tests/wiki