LinuxLists.cc - [linus:master] [sched/fair] 86bfbb7ce4: fxmark.ssd_ext4_dbench_client_2

2023-09-19 07:09:21

Subject: [linus:master] [sched/fair] 86bfbb7ce4: fxmark.ssd_ext4_dbench_client_2_directio.works/sec -15.5% regression

Hello,

kernel test robot

commit: 86bfbb7ce4f67a88df
Details are as below:
--------------------------

The kernel config noticed a -15.5% regression of fxmark.ssd_ext4_dbench_client_2_directio.works/sec on:
2639198169b685668e7349 ("sched/fair: Add lag based placement")
el.org/cgit/linux/kernel/git/torvalds/linux.git">https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
threads 2 sockets Intel(R) Xeon(R) Platinum 8358 CPU @ 2.60GHz (Ice Lake) with 128G memory
the commit also has significant impact on the following tests:
------------------------------------------------------------------------------------------------+
| will-it-scale: will-it-scale.per_process_ops 24.7% improvement |
| 224 threads 4 sockets Intel(R) Xeon(R) Platinum 8380H CPU @ 2.90GHz (Cooper Lake) with 192G memory |
| cpufreq_governor=performance |
|
|
| test=context_switch1 |
------------------------------------------------------------------------------------------------+
| filebench: filebench.sum_operations/s 1.7% improvement |
| 96 threads 2 sockets (Ice Lake) with 128G memory |
| cpufreq_governor=performance |
|
|
|
|
------------------------------------------------------------------------------------------------+
| netperf: netperf.Throughput_Mbps -56.6% regression |
| 96 threads 2 sockets Intel(R) Xeon(R) Platinum 8260L CPU @ 2.40GHz (Cascade Lake) with 128G memory |
| cluster=cs-localhost |
| cpufreq_governor=performance |
|
|
|
|
------------------------------------------------------------------------------------------------+
in a separate patch/commit (i.e. not just a new version of
kindly add following tags
test robot <[email protected]>
//lore.kernel.org/oe-lkp/202309191404.2d18793e-oliver.sang@intel.com">https://lore.kernel.org/oe-lkp/[email protected]
------------------------------------------------------------------------>
and materials to reproduce are available at:
.01.org/0day-ci/archive/20230919/202309191404.2d18793e-oliver.sang@intel.com">https://download.01.org/0day-ci/archive/20230919/[email protected]
===============================================================
directio/disk/fstype/kconfig/media/rootfs/tbox_group/test/testcase:
tio/1SSD/ext4/x86_64-rhel-8.3/ssd/debian-11.1-x86_64-20220510.cgz/lkp-icl-2sp5/dbench_client/fxmark
Remove sched_feat(START_DEBIT)")
Add lag based placement")
86bfbb7ce4f67a88df263919816
---------------------------
%stddev
\
-7.9% 964.83 ? 5% perf-c2c.HITM.local
-7.4% 42090 ? 2% vmstat.system.cs
-5.5% 14.71 iostat.cpu.system
3.66 ? 2% iostat.cpu.user
-3.5% 52031 proc-vmstat.nr_active_file
-3.5% 52031 proc-vmstat.nr_zone_active_file
0.16 ? 12% perf-profile.children.cycles-pp.trigger_load_balance
0.24 ? 13% perf-profile.children.cycles-pp.task_tick_mm_cid
0.42 ? 10% perf-profile.self.cycles-pp.perf_mux_hrtimer_handler
0.15 ? 16% perf-profile.self.cycles-pp.trigger_load_balance
0.24 ? 13% perf-profile.self.cycles-pp.task_tick_mm_cid
-7.5% 41945 ? 2% perf-stat.i.context-switches
1716 ? 2% perf-stat.i.cpu-migrations
0.61 ? 3% perf-stat.i.node-load-miss-rate%
-7.4% 41921 ? 2% perf-stat.ps.context-switches
1714 ? 2% perf-stat.ps.cpu-migrations
0.07 ? 42% perf-sched.sch_delay.avg.ms.io_schedule.bit_wait_io.__wait_on_bit_lock.out_of_line_wait_on_bit_lock
0.12 ? 22% perf-sched.sch_delay.avg.ms.smpboot_thread_fn.kthread.ret_from_fork.ret_from_fork_asm
7.84 ? 49% perf-sched.sch_delay.max.ms.io_schedule.bit_wait_io.__wait_on_bit_lock.out_of_line_wait_on_bit_lock
0.22 ? 40% perf-sched.sch_delay.max.ms.io_schedule.folio_wait_bit_common.filemap_fault.__do_fault
2.31 ?114% perf-sched.sch_delay.max.ms.schedule_timeout.rcu_gp_fqs_loop.rcu_gp_kthread.kthread
7.02 ? 31% perf-sched.sch_delay.max.ms.smpboot_thread_fn.kthread.ret_from_fork.ret_from_fork_asm
0.21 ?152% perf-sched.sch_delay.max.ms.start_this_handle.jbd2_journal_start_reserved.__ext4_journal_start_reserved.ext4_convert_unwritten_io_end_vec
6.47 ? 41% perf-sched.sch_delay.max.ms.worker_thread.kthread.ret_from_fork.ret_from_fork_asm
0.06 ? 3% perf-sched.total_sch_delay.average.ms
3524 ? 25% perf-sched.total_wait_and_delay.max.ms
3524 ? 25% perf-sched.total_wait_time.max.ms
2.84 ? 8% perf-sched.wait_and_delay.avg.ms.io_schedule.bit_wait_io.__wait_on_bit.out_of_line_wait_on_bit
28.42 ? 40% perf-sched.wait_and_delay.max.ms.io_schedule.bit_wait_io.__wait_on_bit_lock.out_of_line_wait_on_bit_lock
1.13 ? 51% perf-sched.wait_time.avg.ms.__cond_resched.kmem_cache_alloc.alloc_buffer_head.folio_alloc_buffers.folio_create_empty_buffers
2.73 ? 9% perf-sched.wait_time.avg.ms.io_schedule.bit_wait_io.__wait_on_bit.out_of_line_wait_on_bit
26.89 ? 37% perf-sched.wait_time.max.ms.io_schedule.bit_wait_io.__wait_on_bit_lock.out_of_line_wait_on_bit_lock
+8.4e+08% 1.341e+12 ? 27% sched_debug.cfs_rq:/.avg_vruntime.max
-9.3e+08% -1.286e+12 sched_debug.cfs_rq:/.avg_vruntime.min
+1e+10% 4.758e+11 ? 11% sched_debug.cfs_rq:/.avg_vruntime.stddev
0.77 ? 24% sched_debug.cfs_rq:/.h_nr_running.avg
1.64 ? 15% sched_debug.cfs_rq:/.h_nr_running.max
+1.8e+09% 9.877e+10 ? 64% sched_debug.cfs_rq:/.left_vruntime.stddev
1875 ? 8% sched_debug.cfs_rq:/.load_avg.avg
14201 ? 3% sched_debug.cfs_rq:/.load_avg.max
3294 ? 7% sched_debug.cfs_rq:/.load_avg.stddev
+8.4e+08% 1.341e+12 ? 27% sched_debug.cfs_rq:/.min_vruntime.max
-9.3e+08% -1.286e+12 sched_debug.cfs_rq:/.min_vruntime.min
+1e+10% 4.758e+11 ? 11% sched_debug.cfs_rq:/.min_vruntime.stddev
0.57 ? 13% sched_debug.cfs_rq:/.nr_running.avg
1.41 ? 12% sched_debug.cfs_rq:/.nr_running.max
+1.8e+09% 9.877e+10 ? 64% sched_debug.cfs_rq:/.right_vruntime.stddev
0.76 ? 26% sched_debug.cpu.nr_running.avg
1.64 ? 15% sched_debug.cpu.nr_running.max
-10.8% 1122186 ? 5% sched_debug.cpu.nr_switches.max
-62.4% -170.37 sched_debug.cpu.nr_uninterruptible.avg
274.83 ? 99% sched_debug.cpu.nr_uninterruptible.max
+300.0% 1.172e+08 sched_debug.sysctl_sched.sysctl_sched_features
+10.9% 571.52 fxmark.ssd_ext4_dbench_client_18_directio.idle_sec
52.89 fxmark.ssd_ext4_dbench_client_18_directio.idle_util
-14.4% 304.50 fxmark.ssd_ext4_dbench_client_18_directio.iowait_sec
28.18 fxmark.ssd_ext4_dbench_client_18_directio.iowait_util
-9.1% 17.06 fxmark.ssd_ext4_dbench_client_2_directio.idle_sec
59.62 fxmark.ssd_ext4_dbench_client_2_directio.iowait_sec
50.30 fxmark.ssd_ext4_dbench_client_2_directio.iowait_util
2.38 fxmark.ssd_ext4_dbench_client_2_directio.irq_sec
2.01 fxmark.ssd_ext4_dbench_client_2_directio.irq_util
1.16 fxmark.ssd_ext4_dbench_client_2_directio.softirq_sec
0.97 fxmark.ssd_ext4_dbench_client_2_directio.softirq_util
29.05 ? 2% fxmark.ssd_ext4_dbench_client_2_directio.sys_sec
24.51 ? 2% fxmark.ssd_ext4_dbench_client_2_directio.sys_util
9.26 ? 3% fxmark.ssd_ext4_dbench_client_2_directio.user_sec
7.81 ? 3% fxmark.ssd_ext4_dbench_client_2_directio.user_util
-15.5% 842.40 ? 3% fxmark.ssd_ext4_dbench_client_2_directio.works/sec
71.27 fxmark.ssd_ext4_dbench_client_4_directio.idle_sec
29.87 fxmark.ssd_ext4_dbench_client_4_directio.idle_util
3.52 fxmark.ssd_ext4_dbench_client_4_directio.irq_sec
1.48 fxmark.ssd_ext4_dbench_client_4_directio.irq_util
1.86 fxmark.ssd_ext4_dbench_client_4_directio.softirq_sec
0.78 fxmark.ssd_ext4_dbench_client_4_directio.softirq_util
46.85 ? 2% fxmark.ssd_ext4_dbench_client_4_directio.sys_sec
19.64 ? 2% fxmark.ssd_ext4_dbench_client_4_directio.sys_util
14.62 ? 2% fxmark.ssd_ext4_dbench_client_4_directio.user_sec
6.13 ? 2% fxmark.ssd_ext4_dbench_client_4_directio.user_util
69214 ? 12% fxmark.time.involuntary_context_switches
*************************************************************************
threads 4 sockets Intel(R) Xeon(R) Platinum 8380H CPU @ 2.90GHz (Cooper Lake) with 192G memory
===============================================================
kconfig/mode/nr_task/rootfs/tbox_group/test/testcase:
4-rhel-8.3/process/100%/debian-11.1-x86_64-20220510.cgz/lkp-cpl-4sp2/context_switch1/will-it-scale
Remove sched_feat(START_DEBIT)")
Add lag based placement")
86bfbb7ce4f67a88df263919816
---------------------------
%stddev
\
+1.4% 28.28 boot-time.dhcp
+2.2% 18.21 turbostat.RAMWatt
0.02 ? 2% mpstat.cpu.all.soft%
11.24 mpstat.cpu.all.usr%
+94.7% 3093024 ? 3% numa-numastat.node3.local_node
+86.2% 3170127 ? 4% numa-numastat.node3.numa_hit
77335 ? 42% numa-numastat.node3.other_node
+60.9% 12534430 ? 3% vmstat.memory.cache
+15.3% 337.00 vmstat.procs.r
+24.2% 1.05e+08 vmstat.system.cs
+24.7% 1.07e+08 will-it-scale.224.processes
+24.7% 477602 will-it-scale.per_process_ops
+24.7% 1.07e+08 will-it-scale.workload
-60.8% 203.00 ? 29% perf-c2c.DRAM.local
10723 ? 35% perf-c2c.HITM.local
-28.9% 202.67 ? 24% perf-c2c.HITM.remote
10925 ? 34% perf-c2c.HITM.total
+162.6% 5415996 meminfo.Active
+162.6% 5415916 meminfo.Active(anon)
+62.1% 12333478 ? 3% meminfo.Cached
+15.9% 34422163 meminfo.Committed_AS
+42.2% 4628412 ? 8% meminfo.Inactive
+42.2% 4628232 ? 8% meminfo.Inactive(anon)
+46.0% 1963698 ? 8% meminfo.Mapped
+44.2% 15020958 ? 2% meminfo.Memused
+100.2% 9444812 ? 4% meminfo.Shmem
+44.9% 16150456 ? 2% meminfo.max_used_kB
12303 ? 10% numa-vmstat.node0.nr_kernel_stack
24235 ? 4% numa-vmstat.node0.nr_mapped
1826 ? 13% numa-vmstat.node0.nr_shmem
-99.2% 256.67 ? 90% numa-vmstat.node1.nr_active_anon
10228 ? 3% numa-vmstat.node1.nr_kernel_stack
29518 ? 10% numa-vmstat.node1.nr_mapped
-98.7% 414.33 ? 88% numa-vmstat.node1.nr_shmem
21365 ? 3% numa-vmstat.node1.nr_slab_unreclaimable
-99.2% 256.67 ? 90% numa-vmstat.node1.nr_zone_active_anon
+188.7% 1354332 numa-vmstat.node3.nr_active_anon
+108.8% 2358542 ? 4% numa-vmstat.node3.nr_file_pages
-11.1% 9830943 numa-vmstat.node3.nr_free_pages
+48.7% 1055523 ? 10% numa-vmstat.node3.nr_inactive_anon
+78.5% 408834 ? 9% numa-vmstat.node3.nr_mapped
+108.8% 2358253 ? 4% numa-vmstat.node3.nr_shmem
+188.7% 1354330 numa-vmstat.node3.nr_zone_active_anon
+48.7% 1055522 ? 10% numa-vmstat.node3.nr_zone_inactive_anon
+86.2% 3170187 ? 4% numa-vmstat.node3.numa_hit
+94.7% 3093085 ? 3% numa-vmstat.node3.numa_local
77335 ? 42% numa-vmstat.node3.numa_other
+161.9% 1353199 proc-vmstat.nr_active_anon
-2.5% 4514455 proc-vmstat.nr_dirty_background_threshold
-2.5% 9039950 proc-vmstat.nr_dirty_threshold
+62.1% 3083178 ? 3% proc-vmstat.nr_file_pages
-2.5% 45391452 proc-vmstat.nr_free_pages
+42.5% 1157608 ? 8% proc-vmstat.nr_inactive_anon
+46.2% 491211 ? 8% proc-vmstat.nr_mapped
+1.8% 17155 proc-vmstat.nr_page_table_pages
+100.1% 2361011 ? 4% proc-vmstat.nr_shmem
+5.5% 48350 proc-vmstat.nr_slab_reclaimable
+161.9% 1353199 proc-vmstat.nr_zone_active_anon
+42.5% 1157608 ? 8% proc-vmstat.nr_zone_inactive_anon
995994 ? 7% proc-vmstat.numa_hint_faults
810972 ? 8% proc-vmstat.numa_hint_faults_local
+48.2% 4059353 ? 2% proc-vmstat.numa_hit
+55.5% 3711759 ? 3% proc-vmstat.numa_local
+59.5% 1351057 ? 5% proc-vmstat.numa_pte_updates
+102.8% 2655907 ? 3% proc-vmstat.pgactivate
+46.6% 4220187 ? 2% proc-vmstat.pgalloc_normal
+29.4% 2684996 ? 2% proc-vmstat.pgfault
-6.0% 2562304 ? 4% proc-vmstat.unevictable_pgs_scanned
+29.6% 261678 ? 11% numa-meminfo.node0.AnonPages.max
12302 ? 10% numa-meminfo.node0.KernelStack
97185 ? 4% numa-meminfo.node0.Mapped
7306 ? 13% numa-meminfo.node0.Shmem
+18.9% 138931 ? 10% numa-meminfo.node0.Slab
1026 ? 89% numa-meminfo.node1.Active
1026 ? 89% numa-meminfo.node1.Active(anon)
10227 ? 3% numa-meminfo.node1.KernelStack
-28.4% 118482 ? 10% numa-meminfo.node1.Mapped
85462 ? 3% numa-meminfo.node1.SUnreclaim
1658 ? 88% numa-meminfo.node1.Shmem
-19.9% 153306 ? 21% numa-meminfo.node1.Slab
+188.6% 5415245 numa-meminfo.node3.Active
+188.6% 5415245 numa-meminfo.node3.Active(anon)
+23.5% 547217 numa-meminfo.node3.AnonPages.max
+108.9% 9433700 ? 4% numa-meminfo.node3.FilePages
+48.8% 4223489 ? 9% numa-meminfo.node3.Inactive
+48.8% 4223489 ? 9% numa-meminfo.node3.Inactive(anon)
+79.2% 1636140 ? 9% numa-meminfo.node3.Mapped
-11.1% 39323843 numa-meminfo.node3.MemFree
+93.5% 10159243 ? 4% numa-meminfo.node3.MemUsed
+108.9% 9432543 ? 4% numa-meminfo.node3.Shmem
+1013.5% 3.748e+08 ? 14% sched_debug.cfs_rq:/.avg_vruntime.avg
+34504.8% 1.178e+10 ? 20% sched_debug.cfs_rq:/.avg_vruntime.max
-14.2% 26896148 ? 5% sched_debug.cfs_rq:/.avg_vruntime.min
+6.2e+05% 1.508e+09 ? 13% sched_debug.cfs_rq:/.avg_vruntime.stddev
2.72 ? 7% sched_debug.cfs_rq:/.h_nr_running.max
+1.6e+05% 1.389e+08 ?133% sched_debug.cfs_rq:/.left_vruntime.stddev
28345 ?111% sched_debug.cfs_rq:/.load.avg
195.50 ? 40% sched_debug.cfs_rq:/.load_avg.avg
1442 ? 26% sched_debug.cfs_rq:/.load_avg.stddev
+1013.5% 3.748e+08 ? 14% sched_debug.cfs_rq:/.min_vruntime.avg
+34504.8% 1.178e+10 ? 20% sched_debug.cfs_rq:/.min_vruntime.max
-14.2% 26896148 ? 5% sched_debug.cfs_rq:/.min_vruntime.min
+6.2e+05% 1.508e+09 ? 13% sched_debug.cfs_rq:/.min_vruntime.stddev
0.04 ? 7% sched_debug.cfs_rq:/.nr_running.stddev
+1.6e+05% 1.389e+08 ?133% sched_debug.cfs_rq:/.right_vruntime.stddev
1333 sched_debug.cfs_rq:/.runnable_avg.avg
1031 ? 5% sched_debug.cfs_rq:/.runnable_avg.min
+23.0% 698.41 sched_debug.cfs_rq:/.util_est_enqueued.avg
+91.2% 363.61 ? 6% sched_debug.cfs_rq:/.util_est_enqueued.min
+10.1% 233.86 sched_debug.cfs_rq:/.util_est_enqueued.stddev
+12.3% 774171 sched_debug.cpu.avg_idle.avg
53341 ? 32% sched_debug.cpu.avg_idle.min
27.79 ? 2% sched_debug.cpu.clock.stddev
0.00 ? 32% sched_debug.cpu.next_balance.stddev
1.30 sched_debug.cpu.nr_running.avg
2.72 ? 10% sched_debug.cpu.nr_running.max
+23.7% 69450178 sched_debug.cpu.nr_switches.avg
+21.8% 72371938 sched_debug.cpu.nr_switches.max
-23.2% 38752422 ? 4% sched_debug.cpu.nr_switches.min
+76.1% 2743805 ? 6% sched_debug.cpu.nr_switches.stddev
0.15 ?107% sched_debug.rt_rq:.rt_time.avg
34.13 ?107% sched_debug.rt_rq:.rt_time.max
2.28 ?107% sched_debug.rt_rq:.rt_time.stddev
+300.0% 1.172e+08 sched_debug.sysctl_sched.sysctl_sched_features
1.12 ?137% perf-sched.sch_delay.avg.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64
0.01 ? 19% perf-sched.sch_delay.avg.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
0.05 ? 5% perf-sched.sch_delay.avg.ms.pipe_read.vfs_read.ksys_read.do_syscall_64
15.89 ?105% perf-sched.sch_delay.avg.ms.rcu_gp_kthread.kthread.ret_from_fork.ret_from_fork_asm
0.02 ? 11% perf-sched.sch_delay.avg.ms.schedule_hrtimeout_range_clock.do_select.core_sys_select.kern_select
24.07 ? 9% perf-sched.sch_delay.avg.ms.schedule_timeout.rcu_gp_fqs_loop.rcu_gp_kthread.kthread
1.55 ?139% perf-sched.sch_delay.avg.ms.syslog_print.do_syslog.kmsg_read.vfs_read
0.05 ? 18% perf-sched.sch_delay.avg.ms.worker_thread.kthread.ret_from_fork.ret_from_fork_asm
0.00 ?141% perf-sched.sch_delay.max.ms.__cond_resched.smpboot_thread_fn.kthread.ret_from_fork.ret_from_fork_asm
1.13 ?135% perf-sched.sch_delay.max.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64
63.46 ?141% perf-sched.sch_delay.max.ms.do_nanosleep.hrtimer_nanosleep.common_nsleep.__x64_sys_clock_nanosleep
0.10 ? 71% perf-sched.sch_delay.max.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
-50.4% 900.90 ? 47% perf-sched.sch_delay.max.ms.exit_to_user_mode_loop.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64
221.70 ?108% perf-sched.sch_delay.max.ms.rcu_gp_kthread.kthread.ret_from_fork.ret_from_fork_asm
0.03 ? 21% perf-sched.sch_delay.max.ms.schedule_hrtimeout_range_clock.do_select.core_sys_select.kern_select
-70.1% 575.01 ? 47% perf-sched.sch_delay.max.ms.schedule_timeout.rcu_gp_fqs_loop.rcu_gp_kthread.kthread
0.12 ? 64% perf-sched.sch_delay.max.ms.smpboot_thread_fn.kthread.ret_from_fork.ret_from_fork_asm
1.55 ?138% perf-sched.sch_delay.max.ms.syslog_print.do_syslog.kmsg_read.vfs_read
0.03 ? 2% perf-sched.total_sch_delay.average.ms
2553 ? 14% perf-sched.total_sch_delay.max.ms
0.11 ? 3% perf-sched.total_wait_and_delay.average.ms
+113.7% 17497214 ? 4% perf-sched.total_wait_and_delay.count.ms
0.08 ? 5% perf-sched.total_wait_time.average.ms
0.26 ? 60% perf-sched.wait_and_delay.avg.ms.__cond_resched.generic_perform_write.generic_file_write_iter.vfs_write.ksys_write
0.06 perf-sched.wait_and_delay.avg.ms.exit_to_user_mode_loop.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64
0.13 ? 3% perf-sched.wait_and_delay.avg.ms.pipe_read.vfs_read.ksys_read.do_syscall_64
84.79 ? 42% perf-sched.wait_and_delay.avg.ms.rcu_gp_kthread.kthread.ret_from_fork.ret_from_fork_asm
-57.8% 100.05 ? 25% perf-sched.wait_and_delay.avg.ms.schedule_timeout.rcu_gp_fqs_loop.rcu_gp_kthread.kthread
+118.9% 8628293 ? 4% perf-sched.wait_and_delay.count.exit_to_user_mode_loop.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64
+108.9% 8868039 ? 4% perf-sched.wait_and_delay.count.pipe_read.vfs_read.ksys_read.do_syscall_64
16.67 ? 15% perf-sched.wait_and_delay.count.rcu_gp_kthread.kthread.ret_from_fork.ret_from_fork_asm
2.01 ? 78% perf-sched.wait_and_delay.max.ms.__cond_resched.generic_perform_write.generic_file_write_iter.vfs_write.ksys_write
3.08 ? 6% perf-sched.wait_and_delay.max.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64
694.67 ? 66% perf-sched.wait_and_delay.max.ms.rcu_gp_kthread.kthread.ret_from_fork.ret_from_fork_asm
1466 ? 26% perf-sched.wait_and_delay.max.ms.schedule_timeout.rcu_gp_fqs_loop.rcu_gp_kthread.kthread
4234 ? 19% perf-sched.wait_and_delay.max.ms.smpboot_thread_fn.kthread.ret_from_fork.ret_from_fork_asm
0.01 ? 31% perf-sched.wait_time.avg.ms.__cond_resched.__alloc_pages.__folio_alloc.vma_alloc_folio.shmem_alloc_folio
0.00 ?141% perf-sched.wait_time.avg.ms.__cond_resched.dput.__fput.task_work_run.exit_to_user_mode_loop
0.26 ? 60% perf-sched.wait_time.avg.ms.__cond_resched.generic_perform_write.generic_file_write_iter.vfs_write.ksys_write
1.00 ? 70% perf-sched.wait_time.avg.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64
160.22 ? 94% perf-sched.wait_time.avg.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
0.94 ? 95% perf-sched.wait_time.avg.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
0.05 ? 2% perf-sched.wait_time.avg.ms.exit_to_user_mode_loop.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64
0.08 ? 2% perf-sched.wait_time.avg.ms.pipe_read.vfs_read.ksys_read.do_syscall_64
68.90 ? 30% perf-sched.wait_time.avg.ms.rcu_gp_kthread.kthread.ret_from_fork.ret_from_fork_asm
75.98 ? 30% perf-sched.wait_time.avg.ms.schedule_timeout.rcu_gp_fqs_loop.rcu_gp_kthread.kthread
0.03 ? 83% perf-sched.wait_time.max.ms.__cond_resched.__alloc_pages.__folio_alloc.vma_alloc_folio.shmem_alloc_folio
0.00 ?141% perf-sched.wait_time.max.ms.__cond_resched.dput.__fput.task_work_run.exit_to_user_mode_loop
2.01 ? 78% perf-sched.wait_time.max.ms.__cond_resched.generic_perform_write.generic_file_write_iter.vfs_write.ksys_write
1.95 ? 70% perf-sched.wait_time.max.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64
1737 ? 74% perf-sched.wait_time.max.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
10.36 ?123% perf-sched.wait_time.max.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
508.99 ? 42% perf-sched.wait_time.max.ms.rcu_gp_kthread.kthread.ret_from_fork.ret_from_fork_asm
-56.4% 891.66 ? 18% perf-sched.wait_time.max.ms.schedule_timeout.rcu_gp_fqs_loop.rcu_gp_kthread.kthread
4234 ? 19% perf-sched.wait_time.max.ms.smpboot_thread_fn.kthread.ret_from_fork.ret_from_fork_asm
1.07 ? 17% perf-stat.i.MPKI
1.17 perf-stat.i.branch-miss-rate%
1.53 ? 25% perf-stat.i.cache-miss-rate%
-33.8% 6.982e+08 ? 13% perf-stat.i.cache-references
+31.6% 1.126e+08 ? 3% perf-stat.i.context-switches
1.18 perf-stat.i.cpi
+4.5% 234077 ? 3% perf-stat.i.cpu-clock
+4.8% 7.692e+11 ? 3% perf-stat.i.cpu-cycles
-4.9% 339.95 perf-stat.i.cpu-migrations
95986 ? 7% perf-stat.i.cycles-between-cache-misses
+140.7% 3799592 ? 24% perf-stat.i.dTLB-load-misses
254065 ? 23% perf-stat.i.dTLB-store-misses
+4.0% 1.13e+11 ? 3% perf-stat.i.dTLB-stores
41.65 perf-stat.i.iTLB-load-miss-rate%
+39.6% 3.702e+08 ? 4% perf-stat.i.iTLB-load-misses
-10.5% 5.198e+08 ? 3% perf-stat.i.iTLB-loads
1760 perf-stat.i.instructions-per-iTLB-miss
0.85 perf-stat.i.ipc
+20.6% 515.09 perf-stat.i.metric.K/sec
1837 perf-stat.i.metric.M/sec
8086 ? 17% perf-stat.i.minor-faults
87.50 ? 7% perf-stat.i.node-load-miss-rate%
+9.5% 4411024 ? 5% perf-stat.i.node-load-misses
213203 ? 36% perf-stat.i.node-stores
8086 ? 17% perf-stat.i.page-faults
+4.5% 234077 ? 3% perf-stat.i.task-clock
1.05 ? 18% perf-stat.overall.MPKI
1.15 perf-stat.overall.branch-miss-rate%
1.88 ? 23% perf-stat.overall.cache-miss-rate%
1.17 perf-stat.overall.cpi
62022 ? 2% perf-stat.overall.cycles-between-cache-misses
0.00 ? 11% perf-stat.overall.dTLB-load-miss-rate%
0.00 ? 5% perf-stat.overall.dTLB-store-miss-rate%
41.63 perf-stat.overall.iTLB-load-miss-rate%
1779 perf-stat.overall.instructions-per-iTLB-miss
0.85 perf-stat.overall.ipc
59.75 perf-stat.overall.node-load-miss-rate%
78.04 ? 5% perf-stat.overall.node-store-miss-rate%
-21.5% 1768325 perf-stat.overall.path-length
-5.2% 1.439e+09 perf-stat.ps.branch-misses
+19.9% 11837554 ? 2% perf-stat.ps.cache-misses
-37.4% 6.581e+08 ? 17% perf-stat.ps.cache-references
+24.3% 1.06e+08 perf-stat.ps.context-switches
-21.1% 280.58 ? 9% perf-stat.ps.cpu-migrations
+139.1% 3821899 ? 10% perf-stat.ps.dTLB-load-misses
-2.0% 1.771e+11 perf-stat.ps.dTLB-loads
256716 ? 5% perf-stat.ps.dTLB-store-misses
+32.8% 3.509e+08 perf-stat.ps.iTLB-load-misses
-15.0% 4.92e+08 perf-stat.ps.iTLB-loads
-2.2% 6.246e+11 perf-stat.ps.instructions
7986 ? 3% perf-stat.ps.minor-faults
+5.9% 4253942 perf-stat.ps.node-load-misses
+37.4% 2865700 perf-stat.ps.node-loads
+12.6% 780367 ? 9% perf-stat.ps.node-store-misses
218355 ? 17% perf-stat.ps.node-stores
7986 ? 3% perf-stat.ps.page-faults
-2.1% 1.892e+14 perf-stat.total.instructions
46.19 perf-profile.calltrace.cycles-pp.read
39.07 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.read
38.22 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
17.66 perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.pipe_write.vfs_write.ksys_write
17.38 perf-profile.calltrace.cycles-pp.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.pipe_write.vfs_write
28.96 perf-profile.calltrace.cycles-pp.pipe_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
18.70 perf-profile.calltrace.cycles-pp.__wake_up_common_lock.pipe_write.vfs_write.ksys_write.do_syscall_64
19.33 perf-profile.calltrace.cycles-pp.schedule.pipe_read.vfs_read.ksys_read.do_syscall_64
17.03 perf-profile.calltrace.cycles-pp.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.pipe_write
18.86 perf-profile.calltrace.cycles-pp.__schedule.schedule.pipe_read.vfs_read.ksys_read
33.21 perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
34.58 perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
24.91 perf-profile.calltrace.cycles-pp.pipe_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
28.76 perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
30.27 perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
9.57 ? 2% perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
8.08 ? 2% perf-profile.calltrace.cycles-pp.activate_task.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common
7.93 ? 2% perf-profile.calltrace.cycles-pp.enqueue_task_fair.activate_task.ttwu_do_activate.try_to_wake_up.autoremove_wake_function
7.97 perf-profile.calltrace.cycles-pp.dequeue_task_fair.__schedule.schedule.pipe_read.vfs_read
3.98 ? 2% perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.activate_task.ttwu_do_activate.try_to_wake_up
2.82 perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.pipe_read.vfs_read
3.14 perf-profile.calltrace.cycles-pp.switch_mm_irqs_off.__schedule.schedule.pipe_read.vfs_read
2.01 ? 2% perf-profile.calltrace.cycles-pp.perf_trace_sched_wakeup_template.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
3.11 perf-profile.calltrace.cycles-pp.select_task_rq.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
2.78 perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
2.77 perf-profile.calltrace.cycles-pp.select_task_rq_fair.select_task_rq.try_to_wake_up.autoremove_wake_function.__wake_up_common
2.52 perf-profile.calltrace.cycles-pp.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
1.86 perf-profile.calltrace.cycles-pp.select_idle_sibling.select_task_rq_fair.select_task_rq.try_to_wake_up.autoremove_wake_function
3.98 perf-profile.calltrace.cycles-pp.dequeue_entity.dequeue_task_fair.__schedule.schedule.pipe_read
1.27 ? 5% perf-profile.calltrace.cycles-pp.update_curr.enqueue_entity.enqueue_task_fair.activate_task.ttwu_do_activate
1.72 perf-profile.calltrace.cycles-pp.prepare_to_wait_event.pipe_read.vfs_read.ksys_read.do_syscall_64
1.40 ? 2% perf-profile.calltrace.cycles-pp.reweight_entity.enqueue_task_fair.activate_task.ttwu_do_activate.try_to_wake_up
1.40 perf-profile.calltrace.cycles-pp.set_next_entity.pick_next_task_fair.__schedule.schedule.pipe_read
1.03 ? 2% perf-profile.calltrace.cycles-pp.perf_tp_event.perf_trace_sched_wakeup_template.try_to_wake_up.autoremove_wake_function.__wake_up_common
1.31 perf-profile.calltrace.cycles-pp.prepare_task_switch.__schedule.schedule.pipe_read.vfs_read
1.38 ? 2% perf-profile.calltrace.cycles-pp.reweight_entity.dequeue_task_fair.__schedule.schedule.pipe_read
1.33 perf-profile.calltrace.cycles-pp.__switch_to_asm.read
0.76 ? 4% perf-profile.calltrace.cycles-pp.update_load_avg.enqueue_entity.enqueue_task_fair.activate_task.ttwu_do_activate
0.97 ? 2% perf-profile.calltrace.cycles-pp.update_load_avg.dequeue_entity.dequeue_task_fair.__schedule.schedule
0.86 ? 2% perf-profile.calltrace.cycles-pp.os_xsave.read
0.86 ? 3% perf-profile.calltrace.cycles-pp.update_curr.reweight_entity.enqueue_task_fair.activate_task.ttwu_do_activate
0.90 perf-profile.calltrace.cycles-pp.___perf_sw_event.prepare_task_switch.__schedule.schedule.pipe_read
0.90 perf-profile.calltrace.cycles-pp.update_load_avg.enqueue_task_fair.activate_task.ttwu_do_activate.try_to_wake_up
0.83 ? 2% perf-profile.calltrace.cycles-pp.update_curr.reweight_entity.dequeue_task_fair.__schedule.schedule
0.57 perf-profile.calltrace.cycles-pp.__switch_to.read
0.51 perf-profile.calltrace.cycles-pp.__calc_delta.update_curr.reweight_entity.enqueue_task_fair.activate_task
0.87 ? 2% perf-profile.calltrace.cycles-pp.update_load_avg.dequeue_task_fair.__schedule.schedule.pipe_read
0.67 perf-profile.calltrace.cycles-pp.perf_trace_buf_alloc.perf_trace_sched_wakeup_template.try_to_wake_up.autoremove_wake_function.__wake_up_common
0.52 perf-profile.calltrace.cycles-pp.__calc_delta.update_curr.reweight_entity.dequeue_task_fair.__schedule
0.53 perf-profile.calltrace.cycles-pp.select_idle_cpu.select_idle_sibling.select_task_rq_fair.select_task_rq.try_to_wake_up
1.76 ? 3% perf-profile.calltrace.cycles-pp.update_curr.dequeue_entity.dequeue_task_fair.__schedule.schedule
0.61 ? 2% perf-profile.calltrace.cycles-pp.update_cfs_group.enqueue_task_fair.activate_task.ttwu_do_activate.try_to_wake_up
0.59 ? 7% perf-profile.calltrace.cycles-pp._raw_spin_lock.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
0.53 perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.pipe_read.vfs_read.ksys_read
0.92 perf-profile.calltrace.cycles-pp.place_entity.enqueue_entity.enqueue_task_fair.activate_task.ttwu_do_activate
0.60 ? 3% perf-profile.calltrace.cycles-pp.update_cfs_group.dequeue_task_fair.__schedule.schedule.pipe_read
1.37 perf-profile.calltrace.cycles-pp.check_preempt_curr.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common
1.14 perf-profile.calltrace.cycles-pp.check_preempt_wakeup.check_preempt_curr.ttwu_do_activate.try_to_wake_up.autoremove_wake_function
0.80 perf-profile.calltrace.cycles-pp.__fget_light.__fdget_pos.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.55 perf-profile.calltrace.cycles-pp.mutex_unlock.pipe_read.vfs_read.ksys_read.do_syscall_64
0.58 perf-profile.calltrace.cycles-pp.syscall_return_via_sysret.write
1.13 perf-profile.calltrace.cycles-pp.atime_needs_update.touch_atime.pipe_read.vfs_read.ksys_read
1.39 perf-profile.calltrace.cycles-pp.touch_atime.pipe_read.vfs_read.ksys_read.do_syscall_64
0.72 ? 3% perf-profile.calltrace.cycles-pp.copyout._copy_to_iter.copy_page_to_iter.pipe_read.vfs_read
0.74 perf-profile.calltrace.cycles-pp.mutex_lock.pipe_write.vfs_write.ksys_write.do_syscall_64
1.11 ? 3% perf-profile.calltrace.cycles-pp.apparmor_file_permission.security_file_permission.vfs_write.ksys_write.do_syscall_64
0.76 ? 3% perf-profile.calltrace.cycles-pp.__fget_light.__fdget_pos.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.81 ? 3% perf-profile.calltrace.cycles-pp.__fdget_pos.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
1.35 perf-profile.calltrace.cycles-pp.update_load_avg.set_next_entity.pick_next_task_fair.__schedule.schedule
1.16 ? 3% perf-profile.calltrace.cycles-pp.apparmor_file_permission.security_file_permission.vfs_read.ksys_read.do_syscall_64
1.25 perf-profile.calltrace.cycles-pp._copy_to_iter.copy_page_to_iter.pipe_read.vfs_read.ksys_read
1.38 perf-profile.calltrace.cycles-pp._copy_from_iter.copy_page_from_iter.pipe_write.vfs_write.ksys_write
1.48 perf-profile.calltrace.cycles-pp.copy_page_to_iter.pipe_read.vfs_read.ksys_read.do_syscall_64
1.76 perf-profile.calltrace.cycles-pp.copy_page_from_iter.pipe_write.vfs_write.ksys_write.do_syscall_64
1.44 ? 3% perf-profile.calltrace.cycles-pp.security_file_permission.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
2.01 perf-profile.calltrace.cycles-pp.__entry_text_start.write
2.04 perf-profile.calltrace.cycles-pp.__entry_text_start.read
1.62 ? 2% perf-profile.calltrace.cycles-pp.security_file_permission.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.55 perf-profile.calltrace.cycles-pp.syscall_return_via_sysret.read
0.55 perf-profile.calltrace.cycles-pp.current_time.atime_needs_update.touch_atime.pipe_read.vfs_read
0.56 ? 2% perf-profile.calltrace.cycles-pp.__switch_to.write
0.58 ? 3% perf-profile.calltrace.cycles-pp.update_entity_lag.dequeue_entity.dequeue_task_fair.__schedule.schedule
0.58 ? 2% perf-profile.calltrace.cycles-pp.anon_pipe_buf_release.pipe_read.vfs_read.ksys_read.do_syscall_64
0.60 perf-profile.calltrace.cycles-pp.copyin._copy_from_iter.copy_page_from_iter.pipe_write.vfs_write
0.74 ? 3% perf-profile.calltrace.cycles-pp.update_load_avg.put_prev_entity.pick_next_task_fair.__schedule.schedule
0.78 ? 3% perf-profile.calltrace.cycles-pp.file_update_time.pipe_write.vfs_write.ksys_write.do_syscall_64
3.68 perf-profile.calltrace.cycles-pp.restore_fpregs_from_fpstate.switch_fpu_return.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64
0.83 ? 3% perf-profile.calltrace.cycles-pp.___perf_sw_event.prepare_task_switch.__schedule.schedule.exit_to_user_mode_loop
0.84 ? 2% perf-profile.calltrace.cycles-pp.os_xsave.write
4.49 perf-profile.calltrace.cycles-pp.switch_fpu_return.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.17 ? 2% perf-profile.calltrace.cycles-pp.__switch_to_asm.write
1.27 ? 2% perf-profile.calltrace.cycles-pp.prepare_task_switch.__schedule.schedule.exit_to_user_mode_loop.exit_to_user_mode_prepare
1.33 ? 3% perf-profile.calltrace.cycles-pp.put_prev_entity.pick_next_task_fair.__schedule.schedule.exit_to_user_mode_loop
1.43 ? 3% perf-profile.calltrace.cycles-pp.set_next_entity.pick_next_task_fair.__schedule.schedule.exit_to_user_mode_loop
2.82 ? 2% perf-profile.calltrace.cycles-pp.switch_mm_irqs_off.__schedule.schedule.exit_to_user_mode_loop.exit_to_user_mode_prepare
4.11 ? 3% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.exit_to_user_mode_loop.exit_to_user_mode_prepare
45.82 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
46.83 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write
10.75 ? 2% perf-profile.calltrace.cycles-pp.__schedule.schedule.exit_to_user_mode_loop.exit_to_user_mode_prepare.syscall_exit_to_user_mode
11.17 ? 2% perf-profile.calltrace.cycles-pp.schedule.exit_to_user_mode_loop.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64
53.68 perf-profile.calltrace.cycles-pp.write
11.68 ? 2% perf-profile.calltrace.cycles-pp.exit_to_user_mode_loop.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
14.36 ? 2% perf-profile.calltrace.cycles-pp.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
14.68 ? 2% perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
46.28 perf-profile.children.cycles-pp.read
17.68 perf-profile.children.cycles-pp.__wake_up_common
17.40 perf-profile.children.cycles-pp.autoremove_wake_function
29.16 perf-profile.children.cycles-pp.pipe_read
18.76 perf-profile.children.cycles-pp.__wake_up_common_lock
17.08 perf-profile.children.cycles-pp.try_to_wake_up
33.27 perf-profile.children.cycles-pp.vfs_read
34.60 perf-profile.children.cycles-pp.ksys_read
25.09 perf-profile.children.cycles-pp.pipe_write
28.86 perf-profile.children.cycles-pp.vfs_write
30.31 perf-profile.children.cycles-pp.ksys_write
9.58 ? 2% perf-profile.children.cycles-pp.ttwu_do_activate
8.09 ? 2% perf-profile.children.cycles-pp.activate_task
7.95 ? 2% perf-profile.children.cycles-pp.enqueue_task_fair
4.06 ? 2% perf-profile.children.cycles-pp.enqueue_entity
7.99 perf-profile.children.cycles-pp.dequeue_task_fair
85.98 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
84.15 perf-profile.children.cycles-pp.do_syscall_64
5.46 ? 2% perf-profile.children.cycles-pp.update_curr
2.81 ? 2% perf-profile.children.cycles-pp.reweight_entity
2.03 ? 2% perf-profile.children.cycles-pp.perf_trace_sched_wakeup_template
3.12 perf-profile.children.cycles-pp.select_task_rq
2.78 perf-profile.children.cycles-pp.select_task_rq_fair
5.80 perf-profile.children.cycles-pp.update_load_avg
1.90 perf-profile.children.cycles-pp.select_idle_sibling
4.11 perf-profile.children.cycles-pp.dequeue_entity
1.76 perf-profile.children.cycles-pp.prepare_to_wait_event
1.04 ? 2% perf-profile.children.cycles-pp.perf_tp_event
0.66 ? 2% perf-profile.children.cycles-pp.update_min_vruntime
1.04 perf-profile.children.cycles-pp.__calc_delta
1.70 perf-profile.children.cycles-pp._raw_spin_lock_irqsave
1.30 ? 3% perf-profile.children.cycles-pp.update_cfs_group
0.90 perf-profile.children.cycles-pp.update_rq_clock
1.82 perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
0.73 perf-profile.children.cycles-pp.sched_clock_cpu
0.67 perf-profile.children.cycles-pp.sched_clock
0.69 ? 2% perf-profile.children.cycles-pp.perf_trace_buf_alloc
0.36 ? 3% perf-profile.children.cycles-pp.perf_trace_buf_update
0.49 perf-profile.children.cycles-pp.avg_vruntime
0.41 perf-profile.children.cycles-pp._find_next_and_bit
0.54 perf-profile.children.cycles-pp.select_idle_cpu
0.62 perf-profile.children.cycles-pp.native_sched_clock
0.92 perf-profile.children.cycles-pp.place_entity
0.98 ? 4% perf-profile.children.cycles-pp._raw_spin_lock
0.22 ? 2% perf-profile.children.cycles-pp.tracing_gen_ctx_irq_test
0.48 ? 6% perf-profile.children.cycles-pp.update_rq_clock_task
0.40 ? 2% perf-profile.children.cycles-pp.finish_wait
1.93 ? 2% perf-profile.children.cycles-pp.__update_load_avg_se
0.42 ? 11% perf-profile.children.cycles-pp.perf_trace_sched_stat_runtime
0.47 ? 13% perf-profile.children.cycles-pp.cpuacct_charge
0.23 ? 5% perf-profile.children.cycles-pp.ttwu_queue_wakelist
1.38 perf-profile.children.cycles-pp.check_preempt_curr
0.22 ? 2% perf-profile.children.cycles-pp.__bitmap_and
0.22 perf-profile.children.cycles-pp.check_spread
0.22 ? 2% perf-profile.children.cycles-pp.perf_swevent_get_recursion_context
0.35 ? 3% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
1.19 perf-profile.children.cycles-pp.check_preempt_wakeup
0.50 perf-profile.children.cycles-pp.__list_del_entry_valid
0.27 ? 3% perf-profile.children.cycles-pp.syscall_enter_from_user_mode
0.27 ? 3% perf-profile.children.cycles-pp.available_idle_cpu
0.22 ? 2% perf-profile.children.cycles-pp.mm_cid_get
0.48 perf-profile.children.cycles-pp.__list_add_valid
0.10 ? 4% perf-profile.children.cycles-pp.perf_trace_run_bpf_submit
0.21 ? 2% perf-profile.children.cycles-pp.rcu_note_context_switch
0.05 perf-profile.children.cycles-pp.init_wait_entry
0.09 ? 5% perf-profile.children.cycles-pp.make_vfsuid
0.11 ? 7% perf-profile.children.cycles-pp.write@plt
0.10 ? 4% perf-profile.children.cycles-pp.perf_exclude_event
0.33 ? 2% perf-profile.children.cycles-pp.__x64_sys_read
0.15 perf-profile.children.cycles-pp.switch_ldt
0.14 ? 3% perf-profile.children.cycles-pp.rb_next
0.95 perf-profile.children.cycles-pp.mutex_unlock
0.37 perf-profile.children.cycles-pp.syscall_exit_to_user_mode_prepare
0.20 ? 2% perf-profile.children.cycles-pp.rb_erase
0.62 perf-profile.children.cycles-pp.finish_task_switch
0.33 ? 3% perf-profile.children.cycles-pp.__x64_sys_write
0.05 perf-profile.children.cycles-pp.__wake_up_sync_key
0.28 perf-profile.children.cycles-pp.entry_SYSCALL_64_safe_stack
0.06 ? 8% perf-profile.children.cycles-pp.make_vfsgid
0.23 ? 8% perf-profile.children.cycles-pp.ktime_get_coarse_real_ts64
0.13 ? 3% perf-profile.children.cycles-pp.rb_insert_color
0.22 ? 19% perf-profile.children.cycles-pp.scheduler_tick
0.36 perf-profile.children.cycles-pp.__rdgsbase_inactive
0.75 perf-profile.children.cycles-pp.pick_next_entity
0.18 ? 2% perf-profile.children.cycles-pp.rw_verify_area
0.08 ? 6% perf-profile.children.cycles-pp.evlist__parse_sample
0.13 perf-profile.children.cycles-pp.cr4_update_irqsoff
0.32 ? 2% perf-profile.children.cycles-pp.check_cfs_rq_runtime
0.38 perf-profile.children.cycles-pp.__enqueue_entity
0.46 perf-profile.children.cycles-pp.child
0.39 ? 8% perf-profile.children.cycles-pp.perf_trace_sched_switch
0.31 ? 5% perf-profile.children.cycles-pp.aa_file_perm
0.64 ? 5% perf-profile.children.cycles-pp.rep_movs_alternative
0.11 ? 8% perf-profile.children.cycles-pp.perf_session__deliver_event
0.51 perf-profile.children.cycles-pp.testcase
0.56 perf-profile.children.cycles-pp.__get_task_ioprio
0.64 perf-profile.children.cycles-pp.__wrgsbase_inactive
1.18 perf-profile.children.cycles-pp.syscall_return_via_sysret
0.14 ? 9% perf-profile.children.cycles-pp.perf_session__process_user_event
0.14 ? 9% perf-profile.children.cycles-pp.__ordered_events__flush
1.16 perf-profile.children.cycles-pp.atime_needs_update
1.56 ? 2% perf-profile.children.cycles-pp.__fget_light
1.40 perf-profile.children.cycles-pp.touch_atime
0.29 ? 8% perf-profile.children.cycles-pp.queue_event
0.31 perf-profile.children.cycles-pp.inode_needs_update_time
0.30 ? 6% perf-profile.children.cycles-pp.ordered_events__queue
0.81 perf-profile.children.cycles-pp.copyin
0.74 perf-profile.children.cycles-pp.__dequeue_entity
0.31 ? 7% perf-profile.children.cycles-pp.process_simple
1.83 perf-profile.children.cycles-pp.mutex_lock
1.74 perf-profile.children.cycles-pp.__fdget_pos
0.91 ? 2% perf-profile.children.cycles-pp.copyout
0.80 perf-profile.children.cycles-pp._raw_spin_lock_irq
0.63 ? 5% perf-profile.children.cycles-pp.set_next_buddy
0.85 perf-profile.children.cycles-pp.current_time
0.58 ? 2% perf-profile.children.cycles-pp.anon_pipe_buf_release
1.27 perf-profile.children.cycles-pp._copy_to_iter
0.51 perf-profile.children.cycles-pp.clear_buddies
1.41 perf-profile.children.cycles-pp._copy_from_iter
0.28 ? 2% perf-profile.children.cycles-pp.resched_curr
1.92 perf-profile.children.cycles-pp.__switch_to
1.70 perf-profile.children.cycles-pp.os_xsave
1.49 perf-profile.children.cycles-pp.entry_SYSRETQ_unsafe_stack
1.50 perf-profile.children.cycles-pp.copy_page_to_iter
1.76 perf-profile.children.cycles-pp.___perf_sw_event
0.81 ? 2% perf-profile.children.cycles-pp.file_update_time
0.48 ? 5% perf-profile.children.cycles-pp.reader__read_event
0.50 ? 4% perf-profile.children.cycles-pp.__cmd_record
0.48 ? 4% perf-profile.children.cycles-pp.record__finish_output
0.48 ? 4% perf-profile.children.cycles-pp.perf_session__process_events
1.79 perf-profile.children.cycles-pp.copy_page_from_iter
2.30 ? 3% perf-profile.children.cycles-pp.apparmor_file_permission
2.60 perf-profile.children.cycles-pp.__entry_text_start
2.60 perf-profile.children.cycles-pp.__switch_to_asm
2.58 perf-profile.children.cycles-pp.prepare_task_switch
0.58 ? 3% perf-profile.children.cycles-pp.update_entity_lag
2.93 perf-profile.children.cycles-pp.set_next_entity
3.68 perf-profile.children.cycles-pp.restore_fpregs_from_fpstate
3.14 ? 3% perf-profile.children.cycles-pp.security_file_permission
4.49 perf-profile.children.cycles-pp.switch_fpu_return
1.67 ? 2% perf-profile.children.cycles-pp.put_prev_entity
5.98 perf-profile.children.cycles-pp.switch_mm_irqs_off
29.79 perf-profile.children.cycles-pp.__schedule
30.52 perf-profile.children.cycles-pp.schedule
7.33 perf-profile.children.cycles-pp.pick_next_task_fair
53.86 perf-profile.children.cycles-pp.write
11.73 ? 2% perf-profile.children.cycles-pp.exit_to_user_mode_loop
16.96 perf-profile.children.cycles-pp.exit_to_user_mode_prepare
17.57 perf-profile.children.cycles-pp.syscall_exit_to_user_mode
0.95 ? 5% perf-profile.self.cycles-pp.enqueue_task_fair
0.79 ? 3% perf-profile.self.cycles-pp.enqueue_entity
0.62 ? 3% perf-profile.self.cycles-pp.update_min_vruntime
1.02 perf-profile.self.cycles-pp.__calc_delta
1.62 perf-profile.self.cycles-pp._raw_spin_lock_irqsave
2.31 ? 5% perf-profile.self.cycles-pp.update_curr
1.26 ? 3% perf-profile.self.cycles-pp.update_cfs_group
1.10 ? 2% perf-profile.self.cycles-pp.reweight_entity
0.53 ? 3% perf-profile.self.cycles-pp.check_preempt_wakeup
2.12 ? 3% perf-profile.self.cycles-pp.update_load_avg
1.75 perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
0.69 ? 2% perf-profile.self.cycles-pp.perf_tp_event
0.83 perf-profile.self.cycles-pp.prepare_to_wait_event
0.66 perf-profile.self.cycles-pp.dequeue_task_fair
0.47 ? 2% perf-profile.self.cycles-pp.try_to_wake_up
0.56 perf-profile.self.cycles-pp.dequeue_entity
0.68 perf-profile.self.cycles-pp.select_idle_sibling
0.48 perf-profile.self.cycles-pp.avg_vruntime
0.40 perf-profile.self.cycles-pp._find_next_and_bit
0.14 perf-profile.self.cycles-pp.autoremove_wake_function
0.60 perf-profile.self.cycles-pp.native_sched_clock
0.95 ? 4% perf-profile.self.cycles-pp._raw_spin_lock
0.47 ? 5% perf-profile.self.cycles-pp.update_rq_clock_task
0.22 ? 2% perf-profile.self.cycles-pp.tracing_gen_ctx_irq_test
0.49 ? 2% perf-profile.self.cycles-pp.perf_trace_buf_alloc
1.88 perf-profile.self.cycles-pp.__update_load_avg_se
0.41 ? 12% perf-profile.self.cycles-pp.perf_trace_sched_stat_runtime
0.31 perf-profile.self.cycles-pp.select_idle_cpu
0.88 ? 2% perf-profile.self.cycles-pp.select_task_rq_fair
0.21 ? 4% perf-profile.self.cycles-pp.perf_trace_sched_wakeup_template
0.22 ? 3% perf-profile.self.cycles-pp.ttwu_queue_wakelist
0.45 ? 12% perf-profile.self.cycles-pp.cpuacct_charge
0.21 ? 2% perf-profile.self.cycles-pp.__bitmap_and
0.18 ? 2% perf-profile.self.cycles-pp.check_spread
0.20 perf-profile.self.cycles-pp.perf_swevent_get_recursion_context
0.11 ? 4% perf-profile.self.cycles-pp.ttwu_do_activate
0.14 ? 6% perf-profile.self.cycles-pp.perf_trace_buf_update
0.32 ? 3% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
0.16 ? 5% perf-profile.self.cycles-pp.update_rq_clock
0.14 perf-profile.self.cycles-pp.activate_task
0.34 ? 2% perf-profile.self.cycles-pp.select_task_rq
0.47 perf-profile.self.cycles-pp.__list_add_valid
0.45 perf-profile.self.cycles-pp.__list_del_entry_valid
0.75 perf-profile.self.cycles-pp.do_syscall_64
0.20 ? 2% perf-profile.self.cycles-pp.mm_cid_get
0.20 ? 4% perf-profile.self.cycles-pp.check_preempt_curr
0.07 ? 7% perf-profile.self.cycles-pp.sched_clock_cpu
0.26 ? 3% perf-profile.self.cycles-pp.available_idle_cpu
0.25 ? 3% perf-profile.self.cycles-pp.syscall_enter_from_user_mode
0.27 perf-profile.self.cycles-pp.__wake_up_common
0.19 ? 2% perf-profile.self.cycles-pp.rcu_note_context_switch
0.10 ? 4% perf-profile.self.cycles-pp.perf_trace_run_bpf_submit
0.11 perf-profile.self.cycles-pp.finish_wait
1.85 perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
0.48 perf-profile.self.cycles-pp.atime_needs_update
0.05 perf-profile.self.cycles-pp.sched_clock
0.21 ? 2% perf-profile.self.cycles-pp.__fdget_pos
0.10 ? 8% perf-profile.self.cycles-pp.write@plt
0.08 perf-profile.self.cycles-pp.perf_exclude_event
0.17 ? 2% perf-profile.self.cycles-pp.check_cfs_rq_runtime
0.43 perf-profile.self.cycles-pp.__cond_resched
0.92 perf-profile.self.cycles-pp.mutex_unlock
0.31 ? 3% perf-profile.self.cycles-pp.__x64_sys_read
0.11 perf-profile.self.cycles-pp.rb_next
0.32 perf-profile.self.cycles-pp.syscall_exit_to_user_mode_prepare
0.45 perf-profile.self.cycles-pp.finish_task_switch
2.04 perf-profile.self.cycles-pp.pipe_read
0.15 perf-profile.self.cycles-pp.switch_ldt
0.17 ? 2% perf-profile.self.cycles-pp.rb_erase
0.31 ? 3% perf-profile.self.cycles-pp.__x64_sys_write
0.62 perf-profile.self.cycles-pp.pick_next_entity
0.24 ? 3% perf-profile.self.cycles-pp.copy_page_to_iter
0.14 ? 3% perf-profile.self.cycles-pp.rw_verify_area
0.30 perf-profile.self.cycles-pp.syscall_exit_to_user_mode
0.35 perf-profile.self.cycles-pp.child
1.30 perf-profile.self.cycles-pp.pick_next_task_fair
0.40 perf-profile.self.cycles-pp.__dequeue_entity
0.22 ? 8% perf-profile.self.cycles-pp.ktime_get_coarse_real_ts64
0.06 ? 8% perf-profile.self.cycles-pp.make_vfsgid
0.28 perf-profile.self.cycles-pp.entry_SYSCALL_64_safe_stack
0.35 perf-profile.self.cycles-pp.__wake_up_common_lock
0.12 perf-profile.self.cycles-pp.rb_insert_color
0.39 ? 9% perf-profile.self.cycles-pp.rep_movs_alternative
0.36 perf-profile.self.cycles-pp.__rdgsbase_inactive
0.42 perf-profile.self.cycles-pp.testcase
0.38 perf-profile.self.cycles-pp.copy_page_from_iter
0.35 ? 2% perf-profile.self.cycles-pp._copy_to_iter
0.23 ? 2% perf-profile.self.cycles-pp.file_update_time
0.38 ? 8% perf-profile.self.cycles-pp.perf_trace_sched_switch
0.42 perf-profile.self.cycles-pp.place_entity
0.28 ? 2% perf-profile.self.cycles-pp.aa_file_perm
0.28 perf-profile.self.cycles-pp.put_prev_entity
0.11 perf-profile.self.cycles-pp.cr4_update_irqsoff
0.53 perf-profile.self.cycles-pp.__get_task_ioprio
1.01 perf-profile.self.cycles-pp.read
0.73 perf-profile.self.cycles-pp.schedule
0.45 perf-profile.self.cycles-pp.set_next_entity
0.35 perf-profile.self.cycles-pp.__enqueue_entity
0.64 perf-profile.self.cycles-pp.__wrgsbase_inactive
0.60 perf-profile.self.cycles-pp._copy_from_iter
1.15 perf-profile.self.cycles-pp.syscall_return_via_sysret
1.21 ? 2% perf-profile.self.cycles-pp.mutex_lock
0.67 perf-profile.self.cycles-pp.copyin
0.64 perf-profile.self.cycles-pp.copyout
0.29 ? 7% perf-profile.self.cycles-pp.queue_event
1.07 perf-profile.self.cycles-pp.write
0.30 ? 2% perf-profile.self.cycles-pp.inode_needs_update_time
1.50 ? 2% perf-profile.self.cycles-pp.__fget_light
0.58 ? 5% perf-profile.self.cycles-pp.current_time
0.77 perf-profile.self.cycles-pp._raw_spin_lock_irq
0.60 ? 5% perf-profile.self.cycles-pp.set_next_buddy
1.88 perf-profile.self.cycles-pp.vfs_read
0.81 ? 4% perf-profile.self.cycles-pp.prepare_task_switch
0.78 perf-profile.self.cycles-pp.switch_fpu_return
1.15 ? 2% perf-profile.self.cycles-pp.__entry_text_start
0.56 ? 2% perf-profile.self.cycles-pp.anon_pipe_buf_release
0.55 ? 2% perf-profile.self.cycles-pp.ksys_write
1.81 perf-profile.self.cycles-pp.__switch_to
0.27 ? 3% perf-profile.self.cycles-pp.resched_curr
1.96 ? 4% perf-profile.self.cycles-pp.apparmor_file_permission
0.48 perf-profile.self.cycles-pp.clear_buddies
1.62 perf-profile.self.cycles-pp.___perf_sw_event
1.68 perf-profile.self.cycles-pp.os_xsave
1.44 perf-profile.self.cycles-pp.entry_SYSRETQ_unsafe_stack
2.14 perf-profile.self.cycles-pp.pipe_write
0.74 ? 2% perf-profile.self.cycles-pp.exit_to_user_mode_prepare
0.47 ? 3% perf-profile.self.cycles-pp.exit_to_user_mode_loop
2.58 perf-profile.self.cycles-pp.__switch_to_asm
0.54 ? 3% perf-profile.self.cycles-pp.update_entity_lag
1.96 perf-profile.self.cycles-pp.vfs_write
0.86 ? 2% perf-profile.self.cycles-pp.security_file_permission
3.66 perf-profile.self.cycles-pp.restore_fpregs_from_fpstate
5.85 perf-profile.self.cycles-pp.switch_mm_irqs_off
*************************************************************************
threads 2 sockets (Ice Lake) with 128G memory
===============================================================
disk/fs2/fs/kconfig/rootfs/tbox_group/test/testcase:
cifs/xfs/x86_64-rhel-8.3/debian-11.1-x86_64-20220510.cgz/lkp-icl-2sp1/webproxy.f/filebench
Remove sched_feat(START_DEBIT)")
Add lag based placement")
86bfbb7ce4f67a88df263919816
---------------------------
%stddev
\
5.91 iostat.cpu.system
4.09 mpstat.cpu.all.sys%
9909 ? 34% numa-meminfo.node0.Active(anon)
2477 ? 34% numa-vmstat.node0.nr_active_anon
2477 ? 34% numa-vmstat.node0.nr_zone_active_anon
-3.9% 39326 vmstat.system.cs
-0.9% 98031 vmstat.system.in
+9.9% 22931 proc-vmstat.nr_active_anon
+3.7% 36259 proc-vmstat.nr_shmem
+9.9% 22931 proc-vmstat.nr_zone_active_anon
1112 ? 3% proc-vmstat.numa_huge_pte_updates
+10.6% 707819 proc-vmstat.numa_pte_updates
+5.7% 88601 proc-vmstat.pgactivate
+8.4% 22301 ? 3% proc-vmstat.pgreuse
+11.5% 201.00 turbostat.Avg_MHz
7.29 turbostat.Busy%
2762 turbostat.Bzy_MHz
0.01 turbostat.C1%
6.65 turbostat.C1E%
18.55 turbostat.CPU%c1
229.48 ? 52% turbostat.IPC
10049 ? 4% turbostat.POLL
5.28 ? 6% turbostat.Pkg%pc2
-1.9% 57.00 turbostat.RAMWatt
+1.5% 16.30 filebench.sum_bytes_mb/s
+1.7% 290566 filebench.sum_operations
4842 filebench.sum_operations/s
1274 filebench.sum_reads/s
-1.7% 20.60 filebench.sum_time_ms/op
+1.6% 254.67 filebench.sum_writes/s
-86.6% 200.00 ? 11% filebench.time.involuntary_context_switches
+9.3% 72630 ? 2% filebench.time.minor_page_faults
+21.1% 279.67 filebench.time.percent_of_cpu_this_job_got
+21.7% 201.01 filebench.time.system_time
-7.4% 410985 filebench.time.voluntary_context_switches
9.59e+08 ? 39% sched_debug.cfs_rq:/.avg_vruntime.avg
+1.5e+08% 2.006e+10 ? 61% sched_debug.cfs_rq:/.avg_vruntime.max
+1.2e+08% 3.058e+09 ? 40% sched_debug.cfs_rq:/.avg_vruntime.stddev
9.59e+08 ? 39% sched_debug.cfs_rq:/.min_vruntime.avg
+1.5e+08% 2.006e+10 ? 61% sched_debug.cfs_rq:/.min_vruntime.max
+1.2e+08% 3.058e+09 ? 40% sched_debug.cfs_rq:/.min_vruntime.stddev
1289 ? 17% sched_debug.cfs_rq:/.runnable_avg.max
1284 ? 17% sched_debug.cfs_rq:/.util_avg.max
2458 ? 7% sched_debug.cpu.avg_idle.min
19619 ? 33% sched_debug.cpu.max_idle_balance_cost.stddev
0.00 ? 9% sched_debug.cpu.next_balance.stddev
0.00 ?121% sched_debug.rt_rq:.rt_time.avg
0.33 ?121% sched_debug.rt_rq:.rt_time.max
0.03 ?121% sched_debug.rt_rq:.rt_time.stddev
+300.0% 1.172e+08 sched_debug.sysctl_sched.sysctl_sched_features
-6.4% 16.99 ? 2% perf-stat.i.MPKI
1.05 ? 2% perf-stat.i.branch-miss-rate%
-3.3% 25765825 perf-stat.i.branch-misses
-2.9% 5988372 perf-stat.i.cache-misses
-3.4% 1.731e+08 perf-stat.i.cache-references
-4.3% 40288 perf-stat.i.context-switches
1.67 perf-stat.i.cpi
+12.8% 1.814e+10 perf-stat.i.cpu-cycles
1152 perf-stat.i.cpu-migrations
3384 perf-stat.i.cycles-between-cache-misses
0.16 ? 2% perf-stat.i.dTLB-load-miss-rate%
-9.3% 4248854 perf-stat.i.dTLB-load-misses
0.03 ? 2% perf-stat.i.dTLB-store-miss-rate%
-9.6% 316962 perf-stat.i.dTLB-store-misses
0.63 perf-stat.i.ipc
0.19 perf-stat.i.metric.GHz
-3.1% 41.43 perf-stat.i.metric.K/sec
-4.3% 1378031 perf-stat.i.node-load-misses
-5.6% 48269 perf-stat.i.node-loads
-5.1% 15.98 perf-stat.overall.MPKI
1.01 perf-stat.overall.branch-miss-rate%
1.67 perf-stat.overall.cpi
3030 perf-stat.overall.cycles-between-cache-misses
0.15 perf-stat.overall.dTLB-load-miss-rate%
0.02 perf-stat.overall.dTLB-store-miss-rate%
0.60 perf-stat.overall.ipc
-3.3% 25402609 perf-stat.ps.branch-misses
-2.9% 5904055 perf-stat.ps.cache-misses
-3.4% 1.707e+08 perf-stat.ps.cache-references
-4.3% 39728 perf-stat.ps.context-switches
+12.8% 1.789e+10 perf-stat.ps.cpu-cycles
1136 perf-stat.ps.cpu-migrations
-9.3% 4189616 perf-stat.ps.dTLB-load-misses
-9.7% 312505 perf-stat.ps.dTLB-store-misses
-4.3% 1358892 perf-stat.ps.node-load-misses
-5.5% 47609 perf-stat.ps.node-loads
+1.9% 7.76e+11 perf-stat.total.instructions
8.71 ? 28% perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_openat2.__x64_sys_openat.do_syscall_64
9.09 ? 24% perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_openat2.__x64_sys_openat.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.88 ? 34% perf-profile.calltrace.cycles-pp.copyin.copy_page_from_iter_atomic.generic_perform_write.generic_file_write_iter.vfs_write
1.88 ? 34% perf-profile.calltrace.cycles-pp.update_sd_lb_stats.find_busiest_group.load_balance.newidle_balance.pick_next_task_fair
1.88 ? 34% perf-profile.calltrace.cycles-pp.copy_page_from_iter_atomic.generic_perform_write.generic_file_write_iter.vfs_write.ksys_write
1.88 ? 34% perf-profile.calltrace.cycles-pp.find_busiest_group.load_balance.newidle_balance.pick_next_task_fair.__schedule
1.43 ? 18% perf-profile.calltrace.cycles-pp.do_sys_openat2.__x64_sys_openat.do_syscall_64.entry_SYSCALL_64_after_hwframe.__open64_nocancel
1.43 ? 18% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__open64_nocancel.setlocale
1.43 ? 18% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__open64_nocancel.setlocale
1.43 ? 18% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.sched_setaffinity.evlist_cpu_iterator__next.__evlist__disable
1.43 ? 18% perf-profile.calltrace.cycles-pp.__x64_sys_openat.do_syscall_64.entry_SYSCALL_64_after_hwframe.__open64_nocancel.setlocale
1.43 ? 18% perf-profile.calltrace.cycles-pp.__x64_sys_sched_setaffinity.do_syscall_64.entry_SYSCALL_64_after_hwframe.sched_setaffinity.evlist_cpu_iterator__next
1.43 ? 18% perf-profile.calltrace.cycles-pp.__sched_setaffinity.sched_setaffinity.__x64_sys_sched_setaffinity.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.43 ? 18% perf-profile.calltrace.cycles-pp.sched_setaffinity.__x64_sys_sched_setaffinity.do_syscall_64.entry_SYSCALL_64_after_hwframe.sched_setaffinity
1.43 ? 18% perf-profile.calltrace.cycles-pp.__open64_nocancel.setlocale
2.25 ? 16% perf-profile.calltrace.cycles-pp.do_vmi_align_munmap.do_vmi_munmap.mmap_region.do_mmap.vm_mmap_pgoff
2.78 ? 67% perf-profile.calltrace.cycles-pp.init_file.alloc_empty_file.path_openat.do_filp_open.do_sys_openat2
7.21 ? 20% perf-profile.calltrace.cycles-pp.read
3.37 ? 51% perf-profile.calltrace.cycles-pp.alloc_empty_file.path_openat.do_filp_open.do_sys_openat2.__x64_sys_openat
3.37 ? 48% perf-profile.calltrace.cycles-pp.setlocale
7.81 ? 21% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.read
10.04 ? 23% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
10.04 ? 23% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
10.04 ? 23% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
10.42 ? 18% perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
7.86 ? 41% perf-profile.calltrace.cycles-pp.cpuidle_enter.cpuidle_idle_call.do_idle.cpu_startup_entry.start_secondary
8.24 ? 37% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle.cpu_startup_entry
22.47 ? 12% perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
22.47 ? 12% perf-profile.calltrace.cycles-pp.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
22.61 ? 11% perf-profile.calltrace.cycles-pp.arch_do_signal_or_restart.exit_to_user_mode_loop.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64
9.16 ? 33% perf-profile.children.cycles-pp.path_openat
9.53 ? 29% perf-profile.children.cycles-pp.do_filp_open
10.06 ? 14% perf-profile.children.cycles-pp.__x64_sys_openat
10.06 ? 14% perf-profile.children.cycles-pp.do_sys_openat2
1.73 ? 98% perf-profile.children.cycles-pp.lookup_fast
0.83 ? 71% perf-profile.children.cycles-pp.vma_alloc_folio
1.88 ? 34% perf-profile.children.cycles-pp.copyin
1.88 ? 34% perf-profile.children.cycles-pp.update_sd_lb_stats
1.88 ? 34% perf-profile.children.cycles-pp.copy_page_from_iter_atomic
1.88 ? 34% perf-profile.children.cycles-pp.find_busiest_group
1.43 ? 18% perf-profile.children.cycles-pp.__open64_nocancel
2.18 ? 40% perf-profile.children.cycles-pp.memcg_slab_post_alloc_hook
1.43 ? 18% perf-profile.children.cycles-pp.__x64_sys_sched_setaffinity
1.43 ? 18% perf-profile.children.cycles-pp.__sched_setaffinity
1.43 ? 18% perf-profile.children.cycles-pp.mas_walk
1.43 ? 18% perf-profile.children.cycles-pp.schedule
1.80 ? 20% perf-profile.children.cycles-pp.mod_objcg_state
2.70 ? 35% perf-profile.children.cycles-pp.newidle_balance
2.70 ? 35% perf-profile.children.cycles-pp.load_balance
2.62 ? 74% perf-profile.children.cycles-pp.__do_softirq
2.62 ? 74% perf-profile.children.cycles-pp.__irq_exit_rcu
2.78 ? 67% perf-profile.children.cycles-pp.init_file
3.23 ? 11% perf-profile.children.cycles-pp.do_vmi_munmap
3.23 ? 11% perf-profile.children.cycles-pp.do_vmi_align_munmap
3.23 ? 11% perf-profile.children.cycles-pp.sched_setaffinity
5.03 ? 43% perf-profile.children.cycles-pp.__schedule
7.21 ? 20% perf-profile.children.cycles-pp.read
3.37 ? 51% perf-profile.children.cycles-pp.alloc_empty_file
5.39 ? 48% perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
3.37 ? 48% perf-profile.children.cycles-pp.setlocale
10.04 ? 23% perf-profile.children.cycles-pp.start_secondary
10.42 ? 18% perf-profile.children.cycles-pp.secondary_startup_64_no_verify
10.42 ? 18% perf-profile.children.cycles-pp.cpu_startup_entry
10.42 ? 18% perf-profile.children.cycles-pp.do_idle
6.74 ? 48% perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
8.24 ? 37% perf-profile.children.cycles-pp.cpuidle_enter
8.24 ? 37% perf-profile.children.cycles-pp.cpuidle_enter_state
1.88 ? 34% perf-profile.self.cycles-pp.copyin
0.00 perf-sched.sch_delay.avg.ms.__cond_resched.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg_locked.tcp_recvmsg
0.00 ?141% perf-sched.sch_delay.avg.ms.__cond_resched.aa_sk_perm.security_socket_sendmsg.sock_sendmsg.smb_send_kvec
0.00 perf-sched.sch_delay.avg.ms.__cond_resched.cifs_demultiplex_thread.kthread.ret_from_fork.ret_from_fork_asm
0.00 perf-sched.sch_delay.avg.ms.__cond_resched.down.xfs_buf_lock.xfs_buf_find_lock.xfs_buf_lookup
0.00 perf-sched.sch_delay.avg.ms.__cond_resched.down_read.xfs_ilock_attr_map_shared.xfs_attr_get.xfs_xattr_get
0.00 ? 71% perf-sched.sch_delay.avg.ms.__cond_resched.down_read.xfs_ilock_data_map_shared.xfs_dir2_leaf_getdents.xfs_readdir
0.00 perf-sched.sch_delay.avg.ms.__cond_resched.dput.open_last_lookups.path_openat.do_filp_open
0.00 perf-sched.sch_delay.avg.ms.__cond_resched.dput.path_put.set_fs_pwd.__x64_sys_chdir
0.00 ? 71% perf-sched.sch_delay.avg.ms.__cond_resched.dput.path_put.vfs_statx.vfs_fstatat
0.00 perf-sched.sch_delay.avg.ms.__cond_resched.dput.terminate_walk.path_openat.do_filp_open
0.00 perf-sched.sch_delay.avg.ms.__cond_resched.kmem_cache_alloc.fcntl_setlk.do_fcntl.__x64_sys_fcntl
0.00 perf-sched.sch_delay.avg.ms.__cond_resched.kmem_cache_alloc.getname_flags.part.0
0.00 ?141% perf-sched.sch_delay.avg.ms.__cond_resched.kmem_cache_alloc.posix_lock_inode.do_lock_file_wait.fcntl_setlk
0.00 perf-sched.sch_delay.avg.ms.__cond_resched.kmem_cache_alloc_node.__alloc_skb.tcp_stream_alloc_skb.tcp_sendmsg_locked
0.00 perf-sched.sch_delay.avg.ms.__cond_resched.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl
0.00 perf-sched.sch_delay.avg.ms.__cond_resched.wait_for_response.compound_send_recv.cifs_send_recv.__SMB2_close
0.01 ? 3% perf-sched.sch_delay.avg.ms.__lock_sock.lock_sock_nested.tcp_recvmsg.inet6_recvmsg
0.15 ?111% perf-sched.sch_delay.avg.ms.__lock_sock.lock_sock_nested.tcp_sendmsg.sock_sendmsg
0.04 ? 23% perf-sched.sch_delay.avg.ms.__lock_sock.lock_sock_nested.tcp_sock_set_cork.__smb_send_rqst
0.01 ? 4% perf-sched.sch_delay.avg.ms.__lock_sock.sk_wait_data.tcp_recvmsg_locked.tcp_recvmsg
0.03 ? 11% perf-sched.sch_delay.avg.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
0.03 ? 8% perf-sched.sch_delay.avg.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
0.01 ? 31% perf-sched.sch_delay.avg.ms.exit_to_user_mode_loop.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_reschedule_ipi
0.04 ? 2% perf-sched.sch_delay.avg.ms.io_schedule.folio_wait_bit_common.folio_wait_writeback.__filemap_fdatawait_range
0.03 ? 8% perf-sched.sch_delay.avg.ms.kthreadd.ret_from_fork.ret_from_fork_asm
0.10 ? 27% perf-sched.sch_delay.avg.ms.schedule_hrtimeout_range_clock.do_select.core_sys_select.kern_select
0.03 ? 5% perf-sched.sch_delay.avg.ms.schedule_preempt_disabled.__mutex_lock.constprop.0.cifs_call_async
0.02 perf-sched.sch_delay.avg.ms.schedule_preempt_disabled.rwsem_down_write_slowpath.down_write.open_last_lookups
0.02 ? 17% perf-sched.sch_delay.avg.ms.schedule_timeout.__wait_for_common.__flush_work.isra.0
0.02 ? 38% perf-sched.sch_delay.avg.ms.schedule_timeout.__wait_for_common.wait_for_completion_killable.__kthread_create_on_node
0.01 perf-sched.sch_delay.avg.ms.schedule_timeout.wait_woken.sk_wait_data.tcp_recvmsg_locked
0.02 ? 9% perf-sched.sch_delay.avg.ms.smpboot_thread_fn.kthread.ret_from_fork.ret_from_fork_asm
0.11 ? 20% perf-sched.sch_delay.avg.ms.syslog_print.do_syslog.kmsg_read.vfs_read
0.05 ? 6% perf-sched.sch_delay.avg.ms.wait_for_partner.fifo_open.do_dentry_open.do_open
0.08 ? 7% perf-sched.sch_delay.avg.ms.wait_for_response.compound_send_recv.cifs_send_recv.SMB2_lease_break
0.06 ? 19% perf-sched.sch_delay.avg.ms.wait_for_response.compound_send_recv.cifs_send_recv.SMB2_open
0.03 ? 12% perf-sched.sch_delay.avg.ms.wait_for_response.compound_send_recv.cifs_send_recv.__SMB2_close
0.11 perf-sched.sch_delay.avg.ms.worker_thread.kthread.ret_from_fork.ret_from_fork_asm
0.12 ? 29% perf-sched.sch_delay.max.ms.__cond_resched.__kmem_cache_alloc_node.__kmalloc.cifs_strndup_to_utf16.cifs_convert_path_to_utf16
0.01 ? 12% perf-sched.sch_delay.max.ms.__cond_resched.__release_sock.release_sock.tcp_sendmsg.sock_sendmsg
0.00 perf-sched.sch_delay.max.ms.__cond_resched.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg_locked.tcp_recvmsg
0.05 ? 40% perf-sched.sch_delay.max.ms.__cond_resched.__wait_for_common.affine_move_task.__set_cpus_allowed_ptr.__sched_setaffinity
0.00 ?141% perf-sched.sch_delay.max.ms.__cond_resched.aa_sk_perm.security_socket_sendmsg.sock_sendmsg.smb_send_kvec
0.00 perf-sched.sch_delay.max.ms.__cond_resched.cifs_demultiplex_thread.kthread.ret_from_fork.ret_from_fork_asm
0.00 perf-sched.sch_delay.max.ms.__cond_resched.down.xfs_buf_lock.xfs_buf_find_lock.xfs_buf_lookup
0.00 perf-sched.sch_delay.max.ms.__cond_resched.down_read.xfs_ilock_attr_map_shared.xfs_attr_get.xfs_xattr_get
0.00 ? 71% perf-sched.sch_delay.max.ms.__cond_resched.down_read.xfs_ilock_data_map_shared.xfs_dir2_leaf_getdents.xfs_readdir
0.06 ? 73% perf-sched.sch_delay.max.ms.__cond_resched.dput.cifsFileInfo_put_final._cifsFileInfo_put.process_one_work
0.00 perf-sched.sch_delay.max.ms.__cond_resched.dput.open_last_lookups.path_openat.do_filp_open
0.00 perf-sched.sch_delay.max.ms.__cond_resched.dput.path_put.set_fs_pwd.__x64_sys_chdir
0.00 ? 71% perf-sched.sch_delay.max.ms.__cond_resched.dput.path_put.vfs_statx.vfs_fstatat
0.00 perf-sched.sch_delay.max.ms.__cond_resched.dput.terminate_walk.path_openat.do_filp_open
0.00 perf-sched.sch_delay.max.ms.__cond_resched.kmem_cache_alloc.fcntl_setlk.do_fcntl.__x64_sys_fcntl
0.00 perf-sched.sch_delay.max.ms.__cond_resched.kmem_cache_alloc.getname_flags.part.0
0.00 ?141% perf-sched.sch_delay.max.ms.__cond_resched.kmem_cache_alloc.posix_lock_inode.do_lock_file_wait.fcntl_setlk
0.00 perf-sched.sch_delay.max.ms.__cond_resched.kmem_cache_alloc_node.__alloc_skb.tcp_stream_alloc_skb.tcp_sendmsg_locked
0.00 perf-sched.sch_delay.max.ms.__cond_resched.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl
0.00 perf-sched.sch_delay.max.ms.__cond_resched.wait_for_response.compound_send_recv.cifs_send_recv.__SMB2_close
4.16 ? 62% perf-sched.sch_delay.max.ms.__lock_sock.lock_sock_nested.tcp_sock_set_cork.__smb_send_rqst
0.22 ? 6% perf-sched.sch_delay.max.ms.__lock_sock.sk_wait_data.tcp_recvmsg_locked.tcp_recvmsg
0.01 ? 17% perf-sched.sch_delay.max.ms.exit_to_user_mode_loop.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt
0.08 ? 62% perf-sched.sch_delay.max.ms.exit_to_user_mode_loop.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64
0.82 ? 65% perf-sched.sch_delay.max.ms.irq_thread.kthread.ret_from_fork.ret_from_fork_asm
5.01 ? 84% perf-sched.sch_delay.max.ms.schedule_preempt_disabled.rwsem_down_write_slowpath.down_write.do_unlinkat
2.32 ? 45% perf-sched.sch_delay.max.ms.smpboot_thread_fn.kthread.ret_from_fork.ret_from_fork_asm
0.15 ? 15% perf-sched.sch_delay.max.ms.syslog_print.do_syslog.kmsg_read.vfs_read
1.28 ? 14% perf-sched.sch_delay.max.ms.wait_for_response.compound_send_recv.cifs_send_recv.SMB2_lease_break
202.27 ? 3% perf-sched.sch_delay.max.ms.wait_for_response.compound_send_recv.cifs_send_recv.SMB2_open
9.32 ? 15% perf-sched.sch_delay.max.ms.worker_thread.kthread.ret_from_fork.ret_from_fork_asm
0.04 ? 5% perf-sched.total_sch_delay.average.ms
0.00 perf-sched.wait_and_delay.avg.ms.__cond_resched.cifs_demultiplex_thread.kthread.ret_from_fork.ret_from_fork_asm
0.07 perf-sched.wait_and_delay.avg.ms.__lock_sock.lock_sock_nested.tcp_recvmsg.inet6_recvmsg
45.02 perf-sched.wait_and_delay.avg.ms.__lock_sock.lock_sock_nested.tcp_sendmsg.sock_sendmsg
38.02 ? 2% perf-sched.wait_and_delay.avg.ms.__lock_sock.lock_sock_nested.tcp_sock_set_cork.__smb_send_rqst
2.82 ? 3% perf-sched.wait_and_delay.avg.ms.futex_wait_queue.futex_wait.do_futex.__x64_sys_futex
0.50 ? 3% perf-sched.wait_and_delay.avg.ms.io_schedule.folio_wait_bit_common.folio_wait_writeback.__filemap_fdatawait_range
13.43 ? 10% perf-sched.wait_and_delay.avg.ms.schedule_preempt_disabled.rwsem_down_write_slowpath.down_write.do_unlinkat
18.62 ? 3% perf-sched.wait_and_delay.avg.ms.wait_for_response.compound_send_recv.smb2_compound_op.smb2_query_path_info
8.43 ? 30% perf-sched.wait_and_delay.avg.ms.wait_for_response.compound_send_recv.smb2_compound_op.smb2_unlink
22.82 ? 2% perf-sched.wait_and_delay.avg.ms.worker_thread.kthread.ret_from_fork.ret_from_fork_asm
0.00 perf-sched.wait_and_delay.count.__cond_resched.cifs_demultiplex_thread.kthread.ret_from_fork.ret_from_fork_asm
1924 ? 5% perf-sched.wait_and_delay.count.__lock_sock.lock_sock_nested.tcp_recvmsg.inet6_recvmsg
-52.6% 633.33 ? 4% perf-sched.wait_and_delay.count.__lock_sock.lock_sock_nested.tcp_sendmsg.sock_sendmsg
-51.8% 930.67 ? 3% perf-sched.wait_and_delay.count.__lock_sock.lock_sock_nested.tcp_sock_set_cork.__smb_send_rqst
2994 perf-sched.wait_and_delay.count.__lock_sock.sk_wait_data.tcp_recvmsg_locked.tcp_recvmsg
51.00 ? 2% perf-sched.wait_and_delay.count.schedule_hrtimeout_range_clock.do_poll.constprop.0.do_sys_poll
2957 ? 2% perf-sched.wait_and_delay.count.schedule_preempt_disabled.__mutex_lock.constprop.0.compound_send_recv
28510 perf-sched.wait_and_delay.count.schedule_timeout.wait_woken.sk_wait_data.tcp_recvmsg_locked
13687 perf-sched.wait_and_delay.count.worker_thread.kthread.ret_from_fork.ret_from_fork_asm
0.00 perf-sched.wait_and_delay.max.ms.__cond_resched.cifs_demultiplex_thread.kthread.ret_from_fork.ret_from_fork_asm
2.17 ? 37% perf-sched.wait_and_delay.max.ms.__lock_sock.lock_sock_nested.tcp_recvmsg.inet6_recvmsg
2943 ? 23% perf-sched.wait_and_delay.max.ms.__lock_sock.lock_sock_nested.tcp_sendmsg.sock_sendmsg
+36.7% 874.64 ? 13% perf-sched.wait_and_delay.max.ms.kthreadd.ret_from_fork.ret_from_fork_asm
-6.7% 214.71 ? 2% perf-sched.wait_and_delay.max.ms.wait_for_response.compound_send_recv.smb2_compound_op.smb2_unlink
4011 ? 6% perf-sched.wait_and_delay.max.ms.worker_thread.kthread.ret_from_fork.ret_from_fork_asm
0.55 ? 26% perf-sched.wait_time.avg.ms.__cond_resched.__kmem_cache_alloc_node.__kmalloc.cifs_strndup_to_utf16.cifs_convert_path_to_utf16
0.02 ?141% perf-sched.wait_time.avg.ms.__cond_resched.__kmem_cache_alloc_node.__kmalloc_node.do_getxattr.getxattr
0.00 perf-sched.wait_time.avg.ms.__cond_resched.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg_locked.tcp_recvmsg
0.00 perf-sched.wait_time.avg.ms.__cond_resched.cifs_demultiplex_thread.kthread.ret_from_fork.ret_from_fork_asm
0.00 perf-sched.wait_time.avg.ms.__cond_resched.down.xfs_buf_lock.xfs_buf_find_lock.xfs_buf_lookup
0.00 perf-sched.wait_time.avg.ms.__cond_resched.down_read.xfs_ilock_attr_map_shared.xfs_attr_get.xfs_xattr_get
0.00 perf-sched.wait_time.avg.ms.__cond_resched.dput.open_last_lookups.path_openat.do_filp_open
0.00 perf-sched.wait_time.avg.ms.__cond_resched.dput.path_put.set_fs_pwd.__x64_sys_chdir
0.06 ? 86% perf-sched.wait_time.avg.ms.__cond_resched.dput.path_put.vfs_statx.vfs_fstatat
0.00 perf-sched.wait_time.avg.ms.__cond_resched.dput.terminate_walk.path_openat.do_filp_open
0.00 perf-sched.wait_time.avg.ms.__cond_resched.kmem_cache_alloc.fcntl_setlk.do_fcntl.__x64_sys_fcntl
0.00 perf-sched.wait_time.avg.ms.__cond_resched.kmem_cache_alloc.getname_flags.part.0
0.00 perf-sched.wait_time.avg.ms.__cond_resched.kmem_cache_alloc_node.__alloc_skb.tcp_stream_alloc_skb.tcp_sendmsg_locked
0.00 perf-sched.wait_time.avg.ms.__cond_resched.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl
0.00 perf-sched.wait_time.avg.ms.__cond_resched.wait_for_response.compound_send_recv.cifs_send_recv.__SMB2_close
0.05 perf-sched.wait_time.avg.ms.__lock_sock.lock_sock_nested.tcp_recvmsg.inet6_recvmsg
44.88 perf-sched.wait_time.avg.ms.__lock_sock.lock_sock_nested.tcp_sendmsg.sock_sendmsg
37.99 ? 2% perf-sched.wait_time.avg.ms.__lock_sock.lock_sock_nested.tcp_sock_set_cork.__smb_send_rqst
2.77 ? 3% perf-sched.wait_time.avg.ms.futex_wait_queue.futex_wait.do_futex.__x64_sys_futex
0.46 ? 3% perf-sched.wait_time.avg.ms.io_schedule.folio_wait_bit_common.folio_wait_writeback.__filemap_fdatawait_range
0.75 ? 4% perf-sched.wait_time.avg.ms.schedule_preempt_disabled.__mutex_lock.constprop.0.cifs_call_async
13.41 ? 10% perf-sched.wait_time.avg.ms.schedule_preempt_disabled.rwsem_down_write_slowpath.down_write.do_unlinkat
0.83 ? 2% perf-sched.wait_time.avg.ms.schedule_timeout.__wait_for_common.wait_for_completion_killable.__cifs_readv
1.16 ? 25% perf-sched.wait_time.avg.ms.wait_for_response.compound_send_recv.cifs_send_recv.SMB2_lease_break
18.59 ? 3% perf-sched.wait_time.avg.ms.wait_for_response.compound_send_recv.smb2_compound_op.smb2_query_path_info
8.40 ? 30% perf-sched.wait_time.avg.ms.wait_for_response.compound_send_recv.smb2_compound_op.smb2_unlink
22.71 ? 2% perf-sched.wait_time.avg.ms.worker_thread.kthread.ret_from_fork.ret_from_fork_asm
1.69 ? 29% perf-sched.wait_time.max.ms.__cond_resched.__kmem_cache_alloc_node.__kmalloc.cifs_strndup_to_utf16.cifs_convert_path_to_utf16
0.03 ?141% perf-sched.wait_time.max.ms.__cond_resched.__kmem_cache_alloc_node.__kmalloc_node.do_getxattr.getxattr
0.34 ? 61% perf-sched.wait_time.max.ms.__cond_resched.__release_sock.release_sock.tcp_sendmsg.sock_sendmsg
0.00 perf-sched.wait_time.max.ms.__cond_resched.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg_locked.tcp_recvmsg
0.59 ?141% perf-sched.wait_time.max.ms.__cond_resched.aa_sk_perm.security_socket_sendmsg.sock_sendmsg.smb_send_kvec
0.00 perf-sched.wait_time.max.ms.__cond_resched.cifs_demultiplex_thread.kthread.ret_from_fork.ret_from_fork_asm
0.00 perf-sched.wait_time.max.ms.__cond_resched.down.xfs_buf_lock.xfs_buf_find_lock.xfs_buf_lookup
0.00 perf-sched.wait_time.max.ms.__cond_resched.down_read.xfs_ilock_attr_map_shared.xfs_attr_get.xfs_xattr_get
0.15 ?108% perf-sched.wait_time.max.ms.__cond_resched.down_read.xfs_ilock_data_map_shared.xfs_dir2_leaf_getdents.xfs_readdir
0.99 ? 99% perf-sched.wait_time.max.ms.__cond_resched.dput.cifsFileInfo_put_final._cifsFileInfo_put.process_one_work
0.00 perf-sched.wait_time.max.ms.__cond_resched.dput.open_last_lookups.path_openat.do_filp_open
0.00 perf-sched.wait_time.max.ms.__cond_resched.dput.path_put.set_fs_pwd.__x64_sys_chdir
0.06 ? 86% perf-sched.wait_time.max.ms.__cond_resched.dput.path_put.vfs_statx.vfs_fstatat
0.00 perf-sched.wait_time.max.ms.__cond_resched.dput.terminate_walk.path_openat.do_filp_open
0.00 perf-sched.wait_time.max.ms.__cond_resched.kmem_cache_alloc.fcntl_setlk.do_fcntl.__x64_sys_fcntl
0.00 perf-sched.wait_time.max.ms.__cond_resched.kmem_cache_alloc.getname_flags.part.0
0.00 perf-sched.wait_time.max.ms.__cond_resched.kmem_cache_alloc_node.__alloc_skb.tcp_stream_alloc_skb.tcp_sendmsg_locked
0.00 perf-sched.wait_time.max.ms.__cond_resched.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl
0.00 perf-sched.wait_time.max.ms.__cond_resched.wait_for_response.compound_send_recv.cifs_send_recv.__SMB2_close
2.09 ? 38% perf-sched.wait_time.max.ms.__lock_sock.lock_sock_nested.tcp_recvmsg.inet6_recvmsg
2943 ? 23% perf-sched.wait_time.max.ms.__lock_sock.lock_sock_nested.tcp_sendmsg.sock_sendmsg
0.23 ? 65% perf-sched.wait_time.max.ms.exit_to_user_mode_loop.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt
0.43 ? 67% perf-sched.wait_time.max.ms.exit_to_user_mode_loop.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64
+36.7% 874.58 ? 13% perf-sched.wait_time.max.ms.kthreadd.ret_from_fork.ret_from_fork_asm
0.01 ? 32% perf-sched.wait_time.max.ms.wait_for_partner.fifo_open.do_dentry_open.do_open
-6.7% 214.64 ? 2% perf-sched.wait_time.max.ms.wait_for_response.compound_send_recv.smb2_compound_op.smb2_unlink
4011 ? 6% perf-sched.wait_time.max.ms.worker_thread.kthread.ret_from_fork.ret_from_fork_asm
*************************************************************************
threads 2 sockets Intel(R) Xeon(R) Platinum 8260L CPU @ 2.40GHz (Cascade Lake) with 128G memory
===============================================================
overnor/ip/kconfig/nr_threads/rootfs/runtime/tbox_group/test/testcase:
ormance/ipv4/x86_64-rhel-8.3/200%/debian-11.1-x86_64-20220510.cgz/300s/lkp-csl-2sp3/TCP_MAERTS/netperf
Remove sched_feat(START_DEBIT)")
Add lag based placement")
86bfbb7ce4f67a88df263919816
---------------------------
%stddev
\
+48.3% 4.786e+08 ? 13% cpuidle..time
+309.9% 6294878 ? 23% cpuidle..usage
+16.7% 273.00 vmstat.procs.r
-95.9% 444555 ? 6% vmstat.system.cs
-18.1% 116761 ? 11% vmstat.system.in
-40.7% 2.743e+08 numa-numastat.node0.local_node
-40.7% 2.741e+08 numa-numastat.node0.numa_hit
-36.1% 2.788e+08 ? 2% numa-numastat.node1.local_node
-36.2% 2.788e+08 ? 2% numa-numastat.node1.numa_hit
6354 ? 46% perf-c2c.DRAM.local
-33.2% 608.67 ? 43% perf-c2c.DRAM.remote
1482 ? 43% perf-c2c.HITM.local
-48.1% 101.33 ? 35% perf-c2c.HITM.remote
1584 ? 43% perf-c2c.HITM.total
52481 ? 20% meminfo.Active
51793 ? 20% meminfo.Active(anon)
+27.8% 225718 ? 9% meminfo.DirectMap4k
+11.5% 4723511 meminfo.Memused
63231 ? 11% meminfo.Shmem
-10.4% 4903564 meminfo.max_used_kB
1.57 ? 15% mpstat.cpu.all.idle%
0.00 mpstat.cpu.all.iowait%
2.46 mpstat.cpu.all.irq%
5.94 mpstat.cpu.all.soft%
83.89 mpstat.cpu.all.sys%
6.15 mpstat.cpu.all.usr%
2577 netperf.Throughput_Mbps
-56.6% 494893 netperf.Throughput_total_Mbps
+144.6% 1446798 netperf.time.involuntary_context_switches
4547 netperf.time.percent_of_cpu_this_job_got
13683 netperf.time.system_time
-68.2% 273.58 netperf.time.user_time
-96.1% 64354651 ? 5% netperf.time.voluntary_context_switches
-56.6% 1.133e+09 netperf.workload
6591 ? 48% numa-meminfo.node0.Active
6133 ? 46% numa-meminfo.node0.Active(anon)
10483 ? 35% numa-meminfo.node0.Shmem
53849 ? 13% numa-meminfo.node1.Active
53619 ? 13% numa-meminfo.node1.Active(anon)
6810 ? 36% numa-meminfo.node1.Mapped
+33.3% 1108221 ? 8% numa-meminfo.node1.MemUsed
74751 ?101% numa-meminfo.node1.Unevictable
14746 ? 10% proc-vmstat.nr_active_anon
10710 ? 9% proc-vmstat.nr_mapped
18514 ? 5% proc-vmstat.nr_shmem
14746 ? 10% proc-vmstat.nr_zone_active_anon
-38.5% 5.529e+08 proc-vmstat.numa_hit
-38.5% 5.531e+08 proc-vmstat.numa_local
-38.5% 4.415e+09 proc-vmstat.pgalloc_normal
-10.8% 811852 proc-vmstat.pgfault
-38.5% 4.414e+09 proc-vmstat.pgfree
40020 ? 8% proc-vmstat.pgreuse
+9.3% 3059968 ? 5% proc-vmstat.unevictable_pgs_scanned
1493 ? 47% numa-vmstat.node0.nr_active_anon
2541 ? 34% numa-vmstat.node0.nr_shmem
1493 ? 47% numa-vmstat.node0.nr_zone_active_anon
-40.7% 2.741e+08 numa-vmstat.node0.numa_hit
-40.7% 2.742e+08 numa-vmstat.node0.numa_local
13170 ? 17% numa-vmstat.node1.nr_active_anon
1674 ? 30% numa-vmstat.node1.nr_mapped
18687 ?101% numa-vmstat.node1.nr_unevictable
13170 ? 17% numa-vmstat.node1.nr_zone_active_anon
18687 ?101% numa-vmstat.node1.nr_zone_unevictable
-36.2% 2.787e+08 ? 2% numa-vmstat.node1.numa_hit
-36.1% 2.788e+08 ? 2% numa-vmstat.node1.numa_local
3018 turbostat.Avg_MHz
3083 turbostat.Bzy_MHz
+462.5% 4375927 ? 20% turbostat.C1
0.09 ? 23% turbostat.C1%
19371 ? 18% turbostat.C1E
0.02 turbostat.C1E%
+51.0% 402841 ? 14% turbostat.C6
1.47 ? 12% turbostat.C6%
1.68 ? 9% turbostat.CPU%c1
0.03 turbostat.IPC
-20.5% 34620615 ? 12% turbostat.IRQ
+223.4% 1475732 ? 39% turbostat.POLL
92.52 turbostat.RAMWatt
+54898.8% 6.639e+09 ? 30% sched_debug.cfs_rq:/.avg_vruntime.avg
+1.5e+06% 2.534e+11 ? 71% sched_debug.cfs_rq:/.avg_vruntime.max
+2180.3% 2.158e+08 ?127% sched_debug.cfs_rq:/.avg_vruntime.min
+1.4e+06% 2.727e+10 ? 69% sched_debug.cfs_rq:/.avg_vruntime.stddev
2.40 ? 3% sched_debug.cfs_rq:/.h_nr_running.avg
4.78 ? 5% sched_debug.cfs_rq:/.h_nr_running.max
0.83 ? 5% sched_debug.cfs_rq:/.h_nr_running.stddev
15714991 ? 82% sched_debug.cfs_rq:/.left_vruntime.avg
+9.8e+16% 9.788e+08 ? 57% sched_debug.cfs_rq:/.left_vruntime.max
21127 ? 42% sched_debug.cfs_rq:/.load.avg
600854 ? 59% sched_debug.cfs_rq:/.load.max
76002 ? 64% sched_debug.cfs_rq:/.load.stddev
+54878.0% 6.636e+09 ? 30% sched_debug.cfs_rq:/.min_vruntime.avg
+1.5e+06% 2.534e+11 ? 71% sched_debug.cfs_rq:/.min_vruntime.max
+2180.3% 2.158e+08 ?127% sched_debug.cfs_rq:/.min_vruntime.min
+1.4e+06% 2.727e+10 ? 69% sched_debug.cfs_rq:/.min_vruntime.stddev
1.56 ? 22% sched_debug.cfs_rq:/.nr_running.max
0.12 ? 38% sched_debug.cfs_rq:/.nr_running.stddev
60.09 ?116% sched_debug.cfs_rq:/.removed.load_avg.avg
532.16 ?128% sched_debug.cfs_rq:/.removed.load_avg.stddev
15966955 ? 81% sched_debug.cfs_rq:/.right_vruntime.avg
+9.9e+16% 9.896e+08 ? 56% sched_debug.cfs_rq:/.right_vruntime.max
2485 ? 3% sched_debug.cfs_rq:/.runnable_avg.avg
4352 ? 4% sched_debug.cfs_rq:/.runnable_avg.max
+47.6% 733.33 ? 6% sched_debug.cfs_rq:/.runnable_avg.stddev
1596 ? 4% sched_debug.cfs_rq:/.util_avg.max
-45.6% 268.33 ? 16% sched_debug.cfs_rq:/.util_avg.min
+28.3% 199.40 ? 2% sched_debug.cfs_rq:/.util_avg.stddev
+16.5% 855.34 sched_debug.cfs_rq:/.util_est_enqueued.avg
1986 ? 6% sched_debug.cfs_rq:/.util_est_enqueued.max
+24.8% 194.00 ? 6% sched_debug.cfs_rq:/.util_est_enqueued.min
+18.1% 355.87 ? 3% sched_debug.cfs_rq:/.util_est_enqueued.stddev
37518 ? 10% sched_debug.cpu.avg_idle.min
94.33 ? 13% sched_debug.cpu.clock.stddev
+10.1% 179321 sched_debug.cpu.clock_task.min
-39.3% 904.09 ? 4% sched_debug.cpu.clock_task.stddev
0.00 ? 13% sched_debug.cpu.next_balance.stddev
2.40 ? 3% sched_debug.cpu.nr_running.avg
4.83 ? 5% sched_debug.cpu.nr_running.max
0.83 ? 5% sched_debug.cpu.nr_running.stddev
-96.1% 641907 sched_debug.cpu.nr_switches.avg
-86.5% 2559350 ? 4% sched_debug.cpu.nr_switches.max
-98.0% 263371 ? 6% sched_debug.cpu.nr_switches.min
-83.5% 304052 ? 3% sched_debug.cpu.nr_switches.stddev
+300.0% 1.172e+08 sched_debug.sysctl_sched.sysctl_sched_features
61.02 perf-stat.i.MPKI
-76.6% 5.97e+09 ? 7% perf-stat.i.branch-instructions
1.17 perf-stat.i.branch-miss-rate%
-81.7% 68308705 ? 7% perf-stat.i.branch-misses
69.77 perf-stat.i.cache-miss-rate%
+762.5% 1.31e+09 ? 5% perf-stat.i.cache-misses
+24.3% 1.877e+09 ? 6% perf-stat.i.cache-references
-95.1% 539736 ? 9% perf-stat.i.context-switches
10.90 perf-stat.i.cpi
+17.0% 112365 ? 6% perf-stat.i.cpu-clock
+27.6% 3.333e+11 ? 5% perf-stat.i.cpu-cycles
+15.6% 906.45 ? 4% perf-stat.i.cpu-migrations
-89.8% 310.17 ? 6% perf-stat.i.cycles-between-cache-misses
-77.5% 3856145 ? 43% perf-stat.i.dTLB-load-misses
-77.1% 8.78e+09 ? 7% perf-stat.i.dTLB-loads
0.01 perf-stat.i.dTLB-store-miss-rate%
-90.1% 379087 ? 8% perf-stat.i.dTLB-store-misses
-77.5% 4.999e+09 ? 7% perf-stat.i.dTLB-stores
84.09 perf-stat.i.iTLB-load-miss-rate%
-78.0% 29068110 ? 8% perf-stat.i.iTLB-load-misses
-94.8% 5569730 ? 7% perf-stat.i.iTLB-loads
-76.5% 3.127e+10 ? 7% perf-stat.i.instructions
1156 perf-stat.i.instructions-per-iTLB-miss
0.11 ? 4% perf-stat.i.ipc
2.96 perf-stat.i.metric.GHz
-54.4% 208.63 perf-stat.i.metric.K/sec
-78.2% 198.86 perf-stat.i.metric.M/sec
3007 ? 13% perf-stat.i.minor-faults
4.60 ? 22% perf-stat.i.node-load-miss-rate%
+1803.7% 4.519e+08 ? 5% perf-stat.i.node-loads
5.25 ? 23% perf-stat.i.node-store-miss-rate%
+43.0% 5899737 ? 8% perf-stat.i.node-store-misses
+905.7% 2.141e+08 ? 6% perf-stat.i.node-stores
3008 ? 13% perf-stat.i.page-faults
+17.0% 112365 ? 6% perf-stat.i.task-clock
61.95 perf-stat.overall.MPKI
1.13 perf-stat.overall.branch-miss-rate%
71.32 perf-stat.overall.cache-miss-rate%
11.07 perf-stat.overall.cpi
-86.0% 250.63 perf-stat.overall.cycles-between-cache-misses
0.01 perf-stat.overall.dTLB-store-miss-rate%
84.27 perf-stat.overall.iTLB-load-miss-rate%
1084 perf-stat.overall.instructions-per-iTLB-miss
0.09 perf-stat.overall.ipc
2.03 perf-stat.overall.node-load-miss-rate%
2.76 ? 5% perf-stat.overall.node-store-miss-rate%
7041 perf-stat.overall.path-length
-80.5% 4.951e+09 perf-stat.ps.branch-instructions
-85.0% 55888599 perf-stat.ps.branch-misses
+651.3% 1.146e+09 perf-stat.ps.cache-misses
+6.8% 1.607e+09 perf-stat.ps.cache-references
-96.1% 424862 ? 5% perf-stat.ps.context-switches
+10.3% 2.873e+11 perf-stat.ps.cpu-cycles
-6.9% 726.59 ? 7% perf-stat.ps.cpu-migrations
-81.4% 3186378 ? 39% perf-stat.ps.dTLB-load-misses
-80.9% 7.291e+09 perf-stat.ps.dTLB-loads
-91.7% 318568 perf-stat.ps.dTLB-store-misses
-81.2% 4.155e+09 perf-stat.ps.dTLB-stores
-81.9% 23917524 perf-stat.ps.iTLB-load-misses
-95.8% 4467618 ? 5% perf-stat.ps.iTLB-loads
-80.4% 2.595e+10 perf-stat.ps.instructions
0.11 ? 23% perf-stat.ps.major-faults
2045 perf-stat.ps.minor-faults
-27.6% 8267014 perf-stat.ps.node-load-misses
+1558.8% 3.98e+08 perf-stat.ps.node-loads
+26.1% 5184959 ? 5% perf-stat.ps.node-store-misses
+746.0% 1.824e+08 perf-stat.ps.node-stores
2045 perf-stat.ps.page-faults
-80.1% 7.976e+12 perf-stat.total.instructions
33.19 ? 2% perf-profile.calltrace.cycles-pp.accept_connections.main.__libc_start_main
33.19 ? 2% perf-profile.calltrace.cycles-pp.accept_connection.accept_connections.main.__libc_start_main
33.19 ? 2% perf-profile.calltrace.cycles-pp.spawn_child.accept_connection.accept_connections.main.__libc_start_main
33.19 ? 2% perf-profile.calltrace.cycles-pp.process_requests.spawn_child.accept_connection.accept_connections.main
4.79 ? 3% perf-profile.calltrace.cycles-pp.__local_bh_enable_ip.__dev_queue_xmit.ip_finish_output2.__ip_queue_xmit.__tcp_transmit_skb
4.78 ? 3% perf-profile.calltrace.cycles-pp.do_softirq.__local_bh_enable_ip.__dev_queue_xmit.ip_finish_output2.__ip_queue_xmit
2.30 ? 14% perf-profile.calltrace.cycles-pp.__dev_queue_xmit.ip_finish_output2.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit
4.77 ? 3% perf-profile.calltrace.cycles-pp.__do_softirq.do_softirq.__local_bh_enable_ip.__dev_queue_xmit.ip_finish_output2
2.85 ? 12% perf-profile.calltrace.cycles-pp.__napi_poll.net_rx_action.__do_softirq.do_softirq.__local_bh_enable_ip
2.84 ? 12% perf-profile.calltrace.cycles-pp.process_backlog.__napi_poll.net_rx_action.__do_softirq.do_softirq
2.80 ? 12% perf-profile.calltrace.cycles-pp.__netif_receive_skb_one_core.process_backlog.__napi_poll.net_rx_action.__do_softirq
4.64 ? 3% perf-profile.calltrace.cycles-pp.net_rx_action.__do_softirq.do_softirq.__local_bh_enable_ip.__dev_queue_xmit
38.51 ? 17% perf-profile.calltrace.cycles-pp.recv_omni.process_requests.spawn_child.accept_connection.accept_connections
2.65 ? 12% perf-profile.calltrace.cycles-pp.ip_local_deliver_finish.__netif_receive_skb_one_core.process_backlog.__napi_poll.net_rx_action
2.65 ? 11% perf-profile.calltrace.cycles-pp.ip_protocol_deliver_rcu.ip_local_deliver_finish.__netif_receive_skb_one_core.process_backlog.__napi_poll
2.62 ? 12% perf-profile.calltrace.cycles-pp.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.__netif_receive_skb_one_core.process_backlog
1.49 ? 24% perf-profile.calltrace.cycles-pp.ip_finish_output2.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames
1.07 ? 5% perf-profile.calltrace.cycles-pp.__tcp_push_pending_frames.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto
1.05 ? 5% perf-profile.calltrace.cycles-pp.tcp_write_xmit.__tcp_push_pending_frames.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg
0.00 perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_sendmsg_locked.tcp_sendmsg
2.22 ? 4% perf-profile.calltrace.cycles-pp.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.__netif_receive_skb_one_core
0.00 perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_sendmsg_locked
2.22 ? 4% perf-profile.calltrace.cycles-pp.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish
41.39 perf-profile.calltrace.cycles-pp.__sys_sendto.__x64_sys_sendto.do_syscall_64.entry_SYSCALL_64_after_hwframe.__send
0.00 perf-profile.calltrace.cycles-pp.sk_wait_data.tcp_recvmsg_locked.tcp_recvmsg.inet_recvmsg.sock_recvmsg
0.00 perf-profile.calltrace.cycles-pp.tcp_data_queue.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu
40.60 perf-profile.calltrace.cycles-pp.sock_sendmsg.__sys_sendto.__x64_sys_sendto.do_syscall_64.entry_SYSCALL_64_after_hwframe
41.44 perf-profile.calltrace.cycles-pp.__x64_sys_sendto.do_syscall_64.entry_SYSCALL_64_after_hwframe.__send.recv_omni
40.31 perf-profile.calltrace.cycles-pp.tcp_sendmsg.sock_sendmsg.__sys_sendto.__x64_sys_sendto.do_syscall_64
4.27 ? 8% perf-profile.calltrace.cycles-pp.release_sock.tcp_sendmsg.sock_sendmsg.__sys_sendto.__x64_sys_sendto
0.00 perf-profile.calltrace.cycles-pp.wait_woken.sk_wait_data.tcp_recvmsg_locked.tcp_recvmsg.inet_recvmsg
4.13 ? 8% perf-profile.calltrace.cycles-pp.__release_sock.release_sock.tcp_sendmsg.sock_sendmsg.__sys_sendto
0.00 perf-profile.calltrace.cycles-pp.schedule_timeout.wait_woken.sk_wait_data.tcp_recvmsg_locked.tcp_recvmsg
0.00 perf-profile.calltrace.cycles-pp.schedule.schedule_timeout.wait_woken.sk_wait_data.tcp_recvmsg_locked
0.00 perf-profile.calltrace.cycles-pp.sock_def_readable.tcp_data_queue.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv
0.00 perf-profile.calltrace.cycles-pp.__schedule.schedule.schedule_timeout.wait_woken.sk_wait_data
0.00 perf-profile.calltrace.cycles-pp.__wake_up_common_lock.sock_def_readable.tcp_data_queue.tcp_rcv_established.tcp_v4_do_rcv
0.00 perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.sock_def_readable.tcp_data_queue.tcp_rcv_established
0.00 perf-profile.calltrace.cycles-pp.try_to_wake_up.__wake_up_common.__wake_up_common_lock.sock_def_readable.tcp_data_queue
3.05 perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_recvmsg_locked.tcp_recvmsg.inet_recvmsg.sock_recvmsg
3.09 ? 2% perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_recvmsg_locked.tcp_recvmsg.inet_recvmsg
1.88 ? 6% perf-profile.calltrace.cycles-pp.tcp_write_xmit.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto
0.91 ? 10% perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.tcp_sendmsg_locked.tcp_sendmsg
1.50 ? 22% perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_write_xmit.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg
0.86 ? 11% perf-profile.calltrace.cycles-pp.ip_finish_output2.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.tcp_sendmsg_locked
3.02 ? 2% perf-profile.calltrace.cycles-pp.ip_finish_output2.__ip_queue_xmit.__tcp_transmit_skb.tcp_recvmsg_locked.tcp_recvmsg
3.94 ? 8% perf-profile.calltrace.cycles-pp.tcp_v4_do_rcv.__release_sock.release_sock.tcp_sendmsg.sock_sendmsg
3.94 ? 8% perf-profile.calltrace.cycles-pp.tcp_rcv_established.tcp_v4_do_rcv.__release_sock.release_sock.tcp_sendmsg
2.67 ? 8% perf-profile.calltrace.cycles-pp.__tcp_push_pending_frames.tcp_rcv_established.tcp_v4_do_rcv.__release_sock.release_sock
2.67 ? 8% perf-profile.calltrace.cycles-pp.tcp_write_xmit.__tcp_push_pending_frames.tcp_rcv_established.tcp_v4_do_rcv.__release_sock
2.99 ? 2% perf-profile.calltrace.cycles-pp.__dev_queue_xmit.ip_finish_output2.__ip_queue_xmit.__tcp_transmit_skb.tcp_recvmsg_locked
1.73 ? 18% perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_rcv_established
2.74 perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_rcv_established.tcp_v4_do_rcv
0.88 perf-profile.calltrace.cycles-pp.tcp_ack.tcp_rcv_established.tcp_v4_do_rcv.__release_sock.release_sock
0.82 ? 4% perf-profile.calltrace.cycles-pp.tcp_clean_rtx_queue.tcp_ack.tcp_rcv_established.tcp_v4_do_rcv.__release_sock
0.83 ? 3% perf-profile.calltrace.cycles-pp.tcp_stream_alloc_skb.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto
0.91 ? 2% perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.recv.send_omni_inner
0.62 perf-profile.calltrace.cycles-pp.__alloc_skb.tcp_stream_alloc_skb.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg
5.29 perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.__send.recv_omni
35.76 perf-profile.calltrace.cycles-pp.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto.__x64_sys_sendto
1.31 ? 3% perf-profile.calltrace.cycles-pp.tcp_ack.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu
1.25 perf-profile.calltrace.cycles-pp.simple_copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg_locked.tcp_recvmsg
1.24 ? 4% perf-profile.calltrace.cycles-pp.tcp_clean_rtx_queue.tcp_ack.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv
1.23 perf-profile.calltrace.cycles-pp.__check_object_size.simple_copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg_locked
0.59 ? 7% perf-profile.calltrace.cycles-pp.try_charge_memcg.mem_cgroup_charge_skmem.__sk_mem_raise_allocated.__sk_mem_schedule.tcp_wmem_schedule
0.64 perf-profile.calltrace.cycles-pp.try_charge_memcg.mem_cgroup_charge_skmem.__sk_mem_raise_allocated.__sk_mem_schedule.tcp_try_rmem_schedule
1.18 perf-profile.calltrace.cycles-pp.check_heap_object.__check_object_size.simple_copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter
0.65 ? 4% perf-profile.calltrace.cycles-pp.skb_release_data.napi_consume_skb.net_rx_action.__do_softirq.do_softirq
0.65 ? 4% perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.rep_movs_alternative.copyout._copy_to_iter
0.66 ? 4% perf-profile.calltrace.cycles-pp.napi_consume_skb.net_rx_action.__do_softirq.do_softirq.__local_bh_enable_ip
1.39 perf-profile.calltrace.cycles-pp.__sk_mem_reduce_allocated.tcp_recvmsg_locked.tcp_recvmsg.inet_recvmsg.sock_recvmsg
0.75 ? 10% perf-profile.calltrace.cycles-pp.rmqueue.get_page_from_freelist.__alloc_pages.skb_page_frag_refill.sk_page_frag_refill
1.11 ? 9% perf-profile.calltrace.cycles-pp.__alloc_pages.skb_page_frag_refill.sk_page_frag_refill.tcp_sendmsg_locked.tcp_sendmsg
0.80 ? 4% perf-profile.calltrace.cycles-pp.tcp_write_xmit.__tcp_push_pending_frames.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv
0.80 ? 4% perf-profile.calltrace.cycles-pp.__tcp_push_pending_frames.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu
0.95 ? 3% perf-profile.calltrace.cycles-pp.mem_cgroup_charge_skmem.__sk_mem_raise_allocated.__sk_mem_schedule.tcp_try_rmem_schedule.tcp_data_queue
0.99 ? 9% perf-profile.calltrace.cycles-pp.get_page_from_freelist.__alloc_pages.skb_page_frag_refill.sk_page_frag_refill.tcp_sendmsg_locked
1.00 ? 2% perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.rep_movs_alternative.copyout._copy_to_iter.__skb_datagram_iter
1.02 ? 2% perf-profile.calltrace.cycles-pp.__sk_mem_raise_allocated.__sk_mem_schedule.tcp_try_rmem_schedule.tcp_data_queue.tcp_rcv_established
1.02 ? 3% perf-profile.calltrace.cycles-pp.__sk_mem_schedule.tcp_try_rmem_schedule.tcp_data_queue.tcp_rcv_established.tcp_v4_do_rcv
1.03 ? 2% perf-profile.calltrace.cycles-pp.tcp_try_rmem_schedule.tcp_data_queue.tcp_rcv_established.tcp_v4_do_rcv.__release_sock
1.95 ? 4% perf-profile.calltrace.cycles-pp.sk_page_frag_refill.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto
1.94 ? 4% perf-profile.calltrace.cycles-pp.skb_page_frag_refill.sk_page_frag_refill.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg
1.33 ? 18% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.free_pcppages_bulk.free_unref_page.skb_release_data
1.33 ? 3% perf-profile.calltrace.cycles-pp.__sk_mem_reduce_allocated.tcp_clean_rtx_queue.tcp_ack.tcp_rcv_established.tcp_v4_do_rcv
1.39 ? 18% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.free_pcppages_bulk.free_unref_page.skb_release_data.skb_attempt_defer_free
1.43 ? 2% perf-profile.calltrace.cycles-pp.tcp_data_queue.tcp_rcv_established.tcp_v4_do_rcv.__release_sock.release_sock
1.57 ? 3% perf-profile.calltrace.cycles-pp.tcp_rcv_established.tcp_v4_do_rcv.__release_sock.release_sock.tcp_recvmsg
1.84 ? 15% perf-profile.calltrace.cycles-pp.free_pcppages_bulk.free_unref_page.skb_release_data.skb_attempt_defer_free.tcp_recvmsg_locked
1.98 ? 2% perf-profile.calltrace.cycles-pp.tcp_v4_do_rcv.__release_sock.release_sock.tcp_recvmsg.inet_recvmsg
2.02 ? 2% perf-profile.calltrace.cycles-pp.__release_sock.release_sock.tcp_recvmsg.inet_recvmsg.sock_recvmsg
2.06 ? 2% perf-profile.calltrace.cycles-pp.release_sock.tcp_recvmsg.inet_recvmsg.sock_recvmsg.__sys_recvfrom
2.48 ? 13% perf-profile.calltrace.cycles-pp.free_unref_page.skb_release_data.skb_attempt_defer_free.tcp_recvmsg_locked.tcp_recvmsg
2.75 ? 13% perf-profile.calltrace.cycles-pp.skb_release_data.skb_attempt_defer_free.tcp_recvmsg_locked.tcp_recvmsg.inet_recvmsg
2.76 ? 13% perf-profile.calltrace.cycles-pp.skb_attempt_defer_free.tcp_recvmsg_locked.tcp_recvmsg.inet_recvmsg.sock_recvmsg
3.93 ? 4% perf-profile.calltrace.cycles-pp.mem_cgroup_charge_skmem.__sk_mem_raise_allocated.__sk_mem_schedule.tcp_wmem_schedule.tcp_sendmsg_locked
4.66 ? 3% perf-profile.calltrace.cycles-pp.tcp_wmem_schedule.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto
4.62 ? 3% perf-profile.calltrace.cycles-pp.__sk_mem_schedule.tcp_wmem_schedule.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg
4.55 ? 3% perf-profile.calltrace.cycles-pp.__sk_mem_raise_allocated.__sk_mem_schedule.tcp_wmem_schedule.tcp_sendmsg_locked.tcp_sendmsg
22.07 perf-profile.calltrace.cycles-pp.skb_do_copy_data_nocache.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto
20.97 perf-profile.calltrace.cycles-pp.rep_movs_alternative.copyin._copy_from_iter.skb_do_copy_data_nocache.tcp_sendmsg_locked
21.20 perf-profile.calltrace.cycles-pp.copyin._copy_from_iter.skb_do_copy_data_nocache.tcp_sendmsg_locked.tcp_sendmsg
21.54 perf-profile.calltrace.cycles-pp._copy_from_iter.skb_do_copy_data_nocache.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg
51.46 perf-profile.calltrace.cycles-pp.send_tcp_maerts.main.__libc_start_main
51.46 perf-profile.calltrace.cycles-pp.send_omni_inner.send_tcp_maerts.main.__libc_start_main
51.31 perf-profile.calltrace.cycles-pp.recv.send_omni_inner.send_tcp_maerts.main.__libc_start_main
51.43 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.recv.send_omni_inner.send_tcp_maerts.main
51.41 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.recv.send_omni_inner.send_tcp_maerts
48.09 perf-profile.calltrace.cycles-pp.tcp_recvmsg_locked.tcp_recvmsg.inet_recvmsg.sock_recvmsg.__sys_recvfrom
50.46 perf-profile.calltrace.cycles-pp.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe.recv
50.32 perf-profile.calltrace.cycles-pp.sock_recvmsg.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe
50.25 perf-profile.calltrace.cycles-pp.inet_recvmsg.sock_recvmsg.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64
50.47 perf-profile.calltrace.cycles-pp.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe.recv.send_omni_inner
50.24 perf-profile.calltrace.cycles-pp.tcp_recvmsg.inet_recvmsg.sock_recvmsg.__sys_recvfrom.__x64_sys_recvfrom
36.25 perf-profile.calltrace.cycles-pp.rep_movs_alternative.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter
36.88 perf-profile.calltrace.cycles-pp._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg_locked.tcp_recvmsg
36.72 perf-profile.calltrace.cycles-pp.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg_locked
38.69 perf-profile.calltrace.cycles-pp.skb_copy_datagram_iter.tcp_recvmsg_locked.tcp_recvmsg.inet_recvmsg.sock_recvmsg
38.68 perf-profile.calltrace.cycles-pp.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg_locked.tcp_recvmsg.inet_recvmsg
8.27 perf-profile.children.cycles-pp.__tcp_transmit_skb
7.09 perf-profile.children.cycles-pp.__ip_queue_xmit
6.78 perf-profile.children.cycles-pp.ip_finish_output2
6.67 perf-profile.children.cycles-pp.__dev_queue_xmit
6.92 ? 2% perf-profile.children.cycles-pp.tcp_write_xmit
5.87 perf-profile.children.cycles-pp.__local_bh_enable_ip
5.82 perf-profile.children.cycles-pp.do_softirq
6.14 perf-profile.children.cycles-pp.__do_softirq
4.41 ? 3% perf-profile.children.cycles-pp.__napi_poll
4.40 ? 3% perf-profile.children.cycles-pp.process_backlog
5.05 ? 4% perf-profile.children.cycles-pp.__tcp_push_pending_frames
4.30 ? 3% perf-profile.children.cycles-pp.__netif_receive_skb_one_core
5.86 perf-profile.children.cycles-pp.net_rx_action
38.52 ? 17% perf-profile.children.cycles-pp.accept_connections
3.98 ? 3% perf-profile.children.cycles-pp.ip_local_deliver_finish
3.97 ? 3% perf-profile.children.cycles-pp.ip_protocol_deliver_rcu
3.91 ? 3% perf-profile.children.cycles-pp.tcp_v4_rcv
0.62 ? 6% perf-profile.children.cycles-pp.__schedule
47.41 perf-profile.children.cycles-pp.__send
9.34 ? 2% perf-profile.children.cycles-pp.tcp_v4_do_rcv
8.85 ? 2% perf-profile.children.cycles-pp.tcp_rcv_established
47.50 perf-profile.children.cycles-pp.recv_omni
0.51 ? 5% perf-profile.children.cycles-pp.schedule
41.47 perf-profile.children.cycles-pp.__x64_sys_sendto
41.43 perf-profile.children.cycles-pp.__sys_sendto
0.37 ? 11% perf-profile.children.cycles-pp.sk_wait_data
40.63 perf-profile.children.cycles-pp.sock_sendmsg
40.35 perf-profile.children.cycles-pp.tcp_sendmsg
0.45 ? 5% perf-profile.children.cycles-pp.wait_woken
0.43 ? 6% perf-profile.children.cycles-pp.schedule_timeout
0.30 ? 9% perf-profile.children.cycles-pp.sock_def_readable
0.34 ? 7% perf-profile.children.cycles-pp.__wake_up_common_lock
2.33 perf-profile.children.cycles-pp.tcp_data_queue
6.38 ? 6% perf-profile.children.cycles-pp.release_sock
0.32 ? 6% perf-profile.children.cycles-pp.__wake_up_common
0.30 ? 8% perf-profile.children.cycles-pp.try_to_wake_up
6.19 ? 6% perf-profile.children.cycles-pp.__release_sock
0.17 ? 9% perf-profile.children.cycles-pp.ttwu_do_activate
0.36 perf-profile.children.cycles-pp.exit_to_user_mode_prepare
0.14 ? 11% perf-profile.children.cycles-pp.activate_task
0.14 ? 9% perf-profile.children.cycles-pp.enqueue_task_fair
0.12 ? 6% perf-profile.children.cycles-pp.pick_next_task_fair
0.13 ? 9% perf-profile.children.cycles-pp.dequeue_task_fair
0.20 ? 6% perf-profile.children.cycles-pp.__cond_resched
0.24 perf-profile.children.cycles-pp.exit_to_user_mode_loop
0.16 ? 5% perf-profile.children.cycles-pp.update_load_avg
0.37 ? 3% perf-profile.children.cycles-pp.kmem_cache_alloc_node
1.06 ? 3% perf-profile.children.cycles-pp.__alloc_skb
2.79 perf-profile.children.cycles-pp.tcp_ack
6.24 perf-profile.children.cycles-pp.syscall_exit_to_user_mode
0.08 ? 10% perf-profile.children.cycles-pp.enqueue_entity
0.16 ? 5% perf-profile.children.cycles-pp.update_curr
0.10 ? 12% perf-profile.children.cycles-pp.switch_mm_irqs_off
1.19 ? 2% perf-profile.children.cycles-pp.tcp_stream_alloc_skb
0.29 ? 4% perf-profile.children.cycles-pp.dev_hard_start_xmit
0.26 ? 4% perf-profile.children.cycles-pp.loopback_xmit
0.08 ? 6% perf-profile.children.cycles-pp.dequeue_entity
0.20 ? 4% perf-profile.children.cycles-pp.ip_rcv
0.10 ? 4% perf-profile.children.cycles-pp.switch_fpu_return
0.27 ? 6% perf-profile.children.cycles-pp.__kfree_skb
0.04 ? 71% perf-profile.children.cycles-pp.select_task_rq
0.08 ? 10% perf-profile.children.cycles-pp.restore_fpregs_from_fpstate
0.07 ? 11% perf-profile.children.cycles-pp.prepare_task_switch
0.04 ? 70% perf-profile.children.cycles-pp.select_task_rq_fair
0.05 ? 8% perf-profile.children.cycles-pp.__switch_to_asm
2.54 perf-profile.children.cycles-pp.tcp_clean_rtx_queue
0.07 perf-profile.children.cycles-pp.sched_clock_cpu
0.10 ? 8% perf-profile.children.cycles-pp.ip_rcv_finish_core
0.11 ? 4% perf-profile.children.cycles-pp.irqtime_account_irq
0.05 ? 8% perf-profile.children.cycles-pp.___perf_sw_event
0.05 ? 8% perf-profile.children.cycles-pp.dst_release
0.06 perf-profile.children.cycles-pp.sched_clock
0.23 ? 5% perf-profile.children.cycles-pp.sk_reset_timer
0.18 ? 5% perf-profile.children.cycles-pp.__tcp_send_ack
0.24 perf-profile.children.cycles-pp.tcp_current_mss
0.08 ? 6% perf-profile.children.cycles-pp.tcp_schedule_loss_probe
0.13 ? 7% perf-profile.children.cycles-pp.__netif_rx
0.24 perf-profile.children.cycles-pp.tcp_send_mss
0.14 ? 8% perf-profile.children.cycles-pp.__inet_lookup_established
0.25 ? 4% perf-profile.children.cycles-pp.tcp_event_new_data_sent
0.12 ? 6% perf-profile.children.cycles-pp.netif_rx_internal
0.06 ? 7% perf-profile.children.cycles-pp._raw_spin_lock
0.35 ? 3% perf-profile.children.cycles-pp._raw_spin_lock_bh
0.05 perf-profile.children.cycles-pp.native_sched_clock
0.06 ? 14% perf-profile.children.cycles-pp.__sk_dst_check
0.22 ? 5% perf-profile.children.cycles-pp.__mod_timer
0.10 ? 4% perf-profile.children.cycles-pp.tcp_mstamp_refresh
0.12 ? 6% perf-profile.children.cycles-pp.read_tsc
0.11 ? 4% perf-profile.children.cycles-pp.enqueue_to_backlog
0.10 ? 12% perf-profile.children.cycles-pp.__netif_receive_skb_core
0.13 perf-profile.children.cycles-pp.kmalloc_reserve
0.26 ? 4% perf-profile.children.cycles-pp.__virt_addr_valid
0.07 perf-profile.children.cycles-pp.ip_output
0.08 perf-profile.children.cycles-pp.validate_xmit_skb
0.06 perf-profile.children.cycles-pp.update_cfs_group
0.07 ? 6% perf-profile.children.cycles-pp.ip_rcv_core
0.07 ? 7% perf-profile.children.cycles-pp.sk_filter_trim_cap
0.17 ? 2% perf-profile.children.cycles-pp.__entry_text_start
0.05 perf-profile.children.cycles-pp.recv_data
0.03 ? 70% perf-profile.children.cycles-pp._raw_spin_lock_irq
0.35 ? 2% perf-profile.children.cycles-pp.kmem_cache_free
0.05 perf-profile.children.cycles-pp.ip_local_out
0.52 perf-profile.children.cycles-pp.sockfd_lookup_light
0.73 ? 4% perf-profile.children.cycles-pp.ktime_get
0.23 ? 3% perf-profile.children.cycles-pp.aa_sk_perm
0.10 ? 8% perf-profile.children.cycles-pp.send_data
0.05 perf-profile.children.cycles-pp.security_socket_recvmsg
0.10 ? 4% perf-profile.children.cycles-pp.ipv4_mtu
0.06 perf-profile.children.cycles-pp.update_rq_clock_task
0.15 ? 3% perf-profile.children.cycles-pp.tcp_tso_segs
0.07 perf-profile.children.cycles-pp.tcp_add_backlog
0.40 perf-profile.children.cycles-pp.__fget_light
0.09 perf-profile.children.cycles-pp.entry_SYSRETQ_unsafe_stack
0.08 ? 5% perf-profile.children.cycles-pp.tcp_rcv_space_adjust
0.03 ? 70% perf-profile.children.cycles-pp.syscall_return_via_sysret
0.08 ? 10% perf-profile.children.cycles-pp.rb_erase
0.22 ? 2% perf-profile.children.cycles-pp.lock_sock_nested
0.12 ? 7% perf-profile.children.cycles-pp.cgroup_rstat_updated
0.04 ? 71% perf-profile.children.cycles-pp.__list_add_valid
0.03 ? 70% perf-profile.children.cycles-pp.import_single_range
0.06 ? 8% perf-profile.children.cycles-pp.lock_timer_base
0.26 ? 4% perf-profile.children.cycles-pp.__skb_clone
0.06 ? 8% perf-profile.children.cycles-pp.tcp_mtu_probe
0.23 ? 3% perf-profile.children.cycles-pp.security_socket_sendmsg
0.06 ? 8% perf-profile.children.cycles-pp.check_stack_object
0.07 ? 7% perf-profile.children.cycles-pp.alloc_pages
0.09 ? 5% perf-profile.children.cycles-pp._raw_spin_trylock
0.11 ? 4% perf-profile.children.cycles-pp.kfree_skbmem
0.18 ? 5% perf-profile.children.cycles-pp.__tcp_cleanup_rbuf
0.31 ? 3% perf-profile.children.cycles-pp.tcp_check_space
0.09 ? 5% perf-profile.children.cycles-pp.__folio_put
0.09 ? 5% perf-profile.children.cycles-pp.free_unref_page_commit
0.05 perf-profile.children.cycles-pp.account_system_index_time
0.05 ? 8% perf-profile.children.cycles-pp.record__pushfn
0.05 ? 8% perf-profile.children.cycles-pp.__libc_write
0.05 ? 8% perf-profile.children.cycles-pp.writen
0.05 ? 8% perf-profile.children.cycles-pp.ksys_write
0.05 ? 8% perf-profile.children.cycles-pp.vfs_write
0.05 ? 8% perf-profile.children.cycles-pp.generic_file_write_iter
0.05 ? 8% perf-profile.children.cycles-pp.generic_perform_write
0.06 ? 16% perf-profile.children.cycles-pp.perf_mmap__push
0.06 ? 13% perf-profile.children.cycles-pp.__run_timers
0.06 ? 14% perf-profile.children.cycles-pp.ret_from_fork_asm
0.06 ? 14% perf-profile.children.cycles-pp.ret_from_fork
0.06 ? 14% perf-profile.children.cycles-pp.kthread
0.06 ? 7% perf-profile.children.cycles-pp.run_timer_softirq
0.06 ? 7% perf-profile.children.cycles-pp.record__mmap_read_evlist
0.14 ? 6% perf-profile.children.cycles-pp.task_mm_cid_work
0.14 ? 5% perf-profile.children.cycles-pp.task_work_run
0.07 ? 6% perf-profile.children.cycles-pp.__slab_free
0.07 ? 6% perf-profile.children.cycles-pp.run_builtin
0.07 ? 6% perf-profile.children.cycles-pp.cmd_record
0.07 ? 6% perf-profile.children.cycles-pp.__cmd_record
0.08 perf-profile.children.cycles-pp.folio_test_hugetlb
0.08 ? 11% perf-profile.children.cycles-pp.sk_stream_write_space
0.34 ? 5% perf-profile.children.cycles-pp.bpf_skops_write_hdr_opt
0.10 ? 4% perf-profile.children.cycles-pp.___slab_alloc
0.35 perf-profile.children.cycles-pp.__tcp_ack_snd_check
0.46 ? 2% perf-profile.children.cycles-pp.__list_del_entry_valid
0.14 ? 6% perf-profile.children.cycles-pp.__intel_pmu_enable_all
0.14 ? 3% perf-profile.children.cycles-pp.sk_stream_wait_memory
0.18 perf-profile.children.cycles-pp.__zone_watermark_ok
0.28 ? 3% perf-profile.children.cycles-pp.sock_rfree
0.34 ? 2% perf-profile.children.cycles-pp.tcp_queue_rcv
1.69 perf-profile.children.cycles-pp.__check_object_size
0.31 perf-profile.children.cycles-pp.skb_clone
0.31 ? 4% perf-profile.children.cycles-pp.task_tick_fair
0.45 ? 2% perf-profile.children.cycles-pp.perf_event_task_tick
0.45 ? 2% perf-profile.children.cycles-pp.perf_adjust_freq_unthr_context
0.28 ? 5% perf-profile.children.cycles-pp.propagate_protected_usage
0.28 ? 3% perf-profile.children.cycles-pp.skb_try_coalesce
0.40 ? 3% perf-profile.children.cycles-pp.__build_skb_around
0.31 ? 3% perf-profile.children.cycles-pp.tcp_try_coalesce
0.31 ? 3% perf-profile.children.cycles-pp.__irq_exit_rcu
0.87 ? 7% perf-profile.children.cycles-pp.mem_cgroup_uncharge_skmem
0.45 ? 4% perf-profile.children.cycles-pp.__free_one_page
0.67 ? 3% perf-profile.children.cycles-pp.__tcp_select_window
1.54 perf-profile.children.cycles-pp.check_heap_object
1.27 perf-profile.children.cycles-pp.simple_copy_to_iter
0.57 ? 2% perf-profile.children.cycles-pp.page_counter_uncharge
0.89 ? 4% perf-profile.children.cycles-pp.scheduler_tick
1.10 ? 3% perf-profile.children.cycles-pp.update_process_times
1.15 ? 3% perf-profile.children.cycles-pp.tick_sched_timer
1.12 ? 3% perf-profile.children.cycles-pp.tick_sched_handle
0.74 ? 11% perf-profile.children.cycles-pp.rmqueue_bulk
1.31 ? 2% perf-profile.children.cycles-pp.__hrtimer_run_queues
1.41 ? 2% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
1.40 ? 2% perf-profile.children.cycles-pp.hrtimer_interrupt
0.81 ? 4% perf-profile.children.cycles-pp.page_counter_try_charge
0.86 perf-profile.children.cycles-pp.drain_stock
1.17 ? 2% perf-profile.children.cycles-pp.refill_stock
1.09 ? 7% perf-profile.children.cycles-pp.rmqueue
1.33 perf-profile.children.cycles-pp.free_unref_page_prepare
1.42 ? 6% perf-profile.children.cycles-pp.get_page_from_freelist
1.72 perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
1.60 ? 5% perf-profile.children.cycles-pp.__alloc_pages
1.95 ? 5% perf-profile.children.cycles-pp.sk_page_frag_refill
1.94 ? 4% perf-profile.children.cycles-pp.skb_page_frag_refill
2.13 ? 15% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
1.31 ? 5% perf-profile.children.cycles-pp.napi_consume_skb
1.73 ? 2% perf-profile.children.cycles-pp.try_charge_memcg
1.36 perf-profile.children.cycles-pp.tcp_try_rmem_schedule
2.19 perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
3.05 ? 2% perf-profile.children.cycles-pp.__sk_mem_reduce_allocated
2.01 ? 13% perf-profile.children.cycles-pp.free_pcppages_bulk
2.06 ? 15% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
2.79 ? 12% perf-profile.children.cycles-pp.skb_attempt_defer_free
4.32 ? 6% perf-profile.children.cycles-pp.skb_release_data
3.53 ? 7% perf-profile.children.cycles-pp.free_unref_page
4.67 ? 3% perf-profile.children.cycles-pp.tcp_wmem_schedule
98.91 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
5.51 ? 3% perf-profile.children.cycles-pp.mem_cgroup_charge_skmem
98.83 perf-profile.children.cycles-pp.do_syscall_64
6.17 ? 2% perf-profile.children.cycles-pp.__sk_mem_schedule
6.12 ? 2% perf-profile.children.cycles-pp.__sk_mem_raise_allocated
22.08 perf-profile.children.cycles-pp.skb_do_copy_data_nocache
52.03 perf-profile.children.cycles-pp.recv
21.34 perf-profile.children.cycles-pp.copyin
21.55 perf-profile.children.cycles-pp._copy_from_iter
51.93 perf-profile.children.cycles-pp.send_tcp_maerts
52.03 perf-profile.children.cycles-pp.send_omni_inner
50.90 perf-profile.children.cycles-pp.__x64_sys_recvfrom
48.51 perf-profile.children.cycles-pp.tcp_recvmsg_locked
50.88 perf-profile.children.cycles-pp.__sys_recvfrom
50.73 perf-profile.children.cycles-pp.sock_recvmsg
50.67 perf-profile.children.cycles-pp.inet_recvmsg
50.65 perf-profile.children.cycles-pp.tcp_recvmsg
37.30 perf-profile.children.cycles-pp._copy_to_iter
37.15 perf-profile.children.cycles-pp.copyout
39.14 perf-profile.children.cycles-pp.skb_copy_datagram_iter
39.13 perf-profile.children.cycles-pp.__skb_datagram_iter
58.27 perf-profile.children.cycles-pp.rep_movs_alternative
0.09 ? 10% perf-profile.self.cycles-pp.switch_mm_irqs_off
0.09 ? 5% perf-profile.self.cycles-pp.update_curr
0.10 ? 4% perf-profile.self.cycles-pp.__schedule
0.32 ? 2% perf-profile.self.cycles-pp.__tcp_transmit_skb
0.09 perf-profile.self.cycles-pp.update_load_avg
0.08 ? 10% perf-profile.self.cycles-pp.restore_fpregs_from_fpstate
0.62 ? 5% perf-profile.self.cycles-pp.__dev_queue_xmit
0.05 ? 8% perf-profile.self.cycles-pp.__switch_to_asm
0.16 perf-profile.self.cycles-pp.tcp_ack
0.21 ? 4% perf-profile.self.cycles-pp.kmem_cache_alloc_node
0.10 ? 8% perf-profile.self.cycles-pp.ip_rcv_finish_core
0.19 ? 4% perf-profile.self.cycles-pp._raw_spin_lock_bh
0.05 ? 8% perf-profile.self.cycles-pp.dst_release
0.11 ? 7% perf-profile.self.cycles-pp.tcp_v4_rcv
0.22 ? 8% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.10 ? 4% perf-profile.self.cycles-pp.ip_finish_output2
0.08 ? 6% perf-profile.self.cycles-pp.__do_softirq
0.06 perf-profile.self.cycles-pp._raw_spin_lock
0.05 perf-profile.self.cycles-pp.native_sched_clock
0.07 ? 6% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
0.11 ? 7% perf-profile.self.cycles-pp.read_tsc
0.08 ? 10% perf-profile.self.cycles-pp.net_rx_action
0.10 ? 12% perf-profile.self.cycles-pp.__netif_receive_skb_core
0.07 ? 7% perf-profile.self.cycles-pp.__sys_recvfrom
0.12 ? 8% perf-profile.self.cycles-pp.__inet_lookup_established
0.07 ? 7% perf-profile.self.cycles-pp.send_omni_inner
0.26 ? 4% perf-profile.self.cycles-pp.__virt_addr_valid
0.10 ? 4% perf-profile.self.cycles-pp.__ip_queue_xmit
0.06 perf-profile.self.cycles-pp.update_cfs_group
0.03 ? 70% perf-profile.self.cycles-pp.loopback_xmit
0.23 ? 2% perf-profile.self.cycles-pp.tcp_clean_rtx_queue
0.07 perf-profile.self.cycles-pp.ip_rcv_core
0.06 ? 8% perf-profile.self.cycles-pp.process_backlog
0.37 perf-profile.self.cycles-pp.tcp_write_xmit
0.34 ? 2% perf-profile.self.cycles-pp.kmem_cache_free
0.03 ? 70% perf-profile.self.cycles-pp._raw_spin_lock_irq
0.32 ? 2% perf-profile.self.cycles-pp.__sys_sendto
0.03 ? 70% perf-profile.self.cycles-pp.ip_output
0.13 perf-profile.self.cycles-pp.tcp_rcv_established
0.07 ? 7% perf-profile.self.cycles-pp.__mod_timer
0.11 perf-profile.self.cycles-pp.tcp_current_mss
0.03 ? 70% perf-profile.self.cycles-pp.__local_bh_enable_ip
0.03 ? 70% perf-profile.self.cycles-pp.tcp_data_queue
0.12 perf-profile.self.cycles-pp.recv_omni
0.13 ? 9% perf-profile.self.cycles-pp.__send
0.42 perf-profile.self.cycles-pp.tcp_recvmsg_locked
0.21 ? 4% perf-profile.self.cycles-pp.aa_sk_perm
0.09 ? 5% perf-profile.self.cycles-pp.ipv4_mtu
0.03 ? 70% perf-profile.self.cycles-pp.tcp_v4_do_rcv
0.14 ? 3% perf-profile.self.cycles-pp.tcp_tso_segs
0.08 ? 5% perf-profile.self.cycles-pp.entry_SYSRETQ_unsafe_stack
0.40 perf-profile.self.cycles-pp.__fget_light
0.05 ? 8% perf-profile.self.cycles-pp.enqueue_to_backlog
0.07 ? 11% perf-profile.self.cycles-pp.send_data
0.27 ? 5% perf-profile.self.cycles-pp.__alloc_skb
0.03 ? 70% perf-profile.self.cycles-pp.tcp_event_new_data_sent
0.03 ? 70% perf-profile.self.cycles-pp.irqtime_account_irq
0.07 ? 11% perf-profile.self.cycles-pp.do_syscall_64
0.03 ? 70% perf-profile.self.cycles-pp.syscall_return_via_sysret
0.08 ? 6% perf-profile.self.cycles-pp.rb_erase
0.16 perf-profile.self.cycles-pp.__check_object_size
0.09 ? 5% perf-profile.self.cycles-pp.__entry_text_start
0.05 perf-profile.self.cycles-pp.copyout
0.03 ? 70% perf-profile.self.cycles-pp.__list_add_valid
0.12 ? 7% perf-profile.self.cycles-pp.cgroup_rstat_updated
0.20 ? 2% perf-profile.self.cycles-pp.copyin
0.03 ? 70% perf-profile.self.cycles-pp.tcp_wmem_schedule
0.10 ? 9% perf-profile.self.cycles-pp.skb_do_copy_data_nocache
0.06 ? 8% perf-profile.self.cycles-pp.tcp_mtu_probe
0.05 perf-profile.self.cycles-pp.check_stack_object
0.22 ? 7% perf-profile.self.cycles-pp.tcp_check_space
0.03 ? 70% perf-profile.self.cycles-pp.__sk_mem_schedule
0.15 ? 6% perf-profile.self.cycles-pp._copy_to_iter
0.43 perf-profile.self.cycles-pp.skb_release_data
0.08 ? 5% perf-profile.self.cycles-pp._raw_spin_trylock
0.11 perf-profile.self.cycles-pp.kfree_skbmem
0.12 ? 4% perf-profile.self.cycles-pp.get_page_from_freelist
0.21 ? 2% perf-profile.self.cycles-pp._copy_from_iter
0.18 ? 5% perf-profile.self.cycles-pp.__alloc_pages
0.06 ? 8% perf-profile.self.cycles-pp.rmqueue_bulk
0.13 ? 3% perf-profile.self.cycles-pp.task_mm_cid_work
0.07 perf-profile.self.cycles-pp.___slab_alloc
0.07 ? 6% perf-profile.self.cycles-pp.__slab_free
0.08 ? 6% perf-profile.self.cycles-pp.folio_test_hugetlb
0.08 ? 10% perf-profile.self.cycles-pp.free_unref_page_commit
0.19 ? 2% perf-profile.self.cycles-pp.rmqueue
0.29 perf-profile.self.cycles-pp.skb_page_frag_refill
0.33 ? 5% perf-profile.self.cycles-pp.bpf_skops_write_hdr_opt
0.26 ? 3% perf-profile.self.cycles-pp.sock_rfree
0.31 ? 2% perf-profile.self.cycles-pp.perf_adjust_freq_unthr_context
0.14 ? 6% perf-profile.self.cycles-pp.__intel_pmu_enable_all
0.45 ? 2% perf-profile.self.cycles-pp.__list_del_entry_valid
0.18 perf-profile.self.cycles-pp.__zone_watermark_ok
0.61 ? 6% perf-profile.self.cycles-pp.ktime_get
0.31 perf-profile.self.cycles-pp.skb_clone
0.51 perf-profile.self.cycles-pp.__skb_datagram_iter
0.27 ? 3% perf-profile.self.cycles-pp.skb_try_coalesce
0.28 ? 5% perf-profile.self.cycles-pp.propagate_protected_usage
0.29 ? 9% perf-profile.self.cycles-pp.drain_stock
0.39 ? 2% perf-profile.self.cycles-pp.__build_skb_around
0.39 ? 4% perf-profile.self.cycles-pp.__free_one_page
0.83 ? 7% perf-profile.self.cycles-pp.mem_cgroup_uncharge_skmem
0.41 ? 3% perf-profile.self.cycles-pp.page_counter_uncharge
0.66 ? 3% perf-profile.self.cycles-pp.__tcp_select_window
0.84 ? 2% perf-profile.self.cycles-pp.try_charge_memcg
0.80 ? 4% perf-profile.self.cycles-pp.__sk_mem_raise_allocated
1.06 ? 2% perf-profile.self.cycles-pp.__sk_mem_reduce_allocated
0.67 ? 3% perf-profile.self.cycles-pp.page_counter_try_charge
1.99 perf-profile.self.cycles-pp.tcp_sendmsg_locked
1.18 perf-profile.self.cycles-pp.check_heap_object
1.29 perf-profile.self.cycles-pp.free_unref_page_prepare
5.86 perf-profile.self.cycles-pp.syscall_exit_to_user_mode
2.06 ? 15% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
3.56 ? 5% perf-profile.self.cycles-pp.mem_cgroup_charge_skmem
57.15 perf-profile.self.cycles-pp.rep_movs_alternative
estimated based on internal Intel analysis and are provided
purposes only. Any difference in system hardware or software
may affect actual performance.
om/intel/lkp-tests/wiki">https://github.com/intel/lkp-tests/wiki