lkml.org 
[lkml]   [2020]   [Jun]   [15]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
 
Messages in this thread
/
SubjectRe: [LKP] [rcu] 276c410448: will-it-scale.per_thread_ops -12.3% regression
From
Date
Hi Paul,

Do you have time to take a look at this? Thanks.

On 6/15/2020 4:57 PM, kernel test robot wrote:
> Greeting,
>
> FYI, we noticed a -12.3% regression of will-it-scale.per_thread_ops due to commit:
>
>
> commit: 276c410448dbca357a2bc3539acfe04862e5f172 ("rcu-tasks: Split ->trc_reader_need_end")
> https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
>
> in testcase: will-it-scale
> on test machine: 288 threads Intel(R) Xeon Phi(TM) CPU 7295 @ 1.50GHz with 80G memory
> with following parameters:
>
> nr_task: 100%
> mode: thread
> test: page_fault3
> cpufreq_governor: performance
> ucode: 0x11
>
> test-description: Will It Scale takes a testcase and runs it from 1 through to n parallel copies to see if the testcase will scale. It builds both a process and threads based test in order to see any differences between the two.
> test-url: https://github.com/antonblanchard/will-it-scale
>
>
>
> If you fix the issue, kindly add following tag
> Reported-by: kernel test robot <rong.a.chen@intel.com>
>
>
> Details are as below:
> -------------------------------------------------------------------------------------------------->
>
>
> To reproduce:
>
> git clone https://github.com/intel/lkp-tests.git
> cd lkp-tests
> bin/lkp install job.yaml # job file is attached in this email
> bin/lkp run job.yaml
>
> =========================================================================================
> compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode:
> gcc-9/performance/x86_64-rhel-7.6/thread/100%/debian-x86_64-20191114.cgz/lkp-knm01/page_fault3/will-it-scale/0x11
>
> commit:
> b0afa0f056 ("rcu-tasks: Provide boot parameter to delay IPIs until late in grace period")
> 276c410448 ("rcu-tasks: Split ->trc_reader_need_end")
>
> b0afa0f056676ffe 276c410448dbca357a2bc3539ac
> ---------------- ---------------------------
> fail:runs %reproduction fail:runs
> | | |
> 2:4 -50% :4 dmesg.WARNING:at#for_ip_interrupt_entry/0x
> :4 28% 1:4 perf-profile.calltrace.cycles-pp.error_entry
> 0:4 0% 0:4 perf-profile.children.cycles-pp.error_exit
> 1:4 7% 2:4 perf-profile.children.cycles-pp.error_entry
> 0:4 4% 1:4 perf-profile.self.cycles-pp.error_entry
> %stddev %change %stddev
> \ | \
> 1414 -12.3% 1241 ± 2% will-it-scale.per_thread_ops
> 463.32 +1.7% 470.99 will-it-scale.time.elapsed_time
> 463.32 +1.7% 470.99 will-it-scale.time.elapsed_time.max
> 407566 -12.3% 357573 ± 2% will-it-scale.workload
> 48.51 -1.5% 47.77 boot-time.boot
> 7.203e+10 +20.0% 8.64e+10 ± 2% cpuidle.C1.time
> 2.162e+08 ± 2% +27.7% 2.761e+08 ± 2% cpuidle.C1.usage
> 60.50 +12.2 72.74 ± 2% mpstat.cpu.all.idle%
> 39.17 -12.2 26.97 ± 6% mpstat.cpu.all.sys%
> 2334 ± 12% +18.8% 2772 ± 5% slabinfo.khugepaged_mm_slot.active_objs
> 2334 ± 12% +18.8% 2772 ± 5% slabinfo.khugepaged_mm_slot.num_objs
> 60.25 +20.3% 72.50 ± 2% vmstat.cpu.id
> 92.75 ± 3% -21.6% 72.75 ± 5% vmstat.procs.r
> 223709 +41.8% 317250 ± 3% vmstat.system.cs
> 641687 ± 3% +8.0% 693245 ± 2% proc-vmstat.nr_inactive_anon
> 641688 ± 3% +8.0% 693245 ± 2% proc-vmstat.nr_zone_inactive_anon
> 166782 -3.7% 160632 proc-vmstat.numa_hint_faults
> 166782 -3.7% 160632 proc-vmstat.numa_hint_faults_local
> 984.25 -14.2% 844.75 ± 2% proc-vmstat.numa_huge_pte_updates
> 710979 -11.2% 631134 proc-vmstat.numa_pte_updates
> 1.967e+08 -10.9% 1.752e+08 proc-vmstat.pgfault
> 58.18 +3.4% 60.17 perf-stat.i.MPKI
> 1.173e+09 +10.5% 1.296e+09 perf-stat.i.branch-instructions
> 6.74 -0.1 6.68 perf-stat.i.branch-miss-rate%
> 72495831 +10.7% 80219684 perf-stat.i.branch-misses
> 14.68 -0.6 14.06 perf-stat.i.cache-miss-rate%
> 43014696 +10.5% 47551690 perf-stat.i.cache-misses
> 2.936e+08 +15.6% 3.393e+08 perf-stat.i.cache-references
> 227441 +42.0% 323034 ± 3% perf-stat.i.context-switches
> 37.22 -29.0% 26.44 ± 5% perf-stat.i.cpi
> 1.828e+11 -22.3% 1.421e+11 ± 3% perf-stat.i.cpu-cycles
> 513.71 +13.6% 583.63 perf-stat.i.cpu-migrations
> 4303 -27.8% 3107 ± 5% perf-stat.i.cycles-between-cache-misses
> 1.78 -0.0 1.74 perf-stat.i.iTLB-load-miss-rate%
> 90757979 +9.1% 98982336 perf-stat.i.iTLB-load-misses
> 5.518e+09 +10.1% 6.076e+09 perf-stat.i.iTLB-loads
> 5.501e+09 +10.3% 6.065e+09 perf-stat.i.instructions
> 59.50 +2.4% 60.91 perf-stat.i.instructions-per-iTLB-miss
> 0.03 +48.9% 0.05 ± 3% perf-stat.i.ipc
> 0.61 -22.2% 0.47 ± 3% perf-stat.i.metric.GHz
> 0.85 ± 2% +6.3% 0.90 ± 3% perf-stat.i.metric.K/sec
> 23.19 +10.3% 25.58 perf-stat.i.metric.M/sec
> 398027 -13.3% 345187 ± 2% perf-stat.i.minor-faults
> 398027 -13.3% 345187 ± 2% perf-stat.i.page-faults
> 51.63 +4.7% 54.06 perf-stat.overall.MPKI
> 14.82 -0.6 14.26 perf-stat.overall.cache-miss-rate%
> 32.82 -28.9% 23.34 ± 4% perf-stat.overall.cpi
> 4290 -29.4% 3029 ± 5% perf-stat.overall.cycles-between-cache-misses
> 0.03 +40.9% 0.04 ± 4% perf-stat.overall.ipc
> 6447068 +28.0% 8254132 ± 3% perf-stat.overall.path-length
> 1.214e+09 +10.5% 1.341e+09 perf-stat.ps.branch-instructions
> 72454767 +10.7% 80188768 perf-stat.ps.branch-misses
> 43379426 +11.2% 48228470 perf-stat.ps.cache-misses
> 2.927e+08 +15.5% 3.382e+08 ± 2% perf-stat.ps.cache-references
> 223136 +42.0% 316818 ± 3% perf-stat.ps.context-switches
> 1.861e+11 -21.6% 1.459e+11 ± 3% perf-stat.ps.cpu-cycles
> 498.80 +14.0% 568.54 perf-stat.ps.cpu-migrations
> 90216145 +8.9% 98279965 perf-stat.ps.iTLB-load-misses
> 5.688e+09 +10.2% 6.267e+09 perf-stat.ps.iTLB-loads
> 5.67e+09 +10.3% 6.256e+09 perf-stat.ps.instructions
> 404137 -13.0% 351604 ± 2% perf-stat.ps.minor-faults
> 404137 -13.0% 351604 ± 2% perf-stat.ps.page-faults
> 2.627e+12 +12.2% 2.949e+12 perf-stat.total.instructions
> 84210 -25.9% 62375 ± 5% sched_debug.cfs_rq:/.exec_clock.avg
> 91870 ± 3% -23.3% 70486 ± 5% sched_debug.cfs_rq:/.exec_clock.max
> 79683 -23.1% 61285 ± 6% sched_debug.cfs_rq:/.exec_clock.min
> 2299 ± 7% +36.5% 3139 ± 12% sched_debug.cfs_rq:/.load.avg
> 216559 +81.8% 393746 ± 14% sched_debug.cfs_rq:/.load.max
> 16561 ± 3% +64.0% 27165 ± 14% sched_debug.cfs_rq:/.load.stddev
> 2.32 ± 11% -19.6% 1.87 ± 14% sched_debug.cfs_rq:/.load_avg.avg
> 18373664 ± 3% -19.7% 14762699 ± 8% sched_debug.cfs_rq:/.min_vruntime.avg
> 18652687 ± 3% -19.9% 14948853 ± 8% sched_debug.cfs_rq:/.min_vruntime.max
> 17259651 ± 3% -20.6% 13706324 ± 9% sched_debug.cfs_rq:/.min_vruntime.min
> 0.09 ± 4% -30.2% 0.06 ± 8% sched_debug.cfs_rq:/.nr_running.avg
> 0.27 ± 2% -14.3% 0.24 ± 5% sched_debug.cfs_rq:/.nr_running.stddev
> 18.07 ± 2% -31.0% 12.47 ± 5% sched_debug.cfs_rq:/.nr_spread_over.avg
> 1.97 ± 34% -49.2% 1.00 ± 57% sched_debug.cfs_rq:/.nr_spread_over.min
> 258.66 ± 6% -38.4% 159.22 ± 5% sched_debug.cfs_rq:/.runnable_avg.avg
> 231.14 -13.6% 199.77 ± 7% sched_debug.cfs_rq:/.runnable_avg.stddev
> 302282 ± 40% -44.4% 168177 ± 29% sched_debug.cfs_rq:/.spread0.avg
> 568464 ± 36% -39.3% 344858 ± 16% sched_debug.cfs_rq:/.spread0.max
> 252.26 ± 6% -38.7% 154.72 ± 5% sched_debug.cfs_rq:/.util_avg.avg
> 217.63 -15.4% 184.13 ± 6% sched_debug.cfs_rq:/.util_avg.stddev
> 18.44 ± 12% -50.3% 9.17 ± 9% sched_debug.cfs_rq:/.util_est_enqueued.avg
> 575.84 ± 17% -22.2% 447.81 ± 16% sched_debug.cfs_rq:/.util_est_enqueued.max
> 67.91 ± 9% -35.4% 43.85 ± 9% sched_debug.cfs_rq:/.util_est_enqueued.stddev
> 417156 ± 7% -15.2% 353896 ± 5% sched_debug.cpu.avg_idle.stddev
> 273.72 ± 3% -11.3% 242.79 ± 4% sched_debug.cpu.clock.stddev
> 273.72 ± 3% -11.3% 242.79 ± 4% sched_debug.cpu.clock_task.stddev
> 426.78 ± 3% -27.6% 309.10 ± 12% sched_debug.cpu.curr->pid.avg
> 1282 ± 2% -12.4% 1123 ± 6% sched_debug.cpu.curr->pid.stddev
> 351857 ± 3% -16.4% 294246 ± 4% sched_debug.cpu.max_idle_balance_cost.stddev
> 0.00 -11.8% 0.00 ± 3% sched_debug.cpu.next_balance.stddev
> 0.09 ± 3% -32.0% 0.06 ± 12% sched_debug.cpu.nr_running.avg
> 0.28 -14.6% 0.24 ± 7% sched_debug.cpu.nr_running.stddev
> 163725 +37.4% 225040 ± 4% sched_debug.cpu.nr_switches.avg
> 174783 +35.4% 236604 ± 4% sched_debug.cpu.nr_switches.max
> 151538 +36.4% 206743 ± 4% sched_debug.cpu.nr_switches.min
> 2143 ± 4% +28.5% 2753 ± 4% sched_debug.cpu.nr_switches.stddev
> 160974 +38.1% 222280 ± 4% sched_debug.cpu.sched_count.avg
> 170145 +36.7% 232581 ± 4% sched_debug.cpu.sched_count.max
> 148944 +37.6% 204888 ± 4% sched_debug.cpu.sched_count.min
> 1847 ± 8% +38.7% 2563 ± 6% sched_debug.cpu.sched_count.stddev
> 80136 +38.3% 110820 ± 4% sched_debug.cpu.sched_goidle.avg
> 84559 +36.9% 115782 ± 4% sched_debug.cpu.sched_goidle.max
> 74091 +37.8% 102072 ± 4% sched_debug.cpu.sched_goidle.min
> 891.35 ± 6% +41.4% 1260 ± 6% sched_debug.cpu.sched_goidle.stddev
> 80346 +38.2% 111003 ± 4% sched_debug.cpu.ttwu_count.avg
> 114308 ± 2% +42.7% 163080 ± 6% sched_debug.cpu.ttwu_count.max
> 62759 ± 3% +38.4% 86881 ± 2% sched_debug.cpu.ttwu_count.min
> 8223 ± 7% +53.5% 12623 ± 13% sched_debug.cpu.ttwu_count.stddev
> 2.35 ± 10% -0.7 1.65 ± 14% perf-profile.calltrace.cycles-pp.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
> 0.94 ± 15% -0.5 0.44 ± 58% perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.rwsem_down_read_slowpath.do_user_addr_fault.page_fault
> 0.90 ± 15% -0.5 0.42 ± 58% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.rwsem_down_read_slowpath.do_user_addr_fault.page_fault
> 1.38 ± 4% -0.4 0.94 ± 12% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state
> 0.81 ± 4% +0.1 0.91 ± 4% perf-profile.calltrace.cycles-pp.file_update_time.fault_dirty_shared_page.do_fault.__handle_mm_fault.handle_mm_fault
> 1.35 ± 6% +0.2 1.51 ± 3% perf-profile.calltrace.cycles-pp.find_get_entry.find_lock_entry.shmem_getpage_gfp.shmem_fault.__do_fault
> 1.16 ± 7% +0.2 1.33 ± 5% perf-profile.calltrace.cycles-pp.unlock_page.fault_dirty_shared_page.do_fault.__handle_mm_fault.handle_mm_fault
> 1.29 ± 8% +0.2 1.46 ± 7% perf-profile.calltrace.cycles-pp._raw_spin_lock.alloc_set_pte.finish_fault.do_fault.__handle_mm_fault
> 1.76 ± 7% +0.3 2.04 ± 5% perf-profile.calltrace.cycles-pp.page_add_file_rmap.alloc_set_pte.finish_fault.do_fault.__handle_mm_fault
> 2.13 ± 5% +0.3 2.41 ± 4% perf-profile.calltrace.cycles-pp.fault_dirty_shared_page.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault
> 2.46 ± 8% +0.4 2.81 ± 7% perf-profile.calltrace.cycles-pp.up_read.do_user_addr_fault.page_fault
> 2.86 ± 6% +0.4 3.21 ± 4% perf-profile.calltrace.cycles-pp.find_lock_entry.shmem_getpage_gfp.shmem_fault.__do_fault.do_fault
> 3.12 ± 6% +0.4 3.52 ± 4% perf-profile.calltrace.cycles-pp.shmem_getpage_gfp.shmem_fault.__do_fault.do_fault.__handle_mm_fault
> 3.27 ± 6% +0.4 3.67 ± 4% perf-profile.calltrace.cycles-pp.shmem_fault.__do_fault.do_fault.__handle_mm_fault.handle_mm_fault
> 3.33 ± 6% +0.4 3.75 ± 4% perf-profile.calltrace.cycles-pp.__do_fault.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault
> 0.13 ±173% +0.4 0.55 ± 8% perf-profile.calltrace.cycles-pp.swapgs_restore_regs_and_return_to_usermode
> 3.39 ± 7% +0.5 3.89 ± 5% perf-profile.calltrace.cycles-pp.alloc_set_pte.finish_fault.do_fault.__handle_mm_fault.handle_mm_fault
> 3.44 ± 7% +0.5 3.94 ± 5% perf-profile.calltrace.cycles-pp.finish_fault.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault
> 8.99 ± 6% +1.2 10.20 ± 4% perf-profile.calltrace.cycles-pp.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.page_fault
> 12.23 ± 6% +1.6 13.84 ± 5% perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.page_fault
> 12.68 ± 6% +1.7 14.38 ± 5% perf-profile.calltrace.cycles-pp.handle_mm_fault.do_user_addr_fault.page_fault
> 45.14 ± 9% +6.1 51.25 ± 6% perf-profile.calltrace.cycles-pp.down_read_trylock.do_user_addr_fault.page_fault
> 66.96 ± 7% +7.4 74.37 ± 4% perf-profile.calltrace.cycles-pp.do_user_addr_fault.page_fault
> 69.19 ± 7% +7.7 76.89 ± 4% perf-profile.calltrace.cycles-pp.page_fault
> 17.74 ± 8% -3.3 14.46 ± 20% perf-profile.children.cycles-pp.apic_timer_interrupt
> 17.02 ± 8% -3.1 13.89 ± 20% perf-profile.children.cycles-pp.smp_apic_timer_interrupt
> 2.97 ± 8% -0.7 2.25 ± 12% perf-profile.children.cycles-pp.irq_exit
> 1.88 ± 11% -0.5 1.41 ± 11% perf-profile.children.cycles-pp.__softirqentry_text_start
> 1.02 ± 14% -0.4 0.59 ± 15% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
> 1.75 ± 12% -0.4 1.35 ± 14% perf-profile.children.cycles-pp._raw_spin_lock_irq
> 0.92 ± 12% -0.2 0.68 ± 17% perf-profile.children.cycles-pp.ktime_get
> 0.32 ± 20% -0.2 0.13 ± 30% perf-profile.children.cycles-pp.munmap
> 0.32 ± 22% -0.2 0.14 ± 27% perf-profile.children.cycles-pp.__x64_sys_munmap
> 0.32 ± 22% -0.2 0.14 ± 28% perf-profile.children.cycles-pp.__vm_munmap
> 0.29 ± 21% -0.2 0.13 ± 23% perf-profile.children.cycles-pp.__do_munmap
> 0.28 ± 21% -0.2 0.12 ± 25% perf-profile.children.cycles-pp.unmap_region
> 0.28 ± 22% -0.2 0.13 ± 23% perf-profile.children.cycles-pp.unmap_vmas
> 0.28 ± 21% -0.2 0.13 ± 23% perf-profile.children.cycles-pp.unmap_page_range
> 0.48 ± 6% -0.1 0.34 ± 15% perf-profile.children.cycles-pp.rebalance_domains
> 0.56 ± 12% -0.1 0.43 ± 16% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
> 0.44 ± 11% -0.1 0.33 ± 25% perf-profile.children.cycles-pp.clockevents_program_event
> 0.31 ± 14% -0.1 0.21 ± 16% perf-profile.children.cycles-pp.run_rebalance_domains
> 0.34 ± 9% -0.1 0.25 ± 16% perf-profile.children.cycles-pp.__hrtimer_next_event_base
> 0.28 ± 14% -0.1 0.21 ± 22% perf-profile.children.cycles-pp.rcu_dynticks_eqs_exit
> 0.12 ± 21% -0.1 0.04 ± 59% perf-profile.children.cycles-pp.smp_call_function_many_cond
> 0.12 ± 21% -0.1 0.04 ± 59% perf-profile.children.cycles-pp.on_each_cpu_cond_mask
> 0.12 ± 21% -0.1 0.05 ± 60% perf-profile.children.cycles-pp.flush_tlb_mm_range
> 0.19 ± 16% -0.1 0.12 ± 25% perf-profile.children.cycles-pp.irq_work_tick
> 0.31 ± 10% -0.1 0.24 ± 21% perf-profile.children.cycles-pp.ktime_get_update_offsets_now
> 0.17 ± 13% -0.0 0.12 ± 15% perf-profile.children.cycles-pp.rcu_idle_exit
> 0.12 ± 12% -0.0 0.08 ± 30% perf-profile.children.cycles-pp.tick_nohz_irq_exit
> 0.14 ± 8% -0.0 0.10 ± 12% perf-profile.children.cycles-pp.raise_softirq
> 0.09 ± 7% +0.0 0.11 ± 4% perf-profile.children.cycles-pp._cond_resched
> 0.06 +0.0 0.08 ± 11% perf-profile.children.cycles-pp.lock_page_memcg
> 0.15 ± 7% +0.0 0.17 ± 2% perf-profile.children.cycles-pp.__mod_memcg_state
> 0.07 +0.0 0.09 ± 4% perf-profile.children.cycles-pp.perf_swevent_event
> 0.18 ± 7% +0.0 0.21 ± 4% perf-profile.children.cycles-pp.current_time
> 0.23 ± 3% +0.0 0.26 ± 4% perf-profile.children.cycles-pp.xas_load
> 0.14 ± 9% +0.0 0.18 ± 8% perf-profile.children.cycles-pp.__count_memcg_events
> 0.46 ± 5% +0.1 0.51 ± 4% perf-profile.children.cycles-pp.__mod_lruvec_state
> 0.42 ± 5% +0.1 0.48 ± 7% perf-profile.children.cycles-pp.__mark_inode_dirty
> 0.55 ± 5% +0.1 0.61 ± 3% perf-profile.children.cycles-pp.___perf_sw_event
> 0.47 ± 4% +0.1 0.55 ± 8% perf-profile.children.cycles-pp.swapgs_restore_regs_and_return_to_usermode
> 0.42 ± 9% +0.1 0.50 ± 8% perf-profile.children.cycles-pp.__might_sleep
> 0.81 ± 5% +0.1 0.92 ± 4% perf-profile.children.cycles-pp.file_update_time
> 1.36 ± 6% +0.2 1.52 ± 3% perf-profile.children.cycles-pp.find_get_entry
> 1.17 ± 7% +0.2 1.34 ± 5% perf-profile.children.cycles-pp.unlock_page
> 1.77 ± 7% +0.3 2.05 ± 5% perf-profile.children.cycles-pp.page_add_file_rmap
> 2.14 ± 5% +0.3 2.42 ± 4% perf-profile.children.cycles-pp.fault_dirty_shared_page
> 2.51 ± 8% +0.4 2.86 ± 7% perf-profile.children.cycles-pp.up_read
> 2.90 ± 6% +0.4 3.26 ± 4% perf-profile.children.cycles-pp.find_lock_entry
> 3.12 ± 6% +0.4 3.52 ± 4% perf-profile.children.cycles-pp.shmem_getpage_gfp
> 3.27 ± 6% +0.4 3.68 ± 4% perf-profile.children.cycles-pp.shmem_fault
> 3.33 ± 6% +0.4 3.75 ± 3% perf-profile.children.cycles-pp.__do_fault
> 3.45 ± 7% +0.5 3.95 ± 5% perf-profile.children.cycles-pp.finish_fault
> 3.42 ± 7% +0.5 3.92 ± 5% perf-profile.children.cycles-pp.alloc_set_pte
> 9.02 ± 6% +1.2 10.23 ± 4% perf-profile.children.cycles-pp.do_fault
> 12.26 ± 6% +1.6 13.88 ± 5% perf-profile.children.cycles-pp.__handle_mm_fault
> 12.72 ± 6% +1.7 14.43 ± 5% perf-profile.children.cycles-pp.handle_mm_fault
> 45.27 ± 9% +6.1 51.39 ± 6% perf-profile.children.cycles-pp.down_read_trylock
> 67.33 ± 7% +7.5 74.81 ± 4% perf-profile.children.cycles-pp.do_user_addr_fault
> 69.24 ± 7% +7.7 76.95 ± 4% perf-profile.children.cycles-pp.page_fault
> 1.02 ± 14% -0.4 0.59 ± 15% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
> 0.74 ± 13% -0.2 0.55 ± 18% perf-profile.self.cycles-pp.ktime_get
> 0.28 ± 10% -0.1 0.21 ± 17% perf-profile.self.cycles-pp.__hrtimer_next_event_base
> 0.28 ± 13% -0.1 0.20 ± 21% perf-profile.self.cycles-pp.rcu_dynticks_eqs_exit
> 0.19 ± 16% -0.1 0.12 ± 25% perf-profile.self.cycles-pp.irq_work_tick
> 0.26 ± 7% -0.1 0.21 ± 12% perf-profile.self.cycles-pp.__softirqentry_text_start
> 0.20 ± 15% -0.0 0.16 ± 11% perf-profile.self.cycles-pp.__run_timers
> 0.14 ± 7% -0.0 0.10 ± 12% perf-profile.self.cycles-pp.raise_softirq
> 0.13 ± 9% -0.0 0.10 ± 15% perf-profile.self.cycles-pp.tick_sched_timer
> 0.07 ± 10% -0.0 0.04 ± 58% perf-profile.self.cycles-pp.clockevents_program_event
> 0.09 ± 5% -0.0 0.07 ± 17% perf-profile.self.cycles-pp.apic_timer_interrupt
> 0.05 ± 8% +0.0 0.07 ± 12% perf-profile.self.cycles-pp.lock_page_memcg
> 0.11 ± 4% +0.0 0.12 ± 3% perf-profile.self.cycles-pp.file_update_time
> 0.10 ± 7% +0.0 0.12 ± 7% perf-profile.self.cycles-pp.___might_sleep
> 0.06 ± 6% +0.0 0.08 ± 5% perf-profile.self.cycles-pp.perf_swevent_event
> 0.18 ± 8% +0.0 0.20 ± 6% perf-profile.self.cycles-pp.__mod_lruvec_state
> 0.13 ± 9% +0.0 0.15 ± 3% perf-profile.self.cycles-pp.__mod_memcg_state
> 0.24 ± 6% +0.0 0.27 ± 6% perf-profile.self.cycles-pp.handle_mm_fault
> 0.41 ± 4% +0.0 0.44 ± 3% perf-profile.self.cycles-pp.___perf_sw_event
> 0.14 ± 9% +0.0 0.17 ± 6% perf-profile.self.cycles-pp.__count_memcg_events
> 0.21 ± 6% +0.0 0.25 ± 4% perf-profile.self.cycles-pp.shmem_getpage_gfp
> 0.23 ± 10% +0.1 0.29 ± 13% perf-profile.self.cycles-pp.swapgs_restore_regs_and_return_to_usermode
> 1.02 ± 6% +0.1 1.13 ± 6% perf-profile.self.cycles-pp.find_get_entry
> 0.86 ± 4% +0.1 1.00 ± 6% perf-profile.self.cycles-pp.do_user_addr_fault
> 1.10 ± 6% +0.2 1.26 ± 7% perf-profile.self.cycles-pp.unlock_page
> 1.26 ± 7% +0.2 1.44 ± 8% perf-profile.self.cycles-pp.find_lock_entry
> 1.20 ± 6% +0.2 1.38 ± 8% perf-profile.self.cycles-pp.page_add_file_rmap
> 2.35 ± 7% +0.3 2.69 ± 8% perf-profile.self.cycles-pp.up_read
> 2.97 ± 6% +0.4 3.35 ± 8% perf-profile.self.cycles-pp.__handle_mm_fault
> 42.09 ± 8% +5.7 47.79 ± 8% perf-profile.self.cycles-pp.down_read_trylock
> 406.00 ± 37% +1859.5% 7955 ±151% interrupts.32:IR-PCI-MSI.2097155-edge.eth0-TxRx-2
> 3009113 -4.3% 2880393 ± 2% interrupts.CAL:Function_call_interrupts
> 1445 ± 50% +93.0% 2788 ± 9% interrupts.CPU0.NMI:Non-maskable_interrupts
> 1445 ± 50% +93.0% 2788 ± 9% interrupts.CPU0.PMI:Performance_monitoring_interrupts
> 939.50 ± 16% +23.2% 1157 ± 5% interrupts.CPU100.RES:Rescheduling_interrupts
> 1223 ± 11% +43.3% 1753 ± 23% interrupts.CPU103.NMI:Non-maskable_interrupts
> 1223 ± 11% +43.3% 1753 ± 23% interrupts.CPU103.PMI:Performance_monitoring_interrupts
> 1163 ± 6% +24.5% 1448 ± 6% interrupts.CPU104.RES:Rescheduling_interrupts
> 1062 ± 15% +40.5% 1493 ± 5% interrupts.CPU105.RES:Rescheduling_interrupts
> 1490 ± 28% +70.1% 2536 ± 20% interrupts.CPU106.NMI:Non-maskable_interrupts
> 1490 ± 28% +70.1% 2536 ± 20% interrupts.CPU106.PMI:Performance_monitoring_interrupts
> 1186 ± 3% +26.4% 1499 ± 11% interrupts.CPU106.RES:Rescheduling_interrupts
> 1186 ± 5% +36.5% 1618 ± 9% interrupts.CPU107.RES:Rescheduling_interrupts
> 1484 ± 29% +98.1% 2941 ± 9% interrupts.CPU108.NMI:Non-maskable_interrupts
> 1484 ± 29% +98.1% 2941 ± 9% interrupts.CPU108.PMI:Performance_monitoring_interrupts
> 1087 ± 11% +35.2% 1470 ± 11% interrupts.CPU108.RES:Rescheduling_interrupts
> 905.00 ± 14% +26.9% 1148 ± 8% interrupts.CPU109.RES:Rescheduling_interrupts
> 1534 ± 35% +91.6% 2939 ± 9% interrupts.CPU110.NMI:Non-maskable_interrupts
> 1534 ± 35% +91.6% 2939 ± 9% interrupts.CPU110.PMI:Performance_monitoring_interrupts
> 1222 ± 11% +54.3% 1885 ± 44% interrupts.CPU111.NMI:Non-maskable_interrupts
> 1222 ± 11% +54.3% 1885 ± 44% interrupts.CPU111.PMI:Performance_monitoring_interrupts
> 1066 +27.7% 1360 ± 5% interrupts.CPU111.RES:Rescheduling_interrupts
> 1214 ± 12% +51.1% 1833 ± 35% interrupts.CPU112.NMI:Non-maskable_interrupts
> 1214 ± 12% +51.1% 1833 ± 35% interrupts.CPU112.PMI:Performance_monitoring_interrupts
> 1206 ± 12% +30.8% 1577 ± 9% interrupts.CPU116.RES:Rescheduling_interrupts
> 1102 ± 10% +46.7% 1616 ± 11% interrupts.CPU117.RES:Rescheduling_interrupts
> 1211 ± 3% +35.2% 1638 ± 15% interrupts.CPU118.RES:Rescheduling_interrupts
> 1217 ± 11% +115.4% 2623 ± 29% interrupts.CPU119.NMI:Non-maskable_interrupts
> 1217 ± 11% +115.4% 2623 ± 29% interrupts.CPU119.PMI:Performance_monitoring_interrupts
> 406.00 ± 37% +1859.5% 7955 ±151% interrupts.CPU12.32:IR-PCI-MSI.2097155-edge.eth0-TxRx-2
> 1125 ± 12% +27.3% 1432 ± 10% interrupts.CPU12.NMI:Non-maskable_interrupts
> 1125 ± 12% +27.3% 1432 ± 10% interrupts.CPU12.PMI:Performance_monitoring_interrupts
> 1173 ± 12% +55.5% 1823 ± 35% interrupts.CPU120.NMI:Non-maskable_interrupts
> 1173 ± 12% +55.5% 1823 ± 35% interrupts.CPU120.PMI:Performance_monitoring_interrupts
> 1112 ± 5% +40.2% 1559 ± 6% interrupts.CPU121.RES:Rescheduling_interrupts
> 1227 ± 11% +50.5% 1846 ± 34% interrupts.CPU122.NMI:Non-maskable_interrupts
> 1227 ± 11% +50.5% 1846 ± 34% interrupts.CPU122.PMI:Performance_monitoring_interrupts
> 1036 ± 11% +36.6% 1416 ± 4% interrupts.CPU122.RES:Rescheduling_interrupts
> 1164 ± 22% +40.8% 1639 ± 16% interrupts.CPU123.RES:Rescheduling_interrupts
> 1419 ± 13% +20.7% 1712 ± 9% interrupts.CPU124.RES:Rescheduling_interrupts
> 1209 ± 11% +21.5% 1469 ± 9% interrupts.CPU126.NMI:Non-maskable_interrupts
> 1209 ± 11% +21.5% 1469 ± 9% interrupts.CPU126.PMI:Performance_monitoring_interrupts
> 1266 ± 16% +34.9% 1708 ± 13% interrupts.CPU126.RES:Rescheduling_interrupts
> 1207 ± 24% +36.5% 1648 ± 11% interrupts.CPU127.RES:Rescheduling_interrupts
> 1298 ± 12% +30.8% 1698 interrupts.CPU128.RES:Rescheduling_interrupts
> 1354 ± 7% +33.5% 1808 ± 9% interrupts.CPU129.RES:Rescheduling_interrupts
> 1046 ± 7% +42.3% 1488 ± 17% interrupts.CPU130.RES:Rescheduling_interrupts
> 1068 ± 6% +45.9% 1558 ± 13% interrupts.CPU131.RES:Rescheduling_interrupts
> 1200 ± 2% +41.7% 1701 ± 14% interrupts.CPU132.RES:Rescheduling_interrupts
> 1191 ± 11% +85.4% 2208 ± 39% interrupts.CPU133.NMI:Non-maskable_interrupts
> 1191 ± 11% +85.4% 2208 ± 39% interrupts.CPU133.PMI:Performance_monitoring_interrupts
> 1327 ± 9% +13.8% 1510 ± 4% interrupts.CPU134.RES:Rescheduling_interrupts
> 1203 ± 12% +52.8% 1837 ± 34% interrupts.CPU136.NMI:Non-maskable_interrupts
> 1203 ± 12% +52.8% 1837 ± 34% interrupts.CPU136.PMI:Performance_monitoring_interrupts
> 976.75 ± 8% +19.0% 1162 ± 8% interrupts.CPU136.RES:Rescheduling_interrupts
> 1438 ± 34% +75.9% 2530 ± 27% interrupts.CPU137.NMI:Non-maskable_interrupts
> 1438 ± 34% +75.9% 2530 ± 27% interrupts.CPU137.PMI:Performance_monitoring_interrupts
> 950.75 ± 5% +33.1% 1265 ± 14% interrupts.CPU139.RES:Rescheduling_interrupts
> 1054 ± 6% +26.9% 1338 ± 8% interrupts.CPU140.RES:Rescheduling_interrupts
> 10703 ± 3% -8.0% 9849 ± 4% interrupts.CPU140.TLB:TLB_shootdowns
> 1509 ± 29% +71.5% 2589 ± 27% interrupts.CPU141.NMI:Non-maskable_interrupts
> 1509 ± 29% +71.5% 2589 ± 27% interrupts.CPU141.PMI:Performance_monitoring_interrupts
> 1334 ± 7% +14.9% 1533 ± 8% interrupts.CPU141.RES:Rescheduling_interrupts
> 1505 ± 36% +71.7% 2585 ± 27% interrupts.CPU142.NMI:Non-maskable_interrupts
> 1505 ± 36% +71.7% 2585 ± 27% interrupts.CPU142.PMI:Performance_monitoring_interrupts
> 1206 ± 7% +32.3% 1596 ± 13% interrupts.CPU142.RES:Rescheduling_interrupts
> 1218 ± 11% +55.0% 1888 ± 44% interrupts.CPU143.NMI:Non-maskable_interrupts
> 1218 ± 11% +55.0% 1888 ± 44% interrupts.CPU143.PMI:Performance_monitoring_interrupts
> 1883 ± 5% +37.7% 2594 ± 12% interrupts.CPU143.RES:Rescheduling_interrupts
> 1211 ± 11% +51.1% 1831 ± 35% interrupts.CPU144.NMI:Non-maskable_interrupts
> 1211 ± 11% +51.1% 1831 ± 35% interrupts.CPU144.PMI:Performance_monitoring_interrupts
> 1266 ± 15% +43.3% 1815 ± 7% interrupts.CPU144.RES:Rescheduling_interrupts
> 1226 ± 11% +109.7% 2572 ± 27% interrupts.CPU145.NMI:Non-maskable_interrupts
> 1226 ± 11% +109.7% 2572 ± 27% interrupts.CPU145.PMI:Performance_monitoring_interrupts
> 1370 ± 27% +54.3% 2114 ± 35% interrupts.CPU15.NMI:Non-maskable_interrupts
> 1370 ± 27% +54.3% 2114 ± 35% interrupts.CPU15.PMI:Performance_monitoring_interrupts
> 685.25 ± 6% +33.2% 913.00 ± 9% interrupts.CPU15.RES:Rescheduling_interrupts
> 1197 ± 11% +84.2% 2206 ± 39% interrupts.CPU150.NMI:Non-maskable_interrupts
> 1197 ± 11% +84.2% 2206 ± 39% interrupts.CPU150.PMI:Performance_monitoring_interrupts
> 1097 ± 9% +33.0% 1459 ± 13% interrupts.CPU152.RES:Rescheduling_interrupts
> 1263 ± 7% +31.8% 1665 ± 8% interrupts.CPU154.RES:Rescheduling_interrupts
> 1215 ± 12% +49.4% 1815 ± 33% interrupts.CPU155.NMI:Non-maskable_interrupts
> 1215 ± 12% +49.4% 1815 ± 33% interrupts.CPU155.PMI:Performance_monitoring_interrupts
> 1222 ± 5% +29.1% 1578 ± 9% interrupts.CPU155.RES:Rescheduling_interrupts
> 1065 ± 9% +30.1% 1386 ± 13% interrupts.CPU156.RES:Rescheduling_interrupts
> 1017 ± 13% +23.8% 1259 ± 7% interrupts.CPU157.RES:Rescheduling_interrupts
> 1055 ± 11% +28.5% 1356 ± 11% interrupts.CPU158.RES:Rescheduling_interrupts
> 1016 ± 9% +39.7% 1420 ± 13% interrupts.CPU159.RES:Rescheduling_interrupts
> 1084 ± 2% +24.3% 1347 ± 13% interrupts.CPU161.RES:Rescheduling_interrupts
> 918.75 ± 13% +20.4% 1106 ± 11% interrupts.CPU162.RES:Rescheduling_interrupts
> 10725 -8.9% 9774 ± 2% interrupts.CPU162.TLB:TLB_shootdowns
> 959.75 ± 9% +24.8% 1197 ± 11% interrupts.CPU163.RES:Rescheduling_interrupts
> 1177 ± 8% +36.8% 1610 ± 15% interrupts.CPU167.RES:Rescheduling_interrupts
> 1211 ± 12% +84.4% 2233 ± 39% interrupts.CPU168.NMI:Non-maskable_interrupts
> 1211 ± 12% +84.4% 2233 ± 39% interrupts.CPU168.PMI:Performance_monitoring_interrupts
> 1220 ± 12% +22.2% 1491 ± 8% interrupts.CPU169.RES:Rescheduling_interrupts
> 711.00 ± 6% +33.3% 948.00 ± 13% interrupts.CPU17.RES:Rescheduling_interrupts
> 1254 ± 8% +32.6% 1663 ± 18% interrupts.CPU170.RES:Rescheduling_interrupts
> 1149 ± 10% +46.0% 1677 ± 11% interrupts.CPU171.RES:Rescheduling_interrupts
> 1578 ± 49% +41.6% 2234 ± 40% interrupts.CPU173.NMI:Non-maskable_interrupts
> 1578 ± 49% +41.6% 2234 ± 40% interrupts.CPU173.PMI:Performance_monitoring_interrupts
> 1242 ± 9% +17.3% 1456 ± 9% interrupts.CPU174.NMI:Non-maskable_interrupts
> 1242 ± 9% +17.3% 1456 ± 9% interrupts.CPU174.PMI:Performance_monitoring_interrupts
> 1008 ± 7% +26.7% 1278 interrupts.CPU176.RES:Rescheduling_interrupts
> 1015 ± 4% +33.9% 1360 ± 8% interrupts.CPU177.RES:Rescheduling_interrupts
> 929.50 ± 13% +27.4% 1183 ± 6% interrupts.CPU178.RES:Rescheduling_interrupts
> 1051 ± 8% +20.7% 1268 interrupts.CPU179.RES:Rescheduling_interrupts
> 1149 ± 13% +87.3% 2153 ± 34% interrupts.CPU18.NMI:Non-maskable_interrupts
> 1149 ± 13% +87.3% 2153 ± 34% interrupts.CPU18.PMI:Performance_monitoring_interrupts
> 832.75 ± 4% +23.5% 1028 interrupts.CPU18.RES:Rescheduling_interrupts
> 1215 ± 11% +21.9% 1481 ± 9% interrupts.CPU180.NMI:Non-maskable_interrupts
> 1215 ± 11% +21.9% 1481 ± 9% interrupts.CPU180.PMI:Performance_monitoring_interrupts
> 1050 ± 15% +39.3% 1463 ± 6% interrupts.CPU181.RES:Rescheduling_interrupts
> 1093 ± 5% +28.7% 1407 ± 11% interrupts.CPU182.RES:Rescheduling_interrupts
> 1082 ± 5% +27.6% 1381 ± 3% interrupts.CPU183.RES:Rescheduling_interrupts
> 990.50 ± 10% +28.1% 1269 ± 8% interrupts.CPU184.RES:Rescheduling_interrupts
> 964.00 ± 13% +28.2% 1235 ± 8% interrupts.CPU186.RES:Rescheduling_interrupts
> 1498 ± 29% +68.5% 2524 ± 19% interrupts.CPU187.NMI:Non-maskable_interrupts
> 1498 ± 29% +68.5% 2524 ± 19% interrupts.CPU187.PMI:Performance_monitoring_interrupts
> 1084 ± 11% +35.9% 1473 ± 9% interrupts.CPU188.RES:Rescheduling_interrupts
> 1537 ± 34% +68.0% 2582 ± 26% interrupts.CPU190.NMI:Non-maskable_interrupts
> 1537 ± 34% +68.0% 2582 ± 26% interrupts.CPU190.PMI:Performance_monitoring_interrupts
> 1247 ± 2% +32.7% 1655 ± 5% interrupts.CPU190.RES:Rescheduling_interrupts
> 1292 ± 11% +26.0% 1628 ± 6% interrupts.CPU191.RES:Rescheduling_interrupts
> 1223 ± 13% +50.2% 1837 ± 33% interrupts.CPU192.NMI:Non-maskable_interrupts
> 1223 ± 13% +50.2% 1837 ± 33% interrupts.CPU192.PMI:Performance_monitoring_interrupts
> 1263 ± 8% +30.8% 1651 ± 8% interrupts.CPU193.RES:Rescheduling_interrupts
> 1369 ± 8% +25.9% 1724 ± 13% interrupts.CPU196.RES:Rescheduling_interrupts
> 1127 ± 9% +27.5% 1437 ± 6% interrupts.CPU197.RES:Rescheduling_interrupts
> 1134 ± 10% +25.8% 1427 ± 19% interrupts.CPU198.RES:Rescheduling_interrupts
> 1205 ± 12% +47.0% 1772 ± 24% interrupts.CPU199.NMI:Non-maskable_interrupts
> 1205 ± 12% +47.0% 1772 ± 24% interrupts.CPU199.PMI:Performance_monitoring_interrupts
> 1160 ± 12% +117.2% 2520 ± 25% interrupts.CPU2.NMI:Non-maskable_interrupts
> 1160 ± 12% +117.2% 2520 ± 25% interrupts.CPU2.PMI:Performance_monitoring_interrupts
> 1408 ± 27% +77.7% 2502 ± 27% interrupts.CPU20.NMI:Non-maskable_interrupts
> 1408 ± 27% +77.7% 2502 ± 27% interrupts.CPU20.PMI:Performance_monitoring_interrupts
> 1077 ± 13% +28.2% 1381 ± 9% interrupts.CPU202.RES:Rescheduling_interrupts
> 1512 ± 36% +41.9% 2147 ± 26% interrupts.CPU203.NMI:Non-maskable_interrupts
> 1512 ± 36% +41.9% 2147 ± 26% interrupts.CPU203.PMI:Performance_monitoring_interrupts
> 1052 ± 5% +35.0% 1420 ± 20% interrupts.CPU203.RES:Rescheduling_interrupts
> 1001 ± 3% +41.0% 1411 ± 19% interrupts.CPU204.RES:Rescheduling_interrupts
> 1140 ± 4% +31.4% 1498 ± 7% interrupts.CPU206.RES:Rescheduling_interrupts
> 1288 ± 5% +27.6% 1643 ± 3% interrupts.CPU208.RES:Rescheduling_interrupts
> 1131 ± 13% +60.9% 1821 ± 44% interrupts.CPU21.NMI:Non-maskable_interrupts
> 1131 ± 13% +60.9% 1821 ± 44% interrupts.CPU21.PMI:Performance_monitoring_interrupts
> 1126 ± 2% +29.1% 1454 ± 13% interrupts.CPU210.RES:Rescheduling_interrupts
> 10556 ± 3% -8.9% 9618 ± 2% interrupts.CPU210.TLB:TLB_shootdowns
> 1042 ± 12% +42.8% 1489 ± 9% interrupts.CPU211.RES:Rescheduling_interrupts
> 1156 ± 10% +18.5% 1371 ± 9% interrupts.CPU212.RES:Rescheduling_interrupts
> 1336 ± 4% +13.8% 1520 ± 5% interrupts.CPU213.RES:Rescheduling_interrupts
> 1201 ± 5% +23.0% 1477 ± 8% interrupts.CPU214.RES:Rescheduling_interrupts
> 1622 ± 6% +36.7% 2219 ± 17% interrupts.CPU215.RES:Rescheduling_interrupts
> 1178 ± 16% +30.5% 1538 ± 6% interrupts.CPU216.RES:Rescheduling_interrupts
> 1006 ± 13% +48.5% 1494 ± 7% interrupts.CPU217.RES:Rescheduling_interrupts
> 1603 ± 48% +40.3% 2248 ± 38% interrupts.CPU218.NMI:Non-maskable_interrupts
> 1603 ± 48% +40.3% 2248 ± 38% interrupts.CPU218.PMI:Performance_monitoring_interrupts
> 1235 ± 9% +36.4% 1684 ± 6% interrupts.CPU218.RES:Rescheduling_interrupts
> 1219 ± 13% +29.3% 1576 ± 8% interrupts.CPU219.RES:Rescheduling_interrupts
> 1153 ± 12% +145.2% 2828 ± 10% interrupts.CPU22.NMI:Non-maskable_interrupts
> 1153 ± 12% +145.2% 2828 ± 10% interrupts.CPU22.PMI:Performance_monitoring_interrupts
> 849.50 ± 4% +25.5% 1066 ± 6% interrupts.CPU22.RES:Rescheduling_interrupts
> 1209 ± 12% +84.1% 2226 ± 40% interrupts.CPU220.NMI:Non-maskable_interrupts
> 1209 ± 12% +84.1% 2226 ± 40% interrupts.CPU220.PMI:Performance_monitoring_interrupts
> 1037 ± 10% +14.3% 1186 ± 3% interrupts.CPU220.RES:Rescheduling_interrupts
> 1092 ± 8% +31.8% 1440 ± 14% interrupts.CPU221.RES:Rescheduling_interrupts
> 1112 ± 13% +28.8% 1433 ± 9% interrupts.CPU222.RES:Rescheduling_interrupts
> 1220 ± 9% +32.8% 1620 ± 7% interrupts.CPU223.RES:Rescheduling_interrupts
> 1515 ± 34% +42.5% 2159 ± 28% interrupts.CPU226.NMI:Non-maskable_interrupts
> 1515 ± 34% +42.5% 2159 ± 28% interrupts.CPU226.PMI:Performance_monitoring_interrupts
> 1083 ± 8% +33.0% 1441 ± 13% interrupts.CPU226.RES:Rescheduling_interrupts
> 956.50 ± 11% +23.7% 1183 ± 8% interrupts.CPU227.RES:Rescheduling_interrupts
> 1180 ± 3% +38.2% 1631 ± 18% interrupts.CPU228.RES:Rescheduling_interrupts
> 1223 ± 11% +20.1% 1468 ± 9% interrupts.CPU229.NMI:Non-maskable_interrupts
> 1223 ± 11% +20.1% 1468 ± 9% interrupts.CPU229.PMI:Performance_monitoring_interrupts
> 1149 ± 12% +58.3% 1819 ± 44% interrupts.CPU23.NMI:Non-maskable_interrupts
> 1149 ± 12% +58.3% 1819 ± 44% interrupts.CPU23.PMI:Performance_monitoring_interrupts
> 726.75 ± 4% +32.6% 963.50 ± 6% interrupts.CPU23.RES:Rescheduling_interrupts
> 1013 ± 7% +35.2% 1370 ± 14% interrupts.CPU230.RES:Rescheduling_interrupts
> 1004 ± 5% +29.5% 1300 ± 8% interrupts.CPU231.RES:Rescheduling_interrupts
> 1213 ± 13% +141.5% 2929 ± 9% interrupts.CPU233.NMI:Non-maskable_interrupts
> 1213 ± 13% +141.5% 2929 ± 9% interrupts.CPU233.PMI:Performance_monitoring_interrupts
> 1013 ± 9% +22.5% 1241 ± 8% interrupts.CPU233.RES:Rescheduling_interrupts
> 1177 ± 13% +80.2% 2121 ± 29% interrupts.CPU234.NMI:Non-maskable_interrupts
> 1177 ± 13% +80.2% 2121 ± 29% interrupts.CPU234.PMI:Performance_monitoring_interrupts
> 1515 ± 35% +68.0% 2545 ± 26% interrupts.CPU237.NMI:Non-maskable_interrupts
> 1515 ± 35% +68.0% 2545 ± 26% interrupts.CPU237.PMI:Performance_monitoring_interrupts
> 1770 ± 29% +64.4% 2910 ± 10% interrupts.CPU238.NMI:Non-maskable_interrupts
> 1770 ± 29% +64.4% 2910 ± 10% interrupts.CPU238.PMI:Performance_monitoring_interrupts
> 1000 ± 10% +23.4% 1233 ± 3% interrupts.CPU238.RES:Rescheduling_interrupts
> 1178 ± 6% +23.5% 1456 ± 8% interrupts.CPU239.RES:Rescheduling_interrupts
> 1151 ± 14% +115.7% 2483 ± 27% interrupts.CPU24.NMI:Non-maskable_interrupts
> 1151 ± 14% +115.7% 2483 ± 27% interrupts.CPU24.PMI:Performance_monitoring_interrupts
> 823.00 ± 9% +51.7% 1248 ± 19% interrupts.CPU24.RES:Rescheduling_interrupts
> 1217 ± 15% +22.9% 1496 ± 8% interrupts.CPU240.RES:Rescheduling_interrupts
> 1014 ± 4% +54.4% 1565 ± 20% interrupts.CPU242.RES:Rescheduling_interrupts
> 10616 ± 3% -8.3% 9731 interrupts.CPU242.TLB:TLB_shootdowns
> 1043 ± 11% +36.3% 1422 ± 16% interrupts.CPU243.RES:Rescheduling_interrupts
> 1215 ± 11% +83.3% 2227 ± 40% interrupts.CPU247.NMI:Non-maskable_interrupts
> 1215 ± 11% +83.3% 2227 ± 40% interrupts.CPU247.PMI:Performance_monitoring_interrupts
> 1499 ± 34% +68.8% 2531 ± 20% interrupts.CPU248.NMI:Non-maskable_interrupts
> 1499 ± 34% +68.8% 2531 ± 20% interrupts.CPU248.PMI:Performance_monitoring_interrupts
> 1034 ± 5% +28.3% 1327 ± 15% interrupts.CPU248.RES:Rescheduling_interrupts
> 1103 ± 14% +25.1% 1380 ± 8% interrupts.CPU249.RES:Rescheduling_interrupts
> 1143 ± 13% +49.8% 1712 ± 24% interrupts.CPU25.NMI:Non-maskable_interrupts
> 1143 ± 13% +49.8% 1712 ± 24% interrupts.CPU25.PMI:Performance_monitoring_interrupts
> 749.50 ± 9% +24.9% 936.25 ± 4% interrupts.CPU25.RES:Rescheduling_interrupts
> 10842 ± 2% -8.8% 9885 ± 2% interrupts.CPU25.TLB:TLB_shootdowns
> 1099 ± 5% +18.0% 1297 ± 3% interrupts.CPU251.RES:Rescheduling_interrupts
> 993.25 ± 11% +23.1% 1223 ± 5% interrupts.CPU252.RES:Rescheduling_interrupts
> 1017 ± 12% +34.7% 1369 ± 11% interrupts.CPU253.RES:Rescheduling_interrupts
> 1532 ± 49% +44.3% 2211 ± 39% interrupts.CPU254.NMI:Non-maskable_interrupts
> 1532 ± 49% +44.3% 2211 ± 39% interrupts.CPU254.PMI:Performance_monitoring_interrupts
> 979.50 ± 10% +29.8% 1271 ± 10% interrupts.CPU254.RES:Rescheduling_interrupts
> 928.50 ± 8% +43.7% 1334 ± 17% interrupts.CPU256.RES:Rescheduling_interrupts
> 1049 ± 12% +23.9% 1300 ± 8% interrupts.CPU257.RES:Rescheduling_interrupts
> 1183 ± 4% +12.5% 1331 ± 10% interrupts.CPU258.RES:Rescheduling_interrupts
> 796.50 ± 6% +38.3% 1101 ± 23% interrupts.CPU26.RES:Rescheduling_interrupts
> 1087 ± 8% +28.4% 1396 ± 6% interrupts.CPU260.RES:Rescheduling_interrupts
> 1081 ± 11% +40.3% 1517 ± 6% interrupts.CPU261.RES:Rescheduling_interrupts
> 1553 ± 48% +43.8% 2233 ± 39% interrupts.CPU262.NMI:Non-maskable_interrupts
> 1553 ± 48% +43.8% 2233 ± 39% interrupts.CPU262.PMI:Performance_monitoring_interrupts
> 1270 ± 13% +29.0% 1638 ± 10% interrupts.CPU262.RES:Rescheduling_interrupts
> 1170 ± 13% +57.6% 1844 ± 44% interrupts.CPU264.NMI:Non-maskable_interrupts
> 1170 ± 13% +57.6% 1844 ± 44% interrupts.CPU264.PMI:Performance_monitoring_interrupts
> 899.00 ± 10% +38.8% 1247 ± 14% interrupts.CPU264.RES:Rescheduling_interrupts
> 912.25 ± 11% +18.3% 1079 ± 7% interrupts.CPU267.RES:Rescheduling_interrupts
> 703.25 ± 9% +48.5% 1044 ± 21% interrupts.CPU27.RES:Rescheduling_interrupts
> 1198 ± 12% +82.4% 2185 ± 40% interrupts.CPU273.NMI:Non-maskable_interrupts
> 1198 ± 12% +82.4% 2185 ± 40% interrupts.CPU273.PMI:Performance_monitoring_interrupts
> 847.50 ± 10% +44.9% 1228 ± 18% interrupts.CPU273.RES:Rescheduling_interrupts
> 900.50 ± 19% +34.2% 1208 ± 17% interrupts.CPU274.RES:Rescheduling_interrupts
> 1175 ± 13% +82.5% 2145 ± 36% interrupts.CPU275.NMI:Non-maskable_interrupts
> 1175 ± 13% +82.5% 2145 ± 36% interrupts.CPU275.PMI:Performance_monitoring_interrupts
> 800.50 ± 8% +35.5% 1084 ± 14% interrupts.CPU275.RES:Rescheduling_interrupts
> 803.00 ± 7% +55.0% 1244 ± 20% interrupts.CPU276.RES:Rescheduling_interrupts
> 888.50 ± 11% +40.6% 1249 ± 9% interrupts.CPU277.RES:Rescheduling_interrupts
> 10916 -10.1% 9813 ± 2% interrupts.CPU277.TLB:TLB_shootdowns
> 1035 ± 2% +23.6% 1280 ± 5% interrupts.CPU278.RES:Rescheduling_interrupts
> 926.75 ± 8% +37.3% 1272 ± 16% interrupts.CPU279.RES:Rescheduling_interrupts
> 753.25 ± 21% +42.8% 1076 ± 8% interrupts.CPU282.RES:Rescheduling_interrupts
> 1183 ± 12% +55.6% 1841 ± 44% interrupts.CPU283.NMI:Non-maskable_interrupts
> 1183 ± 12% +55.6% 1841 ± 44% interrupts.CPU283.PMI:Performance_monitoring_interrupts
> 1187 ± 11% +112.7% 2525 ± 27% interrupts.CPU284.NMI:Non-maskable_interrupts
> 1187 ± 11% +112.7% 2525 ± 27% interrupts.CPU284.PMI:Performance_monitoring_interrupts
> 2063 ± 28% +38.7% 2863 ± 9% interrupts.CPU285.NMI:Non-maskable_interrupts
> 2063 ± 28% +38.7% 2863 ± 9% interrupts.CPU285.PMI:Performance_monitoring_interrupts
> 854.25 ± 3% +27.0% 1084 ± 5% interrupts.CPU286.RES:Rescheduling_interrupts
> 729.50 ± 11% +33.3% 972.75 ± 5% interrupts.CPU287.RES:Rescheduling_interrupts
> 1473 ± 50% +72.6% 2542 ± 30% interrupts.CPU29.NMI:Non-maskable_interrupts
> 1473 ± 50% +72.6% 2542 ± 30% interrupts.CPU29.PMI:Performance_monitoring_interrupts
> 1133 ± 13% +92.6% 2183 ± 39% interrupts.CPU3.NMI:Non-maskable_interrupts
> 1133 ± 13% +92.6% 2183 ± 39% interrupts.CPU3.PMI:Performance_monitoring_interrupts
> 853.00 ± 5% +19.3% 1017 ± 4% interrupts.CPU3.RES:Rescheduling_interrupts
> 865.00 ± 5% +27.6% 1103 ± 9% interrupts.CPU30.RES:Rescheduling_interrupts
> 750.50 ± 10% +20.9% 907.25 ± 12% interrupts.CPU31.RES:Rescheduling_interrupts
> 1140 ± 13% +93.0% 2201 ± 40% interrupts.CPU32.NMI:Non-maskable_interrupts
> 1140 ± 13% +93.0% 2201 ± 40% interrupts.CPU32.PMI:Performance_monitoring_interrupts
> 800.50 ± 10% +17.9% 944.00 ± 4% interrupts.CPU32.RES:Rescheduling_interrupts
> 836.50 ± 5% +18.9% 994.50 ± 4% interrupts.CPU34.RES:Rescheduling_interrupts
> 797.00 ± 4% +21.9% 971.75 ± 6% interrupts.CPU35.RES:Rescheduling_interrupts
> 754.00 ± 4% +21.2% 914.00 ± 5% interrupts.CPU36.RES:Rescheduling_interrupts
> 616.25 ± 8% +44.8% 892.25 ± 15% interrupts.CPU37.RES:Rescheduling_interrupts
> 791.25 ± 6% +32.6% 1049 ± 16% interrupts.CPU38.RES:Rescheduling_interrupts
> 686.75 ± 5% +34.9% 926.50 ± 14% interrupts.CPU39.RES:Rescheduling_interrupts
> 878.50 ± 6% +31.6% 1156 ± 16% interrupts.CPU4.RES:Rescheduling_interrupts
> 1180 ± 12% +85.2% 2185 ± 34% interrupts.CPU42.NMI:Non-maskable_interrupts
> 1180 ± 12% +85.2% 2185 ± 34% interrupts.CPU42.PMI:Performance_monitoring_interrupts
> 980.75 ± 11% +39.5% 1367 ± 14% interrupts.CPU45.RES:Rescheduling_interrupts
> 1103 ± 14% +22.1% 1347 ± 6% interrupts.CPU46.RES:Rescheduling_interrupts
> 925.00 ± 26% +42.2% 1315 ± 10% interrupts.CPU47.RES:Rescheduling_interrupts
> 960.25 ± 15% +41.2% 1356 ± 12% interrupts.CPU48.RES:Rescheduling_interrupts
> 921.75 ± 8% +23.2% 1135 ± 11% interrupts.CPU49.RES:Rescheduling_interrupts
> 1067 ± 15% +25.3% 1337 ± 10% interrupts.CPU50.RES:Rescheduling_interrupts
> 1076 ± 7% +49.1% 1605 ± 17% interrupts.CPU56.RES:Rescheduling_interrupts
> 10449 ± 2% -7.7% 9646 ± 3% interrupts.CPU56.TLB:TLB_shootdowns
> 913.75 ± 13% +40.9% 1287 ± 13% interrupts.CPU58.RES:Rescheduling_interrupts
> 767.50 ± 8% +54.1% 1182 ± 14% interrupts.CPU59.RES:Rescheduling_interrupts
> 1374 ± 27% +79.9% 2473 ± 26% interrupts.CPU6.NMI:Non-maskable_interrupts
> 1374 ± 27% +79.9% 2473 ± 26% interrupts.CPU6.PMI:Performance_monitoring_interrupts
> 825.00 ± 11% +38.8% 1145 ± 18% interrupts.CPU6.RES:Rescheduling_interrupts
> 1016 ± 21% +32.2% 1343 ± 12% interrupts.CPU60.RES:Rescheduling_interrupts
> 802.50 ± 12% +52.6% 1225 ± 16% interrupts.CPU61.RES:Rescheduling_interrupts
> 895.50 ± 8% +21.4% 1087 ± 2% interrupts.CPU62.RES:Rescheduling_interrupts
> 973.25 ± 22% +41.4% 1376 ± 6% interrupts.CPU66.RES:Rescheduling_interrupts
> 854.75 ± 10% +33.8% 1143 ± 13% interrupts.CPU67.RES:Rescheduling_interrupts
> 771.25 ± 12% +40.2% 1081 ± 13% interrupts.CPU69.RES:Rescheduling_interrupts
> 621.50 ± 7% +45.4% 903.50 ± 12% interrupts.CPU7.RES:Rescheduling_interrupts
> 1169 ± 7% +24.5% 1455 ± 5% interrupts.CPU70.RES:Rescheduling_interrupts
> 10547 ± 2% -8.5% 9654 interrupts.CPU70.TLB:TLB_shootdowns
> 1574 ± 12% +34.4% 2115 ± 11% interrupts.CPU71.RES:Rescheduling_interrupts
> 1456 ± 29% +49.9% 2183 ± 35% interrupts.CPU72.NMI:Non-maskable_interrupts
> 1456 ± 29% +49.9% 2183 ± 35% interrupts.CPU72.PMI:Performance_monitoring_interrupts
> 1183 ± 12% +25.6% 1485 ± 8% interrupts.CPU72.RES:Rescheduling_interrupts
> 1514 ± 33% +41.4% 2142 ± 27% interrupts.CPU73.NMI:Non-maskable_interrupts
> 1514 ± 33% +41.4% 2142 ± 27% interrupts.CPU73.PMI:Performance_monitoring_interrupts
> 986.75 ± 21% +56.7% 1546 ± 14% interrupts.CPU73.RES:Rescheduling_interrupts
> 1001 ± 4% +35.5% 1356 ± 7% interrupts.CPU76.RES:Rescheduling_interrupts
> 1004 ± 10% +22.4% 1229 ± 11% interrupts.CPU77.RES:Rescheduling_interrupts
> 897.25 ± 9% +34.5% 1206 ± 19% interrupts.CPU78.RES:Rescheduling_interrupts
> 785.75 ± 11% +25.6% 987.00 ± 4% interrupts.CPU8.RES:Rescheduling_interrupts
> 943.75 ± 9% +29.1% 1218 ± 12% interrupts.CPU81.RES:Rescheduling_interrupts
> 991.75 ± 2% +37.9% 1367 ± 17% interrupts.CPU82.RES:Rescheduling_interrupts
> 1177 ± 12% +58.9% 1870 ± 44% interrupts.CPU83.NMI:Non-maskable_interrupts
> 1177 ± 12% +58.9% 1870 ± 44% interrupts.CPU83.PMI:Performance_monitoring_interrupts
> 1170 ± 15% +17.1% 1370 ± 6% interrupts.CPU83.RES:Rescheduling_interrupts
> 1499 ± 30% +45.9% 2188 ± 34% interrupts.CPU86.NMI:Non-maskable_interrupts
> 1499 ± 30% +45.9% 2188 ± 34% interrupts.CPU86.PMI:Performance_monitoring_interrupts
> 1193 ± 10% +109.8% 2502 ± 20% interrupts.CPU87.NMI:Non-maskable_interrupts
> 1193 ± 10% +109.8% 2502 ± 20% interrupts.CPU87.PMI:Performance_monitoring_interrupts
> 1145 ± 14% +31.2% 1502 ± 7% interrupts.CPU87.RES:Rescheduling_interrupts
> 1177 ± 6% +21.1% 1426 ± 8% interrupts.CPU88.RES:Rescheduling_interrupts
> 1140 ± 14% +91.1% 2179 ± 40% interrupts.CPU9.NMI:Non-maskable_interrupts
> 1140 ± 14% +91.1% 2179 ± 40% interrupts.CPU9.PMI:Performance_monitoring_interrupts
> 676.75 ± 10% +41.2% 955.25 ± 11% interrupts.CPU9.RES:Rescheduling_interrupts
> 1195 ± 11% +56.7% 1872 ± 43% interrupts.CPU90.NMI:Non-maskable_interrupts
> 1195 ± 11% +56.7% 1872 ± 43% interrupts.CPU90.PMI:Performance_monitoring_interrupts
> 2083 ± 27% +40.0% 2917 ± 10% interrupts.CPU95.NMI:Non-maskable_interrupts
> 2083 ± 27% +40.0% 2917 ± 10% interrupts.CPU95.PMI:Performance_monitoring_interrupts
> 1110 ± 6% +14.4% 1270 ± 11% interrupts.CPU95.RES:Rescheduling_interrupts
> 1110 ± 6% +41.0% 1566 ± 18% interrupts.CPU98.RES:Rescheduling_interrupts
> 984.75 ± 9% +58.2% 1557 ± 19% interrupts.CPU99.RES:Rescheduling_interrupts
> 310787 ± 6% +23.6% 384165 ± 4% interrupts.RES:Rescheduling_interrupts
> 33134 ± 2% +14.7% 38003 ± 6% softirqs.CPU0.SCHED
> 27079 ± 2% +17.4% 31779 ± 3% softirqs.CPU1.SCHED
> 162495 +8.8% 176829 ± 4% softirqs.CPU1.TIMER
> 26465 +19.2% 31556 ± 3% softirqs.CPU10.SCHED
> 25261 ± 3% +16.4% 29411 ± 3% softirqs.CPU100.SCHED
> 25450 +18.5% 30153 ± 4% softirqs.CPU101.SCHED
> 25169 ± 2% +19.3% 30020 ± 3% softirqs.CPU102.SCHED
> 24805 ± 3% +20.5% 29893 ± 3% softirqs.CPU103.SCHED
> 25132 ± 3% +18.9% 29875 ± 3% softirqs.CPU104.SCHED
> 177301 ± 2% +11.3% 197274 ± 4% softirqs.CPU104.TIMER
> 24869 ± 3% +18.8% 29537 ± 2% softirqs.CPU105.SCHED
> 25032 ± 2% +17.7% 29462 ± 3% softirqs.CPU106.SCHED
> 24317 +22.3% 29729 ± 3% softirqs.CPU107.SCHED
> 25241 ± 3% +18.5% 29917 ± 2% softirqs.CPU108.SCHED
> 25571 ± 2% +17.6% 30075 ± 3% softirqs.CPU109.SCHED
> 25910 +17.9% 30551 ± 3% softirqs.CPU11.SCHED
> 24927 ± 2% +18.5% 29538 ± 4% softirqs.CPU110.SCHED
> 25019 ± 2% +19.2% 29833 ± 4% softirqs.CPU111.SCHED
> 25067 ± 2% +18.7% 29743 ± 4% softirqs.CPU112.SCHED
> 25105 ± 2% +19.1% 29892 ± 2% softirqs.CPU113.SCHED
> 25603 ± 2% +16.2% 29753 ± 4% softirqs.CPU114.SCHED
> 25517 ± 2% +17.9% 30096 ± 3% softirqs.CPU115.SCHED
> 176346 ± 5% +11.4% 196390 ± 4% softirqs.CPU115.TIMER
> 24988 ± 2% +17.3% 29299 ± 4% softirqs.CPU116.SCHED
> 24362 +22.1% 29748 ± 2% softirqs.CPU117.SCHED
> 25420 ± 2% +18.4% 30101 ± 3% softirqs.CPU118.SCHED
> 25202 +17.2% 29531 ± 3% softirqs.CPU119.SCHED
> 246.00 ± 32% +5886.8% 14727 ±166% softirqs.CPU12.NET_RX
> 25808 ± 2% +19.6% 30866 ± 4% softirqs.CPU12.SCHED
> 161592 ± 4% +26.1% 203759 ± 17% softirqs.CPU12.TIMER
> 25550 +16.3% 29721 ± 3% softirqs.CPU120.SCHED
> 172644 ± 4% +13.1% 195269 ± 4% softirqs.CPU120.TIMER
> 24062 ± 5% +24.3% 29898 ± 3% softirqs.CPU121.SCHED
> 173612 ± 4% +12.4% 195124 ± 3% softirqs.CPU121.TIMER
> 24774 ± 3% +20.1% 29742 ± 2% softirqs.CPU122.SCHED
> 25233 ± 2% +18.4% 29878 ± 2% softirqs.CPU123.SCHED
> 25038 ± 2% +18.0% 29548 ± 4% softirqs.CPU124.SCHED
> 24756 +19.1% 29485 ± 3% softirqs.CPU125.SCHED
> 25079 +19.2% 29903 ± 3% softirqs.CPU126.SCHED
> 25110 +17.9% 29598 ± 3% softirqs.CPU127.SCHED
> 24869 ± 3% +19.6% 29754 ± 3% softirqs.CPU128.SCHED
> 25255 ± 2% +17.6% 29710 ± 3% softirqs.CPU129.SCHED
> 26257 +22.8% 32254 ± 3% softirqs.CPU13.SCHED
> 25274 ± 2% +19.3% 30153 ± 2% softirqs.CPU130.SCHED
> 25219 ± 2% +15.4% 29103 ± 2% softirqs.CPU131.SCHED
> 25034 ± 2% +19.3% 29869 ± 2% softirqs.CPU132.SCHED
> 25448 +17.1% 29792 softirqs.CPU133.SCHED
> 25064 +17.5% 29450 ± 4% softirqs.CPU134.SCHED
> 25561 ± 2% +16.4% 29742 ± 4% softirqs.CPU135.SCHED
> 25620 +17.3% 30041 ± 3% softirqs.CPU136.SCHED
> 174761 ± 6% +11.1% 194097 ± 7% softirqs.CPU136.TIMER
> 26235 ± 2% +14.8% 30124 ± 2% softirqs.CPU137.SCHED
> 169540 ± 4% +13.3% 192089 ± 3% softirqs.CPU137.TIMER
> 25194 +18.3% 29808 ± 3% softirqs.CPU138.SCHED
> 25038 ± 4% +19.7% 29982 ± 4% softirqs.CPU139.SCHED
> 26136 ± 2% +20.5% 31494 ± 2% softirqs.CPU14.SCHED
> 25185 +20.2% 30269 ± 3% softirqs.CPU140.SCHED
> 25032 +20.2% 30098 ± 2% softirqs.CPU141.SCHED
> 25247 ± 2% +16.9% 29514 softirqs.CPU142.SCHED
> 24775 +12.9% 27962 ± 6% softirqs.CPU143.SCHED
> 25196 +19.1% 30016 ± 3% softirqs.CPU144.SCHED
> 24907 ± 2% +18.4% 29495 ± 3% softirqs.CPU145.SCHED
> 25254 +16.3% 29359 ± 4% softirqs.CPU146.SCHED
> 25123 +19.8% 30089 ± 3% softirqs.CPU147.SCHED
> 25311 ± 6% +17.6% 29757 ± 5% softirqs.CPU148.SCHED
> 25020 ± 2% +20.4% 30121 ± 2% softirqs.CPU149.SCHED
> 26013 +19.5% 31094 ± 2% softirqs.CPU15.SCHED
> 25040 +19.1% 29828 ± 4% softirqs.CPU150.SCHED
> 25358 +20.1% 30458 ± 2% softirqs.CPU151.SCHED
> 175966 ± 6% +11.6% 196369 ± 4% softirqs.CPU151.TIMER
> 24847 ± 2% +20.7% 30003 ± 2% softirqs.CPU152.SCHED
> 24860 ± 4% +19.9% 29811 ± 3% softirqs.CPU153.SCHED
> 25102 ± 3% +18.0% 29611 ± 3% softirqs.CPU154.SCHED
> 24819 +20.0% 29792 ± 3% softirqs.CPU155.SCHED
> 25414 ± 2% +17.3% 29808 softirqs.CPU156.SCHED
> 176417 ± 5% +15.6% 203967 ± 5% softirqs.CPU156.TIMER
> 25556 +16.1% 29663 ± 4% softirqs.CPU157.SCHED
> 25241 ± 2% +19.9% 30256 ± 3% softirqs.CPU158.SCHED
> 25462 +17.9% 30017 ± 2% softirqs.CPU159.SCHED
> 25909 +18.5% 30694 ± 3% softirqs.CPU16.SCHED
> 25139 +18.1% 29684 ± 4% softirqs.CPU160.SCHED
> 25431 +17.2% 29812 ± 4% softirqs.CPU161.SCHED
> 25712 +18.6% 30483 ± 5% softirqs.CPU162.SCHED
> 172304 ± 4% +13.1% 194925 ± 4% softirqs.CPU162.TIMER
> 25736 +16.7% 30040 ± 3% softirqs.CPU163.SCHED
> 169697 ± 6% +16.0% 196768 ± 7% softirqs.CPU163.TIMER
> 25196 ± 2% +17.4% 29591 ± 2% softirqs.CPU164.SCHED
> 24976 +19.1% 29753 ± 2% softirqs.CPU165.SCHED
> 25153 ± 2% +18.0% 29682 ± 2% softirqs.CPU166.SCHED
> 24977 +19.7% 29886 ± 2% softirqs.CPU167.SCHED
> 24784 ± 3% +18.9% 29457 ± 3% softirqs.CPU168.SCHED
> 25266 ± 2% +17.1% 29596 ± 4% softirqs.CPU169.SCHED
> 25886 ± 2% +19.3% 30876 ± 3% softirqs.CPU17.SCHED
> 24920 +17.6% 29295 ± 3% softirqs.CPU170.SCHED
> 24993 +18.7% 29660 ± 3% softirqs.CPU171.SCHED
> 25422 +17.1% 29763 ± 2% softirqs.CPU172.SCHED
> 25491 ± 2% +17.7% 29994 ± 3% softirqs.CPU173.SCHED
> 25264 ± 2% +16.8% 29518 ± 6% softirqs.CPU174.SCHED
> 25266 ± 2% +17.9% 29791 ± 2% softirqs.CPU175.SCHED
> 25231 ± 2% +17.9% 29754 ± 3% softirqs.CPU176.SCHED
> 183212 ± 2% +10.0% 201572 ± 2% softirqs.CPU176.TIMER
> 25273 ± 2% +18.3% 29899 ± 3% softirqs.CPU177.SCHED
> 25155 +19.8% 30145 ± 2% softirqs.CPU178.SCHED
> 25499 ± 2% +16.0% 29576 ± 5% softirqs.CPU179.SCHED
> 26339 +16.3% 30634 ± 2% softirqs.CPU18.SCHED
> 24757 ± 4% +19.2% 29500 ± 2% softirqs.CPU180.SCHED
> 25192 ± 3% +14.7% 28898 ± 5% softirqs.CPU181.SCHED
> 25166 ± 2% +19.2% 29999 ± 2% softirqs.CPU182.SCHED
> 25259 ± 2% +18.4% 29910 ± 4% softirqs.CPU183.SCHED
> 25247 ± 2% +16.9% 29519 ± 4% softirqs.CPU184.SCHED
> 25415 ± 2% +16.9% 29715 ± 2% softirqs.CPU185.SCHED
> 180421 ± 5% +11.4% 200946 ± 3% softirqs.CPU185.TIMER
> 24973 ± 3% +16.3% 29053 softirqs.CPU186.SCHED
> 25525 ± 2% +16.1% 29625 ± 2% softirqs.CPU187.SCHED
> 25461 +18.2% 30088 ± 2% softirqs.CPU188.SCHED
> 24833 +20.5% 29936 ± 2% softirqs.CPU189.SCHED
> 25894 +17.1% 30332 ± 4% softirqs.CPU19.SCHED
> 162878 ± 4% +18.0% 192168 ± 14% softirqs.CPU19.TIMER
> 25062 +18.4% 29663 ± 2% softirqs.CPU190.SCHED
> 24867 +18.3% 29425 ± 3% softirqs.CPU191.SCHED
> 24926 +18.8% 29620 ± 2% softirqs.CPU192.SCHED
> 183126 ± 5% +11.9% 204971 ± 2% softirqs.CPU192.TIMER
> 24864 ± 2% +16.2% 28893 ± 4% softirqs.CPU193.SCHED
> 25242 +17.7% 29702 ± 2% softirqs.CPU194.SCHED
> 25230 ± 2% +17.4% 29626 ± 3% softirqs.CPU195.SCHED
> 24981 ± 2% +18.8% 29680 ± 2% softirqs.CPU196.SCHED
> 25020 +17.3% 29348 ± 6% softirqs.CPU197.SCHED
> 25272 +18.5% 29942 ± 3% softirqs.CPU198.SCHED
> 25221 ± 2% +18.8% 29968 ± 3% softirqs.CPU199.SCHED
> 182100 ± 4% +8.3% 197211 ± 3% softirqs.CPU199.TIMER
> 26451 +18.1% 31251 ± 3% softirqs.CPU2.SCHED
> 26194 +18.4% 31019 ± 2% softirqs.CPU20.SCHED
> 25645 ± 2% +17.6% 30168 ± 3% softirqs.CPU200.SCHED
> 25337 +20.0% 30393 ± 3% softirqs.CPU201.SCHED
> 25160 +19.0% 29945 ± 2% softirqs.CPU202.SCHED
> 25322 ± 2% +18.3% 29944 ± 3% softirqs.CPU203.SCHED
> 25076 +20.2% 30130 ± 3% softirqs.CPU204.SCHED
> 25542 +19.2% 30455 ± 2% softirqs.CPU205.SCHED
> 25245 ± 2% +16.7% 29455 ± 2% softirqs.CPU206.SCHED
> 25317 ± 2% +17.5% 29743 ± 3% softirqs.CPU207.SCHED
> 25283 ± 2% +18.5% 29958 ± 4% softirqs.CPU208.SCHED
> 25533 +12.9% 28839 ± 6% softirqs.CPU209.SCHED
> 176766 ± 3% +13.1% 199978 ± 2% softirqs.CPU209.TIMER
> 26093 +18.6% 30954 ± 3% softirqs.CPU21.SCHED
> 25426 ± 2% +17.8% 29963 ± 3% softirqs.CPU210.SCHED
> 25363 ± 2% +17.5% 29794 softirqs.CPU211.SCHED
> 25056 ± 2% +18.3% 29644 ± 5% softirqs.CPU212.SCHED
> 24915 ± 2% +18.8% 29602 ± 3% softirqs.CPU213.SCHED
> 25269 ± 2% +19.9% 30296 ± 2% softirqs.CPU214.SCHED
> 24759 ± 2% +16.4% 28808 ± 5% softirqs.CPU215.SCHED
> 25090 +19.8% 30061 ± 2% softirqs.CPU216.SCHED
> 24887 ± 2% +17.2% 29156 softirqs.CPU217.SCHED
> 25021 +17.2% 29336 ± 4% softirqs.CPU218.SCHED
> 25320 ± 2% +17.7% 29806 ± 2% softirqs.CPU219.SCHED
> 25672 ± 2% +20.9% 31048 softirqs.CPU22.SCHED
> 25182 ± 2% +18.8% 29919 ± 3% softirqs.CPU220.SCHED
> 25152 ± 2% +20.3% 30248 ± 4% softirqs.CPU221.SCHED
> 24777 +19.1% 29504 ± 5% softirqs.CPU222.SCHED
> 25122 ± 3% +19.6% 30041 ± 2% softirqs.CPU223.SCHED
> 25079 ± 2% +19.4% 29954 ± 2% softirqs.CPU224.SCHED
> 25236 ± 2% +18.8% 29969 ± 2% softirqs.CPU225.SCHED
> 25105 ± 3% +19.0% 29876 ± 2% softirqs.CPU226.SCHED
> 25609 +15.6% 29613 ± 4% softirqs.CPU227.SCHED
> 180136 ± 8% +11.0% 200040 ± 5% softirqs.CPU227.TIMER
> 25435 +15.9% 29476 ± 2% softirqs.CPU228.SCHED
> 175813 ± 3% +16.7% 205108 ± 5% softirqs.CPU228.TIMER
> 25142 ± 2% +14.1% 28699 ± 5% softirqs.CPU229.SCHED
> 25831 +19.2% 30787 ± 2% softirqs.CPU23.SCHED
> 25460 ± 2% +18.8% 30242 ± 3% softirqs.CPU230.SCHED
> 25200 ± 3% +20.1% 30259 ± 2% softirqs.CPU231.SCHED
> 168374 ± 3% +8.7% 183098 ± 3% softirqs.CPU231.TIMER
> 25379 ± 2% +17.1% 29711 ± 2% softirqs.CPU232.SCHED
> 25524 ± 2% +18.5% 30246 ± 3% softirqs.CPU233.SCHED
> 25686 ± 2% +17.5% 30170 ± 3% softirqs.CPU234.SCHED
> 170330 ± 4% +11.3% 189542 ± 5% softirqs.CPU234.TIMER
> 25635 ± 2% +14.7% 29410 ± 4% softirqs.CPU235.SCHED
> 176292 ± 7% +15.9% 204389 ± 6% softirqs.CPU235.TIMER
> 25549 ± 2% +16.3% 29718 ± 2% softirqs.CPU236.SCHED
> 178538 ± 4% +9.2% 194880 ± 4% softirqs.CPU236.TIMER
> 25386 ± 2% +18.4% 30055 ± 2% softirqs.CPU237.SCHED
> 25191 ± 2% +17.9% 29707 softirqs.CPU238.SCHED
> 25186 ± 3% +20.3% 30293 softirqs.CPU239.SCHED
> 25877 +19.0% 30799 ± 3% softirqs.CPU24.SCHED
> 25506 +17.5% 29967 ± 3% softirqs.CPU240.SCHED
> 24964 ± 2% +21.1% 30222 ± 3% softirqs.CPU241.SCHED
> 25258 +17.7% 29719 ± 2% softirqs.CPU242.SCHED
> 25162 +18.2% 29740 ± 4% softirqs.CPU243.SCHED
> 25808 +17.3% 30285 ± 3% softirqs.CPU244.SCHED
> 25679 +17.4% 30150 ± 3% softirqs.CPU245.SCHED
> 175664 ± 3% +8.3% 190327 ± 4% softirqs.CPU245.TIMER
> 25134 ± 2% +19.7% 30079 ± 4% softirqs.CPU246.SCHED
> 24942 +19.9% 29913 ± 3% softirqs.CPU247.SCHED
> 25395 ± 2% +17.8% 29906 ± 2% softirqs.CPU248.SCHED
> 180993 ± 3% +10.8% 200584 ± 4% softirqs.CPU248.TIMER
> 25491 ± 2% +18.0% 30075 ± 4% softirqs.CPU249.SCHED
> 26099 +17.2% 30595 ± 3% softirqs.CPU25.SCHED
> 25332 +18.7% 30060 ± 2% softirqs.CPU250.SCHED
> 25471 ± 2% +17.4% 29892 ± 3% softirqs.CPU251.SCHED
> 180242 ± 4% +9.8% 197819 ± 4% softirqs.CPU251.TIMER
> 25406 ± 2% +16.9% 29694 ± 3% softirqs.CPU252.SCHED
> 25317 ± 3% +18.2% 29922 ± 3% softirqs.CPU253.SCHED
> 25103 ± 4% +19.9% 30106 ± 3% softirqs.CPU254.SCHED
> 25231 ± 2% +19.8% 30227 ± 3% softirqs.CPU255.SCHED
> 25509 ± 2% +18.2% 30161 ± 3% softirqs.CPU256.SCHED
> 25559 ± 3% +16.9% 29888 ± 3% softirqs.CPU257.SCHED
> 25277 ± 2% +16.8% 29523 ± 2% softirqs.CPU258.SCHED
> 24695 ± 5% +20.4% 29721 ± 2% softirqs.CPU259.SCHED
> 182550 ± 5% +10.5% 201781 ± 3% softirqs.CPU259.TIMER
> 25905 +19.5% 30970 ± 2% softirqs.CPU26.SCHED
> 164306 ± 3% +7.6% 176738 ± 5% softirqs.CPU26.TIMER
> 24829 ± 2% +20.8% 29990 ± 2% softirqs.CPU260.SCHED
> 25156 +19.1% 29971 ± 2% softirqs.CPU261.SCHED
> 25098 ± 3% +17.6% 29515 ± 4% softirqs.CPU262.SCHED
> 180807 ± 5% +9.4% 197856 ± 3% softirqs.CPU262.TIMER
> 25053 ± 2% +18.2% 29613 ± 2% softirqs.CPU263.SCHED
> 25505 +18.9% 30336 ± 3% softirqs.CPU264.SCHED
> 169958 ± 5% +11.8% 189979 ± 4% softirqs.CPU264.TIMER
> 25011 ± 3% +18.5% 29640 ± 4% softirqs.CPU265.SCHED
> 169719 ± 4% +22.2% 207453 ± 8% softirqs.CPU265.TIMER
> 25489 ± 2% +18.6% 30231 ± 3% softirqs.CPU266.SCHED
> 25727 +18.8% 30554 ± 2% softirqs.CPU267.SCHED
> 25423 +18.1% 30020 ± 2% softirqs.CPU268.SCHED
> 25451 ± 2% +19.0% 30292 ± 4% softirqs.CPU269.SCHED
> 26042 +18.5% 30852 ± 3% softirqs.CPU27.SCHED
> 163812 ± 3% +8.6% 177825 ± 5% softirqs.CPU27.TIMER
> 25649 ± 2% +18.3% 30337 ± 3% softirqs.CPU270.SCHED
> 25318 +19.3% 30212 ± 3% softirqs.CPU271.SCHED
> 25592 ± 2% +19.6% 30603 ± 3% softirqs.CPU272.SCHED
> 25440 ± 2% +20.0% 30520 ± 3% softirqs.CPU273.SCHED
> 26007 +18.2% 30741 ± 2% softirqs.CPU274.SCHED
> 25661 +18.7% 30454 ± 3% softirqs.CPU275.SCHED
> 25227 +21.0% 30536 ± 2% softirqs.CPU276.SCHED
> 25923 +17.9% 30560 ± 3% softirqs.CPU277.SCHED
> 25973 +14.6% 29757 ± 5% softirqs.CPU278.SCHED
> 25905 ± 2% +16.2% 30089 ± 3% softirqs.CPU279.SCHED
> 26091 +18.3% 30875 ± 3% softirqs.CPU28.SCHED
> 25736 ± 2% +17.4% 30217 ± 4% softirqs.CPU280.SCHED
> 25964 +13.5% 29482 ± 6% softirqs.CPU281.SCHED
> 170413 ± 4% +11.8% 190550 ± 4% softirqs.CPU281.TIMER
> 25669 +18.8% 30484 ± 3% softirqs.CPU282.SCHED
> 25462 ± 2% +18.6% 30208 softirqs.CPU283.SCHED
> 174059 ± 6% +10.6% 192446 ± 5% softirqs.CPU283.TIMER
> 25578 +18.4% 30287 ± 3% softirqs.CPU284.SCHED
> 25703 +19.1% 30617 ± 3% softirqs.CPU285.SCHED
> 25775 ± 2% +16.0% 29891 ± 2% softirqs.CPU286.SCHED
> 25175 ± 2% +16.0% 29204 ± 4% softirqs.CPU287.SCHED
> 26076 +17.7% 30684 ± 3% softirqs.CPU29.SCHED
> 26116 +18.8% 31032 ± 2% softirqs.CPU3.SCHED
> 26043 +18.2% 30789 ± 3% softirqs.CPU30.SCHED
> 25884 +18.5% 30681 ± 2% softirqs.CPU31.SCHED
> 167289 ± 2% +6.3% 177832 ± 6% softirqs.CPU31.TIMER
> 26095 +17.1% 30563 ± 3% softirqs.CPU32.SCHED
> 161186 ± 2% +10.6% 178192 ± 4% softirqs.CPU32.TIMER
> 26124 +18.2% 30887 ± 3% softirqs.CPU33.SCHED
> 25966 +18.0% 30651 ± 2% softirqs.CPU34.SCHED
> 167402 ± 4% +6.6% 178425 ± 4% softirqs.CPU34.TIMER
> 25944 +18.0% 30622 ± 3% softirqs.CPU35.SCHED
> 26167 +17.9% 30861 ± 2% softirqs.CPU36.SCHED
> 25900 +20.7% 31271 ± 3% softirqs.CPU37.SCHED
> 25475 ± 3% +21.1% 30843 ± 3% softirqs.CPU38.SCHED
> 25642 ± 2% +19.4% 30627 ± 3% softirqs.CPU39.SCHED
> 25494 ± 2% +20.7% 30774 ± 2% softirqs.CPU4.SCHED
> 25610 +18.1% 30236 ± 4% softirqs.CPU40.SCHED
> 26064 ± 3% +17.2% 30546 ± 3% softirqs.CPU41.SCHED
> 25739 ± 2% +15.2% 29643 ± 4% softirqs.CPU42.SCHED
> 25730 ± 2% +18.5% 30493 ± 3% softirqs.CPU43.SCHED
> 175037 ± 6% +10.6% 193664 ± 4% softirqs.CPU43.TIMER
> 25729 +18.4% 30470 ± 3% softirqs.CPU44.SCHED
> 25114 ± 2% +21.3% 30475 ± 2% softirqs.CPU45.SCHED
> 25415 ± 3% +20.1% 30511 ± 2% softirqs.CPU46.SCHED
> 25558 +17.4% 29994 softirqs.CPU47.SCHED
> 25624 +16.7% 29897 ± 4% softirqs.CPU48.SCHED
> 167429 ± 5% +13.0% 189268 ± 5% softirqs.CPU48.TIMER
> 25871 +17.3% 30344 ± 3% softirqs.CPU49.SCHED
> 167694 ± 3% +12.5% 188683 ± 4% softirqs.CPU49.TIMER
> 25681 +20.0% 30819 ± 3% softirqs.CPU5.SCHED
> 25661 +17.8% 30220 softirqs.CPU50.SCHED
> 25857 +17.6% 30408 ± 3% softirqs.CPU51.SCHED
> 25943 +17.7% 30544 ± 3% softirqs.CPU52.SCHED
> 25398 ± 2% +19.6% 30387 ± 3% softirqs.CPU53.SCHED
> 25599 ± 2% +18.9% 30428 ± 3% softirqs.CPU54.SCHED
> 25454 ± 2% +20.5% 30663 ± 3% softirqs.CPU55.SCHED
> 25603 ± 2% +18.6% 30374 ± 3% softirqs.CPU56.SCHED
> 25665 +18.7% 30453 ± 3% softirqs.CPU57.SCHED
> 25853 +18.9% 30740 ± 2% softirqs.CPU58.SCHED
> 25916 +17.5% 30454 ± 3% softirqs.CPU59.SCHED
> 26202 +16.7% 30570 ± 3% softirqs.CPU6.SCHED
> 25549 ± 2% +20.5% 30778 ± 2% softirqs.CPU60.SCHED
> 25854 +18.5% 30626 ± 2% softirqs.CPU61.SCHED
> 25516 ± 2% +17.1% 29871 ± 4% softirqs.CPU62.SCHED
> 25833 +17.2% 30284 ± 3% softirqs.CPU63.SCHED
> 25510 ± 3% +19.2% 30420 ± 3% softirqs.CPU64.SCHED
> 26177 +16.5% 30487 ± 3% softirqs.CPU65.SCHED
> 166747 ± 3% +11.5% 185900 ± 3% softirqs.CPU65.TIMER
> 25637 ± 2% +19.0% 30503 ± 3% softirqs.CPU66.SCHED
> 25644 ± 2% +15.4% 29588 softirqs.CPU67.SCHED
> 25796 +18.6% 30585 ± 3% softirqs.CPU68.SCHED
> 25503 +20.2% 30654 ± 3% softirqs.CPU69.SCHED
> 25912 +16.4% 30171 ± 4% softirqs.CPU7.SCHED
> 25994 ± 6% +16.2% 30203 softirqs.CPU70.SCHED
> 25255 +17.9% 29766 ± 3% softirqs.CPU71.SCHED
> 25057 +19.1% 29854 ± 3% softirqs.CPU72.SCHED
> 24925 ± 2% +18.7% 29588 ± 2% softirqs.CPU73.SCHED
> 25774 +16.1% 29929 ± 3% softirqs.CPU74.SCHED
> 177035 ± 2% +7.9% 190942 ± 4% softirqs.CPU74.TIMER
> 25433 +19.2% 30327 ± 3% softirqs.CPU75.SCHED
> 25274 ± 2% +15.5% 29184 ± 3% softirqs.CPU76.SCHED
> 25297 +17.7% 29765 ± 4% softirqs.CPU77.SCHED
> 25557 ± 2% +18.2% 30203 ± 3% softirqs.CPU78.SCHED
> 25604 ± 2% +17.3% 30034 ± 3% softirqs.CPU79.SCHED
> 175758 ± 6% +9.8% 193033 ± 3% softirqs.CPU79.TIMER
> 26086 +18.4% 30878 ± 2% softirqs.CPU8.SCHED
> 25297 +18.6% 30013 ± 3% softirqs.CPU80.SCHED
> 25450 +17.8% 29987 ± 2% softirqs.CPU81.SCHED
> 25125 ± 3% +17.0% 29404 ± 3% softirqs.CPU82.SCHED
> 24840 ± 2% +18.7% 29490 ± 6% softirqs.CPU83.SCHED
> 25920 +14.9% 29770 ± 2% softirqs.CPU84.SCHED
> 168708 ± 5% +18.4% 199703 ± 7% softirqs.CPU84.TIMER
> 24980 ± 3% +19.5% 29850 ± 3% softirqs.CPU85.SCHED
> 25338 +18.6% 30042 ± 2% softirqs.CPU86.SCHED
> 25404 ± 2% +18.6% 30142 ± 2% softirqs.CPU87.SCHED
> 177099 ± 3% +9.0% 193072 softirqs.CPU87.TIMER
> 24855 ± 2% +20.7% 30000 ± 3% softirqs.CPU88.SCHED
> 25532 ± 2% +17.2% 29916 ± 3% softirqs.CPU89.SCHED
> 26321 ± 2% +14.7% 30186 ± 4% softirqs.CPU9.SCHED
> 25622 ± 2% +17.4% 30077 ± 3% softirqs.CPU90.SCHED
> 177491 ± 4% +10.9% 196822 ± 4% softirqs.CPU90.TIMER
> 25638 ± 2% +14.0% 29228 ± 5% softirqs.CPU91.SCHED
> 175040 ± 5% +16.7% 204221 ± 6% softirqs.CPU91.TIMER
> 25387 ± 2% +18.0% 29968 ± 2% softirqs.CPU92.SCHED
> 25316 ± 2% +19.5% 30262 ± 2% softirqs.CPU93.SCHED
> 25125 ± 2% +19.6% 30051 softirqs.CPU94.SCHED
> 25303 ± 2% +18.1% 29875 ± 2% softirqs.CPU95.SCHED
> 25481 +18.3% 30133 ± 3% softirqs.CPU96.SCHED
> 25533 +18.1% 30146 ± 3% softirqs.CPU97.SCHED
> 24892 ± 3% +20.4% 29982 ± 3% softirqs.CPU98.SCHED
> 24611 +20.3% 29607 ± 3% softirqs.CPU99.SCHED
> 7325587 +18.2% 8660780 ± 3% softirqs.SCHED
>
>
>
> will-it-scale.per_thread_ops
>
> 1500 +--------------------------------------------------------------------+
> 1450 |+. +. .+ +++. +. .+++. +. .++. + |
> | + ++ + ++ + ++ + + .++.+ |
> 1400 |-+ : + + |
> 1350 |-+ : : OO |
> 1300 |-+ + O |
> 1250 |-+ OO O OO OO O|
> | O OO O O OO OO O |
> 1200 |-+ O O OO OO OO O |
> 1150 |-+ O |
> 1100 |-+ O O O O |
> 1050 |O+O O O O O |
> | O O O O |
> 1000 |-+ O O |
> 950 +--------------------------------------------------------------------+
>
>
> [*] bisect-good sample
> [O] bisect-bad sample
>
>
>
> Disclaimer:
> Results have been estimated based on internal Intel analysis and are provided
> for informational purposes only. Any difference in system hardware or software
> design or configuration may affect actual performance.
>
>
> Thanks,
> Rong Chen
>
>
> _______________________________________________
> LKP mailing list -- lkp@lists.01.org
> To unsubscribe send an email to lkp-leave@lists.01.org
>

--
Zhengjun Xing

\
 
 \ /
  Last update: 2020-06-16 04:06    [W:0.792 / U:0.704 seconds]
©2003-2020 Jasper Spaans|hosted at Digital Ocean and TransIP|Read the blog|Advertise on this site