Received: by 2002:a05:6a10:2785:0:0:0:0 with SMTP id ia5csp148694pxb; Tue, 12 Jan 2021 23:18:38 -0800 (PST) X-Google-Smtp-Source: ABdhPJzG9esWpP1Mb+58wiaHfr+p5g515mpXefYy3NBph8OmLAMUjV7gVPNfa/2ZCIv7isrwMg8X X-Received: by 2002:a17:906:e093:: with SMTP id gh19mr585643ejb.510.1610522318385; Tue, 12 Jan 2021 23:18:38 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1610522318; cv=none; d=google.com; s=arc-20160816; b=gtHa/wI2jv26lbU6Cj7hAAtnqlK9BbJVEYx6CKwa13KeGlIbq5GpzoGT+/T+EhUccs F+BLoh1mOaqIMA1NyfSzsvF9uxszMn+Kk6y4i9v3GDCcmCf5Akro+j9oOlmK56ETGx6p b934znAFpCfb3tBwiSg3POL73hleTxpevRvONWQ9gY/b62sqCnvo90x6L4zQhGmx0M0d z9HPONQieHelVVM0c7QIR8JblKp3vmtbWf+aHohaOxobOlkTrNq0UeWWZ0v1aKPJEG3V 0aJ6K7olqL65qXQ3xTXGRIgUX3AwRJrLd0PZm2RfHRvpJfV+8xx7gXcnaqqZJX07sZ93 jzuQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:content-language :in-reply-to:mime-version:user-agent:date:message-id:from:references :cc:to:subject:dkim-signature; bh=kR9KWmbp60BGGGyS1bn3ZbBdvW4MDhJ+r3/wObe6qr4=; b=X+xZPEdu4d5kYVesMnmRqoQ+O4clDu9DdN7+vusvNNk7kNzZxrKOshZZH3qtuWlMsH ZosRBdoknJkp/s1+2ARryf3qz8P4Fft/s3rPz5A9jO8b1MRh6ksEhqWH0A8WqzhOSaVx ErGToJI3kQGHLGvZlfmlekVa3Vh8BPAbNk7esfIsOktWliUVnnBG+R7gBNuG2MBODzsT otYOPzSkDppCgf2pMdp27zx2Aw1HmhTHGESImyAPrAEOTlcqrvjlGlBueg59sYpnkl7Q def2DE6lZ1a1rKWPytRDD4V8zf/bMMc+91aPUuStmTsOhFTr+lSIM3grLQ3HzfnkuzDJ xa4A== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmx.net header.s=badeba3b8450 header.b=Bcp14lL5; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=gmx.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id a14si563342eds.103.2021.01.12.23.18.14; Tue, 12 Jan 2021 23:18:38 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@gmx.net header.s=badeba3b8450 header.b=Bcp14lL5; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=gmx.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726683AbhAMHRF (ORCPT + 99 others); Wed, 13 Jan 2021 02:17:05 -0500 Received: from mout.gmx.net ([212.227.17.21]:40341 "EHLO mout.gmx.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726294AbhAMHRE (ORCPT ); Wed, 13 Jan 2021 02:17:04 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1610522116; bh=18+YD26YNEy40kHqqO6VrwM2YUafJZENlzKKFDQwYU0=; h=X-UI-Sender-Class:Subject:To:Cc:References:From:Date:In-Reply-To; b=Bcp14lL59ftuqYNHO+BRHHdVa7bP3Mqt7af+5tl+iyzH/BUsNveQpgnWjYFaX0oRu o0ICLya28DAMpc5mGaV8hWIyFpHwaBIX6OmeNmhOi62JOPxnuhzr75IqafgPnzKHuq F85P9J90TG8ZyLRM8fCIoYK669QC1jQ6zWUhqlpQ= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Received: from [0.0.0.0] ([149.28.201.231]) by mail.gmx.com (mrgmx105 [212.227.17.174]) with ESMTPSA (Nemesis) id 1MCbEp-1kqXpZ37Ct-009gN0; Wed, 13 Jan 2021 08:15:15 +0100 Subject: Re: [btrfs] e86bb85b1f: stress-ng.utime.ops_per_sec -70.1% regression To: kernel test robot , Qu Wenruo Cc: 0day robot , LKML , lkp@lists.01.org, ying.huang@intel.com, feng.tang@intel.com, zhengjun.xing@intel.com, linux-btrfs@vger.kernel.org References: <20210112152415.GG30747@xsang-OptiPlex-9020> From: Qu Wenruo Message-ID: Date: Wed, 13 Jan 2021 15:15:09 +0800 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.6.0 MIME-Version: 1.0 In-Reply-To: <20210112152415.GG30747@xsang-OptiPlex-9020> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: quoted-printable X-Provags-ID: V03:K1:MFXpDvKLB1s8m8k1f0Aztp7IdItgH4SJ5TzDMn+gr4vgas3bBYa 4KPCc+v7m05CghHNrEWKBfE4cxAbzSFYSLrzkKDvDWn6taqP9tMSOzeCuoRVJIcwn5EREAz m7xTE71meZXR/wXRsx9Wf3BNwrRjYtzdh2D2+FF54kFlKQc0l1c6yMaN56Ino84900cGAKm AIvjMzbgBQVqhdw1J9QEA== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:1uRxYMGNZWc=:g5DbyEIfWbmNchJXO0uo3X zQoxtV7hurwg2a+IQ1KSLMzh3sEFKbnduiBXgtPMZ+yTNTYi4RIUGBbpCWGY2ZUtlnkrirOzO B1pD4DiaqZyh/rWP/jIUqgvmtE0Nf1WD8yiNzNAPSBc9cH20jSVgcO4ZMPfwKHZVVDctFL+ii x2KuCbXJXPLmWVx9cVhlic6Y8D+UlbVqskLfhaBqGyqNtBZ83/chO+8aXxySh8QjYwcTlrrBQ G4iIGjzsHXPS3cHI+RcmJi+9Gj/ZtmRavgxoNZbd3qgRo7aezm8dN2suYQ1vBGLPa4ruZNyb8 XC8RDE5wib4tJio9KLLBz4zy5kLKigKhyQZf79KaB20a7JMOo4fKIbFniH7mswq+9J35vNDRb t+IfUYr7TO8fM+SNzr2B5UbkNn/jrftegF2xMws+MtaYv+QFd+yjbap413DV+e58dYNBfXPdw R28zZN51w5ljZiJWRx/BO00aNaEKdF3wpa6jp9ObnFdHib8Fnb6AVpCpbywnUdQowAI7iUVkl 0sgAcygkEZv2e1NaDADPFuPWBJJailuyrUvGDT0Y2+J48wE99fzRbfYIwHunv/D8HfodGosCa NyLcjtcIY9l1OnIKTYCh8F1auQZ7MN0Vlt40YTE2KBP/d78rVKm/lyljAzsC8msgv6xAGYqph s5aL9u3i79fwETgXf+c9saMsBIwQbVGnzPgej6WVhkUT4feDMvHE0WJ8Xkir6XKJyFlfP9E9F CGk9Ybinn5UPjdgeeMdlc11keMxxeQi9uMHo0Oq5JRi39AmOANjpTYFfufioX7DI819/BGRNB 4SWV3wCuMv/69iroMbSiWzteHAkatQ8r1xsJPgYKzHyKvOcO7Ptc7Y76ZquDOrPlm5ZFi/uW0 JEJZE9DDMKa3gA9rHUnA== Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 2021/1/12 =E4=B8=8B=E5=8D=8811:24, kernel test robot wrote: > > Greeting, > > FYI, we noticed a -70.1% regression of stress-ng.utime.ops_per_sec due t= o commit: > > > commit: e86bb85b1fec48bcb8dfb79ec9f104d1a38fda78 ("[PATCH] btrfs: make b= trfs_dirty_inode() to always reserve metadata space") > url: https://github.com/0day-ci/linux/commits/Qu-Wenruo/btrfs-make-btrfs= _dirty_inode-to-always-reserve-metadata-space/20210108-134133 > base: https://git.kernel.org/cgit/linux/kernel/git/kdave/linux.git for-n= ext > > in testcase: stress-ng > on test machine: 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz wit= h 512G memory > with following parameters: > > nr_threads: 10% > disk: 1HDD > testtime: 30s > class: filesystem > cpufreq_governor: performance > ucode: 0x5003003 > fs: btrfs > > > > > If you fix the issue, kindly add following tag > Reported-by: kernel test robot > > > Details are as below: > ------------------------------------------------------------------------= --------------------------> > > > To reproduce: > > git clone https://github.com/intel/lkp-tests.git > cd lkp-tests > bin/lkp install job.yaml # job file is attached in this email > bin/lkp run job.yaml > > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > class/compiler/cpufreq_governor/disk/fs/kconfig/nr_threads/rootfs/tbox_g= roup/testcase/testtime/ucode: > filesystem/gcc-9/performance/1HDD/btrfs/x86_64-rhel-8.3/10%/debian-10= .4-x86_64-20200603.cgz/lkp-csl-2sp7/stress-ng/30s/0x5003003 > > commit: > 97847e0652 ("Merge branch 'for-next-next-v5.10-20201211' into for-nex= t-20201211") > e86bb85b1f ("btrfs: make btrfs_dirty_inode() to always reserve metada= ta space") > > 97847e06525b51ea e86bb85b1fec48bcb8dfb79ec9f > ---------------- --------------------------- > %stddev %change %stddev > \ | \ > 1098218 -40.4% 654054 stress-ng.access.ops > 36607 -40.4% 21801 stress-ng.access.ops_per_= sec This is a little interesting. Although accessing an inode will update its atime, but don't we have lazy_atime mount option? > 92962 =C2=B1 2% -44.1% 51992 =C2=B1 3% stress-ng.chmod= .ops > 3098 =C2=B1 2% -44.1% 1733 =C2=B1 3% stress-ng.chmod= .ops_per_sec > 936128 =C2=B1 6% -41.0% 552284 stress-ng.chown.ops > 31204 =C2=B1 6% -41.0% 18409 stress-ng.chown.ops_= per_sec > 1939514 -18.5% 1580533 stress-ng.fcntl.ops > 64650 -18.5% 52684 stress-ng.fcntl.ops_per_s= ec > 3705607 =C2=B1 2% -70.1% 1109769 stress-ng.utime.ops > 123519 =C2=B1 2% -70.1% 36992 stress-ng.utime.ops_= per_sec Another interesting part is, only stress-ng is reporting such regressioin on the commit? No other report on the commit with different test env? E.g. NVME SSD? Above operations is affected by such commit, but I'm a little surprised only one report here. Just because flushing on HDD is more expensive? If no other test suite is fine, I would prefer to accept the drop, as it really streamline the operations. Thanks, Qu > 381.20 =C2=B1 6% +12.3% 428.27 =C2=B1 9% sched_debug.cfs= _rq:/.load_avg.avg > 6316 =C2=B1 57% -79.8% 1278 =C2=B1 68% softirqs.CPU77.= BLOCK > 10488 =C2=B1101% -89.5% 1100 =C2=B1124% softirqs.CPU78.= BLOCK > 5605 =C2=B1 92% -82.3% 990.50 =C2=B1 32% softirqs.CPU80.= BLOCK > 6094 =C2=B1128% -89.9% 614.50 =C2=B1 44% softirqs.CPU92.= BLOCK > 4921 =C2=B1 9% +20.5% 5931 =C2=B1 5% slabinfo.dmaeng= ine-unmap-16.active_objs > 4922 =C2=B1 9% +20.5% 5933 =C2=B1 5% slabinfo.dmaeng= ine-unmap-16.num_objs > 9818 =C2=B1 5% -6.9% 9139 =C2=B1 3% slabinfo.kmallo= c-rcl-256.active_objs > 49223 =C2=B1 3% -18.4% 40177 =C2=B1 3% slabinfo.radix_= tree_node.active_objs > 903.25 =C2=B1 3% -18.0% 740.50 =C2=B1 3% slabinfo.radix_= tree_node.active_slabs > 50620 =C2=B1 3% -18.0% 41505 =C2=B1 3% slabinfo.radix_= tree_node.num_objs > 903.25 =C2=B1 3% -18.0% 740.50 =C2=B1 3% slabinfo.radix_= tree_node.num_slabs > 9927 =C2=B1 3% +5.8% 10504 proc-vmstat.nr_activ= e_anon > 6043459 =C2=B1 2% -2.2% 5911900 proc-vmstat.nr_dirti= ed > 1125 -6.1% 1056 =C2=B1 4% proc-vmstat.nr_dirty > 20361 =C2=B1 2% +4.7% 21309 proc-vmstat.nr_shmem > 66221 -4.3% 63404 =C2=B1 2% proc-vmstat.nr_slab_= reclaimable > 9927 =C2=B1 3% +5.8% 10504 proc-vmstat.nr_zone_= active_anon > 1225 -5.8% 1154 =C2=B1 3% proc-vmstat.nr_zone_= write_pending > 11313111 -2.1% 11072335 proc-vmstat.pgfault > 0.00 +125.0% 0.00 =C2=B1 19% perf-sched.sch_delay= .avg.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.start_trans= action.btrfs_dirty_inode > 0.01 =C2=B1 13% -24.5% 0.01 =C2=B1 15% perf-sched.sch_= delay.max.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64 > 3.26 =C2=B1 41% -98.8% 0.04 perf-sched.sch_delay= .max.ms.rwsem_down_write_slowpath.chmod_common.do_fchmodat.__x64_sys_chmod > 0.00 =C2=B1 50% +123.5% 0.01 =C2=B1 24% perf-sched.sch_= delay.max.ms.wait_for_partner.fifo_open.do_dentry_open.path_openat > 4.77 =C2=B1 6% -25.7% 3.54 perf-sched.total_sch= _delay.max.ms > 0.02 =C2=B1 7% +19.5% 0.02 =C2=B1 5% perf-sched.wait= _and_delay.avg.ms.rwsem_down_write_slowpath.chmod_common.do_fchmodat.__x64= _sys_fchmodat > 1711 =C2=B1 27% +60.7% 2750 =C2=B1 22% perf-sched.wait= _and_delay.count.rwsem_down_write_slowpath.chmod_common.__x64_sys_fchmod.d= o_syscall_64 > 0.03 =C2=B1132% +2497.6% 0.81 =C2=B1 66% perf-sched.wait= _time.avg.ms.preempt_schedule_common._cond_resched.dput.path_put.do_fchmod= at > 0.25 =C2=B1 67% +243.4% 0.86 =C2=B1 49% perf-sched.wait= _time.avg.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.start_= transaction.btrfs_dirty_inode > 0.02 =C2=B1 11% +28.6% 0.02 =C2=B1 13% perf-sched.wait= _time.avg.ms.rwsem_down_write_slowpath.chmod_common.do_fchmodat.__x64_sys_= chmod > 0.27 =C2=B1160% +1248.5% 3.67 =C2=B1 57% perf-sched.wait= _time.max.ms.preempt_schedule_common._cond_resched.dput.path_put.do_fchmod= at > 0.04 =C2=B1165% +4851.4% 2.17 =C2=B1 99% perf-sched.wait= _time.max.ms.preempt_schedule_common._cond_resched.mnt_want_write.chmod_co= mmon.do_fchmodat > 36969238 -5.8% 34829162 =C2=B1 2% perf-stat.i.cache-mi= sses > 2.009e+09 -2.7% 1.954e+09 perf-stat.i.dTLB-stores > 12297175 =C2=B1 2% -6.5% 11500340 perf-stat.i.iTLB-loa= d-misses > 1843 +7.0% 1972 =C2=B1 2% perf-stat.i.instruct= ions-per-iTLB-miss > 8936 -2.2% 8740 perf-stat.i.minor-faults > 952962 -3.6% 919068 perf-stat.i.node-loads > 5348157 -7.4% 4950006 =C2=B1 2% perf-stat.i.node-sto= re-misses > 8942 -2.2% 8748 perf-stat.i.page-faults > 0.00 =C2=B1 20% +0.0 0.00 =C2=B1 18% perf-stat.overa= ll.dTLB-store-miss-rate% > 1263 +6.1% 1339 perf-stat.overall.instruc= tions-per-iTLB-miss > 36924576 -5.8% 34784593 =C2=B1 2% perf-stat.ps.cache-m= isses > 2.003e+09 -2.7% 1.949e+09 perf-stat.ps.dTLB-stores > 12274047 =C2=B1 2% -6.5% 11479296 perf-stat.ps.iTLB-lo= ad-misses > 8880 -2.1% 8694 perf-stat.ps.minor-faults > 950813 -3.6% 916929 perf-stat.ps.node-loads > 5343222 -7.5% 4944422 =C2=B1 2% perf-stat.ps.node-st= ore-misses > 8887 -2.1% 8702 perf-stat.ps.page-faults > 57.00 =C2=B1166% -100.0% 0.00 interrupts.92:PCI-MS= I.31981625-edge.i40e-eth0-TxRx-56 > 19339 =C2=B1 7% +31.3% 25385 =C2=B1 16% interrupts.CPU1= 3.CAL:Function_call_interrupts > 19917 =C2=B1 5% +9.7% 21856 interrupts.CPU23.TLB= :TLB_shootdowns > 20940 =C2=B1 5% +9.5% 22935 =C2=B1 4% interrupts.CPU2= 9.CAL:Function_call_interrupts > 3470 =C2=B1 65% -96.1% 136.75 =C2=B1 5% interrupts.CPU2= 9.NMI:Non-maskable_interrupts > 3470 =C2=B1 65% -96.1% 136.75 =C2=B1 5% interrupts.CPU2= 9.PMI:Performance_monitoring_interrupts > 2061 =C2=B1160% -93.5% 134.00 =C2=B1 3% interrupts.CPU3= 3.NMI:Non-maskable_interrupts > 2061 =C2=B1160% -93.5% 134.00 =C2=B1 3% interrupts.CPU3= 3.PMI:Performance_monitoring_interrupts > 3041 =C2=B1 47% +75.6% 5342 =C2=B1 36% interrupts.CPU3= 5.RES:Rescheduling_interrupts > 3748 =C2=B1 96% -96.5% 133.00 =C2=B1 5% interrupts.CPU4= 0.NMI:Non-maskable_interrupts > 3748 =C2=B1 96% -96.5% 133.00 =C2=B1 5% interrupts.CPU4= 0.PMI:Performance_monitoring_interrupts > 21172 =C2=B1 5% -12.7% 18476 =C2=B1 6% interrupts.CPU4= 5.CAL:Function_call_interrupts > 56.25 =C2=B1169% -100.0% 0.00 interrupts.CPU56.92:= PCI-MSI.31981625-edge.i40e-eth0-TxRx-56 > 122.50 =C2=B1 25% -34.5% 80.25 =C2=B1 32% interrupts.CPU5= 6.NMI:Non-maskable_interrupts > 122.50 =C2=B1 25% -34.5% 80.25 =C2=B1 32% interrupts.CPU5= 6.PMI:Performance_monitoring_interrupts > 21585 =C2=B1 5% +13.4% 24479 =C2=B1 5% interrupts.CPU5= 8.TLB:TLB_shootdowns > 3340 =C2=B1 22% +76.3% 5888 =C2=B1 48% interrupts.CPU6= 2.RES:Rescheduling_interrupts > 23969 =C2=B1 5% +12.5% 26976 =C2=B1 14% interrupts.CPU6= 6.CAL:Function_call_interrupts > 22832 =C2=B1 5% +26.5% 28873 =C2=B1 14% interrupts.CPU6= 9.CAL:Function_call_interrupts > 2329 =C2=B1106% -66.3% 784.50 =C2=B1150% interrupts.CPU7= 3.NMI:Non-maskable_interrupts > 2329 =C2=B1106% -66.3% 784.50 =C2=B1150% interrupts.CPU7= 3.PMI:Performance_monitoring_interrupts > 3520 =C2=B1 65% -96.7% 116.00 =C2=B1 27% interrupts.CPU7= 7.NMI:Non-maskable_interrupts > 3520 =C2=B1 65% -96.7% 116.00 =C2=B1 27% interrupts.CPU7= 7.PMI:Performance_monitoring_interrupts > 1570 =C2=B1156% -93.6% 101.00 =C2=B1 37% interrupts.CPU8= 1.NMI:Non-maskable_interrupts > 1570 =C2=B1156% -93.6% 101.00 =C2=B1 37% interrupts.CPU8= 1.PMI:Performance_monitoring_interrupts > 2501 =C2=B1109% -95.9% 102.75 =C2=B1 41% interrupts.CPU8= 8.NMI:Non-maskable_interrupts > 2501 =C2=B1109% -95.9% 102.75 =C2=B1 41% interrupts.CPU8= 8.PMI:Performance_monitoring_interrupts > 5208 =C2=B1 44% -48.6% 2674 =C2=B1 46% interrupts.CPU9= .RES:Rescheduling_interrupts > 20273 =C2=B1 10% +22.3% 24803 =C2=B1 11% interrupts.CPU9= 1.CAL:Function_call_interrupts > 1833 =C2=B1158% -93.6% 117.75 =C2=B1 24% interrupts.CPU9= 4.NMI:Non-maskable_interrupts > 1833 =C2=B1158% -93.6% 117.75 =C2=B1 24% interrupts.CPU9= 4.PMI:Performance_monitoring_interrupts > 47.69 =C2=B1 11% -27.3 20.39 =C2=B1 3% perf-profile.ca= lltrace.cycles-pp.do_faccessat.do_syscall_64.entry_SYSCALL_64_after_hwfram= e > 20.56 =C2=B1 11% -12.1 8.50 =C2=B1 3% perf-profile.ca= lltrace.cycles-pp.prepare_creds.do_faccessat.do_syscall_64.entry_SYSCALL_6= 4_after_hwframe > 18.78 =C2=B1 11% -11.9 6.92 =C2=B1 3% perf-profile.ca= lltrace.cycles-pp.put_cred_rcu.do_faccessat.do_syscall_64.entry_SYSCALL_64= _after_hwframe > 5.42 =C2=B1 12% -3.8 1.60 =C2=B1 3% perf-profile.ca= lltrace.cycles-pp.free_uid.put_cred_rcu.do_faccessat.do_syscall_64.entry_S= YSCALL_64_after_hwframe > 5.38 =C2=B1 12% -3.8 1.57 =C2=B1 3% perf-profile.ca= lltrace.cycles-pp.refcount_dec_and_lock_irqsave.free_uid.put_cred_rcu.do_f= accessat.do_syscall_64 > 5.36 =C2=B1 12% -3.8 1.56 =C2=B1 3% perf-profile.ca= lltrace.cycles-pp.refcount_dec_not_one.refcount_dec_and_lock_irqsave.free_= uid.put_cred_rcu.do_faccessat > 5.32 =C2=B1 11% -3.1 2.19 =C2=B1 3% perf-profile.ca= lltrace.cycles-pp.key_put.put_cred_rcu.do_faccessat.do_syscall_64.entry_SY= SCALL_64_after_hwframe > 5.17 =C2=B1 11% -2.4 2.74 =C2=B1 4% perf-profile.ca= lltrace.cycles-pp.security_prepare_creds.prepare_creds.do_faccessat.do_sys= call_64.entry_SYSCALL_64_after_hwframe > 4.77 =C2=B1 8% -2.3 2.50 =C2=B1 4% perf-profile.ca= lltrace.cycles-pp.btrfs_update_inode.btrfs_dirty_inode.btrfs_setattr.notif= y_change.chmod_common > 3.79 =C2=B1 7% -2.0 1.84 =C2=B1 4% perf-profile.ca= lltrace.cycles-pp.btrfs_delayed_update_inode.btrfs_update_inode.btrfs_dirt= y_inode.btrfs_setattr.notify_change > 3.54 =C2=B1 12% -1.8 1.74 =C2=B1 4% perf-profile.ca= lltrace.cycles-pp.apparmor_cred_prepare.security_prepare_creds.prepare_cre= ds.do_faccessat.do_syscall_64 > 3.49 =C2=B1 9% -1.8 1.72 =C2=B1 6% perf-profile.ca= lltrace.cycles-pp.security_cred_free.put_cred_rcu.do_faccessat.do_syscall_= 64.entry_SYSCALL_64_after_hwframe > 2.49 =C2=B1 9% -1.4 1.08 =C2=B1 8% perf-profile.ca= lltrace.cycles-pp.apparmor_cred_free.security_cred_free.put_cred_rcu.do_fa= ccessat.do_syscall_64 > 3.38 =C2=B1 11% -1.3 2.04 =C2=B1 6% perf-profile.ca= lltrace.cycles-pp.filename_lookup.do_faccessat.do_syscall_64.entry_SYSCALL= _64_after_hwframe > 3.25 =C2=B1 11% -1.3 1.96 =C2=B1 3% perf-profile.ca= lltrace.cycles-pp.__do_sys_newfstatat.do_syscall_64.entry_SYSCALL_64_after= _hwframe > 2.99 =C2=B1 11% -1.2 1.82 =C2=B1 6% perf-profile.ca= lltrace.cycles-pp.path_lookupat.filename_lookup.do_faccessat.do_syscall_64= .entry_SYSCALL_64_after_hwframe > 1.55 =C2=B1 11% -1.2 0.39 =C2=B1 57% perf-profile.ca= lltrace.cycles-pp.join_transaction.start_transaction.btrfs_dirty_inode.btr= fs_setattr.notify_change > 2.89 =C2=B1 10% -1.1 1.75 =C2=B1 3% perf-profile.ca= lltrace.cycles-pp.vfs_statx.__do_sys_newfstatat.do_syscall_64.entry_SYSCAL= L_64_after_hwframe > 2.46 =C2=B1 7% -1.1 1.33 =C2=B1 2% perf-profile.ca= lltrace.cycles-pp.__btrfs_release_delayed_node.btrfs_delayed_update_inode.= btrfs_update_inode.btrfs_dirty_inode.btrfs_setattr > 1.79 =C2=B1 11% -0.7 1.11 =C2=B1 6% perf-profile.ca= lltrace.cycles-pp.link_path_walk.path_lookupat.filename_lookup.do_faccessa= t.do_syscall_64 > 1.57 =C2=B1 11% -0.7 0.91 =C2=B1 3% perf-profile.ca= lltrace.cycles-pp.kmem_cache_alloc.prepare_creds.do_faccessat.do_syscall_6= 4.entry_SYSCALL_64_after_hwframe > 1.64 =C2=B1 9% -0.6 1.00 =C2=B1 4% perf-profile.ca= lltrace.cycles-pp.user_path_at_empty.do_faccessat.do_syscall_64.entry_SYSC= ALL_64_after_hwframe > 1.60 =C2=B1 9% -0.6 0.98 =C2=B1 4% perf-profile.ca= lltrace.cycles-pp.getname_flags.user_path_at_empty.do_faccessat.do_syscall= _64.entry_SYSCALL_64_after_hwframe > 1.54 =C2=B1 8% -0.6 0.94 =C2=B1 3% perf-profile.ca= lltrace.cycles-pp.__kmalloc.security_prepare_creds.prepare_creds.do_facces= sat.do_syscall_64 > 1.21 =C2=B1 10% -0.4 0.77 =C2=B1 5% perf-profile.ca= lltrace.cycles-pp.strncpy_from_user.getname_flags.user_path_at_empty.do_fa= ccessat.do_syscall_64 > 1.00 =C2=B1 10% -0.4 0.63 =C2=B1 3% perf-profile.ca= lltrace.cycles-pp.filename_lookup.vfs_statx.__do_sys_newfstatat.do_syscall= _64.entry_SYSCALL_64_after_hwframe > 0.95 =C2=B1 14% -0.4 0.58 =C2=B1 4% perf-profile.ca= lltrace.cycles-pp.kmem_cache_free.do_faccessat.do_syscall_64.entry_SYSCALL= _64_after_hwframe > 0.95 =C2=B1 7% -0.3 0.61 =C2=B1 4% perf-profile.ca= lltrace.cycles-pp.kfree.security_cred_free.put_cred_rcu.do_faccessat.do_sy= scall_64 > 0.91 =C2=B1 10% -0.3 0.57 =C2=B1 3% perf-profile.ca= lltrace.cycles-pp.path_lookupat.filename_lookup.vfs_statx.__do_sys_newfsta= tat.do_syscall_64 > 0.00 +1.0 0.98 =C2=B1 4% perf-profile.calltra= ce.cycles-pp._find_next_bit.cpumask_next.__percpu_counter_sum.__reserve_by= tes.btrfs_reserve_metadata_bytes > 0.00 +1.6 1.56 =C2=B1 4% perf-profile.calltra= ce.cycles-pp.cpumask_next.__percpu_counter_sum.__reserve_bytes.btrfs_reser= ve_metadata_bytes.btrfs_block_rsv_add > 0.00 +4.2 4.23 =C2=B1 4% perf-profile.calltra= ce.cycles-pp.__percpu_counter_sum.__reserve_bytes.btrfs_reserve_metadata_b= ytes.btrfs_block_rsv_add.start_transaction > 0.00 +12.6 12.55 =C2=B1 4% perf-profile.calltra= ce.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.__reserve_byt= es.btrfs_reserve_metadata_bytes.btrfs_block_rsv_add > 0.00 +13.0 13.01 =C2=B1 4% perf-profile.calltra= ce.cycles-pp._raw_spin_lock.__reserve_bytes.btrfs_reserve_metadata_bytes.b= trfs_block_rsv_add.start_transaction > 0.00 +15.3 15.29 =C2=B1 3% perf-profile.calltra= ce.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.btrfs_block_r= sv_release.btrfs_trans_release_metadata.__btrfs_end_transaction > 0.00 +15.8 15.81 =C2=B1 3% perf-profile.calltra= ce.cycles-pp._raw_spin_lock.btrfs_block_rsv_release.btrfs_trans_release_me= tadata.__btrfs_end_transaction.btrfs_dirty_inode > 0.00 +16.0 16.04 =C2=B1 3% perf-profile.calltra= ce.cycles-pp.btrfs_block_rsv_release.btrfs_trans_release_metadata.__btrfs_= end_transaction.btrfs_dirty_inode.btrfs_setattr > 0.00 +16.0 16.05 =C2=B1 3% perf-profile.calltra= ce.cycles-pp.btrfs_trans_release_metadata.__btrfs_end_transaction.btrfs_di= rty_inode.btrfs_setattr.notify_change > 0.63 =C2=B1 10% +16.7 17.34 =C2=B1 3% perf-profile.ca= lltrace.cycles-pp.__btrfs_end_transaction.btrfs_dirty_inode.btrfs_setattr.= notify_change.chmod_common > 0.00 +18.3 18.27 =C2=B1 4% perf-profile.calltra= ce.cycles-pp.__reserve_bytes.btrfs_reserve_metadata_bytes.btrfs_block_rsv_= add.start_transaction.btrfs_dirty_inode > 0.00 +18.4 18.39 =C2=B1 4% perf-profile.calltra= ce.cycles-pp.btrfs_reserve_metadata_bytes.btrfs_block_rsv_add.start_transa= ction.btrfs_dirty_inode.btrfs_setattr > 2.18 =C2=B1 12% +18.4 20.61 =C2=B1 4% perf-profile.ca= lltrace.cycles-pp.start_transaction.btrfs_dirty_inode.btrfs_setattr.notify= _change.chmod_common > 0.00 +18.9 18.88 =C2=B1 4% perf-profile.calltra= ce.cycles-pp.btrfs_block_rsv_add.start_transaction.btrfs_dirty_inode.btrfs= _setattr.notify_change > 9.24 =C2=B1 10% +32.2 41.40 =C2=B1 3% perf-profile.ca= lltrace.cycles-pp.__x64_sys_fchmod.do_syscall_64.entry_SYSCALL_64_after_hw= frame > 9.16 =C2=B1 10% +32.2 41.36 =C2=B1 3% perf-profile.ca= lltrace.cycles-pp.chmod_common.__x64_sys_fchmod.do_syscall_64.entry_SYSCAL= L_64_after_hwframe > 8.30 =C2=B1 9% +32.6 40.94 =C2=B1 3% perf-profile.ca= lltrace.cycles-pp.notify_change.chmod_common.__x64_sys_fchmod.do_syscall_6= 4.entry_SYSCALL_64_after_hwframe > 8.09 =C2=B1 10% +32.7 40.80 =C2=B1 3% perf-profile.ca= lltrace.cycles-pp.btrfs_setattr.notify_change.chmod_common.__x64_sys_fchmo= d.do_syscall_64 > 7.74 =C2=B1 9% +32.8 40.56 =C2=B1 4% perf-profile.ca= lltrace.cycles-pp.btrfs_dirty_inode.btrfs_setattr.notify_change.chmod_comm= on.__x64_sys_fchmod > 47.72 =C2=B1 11% -27.3 20.41 =C2=B1 3% perf-profile.ch= ildren.cycles-pp.do_faccessat > 20.57 =C2=B1 11% -12.1 8.51 =C2=B1 3% perf-profile.ch= ildren.cycles-pp.prepare_creds > 18.81 =C2=B1 11% -11.9 6.93 =C2=B1 3% perf-profile.ch= ildren.cycles-pp.put_cred_rcu > 5.42 =C2=B1 12% -3.8 1.60 =C2=B1 3% perf-profile.ch= ildren.cycles-pp.free_uid > 5.39 =C2=B1 12% -3.8 1.58 =C2=B1 3% perf-profile.ch= ildren.cycles-pp.refcount_dec_and_lock_irqsave > 5.36 =C2=B1 12% -3.8 1.56 =C2=B1 3% perf-profile.ch= ildren.cycles-pp.refcount_dec_not_one > 5.34 =C2=B1 11% -3.1 2.21 =C2=B1 3% perf-profile.ch= ildren.cycles-pp.key_put > 5.18 =C2=B1 11% -2.4 2.75 =C2=B1 4% perf-profile.ch= ildren.cycles-pp.security_prepare_creds > 4.77 =C2=B1 8% -2.3 2.50 =C2=B1 4% perf-profile.ch= ildren.cycles-pp.btrfs_update_inode > 3.80 =C2=B1 7% -2.0 1.84 =C2=B1 4% perf-profile.ch= ildren.cycles-pp.btrfs_delayed_update_inode > 3.54 =C2=B1 12% -1.8 1.74 =C2=B1 4% perf-profile.ch= ildren.cycles-pp.apparmor_cred_prepare > 3.49 =C2=B1 9% -1.8 1.72 =C2=B1 6% perf-profile.ch= ildren.cycles-pp.security_cred_free > 4.39 =C2=B1 11% -1.7 2.68 =C2=B1 5% perf-profile.ch= ildren.cycles-pp.filename_lookup > 3.93 =C2=B1 11% -1.5 2.40 =C2=B1 5% perf-profile.ch= ildren.cycles-pp.path_lookupat > 2.50 =C2=B1 9% -1.4 1.09 =C2=B1 9% perf-profile.ch= ildren.cycles-pp.apparmor_cred_free > 3.26 =C2=B1 11% -1.3 1.96 =C2=B1 3% perf-profile.ch= ildren.cycles-pp.__do_sys_newfstatat > 2.90 =C2=B1 10% -1.1 1.75 =C2=B1 3% perf-profile.ch= ildren.cycles-pp.vfs_statx > 2.47 =C2=B1 7% -1.1 1.34 =C2=B1 3% perf-profile.ch= ildren.cycles-pp.__btrfs_release_delayed_node > 1.55 =C2=B1 11% -1.1 0.49 =C2=B1 7% perf-profile.ch= ildren.cycles-pp.join_transaction > 2.37 =C2=B1 11% -0.9 1.49 =C2=B1 6% perf-profile.ch= ildren.cycles-pp.link_path_walk > 2.11 =C2=B1 10% -0.9 1.23 =C2=B1 4% perf-profile.ch= ildren.cycles-pp.kmem_cache_alloc > 2.13 =C2=B1 9% -0.8 1.30 =C2=B1 4% perf-profile.ch= ildren.cycles-pp.user_path_at_empty > 2.08 =C2=B1 9% -0.8 1.29 =C2=B1 4% perf-profile.ch= ildren.cycles-pp.getname_flags > 1.17 =C2=B1 12% -0.7 0.50 =C2=B1 6% perf-profile.ch= ildren.cycles-pp.common_perm_cond > 1.58 =C2=B1 14% -0.7 0.92 =C2=B1 7% perf-profile.ch= ildren.cycles-pp.inode_permission > 1.10 =C2=B1 12% -0.6 0.46 =C2=B1 6% perf-profile.ch= ildren.cycles-pp.common_perm > 1.58 =C2=B1 9% -0.6 0.97 =C2=B1 3% perf-profile.ch= ildren.cycles-pp.__kmalloc > 1.56 =C2=B1 11% -0.6 0.99 =C2=B1 4% perf-profile.ch= ildren.cycles-pp.strncpy_from_user > 1.29 =C2=B1 14% -0.5 0.79 =C2=B1 5% perf-profile.ch= ildren.cycles-pp.kmem_cache_free > 1.10 =C2=B1 13% -0.5 0.62 =C2=B1 13% perf-profile.ch= ildren.cycles-pp.mutex_lock > 0.59 =C2=B1 10% -0.4 0.14 =C2=B1 16% perf-profile.ch= ildren.cycles-pp.btrfs_get_or_create_delayed_node > 0.57 =C2=B1 10% -0.4 0.14 =C2=B1 18% perf-profile.ch= ildren.cycles-pp.btrfs_get_delayed_node > 0.83 =C2=B1 13% -0.4 0.46 =C2=B1 4% perf-profile.ch= ildren.cycles-pp.generic_permission > 0.91 =C2=B1 10% -0.4 0.56 =C2=B1 6% perf-profile.ch= ildren.cycles-pp.walk_component > 0.96 =C2=B1 7% -0.4 0.61 =C2=B1 4% perf-profile.ch= ildren.cycles-pp.kfree > 0.60 =C2=B1 14% -0.3 0.26 =C2=B1 3% perf-profile.ch= ildren.cycles-pp.security_path_chmod > 0.65 =C2=B1 10% -0.3 0.31 =C2=B1 7% perf-profile.ch= ildren.cycles-pp.vfs_getattr > 0.64 =C2=B1 10% -0.3 0.30 =C2=B1 7% perf-profile.ch= ildren.cycles-pp.security_inode_getattr > 0.77 =C2=B1 12% -0.3 0.46 =C2=B1 6% perf-profile.ch= ildren.cycles-pp.btrfs_update_root_times > 0.69 =C2=B1 5% -0.3 0.39 =C2=B1 5% perf-profile.ch= ildren.cycles-pp.mutex_unlock > 0.65 =C2=B1 12% -0.3 0.39 =C2=B1 9% perf-profile.ch= ildren.cycles-pp.syscall_return_via_sysret > 0.70 =C2=B1 9% -0.3 0.44 =C2=B1 4% perf-profile.ch= ildren.cycles-pp.__check_object_size > 0.62 =C2=B1 12% -0.3 0.37 =C2=B1 3% perf-profile.ch= ildren.cycles-pp.complete_walk > 0.51 =C2=B1 12% -0.3 0.26 =C2=B1 5% perf-profile.ch= ildren.cycles-pp.get_obj_cgroup_from_current > 0.46 =C2=B1 31% -0.2 0.22 =C2=B1 16% perf-profile.ch= ildren.cycles-pp.revert_creds > 0.59 =C2=B1 12% -0.2 0.36 =C2=B1 3% perf-profile.ch= ildren.cycles-pp.unlazy_walk > 0.48 =C2=B1 11% -0.2 0.28 =C2=B1 5% perf-profile.ch= ildren.cycles-pp.obj_cgroup_charge > 0.58 =C2=B1 10% -0.2 0.38 =C2=B1 3% perf-profile.ch= ildren.cycles-pp.btrfs_getattr > 0.52 =C2=B1 10% -0.2 0.33 =C2=B1 9% perf-profile.ch= ildren.cycles-pp.lookup_fast > 0.47 =C2=B1 20% -0.2 0.29 =C2=B1 15% perf-profile.ch= ildren.cycles-pp.btrfs_permission > 0.33 =C2=B1 12% -0.2 0.15 =C2=B1 8% perf-profile.ch= ildren.cycles-pp.capable_wrt_inode_uidgid > 0.46 =C2=B1 12% -0.2 0.29 perf-profile.childre= n.cycles-pp.__legitimize_path > 0.32 =C2=B1 12% -0.2 0.14 =C2=B1 10% perf-profile.ch= ildren.cycles-pp.security_capable > 0.31 =C2=B1 12% -0.2 0.13 =C2=B1 11% perf-profile.ch= ildren.cycles-pp.apparmor_capable > 0.32 =C2=B1 12% -0.2 0.15 =C2=B1 8% perf-profile.ch= ildren.cycles-pp.ns_capable_common > 0.45 =C2=B1 9% -0.2 0.28 =C2=B1 10% perf-profile.ch= ildren.cycles-pp.refill_obj_stock > 0.28 =C2=B1 63% -0.2 0.12 =C2=B1 27% perf-profile.ch= ildren.cycles-pp.map_id_up > 0.35 =C2=B1 28% -0.1 0.20 =C2=B1 10% perf-profile.ch= ildren.cycles-pp.cp_new_stat > 0.42 =C2=B1 10% -0.1 0.28 =C2=B1 6% perf-profile.ch= ildren.cycles-pp.__mod_memcg_lruvec_state > 0.36 =C2=B1 10% -0.1 0.23 =C2=B1 8% perf-profile.ch= ildren.cycles-pp.path_put > 0.35 =C2=B1 10% -0.1 0.22 =C2=B1 11% perf-profile.ch= ildren.cycles-pp.dput > 0.35 =C2=B1 9% -0.1 0.22 =C2=B1 9% perf-profile.ch= ildren.cycles-pp.__d_lookup_rcu > 0.32 =C2=B1 10% -0.1 0.19 =C2=B1 12% perf-profile.ch= ildren.cycles-pp.path_init > 0.36 =C2=B1 14% -0.1 0.24 =C2=B1 5% perf-profile.ch= ildren.cycles-pp.__entry_text_start > 0.35 =C2=B1 11% -0.1 0.23 =C2=B1 9% perf-profile.ch= ildren.cycles-pp.___might_sleep > 0.32 =C2=B1 9% -0.1 0.20 =C2=B1 4% perf-profile.ch= ildren.cycles-pp.__check_heap_object > 0.27 =C2=B1 10% -0.1 0.16 =C2=B1 7% perf-profile.ch= ildren.cycles-pp.__list_add_valid > 0.26 =C2=B1 7% -0.1 0.16 =C2=B1 11% perf-profile.ch= ildren.cycles-pp.__might_sleep > 0.23 =C2=B1 15% -0.1 0.13 =C2=B1 5% perf-profile.ch= ildren.cycles-pp._cond_resched > 0.19 =C2=B1 39% -0.1 0.09 =C2=B1 7% perf-profile.ch= ildren.cycles-pp.fill_stack_inode_item > 0.23 =C2=B1 14% -0.1 0.14 =C2=B1 12% perf-profile.ch= ildren.cycles-pp.syscall_enter_from_user_mode > 0.23 =C2=B1 14% -0.1 0.15 =C2=B1 7% perf-profile.ch= ildren.cycles-pp.__legitimize_mnt > 0.18 =C2=B1 14% -0.1 0.10 =C2=B1 11% perf-profile.ch= ildren.cycles-pp.override_creds > 0.17 =C2=B1 15% -0.1 0.10 =C2=B1 11% perf-profile.ch= ildren.cycles-pp.__list_del_entry_valid > 0.18 =C2=B1 13% -0.1 0.10 =C2=B1 12% perf-profile.ch= ildren.cycles-pp.step_into > 0.19 =C2=B1 14% -0.1 0.12 =C2=B1 12% perf-profile.ch= ildren.cycles-pp.lockref_get_not_dead > 0.20 =C2=B1 10% -0.1 0.13 =C2=B1 12% perf-profile.ch= ildren.cycles-pp.__mod_memcg_state > 0.19 =C2=B1 16% -0.1 0.12 =C2=B1 11% perf-profile.ch= ildren.cycles-pp.rcu_read_unlock_strict > 0.15 =C2=B1 14% -0.1 0.09 =C2=B1 13% perf-profile.ch= ildren.cycles-pp.lockref_put_or_lock > 0.17 =C2=B1 11% -0.1 0.12 =C2=B1 3% perf-profile.ch= ildren.cycles-pp.memset_erms > 0.17 =C2=B1 17% -0.1 0.12 =C2=B1 7% perf-profile.ch= ildren.cycles-pp.syscall_exit_to_user_mode > 0.16 =C2=B1 7% -0.1 0.11 =C2=B1 4% perf-profile.ch= ildren.cycles-pp._copy_to_user > 0.10 =C2=B1 21% -0.1 0.04 =C2=B1 58% perf-profile.ch= ildren.cycles-pp.mnt_want_write > 0.11 =C2=B1 9% -0.0 0.07 =C2=B1 13% perf-profile.ch= ildren.cycles-pp.inode_get_bytes > 0.11 =C2=B1 18% -0.0 0.07 =C2=B1 13% perf-profile.ch= ildren.cycles-pp.rcu_all_qs > 0.11 =C2=B1 16% -0.0 0.06 =C2=B1 11% perf-profile.ch= ildren.cycles-pp.security_inode_permission > 0.10 -0.0 0.05 =C2=B1 8% perf-profile.childre= n.cycles-pp.__fget_light > 0.11 =C2=B1 13% -0.0 0.07 =C2=B1 7% perf-profile.ch= ildren.cycles-pp.entry_SYSCALL_64_safe_stack > 0.12 =C2=B1 12% -0.0 0.08 =C2=B1 8% perf-profile.ch= ildren.cycles-pp.copy_user_enhanced_fast_string > 0.10 =C2=B1 19% -0.0 0.07 =C2=B1 7% perf-profile.ch= ildren.cycles-pp.__put_cred > 0.11 =C2=B1 14% -0.0 0.07 =C2=B1 14% perf-profile.ch= ildren.cycles-pp.btrfs_balance_delayed_items > 0.09 =C2=B1 14% -0.0 0.06 =C2=B1 14% perf-profile.ch= ildren.cycles-pp.exit_to_user_mode_prepare > 0.10 =C2=B1 14% -0.0 0.08 =C2=B1 6% perf-profile.ch= ildren.cycles-pp.__x86_indirect_thunk_rax > 0.08 =C2=B1 10% -0.0 0.06 =C2=B1 15% perf-profile.ch= ildren.cycles-pp.mntput_no_expire > 0.21 =C2=B1 6% +0.1 0.28 =C2=B1 12% perf-profile.ch= ildren.cycles-pp.btrfs_put_transaction > 0.05 =C2=B1 61% +0.1 0.15 =C2=B1 9% perf-profile.ch= ildren.cycles-pp._raw_spin_unlock_irqrestore > 0.00 +0.2 0.21 =C2=B1 10% perf-profile.childre= n.cycles-pp.find_next_bit > 0.06 =C2=B1 17% +0.3 0.38 =C2=B1 4% perf-profile.ch= ildren.cycles-pp._raw_spin_lock_irqsave > 0.00 +0.4 0.43 =C2=B1 14% perf-profile.childre= n.cycles-pp.btrfs_get_alloc_profile > 0.00 +0.5 0.46 =C2=B1 14% perf-profile.childre= n.cycles-pp.calc_available_free_space > 0.00 +0.5 0.48 =C2=B1 2% perf-profile.childre= n.cycles-pp.btrfs_block_rsv_add_bytes > 0.00 +0.5 0.48 =C2=B1 8% perf-profile.childre= n.cycles-pp.wait_current_trans > 0.00 +1.0 1.00 =C2=B1 4% perf-profile.childre= n.cycles-pp._find_next_bit > 0.00 +1.8 1.77 =C2=B1 4% perf-profile.childre= n.cycles-pp.cpumask_next > 0.00 +4.2 4.24 =C2=B1 4% perf-profile.childre= n.cycles-pp.__percpu_counter_sum > 0.00 +16.0 16.04 =C2=B1 3% perf-profile.childre= n.cycles-pp.btrfs_block_rsv_release > 0.00 +16.0 16.05 =C2=B1 3% perf-profile.childre= n.cycles-pp.btrfs_trans_release_metadata > 0.64 =C2=B1 9% +16.7 17.35 =C2=B1 3% perf-profile.ch= ildren.cycles-pp.__btrfs_end_transaction > 0.00 +18.3 18.27 =C2=B1 4% perf-profile.childre= n.cycles-pp.__reserve_bytes > 0.00 +18.4 18.39 =C2=B1 4% perf-profile.childre= n.cycles-pp.btrfs_reserve_metadata_bytes > 2.19 =C2=B1 12% +18.4 20.61 =C2=B1 4% perf-profile.ch= ildren.cycles-pp.start_transaction > 0.00 +18.9 18.88 =C2=B1 4% perf-profile.childre= n.cycles-pp.btrfs_block_rsv_add > 0.75 =C2=B1 8% +27.1 27.88 =C2=B1 3% perf-profile.ch= ildren.cycles-pp.native_queued_spin_lock_slowpath > 2.32 =C2=B1 10% +28.3 30.66 =C2=B1 3% perf-profile.ch= ildren.cycles-pp._raw_spin_lock > 9.25 =C2=B1 10% +32.2 41.41 =C2=B1 3% perf-profile.ch= ildren.cycles-pp.__x64_sys_fchmod > 9.16 =C2=B1 10% +32.2 41.36 =C2=B1 3% perf-profile.ch= ildren.cycles-pp.chmod_common > 8.31 =C2=B1 9% +32.6 40.95 =C2=B1 3% perf-profile.ch= ildren.cycles-pp.notify_change > 8.10 =C2=B1 10% +32.7 40.80 =C2=B1 3% perf-profile.ch= ildren.cycles-pp.btrfs_setattr > 7.75 =C2=B1 9% +32.8 40.56 =C2=B1 4% perf-profile.ch= ildren.cycles-pp.btrfs_dirty_inode > 13.73 =C2=B1 11% -8.9 4.81 =C2=B1 4% perf-profile.se= lf.cycles-pp.prepare_creds > 5.33 =C2=B1 12% -3.8 1.55 =C2=B1 3% perf-profile.se= lf.cycles-pp.refcount_dec_not_one > 4.57 =C2=B1 11% -3.1 1.42 =C2=B1 4% perf-profile.se= lf.cycles-pp.put_cred_rcu > 5.30 =C2=B1 11% -3.1 2.19 =C2=B1 3% perf-profile.se= lf.cycles-pp.key_put > 3.53 =C2=B1 12% -1.8 1.73 =C2=B1 4% perf-profile.se= lf.cycles-pp.apparmor_cred_prepare > 2.48 =C2=B1 9% -1.4 1.08 =C2=B1 9% perf-profile.se= lf.cycles-pp.apparmor_cred_free > 1.10 =C2=B1 12% -0.6 0.45 =C2=B1 5% perf-profile.se= lf.cycles-pp.common_perm > 1.04 =C2=B1 14% -0.5 0.58 =C2=B1 13% perf-profile.se= lf.cycles-pp.mutex_lock > 0.57 =C2=B1 11% -0.4 0.13 =C2=B1 20% perf-profile.se= lf.cycles-pp.btrfs_get_delayed_node > 1.06 =C2=B1 9% -0.4 0.63 =C2=B1 5% perf-profile.se= lf.cycles-pp.kmem_cache_alloc > 1.02 =C2=B1 10% -0.4 0.64 =C2=B1 4% perf-profile.se= lf.cycles-pp.link_path_walk > 0.93 =C2=B1 14% -0.4 0.55 =C2=B1 5% perf-profile.se= lf.cycles-pp.kmem_cache_free > 0.79 =C2=B1 8% -0.3 0.48 =C2=B1 4% perf-profile.se= lf.cycles-pp.__kmalloc > 0.69 =C2=B1 5% -0.3 0.39 =C2=B1 6% perf-profile.se= lf.cycles-pp.mutex_unlock > 0.72 =C2=B1 11% -0.3 0.46 =C2=B1 5% perf-profile.se= lf.cycles-pp.strncpy_from_user > 0.65 =C2=B1 12% -0.3 0.39 =C2=B1 9% perf-profile.se= lf.cycles-pp.syscall_return_via_sysret > 0.46 =C2=B1 31% -0.2 0.22 =C2=B1 16% perf-profile.se= lf.cycles-pp.revert_creds > 0.64 =C2=B1 9% -0.2 0.40 =C2=B1 3% perf-profile.se= lf.cycles-pp.kfree > 0.60 =C2=B1 9% -0.2 0.38 =C2=B1 7% perf-profile.se= lf.cycles-pp.join_transaction > 0.41 =C2=B1 11% -0.2 0.22 =C2=B1 5% perf-profile.se= lf.cycles-pp.get_obj_cgroup_from_current > 0.45 =C2=B1 10% -0.2 0.27 =C2=B1 5% perf-profile.se= lf.cycles-pp.obj_cgroup_charge > 0.30 =C2=B1 13% -0.2 0.13 =C2=B1 11% perf-profile.se= lf.cycles-pp.apparmor_capable > 0.44 =C2=B1 20% -0.2 0.28 =C2=B1 16% perf-profile.se= lf.cycles-pp.btrfs_permission > 0.42 =C2=B1 11% -0.2 0.27 =C2=B1 8% perf-profile.se= lf.cycles-pp.generic_permission > 0.42 =C2=B1 8% -0.2 0.27 =C2=B1 10% perf-profile.se= lf.cycles-pp.refill_obj_stock > 0.47 =C2=B1 10% -0.2 0.32 =C2=B1 2% perf-profile.se= lf.cycles-pp.btrfs_getattr > 0.27 =C2=B1 65% -0.2 0.12 =C2=B1 25% perf-profile.se= lf.cycles-pp.map_id_up > 0.36 =C2=B1 14% -0.1 0.23 =C2=B1 4% perf-profile.se= lf.cycles-pp.__entry_text_start > 0.34 =C2=B1 10% -0.1 0.22 =C2=B1 9% perf-profile.se= lf.cycles-pp.__d_lookup_rcu > 0.38 =C2=B1 11% -0.1 0.25 =C2=B1 5% perf-profile.se= lf.cycles-pp.do_faccessat > 0.32 =C2=B1 19% -0.1 0.20 =C2=B1 13% perf-profile.se= lf.cycles-pp.inode_permission > 0.34 =C2=B1 13% -0.1 0.22 =C2=B1 9% perf-profile.se= lf.cycles-pp.___might_sleep > 0.31 =C2=B1 9% -0.1 0.20 =C2=B1 4% perf-profile.se= lf.cycles-pp.__check_heap_object > 0.27 =C2=B1 10% -0.1 0.16 =C2=B1 7% perf-profile.se= lf.cycles-pp.__list_add_valid > 0.28 =C2=B1 11% -0.1 0.17 =C2=B1 11% perf-profile.se= lf.cycles-pp.path_init > 0.25 =C2=B1 8% -0.1 0.15 =C2=B1 10% perf-profile.se= lf.cycles-pp.__might_sleep > 0.26 =C2=B1 8% -0.1 0.16 =C2=B1 7% perf-profile.se= lf.cycles-pp.__check_object_size > 0.23 =C2=B1 16% -0.1 0.13 =C2=B1 13% perf-profile.se= lf.cycles-pp.syscall_enter_from_user_mode > 0.17 =C2=B1 16% -0.1 0.09 =C2=B1 7% perf-profile.se= lf.cycles-pp.override_creds > 0.22 =C2=B1 15% -0.1 0.14 =C2=B1 8% perf-profile.se= lf.cycles-pp.__legitimize_mnt > 0.20 =C2=B1 13% -0.1 0.12 =C2=B1 12% perf-profile.se= lf.cycles-pp.entry_SYSCALL_64_after_hwframe > 0.14 =C2=B1 18% -0.1 0.06 perf-profile.self.cy= cles-pp.btrfs_update_inode > 0.21 =C2=B1 13% -0.1 0.13 =C2=B1 5% perf-profile.se= lf.cycles-pp.walk_component > 0.17 =C2=B1 11% -0.1 0.10 =C2=B1 11% perf-profile.se= lf.cycles-pp.step_into > 0.17 =C2=B1 17% -0.1 0.10 =C2=B1 11% perf-profile.se= lf.cycles-pp.__list_del_entry_valid > 0.19 =C2=B1 14% -0.1 0.12 =C2=B1 12% perf-profile.se= lf.cycles-pp.lockref_get_not_dead > 0.20 =C2=B1 10% -0.1 0.13 =C2=B1 12% perf-profile.se= lf.cycles-pp.__mod_memcg_state > 0.16 =C2=B1 10% -0.1 0.10 =C2=B1 11% perf-profile.se= lf.cycles-pp.lookup_fast > 0.15 =C2=B1 14% -0.1 0.08 =C2=B1 13% perf-profile.se= lf.cycles-pp.lockref_put_or_lock > 0.20 =C2=B1 10% -0.1 0.14 =C2=B1 5% perf-profile.se= lf.cycles-pp.__mod_memcg_lruvec_state > 0.15 =C2=B1 14% -0.1 0.08 =C2=B1 10% perf-profile.se= lf.cycles-pp.filename_lookup > 0.17 =C2=B1 9% -0.1 0.11 =C2=B1 3% perf-profile.se= lf.cycles-pp.memset_erms > 0.14 =C2=B1 12% -0.1 0.08 =C2=B1 5% perf-profile.se= lf.cycles-pp.getname_flags > 0.07 =C2=B1 11% -0.0 0.03 =C2=B1100% perf-profile.se= lf.cycles-pp.dput > 0.11 =C2=B1 16% -0.0 0.06 =C2=B1 11% perf-profile.se= lf.cycles-pp.security_inode_permission > 0.15 =C2=B1 15% -0.0 0.10 =C2=B1 14% perf-profile.se= lf.cycles-pp.rcu_read_unlock_strict > 0.12 =C2=B1 12% -0.0 0.08 =C2=B1 10% perf-profile.se= lf.cycles-pp.copy_user_enhanced_fast_string > 0.11 =C2=B1 11% -0.0 0.06 =C2=B1 13% perf-profile.se= lf.cycles-pp._cond_resched > 0.11 =C2=B1 13% -0.0 0.07 =C2=B1 7% perf-profile.se= lf.cycles-pp.entry_SYSCALL_64_safe_stack > 0.10 =C2=B1 5% -0.0 0.05 =C2=B1 8% perf-profile.se= lf.cycles-pp.__fget_light > 0.10 =C2=B1 19% -0.0 0.07 =C2=B1 13% perf-profile.se= lf.cycles-pp.path_lookupat > 0.11 =C2=B1 14% -0.0 0.07 =C2=B1 20% perf-profile.se= lf.cycles-pp.btrfs_balance_delayed_items > 0.10 =C2=B1 14% -0.0 0.07 =C2=B1 10% perf-profile.se= lf.cycles-pp.__virt_addr_valid > 0.10 =C2=B1 21% -0.0 0.06 =C2=B1 6% perf-profile.se= lf.cycles-pp.__put_cred > 0.07 =C2=B1 11% -0.0 0.04 =C2=B1 60% perf-profile.se= lf.cycles-pp.exit_to_user_mode_prepare > 0.09 =C2=B1 20% -0.0 0.06 =C2=B1 17% perf-profile.se= lf.cycles-pp.notify_change > 0.07 =C2=B1 12% -0.0 0.05 =C2=B1 8% perf-profile.se= lf.cycles-pp.mntput_no_expire > 0.21 =C2=B1 6% +0.1 0.28 =C2=B1 12% perf-profile.se= lf.cycles-pp.btrfs_put_transaction > 0.05 =C2=B1 62% +0.1 0.13 =C2=B1 11% perf-profile.se= lf.cycles-pp._raw_spin_unlock_irqrestore > 0.00 +0.1 0.12 =C2=B1 5% perf-profile.self.cy= cles-pp.btrfs_reserve_metadata_bytes > 0.00 +0.1 0.14 =C2=B1 13% perf-profile.self.cy= cles-pp.btrfs_block_rsv_release > 0.00 +0.2 0.16 =C2=B1 18% perf-profile.self.cy= cles-pp.btrfs_get_alloc_profile > 0.00 +0.2 0.18 =C2=B1 7% perf-profile.self.cy= cles-pp.wait_current_trans > 0.46 =C2=B1 15% +0.2 0.64 =C2=B1 6% perf-profile.se= lf.cycles-pp.start_transaction > 0.00 +0.2 0.21 =C2=B1 10% perf-profile.self.cy= cles-pp.find_next_bit > 0.06 =C2=B1 20% +0.3 0.38 =C2=B1 4% perf-profile.se= lf.cycles-pp._raw_spin_lock_irqsave > 0.00 +0.6 0.57 =C2=B1 14% perf-profile.self.cy= cles-pp.__reserve_bytes > 0.00 +0.6 0.57 =C2=B1 7% perf-profile.self.cy= cles-pp.cpumask_next > 0.36 =C2=B1 12% +0.6 0.98 =C2=B1 11% perf-profile.se= lf.cycles-pp.__btrfs_end_transaction > 0.00 +1.0 0.99 =C2=B1 4% perf-profile.self.cy= cles-pp._find_next_bit > 1.57 =C2=B1 11% +1.2 2.77 =C2=B1 6% perf-profile.se= lf.cycles-pp._raw_spin_lock > 0.00 +2.1 2.08 =C2=B1 4% perf-profile.self.cy= cles-pp.__percpu_counter_sum > 0.73 =C2=B1 8% +27.1 27.79 =C2=B1 3% perf-profile.se= lf.cycles-pp.native_queued_spin_lock_slowpath > > > > stress-ng.access.ops > > 1.2e+06 +------------------------------------------------------------= -----+ > | +..+..+..+.. .+..+..+. .+.. .+..+..+..+..+..+= ..+ | > 1e+06 |-+ : +. +. +. = | > | : = | > | : = | > 800000 |-+ : = | > | : O O O O O O O O O O O= O | > 600000 |-+O :O O O O O O O O = | > | : = | > 400000 |-+ : = | > | : = | > | : = | > 200000 |-+: = | > | : = | > 0 +------------------------------------------------------------= -----+ > > > stress-ng.access.ops_per_sec > > 40000 +--------------------------------------------------------------= -----+ > | +..+..+..+... .+..+..+. .+.. .+..+...+..+..+..+= ..+ | > 35000 |-+ : +. +. +. = | > 30000 |-+ : = | > | : = | > 25000 |-+ : = | > | : O O O O O O O O O O O= O | > 20000 |-+O :O O O O O O O O = | > | : = | > 15000 |-+ : = | > 10000 |-+ : = | > | : = | > 5000 |-+: = | > | : = | > 0 +--------------------------------------------------------------= -----+ > > > stress-ng.chmod.ops > > 140000 +-------------------------------------------------------------= -----+ > | +.. = | > 120000 |-+ : +..+.. .+.. = | > | : +.. .. +. +.. +.. +.. +.. = | > 100000 |-+ : + ..+.. .. .. .. +.. = | > | : +. + + + +..+= ..+ | > 80000 |-+ : = | > | : = | > 60000 |-+ : O O O = | > | O: O O O O O O O O O O O O O O O O= O | > 40000 |-+ : = | > | : = | > 20000 |-+: = | > | : = | > 0 +-------------------------------------------------------------= -----+ > > > stress-ng.chmod.ops_per_sec > > 4500 +---------------------------------------------------------------= -----+ > | +.. +.. .+.. = | > 4000 |-+ : + +..+. +.. +.. = | > 3500 |-+ : +... + .+.. .+.. + = | > | : + +...+..+. +. + +... .+= ..+ | > 3000 |-+ : + +. = | > 2500 |-+ : = | > | : = | > 2000 |-+ : O O O O O O O = | > 1500 |-+O: O O O O O O O O O O O O= O | > | : = | > 1000 |-+ : = | > 500 |-+: = | > | : = | > 0 +---------------------------------------------------------------= -----+ > > > stress-ng.chown.ops > > 1.2e+06 +------------------------------------------------------------= -----+ > | +..+..+.. .+.. +.. = | > 1e+06 |-+ : +. +.. .+.. .. .+..+.. .+.. = | > | : +. + +..+..+..+. +. = .+ | > | : += . | > 800000 |-+ : = | > | : = | > 600000 |-+O :O O O O O O O O= | > | : O O O O O O O O O O O = O | > 400000 |-+ : = | > | : = | > | : = | > 200000 |-+: = | > | : = | > 0 +------------------------------------------------------------= -----+ > > > stress-ng.chown.ops_per_sec > > 40000 +--------------------------------------------------------------= -----+ > | +..+..+.. ..+.. +.. = | > 35000 |-+ : +. +.. .+.. .. .+...+.. .+.. = | > 30000 |-+ : +. + +..+..+..+. +. = .+ | > | : += . | > 25000 |-+ : = | > | : = | > 20000 |-+O :O O O O O O O O= | > | : O O O O O O O O O O O = O | > 15000 |-+ : = | > 10000 |-+ : = | > | : = | > 5000 |-+: = | > | : = | > 0 +--------------------------------------------------------------= -----+ > > > stress-ng.utime.ops > > 4.5e+06 +------------------------------------------------------------= -----+ > | .+..+.. .+.. .+.. .+.. = | > 4e+06 |-+ +..+. +. +. +. .+..+..+..+.. = .+ | > 3.5e+06 |-+ : +..+..+..+. += . | > | : = | > 3e+06 |-+ : = | > 2.5e+06 |-+ : = | > | : = | > 2e+06 |-+ : = | > 1.5e+06 |-+ : = | > | : O O O O O = | > 1e+06 |-+O: O O O O O O O O O O O O O O= O | > 500000 |-+ : = | > | : = | > 0 +------------------------------------------------------------= -----+ > > > stress-ng.utime.ops_per_sec > > 160000 +-------------------------------------------------------------= -----+ > | .+.. +.. = | > 140000 |-+ .+. +.. .. .+.. ..+.. = | > 120000 |-+ +. + +. +. .+.. .+..+..+..+..+.. = .+ | > | : +. +. += . | > 100000 |-+ : = | > | : = | > 80000 |-+ : = | > | : = | > 60000 |-+ : = | > 40000 |-+ : = | > | O: O O O O O O O O O O O O O O O O O O O= O | > 20000 |-+ : = | > | : = | > 0 +-------------------------------------------------------------= -----+ > > > [*] bisect-good sample > [O] bisect-bad sample > > > > Disclaimer: > Results have been estimated based on internal Intel analysis and are pro= vided > for informational purposes only. Any difference in system hardware or so= ftware > design or configuration may affect actual performance. > > > Thanks, > Oliver Sang >