Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.35 as permitted sender) client-ip=23.128.96.35;
From:   Huang Shijie <shijie@os.amperecomputing.com>
To:     catalin.marinas@arm.com
Cc:     will@kernel.org, mark.rutland@arm.com, suzuki.poulose@arm.com,
        broonie@kernel.org, linux-arm-kernel@lists.infradead.org,
        linux-kernel@vger.kernel.org, anshuman.khandual@arm.com,
        robh@kernel.org, oliver.upton@linux.dev, maz@kernel.org,
        patches@amperecomputing.com,
        Huang Shijie <shijie@os.amperecomputing.com>
Subject: [PATCH 0/4] arm64: an optimization for AmpereOne
Date:   Wed, 22 Nov 2023 17:28:51 +0800
Message-Id: <20231122092855.4440-1-shijie@os.amperecomputing.com>
Content-Transfer-Encoding: 8bit
Content-Type: text/plain
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?Lz1Y1jl4q8J7Qg+b9TCeJOZVWLEquVqUGu1KLfGRdr1MyCp603tTOj0VAJIT?=
 =?us-ascii?Q?s2Qa1fy0J1f3Pnj6j5QXDW8vEQX8F0I4jdkNfQFdIz5W79v7QF3D7s3qE7cA?=
 =?us-ascii?Q?BSt0vJR+xj80j2kjA8/JBEKFPhIAWE41q09sJQ2Ch0uQjIBRJgIa2kAAAghY?=
 =?us-ascii?Q?iEuQ+E1TD8xu4ZDkOhA8khFTSl9lOiaiOXna4Z9WI5n3NMATd9zOAq8PAw/k?=
 =?us-ascii?Q?UwefchrDdwrYZ11W8KfoqLfXPXK8HMXHRDXJFQfm2a1wTIJaj6KLVO2+bBao?=
 =?us-ascii?Q?GBvrF8hY71lDVIYdSj4zQ50UPv7aOT1DxH7aFZqUrv028/W+cUy9yG6RscCm?=
 =?us-ascii?Q?TC6+WyE3Zby/xtvk8JazdVWQMn7JoEArRQG4KsG0G4qUCM1czsGLm1MmWrdQ?=
 =?us-ascii?Q?sOuZR6FZVdGu/HQLlWkbvSHIA80/togxrgYbD2PtsGOBOnpKYmCbjk3YaytH?=
 =?us-ascii?Q?tyD4YVbEH2H810lH1vSe7rgwMvqizIApFJxhFW4ky/XWiyrQpar7/zRBEA6L?=
 =?us-ascii?Q?y+CXbZ5v78S4R0ZEDLwdxcglojwC/bac+Sr6kqd2cXlBYkphnvHhwt2Zaq1y?=
 =?us-ascii?Q?NH15Ip0Kp/4CachSJMKuy0D7JOsFq+zZSmzYsNC7EPwW2bmXNmdrAVIVodyK?=
 =?us-ascii?Q?YE2lvrFf18SSkqJCuZuSrteSur/EkDNM8IddFF2QQM0dIU1TOJG5aHyDVXHb?=
 =?us-ascii?Q?/u6Wjm1dx0SeI19M2E4lJJJs4v6BZd3DyAlxU4oCdm816gSO2RA/fZ1cYLJ/?=
 =?us-ascii?Q?75FKW8I2+Sx4C3EIix7fQJbWGueVmCZQ0TyGB+civlOc9Ae3R1ukJbMU6lm9?=
 =?us-ascii?Q?nlM3yCqDXdfXrSd6/1hLfoZDAVbPDKGi9MU2wjpInx8zX5yGwZ1Ynq4bQMtr?=
 =?us-ascii?Q?wmO4iD+rBpwSEyMQLP+urheP+Y+vX/bqwlNYSmNLL5WXeh5PL5OcDsDnXXxI?=
 =?us-ascii?Q?P1q25tlKPlQVMaSXhS0qMnqQq8q/V6njNqRqrsnfhU8LSpj+2YYeVFb4J+lQ?=
 =?us-ascii?Q?3o0uWMkPNpAsO11N0kVCFZPENwSTPdqFrL1cbJ5HKPWNuti3CkkbV2TDyJw9?=
 =?us-ascii?Q?MWWlAM5aAMpTgN/rAIc/qkEvKqpLjfjGWtFdSClmQbbrr0gh9epco1x4b0M2?=
 =?us-ascii?Q?dX6+xM92ducMV+hCEiejoKEXHNkDrxXkHzK1dir1i2TYwZgyT2g1eHejEZFS?=
 =?us-ascii?Q?PxtpMex9jBiuQ3w3YPjGKVh3pymsbxhx+iRanslDbCeeDNM/4pvTYTy+DyOK?=
 =?us-ascii?Q?ho+ELbBn1qPg3PXleZfDBxRi7U/5evi25nbc86TFVDaQz7n2803viOt2+1dw?=
 =?us-ascii?Q?sGyJapeXiWR2Y54cHYKkEBhDNmK1Bkvgdqx5ZV3fRK2fqIJkdSIHBmJ+nDjO?=
 =?us-ascii?Q?lhWii4AaqLVwzyj47I4XfwZWZR8tQf2exzFH87SEiUeZcJVinxwLP4ClNq3R?=
 =?us-ascii?Q?eXzhSwNDzO/uOixjoph17RBAls97CmJ1Gas/jflEOxqJItl/EZP5IjPVlrN9?=
 =?us-ascii?Q?UFC0N1Mv3fo428CAwEkcN6BNFSX67OESCCAVQBUQdfdsMuzpY6gPz0XJnl6h?=
 =?us-ascii?Q?q+ezV5vUybPqKO2Bv7weY0rZLIXJYhzvgdw5ePT1JCtzYkBx4AUoCrd2HPXh?=
 =?us-ascii?Q?Mw=3D=3D?=
X-OriginatorOrg: os.amperecomputing.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 49059411-ac29-48d2-9a53-08dbeb3d89d8
X-MS-Exchange-CrossTenant-AuthSource: PH0PR01MB7975.prod.exchangelabs.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 22 Nov 2023 09:29:34.6727
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 3bc2b170-fd94-476d-b0ce-4229bdc904a7
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: S6gAJyveqbvRpphzvpEQOz+MmmxjkIFnXlWUX1rQTI93fvB36VGl7NnQlQ77vTtRzBTLqcHzBQXe3uMIr67jm7GkJPJm9ZI+ix64wOOQ6pjCp5kzGitgtjAsr7TvyrB4
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CO1PR01MB6760
X-Spam-Status: No, score=-0.9 required=5.0 tests=DKIM_SIGNED,DKIM_VALID,
	DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,
	SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE autolearn=unavailable
	autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on groat.vger.email
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org
X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (groat.vger.email [0.0.0.0]); Wed, 22 Nov 2023 01:29:53 -0800 (PST)

0) Background:
   We found that AmpereOne benefits from aggressive prefetches when
   using 4K page size.

1) This patch:
    1.1) adds new WORKAROUND_AMPERE_AC03_PREFETCH capability.
    1.2) uses MIDR_AMPERE1 to filter the processor.
    1.3) uses alternative_if to alternative the code
         for AmpereOne.
    1.4) adds software prefetches for the specific loop.
    	 Also add a macro add_prefetch.

2) Test result:
    In hugetlb or tmpfs, We can get big seqential read performance improvement
    up to 1.3x ~ 1.4x.


Huang Shijie (4):
  extable: add __sort_main_extable
  arm64: alternative: handle the kernel exception table
  arm64: copy_template.S: add loop_for_copy_128_bytes macro
  arm64: add software prefetches for AmpereOne

 arch/arm64/Kconfig.platforms    |  7 +++
 arch/arm64/kernel/alternative.c | 18 +++++++
 arch/arm64/kernel/cpu_errata.c  |  9 ++++
 arch/arm64/lib/copy_template.S  | 87 +++++++++++++++++++++++----------
 arch/arm64/tools/cpucaps        |  1 +
 include/linux/extable.h         |  2 +
 kernel/extable.c                |  8 ++-
 7 files changed, 105 insertions(+), 27 deletions(-)

-- 
2.40.1