Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:2 as permitted sender) client-ip=2620:137:e000::3:2;
Message-ID: <a4ae7473-636b-4ff3-9f66-f47dbe934593@intel.com>
Date:   Wed, 25 Oct 2023 11:08:51 +0800
User-Agent: Mozilla Thunderbird
Subject: Re: [PATCH] arm64: mm: drop tlb flush operation when clearing the
 access bit
Content-Language: en-US
To:     Baolin Wang <baolin.wang@linux.alibaba.com>,
        Barry Song <21cnbao@gmail.com>
CC:     <catalin.marinas@arm.com>, <will@kernel.org>,
        <akpm@linux-foundation.org>, <v-songbaohua@oppo.com>,
        <yuzhao@google.com>, <linux-mm@kvack.org>,
        <linux-arm-kernel@lists.infradead.org>,
        <linux-kernel@vger.kernel.org>
References: <ae3115778a3fa10ec77152e18beed54fafe0f6e7.1698151516.git.baolin.wang@linux.alibaba.com>
 <CAGsJ_4zgdAmyU-075jd8KfXn=CdAVC8Rs481sCOd5N2a68yPUg@mail.gmail.com>
 <44e32b0e-0e41-4055-bdb9-15bc7d47197c@intel.com>
 <f3047412-a53c-f8ba-f8aa-4f46e04c5a31@linux.alibaba.com>
From:   "Yin, Fengwei" <fengwei.yin@intel.com>
In-Reply-To: <f3047412-a53c-f8ba-f8aa-4f46e04c5a31@linux.alibaba.com>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 7bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?eFZlZzlsK0txNldZMjlmQTlkTmhoZGpRdkVQbEpHSldZR0ttMFpPeWMwc1RK?=
 =?utf-8?B?WFZVMWdncjZvZVdzWUFodG5hank5WnpndGExNi9OTjE0bzVBU3BsNjVUT0pH?=
 =?utf-8?B?NWxUcjY1TXl3Y1J3QWs2OVp5clBvU2xJYVgrSzNKWTFBNXNHdHNlS1RlR05H?=
 =?utf-8?B?TlJaQkdNTGRPSk1PWUlVcXlOSGY5NVBsZTNRR0tEVThmVzl3OTFnMmF1TEtr?=
 =?utf-8?B?SzUzZzJkU2Nsc1RSOGpyb085M0hxbWVTaHFSVngzbS82djJma2F1UFF2VEcw?=
 =?utf-8?B?UGRPWW9VQWlvWUVsN2Rqd1BvUGo2NzBBeEgxekpVQWJLQkpFM2ZFZzIrV2xQ?=
 =?utf-8?B?NFMyMDlaQnhQaGJmMmZWMHRXbFBIalJXQWR5b3ZOYmpJeGR4SmVaT2o3MVZX?=
 =?utf-8?B?QXdFWDNXcC9pb2NXZE5iaFB1MHQrODVUY0JEK2NVcGFiSzlWYkpwSG14TDlr?=
 =?utf-8?B?SERNb2gwSnM4QW4rdENRK2FIeWI1Q2JveDdjcnhuRzNzbWpyWTRBa291elkv?=
 =?utf-8?B?OEZKWWVkTlM3ZncvSmpoQWFBaEsvMURuMkVIMHhlbDdobzhIcmdzTUN3TUp6?=
 =?utf-8?B?QktMOGVQb0JaTU1xMElBY2M3ckViVzBnZDV3MDdxakZQc0QxbVV2VytPd2J1?=
 =?utf-8?B?MXlJNlNOeFRpbzViM1JuVTZURGQ5eTR5dnR0UFUyYkNOYzhoNURlR0QvOXFK?=
 =?utf-8?B?ZjRBUGJxYlcrWis5bHZtZ0xwQXdXR3VKV3l1RGFyTmNvek1xeXIweFlxUXJ4?=
 =?utf-8?B?cjhMeVZwZFZVYXdvbWdwOGtMNW9tZlRBU21uMlh4MTBVVDZKV1JpeEwvMUVM?=
 =?utf-8?B?L2xwbW1BcDhCem1aL3VrZm9lT3Z4RWFTUGVSc0tMZWNLZE5tL08zZmh0L3VZ?=
 =?utf-8?B?bGdlSC9sRnZLY0MwVTk2alQveVJqdEdjZVdsbm54NWxaSlVEVWJyd09wV1FL?=
 =?utf-8?B?dTd4cFU5blZhalNpNm56SlNHZnQ2WGo4c3hza1o3MnNmd2VEbXNoclJDM3Bv?=
 =?utf-8?B?Rk1sTnVNb0VwTS9hZytpa0dtd0NEck43dEE2dUxMNzF4L2svVWlrR2ZPZlp6?=
 =?utf-8?B?UXU5T0NWQ0w0TjNURXZ1T1BNWUYzcy80Qkx1L3d1NmFQSDB4cytaRHFBcG4z?=
 =?utf-8?B?MDBuaEQzK3BsaVN5dVYvTVpyTjIrRzBIbUVKS2JCMVYwdS9YQWtHQ05iZHFk?=
 =?utf-8?B?TUE1SmlNN1RvYlpydTJSZmt5QVRvK3M2TklqSVNmZW9ob2JCTWRydHNWSG0x?=
 =?utf-8?B?ZERSZnM3amJmMlYxL2VwQURWeUFjQ1NmL1hrMHp1Si9aTk9Sakd5Qlc5a2g2?=
 =?utf-8?B?d09WajdMUDY3aGxtNUNDa1BxMHlhSFVuRFFCb2lJa2NhQzRsT1FpV1dIc0FW?=
 =?utf-8?B?REovRllOUWFGNGpZU3JpcFQ3TElQOXEyTXhINWk3V3BsbFE3L0tXVHRNTURo?=
 =?utf-8?B?cVkrOUhWTENqRVJiK1M1dXZ0ZG1tcWZOL0MvUnBCRFc4dWFqcTd0MWpOd2Ja?=
 =?utf-8?B?ZTBIeVVsWFhQNXZFU3JzcXJlYzFuVXBIMkp5MGQ2SDFkdUl0dnNNOHFTM09Q?=
 =?utf-8?B?b1UxNjZ5eU5FSlF1dVY0MndjOTYwRmZ0a3FySExUZmNuQnZUUGd3aVRjWjE1?=
 =?utf-8?B?TFFCZFc5RGhvVlN6YTVqZXFvWWs2cVZqTFVJSFZwUzExb0tJRmlDenFOaGI0?=
 =?utf-8?B?cWprb0RIK0UzKzVwd0ZhcmtDRGVlMU9yMWQ2RFlZeUs4RnBOb2tJNWg2ZmpU?=
 =?utf-8?B?WnFkbnUyYXZiRy9oYWFsQlArdmJJUUZ1ZUU2bFZSWVZZVWNZeStZYkdVa240?=
 =?utf-8?B?UFBnRUppREthRk00a2RQcXBRWXRUWGdka1EvaVZLay9sMjczMGhWdG8rYVpJ?=
 =?utf-8?B?dG9uN3doWGtwMUFFMXVEcXJwY29FMzJIQ3JJMVRxN2NNT0QvUEpZZjVRSnNn?=
 =?utf-8?B?NlZPOVlBbU5lWjhVVkQyV3NIRnFhYlpFTEZLcmM3SisrUXNWMDl3NzNFOWlH?=
 =?utf-8?B?R3drS3pSQXdnbXlnZVVnaVpxWDFNU0tMREp5L1Y5N3JKVERRL2c1UzJ6SDBj?=
 =?utf-8?B?QXJrT3h5U3V2M0psanFUUHVzbnR0Qi9RVWJQcSs0V0JMTkQ5V0VoVHJRMm1o?=
 =?utf-8?Q?eDASaUpVx5RNt/DPHRY16mmUt?=
X-MS-Exchange-CrossTenant-Network-Message-Id: df84aad3-3cf7-48c0-8273-08dbd507baea
X-MS-Exchange-CrossTenant-AuthSource: CO1PR11MB4820.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 25 Oct 2023 03:08:58.2937
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: 0jgUrZZ0g0zdzKh/DXE67A1Zn133GiKaaZ74FMSPuqO05IsvOLANzPeg6t8r3nGfzoFu7qbTE4wBX4U8sZ4oIg==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SA1PR11MB7697
X-OriginatorOrg: intel.com
X-Spam-Status: No, score=-0.9 required=5.0 tests=DKIMWL_WL_HIGH,DKIM_SIGNED,
	DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,
	MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS autolearn=unavailable
	autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on agentk.vger.email
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org
X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (agentk.vger.email [0.0.0.0]); Tue, 24 Oct 2023 20:09:19 -0700 (PDT)


On 10/25/2023 11:03 AM, Baolin Wang wrote:
>>
>> My understanding is that arm64 doesn't do invalidate the TLB during > context switch. The flush_tlb_page_nosync() here + DSB during context
> 
> Yes, we only perform a TLB flush when the ASID is exhausted during context switch, and I think this is same with x86 IIUC.
If we remove flush_tlb_page_nosync(), can we still claim TLB is flushed during
context switch for ARM64?

> 
>> switch make sure the TLB is invalidated during context switch.
>> So we can't remove flush_tlb_page_nosync() here? Or something was changed
>> for arm64 (I have zero knowledge to TLB on arm64. So some obvious thing
>> may be missed)? Thanks.
> 
> IMHO, the tlb can be easily evicted or flushed if the system is under memory pressure, so like Barry said, the chance of reclaiming hot page is relatively low, at least on X86, we did not see any heavy refault issue.
> 
> For MGLRU, it uses ptep_test_and_clear_young() instead of ptep_clear_flush_young_notify(), and we did not find any problems until now since deploying to ARM servers.