Received: by 2002:a05:6a10:1287:0:0:0:0 with SMTP id d7csp119068pxv; Thu, 15 Jul 2021 00:12:38 -0700 (PDT) X-Google-Smtp-Source: ABdhPJwFf3KoYEwRNwdK7mIp2WCe7TIfq8mVjox/GxfunU9P4IWlUjC1DZAXmwS2aaWb7WKhL4/g X-Received: by 2002:a05:6402:111a:: with SMTP id u26mr4645600edv.260.1626333157836; Thu, 15 Jul 2021 00:12:37 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1626333157; cv=none; d=google.com; s=arc-20160816; b=C0cOImrO5peDqtBvlgeDU2oNbP3bWaseV5RE3k+iuyAtQ6bIJ0Spx/jj671QP9UcVA h8jsVl5+w/J+s01BbwoX2S0gBxoIEX7mdTGe1ST5k6DA8SdAkKXEPjFdM3CfL1CkhtMT yvEZW3Z8StSRmxPlxsOwaHcucPsVW2V76TuZM7B7rIEY6KlIISJcuBLp/CPxMFlDzCbz JxTg9RVLsaZsbiAkMGVp31QE4KrwoUj4rgZaMDtv3BpLDOqXspu3H+eLU9KqIfIh/git CUUi4nOsnXRYW0/B5OUDF99NHstITAR2sCvoBp/naOzqrg5WEMyD43DeBq8Fulc6wH59 Db0Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:content-language :in-reply-to:mime-version:user-agent:date:message-id:from:references :cc:to:subject:reply-to:dkim-signature; bh=nrxR9YJIRDun9r5WDjFAvm6/X83B6W+94/3z0nnD2QQ=; b=0A6dfzZSpHz8L3wIPlNAJbh78FLFXni+6nWEGS1A4J+/uYMvFIowB/RMOsjRReUXcb aKQZ+ZLhYCMagoIivIij4bykxjZJ68rLCdubFDhg3q8MIy/bmvxYzKgVCXj+KqIoaHUB HCRzRkMfUbmrF8LVU7zO8xvQtdesY95Ib9j+yeqd1FQ62SC+EGTKu1EcysvuuAxA0dhm quqpdb3KScgBmZAi1CYHwOEPlDq+4ppI9q4EydHGc1Je8U7LpU/usSDPADIk5Cy1jLlg 2C5g3uTYPw4m9grXA0ZLUOO0zgsI+dUA4DreGoLR07bvU/Bhokw8njUkEMqwvSrVvRtL lwag== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=DjfYac4c; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id m3si6284695edr.6.2021.07.15.00.12.15; Thu, 15 Jul 2021 00:12:37 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=DjfYac4c; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S239430AbhGOFUf (ORCPT + 99 others); Thu, 15 Jul 2021 01:20:35 -0400 Received: from us-smtp-delivery-124.mimecast.com ([216.205.24.124]:31371 "EHLO us-smtp-delivery-124.mimecast.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S238195AbhGOFUe (ORCPT ); Thu, 15 Jul 2021 01:20:34 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1626326261; h=from:from:reply-to:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=nrxR9YJIRDun9r5WDjFAvm6/X83B6W+94/3z0nnD2QQ=; b=DjfYac4cDuJZX18mI8egD7DEXzWsVkg5ybc/lM9sR3k7sJcireGIC/uR6mwKLCxwjK6FV7 kgzsK3RRN5PZV5TuPJyoX51b9kpAKU6H/E+8sVH9xNleCVeni2MP7y8vBpmvbOY63UvxjV 3ijC/SHMnWzAP2eivMItcLc+hwjS3Us= Received: from mimecast-mx01.redhat.com (mimecast-mx01.redhat.com [209.132.183.4]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-541-HZsmSFz7P76Jwfa3DWQxIw-1; Thu, 15 Jul 2021 01:17:39 -0400 X-MC-Unique: HZsmSFz7P76Jwfa3DWQxIw-1 Received: from smtp.corp.redhat.com (int-mx03.intmail.prod.int.phx2.redhat.com [10.5.11.13]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx01.redhat.com (Postfix) with ESMTPS id EAA30802E61; Thu, 15 Jul 2021 05:17:37 +0000 (UTC) Received: from [10.64.54.195] (vpn2-54-195.bne.redhat.com [10.64.54.195]) by smtp.corp.redhat.com (Postfix) with ESMTPS id D528A60854; Thu, 15 Jul 2021 05:17:34 +0000 (UTC) Reply-To: Gavin Shan Subject: Re: [PATCH 00/12] mm/debug_vm_pgtable: Enhancements To: Anshuman Khandual , linux-mm@kvack.org Cc: linux-kernel@vger.kernel.org, catalin.marinas@arm.com, will@kernel.org, akpm@linux-foundation.org, shan.gavin@gmail.com, chuhu@redhat.com References: <20210706061748.161258-1-gshan@redhat.com> <42a26202-10f7-e744-3fc5-c9e5a7445193@arm.com> <30a938df-f5c8-910c-8ddc-52a2d2a0a11e@arm.com> From: Gavin Shan Message-ID: Date: Thu, 15 Jul 2021 15:17:53 +1000 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.2.0 MIME-Version: 1.0 In-Reply-To: <30a938df-f5c8-910c-8ddc-52a2d2a0a11e@arm.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.79 on 10.5.11.13 Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hi Anshuman, On 7/14/21 3:26 PM, Anshuman Khandual wrote: > On 7/13/21 6:50 AM, Gavin Shan wrote: >> On 7/12/21 2:14 PM, Anshuman Khandual wrote: >>> Though I have not jumped into the details for all individual >>> patches here but still have some high level questions below. >>> >>> On 7/6/21 11:47 AM, Gavin Shan wrote: >>>> There are couple of issues with current implementations and this series >>>> tries to resolve the issues: >>>> >>>>    (a) All needed information are scattered in variables, passed to various >>>>        test functions. The code is organized in pretty much relaxed fashion. >>> All these variables are first prepared in debug_vm_pgtable(), before >>> getting passed into respective individual test functions. Also these >>> test functions receive only the required number of variables not all. >>> Adding a structure that captures all test parameters at once before >>> passing them down will be unnecessary. I am still wondering what will >>> be the real benefit of this large code churn ? >>> >> >> Thanks for your review. There are couple of reasons to have "struct vm_pgtable_debug". >> >> (1) With the struct, the old and new implementation can coexist. In this way, >>     the patches in this series can be stacked up easily. > > Makes sense. > >> (2) I think passing single struct to individual test functions improves the >>     code readability. Besides, it also makes the empty stubs simplified. > > Empty stub simplified - reduced argument set in the empty stubs ? > Yes. >> (3) The code can be extended easily if we need in future. > > Agreed. > >> >>>> >>>>    (b) The page isn't allocated from buddy during page table entry modifying >>>>        tests. The page can be invalid, conflicting to the implementations >>>>        of set_{pud, pmd, pte}_at() on ARM64. The target page is accessed >>>>        so that the iCache can be flushed when execution permission is given >>>>        on ARM64. Besides, the target page can be unmapped and access to >>>>        it causes kernel crash. >>> >>> Using 'start_kernel' based method for struct page usage, enabled this >>> test to run on platforms which might not have enough memory required >>> for various individual test functions. This method is not a problem for >>> tests that just need an aligned pfn (which creates a page table entry) >>> not a real struct page. >>> >>> But not allocating and owning the struct page might be problematic for >>> tests that expect a real struct page and transform its state via set_ >>> {pud, pmd, pte}_at() functions as reported here. >>> >> >> Yeah, I totally agree. The series follows what you explained: Except the >> test cases where set_{pud, pmd, pte}_at() is used, the allocated page >> is used. For other test cases, 'start_kernel' based PFN is used as before. >> >>>> >>>> "struct vm_pgtable_debug" is introduced to address issue (a). For issue >>>> (b), the used page is allocated from buddy in page table entry modifying >>>> tests. The corresponding tets will be skipped if we fail to allocate the >>>> (huge) page. For other test cases, the original page around to kernel >>>> symbol (@start_kernel) is still used. >>> >>> For all basic pfn requiring tests, existing 'start_kernel' based method >>> should continue but allocate a struct page for other tests which change >>> the passed struct page. Skipping the tests when allocation fails is the >>> right thing to do. >>> >> >> Yes, it's exactly what this series does. Hope you can jump into the details >> when you get a chance :) > > I have already started looking into the series. But still wondering if > the huge page memory allocation change and the arm64 specific page fix > should be completed first, before getting into the new structure based > arguments (in a separate series). Although the end result would still > remain the same, the transition there would be better I guess. Do you > see any challenges in achieving that ? > Thanks for your time to review in details. As I can understand, the reason to have the fix for easy backporting to stable-kernel and I didn't do that because of couple of facts: (1) The changes included in this series only affects only one source file, so backporting the whole series isn't hard. (2) There will be more redundant code if we include the fix before switching to "struct vm_pgtable_debug". It's unnecessary. So lets keep the patch layout we had if you agree. Actually, the issues are found during the testing with RHEL downstream kernel. Once it's settled down, I will backport the whole series to RHEL downstream kernel. Thanks, Gavin