Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18;
Message-ID: <f883edca-42cb-9194-363c-44fbc806cfe5@nvidia.com>
Date:   Mon, 1 Nov 2021 12:31:38 -0700
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101
 Thunderbird/91.2.1
Subject: Re: [RFC 3/8] mm: Avoid using set_page_count() in
 set_page_recounted()
Content-Language: en-US
To:     Pasha Tatashin <pasha.tatashin@soleen.com>
Cc:     LKML <linux-kernel@vger.kernel.org>, linux-mm <linux-mm@kvack.org>,
        linux-m68k@lists.linux-m68k.org,
        Anshuman Khandual <anshuman.khandual@arm.com>,
        Matthew Wilcox <willy@infradead.org>,
        Andrew Morton <akpm@linux-foundation.org>,
        william.kucharski@oracle.com,
        Mike Kravetz <mike.kravetz@oracle.com>,
        Vlastimil Babka <vbabka@suse.cz>,
        Geert Uytterhoeven <geert@linux-m68k.org>,
        schmitzmic@gmail.com, Steven Rostedt <rostedt@goodmis.org>,
        Ingo Molnar <mingo@redhat.com>,
        Johannes Weiner <hannes@cmpxchg.org>,
        Roman Gushchin <guro@fb.com>,
        Muchun Song <songmuchun@bytedance.com>, weixugc@google.com,
        Greg Thelen <gthelen@google.com>
References: <20211026173822.502506-1-pasha.tatashin@soleen.com>
 <20211026173822.502506-4-pasha.tatashin@soleen.com>
 <7b131cb1-68d8-6746-f9c1-2b01d4838869@nvidia.com>
 <CA+CK2bD6x01PevPqshzYqkO3aokjP2jBbt_4e5H5U3DVEdcJ5Q@mail.gmail.com>
 <b346cafd-d8b8-57a4-c7b9-6574b256a400@nvidia.com>
 <CA+CK2bBiomTe-vOuxM_R+0CMAippyrfZ6AgpXQGqps3ZFQCtRA@mail.gmail.com>
 <19d16b40-355f-3f79-dcba-e1d8d2216d33@nvidia.com>
 <CA+CK2bBn81pz5NqCvS9jz+DvXbGG6d52Q=xTySJvJuqNRmFkkg@mail.gmail.com>
From:   John Hubbard <jhubbard@nvidia.com>
In-Reply-To: <CA+CK2bBn81pz5NqCvS9jz+DvXbGG6d52Q=xTySJvJuqNRmFkkg@mail.gmail.com>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?ZUwrZTYrdmpBaG91bE90Z2gwbTFnUmxmU00xODFzWVdwenU0b3EzVVpIdkZH?=
 =?utf-8?B?VjMrZGlhWkcyaGYrMmw2RG9JWTRPTUJVclJOc3JjcTlxWWI1WGtKY0dzYk1E?=
 =?utf-8?B?UG9zaisrUnR4TkEzV1J0WVFwYlY2OVhoZkRnZ1ZNenpic3h2Q09LaDViWW9q?=
 =?utf-8?B?R29tZ2JMdkYybUh0U0hJWlRhd1JaYk81L0RPcUdBNzlyOWliZ2lUS1ErNU9Z?=
 =?utf-8?B?U2NkTWs2bHVwVFhXRHUrSzdDVnBNRGJZakRmSDlPRXVMZ2JMcEVTaUVNayty?=
 =?utf-8?B?dHRsU3JDTzEzem00RmM2M0FwOHFrUFdRd2ltZVAzVCtBbXZueVl3dFVVOVgv?=
 =?utf-8?B?bk5CTVdkaStlLzVPeE5iOWRkVHN2cnhYOE5HNDdNa0Z3R25LWFFwWVlYbTFR?=
 =?utf-8?B?ZnJvKzRJQ2Fpei9UZENPSVlTWVJBTlgvN3F6cy9rSWp0VUtnS3FhQmhEU29n?=
 =?utf-8?B?eFJKeDBHUjlHMVFHZ3k0T1B3TWppK2RVdlRTd0s0RFpIcTJ0NVU0aHNiRU8w?=
 =?utf-8?B?RFpTZjFraTZUdlZRbU1tZ2RyZVpOd2xEMkorZEZKTFRDNzdZSGNDbFgxKzZj?=
 =?utf-8?B?NzFFcVNlNTNzU21XZmlwTy9xOUxpdk5IT3pUMTZGQ3lidXFPbkpTRzhJYUND?=
 =?utf-8?B?UjVLcmU5QXpPRVR6d2t3dURya2ZNbmIzemhITDZPakllU1RmZVhPWmRZZzRn?=
 =?utf-8?B?Z29vbFg5RmVxVVRmajMzR2lGVnVIazRTY3ltV0FySnJBOUVzMzFVUzZPZVpz?=
 =?utf-8?B?UjM1VVJKbWpCc3hoeUk1b0Q5SWNNejFMc0V5WkllTDRUQXhPT2ZZSEFXUjlL?=
 =?utf-8?B?TUx3ZmwxS0NhUXBGc1pKdFNHc2JTZzdiTVVKblhYQjFsNGxsdmxjSjBQMDBF?=
 =?utf-8?B?MGFYbmYvSXh3STJReUNCbkJBMDh6OEsxcURzM2d6Um14VlRuNkJsSWpmNEhP?=
 =?utf-8?B?T1ZJTWZxQXo1TDVBYTQvQk1XVklsdUFiOGtUMS9rakp0S05xMUQ3MzlaeXFj?=
 =?utf-8?B?VmRHUXA5SUJEa0ZmNE1ZM3RLZmpoVVBVVEJUd1YwRnFSejI2YUVKaU43ZHNH?=
 =?utf-8?B?aTIvNndYZ3lrN1JBUTRMVlFmVlpDZzlsZDAzcVgxc1FvTUhseHpXSDhTMk1N?=
 =?utf-8?B?Z3U2ZUZ5OXBkMk5LMXB5QnFaM2oyeXdIZG5TeXJzOXBwazkrTS9NdXVQRWdQ?=
 =?utf-8?B?OTNHZ0MySnk2U3VRQjVpNUpCb0hRMGZlRlZ2YnM2a3d0eHYzQXRNM1Rvd21o?=
 =?utf-8?B?OERHRU5Pc1lCeEI5TVVUUm82U0I5NWxhd0FnZVFrM1Zhdk1wQnlhNVh0L1M0?=
 =?utf-8?B?eDFBdkZxSlFoMmRGdlNLVXFDK09XNlVBQ3RyWVcvS3ZPdWtld1ltb3BtWFQz?=
 =?utf-8?B?YlhHMTZPbWE3eTV4WWc5QThYRUtKS2REQW9hL28yQVUrTG5mNTVGeXhGZEdl?=
 =?utf-8?B?SUJTRHEyVVRXOGVvWEFMeXl5ZGlKRXFUOG80bGhkUFhaT0lRWXVXMXlpT2tW?=
 =?utf-8?B?OGowaHY0SGNRTlRlQ2UyMlhCQ3ZsVm5jWHFpdG0yeEZhNjkrOVFTMUVzUUM5?=
 =?utf-8?B?czdra2NYM2R1OHJpZkMwSExtRHpDS0dEU3B0NUt4Rjk5S1ViQ1NVQ1FOc1Qv?=
 =?utf-8?B?WjdXQ3FRS09OUEZZdmF1WkVuazNtKzFmOHVkekxveGp2U3VaRkFWNGVieXFy?=
 =?utf-8?B?MUcvM2Y4eXJNemlwcjdMZFBxK3Z0TEJ4TzhlSjhuVUxWVndZalFXR1U0TzVO?=
 =?utf-8?B?c21RMjljaWIzNUJCWURmOG9HTlY0ZGF2SlFtaVJvM284em5VZ3J4RDBJdzlz?=
 =?utf-8?B?OXl6dnl5S09CM0cxakFqN0xKMEdreGFzVzhsY3FxdVhCWDZreXFkZ21UYVE2?=
 =?utf-8?B?RUhTWTNnNnVnbUNoNGlVMzkyY3g3UDBVOElRRHlSVFRRbEI5ZmpMWm9pZWpW?=
 =?utf-8?B?Q3RtNTNUSjZkOSszUTRtRHNaYjRvanBOeHhpYThPKy9Yc1JvUzYvVUdmbXhT?=
 =?utf-8?B?d3FpcHpSUGIzUm9Sc2VxMERrYUQ1RTZ6aGhwU1JBZzdNdW1MdWR5dVhEZjNm?=
 =?utf-8?B?SUNidDcza2FNVldFOTQ5MVUwdkFNTUNCeTdaYlV3bDRoUEVDWU56TEZFVkYz?=
 =?utf-8?B?ZTJ2bHhLSnpLS3NnM281RVhtb2NXMmRFOUVQU2d5bFZadlMxeWJERlp2U01Q?=
 =?utf-8?Q?8FnjmZsMQcCqLLwj336h3/g=3D?=
X-OriginatorOrg: Nvidia.com
X-MS-Exchange-CrossTenant-Network-Message-Id: b484ec04-c84d-4537-118f-08d99d6e3a4a
X-MS-Exchange-CrossTenant-AuthSource: BY5PR12MB4130.namprd12.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 01 Nov 2021 19:31:40.1264
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: fQPfJI/OwrOY75IV+ol9F7nSAFg+nvWN1cxR17HHU/RdxpR1S1EIV0BiCMrWhZ/kFqZ8u7qCht2ZS//aGb7swA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BY5PR12MB4307
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

On 11/1/21 07:22, Pasha Tatashin wrote:
>>>> Yes, you are just repeating what the diffs say.
>>>>
>>>> But it's still not good to have this function name doing something completely
>>>> different than its name indicates.
>>>
>>> I see, I can rename it to: 'set_page_recounted/get_page_recounted' ?
>>>
>>
>> What? No, that's not where I was going at all. The function is already
>> named set_page_refcounted(), and one of the problems I see is that your
>> changes turn it into something that most certainly does not
>> set_page_refounted(). Instead, this patch *increments* the refcount.
>> That is not the same thing.
>>
>> And then it uses a .config-sensitive assertion to "prevent" problems.
>> And by that I mean, the wording throughout this series seems to equate
>> VM_BUG_ON_PAGE() assertions with real assertions. They are only active,
>> however, in CONFIG_DEBUG_VM configurations, and provide no protection at
>> all for normal (most distros) users. That's something that the wording,
>> comments, and even design should be tweaked to account for.
> 
> VM_BUG_ON and BUG_ON should be treated the same. Yes, they are config
> sensitive, but in both cases *BUG_ON() means that there is an
> unrecoverable problem that occured. The only difference between the
> two is that VM_BUG_ON() is not enabled when distros decide to reduce
> the size of their kernel and improve runtime performance by skipping
> some extra checking.
> 
> There is no logical separation between VM_BUG_ON and BUG_ON, there is
> been a lengthy discussion about this:
> 
> https://lore.kernel.org/lkml/CA+55aFy6a8BVWtqgeJKZuhU-CZFVZ3X90SdQ5z+NTDDsEOnpJA@mail.gmail.com/
> "so *no*. VM_BUG_ON() is no less deadly than a regular BUG_ON(). It
> just allows some people to build smaller kernels, but apparently
> distro people would rather have debugging than save a few kB of RAM."
> 
> Losing control of ref_count is an unrecoverable problem because it
> leads to security sensitive memory corruptions. It is better to crash
> the kernel when that happens instead of ending up with some pages
> mapped into the wrong address space.
> 
> The races are tricky to spot, but set_page_count() is inherently
> dangerous, so I am removing it entirely and replacing it with safer
> operations which do the same thing.
> 
> One example is this:
> https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?h=7118fc29

I don't think we have any disagreement about the landscape here. But it's
much easier to describe the problem than it is to fix it--as always. And
repeating the problem doesn't make a proposed fix more (or less) appropriate. :)

> 
>>>>>> I understand where this patchset is going, but this intermediate step is
>>>>>> not a good move.
>>>>>>
>>>>>> Also, for the overall series, if you want to change from
>>>>>> "set_page_count()" to "inc_and_verify_val_equals_one()", then the way to
>>>>>> do that is *not* to depend solely on VM_BUG*() to verify. Instead,
>>>>>> return something like -EBUSY if incrementing the value results in a
>>>>>> surprise, and let the caller decide how to handle it.
> 
> In set_page_refcounted() we already have:
> 
> VM_BUG_ON_PAGE(page_ref_count(page), page);
> set_page_count(page, 1);
> 
> I am pointing out that above code is racy:
> 
> Between the check VM_BUG_ON_PAGE() check and unconditional set to 1
> the value of page->_refcount can change.
> 
> I am replacing it with an identical version of code that is not racy.

And I'm pointing out that raciness is not the real bug, or at least, not
the only bug. "Fixing" the race does not fix the code, but the patch
series seems to imply that it does.

> There is no need to complicate the code by introducing new -EBUSY
> returns here, as it would reduce the fragility of this could even
> farther.
> 
>>>>> Actually, -EBUSY would be OK if the problems were because we failed to
> 
> I am not sure -EBUSY would be OK here, it means we had a race which we
> were not aware about, and which could have led to memory corruptions.
> 
>>>>> modify refcount for some reason, but if we modified refcount and got
>>>>> an unexpected value (i.e underflow/overflow) we better report it right
>>>>> away instead of waiting for memory corruption to happen.
>>>>>
>>>>
>>>> Having the caller do the BUG() or VM_BUG*() is not a significant delay.
> 
> I agree, however, helper functions exist to remove code duplications.
> If we must verify the assumption of set_page_refcounted() that non
> counted page is turned into a counted page, it is better to do it in
> one place than at every call site. We do it today in thus helper
> function, I do not see why we would change that.
> 

Let's ignore this -EBUSY idea for now, because I'm not sure where you are
going with your next version, and maybe it won't even come up.


thanks,
-- 
John Hubbard
NVIDIA