Received: by 2002:a25:8b91:0:0:0:0:0 with SMTP id j17csp1822282ybl; Thu, 9 Jan 2020 02:12:00 -0800 (PST) X-Google-Smtp-Source: APXvYqw+FGB3SHPziw/Gcy4jJQdGK/NTxtzbwpAxrDxhAE9AXW+ZahprQw0iOiQsPWOqFGJiwvZ7 X-Received: by 2002:a05:6830:1501:: with SMTP id k1mr7657833otp.125.1578564720714; Thu, 09 Jan 2020 02:12:00 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1578564720; cv=none; d=google.com; s=arc-20160816; b=E0j0pRlsgaApucCOO6LQjhnCuWZ3UtAOc619/kThG3cPmxTu3GRBgqimpU6glrHNLq h+Zcf7ojQGKuAapDj0AHfVhEeNqTPv/GIDzVei6DTry9BC3zBVZQ3TzQtRwAHDqBuxJY ZHMVZ5Sl7/7CwKWrKayKUga7EcU2crCpi2UE43laXHiw+J1FPzcY5rGXEms2nXt/oHR7 BGfERcby4ys051doRBIjdfEXAbJzLHc+4i9GYTPD7+KLm4mOj8OGC6DNcyKcIiQZTorC xUyUi7AqhMcQ8hdrs8HobtMq7J83mm8HcWOMVwcZ3IzMK/2HXqs1VvnL+Huzsc9oLklb sFxQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-disposition:mime-version:references:reply-to:message-id :subject:cc:to:from:date; bh=oRnSeu9H+CStDHqTSZmeysYusPyMpVG+u0MIhshC1AQ=; b=nx7Uzg8rghNAn9QVNkBAU1qJfPWi0gX0IKpEG6qyz5U1oS/sRfGHCqe9/OmsTFsd73 238PCQ1QPQ08/Be1zNlboaSUhZfcnjwygPRC8iu47s1YiFqaa/Koe9SeYyWVQN++LjRJ pFndGoA60isHG2DZmXN7zZXe2fDVJLAfF1mxSxGXFYn/Cx65BZt2MeK1/0uRJaY7mDXD iTJKJisUthEKy9HipNH78mWdNQkum1JGMCD2FEdu3mv46XdSqkO0tquPNyaFkLmPzBEa E4fZMmq0vz8gNMcQuPmiTeDxCqWNfyRs7yePYvsVaTUkSzxEU1E+kK5z+sykBgG7RkuD 7ycw== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id l5si3760877otn.194.2020.01.09.02.11.48; Thu, 09 Jan 2020 02:12:00 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728836AbgAIIwd (ORCPT + 99 others); Thu, 9 Jan 2020 03:52:33 -0500 Received: from mga05.intel.com ([192.55.52.43]:50456 "EHLO mga05.intel.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1728690AbgAIIwd (ORCPT ); Thu, 9 Jan 2020 03:52:33 -0500 X-Amp-Result: UNKNOWN X-Amp-Original-Verdict: FILE UNKNOWN X-Amp-File-Uploaded: False Received: from fmsmga005.fm.intel.com ([10.253.24.32]) by fmsmga105.fm.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 09 Jan 2020 00:52:33 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.69,413,1571727600"; d="scan'208";a="421716257" Received: from richard.sh.intel.com (HELO localhost) ([10.239.159.54]) by fmsmga005.fm.intel.com with ESMTP; 09 Jan 2020 00:52:31 -0800 Date: Thu, 9 Jan 2020 16:52:31 +0800 From: Wei Yang To: Michal Hocko Cc: Wei Yang , hannes@cmpxchg.org, vdavydov.dev@gmail.com, akpm@linux-foundation.org, kirill.shutemov@linux.intel.com, cgroups@vger.kernel.org, linux-mm@kvack.org, linux-kernel@vger.kernel.org, yang.shi@linux.alibaba.com Subject: Re: [RFC PATCH] mm: thp: grab the lock before manipulation defer list Message-ID: <20200109085231.GA7305@richard> Reply-To: Wei Yang References: <20200103143407.1089-1-richardw.yang@linux.intel.com> <20200106102345.GE12699@dhcp22.suse.cz> <20200107012241.GA15341@richard> <20200107083808.GC32178@dhcp22.suse.cz> <20200108003543.GA13943@richard> <20200108094041.GQ32178@dhcp22.suse.cz> <20200109031821.GA5206@richard> <20200109083641.GH4951@dhcp22.suse.cz> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20200109083641.GH4951@dhcp22.suse.cz> User-Agent: Mutt/1.9.4 (2018-02-28) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, Jan 09, 2020 at 09:36:41AM +0100, Michal Hocko wrote: >On Thu 09-01-20 11:18:21, Wei Yang wrote: >> On Wed, Jan 08, 2020 at 10:40:41AM +0100, Michal Hocko wrote: >> >On Wed 08-01-20 08:35:43, Wei Yang wrote: >> >> On Tue, Jan 07, 2020 at 09:38:08AM +0100, Michal Hocko wrote: >> >> >On Tue 07-01-20 09:22:41, Wei Yang wrote: >> >> >> On Mon, Jan 06, 2020 at 11:23:45AM +0100, Michal Hocko wrote: >> >> >> >On Fri 03-01-20 22:34:07, Wei Yang wrote: >> >> >> >> As all the other places, we grab the lock before manipulate the defer list. >> >> >> >> Current implementation may face a race condition. >> >> >> > >> >> >> >Please always make sure to describe the effect of the change. Why a racy >> >> >> >list_empty check matters? >> >> >> > >> >> >> >> >> >> Hmm... access the list without proper lock leads to many bad behaviors. >> >> > >> >> >My point is that the changelog should describe that bad behavior. >> >> > >> >> >> For example, if we grab the lock after checking list_empty, the page may >> >> >> already be removed from list in split_huge_page_list. And then list_del_init >> >> >> would trigger bug. >> >> > >> >> >And how does list_empty check under the lock guarantee that the page is >> >> >on the deferred list? >> >> >> >> Just one confusion, is this kind of description basic concept of concurrent >> >> programming? How detail level we need to describe the effect? >> > >> >When I write changelogs for patches like this I usually describe, what >> >is the potential race - e.g. >> > CPU1 CPU2 >> > path1 path2 >> > check lock >> > operation2 >> > unlock >> > lock >> > # check might not hold anymore >> > operation1 >> > unlock >> > >> >and what is the effect of the race - e.g. a crash, data corruption, >> >pointless attempt for operation1 which fails with user visible effect >> >etc. >> >> Hi, Michal, here is my attempt for an example. Hope this one looks good to >> you. >> >> >> For example, the potential race would be: >> >> CPU1 CPU2 >> mem_cgroup_move_account split_huge_page_to_list >> !list_empty >> lock >> !list_empty >> list_del >> unlock >> lock >> # !list_empty might not hold anymore >> list_del_init >> unlock >> >> When this sequence happens, the list_del_init() in >> mem_cgroup_move_account() would crash since the page is already been >> removed by list_del in split_huge_page_to_list(). > >Yes this looks much more informative. I would just add that this will >crash if CONFIG_DEBUG_LIST. > >Thanks! Glad you like it~ Will prepare v2 with your suggestion :-) >-- >Michal Hocko >SUSE Labs -- Wei Yang Help you, Help me