Received: by 2002:ac0:aed5:0:0:0:0:0 with SMTP id t21csp2973979imb; Mon, 4 Mar 2019 20:18:41 -0800 (PST) X-Google-Smtp-Source: APXvYqwpuksWXdsgdkJ0I+9AF2KM+r5Je7d9znk93RCrRLMTnAd9NijNK8ahDZBkviWsZaEVFgTk X-Received: by 2002:a17:902:8b82:: with SMTP id ay2mr23909565plb.64.1551759520960; Mon, 04 Mar 2019 20:18:40 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1551759520; cv=none; d=google.com; s=arc-20160816; b=Q4i7x1bqzOQnwYetqJfWRLYtQ6VJOo4QMJW3pITKQu5DmZcysmAqW5JGnbqZj5RI5j /np3Et91+rgondKkvp6oZBnAQj1Faf6c1v/oWSy3A9Z+cZeICR/CKSxtOI60KjIbomUA cyIK1fAfBBnFoh5DrkIYXlTlinQFR2K7XDCzdOX5b1yHowbGzZZPRAaXhYUbTt/4KL8r vS6NpmyloooNNZ4FzQbCBtB40Rvv5PclqX4u0/6hhWJYZWmkikJhAJheC/RQPdHBYajK yuAqrdsaiYbcdIZbUOhqKt78R5yMr2J1P9upw3EgkgkgpAaGJADNtfxiN3GgXIfZOhQA rhfg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:from:references:cc:to:subject:dkim-signature; bh=567Z1LQrcn1jhTw4xpN14TmoibNHf0KqVc9qvZCGIJk=; b=Dim6Flqa0Ipp6u88HwDIf9g/+kmh60wrBYZ3tFAqwHKBVYyQHTc6LHGBjF92lOx+uw W1rkff7FXkfO5FJNguySvpo9kbIWlPMAyUTvf5vRECwFvaWyuUkD25HhjNHhC11gE+v5 WbUMNfEMulbJ3R73iacxyOGJpzgR5XiEFY+kweiZIYI+l7ys6FSjtOs+rKLRl02IZrkL klwI7sLOrjog/crAIbC/bJvy2T7ZgfVKaqZAL0UNJ7iF+yXKBa6+Nfxl//Pc1Unc/Irz Cm2D9B70+PupECCuXD6+GRRP6nQXotTQX3/xeDYSXdVsojtZBmziU+FgVuMYgli6smLt Y/2g== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@oracle.com header.s=corp-2018-07-02 header.b=uSscDkbs; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=oracle.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id n5si6838109pff.191.2019.03.04.20.18.25; Mon, 04 Mar 2019 20:18:40 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@oracle.com header.s=corp-2018-07-02 header.b=uSscDkbs; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=oracle.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727047AbfCEERM (ORCPT + 99 others); Mon, 4 Mar 2019 23:17:12 -0500 Received: from aserp2130.oracle.com ([141.146.126.79]:56332 "EHLO aserp2130.oracle.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726590AbfCEERM (ORCPT ); Mon, 4 Mar 2019 23:17:12 -0500 Received: from pps.filterd (aserp2130.oracle.com [127.0.0.1]) by aserp2130.oracle.com (8.16.0.27/8.16.0.27) with SMTP id x254Eoam123693; Tue, 5 Mar 2019 04:15:50 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h=subject : to : cc : references : from : message-id : date : mime-version : in-reply-to : content-type : content-transfer-encoding; s=corp-2018-07-02; bh=567Z1LQrcn1jhTw4xpN14TmoibNHf0KqVc9qvZCGIJk=; b=uSscDkbsyI7z84pF+b17PGBHyt8QAUOsFr8mn2QVwDyXpe3dIxsFuNrz5vPo1o929j/H 4Uj9hKJUQi50KxOZdZQHOs9o81Bi3VmoXmw0JSPiR5u9fq6k9InsrQYVPRibTLpcr2MD mreoOCEOyP8NAyehal8/ZZBiX0E0xCR9rGS/o/to5cyYBanzKrqNIG6MXSVYe3byCJjC 5zD+pJJm8Y84oS1cJAaxdPyv3iOebESxT899JGAOozs1rFUXF4ytC7eVRaxWGXoi5emK 3Ym9yCnBJFO7UgeVnKNnfhtmzeBtmelH13r/AAG7K7P7wPdmhMAVyPtb9mBb/Kjzy61h 4A== Received: from aserv0022.oracle.com (aserv0022.oracle.com [141.146.126.234]) by aserp2130.oracle.com with ESMTP id 2qyfbe36y6-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Tue, 05 Mar 2019 04:15:50 +0000 Received: from aserv0121.oracle.com (aserv0121.oracle.com [141.146.126.235]) by aserv0022.oracle.com (8.14.4/8.14.4) with ESMTP id x254FjiH001526 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Tue, 5 Mar 2019 04:15:45 GMT Received: from abhmp0007.oracle.com (abhmp0007.oracle.com [141.146.116.13]) by aserv0121.oracle.com (8.14.4/8.13.8) with ESMTP id x254FfDA032766; Tue, 5 Mar 2019 04:15:42 GMT Received: from [192.168.1.164] (/50.38.38.67) by default (Oracle Beehive Gateway v4.0) with ESMTP ; Mon, 04 Mar 2019 20:15:41 -0800 Subject: Re: [PATCH v4] mm/hugetlb: Fix unsigned overflow in __nr_hugepages_store_common() To: Naoya Horiguchi , Andrew Morton , Oscar Salvador Cc: David Rientjes , Jing Xiangfeng , "mhocko@kernel.org" , "hughd@google.com" , "linux-mm@kvack.org" , Andrea Arcangeli , "kirill.shutemov@linux.intel.com" , linux-kernel@vger.kernel.org, Alexandre Ghiti References: <388cbbf5-7086-1d04-4c49-049021504b9d@oracle.com> <8c167be7-06fa-a8c0-8ee7-0bfad41eaba2@oracle.com> <13400ee2-3d3b-e5d6-2d78-a770820417de@oracle.com> <5C74A2DA.1030304@huawei.com> <20190226143620.c6af15c7c897d3362b191e36@linux-foundation.org> <086c4a4b-a37d-f144-00c0-d9a4062cc5fe@oracle.com> <20190305000402.GA4698@hori.linux.bs1.fc.nec.co.jp> From: Mike Kravetz Message-ID: <8f3aede3-c07e-ac15-1577-7667e5b70d2f@oracle.com> Date: Mon, 4 Mar 2019 20:15:40 -0800 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.4.0 MIME-Version: 1.0 In-Reply-To: <20190305000402.GA4698@hori.linux.bs1.fc.nec.co.jp> Content-Type: text/plain; charset=iso-2022-jp Content-Language: en-US Content-Transfer-Encoding: 7bit X-Proofpoint-Virus-Version: vendor=nai engine=5900 definitions=9185 signatures=668685 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 priorityscore=1501 malwarescore=0 suspectscore=2 phishscore=0 bulkscore=0 spamscore=0 clxscore=1015 lowpriorityscore=0 mlxscore=0 impostorscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1810050000 definitions=main-1903050029 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 3/4/19 4:03 PM, Naoya Horiguchi wrote: > On Tue, Feb 26, 2019 at 04:03:23PM -0800, Mike Kravetz wrote: >> On 2/26/19 2:36 PM, Andrew Morton wrote: > ... >>>> >>>> + } else { >>>> /* >>>> - * per node hstate attribute: adjust count to global, >>>> - * but restrict alloc/free to the specified node. >>>> + * Node specific request, but we could not allocate >>>> + * node mask. Pass in ALL nodes, and clear nid. >>>> */ >>> >>> Ditto here, somewhat. > > # I missed this part when reviewing yesterday for some reason, sorry. > >> >> I was just going to update the comments and send you a new patch, but >> but your comment got me thinking about this situation. I did not really >> change the way this code operates. As a reminder, the original code is like: >> >> NODEMASK_ALLOC(nodemask_t, nodes_allowed, GFP_KERNEL | __GFP_NORETRY); >> >> if (nid == NUMA_NO_NODE) { >> /* do something */ >> } else if (nodes_allowed) { >> /* do something else */ >> } else { >> nodes_allowed = &node_states[N_MEMORY]; >> } >> >> So, the only way we get to that final else if if we can not allocate >> a node mask (kmalloc a few words). Right? I wonder why we should >> even try to continue in this case. Why not just return right there? > > Simply returning on allocation failure looks better to me. > As you mentioned below, current behavior for this 'else' case is not > helpful for anyone. Thanks Naoya. And, thank you Oscar for your suggestion. I think the simplest thing to do would be simply return in this case. In practice, we will likely never hit the condition. If we do, the system is really low on memory and there will be other more important issues. The revised patch below updates comments as suggested, and returns -ENOMEM if we can not allocate a node mask. Andrew, this is on top of Alexandre Ghiti's "hugetlb: allow to free gigantic pages regardless of the configuration" patch. Both patches modify __nr_hugepages_store_common(). Alex's patch is going to change slightly in this area. Let me know if there is something I can do to help make merging easier. From: Mike Kravetz Date: Mon, 4 Mar 2019 17:45:11 -0800 Subject: [PATCH] hugetlbfs: fix potential over/underflow setting node specific nr_hugepages The number of node specific huge pages can be set via a file such as: /sys/devices/system/node/node1/hugepages/hugepages-2048kB/nr_hugepages When a node specific value is specified, the global number of huge pages must also be adjusted. This adjustment is calculated as the specified node specific value + (global value - current node value). If the node specific value provided by the user is large enough, this calculation could overflow an unsigned long leading to a smaller than expected number of huge pages. To fix, check the calculation for overflow. If overflow is detected, use ULONG_MAX as the requested value. This is inline with the user request to allocate as many huge pages as possible. It was also noticed that the above calculation was done outside the hugetlb_lock. Therefore, the values could be inconsistent and result in underflow. To fix, the calculation is moved within the routine set_max_huge_pages() where the lock is held. In addition, the code in __nr_hugepages_store_common() which tries to handle the case of not being able to allocate a node mask would likely result in incorrect behavior. Luckily, it is very unlikely we will ever take this path. If we do, simply return ENOMEM. Reported-by: Jing Xiangfeng Signed-off-by: Mike Kravetz --- mm/hugetlb.c | 42 +++++++++++++++++++++++++++++++++--------- 1 file changed, 33 insertions(+), 9 deletions(-) diff --git a/mm/hugetlb.c b/mm/hugetlb.c index c5c4558e4a79..5a190a652cac 100644 --- a/mm/hugetlb.c +++ b/mm/hugetlb.c @@ -2274,7 +2274,7 @@ static int adjust_pool_surplus(struct hstate *h, nodemask_t *nodes_allowed, } #define persistent_huge_pages(h) (h->nr_huge_pages - h->surplus_huge_pages) -static int set_max_huge_pages(struct hstate *h, unsigned long count, +static int set_max_huge_pages(struct hstate *h, unsigned long count, int nid, nodemask_t *nodes_allowed) { unsigned long min_count, ret; @@ -2289,6 +2289,28 @@ static int set_max_huge_pages(struct hstate *h, unsigned long count, goto decrease_pool; } + spin_lock(&hugetlb_lock); + + /* + * Check for a node specific request. + * Changing node specific huge page count may require a corresponding + * change to the global count. In any case, the passed node mask + * (nodes_allowed) will restrict alloc/free to the specified node. + */ + if (nid != NUMA_NO_NODE) { + unsigned long old_count = count; + + count += h->nr_huge_pages - h->nr_huge_pages_node[nid]; + /* + * User may have specified a large count value which caused the + * above calculation to overflow. In this case, they wanted + * to allocate as many huge pages as possible. Set count to + * largest possible value to align with their intention. + */ + if (count < old_count) + count = ULONG_MAX; + } + /* * Increase the pool size * First take pages out of surplus state. Then make up the @@ -2300,7 +2322,6 @@ static int set_max_huge_pages(struct hstate *h, unsigned long count, * pool might be one hugepage larger than it needs to be, but * within all the constraints specified by the sysctls. */ - spin_lock(&hugetlb_lock); while (h->surplus_huge_pages && count > persistent_huge_pages(h)) { if (!adjust_pool_surplus(h, nodes_allowed, -1)) break; @@ -2421,16 +2442,19 @@ static ssize_t __nr_hugepages_store_common(bool obey_mempolicy, nodes_allowed = &node_states[N_MEMORY]; } } else if (nodes_allowed) { + /* Node specific request */ + init_nodemask_of_node(nodes_allowed, nid); + } else { /* - * per node hstate attribute: adjust count to global, - * but restrict alloc/free to the specified node. + * Node specific request, but we could not allocate the few + * words required for a node mask. We are unlikely to hit + * this condition. Since we can not pass down the appropriate + * node mask, just return ENOMEM. */ - count += h->nr_huge_pages - h->nr_huge_pages_node[nid]; - init_nodemask_of_node(nodes_allowed, nid); - } else - nodes_allowed = &node_states[N_MEMORY]; + return -ENOMEM; + } - err = set_max_huge_pages(h, count, nodes_allowed); + err = set_max_huge_pages(h, count, nid, nodes_allowed); if (err) goto out; -- 2.17.2