Received: by 10.223.176.5 with SMTP id f5csp2044789wra; Wed, 31 Jan 2018 15:52:08 -0800 (PST) X-Google-Smtp-Source: AH8x226RLyPTThmzix0HjbL/0sEGnD5PiKnFOcdj0Ikk2B/OlUC5uDJJuklys6KXNrXrv5Z+1bMU X-Received: by 10.99.63.201 with SMTP id m192mr26616433pga.358.1517442728491; Wed, 31 Jan 2018 15:52:08 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1517442728; cv=none; d=google.com; s=arc-20160816; b=d/NSaEdrnSQMeidgG2LomI9rLuOAQkoW3wtWOtjWfIDQ9sSd4Yufza3N9Mj/bNvziW Jh2z+wf4Mg71w2QqXW3nlSKIIcc0LhfzaOcNT0pcaPIx14JFFh5X1Gt8J9kJsYppOEKZ sNNaj7hR7nByjCtbgmzgnqxOitQJfLw1UOd1rM2U/MMkNe7GJwjmfRY477nt9Fru5640 dEm+cgDwe/Elw6It0akCHL3TEh8h3bHLGmDvGuuwFKI1s88kk3xcHMfNmnELuHUFRZd6 CDWlqJQJv/sYO4N0usHDhFDf7nUReTmOPJYuWPkAz3gOJ3REkF3MsEMt8yGfC0xt7XGu iU5A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:references:in-reply-to:message-id:date :subject:cc:to:from:dkim-signature:arc-authentication-results; bh=ACergrKDlGTBErxlju2Ng8Ife2WMlxrmFpLFDH1ABgc=; b=zLyqbv+CYX5hDVZcXUV195/cS3jFfeQRJ2i3pphcPndyY0A2ua72D9HT4Qy1Tep6VN ZmR+xCOh52sbN9SSIvSHD1XAzuzdkFOfeuiKpewuklPVi+m0R87N8riVAmMlmevmCwvs Jpv1RaHWHjFz3tPaZMQCX9IIt2l2l5XBC4WjgrsV5TVeZPZeMd8adkrJR3Osor894oVv c2hYIz306d7mZ1B11ikxofWpxbFCb693d+dgMfF17p4q9qL8Yg1ErLsZ40QGOW2P2xcE rb8+0EAhyxIU/v8v7GDnQ+hS5BCRd+RCc5U9rK8u0b+Ti4QEMVfgDuiI3MgI3dKsJPcn ZIpg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@oracle.com header.s=corp-2017-10-26 header.b=QiA6rK4Y; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=oracle.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id h15-v6si671241plk.480.2018.01.31.15.51.53; Wed, 31 Jan 2018 15:52:08 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@oracle.com header.s=corp-2017-10-26 header.b=QiA6rK4Y; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=oracle.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1755851AbeAaXNS (ORCPT + 99 others); Wed, 31 Jan 2018 18:13:18 -0500 Received: from userp2130.oracle.com ([156.151.31.86]:45838 "EHLO userp2130.oracle.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1754524AbeAaXFN (ORCPT ); Wed, 31 Jan 2018 18:05:13 -0500 Received: from pps.filterd (userp2130.oracle.com [127.0.0.1]) by userp2130.oracle.com (8.16.0.22/8.16.0.22) with SMTP id w0VMpiIx145392; Wed, 31 Jan 2018 23:04:32 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h=from : to : cc : subject : date : message-id : in-reply-to : references; s=corp-2017-10-26; bh=ACergrKDlGTBErxlju2Ng8Ife2WMlxrmFpLFDH1ABgc=; b=QiA6rK4YhW8fC+pRSxdKuLkeJU1K27whhj2mWKZEl8UuFm7P/xorzctTGM1euslGxLwK y+6YA3f/sKkkYDMSFy8QOdRI5tfUoulJtT/XLMmx2ZIzFypghu9PIlrL+WeUP9bkBmwl igy2vJ0+ql40RWD899DL5CRg9xmyCiCrDoZ+VxcOboaclhh4+sNL/CuRNVX7odQzokZ9 WlnexhTMARyzU0g7Wkg+t8Nj0SNuVmbT9MyMhRHjC7A1EG+vEJM+Oz+YuGbUP/7JHlJb g9Dmej0LTDcIFNiixUn6oyONcSfG7ilMXZznSpPXZQCCVzamI5JZsokKU6UD6hMtmCVA xQ== Received: from aserv0021.oracle.com (aserv0021.oracle.com [141.146.126.233]) by userp2130.oracle.com with ESMTP id 2fujpm98tf-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Wed, 31 Jan 2018 23:04:32 +0000 Received: from aserv0122.oracle.com (aserv0122.oracle.com [141.146.126.236]) by aserv0021.oracle.com (8.14.4/8.14.4) with ESMTP id w0VN4VGf023047 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Wed, 31 Jan 2018 23:04:31 GMT Received: from abhmp0010.oracle.com (abhmp0010.oracle.com [141.146.116.16]) by aserv0122.oracle.com (8.14.4/8.14.4) with ESMTP id w0VN4UVW022142; Wed, 31 Jan 2018 23:04:30 GMT Received: from parnassus.us.oracle.com (/10.39.213.30) by default (Oracle Beehive Gateway v4.0) with ESMTP ; Wed, 31 Jan 2018 15:04:30 -0800 From: daniel.m.jordan@oracle.com To: linux-mm@kvack.org, linux-kernel@vger.kernel.org Cc: aaron.lu@intel.com, ak@linux.intel.com, akpm@linux-foundation.org, Dave.Dice@oracle.com, dave@stgolabs.net, khandual@linux.vnet.ibm.com, ldufour@linux.vnet.ibm.com, mgorman@suse.de, mhocko@kernel.org, pasha.tatashin@oracle.com, steven.sistare@oracle.com, yossi.lev@oracle.com Subject: [RFC PATCH v1 08/13] mm: temporarily convert lru_lock callsites to lock-all API Date: Wed, 31 Jan 2018 18:04:08 -0500 Message-Id: <20180131230413.27653-9-daniel.m.jordan@oracle.com> X-Mailer: git-send-email 2.16.1 In-Reply-To: <20180131230413.27653-1-daniel.m.jordan@oracle.com> References: <20180131230413.27653-1-daniel.m.jordan@oracle.com> X-Proofpoint-Virus-Version: vendor=nai engine=5900 definitions=8791 signatures=668659 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 suspectscore=2 malwarescore=0 phishscore=0 bulkscore=0 spamscore=0 mlxscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1711220000 definitions=main-1801310283 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org These will use the lru_batch_locks in a later series. Signed-off-by: Daniel Jordan --- mm/swap.c | 18 ++++++++---------- mm/vmscan.c | 4 ++-- 2 files changed, 10 insertions(+), 12 deletions(-) diff --git a/mm/swap.c b/mm/swap.c index c4ca7e1c7c03..cf6a59f2cad6 100644 --- a/mm/swap.c +++ b/mm/swap.c @@ -62,12 +62,12 @@ static void __page_cache_release(struct page *page) struct lruvec *lruvec; unsigned long flags; - spin_lock_irqsave(zone_lru_lock(zone), flags); + lru_lock_all(zone->zone_pgdat, &flags); lruvec = mem_cgroup_page_lruvec(page, zone->zone_pgdat); VM_BUG_ON_PAGE(!PageLRU(page), page); __ClearPageLRU(page); del_page_from_lru_list(page, lruvec, page_off_lru(page)); - spin_unlock_irqrestore(zone_lru_lock(zone), flags); + lru_unlock_all(zone->zone_pgdat, &flags); } __ClearPageWaiters(page); mem_cgroup_uncharge(page); @@ -758,7 +758,7 @@ void release_pages(struct page **pages, int nr) * same pgdat. The lock is held only if pgdat != NULL. */ if (locked_pgdat && ++lock_batch == SWAP_CLUSTER_MAX) { - spin_unlock_irqrestore(&locked_pgdat->lru_lock, flags); + lru_unlock_all(locked_pgdat, &flags); locked_pgdat = NULL; } @@ -768,8 +768,7 @@ void release_pages(struct page **pages, int nr) /* Device public page can not be huge page */ if (is_device_public_page(page)) { if (locked_pgdat) { - spin_unlock_irqrestore(&locked_pgdat->lru_lock, - flags); + lru_unlock_all(locked_pgdat, &flags); locked_pgdat = NULL; } put_zone_device_private_or_public_page(page); @@ -782,7 +781,7 @@ void release_pages(struct page **pages, int nr) if (PageCompound(page)) { if (locked_pgdat) { - spin_unlock_irqrestore(&locked_pgdat->lru_lock, flags); + lru_unlock_all(locked_pgdat, &flags); locked_pgdat = NULL; } __put_compound_page(page); @@ -794,11 +793,10 @@ void release_pages(struct page **pages, int nr) if (pgdat != locked_pgdat) { if (locked_pgdat) - spin_unlock_irqrestore(&locked_pgdat->lru_lock, - flags); + lru_unlock_all(locked_pgdat, &flags); lock_batch = 0; locked_pgdat = pgdat; - spin_lock_irqsave(&locked_pgdat->lru_lock, flags); + lru_lock_all(locked_pgdat, &flags); } lruvec = mem_cgroup_page_lruvec(page, locked_pgdat); @@ -814,7 +812,7 @@ void release_pages(struct page **pages, int nr) list_add(&page->lru, &pages_to_free); } if (locked_pgdat) - spin_unlock_irqrestore(&locked_pgdat->lru_lock, flags); + lru_unlock_all(locked_pgdat, &flags); mem_cgroup_uncharge_list(&pages_to_free); free_unref_page_list(&pages_to_free); diff --git a/mm/vmscan.c b/mm/vmscan.c index b893200a397d..7f5ff0bb133f 100644 --- a/mm/vmscan.c +++ b/mm/vmscan.c @@ -1623,7 +1623,7 @@ int isolate_lru_page(struct page *page) struct zone *zone = page_zone(page); struct lruvec *lruvec; - spin_lock_irq(zone_lru_lock(zone)); + lru_lock_all(zone->zone_pgdat, NULL); lruvec = mem_cgroup_page_lruvec(page, zone->zone_pgdat); if (PageLRU(page)) { int lru = page_lru(page); @@ -1632,7 +1632,7 @@ int isolate_lru_page(struct page *page) del_page_from_lru_list(page, lruvec, lru); ret = 0; } - spin_unlock_irq(zone_lru_lock(zone)); + lru_unlock_all(zone->zone_pgdat, NULL); } return ret; } -- 2.16.1