Received: by 2002:ac0:a5b6:0:0:0:0:0 with SMTP id m51-v6csp3688769imm; Mon, 18 Jun 2018 02:19:40 -0700 (PDT) X-Google-Smtp-Source: ADUXVKJkeGs3gves9GIpiXaoA33CZVPNOPFdTkqmnavSCX+cB26pRID8Og8A3anolt9J61axSlur X-Received: by 2002:a62:ea14:: with SMTP id t20-v6mr12739548pfh.117.1529313580444; Mon, 18 Jun 2018 02:19:40 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1529313580; cv=none; d=google.com; s=arc-20160816; b=0JoH4q08ZrDfLRcFh+cDkrj2d7HdW7LpPIgMISDJ5Jt+m1rDDHNvAHkrMvfHUGa0SR nbRVXpmgSPMiGQQUjibp8V99PDFypZ/1ZDKCuxezXsNz34LOk5IdJKy0hFB+IoYEdb5a v4njk5j0BvC+m/rgz1lGkMsxfdSxynx6KuOz/TYyV2vZFpdwj4kUwtUIkaVkGubx5Bo6 /wi+EKPODG3Nu1xvm3mRmza/4s7hw3SXF0Hh3Fhl7xVOlsK1/R3Ait4geYHfcinQg/8z EIKteN1eRP8UIpDNaMWEEqR8nD1H1lxRjGXvKtsaqkOlha1zTDvDfZ8pkm2PoYpmsrYA TP9w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:references:in-reply-to:message-id:date :subject:cc:to:from:arc-authentication-results; bh=hIelfCnl3m8PpTjNwhbmOkPdGqVAdkU75o5TEQ0MIm0=; b=wzsZsInp0jCatytmIzvN5eQg7uNkT5H5ujy3zUxDGEodwNX6Py5+zJhz4d71hJoYuQ QaTMdPThuObNbktVezMhVAXPldFq0ETn3hUhbYayrIchM9stsvShp1tq5tGdYTmKXwv/ liQbZAwKwmVa68TQNCDFKDU9SHZHS6+Jf+N0nEFocK7DPcHKXId4TdEq3Pp3MKtaoGqF zl61fOWED3qSh5gYMXK6cD1jXZphKoyzY8Rhq1otCfuhYvhWZOyauSHTSL6f/gq07OH/ Eqa7K9kpUOMiN4E+GtUJUgeNI5wDTd7Tp25SNIJt572Pm4SptxSs4O+3ucaD/JciER63 Fumw== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id e7-v6si11721458pgf.317.2018.06.18.02.19.24; Mon, 18 Jun 2018 02:19:40 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S966724AbeFRJSc (ORCPT + 99 others); Mon, 18 Jun 2018 05:18:32 -0400 Received: from mx2.suse.de ([195.135.220.15]:38509 "EHLO mx2.suse.de" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S934101AbeFRJS3 (ORCPT ); Mon, 18 Jun 2018 05:18:29 -0400 X-Virus-Scanned: by amavisd-new at test-mx.suse.de Received: from relay1.suse.de (charybdis-ext-too.suse.de [195.135.220.254]) by mx2.suse.de (Postfix) with ESMTP id CDE7CACA3; Mon, 18 Jun 2018 09:18:27 +0000 (UTC) From: Vlastimil Babka To: Andrew Morton Cc: linux-mm@kvack.org, linux-kernel@vger.kernel.org, Roman Gushchin , Michal Hocko , Johannes Weiner , linux-api@vger.kernel.org, Christoph Lameter , David Rientjes , Mel Gorman , Matthew Wilcox , Vlastimil Babka Subject: [PATCH v2 4/7] dcache: allocate external names from reclaimable kmalloc caches Date: Mon, 18 Jun 2018 11:18:05 +0200 Message-Id: <20180618091808.4419-5-vbabka@suse.cz> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20180618091808.4419-1-vbabka@suse.cz> References: <20180618091808.4419-1-vbabka@suse.cz> Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org We can use the newly introduced kmalloc-reclaimable-X caches, to allocate external names in dcache, which will take care of the proper accounting automatically, and also improve anti-fragmentation page grouping. This effectively reverts commit f1782c9bc547 ("dcache: account external names as indirectly reclaimable memory") and instead passes __GFP_RECLAIMABLE to kmalloc(). The accounting thus moves from NR_INDIRECTLY_RECLAIMABLE_BYTES to NR_SLAB_RECLAIMABLE, which is also considered in MemAvailable calculation and overcommit decisions. Signed-off-by: Vlastimil Babka --- fs/dcache.c | 38 +++++++++----------------------------- 1 file changed, 9 insertions(+), 29 deletions(-) diff --git a/fs/dcache.c b/fs/dcache.c index 0e8e5de3c48a..518c9ed8db8c 100644 --- a/fs/dcache.c +++ b/fs/dcache.c @@ -257,24 +257,10 @@ static void __d_free(struct rcu_head *head) kmem_cache_free(dentry_cache, dentry); } -static void __d_free_external_name(struct rcu_head *head) -{ - struct external_name *name = container_of(head, struct external_name, - u.head); - - mod_node_page_state(page_pgdat(virt_to_page(name)), - NR_INDIRECTLY_RECLAIMABLE_BYTES, - -ksize(name)); - - kfree(name); -} - static void __d_free_external(struct rcu_head *head) { struct dentry *dentry = container_of(head, struct dentry, d_u.d_rcu); - - __d_free_external_name(&external_name(dentry)->u.head); - + kfree(external_name(dentry)); kmem_cache_free(dentry_cache, dentry); } @@ -305,7 +291,7 @@ void release_dentry_name_snapshot(struct name_snapshot *name) struct external_name *p; p = container_of(name->name, struct external_name, name[0]); if (unlikely(atomic_dec_and_test(&p->u.count))) - call_rcu(&p->u.head, __d_free_external_name); + kfree_rcu(p, u.head); } } EXPORT_SYMBOL(release_dentry_name_snapshot); @@ -1608,7 +1594,6 @@ EXPORT_SYMBOL(d_invalidate); struct dentry *__d_alloc(struct super_block *sb, const struct qstr *name) { - struct external_name *ext = NULL; struct dentry *dentry; char *dname; int err; @@ -1629,14 +1614,15 @@ struct dentry *__d_alloc(struct super_block *sb, const struct qstr *name) dname = dentry->d_iname; } else if (name->len > DNAME_INLINE_LEN-1) { size_t size = offsetof(struct external_name, name[1]); - - ext = kmalloc(size + name->len, GFP_KERNEL_ACCOUNT); - if (!ext) { + struct external_name *p = kmalloc(size + name->len, + GFP_KERNEL_ACCOUNT | + __GFP_RECLAIMABLE); + if (!p) { kmem_cache_free(dentry_cache, dentry); return NULL; } - atomic_set(&ext->u.count, 1); - dname = ext->name; + atomic_set(&p->u.count, 1); + dname = p->name; } else { dname = dentry->d_iname; } @@ -1675,12 +1661,6 @@ struct dentry *__d_alloc(struct super_block *sb, const struct qstr *name) } } - if (unlikely(ext)) { - pg_data_t *pgdat = page_pgdat(virt_to_page(ext)); - mod_node_page_state(pgdat, NR_INDIRECTLY_RECLAIMABLE_BYTES, - ksize(ext)); - } - this_cpu_inc(nr_dentry); return dentry; @@ -2761,7 +2741,7 @@ static void copy_name(struct dentry *dentry, struct dentry *target) dentry->d_name.hash_len = target->d_name.hash_len; } if (old_name && likely(atomic_dec_and_test(&old_name->u.count))) - call_rcu(&old_name->u.head, __d_free_external_name); + kfree_rcu(old_name, u.head); } /* -- 2.17.1