Received: by 2002:a25:4158:0:0:0:0:0 with SMTP id o85csp4635368yba; Wed, 17 Apr 2019 16:05:05 -0700 (PDT) X-Google-Smtp-Source: APXvYqy25zO+o0XnO91vDTTEENPdvMUVcYbVSvjjSclfBh0LJUwhWtmCBYIpLPZaCa2Bfq9z+/kY X-Received: by 2002:aa7:920b:: with SMTP id 11mr92345930pfo.3.1555542305906; Wed, 17 Apr 2019 16:05:05 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1555542305; cv=none; d=google.com; s=arc-20160816; b=xVY2D2xIbLGMkPSpALkl/ty4rFn6eg2JJ1pmJnoyXmwI6yjn8bdX5FdcHkc39NGB6V q7nYeeZmnrK1etPuPOfx/2ObY3RpUJm+rUtlj2NkQUn+nBAVHm3TSvsFgDpbR1+Y2TxS qikc5qOGnckt2VVob5bvqRbxly/tMvAWwM+z/bb/l9KSl+dNni7mQfk6+TkbMvIPQ9qO HX7v7vAjhXGTQScdA+fCtAn5PcpC3XPt/2hpVKV3jxK56OAzP0qgnej62NlA4GtVxo8C oRl0pYfE6cd/lVIPQYYsLynCbmpmvSICj7W9P0w0aA06PVU2xz1rUz0cfTDYl4YFdK1A hrQw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:mime-version:content-transfer-encoding :content-id:content-language:accept-language:in-reply-to:references :message-id:date:thread-index:thread-topic:subject:cc:to:from :dkim-signature:dkim-signature; bh=SEEpP0WYkh4k0MJtvadNPgeueJmDQbdqvnqLPlyDGFU=; b=HFn64pzH/bhqlKgR/MyrIb/TWVAVZsLqw/kjd48rfRH6j/5PNx/CG0nFG4EmR2Oz30 gfJ5OocEIct8wSD/YZmw+fKl0Bfx/iz5XttjDd0LLlEddUGGs9//H26FsjB0nIA032mn LvqUpHBZDGVt9GB0HvDCZc52A9q2mC/ZDkYhqO2BGx4IVSuIZtRZP8bTQWy8VxhCja3x eplWQwSmfgCzBJfthHF6mN7TNifkRKkZVRFpG0J9ih1ZrP6LxfIpto3Kza0GWDbxNVIM E65XFAZO38X4hQOsxwPGf0SWxMNPi4JSzxfuy6v215u/cSe78GMq0HstgyCuPZgeqCEu hQgQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@fb.com header.s=facebook header.b=PpC6OFyQ; dkim=pass header.i=@fb.onmicrosoft.com header.s=selector1-fb-com header.b=jQ1wEpk5; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=fb.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id n1si263638pld.280.2019.04.17.16.04.50; Wed, 17 Apr 2019 16:05:05 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@fb.com header.s=facebook header.b=PpC6OFyQ; dkim=pass header.i=@fb.onmicrosoft.com header.s=selector1-fb-com header.b=jQ1wEpk5; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=fb.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S2387704AbfDQXDJ (ORCPT + 99 others); Wed, 17 Apr 2019 19:03:09 -0400 Received: from mx0b-00082601.pphosted.com ([67.231.153.30]:52334 "EHLO mx0b-00082601.pphosted.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1729079AbfDQXDI (ORCPT ); Wed, 17 Apr 2019 19:03:08 -0400 Received: from pps.filterd (m0109331.ppops.net [127.0.0.1]) by mx0a-00082601.pphosted.com (8.16.0.27/8.16.0.27) with SMTP id x3HN2pbu019237; Wed, 17 Apr 2019 16:02:52 -0700 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=fb.com; h=from : to : cc : subject : date : message-id : references : in-reply-to : content-type : content-id : content-transfer-encoding : mime-version; s=facebook; bh=SEEpP0WYkh4k0MJtvadNPgeueJmDQbdqvnqLPlyDGFU=; b=PpC6OFyQiBX9sljmGjjzIUOq0UfpSVKwjkoWC9n+bmJMPQRuQ8++UbQ5+vvpEfJCcdsx c6ZquAPFfwWx3pnuc2VUWq97Fu4TxnnwyE68wb8rUnAGS3ZTcRNdGAROKk3CRBeAxA/h VIo5oTwQNkQbiy9uctB3YoHNzsOpJUdgNAk= Received: from mail.thefacebook.com (mailout.thefacebook.com [199.201.64.23]) by mx0a-00082601.pphosted.com with ESMTP id 2rx7w1h8s6-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-SHA384 bits=256 verify=NOT); Wed, 17 Apr 2019 16:02:52 -0700 Received: from prn-hub03.TheFacebook.com (2620:10d:c081:35::127) by prn-hub06.TheFacebook.com (2620:10d:c081:35::130) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.1.1713.5; Wed, 17 Apr 2019 16:02:47 -0700 Received: from NAM05-CO1-obe.outbound.protection.outlook.com (192.168.54.28) by o365-in.thefacebook.com (192.168.16.27) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.1.1713.5 via Frontend Transport; Wed, 17 Apr 2019 16:02:47 -0700 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=fb.onmicrosoft.com; s=selector1-fb-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=SEEpP0WYkh4k0MJtvadNPgeueJmDQbdqvnqLPlyDGFU=; b=jQ1wEpk5xsG3yV5Bm/6oGqTSl2QT0MFXX20QZuAWMj8DuPVp9Z97rgBMhaR//ZbW0PLJcX5fD5/PZF3v0vIlTzbfwM2nes539PW3xCxWTIQaFPhDSWrXdtTNcKZgIlyiHidibbqr84YRl6PcdV+QtZwfK73/egolH/czk6nqx/g= Received: from BYAPR15MB2631.namprd15.prod.outlook.com (20.179.156.24) by BYAPR15MB3190.namprd15.prod.outlook.com (20.179.56.92) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1813.11; Wed, 17 Apr 2019 23:02:25 +0000 Received: from BYAPR15MB2631.namprd15.prod.outlook.com ([fe80::d1a1:d74:852:a21e]) by BYAPR15MB2631.namprd15.prod.outlook.com ([fe80::d1a1:d74:852:a21e%5]) with mapi id 15.20.1792.021; Wed, 17 Apr 2019 23:02:25 +0000 From: Roman Gushchin To: Andrew Morton CC: Roman Gushchin , "linux-mm@kvack.org" , "linux-kernel@vger.kernel.org" , Kernel Team , "Matthew Wilcox" , Johannes Weiner , "Vlastimil Babka" Subject: Re: [PATCH v4 1/2] mm: refactor __vunmap() to avoid duplicated call to find_vm_area() Thread-Topic: [PATCH v4 1/2] mm: refactor __vunmap() to avoid duplicated call to find_vm_area() Thread-Index: AQHU9VVf0J9odzgRMk2KdtJT9GHQdKZA5rSAgAAR2wA= Date: Wed, 17 Apr 2019 23:02:25 +0000 Message-ID: <20190417230219.GA5538@tower.DHCP.thefacebook.com> References: <20190417194002.12369-1-guro@fb.com> <20190417194002.12369-2-guro@fb.com> <20190417145827.8b1c83bf22de8ba514f157e3@linux-foundation.org> In-Reply-To: <20190417145827.8b1c83bf22de8ba514f157e3@linux-foundation.org> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-clientproxiedby: MWHPR12CA0031.namprd12.prod.outlook.com (2603:10b6:301:2::17) To BYAPR15MB2631.namprd15.prod.outlook.com (2603:10b6:a03:152::24) x-ms-exchange-messagesentrepresentingtype: 1 x-originating-ip: [2620:10d:c090:200::1:7270] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 356c02f2-6f66-4a70-7791-08d6c388c1b1 x-microsoft-antispam: BCL:0;PCL:0;RULEID:(2390118)(7020095)(4652040)(8989299)(5600141)(711020)(4605104)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(2017052603328)(7193020);SRVR:BYAPR15MB3190; x-ms-traffictypediagnostic: BYAPR15MB3190: x-microsoft-antispam-prvs: x-forefront-prvs: 0010D93EFE x-forefront-antispam-report: SFV:NSPM;SFS:(10019020)(376002)(346002)(396003)(136003)(39860400002)(366004)(199004)(189003)(25786009)(6916009)(71190400001)(71200400001)(476003)(6486002)(5660300002)(46003)(54906003)(11346002)(8676002)(486006)(97736004)(478600001)(86362001)(1076003)(6436002)(316002)(53546011)(6506007)(256004)(6512007)(6246003)(6116002)(14444005)(446003)(186003)(386003)(81156014)(81166006)(53936002)(8936002)(102836004)(7736002)(229853002)(4326008)(52116002)(2906002)(68736007)(33656002)(9686003)(76176011)(305945005)(99286004)(14454004)(37363001);DIR:OUT;SFP:1102;SCL:1;SRVR:BYAPR15MB3190;H:BYAPR15MB2631.namprd15.prod.outlook.com;FPR:;SPF:None;LANG:en;PTR:InfoNoRecords;A:1;MX:1; received-spf: None (protection.outlook.com: fb.com does not designate permitted sender hosts) x-ms-exchange-senderadcheck: 1 x-microsoft-antispam-message-info: M72ARGDIpm80FoZXz9ldgVyLzaT3sBSixZt4G4J7xGTf6Zc+oHddh56PLAwmYH4wA9ernKV6zwD9zknni5VWbYbghWGU9rowWyvWOChJZa9Pg3Y5GiohB3h1m+mjA5cngTfA+FY2ujsYiTuz76vGZHHEMTLpoEEjiSPSi0nfyoj4BSShbqPx4EiURnf/9Gi1yMe7CuhU8QJjVXNFemly/Et68nZ893/wiPSlf5P368RyssoO6DzNJHv/1Z7HjzNcebwZ8VN6h5hCSwuAsdr9nLlymH8vsytYPq4TxHJ1vXRbexp80e6gZ2L81CGHNEwtOh6JTqLRMm79ztisenn7qZbVD59yVeGisTh7imw9PdBnKKwuV/DEUuDtghPfJDUSku+VTSTyjWSVDZFuJmRZbPELEkz24TfhFOsvQTxbk0M= Content-Type: text/plain; charset="us-ascii" Content-ID: <2B6F40F0B437D94AA8B7732ED7F6698B@namprd15.prod.outlook.com> Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-CrossTenant-Network-Message-Id: 356c02f2-6f66-4a70-7791-08d6c388c1b1 X-MS-Exchange-CrossTenant-originalarrivaltime: 17 Apr 2019 23:02:25.5428 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 8ae927fe-1255-47a7-a2af-5f3a069daaa2 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-Transport-CrossTenantHeadersStamped: BYAPR15MB3190 X-OriginatorOrg: fb.com X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:,, definitions=2019-04-17_11:,, signatures=0 X-Proofpoint-Spam-Reason: safe X-FB-Internal: Safe Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Wed, Apr 17, 2019 at 02:58:27PM -0700, Andrew Morton wrote: > On Wed, 17 Apr 2019 12:40:01 -0700 Roman Gushchin wrot= e: >=20 > > __vunmap() calls find_vm_area() twice without an obvious reason: > > first directly to get the area pointer, second indirectly by calling > > remove_vm_area(), which is again searching for the area. > >=20 > > To remove this redundancy, let's split remove_vm_area() into > > __remove_vm_area(struct vmap_area *), which performs the actual area > > removal, and remove_vm_area(const void *addr) wrapper, which can > > be used everywhere, where it has been used before. > >=20 > > On my test setup, I've got 5-10% speed up on vfree()'ing 1000000 > > of 4-pages vmalloc blocks. > >=20 > > Perf report before: > > 22.64% cat [kernel.vmlinux] [k] free_pcppages_bulk > > 10.30% cat [kernel.vmlinux] [k] __vunmap > > 9.80% cat [kernel.vmlinux] [k] find_vmap_area > > 8.11% cat [kernel.vmlinux] [k] vunmap_page_range > > 4.20% cat [kernel.vmlinux] [k] __slab_free > > 3.56% cat [kernel.vmlinux] [k] __list_del_entry_valid > > 3.46% cat [kernel.vmlinux] [k] smp_call_function_many > > 3.33% cat [kernel.vmlinux] [k] kfree > > 3.32% cat [kernel.vmlinux] [k] free_unref_page > >=20 > > Perf report after: > > 23.01% cat [kernel.kallsyms] [k] free_pcppages_bulk > > 9.46% cat [kernel.kallsyms] [k] __vunmap > > 9.15% cat [kernel.kallsyms] [k] vunmap_page_range > > 6.17% cat [kernel.kallsyms] [k] __slab_free > > 5.61% cat [kernel.kallsyms] [k] kfree > > 4.86% cat [kernel.kallsyms] [k] bad_range > > 4.67% cat [kernel.kallsyms] [k] free_unref_page_commit > > 4.24% cat [kernel.kallsyms] [k] __list_del_entry_valid > > 3.68% cat [kernel.kallsyms] [k] free_unref_page > > 3.65% cat [kernel.kallsyms] [k] __list_add_valid > > 3.19% cat [kernel.kallsyms] [k] __purge_vmap_area_lazy > > 3.10% cat [kernel.kallsyms] [k] find_vmap_area > > 3.05% cat [kernel.kallsyms] [k] rcu_cblist_dequeue > >=20 > > ... > > > > --- a/mm/vmalloc.c > > +++ b/mm/vmalloc.c > > @@ -2068,6 +2068,24 @@ struct vm_struct *find_vm_area(const void *addr) > > return NULL; > > } > > =20 > > +static struct vm_struct *__remove_vm_area(struct vmap_area *va) > > +{ > > + struct vm_struct *vm =3D va->vm; > > + > > + might_sleep(); >=20 > Where might __remove_vm_area() sleep? >=20 > From a quick scan I'm only seeing vfree(), and that has the > might_sleep_if(!in_interrupt()). >=20 > So perhaps we can remove this... Agree. Here is the patch. Thank you! -- From 4adf58e4d3ffe45a542156ca0bce3dc9f6679939 Mon Sep 17 00:00:00 2001 From: Roman Gushchin Date: Wed, 17 Apr 2019 15:55:49 -0700 Subject: [PATCH] mm: remove might_sleep() in __remove_vm_area() __remove_vm_area() has a redundant might_sleep() call, which isn't really required, because the only place it can sleep is vfree() and it already contains might_sleep_if(!in_interrupt()). Suggested-by: Andrew Morton Signed-off-by: Roman Gushchin --- mm/vmalloc.c | 2 -- 1 file changed, 2 deletions(-) diff --git a/mm/vmalloc.c b/mm/vmalloc.c index 69a5673c4cd3..4a91acce4b5f 100644 --- a/mm/vmalloc.c +++ b/mm/vmalloc.c @@ -2079,8 +2079,6 @@ static struct vm_struct *__remove_vm_area(struct vmap= _area *va) { struct vm_struct *vm =3D va->vm; =20 - might_sleep(); - spin_lock(&vmap_area_lock); va->vm =3D NULL; va->flags &=3D ~VM_VM_AREA; --=20 2.20.1