Received: by 2002:ac0:aa62:0:0:0:0:0 with SMTP id w31-v6csp2315645ima; Mon, 22 Oct 2018 07:51:10 -0700 (PDT) X-Google-Smtp-Source: ACcGV61ucH0RsJN/DFPXABPmdc6JTGJ6tUfcDaISLlH+2612izMP9kzXZbmxDe6dzvgYKQZJGLbF X-Received: by 2002:a62:6f43:: with SMTP id k64-v6mr44494635pfc.87.1540219870403; Mon, 22 Oct 2018 07:51:10 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1540219870; cv=none; d=google.com; s=arc-20160816; b=ljv5tbl8LHavJQHl5Naiu3QLS7kEhgdUjnw+Ky5H2Nl2mcVU54kOrbxnbjxn5HtIn4 jlGPuNb9O1bnMk8fTiO5q0XfWI9gRoR8PzlO1VLos10KDJKSbNqKrPDMw2SRQXF6o7O1 DN9mzwDeIEGC7rOxy6A5drnP3PoeEZT3LHILsTuA6VNWTI0Up5FngWFcQzcrA5NP0hpF hQr84IwSSL/6Ap7HsabjnT6WFEnTSpJMYSn3XoUrbH3OgJ0K7OLwoAnKM+Ow/5NmEtp6 ljHUFtCUu/DDNySh1Lml9v2jWG7nLJuGw/XCtrewVG+kDhJ7s6MqgCtBXWoDqQkUrEkh OYVw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-disposition:mime-version:references:message-id:subject:cc :to:date:from:dkim-signature; bh=UhkGHSoVnp7RarPQBnZ0k0r3I18r5NVenEUHB5tvd98=; b=Un/Hh6ktUOB0y9PSoMMmhelHYmAZ+zfSRTh2N8kxCNZ0/+0NGdWBtYTYqpTirT8J03 y1v9yhjxBpauM6X9JTiVhiC9w5FTDvMzJlikBSWrRYWk4bVUNoPCMC8QwGBiokWPRpz5 WGHokSSPWQPX6MeeR2MYwN1tItchekfBnpnwNxuChRUzXEZvFx/ygj0XCo2o/5FJBGuj RkdVRnnxfBt0DCsFTf4uuohVbx9pvjikVNXCrHkavN3P/jdRX51JPVZDpQIR41FuhWWF 6FFf77bMKY2gEwQgQbihpe18FYjHltOT3WLZYDw1jgIEUadN5CdN9yfeAJ92yzqcsMKY 56wA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b="g17fV/JW"; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id 31-v6si61641pli.294.2018.10.22.07.50.55; Mon, 22 Oct 2018 07:51:10 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b="g17fV/JW"; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728360AbeJVWUC (ORCPT + 99 others); Mon, 22 Oct 2018 18:20:02 -0400 Received: from mail-lf1-f67.google.com ([209.85.167.67]:41611 "EHLO mail-lf1-f67.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727210AbeJVWUC (ORCPT ); Mon, 22 Oct 2018 18:20:02 -0400 Received: by mail-lf1-f67.google.com with SMTP id q39-v6so30445848lfi.8 for ; Mon, 22 Oct 2018 07:01:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:date:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=UhkGHSoVnp7RarPQBnZ0k0r3I18r5NVenEUHB5tvd98=; b=g17fV/JWRCv7GSRokczJfa1xMGvqzwjdTS3ypcnyyFfrNu+f701B7Jk3HDtOAW686n NDeKmOxjJq4RPviibap+gSyMVmQZifn5zJpgh3Bp7Xdl80VkddV9Q0XYvFuIsQgT0ur9 NVNQhCJuXJNaYNLJOcRURzTlJZgS+eNFwXAkSID7+jrE5O7ddKLjf5SgOn2S+ngQkw6g br7jn/vW9ryey07fpIFyve5f8FHWjaUUuTfZYewHbvPQPFikbi8D9dia5yo35bDDJXug hzkFFKL1GlhZdGhSgW3jHVRZtQvGnW3ZXPE53noKrvdeVeMkDRxp5r6Uj6ZyCxy1FDdg SHpA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:date:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to:user-agent; bh=UhkGHSoVnp7RarPQBnZ0k0r3I18r5NVenEUHB5tvd98=; b=rDeiM8fkjSXmzpi8Egxo/UXiMfRB9BQ5r5x4xPkjkdHUQPfE1nZ0kRNC58YxPMBcd3 mdN0HDKtmhEZKYpVu/RnZRd9hk1UvPJE5Lew01rzRwSGtlyCzqXC/q+6TJf5HVPGA364 IeyWkJJD+IXqvhYxyAMebv+QxfEZFNnSScHQ1M7rPDVIAZmVX8GppQyYt7YkhNpCi6Vm /c0hFSp6aAGBYWEoFW0GTqPDamare3UO7lYj1BEluwTnG1NPm7FB/NP1qmMeHX4qJWiR epFk4rFdsDHdgoKJAOX4mj1cN+QlFUqn5sb1Mnz5EQZ1EfEdQWq3/f1lUoLzjhpIx3EF 0V/A== X-Gm-Message-State: ABuFfog9RN3n+kHV+a72MkATuG93tMYU7hd9SvavCCtvQvtyY+dMwrGD ozqmlX7RzrZRizynMwzYDKM= X-Received: by 2002:a19:2a4b:: with SMTP id f72mr7620122lfl.139.1540216877570; Mon, 22 Oct 2018 07:01:17 -0700 (PDT) Received: from pc636 ([37.139.158.167]) by smtp.gmail.com with ESMTPSA id h21-v6sm1958498lfh.38.2018.10.22.07.01.15 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Mon, 22 Oct 2018 07:01:16 -0700 (PDT) From: Uladzislau Rezki X-Google-Original-From: Uladzislau Rezki Date: Mon, 22 Oct 2018 16:01:08 +0200 To: Roman Gushchin Cc: "Uladzislau Rezki (Sony)" , Matthew Wilcox , Andrew Morton , "linux-mm@kvack.org" , LKML , Michal Hocko , Thomas Garnier , Oleksiy Avramchenko , Steven Rostedt , Joel Fernandes , Thomas Gleixner , Ingo Molnar , Tejun Heo Subject: Re: [RFC PATCH 0/2] improve vmalloc allocation Message-ID: <20181022140108.jwahqbudbn4xiw43@pc636> References: <20181019173538.590-1-urezki@gmail.com> <20181019224432.GA616@tower.DHCP.thefacebook.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20181019224432.GA616@tower.DHCP.thefacebook.com> User-Agent: NeoMutt/20170113 (1.7.2) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Fri, Oct 19, 2018 at 10:44:39PM +0000, Roman Gushchin wrote: > On Fri, Oct 19, 2018 at 07:35:36PM +0200, Uladzislau Rezki (Sony) wrote: > > Objective > > --------- > > Initiative of improving vmalloc allocator comes from getting many issues > > related to allocation time, i.e. sometimes it is terribly slow. As a result > > many workloads which are sensitive for long (more than 1 millisecond) preemption > > off scenario are affected by that slowness(test cases like UI or audio, etc.). > > > > The problem is that, currently an allocation of the new VA area is done over > > busy list iteration until a suitable hole is found between two busy areas. > > Therefore each new allocation causes the list being grown. Due to long list > > and different permissive parameters an allocation can take a long time on > > embedded devices(milliseconds). > ... > > 3) This one is related to PCPU allocator(see pcpu_alloc_test()). In that > > stress test case i see that SUnreclaim(/proc/meminfo) parameter gets increased, > > i.e. there is a memory leek somewhere in percpu allocator. It sounds like > > a memory that is allocated by pcpu_get_vm_areas() sometimes is not freed. > > Resulting in memory leaking or "Kernel panic": > > > > Can you, please, try the following patch: > 6685b357363b ("percpu: stop leaking bitmap metadata blocks") ? > I have tested that patch. It fixes the leak for sure. Thank you for a good point. > > BTW, with growing number of vmalloc users (per-cpu allocator and bpf stuff are > big drivers), I find the patchset very interesting. > > Thanks! Thank you! -- Vlad Rezki