Received: by 2002:a25:683:0:0:0:0:0 with SMTP id 125csp813017ybg; Tue, 9 Jun 2020 13:34:28 -0700 (PDT) X-Google-Smtp-Source: ABdhPJyk72PVtC+ybmUNgZWJdoxTFLhyB9jzdzVAfQ8clvzGIwENb6C2C1FA8pcKAf/ViKbwVqOa X-Received: by 2002:a17:906:5243:: with SMTP id y3mr169744ejm.193.1591734868487; Tue, 09 Jun 2020 13:34:28 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1591734868; cv=none; d=google.com; s=arc-20160816; b=qoKZI6jsiagYygLaPVVQ/RJzzCqbH0Toq4Q0XJ42C4y96hdR9BPazJCybAnLEYClC7 RlXKLe2LS3A7dij66lWpmq4NJZXUbPaSWAeqQ5oQek9IZpWBKpriy7DAHcI2Jvqt9S20 XvrhCWBd30hFVg59PgjaRi7z2pNHrkJRpom3KyEVPOoMsZOaRJiVFxxMDFqGaB6RaVMU L8go5+m1jqdp6a6NvPZkGWLffQw1MckrYF5wR0m02Dctw7HgGJ6AUR7hzNPq79XST45x IBS5DaRWiiGW4B7XWcC+SO9hpSEPVH/U1wCOrIo4ToS1fSb/9BYYNNk+vfPDhts8DWjk c0HQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:dkim-signature; bh=BwHRiAPDtrkwECsv6SA7fU7H4zLVJKTcGFNk2QXOnhU=; b=rVaGOSGD+josAoURsZRnGGtLHo8NGpBiTcVq1MbAqdKIkbJqcwkcCMUVVCBZHcImqY 1ucxla1uXxlKiOBGabT9mBEesMGx/3QsHD6C6tv7n1egEk9/a/NSj4xuq5xbEQebtwu+ KkUb82/ErKyL+af+6ibnlokpWFTnaaixxNpEWVTFn9uSr6PyBw0LsaJJ37luLkvwmUqq hQYwwto6ezh9SDIM/g6SVdy/5R3ifegN6lJFZd3UecCBhiaZCB7J0v2f9Ej/XPggMFBk pp4brKKxs/R5PTSITQbCo/00sR+VRc1UrdhV2qEWMJd4vr7v3gop3tmGDZXTEq0zTc6g j2XQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@nitingupta.dev header.s=google header.b=VIHY8xLi; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id c15si10939323ejx.148.2020.06.09.13.34.05; Tue, 09 Jun 2020 13:34:28 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@nitingupta.dev header.s=google header.b=VIHY8xLi; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1729220AbgFIShp (ORCPT + 99 others); Tue, 9 Jun 2020 14:37:45 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:48748 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1728004AbgFISho (ORCPT ); Tue, 9 Jun 2020 14:37:44 -0400 Received: from mail-lf1-x143.google.com (mail-lf1-x143.google.com [IPv6:2a00:1450:4864:20::143]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 495F6C03E97C for ; Tue, 9 Jun 2020 11:37:44 -0700 (PDT) Received: by mail-lf1-x143.google.com with SMTP id c12so13097938lfc.10 for ; Tue, 09 Jun 2020 11:37:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nitingupta.dev; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=BwHRiAPDtrkwECsv6SA7fU7H4zLVJKTcGFNk2QXOnhU=; b=VIHY8xLiHmbfAk+929GtvjqxvUF90uuWGK5L3c+gPpqDFRUpDiapReEG17Y3LutSww 3V4dWOmewogkwd+Eh2mmUpKoH16NlRQle+kI7Ko4/1uBuemv435R5GU4c4mZfT3By+vr SVqe2G5aySIYKw5hxgQiZjXAPzP+T8vokiag6aXGMR6sDZe5pPUDOq6HgWNca8MC52A7 s5P1ye0S5PDBu7AxhHFPbfcEVraz8m2ymqGLFoxZrFnyou69s91LmCHH95LIuM1OqCgh uMYv3citOqdRrf9huGay2dU3OYM+dmat6IejYUUbBgED5NkrInRwRjh2cXUyRAkBVYvk BSSQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=BwHRiAPDtrkwECsv6SA7fU7H4zLVJKTcGFNk2QXOnhU=; b=JUiGDnv6uWRcE5kSs78lxqGwN9oxkZ7O2GmA2uz96SEr3d8iai7LyudZb04P9nXJIk lYnjfpthiJyHYPNXZV+SrS5uhU0lDPJkQ551+MWmEmJd373zDxeDmw0CMflbs/bfSoxi jAabUU+BWnUD/rLsnjL+K3jpCeoKlBpdxNJAHFcHIvNZM3bKI1gXiT4O0ck9Zy6NjndY gMFVkfmi/sQ4UAWoObESnJfR1oVmjKlM+c6zBffr/j1efqcIEsph/O99YzPupfmsO4v3 aaZsgl1mJ4sm6VloxKP5Bb+StmqbDZyKMzlStMuwmb5ncXordP347U/2HbAsdi3aEQX8 /g/A== X-Gm-Message-State: AOAM530bfUM+kTYWqk0tINxI4eOW4mObKZXxiDjGXlhNeU2GjxflBuO1 eFfWioWSZoyxtTPiky6MkSzP2bxVR6vScM6Poywfvg== X-Received: by 2002:a19:ae0f:: with SMTP id f15mr16495368lfc.142.1591727862693; Tue, 09 Jun 2020 11:37:42 -0700 (PDT) MIME-Version: 1.0 References: <20200601194822.30252-1-nigupta@nvidia.com> In-Reply-To: <20200601194822.30252-1-nigupta@nvidia.com> From: Nitin Gupta Date: Tue, 9 Jun 2020 11:37:31 -0700 Message-ID: Subject: Re: [PATCH v6] mm: Proactive compaction To: Vlastimil Babka , Andrew Morton Cc: Mel Gorman , Michal Hocko , Nitin Gupta , Matthew Wilcox , Mike Kravetz , Joonsoo Kim , David Rientjes , linux-kernel , linux-mm , Linux API , Khalid Aziz Content-Type: text/plain; charset="UTF-8" Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Mon, Jun 1, 2020 at 12:48 PM Nitin Gupta wrote: > > For some applications, we need to allocate almost all memory as > hugepages. However, on a running system, higher-order allocations can > fail if the memory is fragmented. Linux kernel currently does on-demand > compaction as we request more hugepages, but this style of compaction > incurs very high latency. Experiments with one-time full memory > compaction (followed by hugepage allocations) show that kernel is able > to restore a highly fragmented memory state to a fairly compacted memory > state within <1 sec for a 32G system. Such data suggests that a more > proactive compaction can help us allocate a large fraction of memory as > hugepages keeping allocation latencies low. > > Signed-off-by: Nitin Gupta > Reviewed-by: Vlastimil Babka (+CC Khalid) Can this be pipelined for upstream inclusion now? Sorry, I'm a bit rusty on upstream flow these days. Thanks, Nitin