Received: by 2002:a05:6a10:9848:0:0:0:0 with SMTP id x8csp674805pxf; Wed, 10 Mar 2021 15:03:12 -0800 (PST) X-Google-Smtp-Source: ABdhPJynPMrvbSz3bvNe7KsIYwx7+P3WGsjP0Cw8boDPlje876RbJh7z/4KPgAF9Ul8XeibMBwBv X-Received: by 2002:a17:906:3e92:: with SMTP id a18mr203654ejj.95.1615417391854; Wed, 10 Mar 2021 15:03:11 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1615417391; cv=none; d=google.com; s=arc-20160816; b=rcuNdP5NFPcU1VJZdx90CFXi1CPlAQ/zbZ0u6HsNoM9c/gfiOEgdVCQf22OIIg3Csg dn1Aoj5yQPklxfhgBUdkpyZqvZNnBlCQqu2qYC9hyfR4T2cPokIMbWNnah5GGvgCdptx 0UDrfcrQP1dqt8ExgDd/AXXJMBzQaiaiP3MHJ51HtZoZ4z3/pF84hDzzCOxTQ5p9hzQS tBdIWbKokhvKxKw67KoVvJF0YcQhFRZIceIi5CJBg2tZT07+2zPaU/urlfQy16VzXK5l tC5Pkb3avKvJFIJA5OJkI6pUgx9owDgJT55sUkg5l7z1kAUKHUJ+GotdlbVwJJWktT2n o0Ag== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:cc:to:subject:message-id:date:from:in-reply-to :references:mime-version:dkim-signature; bh=f1OhGlJz2j6YTYfzWFHdwbgV7PiLTTKaD5d9gsHnl1E=; b=HPR+wqLT/xXpdr+lrHq57dtxtVO1VqAaW7Gt0HYiaTXa1l6nte9TlmVEgL1EqqV9Ol 3jqjzEdM61RFmxNqBN9g01gTL7LAcWnIgjdZ2i2LkdMD7cUJunjEwAoIlECdFIgDOi9J 7XZpHu56cGTQFWbzbNLOPCXo5eK+slRVu105a3Vw1ClO0+oWr+moECGpPdxPkc3isD+Y u3g47/as4CgRafi+IjENTuhol3PhvzZQ3JG9kJ7HsFGkp9ctZHHnTe59wgunTehUoNJw sQ330hiNDfPitJkaZCMlfWYspASYQNpLy67+8BW8ILp4hbfvvQnPw6nWU2AUHRvJf9XO 97EQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=lW9tBi57; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id w22si491830ejc.517.2021.03.10.15.02.49; Wed, 10 Mar 2021 15:03:11 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=lW9tBi57; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S233007AbhCJXBw (ORCPT + 99 others); Wed, 10 Mar 2021 18:01:52 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:57892 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S231301AbhCJXBd (ORCPT ); Wed, 10 Mar 2021 18:01:33 -0500 Received: from mail-ej1-x632.google.com (mail-ej1-x632.google.com [IPv6:2a00:1450:4864:20::632]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 80C47C061574; Wed, 10 Mar 2021 15:01:33 -0800 (PST) Received: by mail-ej1-x632.google.com with SMTP id mm21so42091050ejb.12; Wed, 10 Mar 2021 15:01:33 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=f1OhGlJz2j6YTYfzWFHdwbgV7PiLTTKaD5d9gsHnl1E=; b=lW9tBi577tyTEpO0bVugV0TKRv6FllVdghAXpihF0GR4vMLzn0uSraikC/rbKnuPYJ r5jAHQTZ/EnQknxboJLonWglrqlTh/g3klmXPo/QOGAIz7Y+dk/tISVVbNUAH0KGBpWV iMvXTPXW1c5IcYFETm0fA3JpvbH0vxcicS9CSZaB0aJURFnqEiafMc/4UIKR52neb+v1 jsdVFgZfr8uv99djkzUxiOK5WoctFNNHVaS4Tg8kYlazUr4IiRJIDuZBvlqHaK84Eliy 55YciVi6/r2iVCksW9DMsaQcCYFxhF5JBgazUoPzAmJmd2Lpp502Qpuzg5pLIwvoSxbh FvlA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=f1OhGlJz2j6YTYfzWFHdwbgV7PiLTTKaD5d9gsHnl1E=; b=d7L+GOqj88uzABAZlwzf5r2JUPT96mcfKMGTRqvY+eytGlegXTxopjASQtQZ/eHWqT H21cWcmXiyk1jzw7Mow5cWob6ugfNFLUUT8Cafsk46+HmH1vOndaxgLj6q6Mz290oX2W 3uzhJ7XeKRxfz8mGezHEFX8WfRCru0xUL1dcikspkAqAnwCperq5vb67keKhQ96DeRqb FA0nMBSM36lNA6efGMmrLI5f2vcBiMsV8Q+rU2V7AWzhOIdKix5ZmD+5WGrQyMVPTfqc oNRkkaYAsKDCvl53MQmU7upLEpjbmNuEtqx1dokbT5C8XWJL011KZNlhT/7+RoDNi67H Cd4A== X-Gm-Message-State: AOAM531LZ/ro4Pu6ekFUVPgquTaKiPrs5Upz7RFPyzu0SPR2usiHXlsF ovVNQUOZvoTaoaXANM3c2pB1ZThWuuDm5s4CAKg= X-Received: by 2002:a17:906:3088:: with SMTP id 8mr185785ejv.499.1615417292149; Wed, 10 Mar 2021 15:01:32 -0800 (PST) MIME-Version: 1.0 References: <20210310174603.5093-1-shy828301@gmail.com> <20210310174603.5093-14-shy828301@gmail.com> In-Reply-To: From: Yang Shi Date: Wed, 10 Mar 2021 15:01:20 -0800 Message-ID: Subject: Re: [v9 PATCH 13/13] mm: vmscan: shrink deferred objects proportional to priority To: Shakeel Butt Cc: Roman Gushchin , Kirill Tkhai , Vlastimil Babka , Dave Chinner , Johannes Weiner , Michal Hocko , Andrew Morton , Linux MM , linux-fsdevel , LKML Content-Type: text/plain; charset="UTF-8" Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Wed, Mar 10, 2021 at 2:41 PM Shakeel Butt wrote: > > On Wed, Mar 10, 2021 at 1:41 PM Yang Shi wrote: > > > > On Wed, Mar 10, 2021 at 1:08 PM Shakeel Butt wrote: > > > > > > On Wed, Mar 10, 2021 at 10:54 AM Yang Shi wrote: > > > > > > > > On Wed, Mar 10, 2021 at 10:24 AM Shakeel Butt wrote: > > > > > > > > > > On Wed, Mar 10, 2021 at 9:46 AM Yang Shi wrote: > > > > > > > > > > > > The number of deferred objects might get windup to an absurd number, and it > > > > > > results in clamp of slab objects. It is undesirable for sustaining workingset. > > > > > > > > > > > > So shrink deferred objects proportional to priority and cap nr_deferred to twice > > > > > > of cache items. > > > > > > > > > > > > The idea is borrowed from Dave Chinner's patch: > > > > > > https://lore.kernel.org/linux-xfs/20191031234618.15403-13-david@fromorbit.com/ > > > > > > > > > > > > Tested with kernel build and vfs metadata heavy workload in our production > > > > > > environment, no regression is spotted so far. > > > > > > > > > > Did you run both of these workloads in the same cgroup or separate cgroups? > > > > > > > > Both are covered. > > > > > > > > > > Have you tried just this patch i.e. without the first 12 patches? > > > > No. It could be applied without the first 12 patches, but I didn't > > test this combination specifically since I don't think it would have > > any difference from with the first 12 patches. I tested running the > > test case under root memcg, it seems equal to w/o the first 12 patches > > and the only difference is where to get nr_deferred. > > I am trying to measure the impact of this patch independently. One > point I can think of is the global reclaim. The first 12 patches do > not aim to improve the global reclaim but this patch will. I am just > wondering what would be negative if any of this patch. Feel free to do so. More tests from more workloads are definitely appreciated. That could give us more confidence about this patch or catch regression sooner.