Received: by 2002:a05:7412:b995:b0:f9:9502:5bb8 with SMTP id it21csp2177534rdb; Sun, 24 Dec 2023 22:42:22 -0800 (PST) X-Google-Smtp-Source: AGHT+IH3qi6SFCQkcFtGUsGwN+vaCtIm1cLH2wneMdMc4DRpigKlqcXG1wBac6YE57I651RCajbs X-Received: by 2002:a05:6871:284:b0:204:1313:52fb with SMTP id i4-20020a056871028400b00204131352fbmr6493562oae.79.1703486542677; Sun, 24 Dec 2023 22:42:22 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1703486542; cv=none; d=google.com; s=arc-20160816; b=VgHn64fNgRnd4VDfkmDTg9QXZLqcc1pvURVw6e4VQikcjKVQQHpzVsIgiY/juB8IwT Dayn2SJRR7UN8VsDFZfrs/Kt1OAbWbvbIIOJ+9vg4y9SkXiOURmrXkE8UzJugLByrzM7 ivD1ij8WCpmulOmzUg/UNHDZEPrqdm20+uegwS5zDiCGQ25pT5O6+QxQ9hlmghpl0qth r01bNLdz9HdnpqeA3V3Phmx+yj7TId5461cIKk92D3azBGP+nEoPH2xl/YZ1KRWb6Gz3 UK1hMrndVFOLZENAf4rkSMzMjtkV9u387b1xsTSDEOM1pytNbWXIpi2dE+BVUGuQ/MN/ VK+A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:list-unsubscribe:list-subscribe :list-id:precedence:dkim-signature; bh=nrGG/yhOTC4gewhDUIIieGQ+ifhBWe6O8VJ8zkxhJjw=; fh=h6VxQKIfydXVZXGMDHiQ4looOYcuIO35AlBrDIo6AlQ=; b=u95gJYZtRJqYP8iQ/fyA7fqXF6HIyTLd4gpaA4ywA74i4sN8GZpnt5Ny2WMEeZOi9f XbrJmAGr7re0AOnbghmQfSvyFiunVGTpY36s6H95jefROQXF5O/A1seCaPv5JS5Te2v6 mpZatBP7AIAdWuFNG3vf1rlDRgJ+wGMLMlGby9oEe+vm+ST84VZYzJBsNGW9YxraSrYx GzhUTeY23JOThnq9dXsxOy07TVI6tonwV9uBz7PkjeRR0PnfWNRvQIt6pJgmPsHKaOUi rl+Wjmhn0gsPtu4vJbB1od6P7txfizHjiECiuEW4K6+9NAw/axmjkfslr77KxkB5AqCH 33aw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@google.com header.s=20230601 header.b="Xt7Hs/ic"; spf=pass (google.com: domain of linux-kernel+bounces-10907-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:40f1:3f00::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-10907-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Return-Path: Received: from sy.mirrors.kernel.org (sy.mirrors.kernel.org. [2604:1380:40f1:3f00::1]) by mx.google.com with ESMTPS id j19-20020a635953000000b005c69365abc9si7513600pgm.687.2023.12.24.22.42.22 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 24 Dec 2023 22:42:22 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel+bounces-10907-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:40f1:3f00::1 as permitted sender) client-ip=2604:1380:40f1:3f00::1; Authentication-Results: mx.google.com; dkim=pass header.i=@google.com header.s=20230601 header.b="Xt7Hs/ic"; spf=pass (google.com: domain of linux-kernel+bounces-10907-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:40f1:3f00::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-10907-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by sy.mirrors.kernel.org (Postfix) with ESMTPS id 96545B20CAE for ; Mon, 25 Dec 2023 06:42:18 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 6966817DB; Mon, 25 Dec 2023 06:42:12 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=google.com header.i=@google.com header.b="Xt7Hs/ic" X-Original-To: linux-kernel@vger.kernel.org Received: from mail-wm1-f49.google.com (mail-wm1-f49.google.com [209.85.128.49]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 0425A15A8 for ; Mon, 25 Dec 2023 06:42:09 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=google.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=google.com Received: by mail-wm1-f49.google.com with SMTP id 5b1f17b1804b1-40d41a32effso143035e9.0 for ; Sun, 24 Dec 2023 22:42:09 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20230601; t=1703486528; x=1704091328; darn=vger.kernel.org; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=nrGG/yhOTC4gewhDUIIieGQ+ifhBWe6O8VJ8zkxhJjw=; b=Xt7Hs/icVW/EqOnkRHQydXc8qeXfprnoBXdzKnxq+uen1/typIGF4x4YCLZipofdKp CxuzGAe40qL1UklsQspcdyIWTGRI12mJ7reqMSt+8muJHSKnSxUMdHxsfuyWqDc3CqIf +YQGYPfxZYaQLG9/AMT1OC9vxSSaCOhbXNvNsDuNIs0iZ03QBWch4/P7kJ0ET4ISX1VN sl4uQhihhq0BzOmQODSKVyrgNJgvvyZJPeBeUfFTq/9tst6fzPKvK12Ng+6dx3yZ5WJw kR1xJW/KJPhv8qINf2nQOTxym+dSLhOy7iqVBDijpDUu0z92C4uF540ZpxVMJlvP4vBf 7CSA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1703486528; x=1704091328; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=nrGG/yhOTC4gewhDUIIieGQ+ifhBWe6O8VJ8zkxhJjw=; b=Wfvgw+JuGp+XqFFtR1z9Ys3Ie0SNl2lvQBABpFeR5wq2FdRY4rRHzScc33GG6LlQb1 3gr+kvwoRiO1V6/u7MY9HUvxq6gXYotZfS+dXrP21vHOh2/lhcs/6ye1yWvVyYOR6NWU 9x8m233nh/zhCw6/tPSxuBb1M8h2a6W20vTk4gDsEVgADVFnOFsiZvC1jO0a1mvhA9Zd vlW5MNoXonLjcOxeHud46YMLCmNk4ESU5amvv4vTzM1kMNwcyYqHlmiradUISD83fxPU kb1A/IydDy2++HMqQa+Jhr8aMM2OzAHosGq+jCcdf5zafCHb/cnt8vvgabIjcpMLlpeq ueQg== X-Gm-Message-State: AOJu0Yxn/3KFZCN90xzQxcsP8zHBLIyp3aqCWAwKXD0AWQc+MDdw0nE9 zI8xMiGnUVSpGZpvhkKsKyupq/X61QmZpi6ylupZjM189xX7qHRGeuPGLpKxKbaz X-Received: by 2002:a05:600c:1c29:b0:40d:3bec:55a with SMTP id j41-20020a05600c1c2900b0040d3bec055amr333083wms.5.1703486528047; Sun, 24 Dec 2023 22:42:08 -0800 (PST) Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 References: <20231222102255.56993-1-ryncsn@gmail.com> <20231222102255.56993-4-ryncsn@gmail.com> In-Reply-To: <20231222102255.56993-4-ryncsn@gmail.com> From: Yu Zhao Date: Sun, 24 Dec 2023 23:41:31 -0700 Message-ID: Subject: Re: [PATCH 3/3] mm, lru_gen: try to prefetch next page when canning LRU To: Kairui Song , Matthew Wilcox Cc: linux-mm@kvack.org, Andrew Morton , linux-kernel@vger.kernel.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Fri, Dec 22, 2023 at 3:24=E2=80=AFAM Kairui Song wrot= e: > > From: Kairui Song > > Prefetch for inactive/active LRU have been long exiting, apply the same > optimization for MGLRU. I seriously doubt that prefetch helps in this case. Willy, any thoughts on this? Thanks. > Tested in a 4G memcg on a EPYC 7K62 with: > > memcached -u nobody -m 16384 -s /tmp/memcached.socket \ > -a 0766 -t 16 -B binary & > > memtier_benchmark -S /tmp/memcached.socket \ > -P memcache_binary -n allkeys \ > --key-minimum=3D1 --key-maximum=3D16000000 -d 1024 \ > --ratio=3D1:0 --key-pattern=3DP:P -c 2 -t 16 --pipeline 8 -x 6 > > Average result of 18 test runs: > > Before: 44017.78 Ops/sec > After patch 1-3: 44890.50 Ops/sec (+1.8%) > > Signed-off-by: Kairui Song > --- > mm/vmscan.c | 12 ++++++++---- > 1 file changed, 8 insertions(+), 4 deletions(-) > > diff --git a/mm/vmscan.c b/mm/vmscan.c > index af1266129c1b..1e9d69e18443 100644 > --- a/mm/vmscan.c > +++ b/mm/vmscan.c > @@ -3764,10 +3764,12 @@ static bool inc_min_seq(struct lruvec *lruvec, in= t type, bool can_swap) > VM_WARN_ON_ONCE_FOLIO(folio_is_file_lru(folio) != =3D type, folio); > VM_WARN_ON_ONCE_FOLIO(folio_zonenum(folio) !=3D z= one, folio); > > - if (unlikely(list_is_first(&folio->lru, head))) > + if (unlikely(list_is_first(&folio->lru, head))) { > prev =3D NULL; > - else > + } else { > prev =3D lru_to_folio(&folio->lru); > + prefetchw(&prev->flags); > + } > > new_gen =3D folio_inc_gen(lruvec, folio, false, &= batch); > lru_gen_try_inc_bulk(lrugen, folio, bulk_gen, new= _gen, type, zone, &batch); > @@ -4434,10 +4436,12 @@ static int scan_folios(struct lruvec *lruvec, str= uct scan_control *sc, > VM_WARN_ON_ONCE_FOLIO(folio_zonenum(folio) !=3D z= one, folio); > > scanned +=3D delta; > - if (unlikely(list_is_first(&folio->lru, head))) > + if (unlikely(list_is_first(&folio->lru, head))) { > prev =3D NULL; > - else > + } else { > prev =3D lru_to_folio(&folio->lru); > + prefetchw(&prev->flags); > + } > > if (sort_folio(lruvec, folio, sc, tier, bulk_gen,= &batch)) > sorted +=3D delta; > -- > 2.43.0 >