Received: by 2002:ab2:644:0:b0:1ec:cbc4:63fb with SMTP id 4csp1164508lqn; Mon, 26 Feb 2024 09:23:51 -0800 (PST) X-Forwarded-Encrypted: i=3; AJvYcCW1rgOlr7DzCpGi6ie3mRKlGCEAOeHQL8Yc9QAmGMr06ixyuv5ncuOBIsydwDTg4wCfhnS74LdCyYh1toYmp81EszljaU1cJhsbvpVZ3g== X-Google-Smtp-Source: AGHT+IGHoARTCw8pb70Mt/HErCjrhOUNaGwKYBgcVCjUvYDx1m9xpmm5eR8vBkSDZQwTeGlRNR6t X-Received: by 2002:a17:90a:ce0a:b0:299:489f:a126 with SMTP id f10-20020a17090ace0a00b00299489fa126mr4705694pju.41.1708968231686; Mon, 26 Feb 2024 09:23:51 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1708968231; cv=pass; d=google.com; s=arc-20160816; b=AZI0A9y9JpWzI3tCU4cY2nb6tbAMx9SAFcQ+lYqTWlFksbHOkpW7m7WsaBxyAZQ262 /IDv7z6AroY9H0txNKixpybPMlzDREp6Uw2kEHGuUYa7AQg0IGYwkIkrbDxcevn/4jy0 BPwwOM2lF+VDoQW9gGuhALnxYnXcWss5iU4GqHhwShqSsQQIOa8QqqVPR1dKMnE0W6qT V+uQW6sVQPVjTEaHLosTgFKhmDIBpEHtWZ+OER9GCTxMYIv48YAWnBOWxeW+rExrR27l eWVsLQeC02m+tdyrwiErDkJR8W+GNffvuEhSH3VhYr7u/76JPd75rGlJrQxgWC5hPtSl e1Yg== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:list-unsubscribe:list-subscribe :list-id:precedence:dkim-signature; bh=dv1MR8FFyIVeo2kD5/jRtw1zZdBqiDH8uTYdJ7duKRA=; fh=LKif76fmwauchrLquF5OBu59+byZwTzYuhY7fNCj/zY=; b=ygOtq3fisN/4dfxwGb/9o0VoSySZeNp3JtTMH49sZH2Qob4juLkoG/0q1imjm7Z3cG RPfqolvcEFjJF+pPsB7Y/jaUSAUTM0AaOWxUhhoCJfbR6cR+p585bZWcq7cCctSTZdTe ChyKT+/Ye847etnmUSs9fTGt27Jhi19J4w3xIaBnuyw8O55YK11P/HDrHp2JJKgEAzVJ uOVGIJYTMtjVFBd/oCkdRe3uqw1xAQ4crZ/UR2VIN9jNsG+0Ocp6mFYkllNIgcrkrL7L X7PJThqfTK323pUmlRd5cFMrqgSFvsdO+yVaPLNhdGSaexy84BVq8coSHG3O6vKSeN6k 6UqQ==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@google.com header.s=20230601 header.b=UtEdZPQI; arc=pass (i=1 spf=pass spfdomain=google.com dkim=pass dkdomain=google.com dmarc=pass fromdomain=google.com); spf=pass (google.com: domain of linux-kernel+bounces-82047-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45e3:2400::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-82047-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Return-Path: Received: from sv.mirrors.kernel.org (sv.mirrors.kernel.org. [2604:1380:45e3:2400::1]) by mx.google.com with ESMTPS id q5-20020a17090aa00500b00299ecfc68absi5759421pjp.16.2024.02.26.09.23.51 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 26 Feb 2024 09:23:51 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel+bounces-82047-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45e3:2400::1 as permitted sender) client-ip=2604:1380:45e3:2400::1; Authentication-Results: mx.google.com; dkim=pass header.i=@google.com header.s=20230601 header.b=UtEdZPQI; arc=pass (i=1 spf=pass spfdomain=google.com dkim=pass dkdomain=google.com dmarc=pass fromdomain=google.com); spf=pass (google.com: domain of linux-kernel+bounces-82047-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45e3:2400::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-82047-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by sv.mirrors.kernel.org (Postfix) with ESMTPS id 52F7229257A for ; Mon, 26 Feb 2024 17:23:33 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 22F4912DD9A; Mon, 26 Feb 2024 17:22:46 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=google.com header.i=@google.com header.b="UtEdZPQI" Received: from mail-lj1-f173.google.com (mail-lj1-f173.google.com [209.85.208.173]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 0B20312CD9C for ; Mon, 26 Feb 2024 17:22:42 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.208.173 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1708968165; cv=none; b=Jxp3Pha3paChuizy25eYJKNAjbplgLBM7zg4iISQ65mbCv1h56Rr7W/huuctFlB8jb1ikg8tC8d1J0RArRZwYcBrjynpLbL/t7703WLXqxGbN+d41+ZrgotxEZLmGZftXAyG0N8qSr9ukBOSGF47Gyq0EHdQESFxOz1/1Q3eIv4= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1708968165; c=relaxed/simple; bh=EqmeweN9yJbHN4ZOPQ4NNULOO0mEliqSsTTtiukx5Xg=; h=MIME-Version:References:In-Reply-To:From:Date:Message-ID:Subject: To:Cc:Content-Type; b=Ou4DHqkRvNDR2UW7DWcqJao+SCrKTeiGZ8xRT5qCOlDn9UORJlKP3uYmxgT4RVw9EO5Dgf/4tpxHGplga6Yh8fyaZx9Q929tAwP9gFLBs1nYhExuSYM4W1S4qzTLKK4pY/OTNDoDG2Na9H6k0qgD6O2ooN8bAapD0amLGitg/48= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=google.com; spf=pass smtp.mailfrom=google.com; dkim=pass (2048-bit key) header.d=google.com header.i=@google.com header.b=UtEdZPQI; arc=none smtp.client-ip=209.85.208.173 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=google.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=google.com Received: by mail-lj1-f173.google.com with SMTP id 38308e7fff4ca-2d180d6bd32so48837261fa.1 for ; Mon, 26 Feb 2024 09:22:42 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20230601; t=1708968161; x=1709572961; darn=vger.kernel.org; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=dv1MR8FFyIVeo2kD5/jRtw1zZdBqiDH8uTYdJ7duKRA=; b=UtEdZPQIZQ3QnohdxOrVw8t21VecFDMJ22AYc8M3h/OLTcWQGmofC5i2wHNfp5etvd IxycCl+BPuxdiJPETX3fYYBIVegZY/vN+xUCEaifNbAmwLrnCi97dSL+u/624e0iVsDD TkEcuEPlhDJPrEhQW3tw6AxiK0wnEC7A0OhZEP3hOXEWT/UH3N5czcorAcpJUMueHs7I XmuqjWvOUm+mpWtOeHegPpxOGo7lxpf9TXhZWzP+WZUnQHy4D9MSMTnWOpNgnZjhkvHe S5lswx19Inj0FaKiPePkX0oICzcdVKrWe/4KjFm0v49JRYDrlDdD2Gk21rsxbVbmQEf/ 3tew== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1708968161; x=1709572961; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=dv1MR8FFyIVeo2kD5/jRtw1zZdBqiDH8uTYdJ7duKRA=; b=APz2UkN4wFdqq4rOHl2uwz3gT6LkuWqmkiN4fbe0/5sdAfng7NhqG5LpFq7toUB0TN jIxMkS7wRj5P4skuEY6rRQVkB4m4HUcNZHDPjPdXkaDxjfpmhb/gZkjkzhexTj+a2JLn 7P8wVAzj4kuMW0oJvrBGkurpsW568oViS8MavVRIcAD6eK5wRF3lLHfNI+MVZxYQKmLx +SilqlzztX7/SH06KmCBU2Xqp4IhAkYyGwhxvToEWWn+d4v4LBMHwFXIPrzXSeM22dkl 59hvxcZUPWqbM9TCUwbyqzE008kV1BZGrNgLjcEOJ3aqGaT/GLvcgXOlhW8S9cAbHpsM Ef9A== X-Forwarded-Encrypted: i=1; AJvYcCVbkblFJZjAxMNXshbRdOFEfPlOYuUSOlicmXgWxQT9ByCcwr+n/bpeaP4rqk8wMkE0fEbj4uCclnKsjAQomrDO2PWbYEkSm8RhC/g7 X-Gm-Message-State: AOJu0YzYbdSLzpR6Kkr3hPjkpSK220wvAvXf2ogOC/U5rBIjL2z4kR4k Cza7PlqQn8W2NauoVHWWROivZmLGT80Lm3PT6IUXaMdaAUT+uLSwSgpUWvJ3rAZ9uo9NMRN0B9n hWlKfcqjK6LFxE2owHSPdsfw5aFC/Oj/cyZuy X-Received: by 2002:a2e:990b:0:b0:2d2:7164:c6ba with SMTP id v11-20020a2e990b000000b002d27164c6bamr4367139lji.43.1708968160893; Mon, 26 Feb 2024 09:22:40 -0800 (PST) Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 References: <20240221194052.927623-1-surenb@google.com> <20240221194052.927623-8-surenb@google.com> <6851f8a0-e5d2-4b79-9cee-cff0fdec2970@suse.cz> In-Reply-To: <6851f8a0-e5d2-4b79-9cee-cff0fdec2970@suse.cz> From: Suren Baghdasaryan Date: Mon, 26 Feb 2024 17:22:21 +0000 Message-ID: Subject: Re: [PATCH v4 07/36] mm: introduce slabobj_ext to support slab object extensions To: Vlastimil Babka Cc: akpm@linux-foundation.org, kent.overstreet@linux.dev, mhocko@suse.com, hannes@cmpxchg.org, roman.gushchin@linux.dev, mgorman@suse.de, dave@stgolabs.net, willy@infradead.org, liam.howlett@oracle.com, penguin-kernel@i-love.sakura.ne.jp, corbet@lwn.net, void@manifault.com, peterz@infradead.org, juri.lelli@redhat.com, catalin.marinas@arm.com, will@kernel.org, arnd@arndb.de, tglx@linutronix.de, mingo@redhat.com, dave.hansen@linux.intel.com, x86@kernel.org, peterx@redhat.com, david@redhat.com, axboe@kernel.dk, mcgrof@kernel.org, masahiroy@kernel.org, nathan@kernel.org, dennis@kernel.org, tj@kernel.org, muchun.song@linux.dev, rppt@kernel.org, paulmck@kernel.org, pasha.tatashin@soleen.com, yosryahmed@google.com, yuzhao@google.com, dhowells@redhat.com, hughd@google.com, andreyknvl@gmail.com, keescook@chromium.org, ndesaulniers@google.com, vvvvvv@google.com, gregkh@linuxfoundation.org, ebiggers@google.com, ytcoode@gmail.com, vincent.guittot@linaro.org, dietmar.eggemann@arm.com, rostedt@goodmis.org, bsegall@google.com, bristot@redhat.com, vschneid@redhat.com, cl@linux.com, penberg@kernel.org, iamjoonsoo.kim@lge.com, 42.hyeyoo@gmail.com, glider@google.com, elver@google.com, dvyukov@google.com, shakeelb@google.com, songmuchun@bytedance.com, jbaron@akamai.com, rientjes@google.com, minchan@google.com, kaleshsingh@google.com, kernel-team@android.com, linux-doc@vger.kernel.org, linux-kernel@vger.kernel.org, iommu@lists.linux.dev, linux-arch@vger.kernel.org, linux-fsdevel@vger.kernel.org, linux-mm@kvack.org, linux-modules@vger.kernel.org, kasan-dev@googlegroups.com, cgroups@vger.kernel.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Mon, Feb 26, 2024 at 8:26=E2=80=AFAM Vlastimil Babka wr= ote: > > On 2/21/24 20:40, Suren Baghdasaryan wrote: > > Currently slab pages can store only vectors of obj_cgroup pointers in > > page->memcg_data. Introduce slabobj_ext structure to allow more data > > to be stored for each slab object. Wrap obj_cgroup into slabobj_ext > > to support current functionality while allowing to extend slabobj_ext > > in the future. > > > > Signed-off-by: Suren Baghdasaryan > > Hi, mostly good from slab perspective, just some fixups: > > > --- a/mm/slab.h > > +++ b/mm/slab.h > > -int memcg_alloc_slab_cgroups(struct slab *slab, struct kmem_cache *s, > > - gfp_t gfp, bool new_slab); > > -void mod_objcg_state(struct obj_cgroup *objcg, struct pglist_data *pgd= at, > > - enum node_stat_item idx, int nr); > > -#else /* CONFIG_MEMCG_KMEM */ > > -static inline struct obj_cgroup **slab_objcgs(struct slab *slab) > > +int alloc_slab_obj_exts(struct slab *slab, struct kmem_cache *s, > > + gfp_t gfp, bool new_slab); > > > > We could remove this declaration and make the function static in mm/slub.= c. Ack. > > > +#else /* CONFIG_SLAB_OBJ_EXT */ > > + > > +static inline struct slabobj_ext *slab_obj_exts(struct slab *slab) > > { > > return NULL; > > } > > > > -static inline int memcg_alloc_slab_cgroups(struct slab *slab, > > - struct kmem_cache *s, gfp_= t gfp, > > - bool new_slab) > > +static inline int alloc_slab_obj_exts(struct slab *slab, > > + struct kmem_cache *s, gfp_t gfp, > > + bool new_slab) > > { > > return 0; > > } > > Ditto Ack. > > > -#endif /* CONFIG_MEMCG_KMEM */ > > + > > +static inline struct slabobj_ext * > > +prepare_slab_obj_exts_hook(struct kmem_cache *s, gfp_t flags, void *p) > > +{ > > + return NULL; > > +} > > Same here (and the definition and usage even happens in later patch). Ack. > > > +#endif /* CONFIG_SLAB_OBJ_EXT */ > > + > > +#ifdef CONFIG_MEMCG_KMEM > > +void mod_objcg_state(struct obj_cgroup *objcg, struct pglist_data *pgd= at, > > + enum node_stat_item idx, int nr); > > +#endif > > > > size_t __ksize(const void *objp); > > > > diff --git a/mm/slub.c b/mm/slub.c > > index d31b03a8d9d5..76fb600fbc80 100644 > > --- a/mm/slub.c > > +++ b/mm/slub.c > > @@ -683,10 +683,10 @@ static inline bool __slab_update_freelist(struct = kmem_cache *s, struct slab *sla > > > > if (s->flags & __CMPXCHG_DOUBLE) { > > ret =3D __update_freelist_fast(slab, freelist_old, counte= rs_old, > > - freelist_new, counters_new); > > + freelist_new, counters_new); > > } else { > > ret =3D __update_freelist_slow(slab, freelist_old, counte= rs_old, > > - freelist_new, counters_new); > > + freelist_new, counters_new); > > } > > if (likely(ret)) > > return true; > > @@ -710,13 +710,13 @@ static inline bool slab_update_freelist(struct km= em_cache *s, struct slab *slab, > > > > if (s->flags & __CMPXCHG_DOUBLE) { > > ret =3D __update_freelist_fast(slab, freelist_old, counte= rs_old, > > - freelist_new, counters_new); > > + freelist_new, counters_new); > > } else { > > unsigned long flags; > > > > local_irq_save(flags); > > ret =3D __update_freelist_slow(slab, freelist_old, counte= rs_old, > > - freelist_new, counters_new); > > + freelist_new, counters_new); > > Please no drive-by fixups of whitespace in code you're not actually > changing. I thought you agreed in v3? Sorry, I must have misunderstood your previous comment. I thought you were saying that the alignment I changed to was incorrect. I'll keep them untouched. > > > static inline bool memcg_slab_pre_alloc_hook(struct kmem_cache *s, > > struct list_lru *lru, > > struct obj_cgroup **objcgp, > > @@ -2314,7 +2364,7 @@ static __always_inline void account_slab(struct s= lab *slab, int order, > > struct kmem_cache *s, gfp_t gfp) > > { > > if (memcg_kmem_online() && (s->flags & SLAB_ACCOUNT)) > > - memcg_alloc_slab_cgroups(slab, s, gfp, true); > > + alloc_slab_obj_exts(slab, s, gfp, true); > > This is still guarded by the memcg_kmem_online() static key, which is goo= d. > > > > > mod_node_page_state(slab_pgdat(slab), cache_vmstat_idx(s), > > PAGE_SIZE << order); > > @@ -2323,8 +2373,7 @@ static __always_inline void account_slab(struct s= lab *slab, int order, > > static __always_inline void unaccount_slab(struct slab *slab, int orde= r, > > struct kmem_cache *s) > > { > > - if (memcg_kmem_online()) > > - memcg_free_slab_cgroups(slab); > > + free_slab_obj_exts(slab); > > But this no longer is, yet it still could be? Yes, I missed that, it seems. free_slab_obj_exts() would bail out but still checking the static key is more efficient. I'll revive this check. Thanks for the review! Suren. > > > > > mod_node_page_state(slab_pgdat(slab), cache_vmstat_idx(s), > > -(PAGE_SIZE << order)); >