Received: by 2002:a05:7412:d8a:b0:e2:908c:2ebd with SMTP id b10csp2795803rdg; Mon, 16 Oct 2023 15:34:51 -0700 (PDT) X-Google-Smtp-Source: AGHT+IGqXGnyGuUXI05mzt9zV/szg+cNJIeIrZ+YmvzQGJUQSgaLciCfzf7vpq8W0E26Povk+C/F X-Received: by 2002:a17:90b:914:b0:27c:f4a9:7e20 with SMTP id bo20-20020a17090b091400b0027cf4a97e20mr204261pjb.15.1697495691647; Mon, 16 Oct 2023 15:34:51 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1697495691; cv=none; d=google.com; s=arc-20160816; b=Kx9njHbJ+vchSfiCg7hdxJDjWr96mg15jB/J+l8zJIkz5zv3NGv1mVPNdfnubBGGBn Df+nHtbCcjPPQvihUmwBfTOqK+sUqURp9OKeEbrqducH0KrpF4p5uLWFTsV2J+uemdn8 XFNnBdz3192UZov6xFKEx5sY5Rf6tX0OGzVA6GmyQ95L+KDyd8cNy9RrbjAT4lerAJWo Ut5mW+Q14rHl7LHE9Y01n9hLXWW8SsLMBtglm3ByAvIKmQIHOpoFhg6zYXgZZc0de0LU fYNNBiBv8yZszh41YkRV4xw10//vM4Ry1vGUUt4gxBjhKzwDZPne2aecxAOgYv0XdT/O pQCw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:cc:to:subject :message-id:date:from:in-reply-to:references:mime-version :dkim-signature; bh=vNaafexrbu6pnn24PMIqsD4prSCGfjBYmlc/DxhvRmw=; fh=b+k1+jYRzZ12Xnu/EhehExsd14IdAsQbXM4Q9Mqioac=; b=FybnCwEg70xGJveJo3WvaQ1/YvGVosMuciXZ9RH8yhX8PiOV4Q4PACD669+8USrato pqFCO9Q9BRq7zmrn2c0yMJryQ0xCt1tolnei2rg7GUC7cuLQhWxZPj0apZGli0URUdvK pRkG0PThCPZYAKG+Ag1DtpxU/X+shZ+vFqSJPWicvtgVNumMPDdt4wkaFrUQjk7VZ6iF grLdmjALT1OC9qk5mKfBxfRVdpT6NWsW7dEXPsaCW2dUv9D6QmEwjH6XNDA9KBlNRAju SEWuMWpnyd8kOBCgIG29xdJ5rjeySKANouDyAhbCqrD37KKubSKHW8LS176WwynH9oIA 6jew== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@google.com header.s=20230601 header.b=AyV9HAEA; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.34 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Return-Path: Received: from howler.vger.email (howler.vger.email. [23.128.96.34]) by mx.google.com with ESMTPS id e16-20020aa798d0000000b0068e26ca7f00si189090pfm.39.2023.10.16.15.34.27 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 16 Oct 2023 15:34:51 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.34 as permitted sender) client-ip=23.128.96.34; Authentication-Results: mx.google.com; dkim=pass header.i=@google.com header.s=20230601 header.b=AyV9HAEA; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.34 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Received: from out1.vger.email (depot.vger.email [IPv6:2620:137:e000::3:0]) by howler.vger.email (Postfix) with ESMTP id B066C806A963; Mon, 16 Oct 2023 15:34:25 -0700 (PDT) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.10 at howler.vger.email Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232345AbjJPWeU (ORCPT + 99 others); Mon, 16 Oct 2023 18:34:20 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:55240 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229943AbjJPWeT (ORCPT ); Mon, 16 Oct 2023 18:34:19 -0400 Received: from mail-pl1-x62b.google.com (mail-pl1-x62b.google.com [IPv6:2607:f8b0:4864:20::62b]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id E36109B for ; Mon, 16 Oct 2023 15:34:17 -0700 (PDT) Received: by mail-pl1-x62b.google.com with SMTP id d9443c01a7336-1c9c145bb5bso36475ad.1 for ; Mon, 16 Oct 2023 15:34:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20230601; t=1697495657; x=1698100457; darn=vger.kernel.org; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=vNaafexrbu6pnn24PMIqsD4prSCGfjBYmlc/DxhvRmw=; b=AyV9HAEABw91cHepsELFKrQRODIeMpGH+w6rkrPIokJ9sWTyLjSv0exqrYLMN0dqQ0 xWT7y9XQ/19a4Z/fomhWiorroSxsWN8Ro0OCCknmLc6LTt9FbYuijB1unNhTbB3LHB72 lFTzkFS6gb4I4bbI2b8RNU1ScEoEjZ7KeUGMpA68lXCv9VQMUC8gGE39hK7vABEgtmbk jzk+b0iC1KcoxYDZq2zlkpQhK3ZELF29V3uL5X+/FKQ+PNGCoEtNRIgRMdKiHPpnM3UI l380/Umjybt6PpueiGJX7o0fzJ/GQGLmK98a6cSZPkcMlcGvuJ649UpI5uFz8CUavpx6 QxFw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1697495657; x=1698100457; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=vNaafexrbu6pnn24PMIqsD4prSCGfjBYmlc/DxhvRmw=; b=P49dhApM82jZZV9B0SuYNpYpxCeAya9+tClydOtpwYGYfz/xp36emOfnBfiM5YCbvR SlFVsJcUQ7NUi22PfRSsk6LLBizm0hdJ/1VR0d9i6ziUt0iWSKjI42Su9mXNt49oUqGv aDoD2rfEdM0zKSaXj6OSor5t5cwHHxLObverjhXDi1JL4zgyTz8iyDya67WG7UZZ4qSq 7t995ai5KPpgPPZTzHCo3Zwb9NpKkX166RRSjgVl7X2tSD8GM+jAO3FuThjBWBXudAn9 +SpK9lwMF8QJM3IDUH9FgMvMmmR1dP/2XmVaq8gaG0rbAuYxqFADy3QAkzOOGGL1peMq gjIg== X-Gm-Message-State: AOJu0YxRV7ZOvPA3/xa95K6f/tyCsOSXDwHnW4DPp6cUrdJQ0Vhmv6QY Drn5bODs5m17Bu2zQZn3Kv+dm44SfGBJNSqMKej1MQ== X-Received: by 2002:a17:903:2406:b0:1bb:2c7b:6d67 with SMTP id e6-20020a170903240600b001bb2c7b6d67mr35150plo.11.1697495657132; Mon, 16 Oct 2023 15:34:17 -0700 (PDT) MIME-Version: 1.0 References: <20231016221900.4031141-1-roman.gushchin@linux.dev> <20231016221900.4031141-3-roman.gushchin@linux.dev> In-Reply-To: <20231016221900.4031141-3-roman.gushchin@linux.dev> From: Shakeel Butt Date: Mon, 16 Oct 2023 15:34:05 -0700 Message-ID: Subject: Re: [PATCH v3 2/5] mm: kmem: add direct objcg pointer to task_struct To: Roman Gushchin Cc: Andrew Morton , linux-kernel@vger.kernel.org, cgroups@vger.kernel.org, Johannes Weiner , Michal Hocko , Muchun Song , Dennis Zhou , David Rientjes , Vlastimil Babka , Naresh Kamboju Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spam-Status: No, score=-8.4 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,USER_IN_DEF_DKIM_WL autolearn=unavailable autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on howler.vger.email Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (howler.vger.email [0.0.0.0]); Mon, 16 Oct 2023 15:34:25 -0700 (PDT) On Mon, Oct 16, 2023 at 3:19=E2=80=AFPM Roman Gushchin wrote: > > To charge a freshly allocated kernel object to a memory cgroup, the > kernel needs to obtain an objcg pointer. Currently it does it > indirectly by obtaining the memcg pointer first and then calling to > __get_obj_cgroup_from_memcg(). > > Usually tasks spend their entire life belonging to the same object > cgroup. So it makes sense to save the objcg pointer on task_struct > directly, so it can be obtained faster. It requires some work on fork, > exit and cgroup migrate paths, but these paths are way colder. > > To avoid any costly synchronization the following rules are applied: > 1) A task sets it's objcg pointer itself. > > 2) If a task is being migrated to another cgroup, the least > significant bit of the objcg pointer is set atomically. > > 3) On the allocation path the objcg pointer is obtained locklessly > using the READ_ONCE() macro and the least significant bit is > checked. If it's set, the following procedure is used to update > it locklessly: > - task->objcg is zeroed using cmpxcg > - new objcg pointer is obtained > - task->objcg is updated using try_cmpxchg > - operation is repeated if try_cmpxcg fails > It guarantees that no updates will be lost if task migration > is racing against objcg pointer update. It also allows to keep > both read and write paths fully lockless. > > Because the task is keeping a reference to the objcg, it can't go away > while the task is alive. > > This commit doesn't change the way the remote memcg charging works. > > Signed-off-by: Roman Gushchin (Cruise) > Tested-by: Naresh Kamboju > Acked-by: Johannes Weiner Acked-by: Shakeel Butt