Received: by 2002:a25:31c3:0:0:0:0:0 with SMTP id x186csp353856ybx; Wed, 6 Nov 2019 18:24:36 -0800 (PST) X-Google-Smtp-Source: APXvYqzptf68lNIX6R6IdQ2KOrYzYjqV7vbuHHrL6o4hXZBvfQK6FHY3M/9noqWsj4kxUQPJKPpx X-Received: by 2002:a17:906:1604:: with SMTP id m4mr835883ejd.124.1573093476139; Wed, 06 Nov 2019 18:24:36 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1573093476; cv=none; d=google.com; s=arc-20160816; b=VMbl4FEVhYFceRZanoQOl/8XXQ2vEI0MYMeV7JeZciWGU4ZR4kOSTtMq+jaSXRZwpz jFr1vE9suvah/kyGTnmg/3PL0ZnLEbVl9HAFy2ZbpiGaNl8IkrrSPAQLPNTOPeaJVNjA /yt1mbXOWw3p6MuI6hqRDbYG5m6isDkIolRdBOuwFtsKoXfzURpi7+s+vo3qVYtnZPRT +VPQwzqa/EDsv3FRLIuThQyF5hPCvCYApxrdiiu6tOA3Nk+auO3UX0CUuKYFuxxoQdCU jEYWbTTeSDzs3x2UON2jIOrVyFmJr4Qjk9eIbvUHTu1iPbXo4uk1CxTcJSJYMd8Q9+8g zw5w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:dkim-signature; bh=AVyrEZrni1dLrbXqEw5bhMGop7jClZ23YRYHr75eQxw=; b=JlHmtHWFY8WxFXORWWAa+C9llvXBQ+Nca53IClRIdSeRpYSHfV7/wF48648dEzowfY FpjV3ru2vuIRGSppxHGz15/TzLbT2nUBeCE53GaJEOKiYTfiq4JVRqhGxXop6bjon6Pi Qs1IOzXEJxaKbVLev7oWjmORzngAso/H6ekJYpdi20RyfJbifs/u2W9SqVweRpCCRMnB qJsRsosPr9fZ/ILoXOSsTp+tsjGjhFRxlsXvgxV6NcmTMsQphwfzst4d9xaWBw836bGR N/J2gCwvGfMLI639Ewsm9Inw4MhNe8EoXZxXOvBCPPdyZCsbBCrsu9OqsjpWwE9eB1Me dBzA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@google.com header.s=20161025 header.b=V65ECVS3; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id c11si327242edb.425.2019.11.06.18.24.13; Wed, 06 Nov 2019 18:24:36 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@google.com header.s=20161025 header.b=V65ECVS3; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1733066AbfKGCWA (ORCPT + 99 others); Wed, 6 Nov 2019 21:22:00 -0500 Received: from mail-ot1-f65.google.com ([209.85.210.65]:35247 "EHLO mail-ot1-f65.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727328AbfKGCWA (ORCPT ); Wed, 6 Nov 2019 21:22:00 -0500 Received: by mail-ot1-f65.google.com with SMTP id z6so679448otb.2 for ; Wed, 06 Nov 2019 18:21:59 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=AVyrEZrni1dLrbXqEw5bhMGop7jClZ23YRYHr75eQxw=; b=V65ECVS3+COSAS/DOQc5qkG+8WZzTosTbxkmjzhGw5VFI3rzHSlYUgi2/d1y68P+9/ puLYgzMXrY9hY2K5iJ0SfXEhG9VsdIRofgzgB9Je0NyGiQlTdnmQjbIeVS7qnJTPrTTe SsFYBgeREsXiaEORnADtojbuXUXMgUPF9BIIaF07+12LEUyIzOwe2Zxa/ZBbbJW9ThfT CAENC1e2BftSC5YEI8uaQztCnlUUSSDl/rlBF5zIhCDVpcXQx2Mvd6yWCpj8aU+kyHvb u7bpH6gK+IrBleSMeMeV3U9AHspElVXqJTWmdF+jjKVtA9QNEQzZVY/0zPrILtv9868y FnbQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=AVyrEZrni1dLrbXqEw5bhMGop7jClZ23YRYHr75eQxw=; b=AIPggGtrvMmQQAxocQdbBU/BCOPrlbYgDqS7GPYqF5Bgo1WA0UEIUhW08TJzzmF6qM OilIbIGgQpiHx0ZwlewvMep7ccjEqPu3IqF+ytcddSJkycTs2DGgBhfra45asYCGeMrg Jb4EUv0yntQz3MQdrChGZDqRJu/EJndSS27xP7+0FynNg2CCOyTmt/paXOQ1TeaooG1s MpEYNqp31NqOUPxPcpjvZJ3IczTzwlrMQFqooExEKLIPHI11sz0t/Aq1KjWNrKhXPb1V sJYn63gGK9I4L+BbQEkWjlmStUSU6/Q6JkU6qCyEdPAdrxPGq2ohJaVlTgBf89zn8aFs R0pg== X-Gm-Message-State: APjAAAVVIJns4mTXjJyJupVQTZ5Nnx9vxtSGezYAsGtD5Ykyd6GcIeDV gR/atc5ULvrNaMiVfyPF8Vm2o657lHF+ApsEg4OktA== X-Received: by 2002:a9d:5e10:: with SMTP id d16mr794891oti.191.1573093319136; Wed, 06 Nov 2019 18:21:59 -0800 (PST) MIME-Version: 1.0 References: <20191106225131.3543616-1-guro@fb.com> <20191107002204.GA96548@cmpxchg.org> <20191107014307.GA1158@castle.dhcp.thefacebook.com> In-Reply-To: <20191107014307.GA1158@castle.dhcp.thefacebook.com> From: Shakeel Butt Date: Wed, 6 Nov 2019 18:21:48 -0800 Message-ID: Subject: Re: [PATCH 1/2] mm: memcg: switch to css_tryget() in get_mem_cgroup_from_mm() To: Roman Gushchin Cc: Johannes Weiner , Linux MM , Andrew Morton , Michal Hocko , LKML , Kernel Team , "stable@vger.kernel.org" , Tejun Heo Content-Type: text/plain; charset="UTF-8" Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Wed, Nov 6, 2019 at 5:43 PM Roman Gushchin wrote: > > On Wed, Nov 06, 2019 at 05:25:26PM -0800, Shakeel Butt wrote: > > On Wed, Nov 6, 2019 at 4:22 PM Johannes Weiner wrote: > > > > > > On Wed, Nov 06, 2019 at 02:51:30PM -0800, Roman Gushchin wrote: > > > > We've encountered a rcu stall in get_mem_cgroup_from_mm(): > > > > > > > > rcu: INFO: rcu_sched self-detected stall on CPU > > > > rcu: 33-....: (21000 ticks this GP) idle=6c6/1/0x4000000000000002 softirq=35441/35441 fqs=5017 > > > > (t=21031 jiffies g=324821 q=95837) NMI backtrace for cpu 33 > > > > <...> > > > > RIP: 0010:get_mem_cgroup_from_mm+0x2f/0x90 > > > > <...> > > > > __memcg_kmem_charge+0x55/0x140 > > > > __alloc_pages_nodemask+0x267/0x320 > > > > pipe_write+0x1ad/0x400 > > > > new_sync_write+0x127/0x1c0 > > > > __kernel_write+0x4f/0xf0 > > > > dump_emit+0x91/0xc0 > > > > writenote+0xa0/0xc0 > > > > elf_core_dump+0x11af/0x1430 > > > > do_coredump+0xc65/0xee0 > > > > ? unix_stream_sendmsg+0x37d/0x3b0 > > > > get_signal+0x132/0x7c0 > > > > do_signal+0x36/0x640 > > > > ? recalc_sigpending+0x17/0x50 > > > > exit_to_usermode_loop+0x61/0xd0 > > > > do_syscall_64+0xd4/0x100 > > > > entry_SYSCALL_64_after_hwframe+0x44/0xa9 > > > > > > > > The problem is caused by an exiting task which is associated with > > > > an offline memcg. We're iterating over and over in the > > > > do {} while (!css_tryget_online()) loop, but obviously the memcg won't > > > > become online and the exiting task won't be migrated to a live memcg. > > > > > > > > Let's fix it by switching from css_tryget_online() to css_tryget(). > > > > > > > > As css_tryget_online() cannot guarantee that the memcg won't go > > > > offline, the check is usually useless, except some rare cases > > > > when for example it determines if something should be presented > > > > to a user. > > > > > > > > A similar problem is described by commit 18fa84a2db0e ("cgroup: Use > > > > css_tryget() instead of css_tryget_online() in task_get_css()"). > > > > > > > > Signed-off-by: Roman Gushchin > > > > Cc: stable@vger.kernel.org > > > > Cc: Tejun Heo > > > > > > Acked-by: Johannes Weiner > > > > > > The bug aside, it doesn't matter whether the cgroup is online for the > > > callers. It used to matter when offlining needed to evacuate all > > > charges from the memcg, and so needed to prevent new ones from showing > > > up, but we don't care now. > > > > Should get_mem_cgroup_from_current() and get_mem_cgroup_from_page() be > > switched to css_tryget() as well then? > > In those case it can't cause a rcu stall, so it's not a so urgent. > But you are right, we should probably do the same here. I'll look > at all remaining callers and prepare the patchset. > > I'll also probably rename it to css_tryget_if_online() to make obvious > that it doesn't hold the cgroup from being onlined. > SGTM