Received: by 2002:a05:6a10:6006:0:0:0:0 with SMTP id w6csp80917pxa; Wed, 26 Aug 2020 05:26:45 -0700 (PDT) X-Google-Smtp-Source: ABdhPJy7e+I/utraooiSPkcP3hpC0jhRFEWhjGJRfNl1B6XJpMLMIV5F1WAH2TJs4iKr3zmSZg85 X-Received: by 2002:a17:906:e24e:: with SMTP id gq14mr9390854ejb.378.1598444805171; Wed, 26 Aug 2020 05:26:45 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1598444805; cv=none; d=google.com; s=arc-20160816; b=m+jWscsqvrl6YgZGH0COj242T3ntdqbfbTLKKZYsUyYkKlLLdomt+DIgFxWFMAzvK8 n2n6nK0awGpdrBQvQdAtEqW5ZvfS25VPWpDGxiTyH6OpYHvu6euII9YPbqBNyxLwj56F X/3ORWPbofj+Q3Y4/HPNy9Y1x8oz59Lhm66+OLbnzacnviyXzcBBTsHmgrgiB9f9QqSO R53fPgin4B/XUTBQlMFS4xPSwOxYuwowQOa2UOlre0Mls49hWA/lE9wS53tZOvRAQKyQ 9m3/Z06gwVcne8k9757iMwq37FhABqKzrYfCUBjpnccH8W9vscWiq+7p2BUwoiolKACR 6SuA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding:in-reply-to :mime-version:user-agent:date:message-id:from:references:cc:to :subject:reply-to; bh=aV44sCY9o3UexVoW3Efy2ZVQmA/yX6bCT3+DEWvWqGI=; b=lpNx1mJFTmVYW1tCYnYrEJ8Oemlp+syDg8QjsQqiio7yX7wGgcSUGzdLaNq4Gz81Fm AUVJNQWdIwqoQ5TkcV+dmyiHOmIk5RdPhdL3h8QlL8FbBxJUPfxLNq8uDisf17TMhhxt 52mCEPqR3GsBl5FxrruetqEJ0QrL4rNyUDaO1mNJEVpAKxi6NcKHLwsiW3c8+z8ADP+u IVo4DY1AiuIg+ShZTK4O4BCLg68BObRDnQrCfjhwphTbtH1midhUv0kWNdJfpmWdQrzs i6FK/tXGZocrYnKpAXELpNFfFQl2fIUlvWAaoaFhR2JI7qtAf4R1pt8vTFHY8NxdIq8F sF5w== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=alibaba.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id r14si1388269ejy.577.2020.08.26.05.26.22; Wed, 26 Aug 2020 05:26:45 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=alibaba.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1729369AbgHZMVn (ORCPT + 99 others); Wed, 26 Aug 2020 08:21:43 -0400 Received: from out30-131.freemail.mail.aliyun.com ([115.124.30.131]:55028 "EHLO out30-131.freemail.mail.aliyun.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1729263AbgHZMVm (ORCPT ); Wed, 26 Aug 2020 08:21:42 -0400 X-Alimail-AntiSpam: AC=PASS;BC=-1|-1;BR=01201311R321e4;CH=green;DM=||false|;DS=||;FP=0|-1|-1|-1|0|-1|-1|-1;HT=e01e01419;MF=xlpang@linux.alibaba.com;NM=1;PH=DS;RN=6;SR=0;TI=SMTPD_---0U6vWez3_1598444499; Received: from xunleideMacBook-Pro.local(mailfrom:xlpang@linux.alibaba.com fp:SMTPD_---0U6vWez3_1598444499) by smtp.aliyun-inc.com(127.0.0.1); Wed, 26 Aug 2020 20:21:39 +0800 Reply-To: xlpang@linux.alibaba.com Subject: Re: [PATCH] mm: memcg: Fix memcg reclaim soft lockup To: Michal Hocko Cc: Johannes Weiner , Andrew Morton , Vladimir Davydov , linux-kernel@vger.kernel.org, linux-mm@kvack.org References: <1598426822-93737-1-git-send-email-xlpang@linux.alibaba.com> <20200826081102.GM22869@dhcp22.suse.cz> <99efed0e-050a-e313-46ab-8fe6228839d5@linux.alibaba.com> <20200826110015.GO22869@dhcp22.suse.cz> <20200826120740.GP22869@dhcp22.suse.cz> From: xunlei Message-ID: <19eb48db-7d5e-0f55-5dfc-6a71274fd896@linux.alibaba.com> Date: Wed, 26 Aug 2020 20:21:39 +0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:68.0) Gecko/20100101 Thunderbird/68.11.0 MIME-Version: 1.0 In-Reply-To: <20200826120740.GP22869@dhcp22.suse.cz> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 2020/8/26 下午8:07, Michal Hocko wrote: > On Wed 26-08-20 20:00:47, xunlei wrote: >> On 2020/8/26 下午7:00, Michal Hocko wrote: >>> On Wed 26-08-20 18:41:18, xunlei wrote: >>>> On 2020/8/26 下午4:11, Michal Hocko wrote: >>>>> On Wed 26-08-20 15:27:02, Xunlei Pang wrote: >>>>>> We've met softlockup with "CONFIG_PREEMPT_NONE=y", when >>>>>> the target memcg doesn't have any reclaimable memory. >>>>> >>>>> Do you have any scenario when this happens or is this some sort of a >>>>> test case? >>>> >>>> It can happen on tiny guest scenarios. >>> >>> OK, you made me more curious. If this is a tiny guest and this is a hard >>> limit reclaim path then we should trigger an oom killer which should >>> kill the offender and that in turn bail out from the try_charge lopp >>> (see should_force_charge). So how come this repeats enough in your setup >>> that it causes soft lockups? >>> >> >> should_force_charge() is false, the current trapped in endless loop is >> not the oom victim. > > How is that possible? If the oom killer kills a task and that doesn't > resolve the oom situation then it would go after another one until all > tasks are killed. Or is your task living outside of the memcg it tries > to charge? > All tasks are in memcgs. Looks like the first oom victim is not finished (unable to schedule), later mem_cgroup_oom()->...->oom_evaluate_task() will set oc->chosen to -1 and abort.