Received: by 2002:ac0:946b:0:0:0:0:0 with SMTP id j40csp127730imj; Thu, 14 Feb 2019 16:55:14 -0800 (PST) X-Google-Smtp-Source: AHgI3IaCWmb0QXmmtM7MLw7EP25xYqo5hZSwmlt6N/Y9Aaox2JxxO6h9YAbGFKZj0SKG8XbzMEZf X-Received: by 2002:a62:2284:: with SMTP id p4mr7044573pfj.115.1550192114438; Thu, 14 Feb 2019 16:55:14 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1550192114; cv=none; d=google.com; s=arc-20160816; b=lLFFc/dJLUhDBYAGrXNWAG6Z0TVMzTAAvPRP6YnyhDVaQrV/SFb56c7g8huvg+Auv6 0g6dHPrXCFMDkXg536ZPkafZvpQml/ha14/KlOW1QCkOOKKs07lUUQPOF8bP5eT/lYLB 2RsgLzPP+sZsO6PCxh/RBY/Z+eccPT3+Je45oHFFMjEmqZuG4zovZC32z0tCjcG0r5jC jpXM1os+gNzxWhmuhgVCSP7avorzq0jbtVE/07axg1kj7IpMr01VKmvrKA8jDlSw8Zig iiX0VnYS0OEky8nLYOAN5zhfyqWHCDbWTIFYJK+IlNydqCQjvi4VOGnuMaTAYDrxqwHR IKyg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:mime-version:content-transfer-encoding :content-id:content-language:accept-language:in-reply-to:references :message-id:date:thread-index:thread-topic:subject:cc:to:from :dkim-signature:dkim-signature; bh=KPdz73e855N+NeDZITgo6wZDKYSeeAFYIkTCWfsaUEc=; b=VcwPybM2aNxXYeuDSvd/kSbcoh4U3qmuF/65Vx1eaJOORHJKvom488b133HKuXZSfw Zg62pswC/Qa1uOAFUaZgKQiKavVmNAjt6WvhCAQpzGizghYVUNLnOnvgliUY/j3BwG7p AZN7/5GxAuIFyi09FJNsKNs+Boz08eZl0V2MD6h5m4q53FoAmVl6IG3ipnqSMfh7iku/ 3zJPlfUnusFzLN0anXQLOP0j9RJqp7EBPQtsFqmcsrEvnQ7qdtGTkd9H4G1NqX9iM/D4 msEpGhz0bVe+vImIi0inakBHIxc+DQOXZ+3tLdLcnYHu6zYuNNMiYT/EC793ZRHLJCHK wpeg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@fb.com header.s=facebook header.b=TPFr9EhP; dkim=pass header.i=@fb.onmicrosoft.com header.s=selector1-fb-com header.b=PEF4hkBl; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=fb.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id p36si3833832pgb.432.2019.02.14.16.54.58; Thu, 14 Feb 2019 16:55:14 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@fb.com header.s=facebook header.b=TPFr9EhP; dkim=pass header.i=@fb.onmicrosoft.com header.s=selector1-fb-com header.b=PEF4hkBl; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=fb.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S2408014AbfBNQl2 (ORCPT + 99 others); Thu, 14 Feb 2019 11:41:28 -0500 Received: from mx0a-00082601.pphosted.com ([67.231.145.42]:49092 "EHLO mx0a-00082601.pphosted.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S2405016AbfBNQl2 (ORCPT ); Thu, 14 Feb 2019 11:41:28 -0500 Received: from pps.filterd (m0109333.ppops.net [127.0.0.1]) by mx0a-00082601.pphosted.com (8.16.0.27/8.16.0.27) with SMTP id x1EGe8lG006328; Thu, 14 Feb 2019 08:41:24 -0800 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=fb.com; h=from : to : cc : subject : date : message-id : references : in-reply-to : content-type : content-id : content-transfer-encoding : mime-version; s=facebook; bh=KPdz73e855N+NeDZITgo6wZDKYSeeAFYIkTCWfsaUEc=; b=TPFr9EhP9LO8QuYm2evzCxLCMAgf6LHZ/oAv5epvaKmgZHI9AKNH9uYYQd31iRZDTw5J cyi9JcOBo3jOELdGKUZ2eHuesmuls+dHWPphasyrA+Xgxg9fLFzhhBfZ1aqan3KF8Vkq apyYLAP0XKdtX47l1ELPzEBBGroWMNxKG7U= Received: from mail.thefacebook.com ([199.201.64.23]) by mx0a-00082601.pphosted.com with ESMTP id 2qnawrg9ap-20 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-SHA384 bits=256 verify=NOT); Thu, 14 Feb 2019 08:41:23 -0800 Received: from prn-mbx03.TheFacebook.com (2620:10d:c081:6::17) by prn-hub04.TheFacebook.com (2620:10d:c081:35::128) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.1.1531.3; Thu, 14 Feb 2019 08:41:07 -0800 Received: from prn-hub03.TheFacebook.com (2620:10d:c081:35::127) by prn-mbx03.TheFacebook.com (2620:10d:c081:6::17) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.1.1531.3; Thu, 14 Feb 2019 08:41:06 -0800 Received: from NAM02-CY1-obe.outbound.protection.outlook.com (192.168.54.28) by o365-in.thefacebook.com (192.168.16.27) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.1.1531.3 via Frontend Transport; Thu, 14 Feb 2019 08:41:06 -0800 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=fb.onmicrosoft.com; s=selector1-fb-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=KPdz73e855N+NeDZITgo6wZDKYSeeAFYIkTCWfsaUEc=; b=PEF4hkBlFsDENBpmjc/Y7In4d/neXHATSqQYkXRTiCdqKjnY4Sxwi/OPCoklfhryhX1M4qBLac72Pp+Gkp6t68rtQxgPRVfaxwdQj4i4S++ax3gpr8JdL1RDB2QS3p12GPhCysbYJn+KAADampMhAyxzCi9hIGIPy6WsRBMGya8= Received: from BYAPR15MB2631.namprd15.prod.outlook.com (20.179.156.24) by BYAPR15MB2744.namprd15.prod.outlook.com (20.179.157.149) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1622.16; Thu, 14 Feb 2019 16:41:05 +0000 Received: from BYAPR15MB2631.namprd15.prod.outlook.com ([fe80::ecc7:1a8c:289f:df92]) by BYAPR15MB2631.namprd15.prod.outlook.com ([fe80::ecc7:1a8c:289f:df92%3]) with mapi id 15.20.1601.016; Thu, 14 Feb 2019 16:41:05 +0000 From: Roman Gushchin To: Oleg Nesterov CC: Roman Gushchin , Tejun Heo , Kernel Team , "cgroups@vger.kernel.org" , "linux-kernel@vger.kernel.org" Subject: Re: [PATCH v6 4/7] cgroup: cgroup v2 freezer Thread-Topic: [PATCH v6 4/7] cgroup: cgroup v2 freezer Thread-Index: AQHUmYm/FY3e3nKVvEu5zzs73euDdKXAH4WAgAU1PgCAAvBngIASo7UAgAToDoCAAAQjAA== Date: Thu, 14 Feb 2019 16:41:05 +0000 Message-ID: <20190214164100.GA8688@tower.DHCP.thefacebook.com> References: <20181222000307.28231-1-guro@fb.com> <20181222000307.28231-5-guro@fb.com> <20190125122713.GA18218@redhat.com> <20190130165200.GA4131@redhat.com> <20190211213036.GA26063@tower.DHCP.thefacebook.com> <20190214162612.GC19102@redhat.com> In-Reply-To: <20190214162612.GC19102@redhat.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-clientproxiedby: BYAPR08CA0055.namprd08.prod.outlook.com (2603:10b6:a03:117::32) To BYAPR15MB2631.namprd15.prod.outlook.com (2603:10b6:a03:152::24) x-ms-exchange-messagesentrepresentingtype: 1 x-originating-ip: [2620:10d:c090:200::6:7cc2] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 41f7b8f2-1f8e-43ca-79a9-08d6929b3664 x-microsoft-antispam: BCL:0;PCL:0;RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600110)(711020)(4605077)(2017052603328)(7153060)(7193020);SRVR:BYAPR15MB2744; x-ms-traffictypediagnostic: BYAPR15MB2744: x-microsoft-exchange-diagnostics: 1;BYAPR15MB2744;20:g0KtTycJbzfQZnhtsfavbUFZDQgigjLRwFl3q7M4YDLgqTzKgTmgXE7Z9wy/+DnI3rvLQonRK57RCb4/ByonaYnVfb/ecg/AgCbhvi+FWYIhdDzhTWjR6t+MFFIZxjXORPvS6skzqLGjXK9zBV7uonrBkwk7UEmLsU1SDlNcp9s= x-microsoft-antispam-prvs: x-forefront-prvs: 09480768F8 x-forefront-antispam-report: SFV:NSPM;SFS:(10019020)(346002)(366004)(136003)(376002)(396003)(39860400002)(189003)(199004)(6246003)(6506007)(6436002)(54906003)(386003)(316002)(229853002)(6512007)(106356001)(53936002)(6486002)(25786009)(93886005)(6916009)(102836004)(105586002)(2906002)(9686003)(33656002)(186003)(8676002)(81156014)(486006)(7736002)(1076003)(81166006)(476003)(4326008)(68736007)(446003)(33896004)(76176011)(6116002)(46003)(256004)(71200400001)(478600001)(71190400001)(14454004)(8936002)(86362001)(52116002)(11346002)(305945005)(99286004)(97736004);DIR:OUT;SFP:1102;SCL:1;SRVR:BYAPR15MB2744;H:BYAPR15MB2631.namprd15.prod.outlook.com;FPR:;SPF:None;LANG:en;PTR:InfoNoRecords;MX:1;A:1; received-spf: None (protection.outlook.com: fb.com does not designate permitted sender hosts) x-ms-exchange-senderadcheck: 1 x-microsoft-antispam-message-info: SgTw2t8g0gra4FgVDcoK+THqo/1x7pcuOJu4lctUMjuoZs8/icPRt6WJIEfktAQ7Z7wiUGUyVgV+tRnhpeiZVJnyjRA4KI0pKbPobXmQYTYBYfhHxKkSGUQ30gFgrglZxtm5pN4a4LOqXLsl0mRUFnGb7M1Msf3T7+75n5kAPtwIgFvIWOFJZcqtWGBDsnPJzX7Oq7UfEjMjc45Pacr6ddtQLAlGyvAOW12bBmNV51TUhKqdzfoB8PyiFA40sq0eHQQFk3BRbIWjX6gAlpemG/U23AyphxHCebsBVSDHjoNguS5Ss55lQ/W30PclBhdPaHiZ9xRzoUB48DmVUpw+0moC9ZDMDi9hSDHgxToi2JwiNHag43mmYJuU0GvaP0AA4mLl5Pg3dQBtWRmATrGUrGXzUEmyvyaqr5Wx6oc011Y= Content-Type: text/plain; charset="us-ascii" Content-ID: Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-CrossTenant-Network-Message-Id: 41f7b8f2-1f8e-43ca-79a9-08d6929b3664 X-MS-Exchange-CrossTenant-originalarrivaltime: 14 Feb 2019 16:41:04.5961 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-id: 8ae927fe-1255-47a7-a2af-5f3a069daaa2 X-MS-Exchange-Transport-CrossTenantHeadersStamped: BYAPR15MB2744 X-OriginatorOrg: fb.com X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:,, definitions=2019-02-14_09:,, signatures=0 X-Proofpoint-Spam-Reason: safe X-FB-Internal: Safe Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, Feb 14, 2019 at 05:26:13PM +0100, Oleg Nesterov wrote: > On 02/11, Roman Gushchin wrote: > > > > On Wed, Jan 30, 2019 at 05:52:01PM +0100, Oleg Nesterov wrote: > > > > > > Worse, this looks just wrong. In the latter case, cgroup becomes CGRP= _FROZEN > > > right after a 2nd task migrates to this cgroup, before this new task = calls > > > do_freezer_trap() or cgroup_enter_stopped(). > > > > You're right. So, it looks like the problem is in the equation > > nr_tasks_frozen + nr_tasks_stopped =3D=3D nr_tasks_to_freeze , > > because a task can be frozen and stopped simultaneously. > > > > So, basically it has to be > > nr_tasks_frozen + nr_tasks_stopped >=3D nr_tasks_to_freeze instead. >=20 > It seems you didn't read the paragraph above, or I missed something... >=20 > How can "frozen + stopped >=3D to_freeze" fix the problem with the falsel= y true > CGRP_FROZEN ? It helps with the problem when cgroup is mistakenly reported as non-frozen, and adding a task makes it frozen due to increased nr_tasks_to_freeze. But you're right, it's not correct. I have to think more how to make the accounting work correctly with stopped tasks. Roman