Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1751589AbdIMV4z (ORCPT ); Wed, 13 Sep 2017 17:56:55 -0400 Received: from mx0a-00082601.pphosted.com ([67.231.145.42]:48510 "EHLO mx0a-00082601.pphosted.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751330AbdIMV4u (ORCPT ); Wed, 13 Sep 2017 17:56:50 -0400 Date: Wed, 13 Sep 2017 14:56:07 -0700 From: Roman Gushchin To: Michal Hocko CC: David Rientjes , , Vladimir Davydov , Johannes Weiner , Tetsuo Handa , Andrew Morton , Tejun Heo , , , , Subject: Re: [v8 0/4] cgroup-aware OOM killer Message-ID: <20170913215607.GA19259@castle> References: <20170911131742.16482-1-guro@fb.com> <20170913122914.5gdksbmkolum7ita@dhcp22.suse.cz> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Disposition: inline In-Reply-To: <20170913122914.5gdksbmkolum7ita@dhcp22.suse.cz> User-Agent: Mutt/1.8.3 (2017-05-23) X-Originating-IP: [2620:10d:c090:180::1:24be] X-ClientProxiedBy: CY4PR0601CA0006.namprd06.prod.outlook.com (2603:10b6:910:87::19) To BL2PR15MB1074.namprd15.prod.outlook.com (2603:10b6:201:17::8) X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 0bacad1d-7560-4a45-0242-08d4faf2432e X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:(300000500095)(300135000095)(300000501095)(300135300095)(22001)(300000502095)(300135100095)(2017030254152)(300000503095)(300135400095)(2017052603199)(201703131423075)(201703031133081)(201702281549075)(300000504095)(300135200095)(300000505095)(300135600095)(300000506095)(300135500095);SRVR:BL2PR15MB1074; X-Microsoft-Exchange-Diagnostics: 1;BL2PR15MB1074;3:AMq2K+RN/biFtJCasKuAyWSWwDB0VVVHo1NLndcBrTxu8BDgxWe4FaEAadvnVSgs0yRaxY5xz+uGgDs6KkZ49RtW/8zR7nqXqgg4gOEIlzBXGgeyku9V0vTmOU0XbpvY5VNXpEDe/M5QgF8QF8R4dDfAyJdRY2f3DGhwbU1x73ZmBolbha7vNr+mn8upUOwbrFhh1JC4hU0x/K5WgQDgiZjT9OKk7Bs30CtkxRxfhiMLRzvjoVbhOq2kZOyH196t;25:T1YP23ahvjJOkF9sBMcRuGD+5QypE3x60DNJZSL7EDeBMPvE2DIOwI2ME7sS1XHPEUmrnh3vIIINNaASNmGkEndLmYyitK2aQn5tQhIupxVkPXhKJMc2mJnrgyLWNOTuMXXG3mPTOyig2KObp6mxyLyPNbmB6OvxvoqwukSIJtn1QlHsgU6suP1mYHPWRXuCsPL4X1QDLmXxKzDUZGcnMAYm1ddyKP4NkAmleVPmXpJckNsgMYlQCV6BK2GVQkxgyXOomgACXDo9aK31K304vAfJ2GP7A1tl9kDSJ4i5ZBw5SlsUhcyRH0EDv1OZRjjrFVbiqOFLD5xfNoJNxjgcMQ==;31:FOL5hRNKZUrdXwSi5lQcrtwRsx+IiFyL7Z2qM43/CJmESer/xA6/4doADcFNNxWLhWe9DAPXRluMw1uyZOM6DFL9wyOKv/gtXfLIU0rVUgn1t1PC9SRN76zIt3Sz6914Ub0d/GDEITmJawjCtOWxPF20dtXmeoKojJguwLmMNDEf4Pk5lVIpogNZB1kp00dpV+h/Z5hZEYCUcGr7UNFsAee0bImgQRZ0aNXv7xI4AXg= X-MS-TrafficTypeDiagnostic: BL2PR15MB1074: X-Microsoft-Exchange-Diagnostics: 1;BL2PR15MB1074;20:cxSyVskNKa/060RaV8VtCqksSkaUdYHMNYJN4ucZdmXludjxhXKY2d0f5whF0FOcZ4CbygmLsLcDWm5XSzucVAxdhsQQWK+zmC9mHOiXR0/KEK9pzgMLY1hZ9vepJwWJy5sKMFxTuqN9mpNGCaZbJZ/b+sHbM6+pCOe/NPS/lt4v+VcWpClB6JLmo+6PCqN1EKgQYAAIE0DaEt4XfEXLlgPZYX+YigFk6ju6nrOcdmdHQ/anZyxiWlczCeS6KEHfoFB2H8eTxeeY8ZRNEput7qNEn/wVOKwbMjFBABY/iJsBhvJyYrM4JyoABbJdlCdijWs6iQyCIWqZDdTjBr24YckOJPSc4amcwGymI03Azknj+QyLmJoV9xTwb/2qh8gcJm56a8puma3utmAkdR/Pl/We3UDEguaVx29n6uN+GT9I0gLKV+RanyQ68jvEvQo324td6fTB4Qy+IX1v4PT/Y9XUrIVfcHOHFwsnQQf4BBsfgnn3Gts5YsRxCaBk4nnY;4:PI0EFscbqz0yC8fguh148OGV6xLsphcmJBl6WP6EPpfFsi+sye0ZxRpjr9p3nXSn7lO8QupG2mZXmO4PfDcVm2NBjUy34DK/P0+SFDQG6NbeGYH/45HuBDpEnfGsce7xagN6VvT5K2UOIKNraEwB1bIFU3KdE+VnDSgYCnQ0kZ+peYCWFlra9WMjwiojuXIWgs/jW+MW2LIZ8bbz0n/PqAJa6YuGR9egMJW/jc2VXaD39nI28i8yoFFvuqFNXPHJ X-Exchange-Antispam-Report-Test: UriScan:; X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-CFA-Test: BCL:0;PCL:0;RULEID:(100000700101)(100105000095)(100000701101)(100105300095)(100000702101)(100105100095)(6040450)(2401047)(8121501046)(5005006)(93006095)(93001095)(100000703101)(100105400095)(3002001)(10201501046)(6041248)(20161123562025)(20161123555025)(20161123558100)(20161123560025)(20161123564025)(201703131423075)(201702281528075)(201703061421075)(201703061406153)(6072148)(201708071742011)(100000704101)(100105200095)(100000705101)(100105500095);SRVR:BL2PR15MB1074;BCL:0;PCL:0;RULEID:(100000800101)(100110000095)(100000801101)(100110300095)(100000802101)(100110100095)(100000803101)(100110400095)(100000804101)(100110200095)(100000805101)(100110500095);SRVR:BL2PR15MB1074; X-Forefront-PRVS: 042957ACD7 X-Forefront-Antispam-Report: SFV:NSPM;SFS:(10019020)(6009001)(376002)(346002)(377424004)(189002)(199003)(24454002)(2906002)(105586002)(39060400002)(101416001)(33716001)(6496005)(33656002)(50986999)(97736004)(6246003)(54356999)(106356001)(86362001)(76176999)(229853002)(5660300001)(25786009)(4001350100001)(6666003)(16586007)(2950100002)(110136004)(4326008)(50466002)(6916009)(83506001)(68736007)(316002)(54906002)(8676002)(7736002)(305945005)(7416002)(81156014)(9686003)(23726003)(189998001)(6116002)(1076002)(55016002)(478600001)(8936002)(53936002)(81166006)(47776003)(18370500001)(42262002);DIR:OUT;SFP:1102;SCL:1;SRVR:BL2PR15MB1074;H:castle;FPR:;SPF:None;PTR:InfoNoRecords;MX:1;A:1;LANG:en; X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1;BL2PR15MB1074;23:CJtFcVzX2SP37qg0h6u2jO/iRY4ofGEPjwsObpjTV?= =?us-ascii?Q?MF6zcuuQLV2Orm7E0D/tAO80AQCAdsn6pTC+FON1iZ/n5AC8dlqzE7ojVH30?= =?us-ascii?Q?P6j9F0QRm3XGehTTGnCserAPoCK/PBVkRLfMev6MW/7TEqA+xbMnP3B4RuPU?= =?us-ascii?Q?v3bLZ61/4wHQiiMEp8YBJeAx0wk70d0OFDafqWUD0kUtgjG6SA6m9wGbqpPr?= =?us-ascii?Q?wLb3feJQZw2zwVcS6SpXVRRxd+eKmapsH+lucEW9/U12mkk11Y0YOUOOTscs?= =?us-ascii?Q?FtsfCc6mE/vpnL5OIC7LoEiybyty0KltVDEpbQRuFjmQeiZSy1eVJw5JnOSk?= =?us-ascii?Q?IgbxuilQOu9t1Ux+X17+gAnjnR2KsAU0JEAcEdUBz6u7jZGl+4oylUuH8juK?= =?us-ascii?Q?qpcwPiQ/Zp2EmTepbTtXDYrT0DxL6co9DX5uMR7RjvsFlNmEQyNbuMbpZdHx?= =?us-ascii?Q?VA6Q7SZtE5WfSs90OhcwB8HAxUYlMVrqjkGbFmAXzIXb+fLjygkjXoD4H9Re?= =?us-ascii?Q?GA2MizcIDuhse1YoUmc5fdQdjKZx9Oxq8WdlsxOehh0FzW8oQhXAmpIY+16y?= =?us-ascii?Q?vYcoRJpLTfcv9exezLe1xAoHU5kfZqJcKnwjK8nbtJ4OiioDJqqdgj2z8kRT?= =?us-ascii?Q?EVgwTHPcCq0WI7AAf2ggYkCyoZzP0gtSUly5nYVNc7y0+cOMqGBURTO95/tM?= =?us-ascii?Q?phNp2iAqaWl7QFMtdZDFjhFP1R2f/3t6cp04OvlgePU/KLVlP9y4Xe/3Xw67?= =?us-ascii?Q?L4emJAqZ98im7k6wWWqWEkq2w9ZKEZEVDVLOc3ePhonisb9t2Tz1Aq6bZ+25?= =?us-ascii?Q?KP9tmLMB1ZpWt7QIOCEiy6y+GjlAfa1Tk1rdWxxYrihdvO2LLd6AK/rAeVz4?= =?us-ascii?Q?HiHolzfBmRGdYUUfxJ8tacz6joiBNDajhJKTa+3TeKtv2umGK1023FO+2sB2?= =?us-ascii?Q?sbvR5aXu9JyKOxMTcCisjpq4AMnVw0bM/uLGN7Tw/aGmcRJSKPZhcbgcvYVG?= =?us-ascii?Q?05pnfKYjylGj8S6YVnuuY1lQZbeEmE70FzuePPnRQI1uhMNGq67GpO4GQH4P?= =?us-ascii?Q?dwB6cnauKOVSu/mhEEJEenBFFrTybSnQJ6lMETtNz7lcVuKOFsUQL6QBjWoG?= =?us-ascii?Q?6EC4bIqqJbm26UgXkbau4O2o2xvIi3fpjb1SgtQ7pH4/Fms0RhPBeha7b2Zy?= =?us-ascii?Q?xuv0EzC7iglxtv2Jba7HBkEpZsEma4yq/ph7K5QzwfscAFWoqS5uktHpu7ch?= =?us-ascii?Q?cBSY5w+T++6U4KBpyZw99fpSVmgzruGJcCz0dQf?= X-Microsoft-Exchange-Diagnostics: 1;BL2PR15MB1074;6:4jtBW+7qb5ORE6c00ItDWp29wxpl+vF6xLT5LJYgD2dRAyO3AC3fb9GdvGAvtAPZwH62da1paMPBMzry006/Ar5O3XE7OcUIEIOqjcZdqTSIErPuCjFv7a+cRCigEMgrbYzw3KOChUAniNaS+hZd3chvhfdD4LW7Uz+Qcx8jqsJRTwTYTaDpWeZnHjyXwaCVTpagBTTV5IX7T+bMzx9DAL6YJzXsNPpnRMT81kTUTUcNkHxM8NAJyOWVyKJpEvjXP2yI6E54wBHCS005D0i4f3vvlGrRYwJTzm9tcfORuGhvDIy3lcIHmaguCt4NISbvngZwXgPeZnGlMZ/qXrQ0Pw==;5:wFZ8lZX8JXraWAb6DuQxxAWS0H6WhhOHG8QDvayDlznUzJTNwTmYH4E93AX0gxL2U6r5wpzZcgqyn58Rnw9WEgiGRjTvbbJdmGrFdMhzcjeTCxTj4pY5/DxtrAmHPotMUre2FMm7pQKTuzOnC2NxCw==;24:r31mT1zADlla7ZlMznoOOCQI9TcnDsHz0r/WarDypL4R6WbEHvVvoOJv4czciSj/ZJxW/nd8zCt5BVNWBHuw8Q+G9iJQbXbEQnQHOQBaE3E=;7:dULnbn0leMlAJmqGTTLYCKxqgNE6WXyy1dM1/bqMqziwpZrLXImIhVJ5ADZfGXFTzcH7K7CoKJqGnZte+drhZ48O76ZrgtusjI6IVfDct5aAj3EM0fq6TDWgnxVRvaony9Fw+W/4//ltisFUS/Kxr9SXNq+PDhVlp7ioPccB+bAsetqeXmXe9pP2wjbDXn/GQXFgCrNcC8kt8FGjmhT9qun5fUhpCuYmUjCyAme4wo0= SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-Microsoft-Exchange-Diagnostics: 1;BL2PR15MB1074;20:oMe+BSLF5R/vwo6ruvO5hGkTfTD6pSjzEU8bphVnKhyZgKSF8AKnEHE4f0NtM47fBB6Vsj7x6WqN03sdaNcBZ+sf9Fh3PzOjeS6321yCSEjbXl/D9NWH0tab9XuqNBLcRdW+licmAig/DTkz/Zz7U1t8xByArPQGz4gc1M7LlAw= X-MS-Exchange-CrossTenant-OriginalArrivalTime: 13 Sep 2017 21:56:16.0481 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 8ae927fe-1255-47a7-a2af-5f3a069daaa2 X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL2PR15MB1074 X-OriginatorOrg: fb.com X-Proofpoint-Spam-Reason: safe X-FB-Internal: Safe X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:,, definitions=2017-09-13_06:,, signatures=0 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 1569 Lines: 41 On Wed, Sep 13, 2017 at 02:29:14PM +0200, Michal Hocko wrote: > On Mon 11-09-17 13:44:39, David Rientjes wrote: > > On Mon, 11 Sep 2017, Roman Gushchin wrote: > > > > > This patchset makes the OOM killer cgroup-aware. > > > > > > v8: > > > - Do not kill tasks with OOM_SCORE_ADJ -1000 > > > - Make the whole thing opt-in with cgroup mount option control > > > - Drop oom_priority for further discussions > > > > Nack, we specifically require oom_priority for this to function correctly, > > otherwise we cannot prefer to kill from low priority leaf memcgs as > > required. > > While I understand that your usecase might require priorities I do not > think this part missing is a reason to nack the cgroup based selection > and kill-all parts. This can be done on top. The only important part > right now is the current selection semantic - only leaf memcgs vs. size > of the hierarchy). I agree. > I strongly believe that comparing only leaf memcgs > is more straightforward and it doesn't lead to unexpected results as > mentioned before (kill a small memcg which is a part of the larger > sub-hierarchy). One of two main goals of this patchset is to introduce cgroup-level fairness: bigger cgroups should be affected more than smaller, despite the size of tasks inside. I believe the same principle should be used for cgroups. Also, the opposite will make oom_semantics more weird: it will mean kill all tasks, but also treat memcg as a leaf cgroup. > > I didn't get to read the new version of this series yet and hope to get > to it soon. Thanks!