Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1754952AbdIGQn2 (ORCPT ); Thu, 7 Sep 2017 12:43:28 -0400 Received: from mx0b-00082601.pphosted.com ([67.231.153.30]:35573 "EHLO mx0a-00082601.pphosted.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1752235AbdIGQnZ (ORCPT ); Thu, 7 Sep 2017 12:43:25 -0400 Date: Thu, 7 Sep 2017 17:42:45 +0100 From: Roman Gushchin To: Christopher Lameter CC: David Rientjes , , , Michal Hocko , , Vladimir Davydov , Johannes Weiner , Tetsuo Handa , Andrew Morton , Tejun Heo , , , , , Subject: Re: [v7 5/5] mm, oom: cgroup v2 mount option to disable cgroup-aware OOM killer Message-ID: <20170907164245.GA21177@castle.DHCP.thefacebook.com> References: <20170905134412.qdvqcfhvbdzmarna@dhcp22.suse.cz> <20170905143021.GA28599@castle.dhcp.TheFacebook.com> <20170905151251.luh4wogjd3msfqgf@dhcp22.suse.cz> <20170905191609.GA19687@castle.dhcp.TheFacebook.com> <20170906084242.l4rcx6n3hdzxvil6@dhcp22.suse.cz> <20170906174043.GA12579@castle.DHCP.thefacebook.com> <20170907145239.GA19022@castle.DHCP.thefacebook.com> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.8.3 (2017-05-23) X-Originating-IP: [2620:10d:c092:200::1:e943] X-ClientProxiedBy: HE1PR05CA0211.eurprd05.prod.outlook.com (2603:10a6:3:fa::11) To CO1PR15MB1077.namprd15.prod.outlook.com (2a01:111:e400:7b66::7) X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 8a6cee1f-1611-4ff5-7c3f-08d4f60f8164 X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:(300000500095)(300135000095)(300000501095)(300135300095)(22001)(300000502095)(300135100095)(2017030254152)(300000503095)(300135400095)(2017052603199)(201703131423075)(201703031133081)(201702281549075)(300000504095)(300135200095)(300000505095)(300135600095)(300000506095)(300135500095);SRVR:CO1PR15MB1077; X-Microsoft-Exchange-Diagnostics: 1;CO1PR15MB1077;3:VN9bmDmLxN3OQQWAoexlMZ6l+7DXYQ6Byi93ZQqijNS/ei1PG7LkTHFBP1MpjZBADLLVadOjY/U+mpnzW+EicRapgDoiEHT/4u1/CNIn2m96HNnqysI+URsAyVlOQYVI3HxrjQrlQfY1gX4NRiLCpUpkYcmMlJ385D6E9q6h97dgxRees4enmDHMAEEwY4L1wkA597I+nVQFdtNK4siaMo+WTry/5cH7CFG82CrhCGDB1VMY9jtE33TVdgv36jLT;25:qavE9sTORyhmeGjx2XyZdvxD4hqpYxegPAWbJpuh/QyCm+JxlALxTSANNyGisGJGGJs9ItD/hhqenGkuNe6vPxYl3JfKfZ6SRG9yoNFdLRNuuCwukUUhKA1yDzSyl2pAJGybpGKTt8aZoXU2tP6zUkZ1OXzjED+iX+3LgRAPxB7HYBVALNkKJgEDmakJOV+EStbxONGWcvRjofx9UoCSryvkLyHCC3O7RRhmZFV/2u00lRK+TjerIyHolTCBJC4pY//j3FRzsU1x1amHLbx+SKdfBva3VBFpml/Ugg9Cru+uHKVkJlwASkbw19BBy9mQgb4nybE2OiWBgzqKUYGu3Q==;31:/9qqG/wQunzQuF85/0fmBHDriXO2CZY/ZfmP08eiIacDmQlwdNIGr4XljDr32No3avHADlc2W3REitMaI1tiaOe3yDlLUKw3NKQ9t6mdagUvAkFkZfLeFruKRETCBrj/X3FJJfkl3etcew8HvaYXn2M0+Vqc00f61ka5eyD2stxpFWl6mpeNU50f7c2Z+aDDsndv2jlm869FqwHqxVCrQn2LSouBoJmsCudqR7K3/O0= X-MS-TrafficTypeDiagnostic: CO1PR15MB1077: X-Microsoft-Exchange-Diagnostics: 1;CO1PR15MB1077;20:zLr+UZhOr5kgfHpfsm9GaySd6rHQrrGslaqZk9BFxvuV8VA/28K4T8M5+3f0WM0Wd8TM81w4pHDXWcQaAb/bwsVMuU7G3sQ1AEvuhafy2tGA7FTMkRaXQ6SdPnULxAexREthd9YBX04JvPVPhAprtC8r4Sj3/MJI4DsD/YzmZzAWSbhDSh5LeNELmnQ0MjaW5dLcYaRC7xbQE4pJ22SOTywyl/5M9Ng+kp2/qzQl1GsyygzlMoeMkT+q46GLfxuL0elrTcAHYhLg/YLvN+tbdOmv7K17Q6C/UFhWgFFwxvGZBXYA8nh6I+XKLEYHXbHlSkMTntxOjlA99o4IXaaQo/5W4DH+IvG7bbl0vT1Xmvit1NYxDAJyIQw2Ue2ffyZKvmpQZ8keUZA0B0QmnDnjs4QQ017ovZN80J5c1b+zSvSe/j/RpwcXzcOjfc5m3ryO6fGzDMVd5crNMNYF2CtYrEJCFUB8+U5ikS9iEXJ3ImNcILNLYEhtHOGQEoXV7KkS;4:ANnJ7UDBPvOCqpO4WZG6j8wz9bLMd6LzAcwyGrgEIdMujSuIw+tl91DnyEMLJgNbLpaIrvBjRMTkOsuOKwqRhYNTV0V7CjIyTEbEA9vq2wDihxb3QHUSh/kK4QCuhTNFsKJ6a478KZ4VSP0vtePbPsQF7KzuxWRXjwQM5tWrcJ0HS2S53BsTNrrsjCoghxWTfelIcoFXQmfKbuiI77Y4hQaZpok73mP5Vi90XXBay3xgExgPTsyP4Y4t6JJfek2d X-Exchange-Antispam-Report-Test: UriScan:; X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-CFA-Test: BCL:0;PCL:0;RULEID:(100000700101)(100105000095)(100000701101)(100105300095)(100000702101)(100105100095)(6040450)(2401047)(8121501046)(5005006)(93006095)(93001095)(3002001)(10201501046)(100000703101)(100105400095)(6041248)(201703131423075)(201702281528075)(201703061421075)(201703061406153)(20161123560025)(20161123564025)(20161123555025)(20161123558100)(20161123562025)(6072148)(201708071742011)(100000704101)(100105200095)(100000705101)(100105500095);SRVR:CO1PR15MB1077;BCL:0;PCL:0;RULEID:(100000800101)(100110000095)(100000801101)(100110300095)(100000802101)(100110100095)(100000803101)(100110400095)(100000804101)(100110200095)(100000805101)(100110500095);SRVR:CO1PR15MB1077; X-Forefront-PRVS: 04238CD941 X-Forefront-Antispam-Report: SFV:NSPM;SFS:(10019020)(6009001)(199003)(189002)(24454002)(25786009)(1076002)(9686003)(55016002)(4001350100001)(39060400002)(4326008)(478600001)(53936002)(54906002)(47776003)(7416002)(6506006)(2906002)(50466002)(23726003)(229853002)(86362001)(2950100002)(6666003)(6116002)(97736004)(93886005)(42186005)(8936002)(5660300001)(6916009)(81166006)(8676002)(81156014)(83506001)(33656002)(189998001)(6246003)(110136004)(101416001)(68736007)(305945005)(105586002)(106356001)(7736002)(50986999)(54356999)(76176999)(18370500001)(42262002);DIR:OUT;SFP:1102;SCL:1;SRVR:CO1PR15MB1077;H:castle.DHCP.thefacebook.com;FPR:;SPF:None;PTR:InfoNoRecords;A:1;MX:1;LANG:en; X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1;CO1PR15MB1077;23:RbRVY3GXXDAbsM19rZx0x2waQXzbcMP3oUqhOR69n?= =?us-ascii?Q?ZLli2mp5ai2OkHQL9/DPXU7leQpeABWTvoPAoN4YGgak0A7K/KVseZ5ukFDT?= =?us-ascii?Q?oaezCs1wwXBUpnLm0q3oGkg26qITnoiECLjkd/Gw6PA6jvP5wItoyNgfMrgq?= =?us-ascii?Q?SvXYiaClfIKse2ms9+Bqvf5TAeHbYEH7LdAIJ6CdAuOzXHA78pY3YOqRHWgM?= =?us-ascii?Q?9XXKTSIuFNvlWzjdkMtZu8CgweAXObuN3YV4oLhBolSFsvUfRX40WGTJTF8g?= =?us-ascii?Q?Zj5OL7B2inSLQ1bqYChAEOD7UHodluZJ/4OeOR2SEoZoY2xxLg8HNSf9yCt4?= =?us-ascii?Q?LO3+sm+3sb3fGS+lfONuNHtRuG6hG4uMl309xo+DY2L9Y75UEUgij6CdTBQX?= =?us-ascii?Q?O8YtRJrQGqdAqsNMWA3XYBDDm0qmplYFYWdXYcUutPL7YS004QtBDrOiSgMb?= =?us-ascii?Q?6A1WPHOkwXnjF3HPSpU9KQI4RSCizPjg7fqGwqXr/oer8Gi1unQFy62BamJI?= =?us-ascii?Q?jZwYQljspXY0RROMRw6lHjBQP04zLcot0GzKC7Kkjh02KmwwNcJHLP7fbNNd?= =?us-ascii?Q?YkSlppOeVqXIA8XU7mC1uW9fzq0jI/mZxdHbWNH7BIZGbeZiwcRkvT8mJqOq?= =?us-ascii?Q?x/GX7++7K/WUDn2LxCgJ+K6OB646iH+Jvjf3/FED5a6B0HuSG7exJaqbALUT?= =?us-ascii?Q?9+vRY+xII/JCoXzdlTzh01Z/pJURIvea6HagFnWsz92qBa2iZmuSnO8NHAN9?= =?us-ascii?Q?xZsFGSx6G6JS2nFyge9k4anMf9wRCxuXR9k5aJ/H3aL1HED1KpewuMksezD2?= =?us-ascii?Q?GkDjYChFU3b09vz8QCOQk/zZXRBq23MlD1thXZALJMfhFfoAr/975KNWoKZ7?= =?us-ascii?Q?HnB80cIfT1ekAMZWfnvKhXUXiMUE/dsnw+ukFx8oKCVsK0IWJWQWWkEqDkQx?= =?us-ascii?Q?UZBjj0k9xgECoXx4BgboGDZ8+AOkCYXyQzG5vHfrpZ10Q7ZXt54zssFWdDoC?= =?us-ascii?Q?IcHYQ5ERLNK0OrWxzYBW1h/Gy7JTG4A/sDCN5i8C1NdARKwVTcAXLbAPu8i0?= =?us-ascii?Q?8XBV0Yl+d9Y1Jg8kZQ2CjHfeSFNFlxFcO8tF1Ql07YUxqpYGjuG+JIkkq8zY?= =?us-ascii?Q?Fu44rwY0DjeQ5onY3EE5QJtlbDX6xKhdUPUtJ3DDFlngN2DQ1WIQSamgthyl?= =?us-ascii?Q?31yxcdzQtfV4+u8TJTGd7ryyA3Dnqb3tC1e?= X-Microsoft-Exchange-Diagnostics: 1;CO1PR15MB1077;6:ebXtGDFgLPtufIKR66bn6SJcDrorfb7h/WS+QpaWO9MmigE6SCE0JJTcbLYCSZz+TtcUp/czgUzTmztAEcW6a1Xz2pN1EPPDIf0q9uJ9YRIQqEoeMx2FWRALxjuF6nAfHzI6D6SslcnWNfDPxbbEiTnUi4p7Pmw6eG2gnWAUaXrfAyVapb0msYdgRzLLWs5fx3huN7XYHWRuq0L/5rnuNq6NmnmwwcH5S5jTM9b7o6KHSOi0xH8BQdeMNTnZtfk4lzBpnQbNkFqeTvu7JvO7pikG8w4gg0U99ZPm99wJtiMxFwK8oGg+VT8JU7cVKpW7DDAyER4UjOEAimga5F66LQ==;5:u507AB2WQ9gEx9CiDhD1pfMQWFfNQbSZzyzFKqGBg4YqCi7a8Km9cGSsJfBooGirC8KgDkcE8pGyES5P2Gc0iYPZnf+9/tBYUWuHUmy5JidLqhC+AB1MegxvRU73pss+NF8vSpwuqZ+8rS5hbPaI1w==;24:QOVwgwrGG7lIAbiKxxO+txoUxESU8rClRIWW+JcerdtPqpFli4N4TaG1wmdFjndJQUaJ4TTKwJjgzhdTqGNwQrh3KjGgGKqJSGAddDVV+vg=;7:MrPuwtY+rwVUmb9T2CCg7/VMkNCzc8aSClmb5jNtxek6fnR8NnlkUMnAwMRyON6EU41Bqt2ibFQWkhXdNoTld94CmutR9YTX6ru1T596ZSadpjby962/JCuAR7K2xiUqzeUuvp1DODuAFcj0pE6IWNGb2P/u0WSmza2EErtVSQ8U4PE7oyUanjBEi20OwHolF8juSmGn0vyLU/MzQWvvVf/92R6lOtqw0IHc8/sW6xo= SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-Microsoft-Exchange-Diagnostics: 1;CO1PR15MB1077;20:AVg4ykpx5ke5OPQ+6HmdFdmFLgYRcoFVqNnr3tF5s/FE5p0hFFgN9rdN33YKPdvTS92myeFZ0+hSrX6yBACTije8EagWXQNodiBzI8sel6EUfzGfUmPPfATb7HN6Q9kDFmeSscx6tjaaCN76efXaunXSwv3IijGTkjeByPvrWaM= X-MS-Exchange-CrossTenant-OriginalArrivalTime: 07 Sep 2017 16:42:58.0619 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 8ae927fe-1255-47a7-a2af-5f3a069daaa2 X-MS-Exchange-Transport-CrossTenantHeadersStamped: CO1PR15MB1077 X-OriginatorOrg: fb.com X-Proofpoint-Spam-Reason: safe X-FB-Internal: Safe X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:,, definitions=2017-09-07_10:,, signatures=0 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 1214 Lines: 23 On Thu, Sep 07, 2017 at 10:03:24AM -0500, Christopher Lameter wrote: > On Thu, 7 Sep 2017, Roman Gushchin wrote: > > > > Really? From what I know and worked on way back when: The reason was to be > > > able to contain the affected application in a cpuset. Multiple apps may > > > have been running in multiple cpusets on a large NUMA machine and the OOM > > > condition in one cpuset should not affect the other. It also helped to > > > isolate the application behavior causing the oom in numerous cases. > > > > > > Doesnt this requirement transfer to cgroups in the same way? > > > > We have per-node memory stats and plan to use them during the OOM victim > > selection. Hopefully it can help. > > One of the OOM causes could be that memory was restricted to a certain > node set. Killing the allocating task is (was?) default behavior in that > case so that the task that has the restrictions is killed. Not any task > that may not have the restrictions and woiuld not experience OOM. As I can see, it's not the default behavior these days. If we have a way to select a victim between memcgs/tasks which are actually using the corresponding type of memory, it's much better than to kill an allocating task.