Received: by 2002:ac0:aa62:0:0:0:0:0 with SMTP id w31-v6csp2618177ima; Mon, 22 Oct 2018 12:51:48 -0700 (PDT) X-Google-Smtp-Source: ACcGV61F8cLYR+Tztz2sO5m37JbwVcf6AW6Kw4GIonn/eTJ2pQSlTqSq5TFsnKDs4oioqK8Sjsag X-Received: by 2002:a63:a902:: with SMTP id u2-v6mr44257590pge.207.1540237908617; Mon, 22 Oct 2018 12:51:48 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1540237908; cv=none; d=google.com; s=arc-20160816; b=xybbAE/eL9r/iUui5XVHUBp1MjCxDjki4cfhvuy4w0s8I/0l5+hbh97gNtNBVPkxY2 IV1wiynGlonP9M7m/wWsm/uvcNhOuL+u8dhF4YiQrJYULoMy1RIxriJ31PfKVtFOaubn fY0jdrNr/ywLtu++1PXXm61r8UiSnzrw48341aHSlfal/OryOWzLwtTpOUQ93uc+aHOI RHVzZNM3ug51c/BcCMrVQpUO3SJ8p/u4gCTAglZlaCEH6/z2sUdAEShJSohUpeEm+5nN p45L0iNPT9wrMX7uhR5awNAmR1H6BY+fo/vimo95VboIsJC0ZjFL/Opiwr+Elug/r0FL 4+Mg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:organization:from:references:cc:to:subject :dkim-signature; bh=XFwxmK7iDoxHdWyToLU4Am7OJ7HnxcXSQILb4j0RfgY=; b=xK5ebgY7R31RWwGDJnZokjwG85FX4voB4xeCVXs7a++cuWmKKmcAyR0OLUh18TnfYh yu2VU+sDTDV/8KRz9LC3z0vwgcZzerEyoK710Vua7vUKvCHrAd17oe9XPXZfUTq3ZqSZ PLV6yM5dz4OoVVmXxFmvY72HcPP48ubsMJStk9FR0uDGx0GG7uXwPDbnTYSk8aV8hVhj K51IaWYPv51NzkuIg1L7+3VXnVc3f5ih3SWfYRLrrf4SHUm3hj5Y3ARMWtQSBJouok8i mZR3f7u6nN6y6KTJ4CBMgLUhAOTj8OoQtwNuj3+ftvWFoA9xsuPjP/uB17gCQGZPa9x4 bkKQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@oracle.com header.s=corp-2018-07-02 header.b=eL2Wf8Mt; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=oracle.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id bf12-v6si32866222plb.22.2018.10.22.12.51.33; Mon, 22 Oct 2018 12:51:48 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@oracle.com header.s=corp-2018-07-02 header.b=eL2Wf8Mt; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=oracle.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728303AbeJWDHV (ORCPT + 99 others); Mon, 22 Oct 2018 23:07:21 -0400 Received: from aserp2120.oracle.com ([141.146.126.78]:49846 "EHLO aserp2120.oracle.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727748AbeJWDHV (ORCPT ); Mon, 22 Oct 2018 23:07:21 -0400 Received: from pps.filterd (aserp2120.oracle.com [127.0.0.1]) by aserp2120.oracle.com (8.16.0.22/8.16.0.22) with SMTP id w9MIiIrJ157874; Mon, 22 Oct 2018 18:47:20 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h=subject : to : cc : references : from : message-id : date : mime-version : in-reply-to : content-type : content-transfer-encoding; s=corp-2018-07-02; bh=XFwxmK7iDoxHdWyToLU4Am7OJ7HnxcXSQILb4j0RfgY=; b=eL2Wf8MtlP4brC4E19V8dPAQJ3cIxSBOjTjuii99Xk74rxCHMNGIy4B9GOLBlRi/vWbV S1zBxPZxYFShC93B0oyTMKtJvFii/7v1IQ3vdJcfImoXEBhbk9FMQuaoVMklzg8ZItQZ A2vSstfz8Kj7FuBgsxbfJl/rY2eYx8k/c9h8AWf2ySftOgEoonT8wWP6mZLxCoJFLAp/ oYcf1El7DC5Ylpl1WL3YVScr7Esa4S0A+Uyv7xM6+0bbNwogvKm7w/0yz8vkS7Ed/Tbp hEe1zJc8chqJo+VzxpSK72V+DHPFRajHGLLIvWD7nIbgIuKvqS6O2xNO71RlJXW44Wj+ jA== Received: from userv0021.oracle.com (userv0021.oracle.com [156.151.31.71]) by aserp2120.oracle.com with ESMTP id 2n7vaprfk2-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Mon, 22 Oct 2018 18:47:20 +0000 Received: from aserv0121.oracle.com (aserv0121.oracle.com [141.146.126.235]) by userv0021.oracle.com (8.14.4/8.14.4) with ESMTP id w9MIlIwp017732 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Mon, 22 Oct 2018 18:47:19 GMT Received: from abhmp0017.oracle.com (abhmp0017.oracle.com [141.146.116.23]) by aserv0121.oracle.com (8.14.4/8.13.8) with ESMTP id w9MIlI21017594; Mon, 22 Oct 2018 18:47:18 GMT Received: from [10.39.206.107] (/10.39.206.107) by default (Oracle Beehive Gateway v4.0) with ESMTP ; Mon, 22 Oct 2018 11:47:18 -0700 Subject: Re: [PATCH 09/10] sched/fair: disable stealing if too many NUMA nodes To: Peter Zijlstra Cc: mingo@redhat.com, subhra.mazumdar@oracle.com, dhaval.giani@oracle.com, rohit.k.jain@oracle.com, daniel.m.jordan@oracle.com, pavel.tatashin@microsoft.com, matt@codeblueprint.co.uk, umgwanakikbuti@gmail.com, riel@redhat.com, jbacik@fb.com, juri.lelli@redhat.com, linux-kernel@vger.kernel.org References: <1540220381-424433-1-git-send-email-steven.sistare@oracle.com> <1540220381-424433-10-git-send-email-steven.sistare@oracle.com> <20181022170604.GG3117@worktop.programming.kicks-ass.net> From: Steven Sistare Organization: Oracle Corporation Message-ID: <1356a3cc-a9f2-6593-4737-1b20fc5daa75@oracle.com> Date: Mon, 22 Oct 2018 14:47:00 -0400 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.9.1 MIME-Version: 1.0 In-Reply-To: <20181022170604.GG3117@worktop.programming.kicks-ass.net> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Proofpoint-Virus-Version: vendor=nai engine=5900 definitions=9054 signatures=668683 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 suspectscore=0 malwarescore=0 phishscore=0 bulkscore=0 spamscore=0 mlxscore=0 mlxlogscore=739 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1807170000 definitions=main-1810220160 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 10/22/2018 1:06 PM, Peter Zijlstra wrote: > On Mon, Oct 22, 2018 at 07:59:40AM -0700, Steve Sistare wrote: >> The STEAL feature causes regressions on hackbench on larger NUMA systems, >> so disable it on systems with more than sched_steal_node_limit nodes >> (default 2). > > How come? From a quick read the stealing is per LLC, where do we steal > across nodes? See the complete explanation in this patch. It is deeper than can be gleaned from a quick read. - Steve