Received: by 10.223.176.5 with SMTP id f5csp3031039wra; Mon, 5 Feb 2018 14:34:27 -0800 (PST) X-Google-Smtp-Source: AH8x226Uj83haGD/xOVcsyJfuxFRs+JV6ny0Dq+qNO4L2uJOlI+H4DS30ntuSF36UvZWa6l1ywDj X-Received: by 2002:a17:902:868f:: with SMTP id g15-v6mr310363plo.137.1517870067193; Mon, 05 Feb 2018 14:34:27 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1517870067; cv=none; d=google.com; s=arc-20160816; b=AEfdUBg3/6i7ZYMJJF3/OFOKw+9Iq+j75zhtubhsfm8l0NTzw7y9hbGrZyFjSaY4U7 XkdUV+VuzhuIRV+wjkWY9pbTLjYR4QeNWZeVOoW+XUPzEjg0hfiYw4l8VORui+7tVteu Z0+Tmz1ecykp3i9p7W7lfhIf/x+NkMcsL53oCFMMcErMlQ9xzLOdBQZmKdZQdAHVxuoo diyAoQy5ulbuEjEbC6E81AO7S5oPK5JApvngPhPmiGEXLZJSj1nipHNwvjvdC4dm7n9e W0gclZYs39ZfJU6DigdiZ23qzHOLkOlPi7t8fxkgHQWpkBtcPzC0iYO5IxfgJqM+5nXi PbrA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-language :content-transfer-encoding:in-reply-to:mime-version:user-agent:date :message-id:from:references:cc:to:subject:dkim-signature :arc-authentication-results; bh=wrWN/wQHYGwx2PKYcIk0LR+6t/DOQ8PpWPiw+mnv6mk=; b=PU0NTrUWFnUucB+WEkhb78jrZnt0G7S63vqYoyz4S0y2hEIEIM+13LBsHoGnApyafL KB4Wt4CxRAHkVT3O1/Jewi0K8DMatECbuKhrHPGA6rP6AqPbBPPMvdhi6uLG5D2CPv5z EGG6S3ph/LCXnnY23t/C6kdsAHqnR36qj8PQ49ClBF/xwMuDRuqAArEIGzjCD0ROk3Vz R9kSLaGazlwFgnGBQMxVSKt+rAdjbxsx4sJ7YAuswAHFkPo/w3vdhpNOjsmJm4ezzozB RyotDP6YAQMW51PhpAZnnGh+i0qR3QW+fq8vLO6163zgNbuKjwe8YnwFg7kXdeCaLnTI Ls/Q== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@oracle.com header.s=corp-2017-10-26 header.b=JMiYxmeC; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=oracle.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id 97-v6si550125ple.430.2018.02.05.14.34.12; Mon, 05 Feb 2018 14:34:27 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@oracle.com header.s=corp-2017-10-26 header.b=JMiYxmeC; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=oracle.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1752009AbeBEWd3 (ORCPT + 99 others); Mon, 5 Feb 2018 17:33:29 -0500 Received: from userp2120.oracle.com ([156.151.31.85]:40658 "EHLO userp2120.oracle.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1750796AbeBEWdW (ORCPT ); Mon, 5 Feb 2018 17:33:22 -0500 Received: from pps.filterd (userp2120.oracle.com [127.0.0.1]) by userp2120.oracle.com (8.16.0.22/8.16.0.22) with SMTP id w15MVtGx085990; Mon, 5 Feb 2018 22:32:05 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h=subject : to : cc : references : from : message-id : date : mime-version : in-reply-to : content-type : content-transfer-encoding; s=corp-2017-10-26; bh=wrWN/wQHYGwx2PKYcIk0LR+6t/DOQ8PpWPiw+mnv6mk=; b=JMiYxmeC0NaVqVJMFGsszgf4/cXBphOOrRqRSa1mhv/oWA7w7s+GjBx7N1l9wJ06uU+h 3BJoVWesYaJeEROkUgie9lteImGElKBrOgC3lv77iwyyoRnSujDMJ8OPnbcuxSECy75n IxED7oiOz+S3jupmvfpbZeX6uhW7ybs9UijOeEwEdFSJj/9B+0O7WKXfKncnbiBMtywk y1ULRGnyqkyXRZKP295zcJWGj9IBlTWUkpD1FRelfPEu/5pViXIrIwzBZeVVfWlnGFkK V8M4Dp8Sq1nlKGwGYhiFmMqsAXUhpQNB7lc9vRTTxK6g3sfpAC9Tj9Y1hIITdF4beXIP EA== Received: from aserv0021.oracle.com (aserv0021.oracle.com [141.146.126.233]) by userp2120.oracle.com with ESMTP id 2fxyny03tq-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Mon, 05 Feb 2018 22:32:05 +0000 Received: from userv0122.oracle.com (userv0122.oracle.com [156.151.31.75]) by aserv0021.oracle.com (8.14.4/8.14.4) with ESMTP id w15MW3uY031277 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Mon, 5 Feb 2018 22:32:03 GMT Received: from abhmp0012.oracle.com (abhmp0012.oracle.com [141.146.116.18]) by userv0122.oracle.com (8.14.4/8.14.4) with ESMTP id w15MW2oW022546; Mon, 5 Feb 2018 22:32:03 GMT Received: from [10.132.91.87] (/10.132.91.87) by default (Oracle Beehive Gateway v4.0) with ESMTP ; Mon, 05 Feb 2018 14:32:02 -0800 Subject: Re: [RESEND RFC PATCH V3] sched: Improve scalability of select_idle_sibling using SMT balance To: Peter Zijlstra , Steven Sistare Cc: linux-kernel@vger.kernel.org, mingo@redhat.com, dhaval.giani@oracle.com, tim.c.chen@linux.intel.com References: <20180129233102.19018-1-subhra.mazumdar@oracle.com> <20180201123335.GV2249@hirez.programming.kicks-ass.net> <911d42cf-54c7-4776-c13e-7c11f8ebfd31@oracle.com> <20180202195943.GR2269@hirez.programming.kicks-ass.net> <25d67bd2-cbe7-2c2a-e89a-13a7ca5adc10@oracle.com> <20180205124854.GX2269@hirez.programming.kicks-ass.net> <20180205170358.GT2295@hirez.programming.kicks-ass.net> From: Subhra Mazumdar Message-ID: <24df5e07-8a6b-26d9-6024-d6caa90c18de@oracle.com> Date: Mon, 5 Feb 2018 14:32:47 -0800 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.5.0 MIME-Version: 1.0 In-Reply-To: <20180205170358.GT2295@hirez.programming.kicks-ass.net> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US X-Proofpoint-Virus-Version: vendor=nai engine=5900 definitions=8796 signatures=668662 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 suspectscore=0 malwarescore=0 phishscore=0 bulkscore=0 spamscore=0 mlxscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1711220000 definitions=main-1802050277 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 02/05/2018 09:03 AM, Peter Zijlstra wrote: > On Mon, Feb 05, 2018 at 01:48:54PM +0100, Peter Zijlstra wrote: >> So while I see the point of tracking these numbers (for SMT>2), I don't >> think its worth doing outside of the core, and then we still need some >> powerpc (or any other architecture with abysmal atomics) tested. > FWIW Power has another 'fun' feature, their cores have asymmetric SMT. > > Their cores have a static power level, based on _which_ SMT sibling is > running, not how many. A single SMT2 runs (much) slower than a single > SMT0. > > So that random selection stuff really doesn't work well for them. Now > 'sadly' x86 can also have ASYM_PACKING set on its SMT domain, so I'm > going to have to figure out what to do about all that. Even the existing code doesn't handle that. The SMT balancing compares the remaining SMT capacity so even with asymmetric cores should work OK. Thanks, Subhra