Received: by 2002:a05:6a10:6744:0:0:0:0 with SMTP id w4csp3253196pxu; Mon, 19 Oct 2020 07:46:17 -0700 (PDT) X-Google-Smtp-Source: ABdhPJwz6fBc+42kfbSj5caDaqpZoOWbqDCQ7LLXV4rYxXtkASBNUvFJQwrlP0epz188ChHUeWKF X-Received: by 2002:a17:906:8248:: with SMTP id f8mr257348ejx.292.1603118777156; Mon, 19 Oct 2020 07:46:17 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1603118777; cv=none; d=google.com; s=arc-20160816; b=cWBhlpmg3pq587oZlkPXyp3PKEGihrCTknZauqRcfLM1ON+e756n+0SigBxW+sZiqD 3tQvr/CPBvj5AUcOJN0TzZar/11CxCT+hX7h+52AwypCoAcRcNKmYj711KutvN6SDGIT boSb2vb9dVZpzogeKfxk9GIPgkgPxAML1G8AGLXMYGZoIlktc3Htux+2shYBCGzqji7w JJd4iJ1Ob9qGVrd1hXvf2/rocXtmMFHwxeNl1Rq/t3OBBouyqm0blcedUei+iiOqiCqV xS3oW5TiQ8oTLZS3yKO+dQObL0gInoSoULgM8HwSBByCBoE8t67hRuyKEjbQTz5JQACp XOhw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-language:content-transfer-encoding :in-reply-to:mime-version:user-agent:date:message-id:autocrypt:from :references:cc:to:subject; bh=VCXAwwP+przUoxfz/EYGpmoRXgEgwvfbwJqpz5WKDI4=; b=eW8dDtLYgLGjRTPmlvV8KTlg95JaKMzwOZ4IS+V8WiC0TV3Zpz8JaVgBm4nj+g8eo5 usupmv0CtlXSSXhd3WPvZcSNzHHFNoK7urZMSkzC2ZiUU5Lx3taZidDCgVEaaExlGFuk Db1PP9bNWs4e48ntqWXiTxM9zCOFg6FNfoYedz0MCaMfALpW5FZ+FIDPjkoxW6X9lEQ/ hbO00Lbaab4/ANv5RI05fnhVziU3jjoQd3VkeV9+x+oNq9xWJSUs2a9hs63i1L5D3b98 Avaxqlk64yT5fYCaF6emoKtOpP4+jxcbEL8/E/4YJBeT/XFFahcyw4eCL1AAOamOHalC J13A== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id e14si96592ejj.573.2020.10.19.07.45.54; Mon, 19 Oct 2020 07:46:17 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1729578AbgJSOm2 (ORCPT + 99 others); Mon, 19 Oct 2020 10:42:28 -0400 Received: from mail2-relais-roc.national.inria.fr ([192.134.164.83]:37766 "EHLO mail2-relais-roc.national.inria.fr" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1729396AbgJSOm1 (ORCPT ); Mon, 19 Oct 2020 10:42:27 -0400 X-IronPort-AV: E=Sophos;i="5.77,394,1596492000"; d="scan'208";a="473331876" Received: from 91-160-5-165.subs.proxad.net (HELO [192.168.44.21]) ([91.160.5.165]) by mail2-relais-roc.national.inria.fr with ESMTP/TLS/DHE-RSA-AES256-SHA; 19 Oct 2020 16:42:25 +0200 Subject: Re: [RFC PATCH] topology: Represent clusters of CPUs within a die. To: Morten Rasmussen , Jonathan Cameron Cc: Len Brown , Peter Zijlstra , Greg Kroah-Hartman , x86@kernel.org, guohanjun@huawei.com, linux-kernel@vger.kernel.org, linuxarm@huawei.com, linux-acpi@vger.kernel.org, Jerome Glisse , Sudeep Holla , Will Deacon , valentin.schneider@arm.com, linux-arm-kernel@lists.infradead.org References: <20201016152702.1513592-1-Jonathan.Cameron@huawei.com> <20201019103522.GK2628@hirez.programming.kicks-ass.net> <20201019123226.00006705@Huawei.com> <20201019131052.GC8004@e123083-lin> <20201019134157.00001c97@Huawei.com> <20201019141653.GE8004@e123083-lin> From: Brice Goglin Autocrypt: addr=Brice.Goglin@inria.fr; prefer-encrypt=mutual; keydata= mQINBFNg91oBEADMfOyfz9iilNPe1Yy3pheXLf5O/Vpr+gFJoXcjA80bMeSWBf4on8Mt5Fg/ jpVuNBhii0Zyq4Lip1I2ve+WQjfL3ixYQqvNRLgfw/FL0gNHSOe9dVFo0ol0lT+vu3AXOVmh AM4IrsOp2Tmt+w89Oyvu+xwHW54CJX3kXp4c7COz79A6OhbMEPQUreerTavSvYpH5pLY55WX qOSdjmlXD45yobQbMg9rFBy1BECrj4DJSpym/zJMFVnyC5yAq2RdPFRyvYfS0c491adD/iw9 eFZY1XWj+WqLSW8zEejdl78npWOucfin7eAKvov5Bqa1MLGS/2ojVMHXJN0qpStpKcueV5Px igX8i4O4pPT10xCXZ7R6KIGUe1FE0N7MLErLvBF6AjMyiFHix9rBG0pWADgCQUUFjc8YBKng nwIKl39uSpk5W5rXbZ9nF3Gp/uigTBNVvaLO4PIDw9J3svHQwCB31COsUWS1QhoLMIQPdUkk GarScanm8i37Ut9G+nB4nLeDRYpPIVBFXFD/DROIEfLqOXNbGwOjDd5RWuzA0TNzJSeOkH/0 qYr3gywjiE81zALO3UeDj8TaPAv3Dmu7SoI86Bl7qm6UOnSL7KQxZWuMTlU3BF3d+0Ly0qxv k1XRPrL58IyoHIgAVom0uUnLkRKHczdhGDpNzsQDJaO71EPp8QARAQABtCRCcmljZSBHb2ds aW4gPEJyaWNlLkdvZ2xpbkBpbnJpYS5mcj6JAjgEEwECACIFAlNg+aMCGwMGCwkIBwMCBhUI AgkKCwQWAgMBAh4BAheAAAoJEESRkPMjWr076RoQAJhJ1q5+wlHIf+YvM0N1V1hQyf+aL35+ BPqxlyw4H65eMWIN/63yWhcxrLwNCdgY1WDWGoiW8KVCCHwJAmrXukFvXjsvShLQJavWRgKH eea12T9XtLc6qY/DEi2/rZvjOCKsMjnc1CYW71jbofaQP6lJsmC+RPWrnL/kjZyVrVrg7/Jo GemLmi/Ny7nLAOt6uL0MC/Mwld14Yud57Qz6VTDGSOvpNacbkJtcCwL3KZDBfSDnZtSbeclY srXoMnFXEJJjKJ6kcJrZDYPrNPkgFpSId/WKJ5pZBoRsKH/w2OdxwtXKCYHksMCiI4+4fVFD WlmVNYzW8ZKXjAstLh+xGABkLVXs+0WjvC67iTZBXTmbYJ5eodv8U0dCIR/dxjK9wxVKbIr2 D+UVbGlfqUuh1zzL68YsOg3L0Xc6TQglKVl6RxX87fCU8ycIs9pMbXeRDoJohflo8NUDpljm zqGlZxBjvb40p37ReJ+VfjWqAvVh+6JLaMpeva/2K1Nvr9O/DOkSRNetrd86PslrIwz8yP4l FaeG0dUwdRdnToNz6E8lbTVOwximW+nwEqOZUs1pQNKDejruN7Xnorr7wVBfp6zZmFCcmlw9 8pSMV3p85wg6nqJnBkQNTzlljycBvZLVvqc6hPOSXpXf5tjkuUVWgtbCc8TDEQFx8Phkgda6 K1LNuQINBFNg91oBEADp3vwjw8tQBnNfYJNJMs6AXC8PXB5uApT1pJ0fioaXvifPNL6gzsGt AF53aLeqB7UXuByHr8Bmsz7BvwA06XfXXdyLQP+8Oz3ZnUpw5inDIzLpRbUuAjI+IjUtguIK AkU1rZNdCXMOqEwCaomRitwaiX9H7yiDTKCUaqx8yAuAQWactWDdyFii2FA7IwVlD/GBqMWV weZsMfeWgPumKB3jyElm1RpkzULrtKbu7MToMH2fmWqBtTkRptABkY7VEd8qENKJBZKJGisk Fk6ylp8VzZdwbAtEDDTGK00Vg4PZGiIGbQo8mBqbc63DY+MdyUEksTTu2gTcqZMm/unQUJA8 xB4JrTAyljo/peIt6lsQa4+/eVolfKL1t1C3DY8f4wMoqnZORagnWA2oHsLsYKvcnqzA0QtY IIb1S1YatV+MNMFf3HuN7xr/jWlfdt59quXiOHU3qxIzXJo/OfC3mwNW4zQWJkG233UOf6YE rmrSaTIBTIWF8CxGY9iXPaJGNYSUa6R/VJS09EWeZgRz9Gk3h5AyDrdo5RFN9HNwOj41o0cj eLDF69092Lg5p5isuOqsrlPi5imHKcDtrXS7LacUI6H0c8onWoH9LuW99WznEtFgPJg++TAv f9M2x57Gzl+/nYTB5/Kpl1qdPPC91zUipiKbnF5f8bQpol0WC+ovmQARAQABiQIfBBgBAgAJ BQJTYPdaAhsMAAoJEESRkPMjWr074+0P/iEcN27dx3oBTzoeGEBhZUVQRZ7w4A61H/vW8oO8 IPkZv9kFr5pCfIonmHEbBlg6yfjeHXwF5SF2ywWRKkRsFHpaFWywxqk9HWXu8cGR1pFsrwC3 EdossuVbEFNmhjHvcAo11nJ7JFzPTEnlPjE6OY9tEDwl+kp1WvyXqNk9bosaX8ivikhmhB47 7BA3Kv8uUE7UL6p7CBdqumaOFISi1we5PYE4P/6YcyhQ9Z2wH6ad2PpwAFNBwxSu+xCrVmaD skAwknf6UVPN3bt67sFAaVgotepx6SPhBuH4OSOxVHMDDLMu7W7pJjnSKzMcAyXmdjON05Sz SaILwfceByvHAnvcFh2pXK9U4E/SyWZDJEcGRRt79akzZxls52stJK/2Tsr0vKtZVAwogiaK uSp+m6BRQcVVhTo/Kq3E0tSnsTHFeIO6QFHKJCJv4FRE3Dmtz15lueihUBowsq9Hk+u3UiLo SmrMAZ6KgA4SQxB2p8/M53kNJl92HHc9nc//aCQDi1R71NyhtSx+6PyivoBkuaKYs+S4pHmt sFE+5+pkUNROtm4ExLen4N4OL6Kq85mWGf2f6hd+OWtn8we1mADjDtdnDHuv+3E3cacFJPP/ wFV94ZhqvW4QcyBWcRNFA5roa7vcnu/MsCcBoheR0UdYsOnJoEpSZswvC/BGqJTkA2sf Message-ID: <0190e18f-7a55-e1d6-b966-f7844a251609@inria.fr> Date: Mon, 19 Oct 2020 16:42:24 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.12.0 MIME-Version: 1.0 In-Reply-To: <20201019141653.GE8004@e123083-lin> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Content-Language: en-US Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Le 19/10/2020 à 16:16, Morten Rasmussen a écrit : > >>> If there is a provable benefit of having interconnect grouping >>> information, I think it would be better represented by a distance matrix >>> like we have for NUMA. >> There have been some discussions in various forums about how to >> describe the complexity of interconnects well enough to actually be >> useful. Those have mostly floundered on the immense complexity of >> designing such a description in a fashion any normal software would actually >> use. +cc Jerome who raised some of this in the kernel a while back. > I agree that representing interconnect details is hard. I had hoped that > a distance matrix would be better than nothing and more generic than > inserting extra group masks. > The distance matrix is indeed more precise, but would it scale to tens/hundreds of core? When ACPI HMAT latency/bandwidth was added, there were concerns that exposing the full matrix would be an issue for the kernel (that's why only local latency/bandwidth is exposed n sysfs). This was only for NUMA nodes/targets/initiators, you would have significantly more cores than that. Brice