Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1756470AbdLTWlJ (ORCPT ); Wed, 20 Dec 2017 17:41:09 -0500 Received: from mga04.intel.com ([192.55.52.120]:39540 "EHLO mga04.intel.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1755460AbdLTWlH (ORCPT ); Wed, 20 Dec 2017 17:41:07 -0500 X-Amp-Result: UNKNOWN X-Amp-Original-Verdict: FILE UNKNOWN X-Amp-File-Uploaded: False X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.45,433,1508828400"; d="scan'208";a="160532892" Date: Wed, 20 Dec 2017 15:41:05 -0700 From: Ross Zwisler To: Dan Williams Cc: Ross Zwisler , Matthew Wilcox , Dave Hansen , Michal Hocko , "linux-kernel@vger.kernel.org" , "Anaczkowski, Lukasz" , "Box, David E" , "Kogut, Jaroslaw" , "Koss, Marcin" , "Koziej, Artur" , "Lahtinen, Joonas" , "Moore, Robert" , "Nachimuthu, Murugasamy" , "Odzioba, Lukasz" , "Rafael J. Wysocki" , "Rafael J. Wysocki" , "Schmauss, Erik" , "Verma, Vishal L" , "Zheng, Lv" , Andrew Morton , Balbir Singh , Brice Goglin , Jerome Glisse , John Hubbard , Len Brown , Tim Chen , devel@acpica.org, Linux ACPI , Linux MM , "linux-nvdimm@lists.01.org" , Linux API , linuxppc-dev Subject: Re: [PATCH v3 0/3] create sysfs representation of ACPI HMAT Message-ID: <20171220224105.GA27258@linux.intel.com> References: <20171214021019.13579-1-ross.zwisler@linux.intel.com> <20171214130032.GK16951@dhcp22.suse.cz> <20171218203547.GA2366@linux.intel.com> <20171220181937.GB12236@bombadil.infradead.org> <2da89d31-27a3-34ab-2dbb-92403c8215ec@intel.com> <20171220211649.GA32200@bombadil.infradead.org> <20171220212408.GA8308@linux.intel.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.9.1 (2017-09-22) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 4460 Lines: 77 On Wed, Dec 20, 2017 at 02:29:56PM -0800, Dan Williams wrote: > On Wed, Dec 20, 2017 at 1:24 PM, Ross Zwisler > wrote: > > On Wed, Dec 20, 2017 at 01:16:49PM -0800, Matthew Wilcox wrote: > >> On Wed, Dec 20, 2017 at 12:22:21PM -0800, Dave Hansen wrote: > >> > On 12/20/2017 10:19 AM, Matthew Wilcox wrote: > >> > > I don't know what the right interface is, but my laptop has a set of > >> > > /sys/devices/system/memory/memoryN/ directories. Perhaps this is the > >> > > right place to expose write_bw (etc). > >> > > >> > Those directories are already too redundant and wasteful. I think we'd > >> > really rather not add to them. In addition, it's technically possible > >> > to have a memory section span NUMA nodes and have different performance > >> > properties, which make it impossible to represent there. > >> > > >> > In any case, ACPI PXM's (Proximity Domains) are guaranteed to have > >> > uniform performance properties in the HMAT, and we just so happen to > >> > always create one NUMA node per PXM. So, NUMA nodes really are a good fit. > >> > >> I think you're missing my larger point which is that I don't think this > >> should be exposed to userspace as an ACPI feature. Because if you do, > >> then it'll also be exposed to userspace as an openfirmware feature. > >> And sooner or later a devicetree feature. And then writing a portable > >> program becomes an exercise in suffering. > >> > >> So, what's the right place in sysfs that isn't tied to ACPI? A new > >> directory or set of directories under /sys/devices/system/memory/ ? > > > > Oh, the current location isn't at all tied to acpi except that it happens to > > be named 'hmat'. When it was all named 'hmem' it was just: > > > > /sys/devices/system/hmem > > > > Which has no ACPI-isms at all. I'm happy to move it under > > /sys/devices/system/memory/hmat if that's helpful, but I think we still have > > the issue that the data represented therein is still pulled right from the > > HMAT, and I don't know how to abstract it into something more platform > > agnostic until I know what data is provided by those other platforms. > > > > For example, the HMAT provides latency information and bandwidth information > > for both reads and writes. Will the devicetree/openfirmware/etc version have > > this same info, or will it be just different enough that it won't translate > > into whatever I choose to stick in sysfs? > > For the initial implementation do we need to have a representation of > all the performance data? Given that > /sys/devices/system/node/nodeX/distance is the only generic > performance attribute published by the kernel today it is already the > case that applications that need to target specific memories need to > go parse information that is not provided by the kernel by default. > The question is can those specialized applications stay special and go > parse the platform specific data sources, like raw HMAT, directly, or > do we expect general purpose applications to make use of this data? I > think a firmware-id to numa-node translation facility > (/sys/devices/system/node/nodeX/fwid) is a simple start that we can > build on with more information as specific use cases arise. We don't represent all the performance data, we only represent the data for local initiator/target pairs. I do think that this is useful to have in sysfs because it provides a way to easily answer the most commonly asked questions (or at least what I'm guessing will be the most commmonly asked queststions), i.e. "given a CPU, what are the speeds of the various types of memory attached to it", and "given a chunk of memory, how fast is it and to which CPU is it local"? By providing this base level of information I'm hoping to prevent most applications from having to parse the HMAT directly. The question of whether or not to include this local performance information was one of the main questions of the initial RFC patch series, and I did get feedback (albiet off-list) that the local performance information was valuable to at least some users. I did intentionally structure my (now very short) set so that the performance information was added as a separate patch, so we can get to the place you're talking about where we only provide firmware id <=> proximity domain mappings by just leaving off the last patch in the series. I'm personally still of the opinion though that this last patch does add value.