Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1757736AbdCUPcp (ORCPT ); Tue, 21 Mar 2017 11:32:45 -0400 Received: from mail-dm3nam03on0079.outbound.protection.outlook.com ([104.47.41.79]:25376 "EHLO NAM03-DM3-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1756686AbdCUPck (ORCPT ); Tue, 21 Mar 2017 11:32:40 -0400 Authentication-Results: lists.infradead.org; dkim=none (message not signed) header.d=none;lists.infradead.org; dmarc=none action=none header.from=caviumnetworks.com; Subject: Re: [PATCH] PCI: ACPI: Fix ThunderX PEM initialization To: Tomasz Nowicki , Bjorn Helgaas , Jon Masters References: <20170131142525.GA9942@bhelgaas-glaptop.roam.corp.google.com> <20170131145720.GA14231@localhost.localdomain> <20170131203109.GA14127@bhelgaas-glaptop.roam.corp.google.com> <20170201125325.GA15805@localhost.localdomain> <20170201151807.GA15793@bhelgaas-glaptop.roam.corp.google.com> <376ae1df-da85-e576-75d6-3ae2ab0f1b41@jonmasters.org> <20170315113323.GA28027@localhost.localdomain> <251db823-591b-483b-9c55-13c911020fd1@jonmasters.org> <48b93116-cc0f-e59d-8aa3-704052ad6759@gmail.com> <20170321134744.GA13150@bhelgaas-glaptop.roam.corp.google.com> Cc: David Daney , Vadim Lomovtsev , David.Daney@cavium.com, linux-pci@vger.kernel.org, linux-kernel@vger.kernel.org, stemerkhanov@CAVIUMNETWORKS.onmicrosoft.com, bhelgaas@google.com, linux-arm-kernel@lists.infradead.org From: David Daney Message-ID: Date: Tue, 21 Mar 2017 07:56:05 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.7.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [50.233.148.156] X-ClientProxiedBy: SN2PR07CA002.namprd07.prod.outlook.com (10.255.174.19) To BL2PR07MB2419.namprd07.prod.outlook.com (10.167.101.143) X-MS-Office365-Filtering-Correlation-Id: c107cf46-d753-4461-6041-08d4706a686b X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:(22001);SRVR:BL2PR07MB2419; X-Microsoft-Exchange-Diagnostics: 1;BL2PR07MB2419;3:rDiIsUIkm5z0WohEX7Mtz4sg0L+qrM9ha/Wm9VqUtHH6qW50lrZt+YDgGRro8XwAIbviw1otL5jOFrE+kfDr+LYiaxv/kfKpcIDNCFF3XBl0FnYMy67Hh+/C70o5aVU02Y5Vhag3ab2v/zC03N6AHh8glrwp701IFRXLzCIolWiRQOaAHuDMDA7SINtvJ7T/LJttMTLakdOJw01t6LWVAPvpgZ9NZPDF86aTxVzVEOQrr/wXRH+kczPzFQoou1osDG8OVQPvC+MgfZOombuANQ==;25:Q2dGsC4QF4UBY1+mNZyvUSuLmgIgWAh7mQe9MXxo2PKTrGarlt5pqLf78NHDrohN8Pg/rhC80u+HBOx9QMq8we2cytR5m5BcXBYvT6+cizbNoYIxuqffrgUXnAzuL6y04gcrDnEos7DqUYYbtclBMd+4coGW+efwpv/zV0i6fm9xiO+BRnsd4pIqoeUDLKHxkaGqPmFyINF12hKL7zYFowH9NTP7dlN1LWtPk0iuo6YXRyiEcX+wXMZuHH4ttaCPMcMeQ14g6xTNVIBaaNBMobwa9rMSxPhjOll+clRQHS+Vfo7CbClqT2Em94a0sGDZINPSFoaOtkGKL8L24AWHPDB7tBeLHUq+RpJSEVuErQl19PR4aAEW0JDaUWJpXzCih8pcXwmbAUzrq86WIK3EhLuXVRraZrRmum/o8bNrJf24xPJMiEsd9yq8gT2Oe1PwlpLymarrkIV70AD8bJXaUQ== X-Microsoft-Exchange-Diagnostics: 1;BL2PR07MB2419;31:4IpGOLWIKiwGQys50TT22/QsLlZHdV9PNiPUFkqxc0/ba/NrcI7YGrTHWCwwtJDP7uCEc5YyBdANpDEWExKaXV6SrqH17u7XC+AaOd5HaS5kjyd748xqQV9ftBiyHWmXcyDLMIVyw52kxSx2auy5tRdnQ8biMnELF0dJIOy4cT6kK7ruA94uAdjHw/Frs64IjGIfA892G5Ixjv9D69V/oj369MqNsSxGLcAdHloIGhM=;20:LPpWuNrqcSJQXBJi5Lkcq5Pz3PLolMbsCEgC2p09YHg+2p9I7Q6ZH7pPNBsIduSz1RZmjSbrdhDWZf4FRDTlALPSNiu6IqYcQFS8W6vhXpEsPH7hda7IrAXqxxaj78ZdZh0RZu22Kd9Yrlvp8njLHGxekIWGu8lboZN2hszllb/CodO6bex243IvEP4h+8DDYj/yo9jyGQ8/IZ0LsX2hb8Uepko1osxUa3qxD59TY6DTxMX2D//N6RkEa439OG9quvCb+8ZrD9C2jGbh+DIV1L9uHoZU1frDDw2JJa8MGrOwPHRK2TXmt/++bzOCah4eGTAKtwmzq1WwKir9TSWBO/Y34NPPfirAojQPHB4MLX7yrC/zW/mcGzps2Hh+25ZBBwdEL8IUfgBAmk4krcapz4rGzLgEl+dLmJnkJ7AawFnDWG0K6egD9+5JMYIGqQNE0fl1DkgAcD5MQASi7NM56nW7yPbAmBWep/KdiW01D3v4SCwi7pMKP+3qjTK5aJeh5BC9v7/doGXzfoqOmc9OppIhzmhoso74BuqDyEYGcb5pwPX6U7E09W3JGbUv/CAk+PV0zgjd8WTYYwDmoKWVlC/7+yeijoA1hkTk5V7ESKM= X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:(158342451672863); X-Exchange-Antispam-Report-CFA-Test: BCL:0;PCL:0;RULEID:(6040375)(601004)(2401047)(5005006)(8121501046)(3002001)(10201501046)(6041248)(20161123564025)(20161123562025)(20161123555025)(20161123560025)(20161123558025)(6072148);SRVR:BL2PR07MB2419;BCL:0;PCL:0;RULEID:;SRVR:BL2PR07MB2419; X-Microsoft-Exchange-Diagnostics: 1;BL2PR07MB2419;4:IBfh2c+ND7B/E4z2N0xPoji7Oz/EzPcdrwjcq7HgzmK4Ctx9ClpxOnEZo28A3q7846aW0/4XDe3fh3MX76QQarDQdlQGKda0GoOZNECorIbfq+M99ftDBp9KButzRIdlrd8pQLfZSDMsXPN29UJ8Fo9BDSexFWoJsNGQENrBE+jCZDoRLkB/wx1wlETsLi0fTEIk+cd0ojyi9qubXMiIrIkSZI7KMov1YEcfzI762z2NgQOJqQ7GcAsnevzK3ROO9AkSNJ/G6drwBPScCbv4Kzm/dtPsSEogfenqpIJgHOIY4nzL23ppy1Jn4ssD27zYxdmG7IvgOGeXovjtPObYKVAtt26eUIcKFLUVp6vy3N0MaZbrR0bPmvlKATs8sOJXZu+nk+wz68rAfCcL1R5x1yABdtoGgbFgWWgNGNr1LsASJTVM2YUQF4AzL26c/w4nEsgGPn43VLr4JmDVY+cYLFLizQk2AuNbOyGS6yWnWHGTb2KHG7G/G5ytgJFKgfOn2k27wLwLCg5NTmZ/kvObNgLagYaA0gaU9nkgW2ge6GnoayvYmqxiNVIhIQDuTA4dpgdWCNXGVNsRxitfMJhX5uYIWJ/1fUiLg2fmDihhi133OrWloo63ZUo6DideYQyJUn50ECBNH/U1muoNOSGRrw== X-Forefront-PRVS: 02530BD3AA X-Forefront-Antispam-Report: SFV:NSPM;SFS:(10009020)(4630300001)(6009001)(39450400003)(24454002)(377454003)(38730400002)(6246003)(47776003)(8676002)(4326008)(53416004)(31686004)(42186005)(81166006)(31696002)(305945005)(7736002)(66066001)(65956001)(65806001)(2950100002)(42882006)(64126003)(230700001)(50466002)(6116002)(3846002)(5660300001)(83506001)(6512007)(93886004)(54906002)(76176999)(23746002)(229853002)(53936002)(189998001)(6506006)(6486002)(25786008)(6306002)(36756003)(54356999)(4001350100001)(53546009)(50986999)(2906002)(33646002);DIR:OUT;SFP:1101;SCL:1;SRVR:BL2PR07MB2419;H:ddl.caveonetworks.com;FPR:;SPF:None;MLV:sfv;LANG:en; X-Microsoft-Exchange-Diagnostics: =?Windows-1252?Q?1;BL2PR07MB2419;23:crifY+JQ6bQxKIC6a7PWRlMOZ0Ys3yd2fiu0H?= =?Windows-1252?Q?p3iBqGGlyaoB72mQkzkUVe3oTDatu0fP0kneGjdvDIMW8M8ft8X4ZWzD?= =?Windows-1252?Q?EzgvxI7UddvWW/tQsH2oGjsUcF5zkhjDGDhKOuz56cAj3jAvsobMCiV0?= =?Windows-1252?Q?/0Za73L4e71o0iFDjKKGAfwsYLwnPF9v6Tvu2FwMoAF6BaPajfIDBUP1?= =?Windows-1252?Q?YHP0kloYx60dB3mgrGXt2T3pD5gqZAuRttfDwGwmjvzADFyFRc1tB96U?= =?Windows-1252?Q?mGi5Gl88ISjgKttINdj7clQMH/ZT6m99wUngSPscs8d/B7Rj1R1QfWuw?= =?Windows-1252?Q?NBq/Wa4+m7sGOoFzMJEk69mJVZKd8Qy6lFzxq8n1R68lHZYs1MyItgQm?= =?Windows-1252?Q?hFiVqr5yHkS6CLp5VLxcz4yDCe8i8/ql1d2aGpReGs7LGAqFMu2Uqhfn?= =?Windows-1252?Q?eRJ8WfoXLKF14MFkOHaQ9PDKOfpSklb3CtuFDz1MUAx98hOkutpxd2iv?= =?Windows-1252?Q?Y0PwUSlTYrjcThdmSBnkEEU3hv3NbOu7xVY8JdJocxinKTSaHlo3KUvI?= =?Windows-1252?Q?wS5Cz/eabOAMfPIX3XfURhYnjx6/gMS1BwH6OQh8nd0hnPeh1+IxJycD?= =?Windows-1252?Q?Nve9ZzabykmuOsXsFn7R/kLft7AsyIMCw2wmbmYbLolrt19yRCYGButk?= =?Windows-1252?Q?x7axE4Nu8bj34SvEOZB4mAfJjkD4O8NJDdeFzkB2FiXTBP/ill2Y7vJV?= =?Windows-1252?Q?IO35reWxARkFP+wMJmS8xA8kSJ/tqyYCW6MvSlQZSxEKloC1htcygqQ+?= =?Windows-1252?Q?5kAU7qMzxA1G4lgnSaM57JIdfhLJME0yXoZX5GDT1B2use4CZdnYOU9h?= =?Windows-1252?Q?zFgya7+65/3bMH4+znDQOgJ0Mnmb3erHKyU0B45TDqVjAH21FkvBoeUX?= =?Windows-1252?Q?H5/F0p+WpmHPfbNDEunr+KFpuZafVgFeO4OsyDLbKjUskTmx7quWyacg?= =?Windows-1252?Q?RRn7ihL0JLTL/Y9sVz9FkYQUrpdwemAqo4jU662/fVQpks3Vcsyh1bcM?= =?Windows-1252?Q?GVIHEoqZtrhzLotdN5avSGe86v+jDS2Ggldlpnanr7zdhJQXggf3qWKQ?= =?Windows-1252?Q?fk//qGfp/uHz8cQNKofQS0hzne9TbvSTD1lHwCJuYuWbNmKtP+ALSNWr?= =?Windows-1252?Q?zZWe7xsLSyEDj7ZZo1Qo+viHS/pD6NPW6h0U0h2m8k02ztYfsecVV787?= =?Windows-1252?Q?KWmqhdobkUEKZU80STt1cZDtb6c9iktdTjDqVo=3D?= X-Microsoft-Exchange-Diagnostics: 1;BL2PR07MB2419;6:jfTQ9JzM42JYP7LmhHwSAAZXO7cUyvrfV0LTXP5QIWZyV3iUzV7YAijAI0BsF61H7wNbCjQ0ywR1xi9Pkv3j629smmvwjnC26EqZAZKD4D/71BbSb/Sc54stcxeNdqkIysqUv8y7id5SXGpUNIHtHv4SVc8PQ+EMgIQaBqttZFN1IVEcwo+xnp3QYzL26F/lEaw9uxN01OmOBtIb9CGkyFM8zZ/r7sxb6EtWpHseFSXHByTxtaVZQpnM7XTFPB0eDoEThORu/BBiAFH22ViRMU9Ti48/13Mzg/QyoJgKy62TJDb2gipRZM5N+2yrekFMv7qxN93qHxvjqlA5icd543rc72Ckj543zN8+nSwXyn4vEUaLZ24UShBZkCYCC0YBTRySBHQo/QJ9e3DroThhfw==;5:91n7uEfV9LrMGyZTJSmZM/S+i7tz2iuKLwl7rnGTVe7hV4cvdKNNa16Y/EVZ0adVbLo1ZoulDnSUuSeAisQS9blPiwYab4FqOYkBpklYNbHfJYr2J8bwEPamvpB97TuD1Tvep2adnwzAF6eGrgl0PQ==;24:VT2tx4D5eSKEXW5bi0B61ftR8B6lygaS+pa7ku/mhMoaeWknHLw+ObFMbsVgdGYW5qOonv4zMZyzdSSPFuqy4ud2d83DwyQ+yzhWr5iZYLo= SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-Microsoft-Exchange-Diagnostics: 1;BL2PR07MB2419;7:1sLJB0M0IKghO2oSzzVsPVNDM6o+nDpIRVRs5poq6GkCJLxfpX1eUPA82j3f1yaQnjY/bLM1kQWebQyHn42UyOzXFjIzIzLUSMOYL//J1JJ0SiHr8+pgwxo8IfTz153dSG4AjuwFl3d/6/7yda5KPUJliRhx5TlRLCDAC3bTzLB75rKEfqmW6dZUUsF5V+pnqldMhG0IqNkoeKK8PinIGu8bcOq1gXT1ajYhahGfEWYtMBrcWHogzg8UW/wHt/ib4/khCtc3GMZLpXbhNtRoxejScdZ60XZ4NetJUqnKgDUVl25vJIVxB1BGKuy1IXiINWfmyB4EpOInmiKJiEBFEw== X-OriginatorOrg: caviumnetworks.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 21 Mar 2017 14:56:07.7406 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL2PR07MB2419 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 3482 Lines: 82 On 03/21/2017 07:17 AM, Tomasz Nowicki wrote: > Hi Bjorn, > > On 21.03.2017 14:47, Bjorn Helgaas wrote: >> On Tue, Mar 21, 2017 at 07:38:07AM -0400, Jon Masters wrote: >>> On 03/16/2017 12:25 PM, David Daney wrote: >>>> On 03/16/2017 07:32 AM, Jon Masters wrote: >>> >>>>>> Yes, it is now contains "CAVxxx" as _HID for device config object. >>>>> >>>>> Which is different from the version that was merged into upstream. >>>>> That >>>>> should never have happened. It will never happen again. I have >>>>> spent some >>>>> time over the past few days ensuring folks understand that I will not >>>>> allow a repeat of this to occur the next time around. We will have >>>>> platforms that are bulletproof and supported by upstream with any >>>>> errata fixes in a very carefully controlled manner. There will >>>>> under no circumstances ever be a situation like this again. >>>> >>>> We are still evaluating the merits of registering the values that >>>> appeared >>>> in v4.10, and not changing them. We should know more in a couple of >>>> days. >>> >>> Thanks David. What was the verdict? (for the public record). If we >>> need to >>> get a change into upstream, let's get that teed up before 4.12 merge. >>> >>> And for other folks following along with this thread: I'm not just >>> picking >>> on Cavium here. I'll be doing the same with *every* ARM server SoC >>> company >>> as necessary over the coming months. We are going to have militantly >>> compliant standards adherence in this industry and every ARM server >>> SoC is >>> going to "just work" with an upstream Linux kernel with an ACPI enabled >>> platform. This will be so utterly clean and boring it'll be amazing. >> >> Thanks for keeping on top of this, Jon. I agree, we should not be >> using unregistered vendor prefixes, e.g., the "THRX" added by >> 44f22bd91e88 ("PCI: Add MCFG quirks for Cavium ThunderX pass2.x host >> controller"). I'm sorry I merged that without doing the due >> diligence. > > Honestly, it is me who is responsible for this since I submitted the patch. Yes. After all this back and forth, Cavium has decided to deploy firmware with "CAVxxx" as _HID. The deciding factor was that the prefix is already registered and there are probably fewer than 10 systems deployed with the experimental and erroneous "THRXxxx" value. Neither option (switching the kernel to "CAVxxx", or changing the firmware to use "THRXxxx") was without its drawbacks. There were valid arguments on either side. In the end internal momentum, among other factors, brought us to the conclusion that using the "CAVxxx" as _HID, and trying to get Tomasz' patches merged is what we will do. We fully realize that there may exists some combinations of the Linux kernel and Cavium firmware (both officially released, and experimental and unsupported) that don't result in functional PCIe. I, personally, am sorry that this screw up happened in the first place. Let's hope that everyone learned something from the experience. Thanks, David Daney > >> >> I suspect the resolution will be to register "THRX". If that doesn't >> happen, I'll propose reverting 44f22bd91e88, not because I want to >> break things, but only because I'm not personally in a position to do >> anything smarter. So please propose a better solution that fits >> within the ACPI _HID/_CID model :) > > I already submitted the patch to fix this. Please see: > https://patchwork.ozlabs.org/patch/739042/ > > Thanks, > Tomasz