Received-SPF: pass (google.com: domain of linux-kernel+bounces-34304-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45e3:2400::1 as permitted sender) client-ip=2604:1380:45e3:2400::1;
Message-ID: <03926c6c-43dc-4ec4-b5a0-eae57c17f507@amd.com>
Date: Mon, 22 Jan 2024 17:50:24 -0600
User-Agent: Mozilla Thunderbird
Subject: Re: [PATCH v4] PCI: Relabel JHL6540 on Lenovo X1 Carbon 7,8
Content-Language: en-US
To: Mika Westerberg <mika.westerberg@linux.intel.com>,
 Dmitry Torokhov <dmitry.torokhov@gmail.com>
Cc: Esther Shimanovich <eshimanovich@chromium.org>,
 Lukas Wunner <lukas@wunner.de>, Bjorn Helgaas <bhelgaas@google.com>,
 linux-pci@vger.kernel.org, linux-kernel@vger.kernel.org,
 Rajat Jain <rajatja@google.com>
References: <20231221-thunderbolt-pci-patch-4-v4-1-2e136e57c9bc@chromium.org>
 <20231228132517.GA12586@wunner.de>
 <20231228133949.GG2543524@black.fi.intel.com>
 <CA+Y6NJFQq39WSSwHwm37ZQV8_rwX+6k5r+0uUs_d1+UyGGLqUw@mail.gmail.com>
 <20240118060002.GV2543524@black.fi.intel.com>
 <23ee70d5-d6c0-4dff-aeac-08cc48b11c54@amd.com> <ZalOCPrVA52wyFfv@google.com>
 <20240119053756.GC2543524@black.fi.intel.com>
 <20240119074829.GD2543524@black.fi.intel.com>
 <20240119102258.GE2543524@black.fi.intel.com>
From: Mario Limonciello <mario.limonciello@amd.com>
In-Reply-To: <20240119102258.GE2543524@black.fi.intel.com>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0:
	=?utf-8?B?VVNQcGtVSXA1ZVhDMUVjMDJHRytHeDkxT25LWTlpREYveFZUTE1WWTJ4eGhP?=
 =?utf-8?B?N1JibVg3UzJZL0R6ZzFwcE1WVVdqMVAxdDVuQnZpTDVGZTRTTnk1ZHU5TXUx?=
 =?utf-8?B?WE1sNjZ3dXFWdlNvbEF5QjlzbGEzOEZ4WG1HU2J5dnIzYnhsa0JwYmZPa1ZI?=
 =?utf-8?B?TDZwZ2FQL2NRN00xWnNwdHNmcTJuMzFsT2FUc3oxKzRlZExZYTJVSit6eTNY?=
 =?utf-8?B?L1pDbTdiaXlBMW9KbmRtY1gxWnRWcU1WSGFsd3d5WkdUZzZBUUFZT1QrcGI3?=
 =?utf-8?B?MDR0TERMb2FORE5NTEZtNy9VR2dSUjZiek9wbmVQTVJ6MjBqaENTemQ3Qk5K?=
 =?utf-8?B?NTZabDdYTE82L1ZNa2pNUkxHdm1CUmhEZFc1RTl4VUt0S0FFdFplb0M1bVhu?=
 =?utf-8?B?S2J6U3FqSERWSTVaYk8wSDJMNk8vU29aeHlHMTZENnZ6d3lyM3R4ajhQZDQ2?=
 =?utf-8?B?WmdqK1lRMU9HcERpdVpwU1FTMktHRUttbjVFRWpVODA1U3NmWDg2RHhmRytN?=
 =?utf-8?B?WHlNMWp4bStZMTZlU0tpQUxRaTRvQzBCQ25wQmVqYzlTZ25UYWo1Z3dpN3FM?=
 =?utf-8?B?OFB2aFVWQnljVEltWEczTCtDNGN5UFlQZUQzbWZGY0V4dFhhNkU1MUtPYzJF?=
 =?utf-8?B?cVE5SGxHbHJIeWN3ZXBaN0w0ZENKRm5OMXBFOVpjYU9NWjZCUHZQNmgrU1pp?=
 =?utf-8?B?eGovbTVqRi9OYTJrd0cxN0p3SlpxOEk5Zyt2YjZWWENWTEJFbWhEZ3dLTFA3?=
 =?utf-8?B?bzNISnFJQTFpcTlHUFl0MkxtVi9HQmRkTTlwZGRqRzVVYnFjN0ZXbER2ZGI5?=
 =?utf-8?B?OXkyLzhTTHk5NCs4MmxqcDhHdlFaRFp6d29tTHBoUXlUTXZGZU9mZlNvWlBB?=
 =?utf-8?B?WDVVSUtRTFl1TStDamRkaFE4cmdZaWlJVGFpNVJHTlh4S0V2YVYrUHkwN1pE?=
 =?utf-8?B?L1hKTTFPQ0xQLzhMYitVOUxxbEJ3bEZVS2hCeWhyRm9XWTRVdC8xUnRoRjc4?=
 =?utf-8?B?VkdlTFlZWjR4aGxhTUFZd3F6cXRGUkhwTndHWURTeG5UMEtSRUJBSXUxTlRZ?=
 =?utf-8?B?U1ZmanNidHNPYTBCNE9mc1VKYTdKei9vcFNrTHpiU2I1UUl2N0d6ZVorSVhE?=
 =?utf-8?B?M2pWSG1VOGtCMkYwSGdjSTBlMDh6N05mdlozOWk0U3BKNmFUeVd2WFNxMXZq?=
 =?utf-8?B?d2czUlFrZSs1WDFLUkl1L1hQTGk2bnZZTDdMcG9QenBXTERodXIxbVpQSEdm?=
 =?utf-8?B?OEtPbFhuK0RrUXF4cUdQVGpiOGIvMld4dXI5ZnJjcVZFSFZCdXIzbVVSRmZr?=
 =?utf-8?B?RHhvMVBqZDdRRis0a1FKdXN6N1JQUGxMZklnOWI0eGxwRVc2Z1hnd0oweDl3?=
 =?utf-8?B?N3FuMU12NVlPV2ZLVmlXUk51alphMW5Rak44RnN3OXBCa1d0WHowV253U1hO?=
 =?utf-8?B?djZNWi9vNWtpY2N3TFZ6Sm0yMXpmUkU2bW05NDBid3Y4RkNpN0hwS0h0alV2?=
 =?utf-8?B?R0NJVFJodEJUVFkrOUsyLzdUWjN0OTA4MjROb0xyaTNJcEdWdk93VE0rNlE4?=
 =?utf-8?B?bkVFY0dlL0hKUUVveW9iem9KTmFlNGVEVmljeDNiMEFSZ3VOV3d4Q0xtSElP?=
 =?utf-8?B?Z3VoNXB1WThrYUFnYi9WbFNESjAzZXVCb0lYcnF5S1RodWhQd1pjOWJNRE51?=
 =?utf-8?B?TmNXdmhBMXdWV2htQlZUOURxaldscUxLNVpVeTBPQTZLb1dEbU13WHBvTHIz?=
 =?utf-8?B?MVVNK2RVMk9BbnExekNNL0FoMXdVZEc1Ykk2UnQ3dWpLR0k4dVc0SEM1NDNN?=
 =?utf-8?B?QTRnTXdRanlYYXE4TG1rdzdJaysyKzVhZUllU2hoNmxGbUNabEd4MXJZb2Vs?=
 =?utf-8?B?V2V6Vi9hd1dSOW9jbDlnZEJ5ZmxwTmhNODJKMWlXaWwvZnBXaldOckVUTC9V?=
 =?utf-8?B?VnA0WXkzeFVseU51U2FBQVBha1NkKzI3UC81ckNDUGJKVFFMOEc0bTE3VzE1?=
 =?utf-8?B?bjR1VjBocXgvejE1RHh3QmtyMEsvSENvcU1yUC9hby9lb2U4Y21sV0FaV3pQ?=
 =?utf-8?B?a0VBR012S1VReVZzdVNld0Y2bXUvekUrT0RxckVtUlJ3Z1RRNTBqS0FweUJw?=
 =?utf-8?Q?IfwcZXV//qnUqu6wI/bnxPqCn?=
X-OriginatorOrg: amd.com
X-MS-Exchange-CrossTenant-Network-Message-Id: a15fbcff-a0e9-4804-753d-08dc1ba4e827
X-MS-Exchange-CrossTenant-AuthSource: MN0PR12MB6101.namprd12.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 22 Jan 2024 23:50:26.4528
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: JBZcOgdAoe7oZZnXZuRgsGN7VoeGEoevsCSbXuBYaA8J9H8qRZIbQO++z8oR4r0jNafvH8A+RXBmCdPfXXuKUQ==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6PR12MB4483

On 1/19/2024 04:22, Mika Westerberg wrote:
> On Fri, Jan 19, 2024 at 09:48:29AM +0200, Mika Westerberg wrote:
>> On Fri, Jan 19, 2024 at 07:37:56AM +0200, Mika Westerberg wrote:
>>> On Thu, Jan 18, 2024 at 08:12:56AM -0800, Dmitry Torokhov wrote:
>>>> On Thu, Jan 18, 2024 at 09:47:07AM -0600, Mario Limonciello wrote:
>>>>> On 1/18/2024 00:00, Mika Westerberg wrote:
>>>>>>> Before my patch, you see that the JHL6540 controller is inaccurately
>>>>>>> labeled “removable”:
>>>>>>> $ udevadm info -a -p /sys/bus/pci/devices/0000:05:00.0 | grep -e
>>>>>>> {removable} -e {device} -e {vendor} -e looking
>>>>>>>     looking at device '/devices/pci0000:00/0000:00:1d.4/0000:05:00.0':
>>>>>>>       ATTR{device}=="0x15d3"
>>>>>>>       ATTR{removable}=="removable"
>>>>>>>       ATTR{vendor}=="0x8086"
>>>>>>
>>>>>> This is actually accurate. The Thunderbolt controller is itself
>>>>>> hot-removable and that BTW happens to be hot-removed when fwupd applies
>>>>>> firmware upgrades to the device.
>>>>
>>>> This is quite interesting take. Does fwupd rip the controller out of the
>>>> box to update it? By that account your touchpad is also removable as it
>>>> may stop functioning when its firmware gets updated.
>>>
>>> The Thunderbolt controller is connected to a hotpluggable PCIe root port
>>> so it will be dissappear from the userspace so that "removable" in that
>>> sense is accurate.
>>
>> There are systems as well where the Thunderbolt (and/or xHCI) controller
>> only appears if there is anything plugged to the physical Type-C ports
>> and it gets removed pretty soon after the physical device gets
>> unplugged. These are also the same Alpine Ridge and Titan Ridge
>> controllers that this patch is dealing with.
>>
>> I tried to think about some sort of more generic heuristic how to figure
>> out that the controller is actually inside the physical system but there
>> is a problem that the same controller can appear on the bus as well, eg.
>> you plug in Thunderbolt dock and that one has xHCI controller too. That
>> device should definitely be "removable". With the "software CM" systems
>> we have a couple of additional hints in the ACPI tables that can be used
>> to identify the "tunneled" ports but this does not apply to the older
>> systems I'm afraid.
> 
> The below "might" work:
> 
> 1. A device that is directly behind a PCIe root or downstream port that
>     has ->external_facing == 1.
> 
> 2. It is a PCIe endpoint.
> 
> 3. It is a sibling to or has any of the below PCI IDs (see
>     drivers/thunderbolt/nhi.h for the definitions):
> 
>     PCI_DEVICE_ID_INTEL_ALPINE_RIDGE_C_4C_NHI
>     PCI_DEVICE_ID_INTEL_ALPINE_RIDGE_C_2C_NHI
>     PCI_DEVICE_ID_INTEL_ALPINE_RIDGE_LP_USBONLY_NHI
>     PCI_DEVICE_ID_INTEL_ALPINE_RIDGE_USBONLY_NHI
>     PCI_DEVICE_ID_INTEL_ALPINE_RIDGE_C_USBONLY_NHI
>     PCI_DEVICE_ID_INTEL_TITAN_RIDGE_2C_NHI
>     PCI_DEVICE_ID_INTEL_TITAN_RIDGE_4C_NHI
> 
>     And for all USB4 we can use the PCI class:
> 
>     PCI_CLASS_SERIAL_USB_USB4
> 
> (4. With USB4 systems we could also add the check that the device is not
> below the tunneled PCIe ports but that's kind of redundant).
> 
> I think this covers the existing devices as well as future discrete USB4
> controllers and marks both the NHI and the xHCI as "fixed" which we
> could also use to lift the bounce buffering restriction from them.
> 
> @Mario, did I miss anything?

The bounce buffering restriction is only for unaligned DMA isn't it? 
Does that tend to happen a lot?

But otherwise I think this does a good job.  It will cover external 
enclosure cases too because of having to check it's directly behind a 
root port.

But it should also include comments about why it's not needed on newer 
systems (IE the ACPI hints for someone with no prior knowledge looking 
at this to find).