Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.33 as permitted sender) client-ip=23.128.96.33;
Message-ID: <adcc6446-8c30-a258-e19b-76fca2c50d21@amd.com>
Date:   Wed, 13 Dec 2023 16:04:57 +0530
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101
 Thunderbird/102.15.1
Subject: Re: [Patch v2 2/2] thunderbolt: Teardown tunnels and reset downstream
 ports created by boot firmware
Content-Language: en-US
To:     Mika Westerberg <mika.westerberg@linux.intel.com>,
        Sanath S <Sanath.S@amd.com>
Cc:     mario.limonciello@amd.com, andreas.noever@gmail.com,
        michael.jamet@intel.com, YehezkelShB@gmail.com,
        linux-usb@vger.kernel.org, linux-kernel@vger.kernel.org
References: <20231212191635.2022520-1-Sanath.S@amd.com>
 <20231212191635.2022520-3-Sanath.S@amd.com>
 <20231213054914.GI1074920@black.fi.intel.com>
 <20231213061805.GK1074920@black.fi.intel.com>
 <20231213062306.GL1074920@black.fi.intel.com>
From:   Sanath S <sanaths2@amd.com>
In-Reply-To: <20231213062306.GL1074920@black.fi.intel.com>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?aTdRUU9oSjZRUG9CQzNxem5CZHZMcUx6ckVmNVJ5cVJiaUMyRUR5L256a1dx?=
 =?utf-8?B?dHJTVWFrYjd4bVZaRllNSTFRTnFGVFJkK0hRbWxaOFAxdUdKRExEamZ1VlA2?=
 =?utf-8?B?MkFCcE5uckhOUGhnZHlRNE9GaFNzZnU5T1h0NVBXUnVBNWRHcUgvTno0Yys0?=
 =?utf-8?B?VUdKK1MzUUcrblV5WkpsZzU1ZUJ0c01SczlUNmhwNFFwdmk4dnBYd1oxUk9l?=
 =?utf-8?B?QzQzYVFRWVF0THJYWWFLbU1QYmVKT0JpTmFYTW50U3VIUzhXaDVUUktiT3VN?=
 =?utf-8?B?YmhaVXRGZUtZaDFOVGlDNHpqaXVxN3pRdkFpYysxNWhub0ZqdWdlNUkzUTF2?=
 =?utf-8?B?U2FXWE96VWY5bHQ4WDdabTJaMFdBK2pZWUpDQWt2Wi9Qak1VZitEbkYyeFlh?=
 =?utf-8?B?UXFRc3hkM2gwWWxIWktsRDZkMW1YZTBYRnZqM2QzbVYvTGlNU3I1U3pHK0lR?=
 =?utf-8?B?b2t2ekVCTVhJNTJ4ajU5dGZnTFBxVkxSYWZKNitzaXhsV2ZRMWpWZGFtcVN2?=
 =?utf-8?B?ZlNpRy9TMEZVUUJ6TDd4TGVPZGk5eFFSZ3JSL1VXblBIQVg3aWd2dmdQQUtW?=
 =?utf-8?B?S2xaYVI4TkdRd0lZdU9TdTZHUVdpbzRVVVpGczBWLzVWQ2VvdGxia2pWNTJQ?=
 =?utf-8?B?T3dYOGJCL3BBbHkrckpUREdtRkV4L0pMN0oxd3JCMy9NQUFJK3V1YU1Jd245?=
 =?utf-8?B?ZCtuQVpkUXVXdGE0ejFpQnpMckhIN0dhSjFWWU1ieWxVelRmeXdsS0pDcnlp?=
 =?utf-8?B?bU11bEJQa2cvcHRIcEV3TWtIb3ZBZzN1NGZXMmxKa0VjOE0ybXdxVU9meDZX?=
 =?utf-8?B?VExOVTZhdnZWSEhUQTdFanBib2VhRCtiaEIxaWNuT3NUdDh0TXZpUHJMdTdP?=
 =?utf-8?B?ZndSUnJLZTZaQ1liWHJnbElXQkpJa2lOZU54cHorNmNVQUpXQktrNkRGcVAr?=
 =?utf-8?B?RGhyU1hia2lMekNCU29Ud2VjNG5hbnJ0dlkvU3NIVEhOV3Y1Z1J2Y1pQcDVG?=
 =?utf-8?B?b3dJdkN3ZzBNazBDU3pvTmJOM3oxQlFzdVRQR0xLTis3VDlTbVNHUG4yZitR?=
 =?utf-8?B?YjFvU3hXMWZ6Tm5BTFZya1l2T1RSbGduZ1VYc0IydVVBOUg1SkhibkJoWGtk?=
 =?utf-8?B?Y0QzNGRwT2xHbGovRHZ4THU0cGZlb2ZlMDQ2eTlVbFBycmNPck1qbDlPdXJh?=
 =?utf-8?B?UzRCalZjRVZGTzkvM0dnRERzTUpQZ1lCS2hWZDBkemNQUGpWUHpra3hyVjg1?=
 =?utf-8?B?b0JleHQzb1E0cXZNaW04NkQrL25PbmppYWZ2TlY0eE05dGNYR2cyRS9lVlRL?=
 =?utf-8?B?eTRsNHlLVXdkdTY4S3F2Tno0akliWFl2T1dPWEVKNTB4alNPeHpQdUppMFBw?=
 =?utf-8?B?MHRCN1VrZjJ2ZmZrYUJhQk1PSU53bGFmZDF4WTBBWVF3U2hNSDlWSkp0WmtB?=
 =?utf-8?B?cDlPLzNtKzBFTW00b2xJcXNUR3RtZTVXYjN3QWJHMEdpK3JQSFNibGhNV0h1?=
 =?utf-8?B?WngvclNEYW1xWUljbHJYbmFyUGtJcG9PVkE2ajh5ZEc5SDVDalJVTm9tOW1m?=
 =?utf-8?B?RTQxZ2cwbFR3VEpuSEFMa2JKZE1JSlROZnVNcHBsT3JkQTNvNlBtKytWUU12?=
 =?utf-8?B?YkdQWlR3NC9nNk5nc3hqWkhYVC9Xb1ROWWF0bitPYUgvOFRHZHZUZlJFaEl0?=
 =?utf-8?B?d1NVZzNuUy9hZUhreWZxUG5xemM5VHpSOXQ5aW5EZWRQWGVMSGpWbmpCcnVi?=
 =?utf-8?B?S3RWYWRyNmw2V2tMaFB1bkVZZlFuQ1pTT2NRRGpuQTJuT3RoZCtQcjBNTUhp?=
 =?utf-8?B?WUdxcnNLRjNoVVlPdGEzNXNjQlBsTG5UbE4xMWprZEN1ZmNMUVV0NjhkZmxJ?=
 =?utf-8?B?WDZuZVdkN01wQmwyMUtqeDhFbk5WaDdwQWZVTElFSHFXMlJrRlJMZ2dTK0JK?=
 =?utf-8?B?Z0VIY0ZiN01ocTBYZFhOdDdXODl6dmF6b0Vac2c3V1JpajhGNEJ3V1BBRStQ?=
 =?utf-8?B?WlhlZ2JiekZzV01RblBCU0R4N05BM0NxOG8rUDIrVW9SSlhqd3BsL0F1OTcz?=
 =?utf-8?B?bW4zYTVMbVR5NEdtK0t0OGVabUdqOXd0M0xWNjBJQ3JiMFlUZForYkJLdFR4?=
 =?utf-8?Q?K9MidB1Oq7xSWGCKnV60w5mr3?=
X-OriginatorOrg: amd.com
X-MS-Exchange-CrossTenant-Network-Message-Id: bd63527b-82d5-4077-ec11-08dbfbc72bff
X-MS-Exchange-CrossTenant-AuthSource: MW4PR12MB7016.namprd12.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 13 Dec 2023 10:35:06.3567
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: /sPjR0WE0h4UDwaoFjr+5mHTgOtajIDHhrEN4X4lwEbG08tfx5W1aq99V91+izCjx+jBa773pLNOTJhTk8mKpA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SA1PR12MB6895
X-Spam-Status: No, score=-1.6 required=5.0 tests=DKIMWL_WL_HIGH,DKIM_SIGNED,
	DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,
	MAILING_LIST_MULTI,NICE_REPLY_A,SPF_HELO_NONE,SPF_PASS,
	T_SCC_BODY_TEXT_LINE autolearn=unavailable autolearn_force=no
	version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lipwig.vger.email
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org
X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (lipwig.vger.email [0.0.0.0]); Wed, 13 Dec 2023 02:35:24 -0800 (PST)


On 12/13/2023 11:53 AM, Mika Westerberg wrote:
> On Wed, Dec 13, 2023 at 08:18:06AM +0200, Mika Westerberg wrote:
>> On Wed, Dec 13, 2023 at 07:49:14AM +0200, Mika Westerberg wrote:
>>> On Wed, Dec 13, 2023 at 12:46:35AM +0530, Sanath S wrote:
>>>> Boot firmware might have created tunnels of its own. Since we cannot
>>>> be sure they are usable for us. Tear them down and reset the ports
>>>> to handle it as a new hotplug for USB3 routers.
>>>>
>>>> Suggested-by: Mario Limonciello <mario.limonciello@amd.com>
>>>> Signed-off-by: Sanath S <Sanath.S@amd.com>
>>>> ---
>>>>   drivers/thunderbolt/tb.c | 11 +++++++++++
>>>>   1 file changed, 11 insertions(+)
>>>>
>>>> diff --git a/drivers/thunderbolt/tb.c b/drivers/thunderbolt/tb.c
>>>> index fd49f86e0353..febd0b6972e3 100644
>>>> --- a/drivers/thunderbolt/tb.c
>>>> +++ b/drivers/thunderbolt/tb.c
>>>> @@ -2598,6 +2598,17 @@ static int tb_start(struct tb *tb)
>>>>   	tb_switch_tmu_enable(tb->root_switch);
>>>>   	/* Full scan to discover devices added before the driver was loaded. */
>>>>   	tb_scan_switch(tb->root_switch);
>>>> +	/*
>>>> +	 * Boot firmware might have created tunnels of its own. Since we cannot
>>>> +	 * be sure they are usable for us, Tear them down and reset the ports
>>>> +	 * to handle it as new hotplug for USB4 routers.
>>>> +	 */
>>>> +	if (tb_switch_is_usb4(tb->root_switch)) {
>>>> +		tb_switch_discover_tunnels(tb->root_switch,
>>>> +					   &tcm->tunnel_list, false);
>>> Why this is needed?
>>>
>>> It should be enough, to do simply something like this:
>>>
>>> 	if (tb_switch_is_usb4(tb->root_switch))
>>> 		tb_switch_reset(tb->root_switch);
If we don't tear down of tunnels before performing the DPR, the PCIe 
enumeration is failing.

PCIe link is not coming up after DPR. Below log is missing without 
performing path
deactivation before performing DPR and hence PCIe enumeration is not 
initiated.

[  746.630865] pcieport 0000:00:03.1: pciehp: Slot(0-1): Card present
[  746.630885] pcieport 0000:00:03.1: pciehp: Slot(0-1): Link Up

I think when we do a DPR, it internally does some handling with PCI Path 
Enable bit(PE).
So, deactivation of PCIe path is necessary for DPR to work.

>> Actually this needs to be done only for USB4 v1 routers since we already
>> reset USB4 v2 hosts so something like:
>>
>> 	/*
>> 	 * Reset USB4 v1 host router to get rid of possible tunnels the
>> 	 * boot firmware created. This makes sure all the tunnels are
>> 	 * created by us and thus have known configuration.
>> 	 *
>> 	 * For USB4 v2 and beyond we do this in nhi_reset() using the
>> 	 * host router reset interface.
>> 	 */
>> 	if (usb4_switch_version(tb->root_switch) == 1)
>> 		tb_switch_reset(tb->root_switch);
>>
>> (possibly add similar comment to the nhi_reset() to refer this one).
> Oh, and would it be possible to tie this with the "host_reset" parameter
> too somehow? I guess it could be moved to "tb.c" and "tb.h" and then
> check it from nhi.c as already done and then here so this would become:
>
>   	if (host_reset && usb4_switch_version(tb->root_switch) == 1)
>   		tb_switch_reset(tb->root_switch);

Is host_reset necessary for USB4 v1 routers ? I did not use host_reset 
in this case.
If its needed, then we have to modify to enable host_reset in nhi.c as well.

> With the idea that the user has a "chicken bit" to disable this
> behaviour (and consistent one with USB4 v2). Feel free to make it look
> nicer though.