Message-ID: <90e97b96-2918-294a-0e71-33a42f28d8a8@suse.com>
Date:   Thu, 16 Mar 2023 13:23:25 +0100
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101
 Thunderbird/102.8.0
Subject: Re: [PATCH v2 1/1] Guard pci_create_sysfs_dev_files with atomic value
Content-Language: en-US
To:     Alexander Stein <alexander.stein@ew.tq-group.com>,
        Bjorn Helgaas <bhelgaas@google.com>,
        Oliver Neukum <oneukum@suse.com>
Cc:     Korneliusz Osmenda <korneliuszo@gmail.com>,
        linux-pci@vger.kernel.org, linux-kernel@vger.kernel.org
References: <20230316091540.494366-1-alexander.stein@ew.tq-group.com>
 <6131694.LvFx2qVVIh@steina-w> <612dfdd2-7de1-12a7-c47c-7569c3466224@suse.com>
 <4888964.44csPzL39Z@steina-w>
From:   Oliver Neukum <oneukum@suse.com>
In-Reply-To: <4888964.44csPzL39Z@steina-w>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?TTdLS3MwZ0JuUExsbDJzNDduN05kVTNIR29ZNHBKdDhlZWE1ZVhGdzBBaE0z?=
 =?utf-8?B?NUt4b3BKSERVNWlGZm55b0gxME40UFFXVTRicWJ5M29idExEY1N6ZzczczVi?=
 =?utf-8?B?ZUcwZFY3TXk1Sm54Q0h1WDZ2Rk50TFQ3R2ZaSFBHbXh0NDVkZGNoTnE3Vml3?=
 =?utf-8?B?VHBKdXFvS2VVWldEakJDRWJhcWpLNGRYck42ai8zeGNqSHZ6VjZJTGdsenZ3?=
 =?utf-8?B?Q3B4Q3JWakMyZkt6S25WeGhCdFpiZUwwMHJPM2tPSmd0ajZQVEVuS3Ztd3M4?=
 =?utf-8?B?Wmw2L3FKM1ZTNUJ2bGVZMDhmdW9iSkprMDVleVVsQ2JiMGFtMm9leFpPUXJn?=
 =?utf-8?B?V1NrSUpmUGhidmNSbFhLaUx0SG0zMjdNNXFJSDQwUWg2WGVSRk51K21YZ2hh?=
 =?utf-8?B?UG9PR2x1eXNhQ3lwM0xmY2ZNVTB4NzYxaHh0UlpWQWU3OHBNckVVdXR0MGRD?=
 =?utf-8?B?U0tFWTcxV2J6Tis5Vk1rWWZ1NlNuKzlUNzJYTHc1ZnFIZ2lFVFhKanNYQWNT?=
 =?utf-8?B?d3dxVEU4WERJeDJ2eS9udWsxSGFKQkJwQVo5UDd4eVJRSWhsMVZPanNoL283?=
 =?utf-8?B?Wkw3ZUt4REdsVVZVMmhySkJ4VnRkelFZODYrR3NsV2VreWpwTnlJakswV3ha?=
 =?utf-8?B?bEtZV29WU1hveWNSdytEL1h2QjBqOW5DQVJiZ1FRaDBpYUdNQkxQbzFKTCt1?=
 =?utf-8?B?VGhaZzhTZkorUEdiNGVkSHhNU1VOcTcvbmxKejJvSVJoKzMyWlJONmwwYjhx?=
 =?utf-8?B?NS9od2NjT2lNcXlSV2JFSCt4L0w4LzZXZzVPRVFyVVFLRWhFMzhQa2tSemta?=
 =?utf-8?B?SXRjQ2c1bTA5K2hGWTIxSGRKUFhBUG5WV2l0elNmWUVVT1czRkxFS3JaTVIr?=
 =?utf-8?B?UFJlZ2pFRDRLZmFhMTBjbUZzQjlqREpPUk4waERZSWtBM0t4bFdKZWd6bzhL?=
 =?utf-8?B?VW5GcmZ0V3RQeDd0ZVloaGRNeWxlaEVlTlMwVnNVVko5RGFvMERwclpickd4?=
 =?utf-8?B?SFNrcm8zWi9QV2YrUDVJY1hTWnNKT0t0NXg2aGpmemc0b3M5YkhKMXRRVW1s?=
 =?utf-8?B?bHB0OEh4MkhQY3V1djloWFdlamljZUdJL1VNVlI0Qmd4SHZlenY1cWpYQ0ZY?=
 =?utf-8?B?N1pKNHZ2azZUQW16Y2piMFpEMUJKellya2xFaVRwSW54a291aEVRU2FsS3p2?=
 =?utf-8?B?WjJBWUxrYlhJczlGQy9FMDc1MXUxVWxkaWVpSFNyOXllWUZsTmtOM1MzVVdU?=
 =?utf-8?B?UklWQkd2cHZLc3AyNndHZzRNKzFFc2Fkdjk0Q3crYnkyUzN0L0FONUNaT0tv?=
 =?utf-8?B?cHlYM2drYXN0Q2taNDJHRmp5UFkrZTVDbG54akpwV2ZZMVhsbFY1cWdzeVRW?=
 =?utf-8?B?VzhQVTlzWi9Sem5IVndDelJKSElldjR1K2ZES2RYanIzdFlUUEx6eGE3Q1Nz?=
 =?utf-8?B?SUxaRUtzRDRBakJuQjI3N2JQZFY4eWdESHdqdU54YXFQM2ZVcUZkeFE5STk5?=
 =?utf-8?B?UnNqMjFVWFVNME96MDJIUmlnc3NRNTE4MVZIUXdXNUhoekNNb1B5R2YrdE1Z?=
 =?utf-8?B?bzVaZXNpMVpQYU83RkxJSlBJTnZURGxNM2dYNHY1SytJYmdVSDh6SUVmc2tQ?=
 =?utf-8?B?VUJJM2pLSVlPN3NuSC9SdzFyVEg1MCt0K2ljc2NlUHFVaEhXVjNrTUZRaDdm?=
 =?utf-8?B?djF3RlR5dERRbDZaOHFFYVZFYmlWMmY1aUE0Qm82eTNONW9vM2R1eEFlMlJn?=
 =?utf-8?B?T2FSTVZmcUNwbnhmQjRDNGlGTlpHKzFmQUxCbmQvZmRPdlNKelBTcFFGQTlV?=
 =?utf-8?B?WThic3IreitHSFNpOHNOdktPWEVEVm1XN2NsWEdIRVA2djRIL3dXc01md2tL?=
 =?utf-8?B?elpzcmJXR1RmVVN1UVFUV1VpYVE0bTVYZFNmVE5OOU1rT2VEZFlHNlM0MEI5?=
 =?utf-8?B?dFlzVUIrY3FSV05ERHFkd1JSbVRtS3hUNGlEY2oxbWFkdy8zdzVmSU12czJo?=
 =?utf-8?B?WUIyd2dWcEZUeHlOV25oNXdUKzd1WDB2aFhnMWhML1NFT2pHUXd5ZldSNDNz?=
 =?utf-8?B?bXJMSmpZMmlBdHZ0b3hpVlhWVVdEU1EwYTkyOEFBY0czWUpPREdadHViS3Uv?=
 =?utf-8?B?czlieTNyUnhySy9rR1hXNU9BVC9KSVJnMXQwc2oxczVURUR0MHhHWjZTUTd3?=
 =?utf-8?Q?o7wmfJ4UxqQGrRzMPfbpiXBV2uoKcJNkqSwKvum/ocZg?=
X-OriginatorOrg: suse.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 49469ebf-d68f-4adf-47e1-08db26193ec0
X-MS-Exchange-CrossTenant-AuthSource: VI1PR04MB7104.eurprd04.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 16 Mar 2023 12:23:27.3133
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: f7a17af6-1c5c-4a36-aa8b-f5be247aa4ba
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: Y9xemrka0W9ehKcDtqQDIksEAqBwv+c4P0ZzQu1RO+w83JEyMnH2cudrwgNRpI8HKTRwrtcVj4pXLuQEaGGc5Q==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: PA4PR04MB7631
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

On 16.03.23 12:58, Alexander Stein wrote:
> Hi Oliver,
> 
> Am Donnerstag, 16. März 2023, 12:17:32 CET schrieb Oliver Neukum:

>> It seems to me that you must not add a bridge before
>> pci_create_sysfs_dev_files() has finished. Now you could add a wait_queue
>> and a flag and wait for it to finish. But that is not very elegant.
> 
> Do we need the pci_sysfs_init initcall at all? Or to put it in other words,
> what does this initcall solve?

Fundamentally something has to discover the root bridge.
Secondly your system has to boot. The device right behind
the root bridge will already be up and running when the kernel
takes control. IMHO treating such devices differently from
other devices makes sense.

> See my different approach eliminating this race at all.

Please elaborate
  
>>  From which initcall is your driver probed?
> 
> The callstack looks like this:
>> imx6_pcie_probe from platform_probe+0x5c/0xb8
>> platform_probe from call_driver_probe+0x24/0x118
>> call_driver_probe from really_probe+0xc4/0x31c
>> really_probe from __driver_probe_device+0x8c/0x120
>> __driver_probe_device from driver_probe_device+0x30/0xc0
>> driver_probe_device from __driver_attach_async_helper+0x50/0xd8
>> __driver_attach_async_helper from async_run_entry_fn+0x30/0x144
>> async_run_entry_fn from process_one_work+0x1c4/0x3d0
>> process_one_work from worker_thread+0x50/0x41c
>> worker_thread from kthread+0xec/0x104
>> kthread from ret_from_fork+0x14/0x2c
> 
> So technically the device is not probed from within a initcall but a kthread.
> It is set to be probed asynchronous in imx6_pcie_driver.

That may be the problem, respectively that system is incomplete
You are registering a PCI bridge. The PCI subsystem should be
done setting up when you run. That is just a simple dependency.

	Regards
		Oliver