Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67;
MIME-Version: 1.0
Content-Type: text/plain; charset=US-ASCII;
 format=flowed
Content-Transfer-Encoding: 7bit
Date:   Thu, 09 Aug 2018 15:30:38 -0700
From:   rishabhb@codeaurora.org
To:     "Rafael J. Wysocki" <rafael@kernel.org>
Cc:     Sodagudi Prasad <psodagud@codeaurora.org>,
        Greg Kroah-Hartman <gregkh@linuxfoundation.org>,
        tsoni@codeaurora.org, Vikram Mulukutla <markivx@codeaurora.org>,
        Linux Kernel Mailing List <linux-kernel@vger.kernel.org>,
        ckadabi@codeaurora.org, rjwysocki@gmail.com
Subject: Re: [PATCH] dd: Invoke one probe retry cycle after every initcall
 level
In-Reply-To: <CAJZ5v0h4=TqzXY3W-eVRyCh1FLzAWASoOdNEJyAmHHgJQEMWeg@mail.gmail.com>
References: <1532035440-7860-1-git-send-email-rishabhb@codeaurora.org>
 <CAJZ5v0gWqx5Op-Bbg7bAYALCyBPsc=-+homAYj2Q1qd3WsqmDw@mail.gmail.com>
 <e4ca8572ed913ab65f63be8a351d4439@codeaurora.org>
 <CAJZ5v0ixuWo9RC21Z8zVhuHfkr1uV4vdqMh4s+qGMR7R8Wycag@mail.gmail.com>
 <68b90830d5024ce75a20b017aaf21c05@codeaurora.org>
 <CAJZ5v0jpm8tVjyWjA36Sp-bTEWUE+6cExjH7=CM=LUB-6xvePA@mail.gmail.com>
 <CA+tyz+6ZwtpKM=G5F2Do_sXWyo8r83ma19fWpn4HELiy0XT7=w@mail.gmail.com>
 <de9fc0924f73bc26e067cce6c18d2714@codeaurora.org>
 <CAJZ5v0h4=TqzXY3W-eVRyCh1FLzAWASoOdNEJyAmHHgJQEMWeg@mail.gmail.com>
Message-ID: <2aecb7753a305aac081c9c9b981cedc1@codeaurora.org>
User-Agent: Roundcube Webmail/1.2.5
Sender: linux-kernel-owner@vger.kernel.org
Precedence: bulk

On 2018-08-06 01:53, Rafael J. Wysocki wrote:
> On Fri, Aug 3, 2018 at 12:20 AM, Sodagudi Prasad
> <psodagud@codeaurora.org> wrote:
>>> From: RAFAEL J. WYSOCKI <rafael@kernel.org>
>>> Date: Wed, Aug 1, 2018 at 2:21 PM
>>> Subject: Re: [PATCH] dd: Invoke one probe retry cycle after every
>>> initcall level
>>> To: Rishabh Bhatnagar <rishabhb@codeaurora.org>
>>> Cc: "Rafael J. Wysocki" <rafael@kernel.org>, Greg Kroah-Hartman
>>> <gregkh@linuxfoundation.org>, Linux Kernel Mailing List
>>> <linux-kernel@vger.kernel.org>, ckadabi@codeaurora.org,
>>> tsoni@codeaurora.org, Vikram Mulukutla <markivx@codeaurora.org>
>>> 
>>> 
>>> On Wed, Aug 1, 2018 at 11:18 PM,  <rishabhb@codeaurora.org> wrote:
>>>> 
>>>> On 2018-07-24 01:24, Rafael J. Wysocki wrote:
>>>>> 
>>>>> 
>>>>> On Mon, Jul 23, 2018 at 10:22 PM,  <rishabhb@codeaurora.org> wrote:
>>>>>> 
>>>>>> 
>>>>>> On 2018-07-23 04:17, Rafael J. Wysocki wrote:
>>>>>>> 
>>>>>>> 
>>>>>>> 
>>>>>>> On Thu, Jul 19, 2018 at 11:24 PM, Rishabh Bhatnagar
>>>>>>> <rishabhb@codeaurora.org> wrote:
>>>>>>>> 
>>>>>>>> 
>>>>>>>> 
>>>>>>>> Drivers that are registered at an initcall level may have to
>>>>>>>> wait until late_init before the probe deferral mechanism can
>>>>>>>> retry their probe functions. It is possible that their
>>>>>>>> dependencies were resolved much earlier, in some cases even
>>>>>>>> before the next initcall level. Invoke one probe retry cycle
>>>>>>>> at every _sync initcall level, allowing these drivers to be
>>>>>>>> probed earlier.
>>>>>>> 
>>>>>>> 
>>>>>>> 
>>>>>>> 
>>>>>>> Can you please say something about the actual use case this is
>>>>>>> expected to address?
>>>>>> 
>>>>>> 
>>>>>> 
>>>>>> We have a display driver that depends 3 other devices to be
>>>>>> probed so that it can bring-up the display. Because of
>>> 
>>> dependencies
>>>>>> 
>>>>>> not being met the deferral mechanism defers the probes for a later
>>> 
>>> time,
>>>>>> 
>>>>>> even though the dependencies might be met earlier. With this
>>> 
>>> change
>>>>>> 
>>>>>> display can be brought up much earlier.
>>>>> 
>>>>> 
>>>>> 
>>>>> OK
>>>>> 
>>>>> What runlevel brings up the display after the change?
>>>>> 
>>>>> Thanks,
>>>>> Rafael
>>>> 
>>>> After the change the display can come up after device_initcall level
>>>> itself.
>>>> The above mentioned 3 devices are probed at 0.503253, 0.505210 and
>>> 
>>> 0.523264
>>>> 
>>>> secs.
>>>> Only the first device is probed successfully. With the current
>>>> deferral mechanism the devices get probed again after late_initcall
>>>> at 9.19 and 9.35 secs. So display can only come up after 9.35 secs.
>>>> With this change the devices are re-probed successfully at 0.60 and
>>>> 0.613 secs. Therefore display can come just after 0.613 secs.
>>> 
>>> 
>>> OK, so why do you touch the initcall levels earlier than device_?
>> 
>> 1)      re-probe probing devices in the active list on every level 
>> help to
>> avoid circular dependency pending list.
>> 2)      There are so many devices which gets deferred in earlier init 
>> call
>> levels, so we wanted to reprobe them at every successive init call 
>> level.
> 
> Do you have specific examples of devices for which that helps?
> 
>>> 
>>>> This change helps in overall android bootup as well.
>>> 
>>> 
>>> How exactly?
>> 
>> We have seen less no of re-probes at late_init and most of the 
>> driver's
>> dependency met earlier than late_init call level. It helped display 
>> and
>> couple of other drivers by executing the re probe work at every init 
>> level.
> 
> So I can believe that walking the deferred list on device_initcall and
> maybe on device_initcall_sync may help, but I'm not quite convinced
> that it matters for the earlier initcall levels.

Many of our drivers are dependent on the regulator and bus driver.
Both the regulator and bus driver are probed in the subsys_initcall 
level.
Now the probe of bus driver requires regulator to be working. If the 
probe of
bus driver happens before regulator, then bus driver's probe will be
deferred and all other device's probes which depend on bus driver will 
also be deferred.
The impact of this problem is reduced if we have this patch.