Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18;
Subject: Re: [PATCH v6 2/4] driver core: add deferring probe reason to
 devices_deferred property
To:     Dmitry Torokhov <dmitry.torokhov@gmail.com>
Cc:     Jernej Skrabec <jernej.skrabec@siol.net>,
        Grygorii Strashko <grygorii.strashko@ti.com>,
        Bartlomiej Zolnierkiewicz <b.zolnierkie@samsung.com>,
        Greg Kroah-Hartman <gregkh@linuxfoundation.org>,
        Jonas Karlman <jonas@kwiboo.se>,
        Russell King - ARM Linux <linux@armlinux.org.uk>,
        "open list:DRM DRIVERS" <dri-devel@lists.freedesktop.org>,
        lkml <linux-kernel@vger.kernel.org>,
        Neil Armstrong <narmstrong@baylibre.com>,
        Andy Shevchenko <andy.shevchenko@gmail.com>,
        Mark Brown <broonie@kernel.org>,
        Laurent Pinchart <Laurent.pinchart@ideasonboard.com>,
        "Rafael J. Wysocki" <rafael@kernel.org>,
        linux-arm-kernel <linux-arm-kernel@lists.infradead.org>,
        Marek Szyprowski <m.szyprowski@samsung.com>
From:   Andrzej Hajda <a.hajda@samsung.com>
Message-ID: <8b228571-d124-e5e2-2f53-57ea4b46b904@samsung.com>
Date:   Fri, 10 Jul 2020 09:42:49 +0200
User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:68.0) Gecko/20100101
        Thunderbird/68.10.0
MIME-Version: 1.0
In-Reply-To: <20200707041442.GE3273837@dtor-ws>
Content-Transfer-Encoding: 8bit
Content-Language: en-GB
Content-Type: text/plain; charset="utf-8"
CMS-TYPE: 201P
References: <20200626100103.18879-1-a.hajda@samsung.com>
        <CGME20200626100110eucas1p2c5b91f2c98a5c6e5739f5af3207d192e@eucas1p2.samsung.com>
        <20200626100103.18879-3-a.hajda@samsung.com>
        <5f159e00-44fd-515b-dd8c-4db9845dc9e6@ti.com>
        <7e3c924b-c025-a829-6868-78e2935c70eb@samsung.com>
        <66faa188-5ef6-d449-07fe-28c8be5e559c@ti.com>
        <21f5ec9c-2d1d-5f28-5aeb-ac0db144a55e@samsung.com>
        <CAKdAkRRLBLCLGH2qhEjaVnt8wNjoyGAfQimNWHZUvzx2m6Mwng@mail.gmail.com>
        <e6057292-39de-831c-0b8d-b3f0b66937dc@samsung.com>
        <20200707041442.GE3273837@dtor-ws>
Sender: linux-kernel-owner@vger.kernel.org
Precedence: bulk


On 07.07.2020 06:14, Dmitry Torokhov wrote:
> On Thu, Jul 02, 2020 at 08:57:55AM +0200, Andrzej Hajda wrote:
>> On 30.06.2020 20:00, Dmitry Torokhov wrote:
>>> On Tue, Jun 30, 2020 at 8:42 AM Andrzej Hajda <a.hajda@samsung.com> wrote:
>>>> On 30.06.2020 10:59, Grygorii Strashko wrote:
>>>>> Hi
>>>>>
>>>>> On 29/06/2020 14:28, Andrzej Hajda wrote:
>>>>>> Hi Grygorii,
>>>>>>
>>>>>> (...)
>>>>>>
>>>>>>>>      /*
>>>>>>>>       * deferred_devs_show() - Show the devices in the deferred probe
>>>>>>>> pending list.
>>>>>>>>       */
>>>>>>>> @@ -221,7 +241,8 @@ static int deferred_devs_show(struct seq_file *s,
>>>>>>>> void *data)
>>>>>>>>          mutex_lock(&deferred_probe_mutex);
>>>>>>>>            list_for_each_entry(curr, &deferred_probe_pending_list,
>>>>>>>> deferred_probe)
>>>>>>>> -        seq_printf(s, "%s\n", dev_name(curr->device));
>>>>>>>> +        seq_printf(s, "%s\t%s", dev_name(curr->device),
>>>>>>>> + curr->device->p->deferred_probe_reason ?: "\n");
>>>>>>>>            mutex_unlock(&deferred_probe_mutex);
>>>>>>>>
>>>>>>> Sry, may be i missing smth, but shouldn't it be optional
>>>>>>> (CONFIG_DEBUG_FS is probably too generic).
>>>>>>>
>>>>>> I am not sure what exactly are you referring to, but this patch does not
>>>>>> add new property, it just extends functionality of existing one.
>>>>> Sry, needed to be more specific.
>>>>>
>>>>> You've added  device_set_deferred_probe_reson(dev, &vaf);
>>>>> which expected to be used on every EPROBE_DEFER in dev_err_probe() in
>>>>> combination with
>>>>>
>>>>> +       } else {
>>>>> +               device_set_deferred_probe_reson(dev, &vaf);
>>>>>                   dev_dbg(dev, "error %d: %pV", err, &vaf);
>>>>>
>>>>> ^^ dev_dbg() does not add any runtime overhead during boot unless enabled
>>>>> +       }
>>>>>
>>>>> But:
>>>>>
>>>>> +void device_set_deferred_probe_reson(const struct device *dev, struct
>>>>> va_format *vaf)
>>>>> +{
>>>>> +       const char *drv = dev_driver_string(dev);
>>>>> +
>>>>> +       mutex_lock(&deferred_probe_mutex);
>>>>> +
>>>>> +       kfree(dev->p->deferred_probe_reason);
>>>>> +       dev->p->deferred_probe_reason = kasprintf(GFP_KERNEL, "%s:
>>>>> %pV", drv, vaf);
>>>>> +
>>>>> +       mutex_unlock(&deferred_probe_mutex);
>>>>> +}
>>>>>
>>>>> ^^ Adds locking, kfree() and kasprintf() for every deferred probe
>>>>> during boot and can't be disabled.
>>>>>
>>>>> Right?
>>>> Right, but usually the burden should be insignificant in comparison to
>>>> probe time, so I do not think it is worth optimizing.
>>> I do not think this is going to take. You are suggesting that we
>>> modify pretty much every driver to supply this deferral reason, and I
>>> doubt it will happen. Can we put this burden on providers that raise
>>> the deferral?
>>
>> I wouldn't say they raise the deferral, they just inform resource is not
>> yet available. Only device driver, and only in its probe function can
>> "raise the deferral".
> Well, this is a matter of perspective. If devm_gpiod_get() returns
> -EBUSY and this is returned to driver core, is it GPIO line signals that
> line is busy, or is it the driver applies its knowledge. I say that in
> majority of cases driver does not really get a say in this and simply
> has to pass whatever error condition that is signalled by providers up
> the stack.
>
> I would consider whenever a driver does not propagate -EPROBE_DEFER to
> the driver code a bug that needs fixing, because it should not degrade
> functionality and/or performance just because we have not figured out
> how to order probing properly and have to rely on deferrals.
>
>>
>>>    I.e. majority of code are using devm API now, so we most
>>> likely know the device for which deferral is being raised. We can have
>>> a list of deferral reasons and their devices and when in device code
>>> once probe is done we could try reconciling it with the deferred
>>> devicelist, and this would mean you only need to implement this in
>>> gpiolib, regulator core, clocks core, etc.
>>
>> This patchset tries to solve simple issue - replace multiple lines of
>> code present in multiple probe functions (additionally fixing lot of
>> them) with single call and then enhance it little bit, nothing more.
>>
>> What you are proposing is blurry at the moment for me, provider does not
>> know if consumer want to defer,
> This is my point - the consumer does not get to decide. If deferral is
> raised, it must be honored.
>
>> or will continue working without missing resource,
> Deferral does not mean resource does not exist and the driver has to get
> by if it can. It means the resource is not ready, and even if the system
> can work without it, it will not be working optimally.
>
>> moreover some consumers can acquire resources after probe - again no
>> probe deferral.
> In this case we should not signal deferral either.


But the provider does not know if *get is called in probe context or 
not, so it is not able to differentiate it.

So the whole idea is for me suspicious/wrong. Kind of proof:

1. If you insist that provider's EPROBE_ERROR must be always propagated 
to driver core then.

2. You must enforce that resources can be gathered only from probe.

3. But this is against current practice, even if majority of drivers 
does it from probe, there are many which doesn't.

QED :)


So if you really want to go this way it would be good to look at these 
drivers, check why they do it this way, and try to convert them.

But I do not think it is a good way.


Regards

Andrzej

>
>> Even if it will be done (it can be, for
>> example by creating probe version of all resource get functions), it
>> will require much more changes but finally it will look like:
>>
>> res = devm_get_resource_from_probe(....)
>>
>> if (IS_ERR(res))
>>
>>       return PTR_ERR(res);
>>
>> vs:
>>
>> res = devm_get_resource(...)
>>
>> if (IS_ERR(res))
>>
>>       return dev_err_probe(dev, PTR_ERR(res), ...);
> And we will need to adjust how many hundreds of drivers?
>
> Consider that most drivers use devm_clk_get(), devm_gpiod_get() and
> devm_regulator_get() and their friends. All these APIs already have
> device for which resource is being allocated, and moreover their use
> outside of probe() path is highly suspicious (because devm outside of
> probe() typically result in unwinding in really surprising order). So if
> you could stash device and deferral reason in a list and then scan this
> list in driver core when handling the raised deferral you would not need
> to change anything in individual drivers.

> Hope this clears what I had in mind.
>
> Thanks.
>