Received: by 2002:a05:6a10:9afc:0:0:0:0 with SMTP id t28csp753191pxm; Wed, 2 Mar 2022 07:50:24 -0800 (PST) X-Google-Smtp-Source: ABdhPJxp46j3d+hNvfw58qNwTRsfBRRY7DJvfneliI11V2mmHOEnJ4ebZROhxsDM/VB6pqdQVjaE X-Received: by 2002:a05:6a00:8c4:b0:4e1:5ee9:59a1 with SMTP id s4-20020a056a0008c400b004e15ee959a1mr33869516pfu.51.1646236224715; Wed, 02 Mar 2022 07:50:24 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1646236224; cv=none; d=google.com; s=arc-20160816; b=JVDcn8GkVsfpNYXrolOjH+8nXoj0iWyogP0SQDFMyOVPQHWMOtvBFm0+vMA6AVl/X5 cXcDfJXY/Hp/Tjpq8FEt0H31HZjEYkZBOA9WJLMXKTRw7yAzDbZy+zZC3K5iBfBhwZJd z/NExTVkAmMcOmQ6vRF2Ncm2y9ws8oN6zhiZgZ9pDVKV/k6b4P9QaVj0CvnT7NWoqW7A RYG0vdaWYzdqHNezTUTYjDf2zDCVghKaPxroqlVRF2iMeYqy3RhGX2f3C9Kr7/uZI70b mCPuGveTrBwzEBfOz7UB6xq9KlOp5llnoeUZu7fBYMqu2hoCxEqRRQXiH2XmS1rBFIqt gfyw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:cc:to:subject:message-id:date:from:in-reply-to :references:mime-version:dkim-signature; bh=Cs5a65+8+xNkyPYqt3ZPHIgi0AGBUKymf66yATghK1A=; b=wbwcNl6tYOSa9oX8GEc4iNvXz6DOZBDmiAoGWVhZyaeqxwcvfEPOMJQkan1MiXQVV0 Ee45v4k+ziCCfYPcpVby7EUz736idAgv6hXADKLepEjOLGQYiskO58Qxv0qyfnm7S6Hv XVE7jg9Qlqj/jvseci7p2bSj7M2FRAiDCwHuJPaYxKOgWt9vIrMSZ14vvUmm6a6FYgAM qFCajQmsBWFOwWnpWzYHO9UxHwpaF2ZpO3sym46dsFVFcQrkI6QrmYf6XVWePdcnrclf R9VPnCZkkIff2QdfHH7AMOYSvJhYX0GgmB3WMHKN8a2K81JB8dVFdMr/QSbs/7b7DcCO 5qJg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20210112 header.b=Ky7r0F7E; spf=pass (google.com: domain of linux-bluetooth-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-bluetooth-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id w2-20020a1709029a8200b0014f0b917878si15580812plp.215.2022.03.02.07.50.01; Wed, 02 Mar 2022 07:50:24 -0800 (PST) Received-SPF: pass (google.com: domain of linux-bluetooth-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20210112 header.b=Ky7r0F7E; spf=pass (google.com: domain of linux-bluetooth-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-bluetooth-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S235941AbiCAS60 (ORCPT + 99 others); Tue, 1 Mar 2022 13:58:26 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:33400 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S237098AbiCAS6Z (ORCPT ); Tue, 1 Mar 2022 13:58:25 -0500 Received: from mail-yw1-x112b.google.com (mail-yw1-x112b.google.com [IPv6:2607:f8b0:4864:20::112b]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id CB68DEBE for ; Tue, 1 Mar 2022 10:57:42 -0800 (PST) Received: by mail-yw1-x112b.google.com with SMTP id 00721157ae682-2dbd8777564so40281307b3.0 for ; Tue, 01 Mar 2022 10:57:42 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=Cs5a65+8+xNkyPYqt3ZPHIgi0AGBUKymf66yATghK1A=; b=Ky7r0F7Ehs5L5hKDUFe9OpBcOpc6qp9YAJhN0+kddl37ks87MlRHlp5G9d9elynEtt ywWEitn/E0tN7M7X3Fi8B5oelsrxY3141H6ey+CWFI/yxQjDWbufaKhuC8h4JAQpwaN1 i1MVL64y8qhXGGN+75mkg73y20xyzFsB4DiwzWO6D6eaME42Kv8mAU6jMc4J29dE0rHq fS1M4f8xdFVhFGW0fCBuzBt9ya1UCTPNC24dip4ODCNu9is/iEq4V/AO2OGz0iUr5cqL 3NpVdx3OkNK9TztkhbMt6KX0R/+cRbxmgIBeZbnh6myFA+VvIv8JSMjc1SlBMiXp5ot6 cbAQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=Cs5a65+8+xNkyPYqt3ZPHIgi0AGBUKymf66yATghK1A=; b=gzGFzIwEH8zvs4ey1ILa/+pKqeAtDGDbA/FN2/hHAWJ+iSiwl0cbTCVjUO3psWHdsi zuzIkZMnx+S+n+2y1/403H4ziirfJaDedej78gvEwx58NEntprU6a9ogGP++gDncq1ox S0j3K0ljVjpfZozkgG/YwQMKBUWMQLiHFveo8sPjz/IN95G+UJAzodr+BCKG0ctM+WsZ QidNsTn564eOrFKxz7v+5ovUjlN8NlpZdXxWFHHr0ynM1Fj0v/uUktFk3p2dhvNZEwdF +UY+slIM1MgsVt7H4rH3phbmCaergHMTj9R1DkcTdhqgQRwDhyigyOjTAbjqSTwvgkyP SULg== X-Gm-Message-State: AOAM533Zw/xpgx/EbaAelorbyaLjzBsu2r2pf0CWixi3ccYQaUXNzS8z os+KY2tp9/X2jq/MoMUcSkgnHhkx0hM29tkJRRM= X-Received: by 2002:a81:6357:0:b0:2d7:2af4:6e12 with SMTP id x84-20020a816357000000b002d72af46e12mr26245900ywb.317.1646161061693; Tue, 01 Mar 2022 10:57:41 -0800 (PST) MIME-Version: 1.0 References: <82216882-463a-8976-e6bc-4a8919107a31@googlemail.com> <2ce6175c-74ec-8469-80a5-374bd1429542@googlemail.com> <17f2bf7e-1d6b-e090-8926-21a408f2b496@googlemail.com> <16cac2c8-c1ca-c8d7-e3d9-5f00be511614@googlemail.com> <6b17bdb5-dddb-e7c7-86f6-2240c6523a81@googlemail.com> In-Reply-To: From: Luiz Augusto von Dentz Date: Tue, 1 Mar 2022 10:57:30 -0800 Message-ID: Subject: Re: bug kernel 5.17, qualcom and intel adapters, unable to reliably connect to bluetooth devices To: Chris Clayton Cc: Chris Murphy , Bluetooth , regressions@lists.linux.dev Content-Type: text/plain; charset="UTF-8" X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_FROM, RCVD_IN_DNSWL_NONE,SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-bluetooth@vger.kernel.org Hi Chris, On Tue, Mar 1, 2022 at 10:34 AM Luiz Augusto von Dentz wrote: > > Hi Chris, > > On Tue, Mar 1, 2022 at 1:26 AM Chris Clayton wrote: > > > > Hi Luiz, > > > > I guess you are hoping for PEBKAC :-) > > > > On 28/02/2022 21:20, Luiz Augusto von Dentz wrote: > > > Hi Chris, > > > > > > On Mon, Feb 28, 2022 at 1:02 PM Chris Clayton wrote: > > >> > > >> Hi Luiz, > > >> > > >> On 28/02/2022 19:34, Luiz Augusto von Dentz wrote: > > >>> Hi Chris, > > >>> > > >>> On Sat, Feb 26, 2022 at 12:04 AM Chris Clayton wrote: > > >>>> > > >>>> Hi, > > >>>> > > >>>> On 24/02/2022 15:16, Luiz Augusto von Dentz wrote: > > >>>>>> I'll try another bisection today, but limit its range to changes made in the net/bluetooth directory. > > >>>> > > >>>> That bisection has proved very difficult because the bluetooth "service" in kernels at some steps of the bisection were > > >>>> completely borked to the extent that blueman's device-manager application wouldn't start and emitted the messages: > > >>>> > > >>>> blueman-manager 12.00.37 ERROR Manager:137 on_dbus_name_appeared: Default adapter not found, trying first available. > > >>>> blueman-manager 12.00.37 ERROR Manager:141 on_dbus_name_appeared: No adapter(s) found, exiting > > >>>> > > >>>> Obviously, I don't know whether the problem I am trying to pinpoint is hiding behind this more fundamental problem with > > >>>> the bluetooth "service", so being unable to say whether that kernel was good or bad, I had to skip. There seems to be a > > >>>> batch of commits that mean that, whilst the kernel builds okay, hunting down a bluetooth-related problem is not > > >>>> possible. Eventually and I cursed and gave up. Whatever was causing this breakage has obviously been fixed. > > >>>> > > >>>>> Please record the HCI with btmon, it must be producing something since > > >>>>> it records even the mgmt commands. > > >>>>> > > >>>> > > >>>> Refreshed by a good night's sleep, I started another bisection (between 5.16 and 5.17-rc1) yesterday morning but this > > >>>> time did not limit it to net/bluetooth. That was going okay until I ran into what I assume is the same batch of borked > > >>>> kernels. I've been more persistent this time but have just had a run of 16 steps in which the bluetooth support in the > > >>>> kernel is broken so badly that testing bluetooth is not possible. I will push on today, but I've suspended that activity > > >>>> to get the hci trace that Luiz has asked for. > > >>>> > > >>>> Using information from the bisect, I built a kernel that had tested as bad (but not borked). The commit is > > >>>> f2b551fad8d8f2ac5e1f810ad595298381e0b0c5. As I've mentioned before, the problem with devices not connecting is > > >>>> intermittent - for a given kernel, sometimes a connection works and other times it doesn't. On the first boot of this > > >>>> kernel, my bluetooth devices could connect, Attached are 4 files related to this - the output from btmon, and the > > >>>> related portions of daemon.log, kern.log and sys.log from /var/log/. Each of the these files is suffixed with ".good". > > >>>> > > >>>> I then powered down the laptop and booted into the same kernel. This time the bluetooth devices could not connect. Four > > >>>> more files are attached for this boot and are suffixed with ".bad". I said in an earlier email that when connection > > >>>> fails, there is no output from btmon, so that log is empty. That's still the case, but I guess that fact itself is a > > >>>> clue to what the problem might be. What I can add, however, is that if, in that same bad kernel, I unload and then > > >>>> reload the btusb module, connections start to work. Maybe that too is a clue. The same unload/load process revives > > >>>> bluetooth on a kernel built after a pull of Linus' latest and greatest this morning. > > >>>> > > >>>> Since I now have a workround, I'm going stop the current bisection that I was doing. I've done another couple of steps > > >>>> this morning and both produced kernels on which I could not test bluetooth and had to tell git bisect to skip. If > > >>>> however, I can provide any other diagnostics, please let me know. > > >>>> > > >>>> Chris > > >>> > > >>> Can you try with the following patch: > > >>> > > >>> https://patchwork.kernel.org/project/bluetooth/patch/20220228173918.524733-1-brian.gix@intel.com/ > > >>> > > >>> > > >> Sorry, that patch has made no difference. After the first boot my headphones connected okay, but after a power-down and > > >> reboot they would not connect without an unload and reload of the btusb module. > > > > > > Can you tell us exactly what steps you are using? Are you applying on > > > top of what, rc6? > > > > > > > Until I got your patch yesterday, I was using a clone of > > git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git which I update frequently and have been doing so for as > > long as I can remember. Just in case there was a hidden flaw in that tree, I took a new clone yesterday, (so yes, the > > patch was tested on top of rc6) copied over the .config file and applied the patch. Then I built and installed the > > kernel, updated grub, powered off the laptop and booted into the new kernel. Once the laptop had booted and logged in to > > my LXQt desktop, I powered on my headphones and a connection was establisehed almost straight away. I powered the > > headphones off and the disconnection worked fine. > > > > Knowing that the problem crops up intermittently, I then rebooted the laptop. When the boot was complete, I then powered > > on my bluetooth headphones an waited for them to connect to the laptop. After about 20 seconds, a connection had not > > been established. I powered off the headphones, used modprobe to unload and then reload the btusb module. When I powered > > on the headphones, a connectiin was established within 2 or 3 seconds. Ive attempted 5 restart with 5.17.0-0.rc6.109.fc37.x86_64, my headset was able to reconnect every single time without any problem. The only think that was a little bit strange was that it reconnects two normally, once from gdm and then another time when gnome is loading, but I assume it is normal nowadays since it appears when switching session pipewire unregisters its audio endpoints. Perhaps it is some race that depends on how bluetoothd is being started or something. > > I've booted this laptop countless times over the last few days. Doing the bisect, I didn't mark a commit as good until I > > had done five boots and been able to connect my headphones on each boot. What I can say from that work is that two > > consecutive boots into a working kernel are very rare. I can't remeber an occasion when it took more than two boots to > > establish that a kernel was bad. > > Do commands such as bluetoothctl power on or scan on works? Try > running bluetoothd -dn from a shell (disable bluetooth.service), also > are there any settings changed in main.conf? > > > -- > Luiz Augusto von Dentz -- Luiz Augusto von Dentz