Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
MIME-Version: 1.0
References: <20230414005309.GA2198310@google.com> <CAKwvOd=yQS+0oDC46Hc5D_V0JET8=xbQmAJrpBdg7c4i2EyqHg@mail.gmail.com>
 <20230418203611.GA3640630@google.com> <CAKwvOdnxCJo-FoPfcNw=SBum6yRXOY7_meT8T6gsjV3c3FFm5A@mail.gmail.com>
 <20230418210321.GA3648938@google.com>
In-Reply-To: <20230418210321.GA3648938@google.com>
From:   Nick Desaulniers <ndesaulniers@google.com>
Date:   Wed, 19 Apr 2023 15:55:13 -0700
Message-ID: <CAKwvOdm-3HABzj6BfdnDsrDO1D19cSJ4z5kMeDwEk1pPGxwYhg@mail.gmail.com>
Subject: Re: clangd cannot handle tree_nocb.h
To:     Joel Fernandes <joel@joelfernandes.org>
Cc:     rcu@vger.kernel.org, nathan@kernel.org, trix@redhat.com,
        llvm@lists.linux.dev, linux-kernel@vger.kernel.org,
        paulmck@kernel.org, Masahiro Yamada <masahiroy@kernel.org>,
        Linux Kbuild mailing list <linux-kbuild@vger.kernel.org>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
Precedence: bulk

On Tue, Apr 18, 2023 at 2:03=E2=80=AFPM Joel Fernandes <joel@joelfernandes.=
org> wrote:
>
> Hi Nick,
>
> On Tue, Apr 18, 2023 at 01:46:40PM -0700, Nick Desaulniers wrote:
> > On Tue, Apr 18, 2023 at 1:36=E2=80=AFPM Joel Fernandes <joel@joelfernan=
des.org> wrote:
> > >
> > > On Fri, Apr 14, 2023 at 03:47:51PM -0700, Nick Desaulniers wrote:
> > > > On Thu, Apr 13, 2023 at 5:53=E2=80=AFPM Joel Fernandes <joel@joelfe=
rnandes.org> wrote:
> > > > >
> > > > > Hello!
> > > > >
> > > > > I have been trying to get clangd working properly with tree_nocb.=
h. clangd
> > > > > trips quite badly when trying to build tree_nocb.h to generate AS=
Ts.
> > > >
> > > > Hi Joel,
> > > > Thanks for the report.  What are you using clangd for? I'll bet
> > > > something interesting.
> > >
> > > Thanks for the response and sorry for the late reply. I am at the OSP=
M
> > > conference. I use vim and vscode with clangd. In vim, YCM uses it to
> > > highlight compiler errors live while editing, I am pretty happy with =
it so
> > > far and has been a huge time saver. Enough that now I want to use it =
for
> > > everything...
> >
> > Cool! I use vim, can you share more info about your set up for this?
> > I'll have to try it.
>
> This is how I installed YCM:
>
> # Install YouCompleteMe for vim
> # cd ~/.vim/bundle
> # git clone https://github.com/Valloric/YouCompleteMe.git
> # cd YouCompleteMe/
> # git submodule update --init --recursive
> # python3 install.py --clang-completer

Thanks, I needed to add this
set runtimepath+=3D~/.vim/bundle/YouCompleteMe/
to my ~/.vimrc as well. Via
https://stackoverflow.com/q/60797142
so not sure I fully installed YCM since I didn't see `runtimepath` in
https://github.com/ycm-core/YouCompleteMe, but it's working now for me! Coo=
l!

>
> Then install and run bear in the kernel sources to generate
> compile_compands.json:
> bear -- make -j99 CC=3Dclang
>
> However, there's also the script:
> scripts/clang-tools/gen_compile_commands.py
>
> This generates the .json from an existing build. Thank God because we can
> probably make this generate better .json files which may make clangd bett=
er.

So we have a compile_commands.json make target. All I did was:

$ make LLVM=3D1 -j128 compile_commands.json

it invokes that python script you found which parses the *.o.cmd files
produced from a build.  Unfortunately, that requires a completed
build, and IIRC I think `make clean` deletes compile_commands.json.  I
think we might only want to do that for mrproper...

>
> You don't need YCM to reproduce the issue though if you just use vscode w=
ith
> the clangd plugin.
>
> > > I first came across clangd when developing Chrome userspace code whic=
h is C++
> > > :). In Chrome, ninja builds can be made to output compile_commands.js=
on.
> > > However, now I noticed the support in the kernel and was like, wow I =
need to
> > > try it. Further, YCM seems to work much better with it than without :=
)
> > >
> > > > I've never used it myself, so I don't know where to even begin with
> > > > how to reproduce the issue.
> > >
> > > Ah ok. :). When I ran get_maintainer on the script, your name popped =
up and
> > > someone also suggested that you're the goto person for clang on the k=
ernel
> > > (which I kind of already knew ;)
> >
> > You've cc'ed the right set of folks.  We might not have the expertise
> > related to clangd specifically, but we can point you in the right
> > direction.
>
> Sure, thanks! And thanks for CC'ing the right folks.
>
> > > > It might be worth filing a bug upstream at
> > > > https://github.com/llvm/llvm-project/issues
> > > > or internally under the component
> > > > Language Platforms > C++ > Clang > Tools > Clangd
> > > > with detailed steps to reproduce (and what the observed error actua=
lly
> > > > is). Feel free to cc me, though I don't know the first thing about
> > > > clangd.
> > >
> > > Ok I will consider doing this if needed. One thing I do observe is la=
ck of
> > > good support for header files and it is a known clangd issue [1].
> > >
> > > However, the fixes I was proposing can purely be done in the kernel i=
tself
> > > since all it'd require is generating compile_compands.json with the -=
D<macro>
> > > and editing files to keep clangd happy. I guess one question is, how =
welcome
> > > would such changes to header files be since they're for tooling and i=
sn't
> > > code that will be compiled outside of clangd.
> >
> > Specifically your patch sites some log print that doesn't look
> > indicative of a failure:
> > https://github.com/llvm/llvm-project/blob/53430bfd5c9d0074dd6de06dccea3=
66e1d40bce4/clang-tools-extra/clangd/TUScheduler.cpp#L903-L906
> > so something else is going on here. Just trying to make sure we root ca=
use this.
> >
>
> Right, so clangd's log does not show failure, the failure is when it disp=
lays
> in the code editor that your code has compiler errors when in fact it doe=
s
> not.
>
> So if you open up tree_nocb.h in vscode, for example, you'll see squiggle=
s
> saying 'undefined reference to rcu_data', etc. That makes clangd stop wor=
king
> at the error. Sorry to not make the failure mode clear earlier.

In vim, the very first line is highlighted with:
Too many errors emitted, stopping now [fatal_too_many_errors]
I guess that disables nice checking that's done in .c files?
--=20
Thanks,
~Nick Desaulniers