Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:8 as permitted sender) client-ip=2620:137:e000::3:8;
MIME-Version: 1.0
References: <20231130125606.64931-1-prabhakar.mahadev-lad.rj@bp.renesas.com>
 <CAMuHMdWd3XY8r-Db_JgazCin_xgSmTGttKzAaHGRKAXsM5xJOQ@mail.gmail.com>
 <CA+V-a8uKCfdOXVQ6cEPQfXFdrJQT_NDztt=++o95AQEAeM9GGg@mail.gmail.com>
 <CAMuHMdVXDBP=rXiaQPFNPzCEY1QrzS5W2wm9=NtkWSwO4_8y2g@mail.gmail.com>
 <CA+V-a8shubctjQrg4DP-4RVAPg-TOn-twWeg5bL+M2JDsMGBbw@mail.gmail.com> <CAMuHMdVaybxXhPu0Od=A8YLR4JpgN4fV=Win==Etg1N8c+r4jA@mail.gmail.com>
In-Reply-To: <CAMuHMdVaybxXhPu0Od=A8YLR4JpgN4fV=Win==Etg1N8c+r4jA@mail.gmail.com>
From:   "Lad, Prabhakar" <prabhakar.csengg@gmail.com>
Date:   Thu, 30 Nov 2023 21:23:21 +0000
Message-ID: <CA+V-a8tZLihfMP_y-YTRdzrNL1ZdACvs07wq_-zeBpzyzbap4g@mail.gmail.com>
Subject: Re: [PATCH v2] riscv: errata: andes: Probe for IOCP only once in boot stage
To:     Geert Uytterhoeven <geert@linux-m68k.org>
Cc:     Paul Walmsley <paul.walmsley@sifive.com>,
        Palmer Dabbelt <palmer@dabbelt.com>,
        Albert Ou <aou@eecs.berkeley.edu>,
        Conor Dooley <conor.dooley@microchip.com>,
        Yu Chien Peter Lin <peterlin@andestech.com>,
        Samuel Holland <samuel.holland@sifive.com>,
        linux-riscv@lists.infradead.org, linux-kernel@vger.kernel.org,
        linux-renesas-soc@vger.kernel.org,
        Biju Das <biju.das.jz@bp.renesas.com>,
        Lad Prabhakar <prabhakar.mahadev-lad.rj@bp.renesas.com>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
Precedence: bulk

Hi Geert,

On Thu, Nov 30, 2023 at 4:54=E2=80=AFPM Geert Uytterhoeven <geert@linux-m68=
k.org> wrote:
>
> Hi Prabhakar,
>
> On Thu, Nov 30, 2023 at 5:50=E2=80=AFPM Lad, Prabhakar
> <prabhakar.csengg@gmail.com> wrote:
> > On Thu, Nov 30, 2023 at 4:26=E2=80=AFPM Geert Uytterhoeven <geert@linux=
-m68k.org> wrote:
> > > On Thu, Nov 30, 2023 at 5:23=E2=80=AFPM Lad, Prabhakar
> > > <prabhakar.csengg@gmail.com> wrote:
> > > > On Thu, Nov 30, 2023 at 2:34=E2=80=AFPM Geert Uytterhoeven <geert@l=
inux-m68k.org> wrote:
> > > > > On Thu, Nov 30, 2023 at 1:56=E2=80=AFPM Prabhakar <prabhakar.csen=
gg@gmail.com> wrote:
> > > > > > From: Lad Prabhakar <prabhakar.mahadev-lad.rj@bp.renesas.com>
> > > > > >
> > > > > > We need to probe for IOCP only once during boot stage, as we we=
re probing
> > > > > > for IOCP for all the stages this caused the below issue during =
module-init
> > > > > > stage,
> > > > > >
> > > > > > [9.019104] Unable to handle kernel paging request at virtual ad=
dress ffffffff8100d3a0
> > > > > > [9.027153] Oops [#1]
> > > > > > [9.029421] Modules linked in: rcar_canfd renesas_usbhs i2c_riic=
 can_dev spi_rspi i2c_core
> > > > > > [9.037686] CPU: 0 PID: 90 Comm: udevd Not tainted 6.7.0-rc1+ #5=
7
> > > > > > [9.043756] Hardware name: Renesas SMARC EVK based on r9a07g043f=
01 (DT)
> > > > > > [9.050339] epc : riscv_noncoherent_supported+0x10/0x3e
> > > > > > [9.055558]  ra : andes_errata_patch_func+0x4a/0x52
> > > > > > [9.060418] epc : ffffffff8000d8c2 ra : ffffffff8000d95c sp : ff=
ffffc8003abb00
> > > > > > [9.067607]  gp : ffffffff814e25a0 tp : ffffffd80361e540 t0 : 00=
00000000000000
> > > > > > [9.074795]  t1 : 000000000900031e t2 : 0000000000000001 s0 : ff=
ffffc8003abb20
> > > > > > [9.081984]  s1 : ffffffff015b57c7 a0 : 0000000000000000 a1 : 00=
00000000000001
> > > > > > [9.089172]  a2 : 0000000000000000 a3 : 0000000000000000 a4 : ff=
ffffff8100d8be
> > > > > > [9.096360]  a5 : 0000000000000001 a6 : 0000000000000001 a7 : 00=
0000000900031e
> > > > > > [9.103548]  s2 : ffffffff015b57d7 s3 : 0000000000000001 s4 : 00=
0000000000031e
> > > > > > [9.110736]  s5 : 8000000000008a45 s6 : 0000000000000500 s7 : 00=
0000000000003f
> > > > > > [9.117924]  s8 : ffffffc8003abd48 s9 : ffffffff015b1140 s10: ff=
ffffff8151a1b0
> > > > > > [9.125113]  s11: ffffffff015b1000 t3 : 0000000000000001 t4 : fe=
fefefefefefeff
> > > > > > [9.132301]  t5 : ffffffff015b57c7 t6 : ffffffd8b63a6000
> > > > > > [9.137587] status: 0000000200000120 badaddr: ffffffff8100d3a0 c=
ause: 000000000000000f
> > > > > > [9.145468] [<ffffffff8000d8c2>] riscv_noncoherent_supported+0x1=
0/0x3e
> > > > > > [9.151972] [<ffffffff800027e8>] _apply_alternatives+0x84/0x86
> > > > > > [9.157784] [<ffffffff800029be>] apply_module_alternatives+0x10/=
0x1a
> > > > > > [9.164113] [<ffffffff80008fcc>] module_finalize+0x5e/0x7a
> > > > > > [9.169583] [<ffffffff80085cd6>] load_module+0xfd8/0x179c
> > > > > > [9.174965] [<ffffffff80086630>] init_module_from_file+0x76/0xaa
> > > > > > [9.180948] [<ffffffff800867f6>] __riscv_sys_finit_module+0x176/=
0x2a8
> > > > > > [9.187365] [<ffffffff80889862>] do_trap_ecall_u+0xbe/0x130
> > > > > > [9.192922] [<ffffffff808920bc>] ret_from_exception+0x0/0x64
> > > > > > [9.198573] Code: 0009 b7e9 6797 014d a783 85a7 c799 4785 0717 0=
100 (0123) aef7
> > > > > > [9.205994] ---[ end trace 0000000000000000 ]---
> > > > > >
> > > > > > This is because we called riscv_noncoherent_supported() for all=
 the stages
> > > > > > during IOCP probe. riscv_noncoherent_supported() function sets
> > > > > > noncoherent_supported variable to true which has an annotation =
set to
> > > > > > "__ro_after_init" due to which we were seeing the above splat. =
Fix this by
> > > > > > probing for IOCP only once in boot stage by having a boolean va=
riable
> > > > > > is_iocp_probe_done which will be set to true upon IOCP probe in
> > > > > > errata_probe_iocp() and we bail out early if is_iocp_probe_done=
 is set.
> > > > > >
> > > > > > While at it make return type of errata_probe_iocp() to void as =
we were
> > > > > > not checking the return value in andes_errata_patch_func().
> > > > > >
> > > > > > Fixes: e021ae7f5145 ("riscv: errata: Add Andes alternative port=
s")
> > > > > > Signed-off-by: Lad Prabhakar <prabhakar.mahadev-lad.rj@bp.renes=
as.com>
> > > > > > ---
> > > > > > v1->v2
> > > > > > * As RISCV_ALTERNATIVES_BOOT stage can happen twice add a is_io=
cp_probe_done
> > > > > >   variable to probe for IOCP only once.
> > > > > > * Updated commit message
> > > > > > * Make return value of errata_probe_iocp() to void
> > > > >
> > > > > Thanks for the update!
> > > > >
> > > > > > --- a/arch/riscv/errata/andes/errata.c
> > > > > > +++ b/arch/riscv/errata/andes/errata.c
> > > > > > @@ -38,29 +38,36 @@ static long ax45mp_iocp_sw_workaround(void)
> > > > > >         return ret.error ? 0 : ret.value;
> > > > > >  }
> > > > > >
> > > > > > -static bool errata_probe_iocp(unsigned int stage, unsigned lon=
g arch_id, unsigned long impid)
> > > > > > +static void errata_probe_iocp(unsigned int stage, unsigned lon=
g arch_id, unsigned long impid)
> > > > > >  {
> > > > > > +       static bool is_iocp_probe_done;
> > > > >
> > > > > done?
> > > > >
> > > > OK I'll rename it to "done".
> > > >
> > > > > > +
> > > > > >         if (!IS_ENABLED(CONFIG_ERRATA_ANDES_CMO))
> > > > > > -               return false;
> > > > > > +               return;
> > > > > > +
> > > > > > +       if (is_iocp_probe_done)
> > > > > > +               return;
> > > > > >
> > > > >
> > > > > Why not keep it simple, and just do
> > > > >
> > > > >     done =3D true;
> > > > >
> > > > OK.
> > > >
> > > > > here?
> > > > > Can arch_id or impid suddenly change, so you have to recheck?
> > > > I only check arch_id and impid here. Are you suggesting I drop it?
> > >
> > > No, I do not suggest to drop it.
> > > I suggested moving the "done =3D true" up, so the check is done only =
once.
> > >
> > OK, I'll have something like below:
> >
> > static void errata_probe_iocp(unsigned int stage, unsigned long
> > arch_id, unsigned long impid)
> > {
> >     static bool done;
> >
> >     if (!IS_ENABLED(CONFIG_ERRATA_ANDES_CMO))
> >         return;
> >
> >     if (done)
> >         return;
> >
> >     if (arch_id !=3D ANDES_AX45MP_MARCHID || impid !=3D ANDES_AX45MP_MI=
MPID)
> >         return;
>
> Please move this check below "done =3D true", as there is no need to
> execute this check multiple times.
>
OK, will do.

Cheers,
Prabhakar