Received-SPF: pass (google.com: domain of linux-kernel+bounces-119554-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:4601:e00::3 as permitted sender) client-ip=2604:1380:4601:e00::3;
Precedence: bulk
Mime-Version: 1.0
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain; charset=UTF-8
Date: Tue, 26 Mar 2024 19:08:41 +0200
Message-Id: <D03UIM5QZUZ8.2G6OHP1IM17OU@kernel.org>
To: "Masami Hiramatsu" <mhiramat@kernel.org>, "Mark Rutland"
 <mark.rutland@arm.com>
Cc: <linux-riscv@lists.infradead.org>, "Paul Walmsley"
 <paul.walmsley@sifive.com>, "Palmer Dabbelt" <palmer@dabbelt.com>, "Albert
 Ou" <aou@eecs.berkeley.edu>, <linux-kernel@vger.kernel.org>, "Naveen N .
 Rao" <naveen.n.rao@linux.ibm.com>, "Anil S Keshavamurthy"
 <anil.s.keshavamurthy@intel.com>, "David S . Miller" <davem@davemloft.net>,
 <linux-trace-kernel@vger.kernel.org>, "Calvin Owens"
 <jcalvinowens@gmail.com>
Subject: Re: [PATCH v2] arch/riscv: Enable kprobes when CONFIG_MODULES=n
From: "Jarkko Sakkinen" <jarkko@kernel.org>
References: <20240323232908.13261-1-jarkko@kernel.org>
 <20240325115632.04e37297491cadfbbf382767@kernel.org>
 <ZgLfsvbCZj2S6fRE@FVFF77S0Q05N.cambridge.arm.com>
 <20240327002403.62649aee45508b7a16caedba@kernel.org>
In-Reply-To: <20240327002403.62649aee45508b7a16caedba@kernel.org>

On Tue Mar 26, 2024 at 5:24 PM EET, Masami Hiramatsu (Google) wrote:
> On Tue, 26 Mar 2024 14:46:10 +0000
> Mark Rutland <mark.rutland@arm.com> wrote:
>
> > Hi Masami,
> >=20
> > On Mon, Mar 25, 2024 at 11:56:32AM +0900, Masami Hiramatsu wrote:
> > > Hi Jarkko,
> > >=20
> > > On Sun, 24 Mar 2024 01:29:08 +0200
> > > Jarkko Sakkinen <jarkko@kernel.org> wrote:
> > >=20
> > > > Tracing with kprobes while running a monolithic kernel is currently
> > > > impossible due the kernel module allocator dependency.
> > > >=20
> > > > Address the issue by allowing architectures to implement module_all=
oc()
> > > > and module_memfree() independent of the module subsystem. An arch t=
ree
> > > > can signal this by setting HAVE_KPROBES_ALLOC in its Kconfig file.
> > > >=20
> > > > Realize the feature on RISC-V by separating allocator to module_all=
oc.c
> > > > and implementing module_memfree().
> > >=20
> > > Even though, this involves changes in arch-independent part. So it sh=
ould
> > > be solved by generic way. Did you checked Calvin's thread?
> > >=20
> > > https://lore.kernel.org/all/cover.1709676663.git.jcalvinowens@gmail.c=
om/
> > >=20
> > > I think, we'd better to introduce `alloc_execmem()`,
> > > CONFIG_HAVE_ALLOC_EXECMEM and CONFIG_ALLOC_EXECMEM at first
> > >=20
> > >   config HAVE_ALLOC_EXECMEM
> > > 	bool
> > >=20
> > >   config ALLOC_EXECMEM
> > > 	bool "Executable trampline memory allocation"
> > > 	depends on MODULES || HAVE_ALLOC_EXECMEM
> > >=20
> > > And define fallback macro to module_alloc() like this.
> > >=20
> > > #ifndef CONFIG_HAVE_ALLOC_EXECMEM
> > > #define alloc_execmem(size, gfp)	module_alloc(size)
> > > #endif
> >=20
> > Please can we *not* do this? I think this is abstracting at the wrong l=
evel (as
> > I mentioned on the prior execmem proposals).
> >=20
> > Different exectuable allocations can have different requirements. For e=
xample,
> > on arm64 modules need to be within 2G of the kernel image, but the kpro=
bes XOL
> > areas can be anywhere in the kernel VA space.
> >=20
> > Forcing those behind the same interface makes things *harder* for archi=
tectures
> > and/or makes the common code more complicated (if that ends up having t=
o track
> > all those different requirements). From my PoV it'd be much better to h=
ave
> > separate kprobes_alloc_*() functions for kprobes which an architecture =
can then
> > choose to implement using a common library if it wants to.
> >=20
> > I took a look at doing that using the core ifdeffery fixups from Jarkko=
's v6,
> > and it looks pretty clean to me (and works in testing on arm64):
> >=20
> >   https://git.kernel.org/pub/scm/linux/kernel/git/mark/linux.git/log/?h=
=3Dkprobes/without-modules
> >=20
> > Could we please start with that approach, with kprobe-specific alloc/fr=
ee code
> > provided by the architecture?
>
> OK, as far as I can read the code, this method also works and neat!=20
> (and minimum intrusion). I actually found that exposing CONFIG_ALLOC_EXEC=
MEM
> to user does not help, it should be an internal change. So hiding this ch=
ange
> from user is better choice. Then there is no reason to introduce the new
> alloc_execmem, but just expand kprobe_alloc_insn_page() is reasonable.
>
> Mark, can you send this series here, so that others can review/test it?

I'm totally fine with this but yeah best would be if it could carry
the riscv part. Mark, even if you have only possibility to compile
test that part I can check that it works.

BR, Jarkko