Received-SPF: pass (google.com: domain of linux-kernel+bounces-211916-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:40f1:3f00::1 as permitted sender) client-ip=2604:1380:40f1:3f00::1;
Date: Wed, 12 Jun 2024 17:26:22 +0100
From: Gary Guo <gary@garyguo.net>
To: Matthew Maurer <mmaurer@google.com>
Cc: Masahiro Yamada <masahiroy@kernel.org>, Nathan Chancellor
 <nathan@kernel.org>, Nicolas Schier <nicolas@fjasle.eu>, Andrew Morton
 <akpm@linux-foundation.org>, Miguel Ojeda <ojeda@kernel.org>, Alex Gaynor
 <alex.gaynor@gmail.com>, Wedson Almeida Filho <wedsonaf@gmail.com>, Boqun
 Feng <boqun.feng@gmail.com>, =?UTF-8?B?QmrDtnJu?= Roy Baron
 <bjorn3_gh@protonmail.com>, Benno Lossin <benno.lossin@proton.me>, Andreas
 Hindborg <a.hindborg@samsung.com>, Alice Ryhl <aliceryhl@google.com>, Nick
 Desaulniers <ndesaulniers@google.com>, Bill Wendling <morbo@google.com>,
 Justin Stitt <justinstitt@google.com>, linux-kbuild@vger.kernel.org,
 linux-kernel@vger.kernel.org, rust-for-linux@vger.kernel.org,
 llvm@lists.linux.dev
Subject: Re: [RFC PATCH 2/2] kbuild: rust: provide an option to inline C
 helpers into Rust
Message-ID: <20240612172623.5876d0ad@eugeo>
In-Reply-To: <CAGSQo02_siEiS07H+7MCi_T2REGoyF6FFuGHVmiUFi4EocLizQ@mail.gmail.com>
References: <20240529202817.3641974-1-gary@garyguo.net>
	<20240529202817.3641974-3-gary@garyguo.net>
	<CAGSQo02_siEiS07H+7MCi_T2REGoyF6FFuGHVmiUFi4EocLizQ@mail.gmail.com>
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: 7bit
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0:
	=?us-ascii?Q?G00p+Ka9p+5WUlHg25Or4f2qraxx2Tzxowxct3+RoKjGAnuoZ5jgtjnf5OI8?=
 =?us-ascii?Q?YyRRG+coZxVllxWUhtSR/MLT/uiDwGz1GHgc8lIE9OiW552sfsHTyECJ157B?=
 =?us-ascii?Q?cdAuS0bfCuFifnoul+c2WspK4T4djIWdXzCgSTUusAr+PgFpV4K+9vdZbniv?=
 =?us-ascii?Q?fnL1xkd7LhdeVmUgFg5RQrAO+awZJ9u0UeDgivcqqGSeuvtng2BVxkhzUZA2?=
 =?us-ascii?Q?BbW+/Ki32LWn9cWfG7PoOhYpIi8DItQ3tF6ThVgm2hifwTxMirqBMjQpKesu?=
 =?us-ascii?Q?OXOjMTjxUlCkr82K4oInn0A3XRprndMfTCubFZRD2PrTRMRJgEo2vNB9+dvt?=
 =?us-ascii?Q?066BlM1xxqaRfndeVzU5rYTGz2R81QS+U6walZZ+16pvSdCkZjRBOqQx7BVB?=
 =?us-ascii?Q?+2DRPnXaDTYNld2gM3J9OFJ5GByH54SrHsrB5knoxBpkoFJu5kn3C3Glmqqp?=
 =?us-ascii?Q?VOzdw11lA/uQ+izCh93q/I1kF0GjrvfCm6o1EjUFUWBs3+W5Dt/1fZ/6apfX?=
 =?us-ascii?Q?FyxvkRPaDtoDNqjP0PThWWRWeKlzbBocxZTPhzRiFKNvAGWuYe9NXBnfJPgk?=
 =?us-ascii?Q?30BdtJMtNwxouhzhrVnyVP6IIhjLgZxk5I4yoblxY+JQS81ho+k9p9XAcf6u?=
 =?us-ascii?Q?ZDLMSgUdU0nUHdHyHpF5NAat2H30tiXBvp1gu1/93gkQEPwf4Xk8HwZ9W8nE?=
 =?us-ascii?Q?S3y8mCRnGucv17YdKNBMWakS7eq1O1hrKAY0+miYW+0xaVof6VUm7hBLMj3G?=
 =?us-ascii?Q?z34erQ553iKvtiYLC1Z8RzAI71gcq2Ll42SSh/38qGU6qKZxs+btZZ1nroJq?=
 =?us-ascii?Q?29QuKLshjkW0tSsdD6XHPXay5Gtvh08VDT8KpAbwFNy6spiCNfhoyburU5dp?=
 =?us-ascii?Q?9fwn2rSCPXK/Mqgb+QsK2pITzv+0giH9bBFxanP7KVUns7kJhUzCdkeY90Zu?=
 =?us-ascii?Q?TCn9YnafJzvj+pP3PqI5e4TIc4DO3VZvuTE9YAKkStsMLil+fs9tqp6/XXfs?=
 =?us-ascii?Q?KGN9dLc2qwdn90/vdf/Ay01OFH62oqyIFb83HCOU0B/BO3K57yDMnO6CeR87?=
 =?us-ascii?Q?o16jwzoFB9JD+qT2DWrYJU+oU5Hs24Y0LgukwI4NfHNcH3/dHPZ5PU5sm5hO?=
 =?us-ascii?Q?j0LISiG/aEloO5x8nSVaqReRIawb57hNVTdUBPFu7sKKVsuVv2+WEd8cLDlH?=
 =?us-ascii?Q?Wz5C83FKyHozA7v2N2fb+RBkghx0LpYxfSs/bfxXMr2Kmstw2QRj1j2D+LYI?=
 =?us-ascii?Q?9UfVleDZSng18Kgsb5BGSnZfQv8Qe+VWg64iykl1G4+5VVY/eYOowCWeMonw?=
 =?us-ascii?Q?R7NJhNlz6uVebYtOUEXtezw0z506CK3h46ZCQ+3DsSF6vd/Y8LTxS26EyZ18?=
 =?us-ascii?Q?DLu5r58q4OVhNNUg99kEcv08FwPwRnm14RaC8rtjQpVGxwdFEbpAvbzZ/H3q?=
 =?us-ascii?Q?+wkTlrfKe2JbhL7+uPfr7Sa5ZizdaX1HjTle6eXVm7zC4lsPTpKrxGKkEoN+?=
 =?us-ascii?Q?0+k9qnr5lXojy0Ky3FuFuaPdMj2BllbmWa4ZTV+V+onYVymx2g7hn5evpzV2?=
 =?us-ascii?Q?MkKAoazXsgNI6EXq57L7d26l63qZGsNjTCFfFgcO?=
X-OriginatorOrg: garyguo.net
X-MS-Exchange-CrossTenant-Network-Message-Id: 5667fda9-ab82-4b94-405f-08dc8afc6756
X-MS-Exchange-CrossTenant-AuthSource: LO2P265MB5183.GBRP265.PROD.OUTLOOK.COM
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 12 Jun 2024 16:26:25.1134
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: bbc898ad-b10f-4e10-8552-d9377b823d45
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: 2sJlvZX0YWrcnTREky5JpAXWfm+Uz5bDEWiQntfEnJ1duUNmQ6rHl0Lb3R+OsJJPYJmUUmR9L7+ZOT9wRxuHAw==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CWLP265MB5866

On Fri, 7 Jun 2024 07:40:45 -0700
Matthew Maurer <mmaurer@google.com> wrote:

> The LLVM `.ll` textual bitcode representation may change from version
> to version, which makes using `sed` to edit it potentially fragile.
> Would it be possible to attach similar attributes without this? (Or
> other attributes that can accomplish something similar, see the second
> part.)

I agree that text editing is fragile and should be avoided, but I'm not
aware of a way to achieve this without text editing.

> Would it be possible to use a Rust-only-LTO (actual LTO) flag rather
> than a `llvm-link`? It seems likely that someone that wants to use a
> synced `clang` and `rustc` to allow helpers to be inlined would be
> unlikely to object to thin LTO of Rust. This would avoid introducing a
> new tool.

There's no way for rustc to actually perform the LTO, since the crate
type that we use is rlib rather than staticlibs or cdylibs, Rust does
not take care of the linking.

> As one possible route around editing the `.ll` file, we could consider
> *not* hiding these symbols, just marking them as "good idea to inline
> if possible", and then masking any symbol that ends up in the final
> `.o` via `objcopy --localize-symbol=blah`. If we're doing full-kernel
> LTO rather than rust-only LTO, we'd need to use `llvm-objcopy`
> instead, but the same process would follow - a postprocessing step on
> the final crate object that localizes the symbol, with LTO giving the
> compiler the option (but not requirement) to inline these functions if
> it seems like a good idea.

This was one of the approach that I considered, but IIUC objcopy
require you to supply it a list of exact-match symbols rather than
patterns, so we have to get all helper symbols and then feed it to
objcopy. I really want to avoid having a script or host program to do
this step.

Best,
Gary