Received: by 2002:a05:6a10:9848:0:0:0:0 with SMTP id x8csp608547pxf; Wed, 10 Mar 2021 13:05:27 -0800 (PST) X-Google-Smtp-Source: ABdhPJzoMyQNm87Zuf720Y8+0YrLN3KtzTYA+IP4PzymLqxT9LogySJaAc9qCP2ZfT+lnZ0viiFK X-Received: by 2002:a50:ec81:: with SMTP id e1mr5338185edr.0.1615410326723; Wed, 10 Mar 2021 13:05:26 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1615410326; cv=none; d=google.com; s=arc-20160816; b=D9uy1JpQBG6GRoQGmLEblZ7pQnlqLd+jrZpDcY5cjT81Acfap/BRBtG3MzvZuvjfmv ciCuein5k/4IrEDDRfLaFNffxDXKcRYyezcUieyWRRPyA/I5z8YTE1Xx+cElLp+4RTwt oL1v8+sDPEBIGyXUc0yc2yDmfDaBI7qZ5nBnJyhN4BU+PRZ+rTiR0TgWteNWz1W/uQ0k KWLsK4sRh+uvX06CpueOtris2QX8hzhP1LtNFSVVrin3GDv5VkrBcf3i9ZX/dVfZXykL aENNm1C/ifD0RKE7PNiz2bUm620PY8uIDTz8QMdxq0aazzIqDPehlmEcbrHlfeLwDDJD nZUw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:in-reply-to:content-disposition:mime-version :references:message-id:subject:cc:to:from:date:dkim-signature; bh=kgZRDWg+E5eBmEuNfvh5FPMkh8S3VA4zLnMLimy3dco=; b=Ci99iJdT67zf1RP+IjJM/PHxwHQaGBjgE9R6Il45z7/sxxFSkQ4VScPri5BAbjn3kQ WGEe26MelPu6nukKJDZMzP3LzSLRBkETGg/ZKemjfSv9St3sk2IqXbPuKMM7OzTOnMEw iQKY34v586yFvah9Aa98WhOA/RakK9yn3dakRLpirtcun144F5IqYYtflNp6UMKfN+rc Fv3wC8cUQAe/2gxcwWq1Nv5fAsuE4vzHTtwAqpqhViQ5AMmVcxq12WrnuwBDvCkiz3dr QIHvaAAB+vaZfqjp6wp9SzWBfDfJiJPMKp+O1IZxtC17mmS1Z79Tz7CslNCBHNRyWMdb xsKw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@chromium.org header.s=google header.b="YN0Z/Vht"; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=chromium.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id dc19si394528edb.127.2021.03.10.13.05.04; Wed, 10 Mar 2021 13:05:26 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@chromium.org header.s=google header.b="YN0Z/Vht"; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=chromium.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S231964AbhCJVD5 (ORCPT + 99 others); Wed, 10 Mar 2021 16:03:57 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:60724 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S231827AbhCJVDw (ORCPT ); Wed, 10 Mar 2021 16:03:52 -0500 Received: from mail-pf1-x42f.google.com (mail-pf1-x42f.google.com [IPv6:2607:f8b0:4864:20::42f]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id A375DC061574 for ; Wed, 10 Mar 2021 13:03:52 -0800 (PST) Received: by mail-pf1-x42f.google.com with SMTP id s21so2039147pfm.1 for ; Wed, 10 Mar 2021 13:03:52 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=chromium.org; s=google; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=kgZRDWg+E5eBmEuNfvh5FPMkh8S3VA4zLnMLimy3dco=; b=YN0Z/Vhtni4MgeYq5ZXFSPAnmyYH+lkZC+AUrGdL1FSjOP6FTEcki8jRb9CpsNidan bTf6DVBu9IZ9qccH7IA+cOlRe8qbtBRf7N3rHBrgr/zXFmg3FnjjA8PO7MJE/yIDO1/a qFVyvQ+I7V0ur72vLR6/jxgCfMQLRlBhrNqzU= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=kgZRDWg+E5eBmEuNfvh5FPMkh8S3VA4zLnMLimy3dco=; b=q7BwEsND9jmxOICE8XnfpBlXIdYZ/Xppi+y+b8NshlH72Yn3cO/PgayefHk9j6JB37 V+trn8pZxQ20V+BhzJ2WgLh1RMR2FFSofKJgEb45h4/04Q7DiHCsMilPX1p8oeLAKd8r emLUpLyrADskqAlCc/9twhcXM4z+Y0Mjcg5SyKplO2xvN6zVAmNqnrVZ6uHjPuOgfgVV DBmVE8zwev+sDVEAAxYV6KGLoXjYLgk7Eo8NUCXdYjOUqwnmJ8frW6edq9lrmU/KGiT8 Ssjf365758WHPmql3rLOjQevWsMZ0mEEf+knEhf9L9Ww4tGK/OJOvrzPsbd07HcBQOU9 I3/Q== X-Gm-Message-State: AOAM5332bFsGHL5GoJCz4S4OKnRChPrMOvsL0TQmL+sUoZJt5j7vzGTd RiXybAXaIsLGVewSlqZs+EG5Og== X-Received: by 2002:aa7:9154:0:b029:1ee:fa0d:24dd with SMTP id 20-20020aa791540000b02901eefa0d24ddmr4403109pfi.17.1615410232053; Wed, 10 Mar 2021 13:03:52 -0800 (PST) Received: from www.outflux.net (smtp.outflux.net. [198.145.64.163]) by smtp.gmail.com with ESMTPSA id m7sm236760pjc.54.2021.03.10.13.03.51 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 10 Mar 2021 13:03:51 -0800 (PST) Date: Wed, 10 Mar 2021 13:03:50 -0800 From: Kees Cook To: Andrey Konovalov Cc: Alexander Potapenko , Thomas Gleixner , Elena Reshetova , the arch/x86 maintainers , Andy Lutomirski , Peter Zijlstra , Catalin Marinas , Will Deacon , Mark Rutland , Alexander Popov , Ard Biesheuvel , Jann Horn , kernel-hardening@lists.openwall.com, linux-hardening@vger.kernel.org, Linux ARM , Linux Memory Management List , LKML , Vlastimil Babka , David Hildenbrand , Mike Rapoport , Andrew Morton , Jonathan Corbet , Randy Dunlap Subject: Re: [PATCH v5 3/7] init_on_alloc: Unpessimize default-on builds Message-ID: <202103101303.6E6569C1@keescook> References: <20210309214301.678739-1-keescook@chromium.org> <20210309214301.678739-4-keescook@chromium.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Wed, Mar 10, 2021 at 01:52:04PM +0100, Andrey Konovalov wrote: > On Tue, Mar 9, 2021 at 10:43 PM Kees Cook wrote: > > > > Right now, the state of CONFIG_INIT_ON_ALLOC_DEFAULT_ON (and > > ...ON_FREE...) did not change the assembly ordering of the static branch > > tests. Use the new jump_label macro to check CONFIG settings to default > > to the "expected" state, unpessimizes the resulting assembly code. > > > > Reviewed-by: Alexander Potapenko > > Link: https://lore.kernel.org/lkml/CAG_fn=X0DVwqLaHJTO6Jw7TGcMSm77GKHinrd0m_6y0SzWOrFA@mail.gmail.com/ > > Signed-off-by: Kees Cook > > --- > > include/linux/mm.h | 6 ++++-- > > 1 file changed, 4 insertions(+), 2 deletions(-) > > > > diff --git a/include/linux/mm.h b/include/linux/mm.h > > index bf341a9bfe46..2ccd856ac0d1 100644 > > --- a/include/linux/mm.h > > +++ b/include/linux/mm.h > > @@ -2874,7 +2874,8 @@ static inline void kernel_unpoison_pages(struct page *page, int numpages) { } > > DECLARE_STATIC_KEY_MAYBE(CONFIG_INIT_ON_ALLOC_DEFAULT_ON, init_on_alloc); > > static inline bool want_init_on_alloc(gfp_t flags) > > { > > - if (static_branch_unlikely(&init_on_alloc)) > > + if (static_branch_maybe(CONFIG_INIT_ON_ALLOC_DEFAULT_ON, > > + &init_on_alloc)) > > return true; > > return flags & __GFP_ZERO; > > } > > @@ -2882,7 +2883,8 @@ static inline bool want_init_on_alloc(gfp_t flags) > > DECLARE_STATIC_KEY_MAYBE(CONFIG_INIT_ON_FREE_DEFAULT_ON, init_on_free); > > static inline bool want_init_on_free(void) > > { > > - return static_branch_unlikely(&init_on_free); > > + return static_branch_maybe(CONFIG_INIT_ON_FREE_DEFAULT_ON, > > + &init_on_free); > > } > > > > extern bool _debug_pagealloc_enabled_early; > > Should we also update slab_want_init_on_alloc() and slab_want_init_on_free()? Whoops! Thank you; I will update and resend. :) -- Kees Cook