Received: by 2002:ad5:474a:0:0:0:0:0 with SMTP id i10csp4069776imu; Mon, 28 Jan 2019 16:41:23 -0800 (PST) X-Google-Smtp-Source: ALg8bN5kNGN2bXXO9fPjol9vBqiZwUFz9bAimnpitG6+wv1ysEkPeB1TBp2j2oOOhHCrcLdF2+bT X-Received: by 2002:a63:f515:: with SMTP id w21mr16613474pgh.220.1548722483882; Mon, 28 Jan 2019 16:41:23 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1548722483; cv=none; d=google.com; s=arc-20160816; b=M2AsiekEj0aNDpoPnUWeeN6wfQWjK6XjAk2IrQyTouA8acT2feGojmxwGjMDZ5hoC3 ltv8KK7mbavt4jrF+aAPKem/6CkQk6QgGQBCEC3smVrcG64QziXGSVEJIWqwFblvNmlR iQ246D2yWB97DeHWmBB2K8HeTAukOL/NbfUT52sYNYQWJYoS7y3b+qdOoBEXMHDO52Qz Eln+8p/2AQRbb6oH4CwgPu7bWswWJSBTZpUuthIuHiPCeRXFfOSkt+NK7Bs4IOhby7Mv Xf516vnJqY+MHUlLc1m8h0pP4SKv4F9MSDazSOxxwNnVjQkxFjmz6fYNbAqB/23h/v5J fdqA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:references:in-reply-to:message-id:date :subject:cc:to:from; bh=zkYOBKDkCPssvs3YCV5eJaPkZC0ctM/7YsEXK+Vqdbc=; b=eahx1g3IBNh+gTG/IXYeQ69eSKoiTLlvTPpDdB5ScTnjP3YeIXO5BwoEdfA5mlNma2 pCrgfqOiVNiYSas2A0t0/HYGvxobyxpJoBENfxKrO9mHW8NUlVQFQvKU121CKGM8hjZK ol4QRUh3HwAOZVoOa6E7Vir+pMSH56q+b2OM5d2Dzp2XfhwAI3lf1gBaeI8lALYDVL/I B0THhDoeaDJQ/BBBs42tnfBRIsF2p6GDigWNDZ+AtF8UEgDAWUHS+RKINzZHdJwrbAMl pJJcMTIi0eJQfkrMzhpGPyHeHlmJM0Zoh1U6e/YqGqMlNKmgSZoXbi3zUTczgryFl+h5 763w== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id h17si2167066pgd.538.2019.01.28.16.41.08; Mon, 28 Jan 2019 16:41:23 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728295AbfA2AkZ (ORCPT + 99 others); Mon, 28 Jan 2019 19:40:25 -0500 Received: from mga06.intel.com ([134.134.136.31]:5079 "EHLO mga06.intel.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727529AbfA2AjS (ORCPT ); Mon, 28 Jan 2019 19:39:18 -0500 X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from orsmga001.jf.intel.com ([10.7.209.18]) by orsmga104.jf.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 28 Jan 2019 16:39:12 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.56,535,1539673200"; d="scan'208";a="133921915" Received: from rpedgeco-desk5.jf.intel.com ([10.54.75.79]) by orsmga001.jf.intel.com with ESMTP; 28 Jan 2019 16:39:12 -0800 From: Rick Edgecombe To: Andy Lutomirski , Ingo Molnar Cc: linux-kernel@vger.kernel.org, x86@kernel.org, hpa@zytor.com, Thomas Gleixner , Borislav Petkov , Nadav Amit , Dave Hansen , Peter Zijlstra , linux_dti@icloud.com, linux-integrity@vger.kernel.org, linux-security-module@vger.kernel.org, akpm@linux-foundation.org, kernel-hardening@lists.openwall.com, linux-mm@kvack.org, will.deacon@arm.com, ard.biesheuvel@linaro.org, kristen@linux.intel.com, deneen.t.dock@intel.com, Nadav Amit , Kees Cook , Dave Hansen , Masami Hiramatsu , Rick Edgecombe Subject: [PATCH v2 11/20] x86/jump-label: remove support for custom poker Date: Mon, 28 Jan 2019 16:34:13 -0800 Message-Id: <20190129003422.9328-12-rick.p.edgecombe@intel.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20190129003422.9328-1-rick.p.edgecombe@intel.com> References: <20190129003422.9328-1-rick.p.edgecombe@intel.com> Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org From: Nadav Amit There are only two types of poking: early and breakpoint based. The use of a function pointer to perform poking complicates the code and is probably inefficient due to the use of indirect branches. Cc: Andy Lutomirski Cc: Kees Cook Cc: Dave Hansen Cc: Masami Hiramatsu Acked-by: Peter Zijlstra (Intel) Signed-off-by: Nadav Amit Signed-off-by: Rick Edgecombe --- arch/x86/kernel/jump_label.c | 24 ++++++++---------------- 1 file changed, 8 insertions(+), 16 deletions(-) diff --git a/arch/x86/kernel/jump_label.c b/arch/x86/kernel/jump_label.c index e36cfec0f35e..427facef8aff 100644 --- a/arch/x86/kernel/jump_label.c +++ b/arch/x86/kernel/jump_label.c @@ -37,7 +37,6 @@ static void bug_at(unsigned char *ip, int line) static void __ref __jump_label_transform(struct jump_entry *entry, enum jump_label_type type, - void *(*poker)(void *, const void *, size_t), int init) { union jump_code_union jmp; @@ -50,14 +49,6 @@ static void __ref __jump_label_transform(struct jump_entry *entry, jmp.offset = jump_entry_target(entry) - (jump_entry_code(entry) + JUMP_LABEL_NOP_SIZE); - /* - * As long as we're UP and not yet marked RO, we can use - * text_poke_early; SYSTEM_BOOTING guarantees both, as we switch to - * SYSTEM_SCHEDULING before going either. - */ - if (system_state == SYSTEM_BOOTING) - poker = text_poke_early; - if (type == JUMP_LABEL_JMP) { if (init) { expect = default_nop; line = __LINE__; @@ -80,16 +71,17 @@ static void __ref __jump_label_transform(struct jump_entry *entry, bug_at((void *)jump_entry_code(entry), line); /* - * Make text_poke_bp() a default fallback poker. + * As long as we're UP and not yet marked RO, we can use + * text_poke_early; SYSTEM_BOOTING guarantees both, as we switch to + * SYSTEM_SCHEDULING before going either. * * At the time the change is being done, just ignore whether we * are doing nop -> jump or jump -> nop transition, and assume * always nop being the 'currently valid' instruction - * */ - if (poker) { - (*poker)((void *)jump_entry_code(entry), code, - JUMP_LABEL_NOP_SIZE); + if (init || system_state == SYSTEM_BOOTING) { + text_poke_early((void *)jump_entry_code(entry), code, + JUMP_LABEL_NOP_SIZE); return; } @@ -101,7 +93,7 @@ void arch_jump_label_transform(struct jump_entry *entry, enum jump_label_type type) { mutex_lock(&text_mutex); - __jump_label_transform(entry, type, NULL, 0); + __jump_label_transform(entry, type, 0); mutex_unlock(&text_mutex); } @@ -131,5 +123,5 @@ __init_or_module void arch_jump_label_transform_static(struct jump_entry *entry, jlstate = JL_STATE_NO_UPDATE; } if (jlstate == JL_STATE_UPDATE) - __jump_label_transform(entry, type, text_poke_early, 1); + __jump_label_transform(entry, type, 1); } -- 2.17.1