Received: by 10.223.176.5 with SMTP id f5csp3473617wra; Mon, 29 Jan 2018 13:46:27 -0800 (PST) X-Google-Smtp-Source: AH8x226IZ5MOyNoxRyGPbxFhCcFiu9N3FVb/2DpWuvk093XlxsdOoI4Tyn1Y2aVKWG/eSE1295oa X-Received: by 2002:a17:902:402:: with SMTP id 2-v6mr20873970ple.353.1517262387602; Mon, 29 Jan 2018 13:46:27 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1517262387; cv=none; d=google.com; s=arc-20160816; b=yuvcOZor7lHb3v7miN7qC7LLpThZEQDBdeXL49VvnXUoglAzc5SEXVtAZi1uq7xi0x tAiAvSHoPMnltYziYs5Kj68xy5ZMBwGYPWc4JDj73CQFEQuTJUxkH8jFQBHk7ivc7dFW LqjGXdZsHeDo37dRYEagl2vbJwDdtgIUpXGX9GahCdQMW5OtV3swLxOF4E2dEaf72sIg Askk9NwtLruSep3bfSovuTEzXc2A4FZ6F0lY9PEBcGnp02q7oZFlQXmpEXa+HIz6BL4s +5uEuoEz3FtwytMkLDm18ugHqLkk2l1Vc6OpEkBHAevF2NYJ10fz29ox+tdfcmzfrr21 CrsQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:cc:to:subject:message-id:date:from :references:in-reply-to:mime-version:dkim-signature :arc-authentication-results; bh=Cy/qDjn4rpLGvGIG+SsLK8hiBHfYMdN5M0B2vhxQoAI=; b=Y9WlSTYVfZN/r0OwWzJVoceIloqeFFVFpvdk864KTb1HsVEmx9CyXJS3amY3Xfi7if nQBmSHANE6dBr4sX5+pHDvy3AItAUuDjfDNInyylJtu+hjXpuXvYx9CTEC5io2jvY9Va PgDVlUPZG3KSQFK+zOH5dJkDS8+eHYzbiVjZhPWkcXUDpLr+xrNGWxlRiTduO4itqJWd fDc/h1eTGTgtbBJA9JB0GJAZTvv0FTsqBtrTxxOS6FnEeN3C7qgkwiE6l45iXcP/57/5 EzUFw0NOqVXXKjYlBAdzWxzHJEcR7qKf6dXcvxhBbeWyGDMiaCjeP9fqRmzLqLtnvTT/ ZqNg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=TfSpdSRo; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id bj5-v6si5412082plb.732.2018.01.29.13.46.12; Mon, 29 Jan 2018 13:46:27 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=TfSpdSRo; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1751937AbeA2Vpk (ORCPT + 99 others); Mon, 29 Jan 2018 16:45:40 -0500 Received: from mail-it0-f65.google.com ([209.85.214.65]:39443 "EHLO mail-it0-f65.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751576AbeA2Vpi (ORCPT ); Mon, 29 Jan 2018 16:45:38 -0500 Received: by mail-it0-f65.google.com with SMTP id 68so11080510ite.4 for ; Mon, 29 Jan 2018 13:45:38 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=Cy/qDjn4rpLGvGIG+SsLK8hiBHfYMdN5M0B2vhxQoAI=; b=TfSpdSRoIaUD2vuoKu1YYJhcrtJk5TMMVAh6VeO6DpVSdI/SKtwPf+ikhPfrt7H1XQ 9rKCwtJRxujCm2mZUOdW8yhcbIFcc6Ng9rMaOIMTAQexi4jpFR2cL3LDpdZXMZyd/uD3 3mSkxmcPpEWhpKlPKMK8mXC6xbGMZ/o0xRtFk= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=Cy/qDjn4rpLGvGIG+SsLK8hiBHfYMdN5M0B2vhxQoAI=; b=ZAertQ4m7OoSXoGAOoLVOpWpY+epN4TMKwWlNgkpB6f0X7fIMkXWjUpQR6JrBOxbl5 +vdZAYspIBHWUArS/7oCr3C5sVI1f45TOiV6PskYoLsReoMYhtEicOdGz1nZh5UMOB3w vWZU3/PemOb6f5hTEPJJxWJ2gtguXlNaeoOiHQZtv6TsR8juD8dj4RFdz4lrSQHZAlgu RB4XuONAytZyzgoiWNI3/w0/H6E3s5dSd7WKI6VAyW1fMpJfjv7S6JgbJUGgT6uC+9xf 38R8xslkoGlrbhFWQSNCAiFWSlGIUron02qrqNE8HzYu2sRUSVtqh3WaYK9GSu+7Nsxg H9hw== X-Gm-Message-State: AKwxytesFMCBkxod61nZ6GbRYEjNL8sirhRlxnE71JkevMi1aB5INak4 uQrZxSK00Jo3ehojYMjgwTlqIuiFJF2ixoRbbMiqsg== X-Received: by 10.36.128.5 with SMTP id g5mr28662808itd.17.1517262337874; Mon, 29 Jan 2018 13:45:37 -0800 (PST) MIME-Version: 1.0 Received: by 10.107.112.13 with HTTP; Mon, 29 Jan 2018 13:45:37 -0800 (PST) In-Reply-To: <20180129174559.1866-16-marc.zyngier@arm.com> References: <20180129174559.1866-1-marc.zyngier@arm.com> <20180129174559.1866-16-marc.zyngier@arm.com> From: Ard Biesheuvel Date: Mon, 29 Jan 2018 21:45:37 +0000 Message-ID: Subject: Re: [PATCH v2 15/16] arm/arm64: smccc: Implement SMCCC v1.1 inline primitive To: Marc Zyngier Cc: Linux Kernel Mailing List , linux-arm-kernel , kvmarm , Catalin Marinas , Will Deacon , Peter Maydell , Christoffer Dall , Lorenzo Pieralisi , Mark Rutland , Robin Murphy , Jon Masters Content-Type: text/plain; charset="UTF-8" Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 29 January 2018 at 17:45, Marc Zyngier wrote: > One of the major improvement of SMCCC v1.1 is that it only clobbers > the first 4 registers, both on 32 and 64bit. This means that it > becomes very easy to provide an inline version of the SMC call > primitive, and avoid performing a function call to stash the > registers that would otherwise be clobbered by SMCCC v1.0. > > Signed-off-by: Marc Zyngier > --- > include/linux/arm-smccc.h | 157 ++++++++++++++++++++++++++++++++++++++++++++++ > 1 file changed, 157 insertions(+) > > diff --git a/include/linux/arm-smccc.h b/include/linux/arm-smccc.h > index dd44d8458c04..bc5843728909 100644 > --- a/include/linux/arm-smccc.h > +++ b/include/linux/arm-smccc.h > @@ -150,5 +150,162 @@ asmlinkage void __arm_smccc_hvc(unsigned long a0, unsigned long a1, > > #define arm_smccc_hvc_quirk(...) __arm_smccc_hvc(__VA_ARGS__) > > +/* SMCCC v1.1 implementation madness follows */ > +#ifdef CONFIG_ARM64 > + > +#define SMCCC_SMC_INST "smc #0" > +#define SMCCC_HVC_INST "hvc #0" > + > +#define __arm_smccc_1_1_prologue(inst) \ > + inst "\n" \ > + "cbz %[ptr], 1f\n" \ > + "stp %x[r0], %x[r1], %[ra0]\n" \ > + "stp %x[r2], %x[r3], %[ra2]\n" \ > + "1:\n" \ > + : [ra0] "=Ump" (*(&___res->a0)), \ > + [ra2] "=Ump" (*(&___res->a2)), > + > +#define __arm_smccc_1_1_epilogue : "memory" > + > +#endif > + > +#ifdef CONFIG_ARM > +#include > +#include > + > +#define SMCCC_SMC_INST __SMC(0) > +#define SMCCC_HVC_INST __HVC(0) > + > +#define __arm_smccc_1_1_prologue(inst) \ > + inst "\n" \ > + "cmp %[ptr], #0\n" \ > + "stmne %[ptr], {%[r0], %[r1], %[r2], %[r3]}\n" \ > + : "=m" (*___res), > + > +#define __arm_smccc_1_1_epilogue : "memory", "cc" > + > +#endif > + > +#define __constraint_write_0 \ > + [r0] "+r" (r0), [r1] "=r" (r1), [r2] "=r" (r2), [r3] "=r" (r3) > +#define __constraint_write_1 \ > + [r0] "+r" (r0), [r1] "+r" (r1), [r2] "=r" (r2), [r3] "=r" (r3) > +#define __constraint_write_2 \ > + [r0] "+r" (r0), [r1] "+r" (r1), [r2] "+r" (r2), [r3] "=r" (r3) > +#define __constraint_write_3 \ > + [r0] "+r" (r0), [r1] "+r" (r1), [r2] "+r" (r2), [r3] "+r" (r3) It seems you need +r for all arguments, otherwise the compiler will notice that the value is never used, and may assign the register to 'res' instead, i.e., 3e4: 320107e0 mov w0, #0x80000001 // #-2147483647 3e8: 320183e1 mov w1, #0x80008000 // #-2147450880 3ec: 910123a2 add x2, x29, #0x48 3f0: d4000002 hvc #0x0 3f4: b4000062 cbz x2, 400 3f8: a90487a0 stp x0, x1, [x29, #72] 3fc: a9058fa2 stp x2, x3, [x29, #88] (for the code generated in the next patch) > +#define __constraint_write_4 __constraint_write_3 > +#define __constraint_write_5 __constraint_write_3 > +#define __constraint_write_6 __constraint_write_3 > +#define __constraint_write_7 __constraint_write_3 > + > +#define __constraint_read_0 : [ptr] "r" (___res) > +#define __constraint_read_1 __constraint_read_0 > +#define __constraint_read_2 __constraint_read_0 > +#define __constraint_read_3 __constraint_read_0 > +#define __constraint_read_4 __constraint_read_3, "r" (r4) > +#define __constraint_read_5 __constraint_read_4, "r" (r5) > +#define __constraint_read_6 __constraint_read_5, "r" (r6) > +#define __constraint_read_7 __constraint_read_6, "r" (r7) > + > +#define ___count_args(_0, _1, _2, _3, _4, _5, _6, _7, _8, x, ...) x > + > +#define __count_args(...) \ > + ___count_args(__VA_ARGS__, 7, 6, 5, 4, 3, 2, 1, 0) > + > +#define __declare_arg_0(a0, res) \ > + struct arm_smccc_res *___res = res; \ > + register u32 r0 asm("r0") = a0; \ > + register unsigned long r1 asm("r1"); \ > + register unsigned long r2 asm("r2"); \ > + register unsigned long r3 asm("r3") > + > +#define __declare_arg_1(a0, a1, res) \ > + struct arm_smccc_res *___res = res; \ > + register u32 r0 asm("r0") = a0; \ > + register typeof(a1) r1 asm("r1") = a1; \ > + register unsigned long r2 asm("r2"); \ > + register unsigned long r3 asm("r3") > + > +#define __declare_arg_2(a0, a1, a2, res) \ > + struct arm_smccc_res *___res = res; \ > + register u32 r0 asm("r0") = a0; \ > + register typeof(a1) r1 asm("r1") = a1; \ > + register typeof(a2) r2 asm("r2") = a2; \ > + register unsigned long r3 asm("r3") > + > +#define __declare_arg_3(a0, a1, a2, a3, res) \ > + struct arm_smccc_res *___res = res; \ > + register u32 r0 asm("r0") = a0; \ > + register typeof(a1) r1 asm("r1") = a1; \ > + register typeof(a2) r2 asm("r2") = a2; \ > + register typeof(a3) r3 asm("r3") = a3 > + > +#define __declare_arg_4(a0, a1, a2, a3, a4, res) \ > + __declare_arg_3(a0, a1, a2, a3, res); \ > + register typeof(a4) r4 asm("r4") = a4 > + > +#define __declare_arg_5(a0, a1, a2, a3, a4, a5, res) \ > + __declare_arg_4(a0, a1, a2, a3, a4, res); \ > + register typeof(a5) r5 asm("r5") = a5 > + > +#define __declare_arg_6(a0, a1, a2, a3, a4, a5, a6, res) \ > + __declare_arg_5(a0, a1, a2, a3, a4, a5, res); \ > + register typeof(a6) r6 asm("r6") = a6 > + > +#define __declare_arg_7(a0, a1, a2, a3, a4, a5, a6, a7, res) \ > + __declare_arg_6(a0, a1, a2, a3, a4, a5, a6, res); \ > + register typeof(a7) r7 asm("r7") = a7 > + > +#define ___declare_args(count, ...) __declare_arg_ ## count(__VA_ARGS__) > +#define __declare_args(count, ...) ___declare_args(count, __VA_ARGS__) > + > +#define ___constraint_write(count) __constraint_write_ ## count > +#define __constraint_write(count) ___constraint_write(count) > + > +#define ___constraint_read(count) __constraint_read_ ## count > +#define __constraint_read(count) ___constraint_read(count) > + > +#define __arm_smccc_1_1(inst, ...) \ > + do { \ > + __declare_args(__count_args(__VA_ARGS__), __VA_ARGS__); \ > + asm(__arm_smccc_1_1_prologue(inst) \ > + __constraint_write(__count_args(__VA_ARGS__)) \ > + __constraint_read(__count_args(__VA_ARGS__)) \ > + __arm_smccc_1_1_epilogue); \ > + } while (0) > + > +/* > + * arm_smccc_1_1_smc() - make an SMCCC v1.1 compliant SMC call > + * > + * This is a variadic macro taking one to eight source arguments, and > + * an optional return structure. > + * > + * @a0-a7: arguments passed in registers 0 to 7 > + * @res: result values from registers 0 to 3 > + * > + * This macro is used to make SMC calls following SMC Calling Convention v1.1. > + * The content of the supplied param are copied to registers 0 to 7 prior > + * to the SMC instruction. The return values are updated with the content > + * from register 0 to 3 on return from the SMC instruction if not NULL. > + */ > +#define arm_smccc_1_1_smc(...) __arm_smccc_1_1(SMCCC_SMC_INST, __VA_ARGS__) > + > +/* > + * arm_smccc_1_1_hvc() - make an SMCCC v1.1 compliant HVC call > + * > + * This is a variadic macro taking one to eight source arguments, and > + * an optional return structure. > + * > + * @a0-a7: arguments passed in registers 0 to 7 > + * @res: result values from registers 0 to 3 > + * > + * This macro is used to make HVC calls following SMC Calling Convention v1.1. > + * The content of the supplied param are copied to registers 0 to 7 prior > + * to the HVC instruction. The return values are updated with the content > + * from register 0 to 3 on return from the HVC instruction if not NULL. > + */ > +#define arm_smccc_1_1_hvc(...) __arm_smccc_1_1(SMCCC_HVC_INST, __VA_ARGS__) > + > #endif /*__ASSEMBLY__*/ > #endif /*__LINUX_ARM_SMCCC_H*/ > -- > 2.14.2 >