Received: by 2002:a05:6902:102b:0:0:0:0 with SMTP id x11csp1746491ybt; Mon, 15 Jun 2020 08:23:16 -0700 (PDT) X-Google-Smtp-Source: ABdhPJxGKl5GoSWikpcCG3R4TVDx/iwoY21SGGT8ejzs8TJPv+sJbMGAfnWpEFtTVrXGEADDnwcm X-Received: by 2002:a50:8b44:: with SMTP id l62mr24568521edl.72.1592234595899; Mon, 15 Jun 2020 08:23:15 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1592234595; cv=none; d=google.com; s=arc-20160816; b=SK6LfF2eAL398XNtwP/X/jv5lL3Obr5BcHrSOovEm+HAKP7oFNeXEAbACIzxPnol0G aPd64SjP9cRrNxCayO6VL1EeHCQzeq//whosXEW2LUnWf2ljtUwVhExFF+W6Op9NVNm+ PpWn55chW7xKj4QbK/6evXqSNsMzCgbCPYh2oI/5JBxD7jpmbT2o1ZCmM570L8axzCIg kw1z7e2aYvlo80hK3GZLCEiu+MFn0ILdH+HLxnJdEsRR60LqyOHYpT60UiCQyAx6x6qz HBHhbN6idU+f0zcUy9tlHdqg/L7Cj/zxaSuVhKV8T4KUTf3Yi/6BTYB97Lm/9EhNAUuj NjWA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:in-reply-to:content-disposition :mime-version:references:message-id:subject:cc:to:from:date :dkim-signature; bh=Udue+LwwMS7xIun8pCno4Qdzcnv4kfX0ri/1a/g6c/k=; b=dcCpwrsDiYO/0kcPOlTuyK24jqQaVpQDKaN0/QHOn1UwlmxhmeV7fBWyy9P5eg9lOH dvMwjP4lJeq8Eh/1Vf/fSHk/IABNUjmduYrQ1pTudUn9W72UgF5bNGviPH7qgfqXvl1w C5zBS0UG6rumTRc1exaVhwjbHqykKZG/DDtDvvB1Xg/wu9/gOXJxjFvh/0KZkKBpEUwe 3G2NQQ7aM0UVFz7DGYeBFU8XbC30WSYA+P59kNZws1Vl9smNdpUxxXBYDFb7bU01DFjl 4jGNnNh4OIeylr63I89v6dyIo9u8LCgx/5i+cewTDOenu0TZRO0OlBprxYWhCrYSFZWq oK5A== ARC-Authentication-Results: i=1; mx.google.com; dkim=fail header.i=@infradead.org header.s=bombadil.20170209 header.b=H52QNX2j; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id b17si9185722eds.13.2020.06.15.08.22.53; Mon, 15 Jun 2020 08:23:15 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=fail header.i=@infradead.org header.s=bombadil.20170209 header.b=H52QNX2j; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1730398AbgFOPVJ (ORCPT + 99 others); Mon, 15 Jun 2020 11:21:09 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:46016 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1730313AbgFOPVI (ORCPT ); Mon, 15 Jun 2020 11:21:08 -0400 Received: from bombadil.infradead.org (bombadil.infradead.org [IPv6:2607:7c80:54:e::133]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 3A272C05BD43 for ; Mon, 15 Jun 2020 08:21:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=bombadil.20170209; h=In-Reply-To:Content-Type:MIME-Version :References:Message-ID:Subject:Cc:To:From:Date:Sender:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description; bh=Udue+LwwMS7xIun8pCno4Qdzcnv4kfX0ri/1a/g6c/k=; b=H52QNX2jaSfrKP3H7353XNxUQl JbEKHp5vhJk+xhPAnq6tsFUNwk1pSZFn/F6enslamIL/ygi3NZkbTzOt4YZinaVC2u+KsYXuLMq/4 jZNur1SlSu9sIbEctHrRVHooj+3eGOpEVqRRopw9dELDrHW6dAO3LIKRFWW2nRZTkTeJ/1aNQEnZa UdmNHi0iBKHH2CknmTdxoKKvj+AXJbxRiBtGlhrKSdwTqXqsGqHLkjgonIU6g8Lr8Q7yV2FcwnY1d oPYuGu5ulSJouIixOcDbpFbmcEzrVcdbN5UYN0dQP1dtJ4MUfYd7sy5UDai1Bv020RLCekRVe1mo6 rhQpYvQQ==; Received: from j217100.upc-j.chello.nl ([24.132.217.100] helo=noisy.programming.kicks-ass.net) by bombadil.infradead.org with esmtpsa (Exim 4.92.3 #3 (Red Hat Linux)) id 1jkquv-00053R-UE; Mon, 15 Jun 2020 15:20:58 +0000 Received: from hirez.programming.kicks-ass.net (hirez.programming.kicks-ass.net [192.168.1.225]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by noisy.programming.kicks-ass.net (Postfix) with ESMTPS id 4EC123003E1; Mon, 15 Jun 2020 17:20:56 +0200 (CEST) Received: by hirez.programming.kicks-ass.net (Postfix, from userid 1000) id 3535C203C3762; Mon, 15 Jun 2020 17:20:56 +0200 (CEST) Date: Mon, 15 Jun 2020 17:20:56 +0200 From: Peter Zijlstra To: Marco Elver Cc: Dmitry Vyukov , Andrey Konovalov , Mark Rutland , Borislav Petkov , Thomas Gleixner , Ingo Molnar , clang-built-linux , "Paul E. McKenney" , Alexander Potapenko , kasan-dev , LKML , the arch/x86 maintainers , Andrew Morton , Josh Poimboeuf Subject: Re: [PATCH -tip v3 1/2] kcov: Make runtime functions noinstr-compatible Message-ID: <20200615152056.GF2554@hirez.programming.kicks-ass.net> References: <20200608110108.GB2497@hirez.programming.kicks-ass.net> <20200611215538.GE4496@worktop.programming.kicks-ass.net> <20200612114900.GA187027@google.com> <20200615142949.GT2531@hirez.programming.kicks-ass.net> <20200615145336.GA220132@google.com> <20200615150327.GW2531@hirez.programming.kicks-ass.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20200615150327.GW2531@hirez.programming.kicks-ass.net> Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Mon, Jun 15, 2020 at 05:03:27PM +0200, Peter Zijlstra wrote: > Yes, I think so. x86_64 needs lib/memcpy_64.S in .noinstr.text then. For > i386 it's an __always_inline inline-asm thing. Bah, I tried writing it without memcpy, but clang inserts memcpy anyway :/ --- diff --git a/arch/x86/kernel/traps.c b/arch/x86/kernel/traps.c index af75109485c26..d74fd6313a4ed 100644 --- a/arch/x86/kernel/traps.c +++ b/arch/x86/kernel/traps.c @@ -686,17 +686,17 @@ struct bad_iret_stack *fixup_bad_iret(struct bad_iret_stack *s) * just below the IRET frame) and we want to pretend that the * exception came from the IRET target. */ - struct bad_iret_stack tmp, *new_stack = + struct bad_iret_stack tmp = *s, *new_stack = (struct bad_iret_stack *)__this_cpu_read(cpu_tss_rw.x86_tss.sp0) - 1; + unsigned long *p = (unsigned long *)s->regs.sp; - /* Copy the IRET target to the temporary storage. */ - memcpy(&tmp.regs.ip, (void *)s->regs.sp, 5*8); + tmp.regs.ip = p[0]; + tmp.regs.cs = p[1]; + tmp.regs.flags = p[2]; + tmp.regs.sp = p[3]; + tmp.regs.ss = p[4]; - /* Copy the remainder of the stack from the current stack. */ - memcpy(&tmp, s, offsetof(struct bad_iret_stack, regs.ip)); - - /* Update the entry stack */ - memcpy(new_stack, &tmp, sizeof(tmp)); + *new_stack = tmp; BUG_ON(!user_mode(&new_stack->regs)); return new_stack;