Received: by 2002:a05:6a10:17d3:0:0:0:0 with SMTP id hz19csp354666pxb; Wed, 14 Apr 2021 17:38:11 -0700 (PDT) X-Google-Smtp-Source: ABdhPJy7VH2sqC0F+W5lMpucaVBoORVAbazar4NZSZM2L5OFQyaUMu0JxsF6iPhVSEEqavlA3osW X-Received: by 2002:aa7:da15:: with SMTP id r21mr957535eds.253.1618447091375; Wed, 14 Apr 2021 17:38:11 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1618447091; cv=none; d=google.com; s=arc-20160816; b=jbU2rvTyB+unu7m7yGfJwvj3g6XIr7J5glZaIoZTYVdsXUnnlf+mfbnSuFEXexvCm5 ePATOKM4nbJWL+4jC5WWiRm9tZxcECe/hGy4aTwDjsrwzR4eN1Q0pui5+v5GN9NUQnki SkF4w9yfNT7EyDk/dtzsmzmHU58zagHscKL/qC5aIsxV1TMf37diUfHKtWqOJrJbuA1/ i3NuQc8233mQhjfODnaVyHppKZ8QDVC8F2c1q29odj1tFbp0cFy2qiT3wql7aat1GYPZ CGhpCh0qzJARNPhHfYgqhIxpMZh3x5LnuIPhUoozzSWpic890WNA3vPud3QP9byI14x2 odxw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:cc:to:subject:message-id:date:from:in-reply-to :references:mime-version:dkim-signature; bh=CzQ5mUD4wfNdi0P00ZxPERafYFyidD1VSYPt3GhsJFE=; b=TRwK7rinflQyT+p10BJD7YcbEcbFAn+uOyb/PMI5bUf43hNB27LwNcATuRVuVyDXIO UY8W3CL47Ovk2O1Aunb8iTkgn7xmWnpe7w9GCN97s/eTOWBWQuj7esKtZixuOHKiWeuF zMkC/66JelfvUXT4xdKel7raO4YxsMBU+xPkpJv+cSue9nYPfsWqfdun0tQcnxCH8TjH +GIQNj5zLE6GPtghHge4ufhbHMRoH/8hIA5icbRsFcK3odSDNXvxO3r8gc10FuVRYHha Ob+x6YpiYQLCQcJE+J++w9ATs1k2jAeSwhEOiF7jrYtvfnkdjvP5KLrSxckFks/7h015 nF+g== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@google.com header.s=20161025 header.b=vS30pULZ; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id j10si890820ejs.270.2021.04.14.17.37.47; Wed, 14 Apr 2021 17:38:11 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@google.com header.s=20161025 header.b=vS30pULZ; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S233624AbhDNRPl (ORCPT + 99 others); Wed, 14 Apr 2021 13:15:41 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:42554 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S232183AbhDNRPk (ORCPT ); Wed, 14 Apr 2021 13:15:40 -0400 Received: from mail-pj1-x102b.google.com (mail-pj1-x102b.google.com [IPv6:2607:f8b0:4864:20::102b]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 5610FC061574 for ; Wed, 14 Apr 2021 10:15:19 -0700 (PDT) Received: by mail-pj1-x102b.google.com with SMTP id q14-20020a17090a430eb02901503aaee02bso123560pjg.3 for ; Wed, 14 Apr 2021 10:15:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=CzQ5mUD4wfNdi0P00ZxPERafYFyidD1VSYPt3GhsJFE=; b=vS30pULZ0aW9HQrz30/psCHrhq6d4pv+guhxV1KgmozRQ2b5Uy9kUJkgfxYBef6+JR xepA8HKCdrBVd2FHcD8hmZYgmDOJR/VCAJShnPuHObfowzZO5M9ZxiU0lgjC2i5c+xAu RnDmrwmuaZpaq/i92Zrrq7bZHQsFMv1PgYjF8PJvFJNVPrcwAe/Z3UxX0SgW0kdxdY5h FqPOtbolLRilnuNwZJ2HCAPU89Z29uY73cULXygu08wqRT9FVxaI4KR4GkYyM588vNsq dsUEpl4BCOFwSayDE2HylBdHvA03fQ4tU4v2HfZOkiv96RbEUSS9g1DWJNbF3f29PaDk s8Lg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=CzQ5mUD4wfNdi0P00ZxPERafYFyidD1VSYPt3GhsJFE=; b=eolgKZSkAo0Vu8ffSOpGs5NB4/1l7igtDFFVHPv9s41UWJN9djT/JBQPi8EoKMPu63 HRi2piqF4baaBw6clifELGj/UPI59h+9P5M7ookOVqM6KlfQU1yq9QzpdqsQ7Y+HULl6 w/66cs0zkPmgIA1jOZugzt0b/aDvqwNBIzBU4MVhA6hSXtZj474MGhHxRd9UCP1Sfo1T PbLhhxYzE1Nl2i6YoLX2XbxcuAejgaTGa03LAYP4Kz7t/FhJzno35VRd81YvppQRnclG wrtB0RZyE2vErhYKkr7ktmeGWJ/78EN94PMJhSKU73PcKRBHLrhMk1idEFP6h4U/RMxm jvaw== X-Gm-Message-State: AOAM531Mt1r56SGdk9RBrtP8x2c/c3n2yfj38FyE4vmOizRVkUVrjDCF QfN4+HawRlzGrsmFCTLR3NWpXv3mpiJnP50sGEIEuQ== X-Received: by 2002:a17:90a:ce8d:: with SMTP id g13mr4631071pju.85.1618420518655; Wed, 14 Apr 2021 10:15:18 -0700 (PDT) MIME-Version: 1.0 References: <20210413162240.3131033-1-eric.dumazet@gmail.com> <20210413162240.3131033-4-eric.dumazet@gmail.com> <567941475.72456.1618332885342.JavaMail.zimbra@efficios.com> <989543379.72506.1618334454075.JavaMail.zimbra@efficios.com> <1347243835.72576.1618336812739.JavaMail.zimbra@efficios.com> <2c6885b0241d4127b8cb7e38abbbe1e5@AcuMS.aculab.com> <1e5576a1a5b24cb0b1d53b9bb22d528e@AcuMS.aculab.com> In-Reply-To: From: Arjun Roy Date: Wed, 14 Apr 2021 10:15:07 -0700 Message-ID: Subject: Re: [PATCH v2 3/3] rseq: optimise rseq_get_rseq_cs() and clear_rseq_cs() To: Eric Dumazet Cc: David Laight , Mathieu Desnoyers , Eric Dumazet , Ingo Molnar , Peter Zijlstra , paulmck , Boqun Feng , linux-kernel Content-Type: text/plain; charset="UTF-8" Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Wed, Apr 14, 2021 at 9:10 AM Eric Dumazet wrote: > > On Wed, Apr 14, 2021 at 6:08 PM David Laight wrote: > > > > From: Eric Dumazet > > > Sent: 14 April 2021 17:00 > > ... > > > > Repeated unsafe_get_user() calls are crying out for an optimisation. > > > > You get something like: > > > > failed = 0; > > > > copy(); > > > > if (failed) goto error; > > > > copy(); > > > > if (failed) goto error; > > > > Where 'failed' is set by the fault handler. > > > > > > > > This could be optimised to: > > > > failed = 0; > > > > copy(); > > > > copy(); > > > > if (failed) goto error; > > > > Even if it faults on every invalid address it probably > > > > doesn't matter - no one cares about that path. > > > > > > > > > On which arch are you looking at ? > > > > > > On x86_64 at least, code generation is just perfect. > > > Not even a conditional jmp, it is all handled by exceptions (if any) > > > > > > stac > > > copy(); > > > copy(); > > > clac > > > > > > > > > > > > efault_end: do error recovery. > > > > It will be x86_64. > > I'm definitely seeing repeated tests of (IIRC) %rdx. > > > > It may well be because the compiler isn't very new. > > Will be an Ubuntu build of 9.3.0. > > Does that support 'asm goto with outputs' - which > > may be the difference. > > > > Yep, probably. I am using some recent clang version. > On x86-64 I can confirm, for me it (4 x unsafe_get_user()) compiles down to stac + lfence + 8 x mov + clac as straight line code. And results in roughly a 5%-10% speedup over copy_from_user(). -Arjun > > David > > > > - > > Registered Address Lakeside, Bramley Road, Mount Farm, Milton Keynes, MK1 1PT, UK > > Registration No: 1397386 (Wales)