Received: by 2002:a05:6a10:a0d1:0:0:0:0 with SMTP id j17csp728921pxa; Wed, 19 Aug 2020 13:13:38 -0700 (PDT) X-Google-Smtp-Source: ABdhPJxImVolKVCAfG/ZyxfvuRjXJ94YI0+rl7Nm/qIer5JG7o24rM2TLvnM5er4+YuwIXqoLdDF X-Received: by 2002:aa7:db10:: with SMTP id t16mr25739810eds.196.1597868018241; Wed, 19 Aug 2020 13:13:38 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1597868018; cv=none; d=google.com; s=arc-20160816; b=EUEEDGua6CadTscVAZsUzTZaidtXThVUQ+Sv3yH29PzEwA4TJBbOxRUOKj2QlwGyDO 8SfwKYGXAteDbXm/jIbxYQgDihCcun9dEIE1xl6pjEU3evrADHJdgIKBqmEEc5fW23dp S48poQndflho0wMZKWVX0FzvGkRPQdc9unSgP+nahsqZ2jMgbYuJ2iWK12TlUnEy3YHl Ij0y72pTOclhs5K9nRpA3V7tbp+Fv+k49v62nr1wM/X5MsH7t7ia8oaOeRAaJoyQkT4j R+DQ/dhnN2wVHh29NV1wi/CxXUuOOEPLxK9sEEDhSp8+LRlZErufRn7abtr12vmvdxsI jVQA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-disposition:mime-version:references:message-id:subject:cc :to:from:date:dkim-signature; bh=aWJlZuyBEoP4j5aoc4JrDsUNwgvnVjmYGVt0UgJZ9d0=; b=lidIOS2UWXN9gtGTKgKPA7KlLyM2d2Kzk9IcUJPWB6Ney98T9AzHX/AxzlVqcri99j e41eT5WxI6he/nozfFK73YBFCQzO6BsWOT+GFJ6ZPVesp2VA6Jq0R21BZkmpSmRxvOUb yxs/chflkB4v264xZ+FNyEwCC+KpuluLxZIrBoV0dJqnOahf/pk31831lpPi1GW5xdpY ak5rGgN63YDusFjU+nJVBK1QiVmvho7AbkN7qP3Kuhj51DwTZWaOkit70gqMmQqFFEor li0mlf58IxJId8fpS/O5xr6fm4vPo2i6BUAQc+Ivp3vmpyAt59+WoMPiuQ8aY1fPTCWo bYKA== ARC-Authentication-Results: i=1; mx.google.com; dkim=fail header.i=@infradead.org header.s=casper.20170209 header.b=Ji3IzFdB; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id k19si15759689ejv.340.2020.08.19.13.13.13; Wed, 19 Aug 2020 13:13:38 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=fail header.i=@infradead.org header.s=casper.20170209 header.b=Ji3IzFdB; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727069AbgHSULt (ORCPT + 99 others); Wed, 19 Aug 2020 16:11:49 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:47034 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1725275AbgHSULt (ORCPT ); Wed, 19 Aug 2020 16:11:49 -0400 Received: from casper.infradead.org (casper.infradead.org [IPv6:2001:8b0:10b:1236::1]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 5B61BC061757; Wed, 19 Aug 2020 13:11:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=casper.20170209; h=In-Reply-To:Content-Type:MIME-Version: References:Message-ID:Subject:Cc:To:From:Date:Sender:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description; bh=aWJlZuyBEoP4j5aoc4JrDsUNwgvnVjmYGVt0UgJZ9d0=; b=Ji3IzFdBJP0RJnXsOKuepMkSP3 Dry6qmMNImqRP/gKYNREt724rVeU3rOs/ANZVz8gD74oH+K58RAqd8GUuB8InXFCG0y/MyjCtOhBu rJdf1PyCMELT8EjVyz0fwj4/AzCF46m04DSdgnKMezRM4qzmDjZHh+rMaDESMZLI2D1OgaNrMF4zz n5H35+fg2ksMi0RhPJdqNp0IwJJ/CGGB4owBNNORj0I12xhazRXLofFt9E10J74hwqtRjconQpLg/ fZ0/noTQg++0r/vFE9XhHURfgqP/Y4NL490Jc3kLnOWnlN7xbO0jJm76iLOBxfLGvDiO9HPNfajPs 59FgxwcQ==; Received: from j217100.upc-j.chello.nl ([24.132.217.100] helo=worktop.programming.kicks-ass.net) by casper.infradead.org with esmtpsa (Exim 4.92.3 #3 (Red Hat Linux)) id 1k8UQk-00041q-1O; Wed, 19 Aug 2020 20:11:31 +0000 Received: by worktop.programming.kicks-ass.net (Postfix, from userid 1000) id 48069980C9E; Wed, 19 Aug 2020 22:11:27 +0200 (CEST) Date: Wed, 19 Aug 2020 22:11:27 +0200 From: Peter Zijlstra To: Sebastian Andrzej Siewior Cc: linux-kernel@vger.kernel.org, io-uring@vger.kernel.org, Ingo Molnar , Juri Lelli , Vincent Guittot , Dietmar Eggemann , Steven Rostedt , Ben Segall , Mel Gorman , Jens Axboe , Thomas Gleixner Subject: Re: [PATCH 2/2] sched: Cache task_struct::flags in sched_submit_work() Message-ID: <20200819201127.GP3982@worktop.programming.kicks-ass.net> References: <20200819142134.GD2674@hirez.programming.kicks-ass.net> <20200819195505.y3fxk72sotnrkczi@linutronix.de> <20200819200025.lqvmyefqnbok5i4f@linutronix.de> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20200819200025.lqvmyefqnbok5i4f@linutronix.de> User-Agent: Mutt/1.10.1 (2018-07-13) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Wed, Aug 19, 2020 at 10:00:25PM +0200, Sebastian Andrzej Siewior wrote: > sched_submit_work() is considered to be a hot path. The preempt_disable() > instruction is a compiler barrier and forces the compiler to load > task_struct::flags for the second comparison. > By using a local variable, the compiler can load the value once and keep it in > a register for the second comparison. > > Verified on x86-64 with gcc-10. > > Signed-off-by: Sebastian Andrzej Siewior > --- > > Optimisation at molecule level, part two. Drop this in case this branch > isn't consider *that* hot and the cache hot value can be loaded again. > But then the value is around and be speculated early on :) That's fine, task->flags can only be changed by current. Patches look good to me, I'll stuff them in tomorrow. Thanks!