Received: by 2002:a05:6902:102b:0:0:0:0 with SMTP id x11csp3064841ybt; Mon, 29 Jun 2020 14:20:51 -0700 (PDT) X-Google-Smtp-Source: ABdhPJyv80qLXgQjmZ/4dnlEv11a4I6LSYUbMYdfhx7GqxTGnaPYYVSeDsrWtUhSwCdlqseoWpGm X-Received: by 2002:a05:6402:a43:: with SMTP id bt3mr9595690edb.332.1593465651616; Mon, 29 Jun 2020 14:20:51 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1593465651; cv=none; d=google.com; s=arc-20160816; b=AQee9eLuplW1b5jevNWmepd4IEHUdg1hA47VT7grscyxSia66rRuZzhzMdsVbfX0vp GU1gS62bjPeFL7pR2VA7XYAU+ZNvLyS0ljFArzxajpEobVgXr5OhjCvEGMkXn7vMQtEa +l/c2A9dLKSBX+/UWueKIAbf3dtOEIt4Qt0dkZdlSgLfMCR5vDy/dx5i1Ogt4duy9gBZ W1WsLaOOhpQ6ZnwPUaTUoGCJdc1lRIwbhRlf/FwO2qd6rZZHGf0JDDqAmG7x7iVlcR21 WWdJC5f8IhxhZoks/+fk7zHu94fm9tUa6HfXiK8zO4Pms7C+VtW4XSuEBwR/wbsgYhkW gSzg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:message-id:date:subject:cc:to:from; bh=mYIBGXOMN0m2eKyoOCr+/rp2i0XVIRpypcEMW6aPSLQ=; b=I2QN7jZdPkYnV1A1gOPyq31Bpqi0zjKuqn6e00zA7PvZqut4tw541GXwEceQxHS/P9 ePDROs3UfdPcduhZKZ+pQkBGMvRrcbiaExAgGnb78kDmCYGTjyXLxX7l9avs3SMvE3zX HqVmuo/89lPnfWgau/CtQAJ9teNfSlAZwtYsXe9RYifwg0Qq1V1zFKlS5Rb5W3aJyiOP KrYhILawGJ4JGJBpEwwX5PqTpS3YOTAm+E9QSziy/o/+hv6C+JZdMSYKYSyNpV54P/Vl ACI4cHrDBf1tJ2BkeQDpI3Of1Aqd24xhVKY/ntLlZKlVO2aiSAJihdrMzjdnEZ8elz30 0mYw== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id q23si350221edg.348.2020.06.29.14.20.28; Mon, 29 Jun 2020 14:20:51 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1729803AbgF2VRD (ORCPT + 99 others); Mon, 29 Jun 2020 17:17:03 -0400 Received: from foss.arm.com ([217.140.110.172]:36814 "EHLO foss.arm.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1729802AbgF2Sy6 (ORCPT ); Mon, 29 Jun 2020 14:54:58 -0400 Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id 347081529; Mon, 29 Jun 2020 09:26:38 -0700 (PDT) Received: from e107158-lin.cambridge.arm.com (e107158-lin.cambridge.arm.com [10.1.195.21]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPSA id 6B2EC3F71E; Mon, 29 Jun 2020 09:26:36 -0700 (PDT) From: Qais Yousef To: Ingo Molnar , Peter Zijlstra Cc: Valentin Schneider , Qais Yousef , Juri Lelli , Vincent Guittot , Dietmar Eggemann , Steven Rostedt , Ben Segall , Mel Gorman , Patrick Bellasi , Chris Redpath , Lukasz Luba , linux-kernel@vger.kernel.org Subject: [PATCH v5 0/2] sched: Optionally skip uclamp logic in fast path Date: Mon, 29 Jun 2020 17:26:31 +0100 Message-Id: <20200629162633.8800-1-qais.yousef@arm.com> X-Mailer: git-send-email 2.17.1 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org This series attempts to address the report that uclamp logic could be expensive sometimes and shows a regression in netperf UDP_STREAM under certain conditions. The first patch is a fix for how struct uclamp_rq is initialized which is required by the 2nd patch which contains the real 'fix'. Worth noting that the root cause of the overhead is believed to be system specific or related to potential certain code/data layout issues, leading to worse I/D $ performance. Different systems exhibited different behaviors and the regression did disappear in certain kernel version while attempting to reporoduce. More info can be found here: https://lore.kernel.org/lkml/20200616110824.dgkkbyapn3io6wik@e107158-lin/ Having the static key seemed the best thing to do to ensure the effect of uclamp is minimized for kernels that compile it in but don't have a userspace that uses it, which will allow distros to distribute uclamp capable kernels by default without having to compromise on performance for some systems that could be affected. Changes in v5: * Fix a race that could happen when order of enqueue/dequeue of tasks A and B is not done in order, and sched_uclamp_used is enabled in between. * Add more comments explaining the race and the behavior of uclamp_rq_util_with() which is now protected with a static key to be a NOP. When no uclamp aggregation at rq level is done, this function can't do much. Changes in v4: * Fix broken boosting of RT tasks when static key is disabled. Changes in v3: * Avoid double negatives and rename the static key to uclamp_used * Unconditionally enable the static key through any of the paths where the user can modify the default uclamp value. * Use C99 named struct initializer for struct uclamp_rq which is easier to read than the memset(). Changes in v2: * Add more info in the commit message about the result of perf diff to demonstrate that the activate/deactivate_task pressure is reduced in the fast path. * Fix sparse warning reported by the test robot. * Add an extra commit about using static_branch_likely() instead of static_branc_unlikely(). Thanks -- Qais Yousef Cc: Juri Lelli Cc: Vincent Guittot Cc: Dietmar Eggemann Cc: Steven Rostedt Cc: Ben Segall Cc: Mel Gorman CC: Patrick Bellasi Cc: Chris Redpath Cc: Lukasz Luba Cc: linux-kernel@vger.kernel.org Qais Yousef (2): sched/uclamp: Fix initialization of struct uclamp_rq sched/uclamp: Protect uclamp fast path code with static key kernel/sched/core.c | 86 +++++++++++++++++++++++++++++--- kernel/sched/cpufreq_schedutil.c | 2 +- kernel/sched/sched.h | 39 ++++++++++++++- 3 files changed, 117 insertions(+), 10 deletions(-) -- 2.17.1