Received: by 2002:a6b:500f:0:0:0:0:0 with SMTP id e15csp232133iob; Mon, 2 May 2022 17:59:18 -0700 (PDT) X-Google-Smtp-Source: ABdhPJxispXvQt6WoILq7ifxnVOdV0sTeBnms3gXoQXc2SzydScFs7SwR6aop/XU07aXt/0BsndG X-Received: by 2002:a17:90a:1509:b0:1d8:c22b:4d61 with SMTP id l9-20020a17090a150900b001d8c22b4d61mr2056414pja.78.1651539558640; Mon, 02 May 2022 17:59:18 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1651539558; cv=none; d=google.com; s=arc-20160816; b=xCjZJg/QCBvanxPqYjZbZX0gXgWEy0HBfLWBGkYpWx119SLYJbWoJV5O66ChQrpX68 86g0ukXlRVkgNav6O+Iz0y1DUvHuBC0PKfE0j4AagaZCLi2QlagngRYnnwWdiEA2/XvQ RwFXVnTMX8BTknKor4xryW6mopnIaGbRTyQe6oPI3A8ft9RfyBdnEYnIw+crHVg32M0Z IPDDFIFV0J3og8dBYeSp5p5xaTc8xBiFHGjIA8AoMdi4oWxr191V35ojX6FKMD6rP1AI rkPg5tjsTEn04dBTSEEC2uzPufYrkHeAbNdUtrPPvYcmhU1TV/6WKNcOUhxz2CH+rMi8 cxlg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:robot-unsubscribe :robot-id:message-id:mime-version:references:in-reply-to:cc:subject :to:reply-to:sender:from:dkim-signature:dkim-signature:date; bh=YATk2HB+C5fwK8D8cN/gu91IL0UXOJNedtSVFfvFfmc=; b=p4mJ5HBpD7RYVlP/gNS8JHsI28vdC1D6ZsxrtT6+WmUOJlu10stMU1klv+c8jgSVIV Xc4CKdwMfi41hNXJRjgaPYLAbIe+wObkNPwvUvDXzIAbBQDnxopSTTYQPbq/jul5Y4Co 4PZDEdGyvQPqRnanyzRy13CWgCxo3+Stm1T4LhD1c2R+2SoVvAAHrZYF20ANVqlEm+7F nVHZwy2fzcD64g5roOt5Lz6IkmQAX+5QAYjvrCIoz90Z5FyEJoVTfoA29jedepia8Bez 6254btgKulm40Ca5hJXO3btGGyqKl4hW6V/GTxMd7xZUP5keaaYbfQc4/eoKzDocFMFX cgtQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@linutronix.de header.s=2020 header.b=YQCTJtMu; dkim=neutral (no key) header.i=@linutronix.de; spf=softfail (google.com: domain of transitioning linux-kernel-owner@vger.kernel.org does not designate 23.128.96.19 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=linutronix.de Return-Path: Received: from lindbergh.monkeyblade.net (lindbergh.monkeyblade.net. [23.128.96.19]) by mx.google.com with ESMTPS id p16-20020a056a000b5000b0050ab78f4b90si11431141pfo.250.2022.05.02.17.59.18 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 02 May 2022 17:59:18 -0700 (PDT) Received-SPF: softfail (google.com: domain of transitioning linux-kernel-owner@vger.kernel.org does not designate 23.128.96.19 as permitted sender) client-ip=23.128.96.19; Authentication-Results: mx.google.com; dkim=pass header.i=@linutronix.de header.s=2020 header.b=YQCTJtMu; dkim=neutral (no key) header.i=@linutronix.de; spf=softfail (google.com: domain of transitioning linux-kernel-owner@vger.kernel.org does not designate 23.128.96.19 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=linutronix.de Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by lindbergh.monkeyblade.net (Postfix) with ESMTP id 145FE4AE15; Mon, 2 May 2022 17:44:38 -0700 (PDT) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1381739AbiEBMIF (ORCPT + 99 others); Mon, 2 May 2022 08:08:05 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:57504 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1384862AbiEBMIE (ORCPT ); Mon, 2 May 2022 08:08:04 -0400 Received: from galois.linutronix.de (Galois.linutronix.de [193.142.43.55]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 49BFA12AFA; Mon, 2 May 2022 05:04:35 -0700 (PDT) Date: Mon, 02 May 2022 12:04:31 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linutronix.de; s=2020; t=1651493072; h=from:from:sender:sender:reply-to:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=YATk2HB+C5fwK8D8cN/gu91IL0UXOJNedtSVFfvFfmc=; b=YQCTJtMuvi4kUrtZ2UK05zVIn76iqKAGULzgVzbMMb9f4mZevp2G/rGlo0akG0rfe/adKx D7KRdvpHhv+fR1wJ6Es7qpn2zsubI4quXlCH51uXwNL7Kfr0uF6EjjxQuw1BkTRInPgJuw GU+2u61TcxcUbVudlGYrlPybNUFjdExAGUaFDDnhg6pRaF1knISG1iClneiD6F3kDpAWJA 49wtMLHCM9RLfLKxljNTzYbslV9ICtd/Xe5pEhZwG9cpCLDvjd3/RuTeuvuUMbvqkdQQfu 2eI7LcK+EGBWWGX/X8n79keOzGGvbeK0INQStxQiYBhGUSP8TA31W1mg+VRdEA== DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=linutronix.de; s=2020e; t=1651493072; h=from:from:sender:sender:reply-to:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=YATk2HB+C5fwK8D8cN/gu91IL0UXOJNedtSVFfvFfmc=; b=k3U2UU3Bwkbkv86MYlSSzwaHDvwhYTosOjA5Ouj//sgD95ZeVOaSCNUBnwzeA+lVKu01Cz eT/acSOuNU5oYuDA== From: "tip-bot2 for Thomas Gleixner" Sender: tip-bot2@linutronix.de Reply-to: linux-kernel@vger.kernel.org To: linux-tip-commits@vger.kernel.org Subject: [tip: timers/core] timekeeping: Consolidate fast timekeeper Cc: Thomas Gleixner , "Peter Zijlstra (Intel)" , x86@kernel.org, linux-kernel@vger.kernel.org In-Reply-To: <20220415091921.072296632@linutronix.de> References: <20220415091921.072296632@linutronix.de> MIME-Version: 1.0 Message-ID: <165149307143.4207.5088655039432642801.tip-bot2@tip-bot2> Robot-ID: Robot-Unsubscribe: Contact to get blacklisted from these emails Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-2.0 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,RDNS_NONE,SPF_HELO_NONE,T_SCC_BODY_TEXT_LINE autolearn=no autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org The following commit has been merged into the timers/core branch of tip: Commit-ID: 90be8d6c1f91e1e5121c219726524c91b52bfc20 Gitweb: https://git.kernel.org/tip/90be8d6c1f91e1e5121c219726524c91b52bfc20 Author: Thomas Gleixner AuthorDate: Fri, 15 Apr 2022 11:19:38 +02:00 Committer: Thomas Gleixner CommitterDate: Mon, 02 May 2022 14:00:20 +02:00 timekeeping: Consolidate fast timekeeper Provide a inline function which replaces the copy & pasta. Signed-off-by: Thomas Gleixner Acked-by: Peter Zijlstra (Intel) Link: https://lore.kernel.org/r/20220415091921.072296632@linutronix.de --- kernel/time/timekeeping.c | 20 ++++++++++---------- 1 file changed, 10 insertions(+), 10 deletions(-) diff --git a/kernel/time/timekeeping.c b/kernel/time/timekeeping.c index 3479804..8895ff2 100644 --- a/kernel/time/timekeeping.c +++ b/kernel/time/timekeeping.c @@ -429,6 +429,14 @@ static void update_fast_timekeeper(const struct tk_read_base *tkr, memcpy(base + 1, base, sizeof(*base)); } +static __always_inline u64 fast_tk_get_delta_ns(struct tk_read_base *tkr) +{ + u64 delta, cycles = tk_clock_read(tkr); + + delta = clocksource_delta(cycles, tkr->cycle_last, tkr->mask); + return timekeeping_delta_to_ns(tkr, delta); +} + static __always_inline u64 __ktime_get_fast_ns(struct tk_fast *tkf) { struct tk_read_base *tkr; @@ -439,12 +447,7 @@ static __always_inline u64 __ktime_get_fast_ns(struct tk_fast *tkf) seq = raw_read_seqcount_latch(&tkf->seq); tkr = tkf->base + (seq & 0x01); now = ktime_to_ns(tkr->base); - - now += timekeeping_delta_to_ns(tkr, - clocksource_delta( - tk_clock_read(tkr), - tkr->cycle_last, - tkr->mask)); + now += fast_tk_get_delta_ns(tkr); } while (read_seqcount_latch_retry(&tkf->seq, seq)); return now; @@ -560,10 +563,7 @@ static __always_inline u64 __ktime_get_real_fast(struct tk_fast *tkf, u64 *mono) tkr = tkf->base + (seq & 0x01); basem = ktime_to_ns(tkr->base); baser = ktime_to_ns(tkr->base_real); - - delta = timekeeping_delta_to_ns(tkr, - clocksource_delta(tk_clock_read(tkr), - tkr->cycle_last, tkr->mask)); + delta = fast_tk_get_delta_ns(tkr); } while (read_seqcount_latch_retry(&tkf->seq, seq)); if (mono)