Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.33 as permitted sender) client-ip=23.128.96.33;
From:   Dongli Zhang <dongli.zhang@oracle.com>
To:     kvm@vger.kernel.org, linux-kselftest@vger.kernel.org
Cc:     linux-kernel@vger.kernel.org, pbonzini@redhat.com,
        shuah@kernel.org, seanjc@google.com, dwmw2@infradead.org,
        joe.jin@oracle.com
Subject: [PATCH 1/1] selftests: KVM: add test to print boottime wallclock
Date:   Fri,  6 Oct 2023 10:57:15 -0700
Message-Id: <20231006175715.105517-1-dongli.zhang@oracle.com>
Content-Transfer-Encoding: 8bit
Content-Type: text/plain
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?XHh61IZM76hONpI9Ajplqt2Jzecc+EuaOAMoHBegaGAKp+ZZbUD9YOJC2dDM?=
 =?us-ascii?Q?tR74D3Han4rIvFtVme0Wml7EWYsFYY4nZQf8NevJDv7deOdd1DuZvGQQ6sBJ?=
 =?us-ascii?Q?4E9JrRsq6WMpHFKWzJ+ZnUQy57+g1Zhv2C7eVx/xCX9COTARX9BHOWf1SQvG?=
 =?us-ascii?Q?NQMoOUNsgG6ThQznewYGYddw+zY53XRw7AEd8s4odQjRCyUWFbuAlhMtxNC+?=
 =?us-ascii?Q?MyByCiCn8C4BfEctJc6+ITuIIaC0nkcMZJgWIuVD9reTORCpr/GZENsZY+a/?=
 =?us-ascii?Q?uSNTSZRcWGknnH4x/JZGYcLXjb8eC/RfypWynBKuBpGBpX3X/DjFS9NIZVlp?=
 =?us-ascii?Q?uuwki7RQmEqW937EDymMn1FAFbIz8EvrQxNy/uNyK2GfUjDnwxHGamtYZxsq?=
 =?us-ascii?Q?NdSVErFzA5YiJOuGm7rjXZesk4rWqIWi+vr5hp/L3uJRKdO0geSW0GBBN8eW?=
 =?us-ascii?Q?fWhJjun8nOeFSPfxDYrqS5CbUB1YFjwN9NYlayywozl8GgUONyKGx2dgmnII?=
 =?us-ascii?Q?kfcoN/9Hz86mXvC7YSw4szk9lhN/6OTBq6gsU2YaIVYXT2s3lAXXKlmsd6g+?=
 =?us-ascii?Q?8/FFBd36Cb9zddO2iR0EbwSTgmox2rOgaQYZXZAeX95Is+PQaKXAHVOF2haw?=
 =?us-ascii?Q?Azugu7ZqAZKXVWmHk/nwepglFVaAm3UL13/pHYEej6IBBwnc1jC3OtfEUQH4?=
 =?us-ascii?Q?S6PU4Rz5XIuwmefCsw9QXvevaer0OgbppVt/SVfWUwb3Ss7me+4AYD8d5Lzq?=
 =?us-ascii?Q?21w0M34+FLkIJl7MXshrAIz1riV9WSuIb5YhiVtQ5Cp5ObOVuGAxPXYjEXfk?=
 =?us-ascii?Q?wYxSqNutzLxKYuuDIilx3jeI4x48CK4P8R/hMIG/dCYQKaYIFTSCbNvv1ALg?=
 =?us-ascii?Q?zap9XFGexkS7/q2fBXMwzwq7t8iL6/VRPtl0dm/dOuXc+u+Y6RV3vcgW2EB3?=
 =?us-ascii?Q?WZG2djIU+dI2rUL2Bn9YSikxf4cZ/6bLRxVSxmyApguPPgfIeZgXWCkhk6Ku?=
 =?us-ascii?Q?0M2VMqn+WvNK7btk8e9B5+jXs5wHxSbySpi55m4vj7tbIwmAdjIq/VP430sI?=
 =?us-ascii?Q?TdLFTnyqx9OL0YzatEVeYArruzpDNwhZ0Lcdh1p6Ng+IMnKhObHbhaUIzzAq?=
 =?us-ascii?Q?09nJ6zf4F8SktxF/+gulWjVaTUv/BszZZQ99s0yjb3SWLybTl1G1AkBUe+gA?=
 =?us-ascii?Q?3oVvvzOpkmZfDKpq60haGDTh1dkGZvWAaQ87DfSuyxra5BkYsL0+aOreOyyO?=
 =?us-ascii?Q?ccyvN4Fo7CTcLu5SgAIS/umtf/fRjfY2A96HZPBL2+zw9mzkYh36pJdojvna?=
 =?us-ascii?Q?XMF7z29noIHB3w5OedEWCCo2/FHMe/74P4eu9dDzDAJlzUySOoNTWdR96lbj?=
 =?us-ascii?Q?+srJjX4FbjpQ9FbZ/5LZJdqncOdg182AV+mQ/O40EbHRiNRunBUGmoCZPzuu?=
 =?us-ascii?Q?MvJDO15SmvgaeQ25FeWPtv8WP0X7UHaiQFHbUddKJcDtKpNe+XZ6xGDns2C2?=
 =?us-ascii?Q?2X/S2j+HMCQHlzr78HuPXA7OeViN0UYH7wCGL3un7uoUz36QSokYTaEJbL9S?=
 =?us-ascii?Q?JUHvzO2guyRoU6IRiZPSFArRxJTdS1DTg75yHqIp?=
X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0: erj5bWSbA//afUHRWZVXt5j7YlRllnjT1w99Z4SdLfg8fYyJZnCDjukO27FwWQOQdGRiMw8uk3JDBPZJuph0a8sqYt+Z93LXFXJGJU86ISWPpKVVjVJPhyuGUvfYuoQeuz5WEl2VNTZGiYHLAR96Wr/GghVvHnnQxIzAIuPnUiLo4Mwr+79FWWu5GpD0qH/2wbB+n/0PrJ0Lvy/btd2xKX9gcFzXxOER0Fk/B6xGlQykN6NTCsHZAfl6yG4sRTkzFb4K+ibrYSu/n9C+Mzbq7SCH2NG/Xzxp9X5C4WMK61Nlj5aGyglgirAczPV5a1e9HYP/GGLSktsdracDxpwpEivDkcKTEkH8HWBn34LEJVM5Qa8DsXcBGD4vdyzJR4fjKBHkyN9NEL8LoOP8uIXRCKhTQT791NWoy24m93NIbORgy0QA50gvKGLzObjin4zSdAGc0CIBpwvoC5MJwz9SuS24BiMcdyD/Pa6u0V6Yx2I/T+7usBKh5albwWecNKyoY3G6egmY6PGJWViIEs0BZP2anPl4XZzzrMmlHboY3YbNU8Vi97XXc8IMtIeyu6Sn536oHqBKM5ZBqoi5fJIyxvi+XYESwHwrBdWwbG+/3GwyP+zcyqlSJwDRBt//WdmpkEP0/Al1lM+OL7Q3GbP/ITr8AUMPT1p8H3TkibNeMl2aGMBL2OB7rKw4ksmCyQSgA1EEzbyG08QuMDm7OKnVuAG4P+NzNeQKGLoszV2+O/JHLNAYkJei4tRHDfVpr1bBshG8m9EWoAoAlfNlypuZxWmIAMmjLOUxKdKadmdK6x0UaZloQwpQCeJ0lcDrWAL5ITjKQ5vcmdIdrTM6CKxWOoc9H8RMsPidmu3a/9DRPlMJl9Z7euFUX+AozbEa8sB6
X-OriginatorOrg: oracle.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 3bb5fd13-860a-408f-c843-08dbc696383a
X-MS-Exchange-CrossTenant-AuthSource: BYAPR10MB2663.namprd10.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 06 Oct 2023 18:01:09.7092
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: h6VWGu/OTIsBI8bkW23O0HLTELEZTrUY2WvL0aK/DeJCPLB7bGbZvPD4PQx6wxPYCBbqdqOnMInduR7KNCv/4A==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM4PR10MB6744
X-Proofpoint-Virus-Version: vendor=baseguard
 engine=ICAP:2.0.267,Aquarius:18.0.980,Hydra:6.0.619,FMLib:17.11.176.26
 definitions=2023-10-06_14,2023-10-06_01,2023-05-22_02
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 adultscore=0 mlxlogscore=999 mlxscore=0
 spamscore=0 malwarescore=0 suspectscore=0 phishscore=0 bulkscore=0
 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2309180000
 definitions=main-2310060135
X-Proofpoint-ORIG-GUID: ZQm88UL7-tVL_eX2O8iPIJvQ12gyZUW1
X-Proofpoint-GUID: ZQm88UL7-tVL_eX2O8iPIJvQ12gyZUW1
X-Spam-Status: No, score=2.7 required=5.0 tests=DKIM_SIGNED,DKIM_VALID,
	DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,
	RCVD_IN_SBL_CSS,SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no
	version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lipwig.vger.email
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org
X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (lipwig.vger.email [0.0.0.0]); Fri, 06 Oct 2023 11:02:01 -0700 (PDT)
X-Spam-Level: **

As inspired by the discussion in [1], the boottime wallclock may drift due
to the fact that the masterclock (or host monotonic clock) and kvmclock are
calculated based on the algorithms in different domains.

This is to introduce a testcase to print the boottime wallclock
periodically to help diagnose the wallclock drift issue in the future.

The idea is to wrmsr the MSR_KVM_WALL_CLOCK_NEW, and read the boottime
wallclock nanoseconds immediately.

References:
[1] https://lore.kernel.org/all/20231001111313.77586-1-nsaenz@amazon.com

Cc: David Woodhouse <dwmw@amazon.co.uk>
Signed-off-by: Dongli Zhang <dongli.zhang@oracle.com>
---
 tools/testing/selftests/kvm/Makefile          |   3 +-
 .../selftests/kvm/x86_64/boottime_wallclock.c | 100 ++++++++++++++++++
 2 files changed, 102 insertions(+), 1 deletion(-)
 create mode 100644 tools/testing/selftests/kvm/x86_64/boottime_wallclock.c

diff --git a/tools/testing/selftests/kvm/Makefile b/tools/testing/selftests/kvm/Makefile
index a3bb36fb3cfc..fea05b0118de 100644
--- a/tools/testing/selftests/kvm/Makefile
+++ b/tools/testing/selftests/kvm/Makefile
@@ -60,7 +60,8 @@ LIBKVM_riscv += lib/riscv/ucall.c
 TEST_PROGS_x86_64 += x86_64/nx_huge_pages_test.sh
 
 # Compiled test targets
-TEST_GEN_PROGS_x86_64 = x86_64/cpuid_test
+TEST_GEN_PROGS_x86_64 = x86_64/boottime_wallclock
+TEST_GEN_PROGS_x86_64 += x86_64/cpuid_test
 TEST_GEN_PROGS_x86_64 += x86_64/cr4_cpuid_sync_test
 TEST_GEN_PROGS_x86_64 += x86_64/dirty_log_page_splitting_test
 TEST_GEN_PROGS_x86_64 += x86_64/get_msr_index_features
diff --git a/tools/testing/selftests/kvm/x86_64/boottime_wallclock.c b/tools/testing/selftests/kvm/x86_64/boottime_wallclock.c
new file mode 100644
index 000000000000..cc48c9b19920
--- /dev/null
+++ b/tools/testing/selftests/kvm/x86_64/boottime_wallclock.c
@@ -0,0 +1,100 @@
+// SPDX-License-Identifier: GPL-2.0-only
+/*
+ * Copyright (C) 2023 Oracle and/or its affiliates.
+ */
+
+#include <asm/kvm_para.h>
+#include <asm/pvclock-abi.h>
+
+#include "kvm_util.h"
+#include "processor.h"
+
+static int period = 10;
+
+#define GUEST_SYNC_WALLCLOCK(__stage, __val)                        \
+		GUEST_SYNC_ARGS(__stage, __val, 0, 0, 0)
+
+static void guest_main(vm_paddr_t wc_pa, struct pvclock_wall_clock *wc)
+{
+	uint64_t wallclock;
+
+	while (true) {
+		wrmsr(MSR_KVM_WALL_CLOCK_NEW, wc_pa);
+
+		wallclock = wc->sec * NSEC_PER_SEC + wc->nsec;
+
+		GUEST_SYNC_WALLCLOCK(0, wallclock);
+	}
+}
+
+static void handle_sync(struct ucall *uc)
+{
+	uint64_t wallclock;
+
+	wallclock = uc->args[2];
+
+	pr_info("Boottime wallclock value: %"PRIu64" ns\n", wallclock);
+}
+
+static void handle_abort(struct ucall *uc)
+{
+	REPORT_GUEST_ASSERT(*uc);
+}
+
+static void enter_guest(struct kvm_vcpu *vcpu)
+{
+	struct ucall uc;
+
+	while (true) {
+		vcpu_run(vcpu);
+
+		TEST_ASSERT_KVM_EXIT_REASON(vcpu, KVM_EXIT_IO);
+
+		switch (get_ucall(vcpu, &uc)) {
+		case UCALL_SYNC:
+			handle_sync(&uc);
+			break;
+		case UCALL_ABORT:
+			handle_abort(&uc);
+			return;
+		default:
+			TEST_ASSERT(0, "unhandled ucall: %ld\n", uc.cmd);
+			return;
+		}
+
+		sleep(period);
+	}
+}
+
+int main(int argc, char *argv[])
+{
+	struct kvm_vcpu *vcpu;
+	struct kvm_vm *vm;
+	vm_vaddr_t wc_gva;
+	vm_paddr_t wc_gpa;
+	int opt;
+
+	while ((opt = getopt(argc, argv, "p:h")) != -1) {
+		switch (opt) {
+		case 'p':
+			period = atoi_positive("The period (seconds)", optarg);
+			break;
+		case 'h':
+		default:
+			pr_info("usage: %s [-p period (seconds)]\n", argv[0]);
+			exit(1);
+		}
+	}
+
+	pr_info("Capture boottime wallclock every %d seconds.\n", period);
+	pr_info("Stop with Ctrl + c.\n\n");
+
+	vm = vm_create_with_one_vcpu(&vcpu, guest_main);
+
+	wc_gva = vm_vaddr_alloc(vm, getpagesize(), 0x10000);
+	wc_gpa = addr_gva2gpa(vm, wc_gva);
+	vcpu_args_set(vcpu, 2, wc_gpa, wc_gva);
+
+	enter_guest(vcpu);
+	kvm_vm_free(vm);
+}
-- 
2.34.1