Received: by 2002:a05:6a10:f347:0:0:0:0 with SMTP id d7csp4314517pxu; Tue, 1 Dec 2020 01:42:32 -0800 (PST) X-Google-Smtp-Source: ABdhPJw/9x+4Aq57BF8e+6AK8oFpXL/JBHowCWAP0fkPyfpKGtGYngJ3EVTzFn4ty6UHuOAjAJIf X-Received: by 2002:a17:906:16da:: with SMTP id t26mr2100618ejd.478.1606815752146; Tue, 01 Dec 2020 01:42:32 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1606815752; cv=none; d=google.com; s=arc-20160816; b=OTLBj/wu/lV9vv7ZntWut0vJeaFaSZHcdIkd2xuOn/4se5ggc+bsu5yaON4lxKiJc5 nR5zHVofErs1gxVjquvjfbcRIiJwym99iI3biriu5KaLkps58CFgYwuFSYATCTYAHIYV QXqOvVlaw9r7/pZJZ7TP5JM4yfGwbtKnYtH7xXawsiJW95XQlMevn+fKln6N+bqJ6ZEp O5WBQWA3o1/7RsD6wKHRMvxsSn4Z1reppKN9HCXzasvG5R6jYQvXLQqMsoY6jpzh42mO Y4nVsW4QCd6uQfQHCUe/ivspGPTHsojEcgFUWkzW46c+LfZkFMhkNdLPDNj6kNmN5mhi rGIw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:ironport-sdr:ironport-sdr; bh=ObypSA7kzDzPcRdfzR1CA6o1Zp1TUx/kQKonAW0ef/0=; b=bHrxdfY7LvQhPHiN/Ly/Ufl4/EaKJ08fEfqVwDvovfGb0f3K5wi+Hw0tBBK9vSFqn6 V134T0nBoFPnakMy7Zd5wvlBIBc3SmB0t2AxotWidnsQhPYSFWBwY21yBOl8xGLOgkio xx2Xj9TOHDC1yRCkbfLRcNg2ydOAJpKOz2azpby8jthw3Azh7LETwdEFtYTin4phGj8v IDayL1nWTan+NVRYzlwzFfVwiQ5L8cSNZ8UpRkSJEX8iis2g8yAbV5XHj8lVIF8+buPB 68wPMFhEkh69/8gJdQGYD2G8zkq8lzh54rGjq7MwxDGVkXHOHM8UFdd0NSwkiJHEyDZO anRw== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id r3si591536ejc.166.2020.12.01.01.42.08; Tue, 01 Dec 2020 01:42:32 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727990AbgLAJkY (ORCPT + 99 others); Tue, 1 Dec 2020 04:40:24 -0500 Received: from mga12.intel.com ([192.55.52.136]:26884 "EHLO mga12.intel.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1725955AbgLAJkX (ORCPT ); Tue, 1 Dec 2020 04:40:23 -0500 IronPort-SDR: 4re5k5ojZXbzk5l1HJQfAIguu3OmNPwr7c+pKQV92Xe9KLnoI6rIT5de1NoLPUpfTdSH1K7G8l SBo+t+FAlw+A== X-IronPort-AV: E=McAfee;i="6000,8403,9821"; a="152051888" X-IronPort-AV: E=Sophos;i="5.78,384,1599548400"; d="scan'208";a="152051888" X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from orsmga005.jf.intel.com ([10.7.209.41]) by fmsmga106.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 01 Dec 2020 01:39:42 -0800 IronPort-SDR: qmdfoQKF6U/udWG8pzgHlQirz9rrXzerdeYSi1FX/EB924nYtlYg3al1qM4HE5aVf3ie/dKRTU m24V4WKUeYuQ== X-IronPort-AV: E=Sophos;i="5.78,384,1599548400"; d="scan'208";a="549489026" Received: from shsi6026.sh.intel.com (HELO localhost) ([10.239.147.88]) by orsmga005-auth.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 01 Dec 2020 01:39:37 -0800 From: shuo.a.liu@intel.com To: linux-kernel@vger.kernel.org, x86@kernel.org Cc: Greg Kroah-Hartman , "H . Peter Anvin" , Thomas Gleixner , Ingo Molnar , Borislav Petkov , Sean Christopherson , Yu Wang , Reinette Chatre , Shuo Liu Subject: [PATCH v6 00/18] HSM driver for ACRN hypervisor Date: Tue, 1 Dec 2020 17:38:35 +0800 Message-Id: <20201201093853.12070-1-shuo.a.liu@intel.com> X-Mailer: git-send-email 2.28.0 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org From: Shuo Liu ACRN is a Type 1 reference hypervisor stack, running directly on the bare-metal hardware, and is suitable for a variety of IoT and embedded device solutions. ACRN implements a hybrid VMM architecture, using a privileged Service VM. The Service VM manages the system resources (CPU, memory, etc.) and I/O devices of User VMs. Multiple User VMs are supported, with each of them running Linux, Android OS or Windows. Both Service VM and User VMs are guest VM. Below figure shows the architecture. Service VM User VM +----------------------------+ | +------------------+ | +--------------+ | | | | | |ACRN userspace| | | | | | +--------------+ | | | | |-----------------ioctl------| | | | ... |kernel space +----------+ | | | | | | HSM | | | | Drivers | | +----------+ | | | | +--------------------|-------+ | +------------------+ +---------------------hypercall----------------------------------------+ | ACRN Hypervisor | +----------------------------------------------------------------------+ | Hardware | +----------------------------------------------------------------------+ There is only one Service VM which could run Linux as OS. In a typical case, the Service VM will be auto started when ACRN Hypervisor is booted. Then the ACRN userspace (an application running in Service VM) could be used to start/stop User VMs by communicating with ACRN Hypervisor Service Module (HSM). ACRN Hypervisor Service Module (HSM) is a middle layer that allows the ACRN userspace and Service VM OS kernel to communicate with ACRN Hypervisor and manage different User VMs. This middle layer provides the following functionalities, - Issues hypercalls to the hypervisor to manage User VMs: * VM/vCPU management * Memory management * Device passthrough * Interrupts injection - I/O requests handling from User VMs. - Exports ioctl through HSM char device. - Exports function calls for other kernel modules ACRN is focused on embedded system. So it doesn't support some features. E.g., - ACRN doesn't support VM migration. - ACRN doesn't support vCPU migration. This patch set adds the HSM to the Linux kernel. I also added a simple example to launch a small guest (with several instructions as payload) on ACRN with demonstration ioctl usage. The basic ARCN support was merged to upstream already. https://lore.kernel.org/lkml/1559108037-18813-3-git-send-email-yakui.zhao@intel.com/ ChangeLog: v6: - Added the cpuid.rst documentation (Boris) - Deleted exported acrn_is_privileged_vm(), user detects feature bits by cpuid_eax() directly (Boris) - Used 'g' as the hcall_id constrain in hypercall definitions (Boris, Segher) - Removed unnecessary reserved fields from structures. Sorted some fields for alignment (Greg) - Used built-in kernel guid_t types (Greg) - Specified the endian of some fields in user/kernel interface structures (Greg) - Removed the alignment attribute from user/kernel interface structures (Greg) - Set reserved fields to zero (Greg) - Added a ioctl interface usage sample in the last patch (Greg) - Used pin_user_pages*() instead of get_user_pages*(). v5: - Corrected typo in documentation. - Removed unused pr_fmt(). - Used supported constraint with a explicit MOV to R8 at beginning of ASM for hypercall interface. - Used dev_dbg() to replace dev_err() in places which might cause a DoS. - Introduced acrn_vm_list_lock as a mutex for friendly review. - Changed to use default attribute group list to add attribute files. v4: - Used acrn_dev.this_device directly for dev_*() (Reinette) - Removed the odd usage of {get|put}_device() on &acrn_dev->this_device (Greg) - Removed unused log code. (Greg) - Corrected the return error values. (Greg) - Mentioned that HSM relies hypervisor for sanity check in acrn_dev_ioctl() comments (Greg) v3: - Used {get|put}_device() helpers on &acrn_dev->this_device - Moved unused code from front patches to later ones. - Removed self-defined pr_fmt() and dev_fmt() - Provided comments for acrn_vm_list_lock. v2: - Removed API version related code. (Dave) - Replaced pr_*() by dev_*(). (Greg) - Used -ENOTTY as the error code of unsupported ioctl. (Greg) Shuo Liu (17): docs: acrn: Introduce ACRN x86/acrn: Introduce acrn_{setup, remove}_intr_handler() x86/acrn: Introduce hypercall interfaces virt: acrn: Introduce ACRN HSM basic driver virt: acrn: Introduce VM management interfaces virt: acrn: Introduce an ioctl to set vCPU registers state virt: acrn: Introduce EPT mapping management virt: acrn: Introduce I/O request management virt: acrn: Introduce PCI configuration space PIO accesses combiner virt: acrn: Introduce interfaces for PCI device passthrough virt: acrn: Introduce interrupt injection interfaces virt: acrn: Introduce interfaces to query C-states and P-states allowed by hypervisor virt: acrn: Introduce I/O ranges operation interfaces virt: acrn: Introduce ioeventfd virt: acrn: Introduce irqfd virt: acrn: Introduce an interface for Service VM to control vCPU sample/acrn: Introduce a sample of HSM ioctl interface usage Yin Fengwei (1): x86/acrn: Introduce acrn_cpuid_base() and hypervisor feature bits .../userspace-api/ioctl/ioctl-number.rst | 1 + Documentation/virt/acrn/cpuid.rst | 46 ++ Documentation/virt/acrn/index.rst | 12 + Documentation/virt/acrn/introduction.rst | 43 ++ Documentation/virt/acrn/io-request.rst | 97 +++ Documentation/virt/index.rst | 1 + MAINTAINERS | 9 + arch/x86/include/asm/acrn.h | 78 +++ arch/x86/kernel/cpu/acrn.c | 16 +- drivers/virt/Kconfig | 2 + drivers/virt/Makefile | 1 + drivers/virt/acrn/Kconfig | 15 + drivers/virt/acrn/Makefile | 3 + drivers/virt/acrn/acrn_drv.h | 227 ++++++ drivers/virt/acrn/hsm.c | 441 ++++++++++++ drivers/virt/acrn/hypercall.h | 254 +++++++ drivers/virt/acrn/ioeventfd.c | 273 ++++++++ drivers/virt/acrn/ioreq.c | 645 ++++++++++++++++++ drivers/virt/acrn/irqfd.c | 235 +++++++ drivers/virt/acrn/mm.c | 306 +++++++++ drivers/virt/acrn/vm.c | 126 ++++ include/uapi/linux/acrn.h | 479 +++++++++++++ samples/acrn/Makefile | 12 + samples/acrn/guest.ld | 9 + samples/acrn/payload.ld | 9 + samples/acrn/vm-sample.c | 136 ++++ 26 files changed, 3475 insertions(+), 1 deletion(-) create mode 100644 Documentation/virt/acrn/cpuid.rst create mode 100644 Documentation/virt/acrn/index.rst create mode 100644 Documentation/virt/acrn/introduction.rst create mode 100644 Documentation/virt/acrn/io-request.rst create mode 100644 arch/x86/include/asm/acrn.h create mode 100644 drivers/virt/acrn/Kconfig create mode 100644 drivers/virt/acrn/Makefile create mode 100644 drivers/virt/acrn/acrn_drv.h create mode 100644 drivers/virt/acrn/hsm.c create mode 100644 drivers/virt/acrn/hypercall.h create mode 100644 drivers/virt/acrn/ioeventfd.c create mode 100644 drivers/virt/acrn/ioreq.c create mode 100644 drivers/virt/acrn/irqfd.c create mode 100644 drivers/virt/acrn/mm.c create mode 100644 drivers/virt/acrn/vm.c create mode 100644 include/uapi/linux/acrn.h create mode 100644 samples/acrn/Makefile create mode 100644 samples/acrn/guest.ld create mode 100644 samples/acrn/payload.ld create mode 100644 samples/acrn/vm-sample.c base-commit: 127c501a03d5db8b833e953728d3bcf53c8832a9 -- 2.28.0