Received: by 2002:a05:6358:11c7:b0:104:8066:f915 with SMTP id i7csp7086233rwl; Wed, 22 Mar 2023 21:57:55 -0700 (PDT) X-Google-Smtp-Source: AK7set8Oxqun4H/YowzG+eSM+B4ap3KtNBJqOCjR420UO+Pbb8R/v1X7rhjgMqRKUeGbaolrS92S X-Received: by 2002:a17:906:2548:b0:933:46a7:c3af with SMTP id j8-20020a170906254800b0093346a7c3afmr8490797ejb.72.1679547475023; Wed, 22 Mar 2023 21:57:55 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1679547475; cv=none; d=google.com; s=arc-20160816; b=AyV/5k3qVTD0I/f+8hAzFoa/MoVKgNT4cnvsdjadfWH6CM2ACbo0fEgx/2lV0wJEp5 j/umCpD4cjNSGU4NHLzBgrrFJTzZuyX7qmyIQ8pcW1NQFRnCNu3M0V+Kcp0Fr5AeWGF1 XTF+/Sti28L6ioKlDOElwP+G3fF4lOuNa6DlRM7wksBqP5V3Jop6WeKamWqTEinmJmU0 yk0M6HsIMMkUQ13aUPwpfcCnGW7GpxK1LgbDE2gH9AVujeaGx68GuxRYRPwUM8pbthPs tZmn1XGut5i001kybArebthbipf9EYXdngo2tNNjqHQxE2n/4cvwzO+F6fHd/0rytxw1 KFxw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from; bh=3BYijkKW/o4EMxIV1S8IlMqTrV5AHESo1/YfBktokEo=; b=GXBxEzXojQE8zFMKJw1Bb/JnEULZUl3yWt4FgPTAoVEzooNkb/cTnu36JpMUlimdM7 Zd+bBeDRZ8829fv53m3kGOGo1KkOinTwOjSnXI3KyolRyHakuDqT9fF4CCRxFzrRwiJV 5grUZCerIoDuot78geQSeFbz2WMYFaJn32LdbAteII8JD1LA+aRdhFsFUyHnjRTTE5rG V3gF3sQ2+P0aPbVt650xsgXj4EtE6DPgnYtaQpTkFLSOw3bQN8CTNHJJuiZ+FaRyexHU AT0r9xn73Fros6F7o1yUe5vLMbKQ9nJPIqgJZTsSU0VSfR0UKtROpFK+QsQO5W9vl/n1 YsYg== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id hu21-20020a170907a09500b0093b62d1f8e0si3501735ejc.271.2023.03.22.21.57.30; Wed, 22 Mar 2023 21:57:55 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229848AbjCWE42 convert rfc822-to-8bit (ORCPT + 99 others); Thu, 23 Mar 2023 00:56:28 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:32972 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229729AbjCWE4W (ORCPT ); Thu, 23 Mar 2023 00:56:22 -0400 Received: from fd01.gateway.ufhost.com (fd01.gateway.ufhost.com [61.152.239.71]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id EC98D29E21 for ; Wed, 22 Mar 2023 21:56:15 -0700 (PDT) Received: from EXMBX165.cuchost.com (unknown [175.102.18.54]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "EXMBX165", Issuer "EXMBX165" (not verified)) by fd01.gateway.ufhost.com (Postfix) with ESMTP id 01EE424DFD7; Thu, 23 Mar 2023 12:56:12 +0800 (CST) Received: from EXMBX066.cuchost.com (172.16.7.66) by EXMBX165.cuchost.com (172.16.6.75) with Microsoft SMTP Server (TLS) id 15.0.1497.42; Thu, 23 Mar 2023 12:56:12 +0800 Received: from jsia-virtual-machine.localdomain (202.188.176.82) by EXMBX066.cuchost.com (172.16.6.66) with Microsoft SMTP Server (TLS) id 15.0.1497.42; Thu, 23 Mar 2023 12:56:08 +0800 From: Sia Jee Heng To: , , CC: , , , , Subject: [PATCH v7 0/4] RISC-V Hibernation Support Date: Thu, 23 Mar 2023 12:56:00 +0800 Message-ID: <20230323045604.536099-1-jeeheng.sia@starfivetech.com> X-Mailer: git-send-email 2.34.1 MIME-Version: 1.0 Content-Type: text/plain X-Originating-IP: [202.188.176.82] X-ClientProxiedBy: EXCAS066.cuchost.com (172.16.6.26) To EXMBX066.cuchost.com (172.16.6.66) X-YovoleRuleAgent: yovoleflag Content-Transfer-Encoding: 8BIT X-Spam-Status: No, score=-0.0 required=5.0 tests=RCVD_IN_MSPIKE_H2, SPF_HELO_PASS,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org This series adds RISC-V Hibernation/suspend to disk support. Low level Arch functions were created to support hibernation. swsusp_arch_suspend() relies code from __cpu_suspend_enter() to write cpu state onto the stack, then calling swsusp_save() to save the memory image. Arch specific hibernation header is implemented and is utilized by the arch_hibernation_header_restore() and arch_hibernation_header_save() functions. The arch specific hibernation header consists of satp, hartid, and the cpu_resume address. The kernel built version is also need to be saved into the hibernation image header to making sure only the same kernel is restore when resume. swsusp_arch_resume() creates a temporary page table that covering only the linear map. It copies the restore code to a 'safe' page, then start to restore the memory image. Once completed, it restores the original kernel's page table. It then calls into __hibernate_cpu_resume() to restore the CPU context. Finally, it follows the normal hibernation path back to the hibernation core. To enable hibernation/suspend to disk into RISCV, the below config need to be enabled: - CONFIG_ARCH_HIBERNATION_HEADER - CONFIG_ARCH_HIBERNATION_POSSIBLE At high-level, this series includes the following changes: 1) Change suspend_save_csrs() and suspend_restore_csrs() to public function as these functions are common to suspend/hibernation. (patch 1) 2) Refactor the common code in the __cpu_resume_enter() function and __hibernate_cpu_resume() function. The common code are used by hibernation and suspend. (patch 2) 3) Enhance kernel_page_present() function to support huge page. (patch 3) 4) Add arch/riscv low level functions to support hibernation/suspend to disk. (patch 4) The above patches are based on kernel v6.3-rc3 and are tested on StarFive VF2 SBC board and Qemu. ACPI platform mode is not supported in this series. Changes since v6: - Rebased to kernel v6.3-rc3 - Resolved nit Changes since v5: - Rebased to kernel v6.3-rc2 - Removed extra line at the commit msg - Added comment to describe the reason to map the kernel address Changes since v4: - Rebased to kernel v6.3-rc1 - Resolved typo(s) - Removed unnecessary helper function - Removed unnecessary "addr" local variable - Removed typecast of 'int' - Used def_bool HIBERNATION - Used "mv a0, zero" instead of "add a0, zero, zero" - Make linear region as executable and writable when restoring the image Changes since v3: - Rebased to kernel v6.2 - Temporary page table code refactoring by reference to ARM64 - Resolved typo(s) and grammars - Resolved documentation errors - Resolved clang build issue - Removed unnecessary comments - Used kzalloc instead of kcalloc Changes since v2: - Rebased to kernel v6.2-rc5 - Refactor the common code used by hibernation and suspend - Create copy_page macro - Solved other comments from Andrew and Conor Changes since v1: - Rebased to kernel v6.2-rc3 - Fixed bot's compilation error Sia Jee Heng (4): RISC-V: Change suspend_save_csrs and suspend_restore_csrs to public function RISC-V: Factor out common code of __cpu_resume_enter() RISC-V: mm: Enable huge page support to kernel_page_present() function RISC-V: Add arch functions to support hibernation/suspend-to-disk arch/riscv/Kconfig | 6 + arch/riscv/include/asm/assembler.h | 82 ++++++ arch/riscv/include/asm/suspend.h | 22 ++ arch/riscv/kernel/Makefile | 1 + arch/riscv/kernel/asm-offsets.c | 5 + arch/riscv/kernel/hibernate-asm.S | 77 ++++++ arch/riscv/kernel/hibernate.c | 427 +++++++++++++++++++++++++++++ arch/riscv/kernel/suspend.c | 4 +- arch/riscv/kernel/suspend_entry.S | 34 +-- arch/riscv/mm/pageattr.c | 8 + 10 files changed, 633 insertions(+), 33 deletions(-) create mode 100644 arch/riscv/include/asm/assembler.h create mode 100644 arch/riscv/kernel/hibernate-asm.S create mode 100644 arch/riscv/kernel/hibernate.c base-commit: fff5a5e7f528b2ed2c335991399a766c2cf01103 -- 2.34.1