2024-05-28 08:00:22

by Jia-hao Bai (白家豪)

[permalink] [raw]
Subject: [BUG] Kernel panic when using Hibernation on kernel 6.1.25

Hi,

I encountered a kernel panic when using the Hibernation on kernel version 6.1.25. Below are the details of the issue:

**Description:**
When I enable CONFIG_HIBERNATION and assign a specific partition for hibernation resuming and perform a specific operation, the system crashes with a kernel panic.

CONFIG_HIBERNATION=y
CONFIG_PM_STD_PARTITION="/dev/mmcblk0p16"

**Steps to Reproduce:**
1. Set printk to level 8: ` echo 8 > /proc/sys/kernel/printk`
2. Set up the swap partition: ` mkswap /dev/mmcblk0p16`
3. Enable the swap partition: ` swapon -p -3 /dev/mmcblk0p16`
4. Configure hibernation resuming settings: ` echo "/dev/mmcblk0p16" > /sys/power/resume`
5. Configure hibernation mode:` echo reboot > /sys/power/disk`
6. Perform the operation: ` echo disk > /sys/power/state`
7. Observe the kernel panic


**Expected Behavior:**
The operation should complete successfully without causing a kernel panic.

**Actual Behavior:**
The system crashes with a kernel panic.

**Environment:**
- Kernel version: 6.1.25
- Distribution: Yocto 4.0 32bit/Kernel 6.1.25 32bit
- Hardware: Arm Cortex A55, 1GB RAM

**Logs:**
```
[ 82.075123] PM: hibernation: Creating image:
[ 82.075123] PM: hibernation: Need to copy 59239 pages
[ 82.075123] 8<--- cut here ---
[ 82.075123] Unable to handle kernel paging request at virtual address c2fc0000
[ 82.075123] [c2fc0000] *pgd=42dff801, *pte=00000000, *ppte=00000000
[ 82.075123] Internal error: Oops: 7 [#1] PREEMPT SMP ARM
[ 82.075123] num_die-1, last_step-0
[ 82.075123]
[ 82.075123] Kernel Offset: disabled
[ 82.075123] PC is at safe_copy_page+0x20/0x34
[ 82.075123] LR is at safe_copy_page+0x18/0x34
[ 82.075123] pc : [<c0c97e58>] lr : [<c0c97e50>] psr: 800001d3
[ 82.075123] sp : c1b63f90 ip : 00000002 fp : ed76b700
[ 82.075123] r10: 00181668 r9 : c13ae5f4 r8 : c13ae620
[ 82.075123] r7 : 0000e767 r6 : c13dc840 r5 : ed881668 r4 : cab4a000
[ 82.075123] r3 : cab49ffc r2 : c2fc1000 r1 : 38e38e39 r0 : c2fc0000
[ 82.075123] CPU: 0 PID: 811 Comm: sh Tainted: G O 6.1.25-mainline #1
[ 82.075123] Hardware name: Generic DT based system
[ 82.075123] unwind_backtrace from show_stack+0x18/0x1c
[ 82.075123] show_stack from dump_stack_lvl+0x40/0x4c
[ 82.075123] dump_stack_lvl from mrdump_common_die+0x334/0x370
[ 82.075123] mrdump_common_die from notify_die+0x8c/0xc4
[ 82.075123] notify_die from die+0x108/0x4c0
[ 82.075123] die from die_kernel_fault+0x6c/0x7c
[ 82.075123] die_kernel_fault from do_page_fault+0x0/0x328```

Please let me know if you need any additional information or if there are any patches I can test.

Thanks,
Jia-hao Bai


2024-06-13 10:52:17

by Pavel Machek

[permalink] [raw]
Subject: Re: [BUG] Kernel panic when using Hibernation on kernel 6.1.25

Hi!

> I encountered a kernel panic when using the Hibernation on kernel version 6.1.25. Below are the details of the issue:
>
> **Description:**
> When I enable CONFIG_HIBERNATION and assign a specific partition for hibernation resuming and perform a specific operation, the system crashes with a kernel panic.
>
> CONFIG_HIBERNATION=y
> CONFIG_PM_STD_PARTITION="/dev/mmcblk0p16"
>
> **Steps to Reproduce:**
> 1. Set printk to level 8: ` echo 8 > /proc/sys/kernel/printk`
> 2. Set up the swap partition: ` mkswap /dev/mmcblk0p16`
> 3. Enable the swap partition: ` swapon -p -3 /dev/mmcblk0p16`
> 4. Configure hibernation resuming settings: ` echo "/dev/mmcblk0p16" > /sys/power/resume`
> 5. Configure hibernation mode:` echo reboot > /sys/power/disk`
> 6. Perform the operation: ` echo disk > /sys/power/state`
> 7. Observe the kernel panic
>
>
> **Expected Behavior:**
> The operation should complete successfully without causing a kernel panic.
>
> **Actual Behavior:**
> The system crashes with a kernel panic.
>
> **Environment:**
> - Kernel version: 6.1.25
> - Distribution: Yocto 4.0 32bit/Kernel 6.1.25 32bit
> - Hardware: Arm Cortex A55, 1GB RAM

We'd need to know way more about the hardware. Also testing with
latest mainline would be useful.

Best regards,
Pavel
--
People of Russia, stop Putin before his war on Ukraine escalates.


Attachments:
(No filename) (1.36 kB)
signature.asc (201.00 B)
Download all attachments

2024-06-14 02:33:05

by Jia-hao Bai (白家豪)

[permalink] [raw]
Subject: RE: [BUG] Kernel panic when using Hibernation on kernel 6.1.25

Hi Pavel,

Hardware: Arm Cortex A55, 1GB RAM, eMMC 8G.

Error log:
[ 1362.985700] sh: notify_die from die+0x144/0x5f0
[ 1362.985700] sh: die from die_kernel_fault+0x138/0x148
[ 1362.985700] sh: die_kernel_fault from __do_kernel_fault.part.0+0x5c/0xac
[ 1362.985700] sh: __do_kernel_fault.part.0 from do_translation_fault+0xbc/0xe0
[ 1362.985700] sh: do_translation_fault from do_DataAbort+0x44/0x1d0
[ 1362.985700] sh: do_DataAbort from __dabt_svc+0x4c/0x80
[ 1362.985700] sh: Exception stack(0xc1e8df38 to 0xc1e8df80)
[ 1362.985700] sh: df20: c3000000 00000000
[ 1362.985700] sh: df40: c3001000 ea157ffc ea158000 c17639a8 c17bd548 edceb060 c184b540 c17bd5a0
[ 1362.985700] sh: df60: 00007fd7 ed76c000 00000000 c1e8df88 c0ebe4dc c0ebe4e4 800001d3 ffffffff
[ 1362.985700] sh: __dabt_svc from safe_copy_page+0x20/0x4c
[ 1362.985700] sh: safe_copy_page from swsusp_save+0x580/0x5ac
[ 1362.985700] sh: swsusp_save from arch_save_image+0x8/0x74
[ 1362.985700] sh: arch_save_image from cpu_suspend_abort+0x0/0x18

We compared between K5.4 and K6.1.25 and found that Hibernation does not save the reserve area on K5.4 because it is blocked by pfn_valid.

Therefore, we have added the following workaround to skip some reserved memory sections.

The skip region is obtained from "cat /proc/iomem".
40000000-42fbffff : System RAM
40008000-410fffff : Kernel code
41200000-4144a25f : Kernel data
43100000-4402ffff : System RAM
45140000-593fffff : System RAM
59401000-5940ffff : System RAM
5941f000-594effff : System RAM
59501180-595fffff : System RAM
59640000-7fffffff : System RAM

static unsigned int pfn_is_reserved(unsigned long pfn){
phys_addr_t phys = __pfn_to_phy
if(phys >= 0x42fc0000 && phys< 0x43100000){
return true;
}
if(phys >= 0x44030000 && phys< 0x45140000){
return true;
}
if(phys >= 0x59400000 && phys< 0x59401000){
return true;
}
if(phys >= 0x59410000 && phys< 0x5941f000){
return true;
}
if(phys >= 0x594f0000 && phys< 0x59501180){
return true;
}
if(phys >= 0x59600000 && phys< 0x59640000){
return true;
}
return false;

}

static struct page *saveable_page(struct zone *zone, unsigned long pfn)
{
struct page *page;

if (!pfn_valid(pfn)){
return NULL;
}

if(pfn_is_reserved(pfn))
return NULL;
........


Do you know of any patches that can fix this problem?

thanks

-----Original Message-----
From: Pavel Machek <[email protected]>
Sent: Thursday, June 13, 2024 6:52 PM
To: Jia-hao Bai (白家豪) <[email protected]>
Cc: [email protected]; [email protected]; Iverlin Wang (王苳霖) <[email protected]>; Boy Wu (吳勃誼) <[email protected]>; Seiya Wang (王迺君) <[email protected]>; Dengjun Su (苏邓军) <[email protected]>; Win Yeh (葉昌倫) <[email protected]>; Sowell Peng (彭首偉) <[email protected]>; Richard-CC Yang (楊職銓) <[email protected]>
Subject: Re: [BUG] Kernel panic when using Hibernation on kernel 6.1.25

Hi!

> I encountered a kernel panic when using the Hibernation on kernel version 6.1.25. Below are the details of the issue:
>
> **Description:**
> When I enable CONFIG_HIBERNATION and assign a specific partition for hibernation resuming and perform a specific operation, the system crashes with a kernel panic.
>
> CONFIG_HIBERNATION=y
> CONFIG_PM_STD_PARTITION="/dev/mmcblk0p16"
>
> **Steps to Reproduce:**
> 1. Set printk to level 8: ` echo 8 > /proc/sys/kernel/printk`
> 2. Set up the swap partition: ` mkswap /dev/mmcblk0p16`
> 3. Enable the swap partition: ` swapon -p -3 /dev/mmcblk0p16`
> 4. Configure hibernation resuming settings: ` echo "/dev/mmcblk0p16" > /sys/power/resume`
> 5. Configure hibernation mode:` echo reboot > /sys/power/disk`
> 6. Perform the operation: ` echo disk > /sys/power/state`
> 7. Observe the kernel panic
>
>
> **Expected Behavior:**
> The operation should complete successfully without causing a kernel panic.
>
> **Actual Behavior:**
> The system crashes with a kernel panic.
>
> **Environment:**
> - Kernel version: 6.1.25
> - Distribution: Yocto 4.0 32bit/Kernel 6.1.25 32bit
> - Hardware: Arm Cortex A55, 1GB RAM

We'd need to know way more about the hardware. Also testing with latest mainline would be useful.

Best regards,
Pavel
--
People of Russia, stop Putin before his war on Ukraine escalates.