2014-06-19 06:17:36

by Jet Chen

[permalink] [raw]
Subject: [HZ] INFO: task kworker/0:1:16 blocked for more than 120 seconds.

Hi Maarten,

0day kernel testing robot got the below dmesg and the first bad commit is

git://people.freedesktop.org/~mlankhorst/linux master
commit 52774d9273d6b8aff39822ccfe10e5a0d7c3a7f8
Author: Maarten Lankhorst <[email protected]>
AuthorDate: Thu Jan 16 16:24:04 2014 +0100
Commit: Maarten Lankhorst <[email protected]>
CommitDate: Wed Jun 18 14:19:52 2014 +0200

There's some really badly broken software out there that is entirely
dependant on HZ for its maximum performance. Raise the maximum HZ value
to some higher and slightly unreasonable values up to some higher and
completely obscene values.
-ck

+--------------------------------------------------+------------+------------+
| | c03339ffa3 | 52774d9273 |
+--------------------------------------------------+------------+------------+
| boot_successes | 60 | 0 |
| boot_failures | 0 | 20 |
| INFO:task_blocked_for_more_than_seconds | 0 | 20 |
| RIP:flat_send_IPI_mask | 0 | 20 |
| Kernel_panic-not_syncing:hung_task:blocked_tasks | 0 | 20 |
| backtrace:serio_handle_event | 0 | 20 |
| backtrace:watchdog | 0 | 20 |
+--------------------------------------------------+------------+------------+

[ 69.176969] torture thread lock_torture_writer parking due to system shutdown
[ 120.553588] spin_lock-torture: Writes: Total: 2 Max/Min: 0/0 Fail: 0 [ 120.554375] torture thread lock_torture_stats parking due to system shutdown
[ 240.031059] INFO: task kworker/0:1:16 blocked for more than 120 seconds.
[ 240.031837] Not tainted 3.16.0-rc1-00045-g52774d9 #1
[ 240.032443] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 240.033280] kworker/0:1 D ffff880013612580 0 16 2 0x00000000

git bisect start 91283063c4f74fb202ac7809a8df3cc00f22203e 7171511eaec5bf23fb06078f59784a3a0626b38f --
git bisect good bc106bf69fdfba649ad98b3c7cfd2b63e84431a8 # 01:57 20+ 0 Merge 'dynticks/timers/missing-kick-v2' into devel-hourly-2014061900
git bisect bad 25f92e043e7e4ca029592e03a2d77a09f226f395 # 02:15 0- 1 Merge 'at91/abe/at91_3.16-rc1_CCF' into devel-hourly-2014061900
git bisect good 6c815b36fd13fd40f3545c9e6e33eb7d4b396d8d # 02:18 20+ 0 Merge 'efi/next' into devel-hourly-2014061900
git bisect good a235b89e0b1332b44baff6277b5dbc711df34b3d # 02:25 20+ 0 Merge 'kvm-ppc/kvm-ppc-queue' into devel-hourly-2014061900
git bisect bad 8b4870846e71960a223e729e3c18942edfe81f16 # 02:44 0- 4 Merge 'spi/for-next' into devel-hourly-2014061900
git bisect bad 2115cd10081ea65213b45d9970aeebe88dabcfb3 # 02:55 0- 5 Merge 'mlankhorst/master' into devel-hourly-2014061900
git bisect bad 52774d9273d6b8aff39822ccfe10e5a0d7c3a7f8 # 03:00 0- 4 There's some really badly broken software out there that is entirely
git bisect good 0da2b800ec8dfad78c888b33be2ad2aea3411796 # 03:06 20+ 0 Merge branch 'for-nouveau'
git bisect good c03339ffa3d9d2330c8c14b8d73e9a4da38101ea # 03:09 20+ 0 drm/nouveau: add guard pages to vm
# first bad commit: [52774d9273d6b8aff39822ccfe10e5a0d7c3a7f8] There's some really badly broken software out there that is entirely
git bisect good c03339ffa3d9d2330c8c14b8d73e9a4da38101ea # 03:12 60+ 0 drm/nouveau: add guard pages to vm
git bisect bad 91283063c4f74fb202ac7809a8df3cc00f22203e # 03:12 0- 13 0day head guard for 'devel-hourly-2014061900'
git bisect good e99cfa2d0634881b8a41d56c48b5956b9a3ba162 # 03:50 60+ 0 Merge tag 'dt-fixes-for-3.16' of git://git.kernel.org/pub/scm/linux/kernel/git/robh/linux
git bisect good 4ca1fbc122fcb09efa2bb1448bff8b71b46434c8 # 04:05 60+ 0 Add linux-next specific files for 20140618


This script may reproduce the error.

-----------------------------------------------------------------------------
#!/bin/bash

kernel=$1
initrd=yocto-minimal-x86_64.cgz

wget --no-clobber https://github.com/fengguang/reproduce-kernel-bug/blob/master/initrd/$initrd

kvm=(
qemu-system-x86_64 -cpu kvm64 -enable-kvm
-kernel $kernel
-initrd $initrd
-smp 2
-m 256M
-net nic,vlan=0,macaddr=00:00:00:00:00:00,model=virtio
-net user,vlan=0
-net nic,vlan=1,model=e1000
-net user,vlan=1
-boot order=nc
-no-reboot
-watchdog i6300esb
-serial stdio
-display none
-monitor null
)

append=(
debug
sched_debug
apic=debug
ignore_loglevel
sysrq_always_enabled
panic=10
prompt_ramdisk=0
earlyprintk=ttyS0,115200
console=ttyS0,115200
console=tty0
vga=normal
root=/dev/ram0
rw
)

"${kvm[@]}" --append "${append[*]}"
-----------------------------------------------------------------------------

Thanks,
Jet


Attachments:
dmesg-yocto-ivb42-53:20140619030107:x86_64-randconfig-hsxa0-06190120:3.16.0-rc1-00045-g52774d9:1 (42.30 kB)
x86_64-randconfig-hsxa0-06190120-91283063c4f74fb202ac7809a8df3cc00f22203e-blocked-for-more-than-----seconds-23032.log (24.93 kB)
config-3.16.0-rc1-00045-g52774d9 (62.32 kB)
Attached Message Part (86.00 B)
Download all attachments