Hi all,
Today's tree will not build for powerpc allyesconfig, sparc(32) defconfig
and probably some other configurations. I just ran out of time trying to
fix all the errors. :-(
New trees:
iommu
watchdog
proc
Dropped trees:
tests (because its future is in doubt and it has conflicts)
hid (too many conflicts for me to fix today)
v4l-dvb (the tree is a mess)
sparseirq (too many conflicts for me to fix today)
scsi-post-merge (appears to be superceded)
bdev (too many conflicts for me to fix today)
The actual changes from Sept 19 are not really relevant at this point -
those interested can read the summary below or the actual merge log in
the tree.
I have also applied the following patches for known problems:
sparc: qlogicpti fallout from sbus removal
tip-core/powerpc: phys_addr_t has moved to linux/types.h
v9fs: don't export static functions
tpm: don't export static functions
mfd/wm8350: don't export static functions
----------------------------------------------------------------------------
I have created today's linux-next tree at
git://git.kernel.org/pub/scm/linux/kernel/git/sfr/linux-next.git
(patches at
http://www.kernel.org/pub/linux/kernel/people/sfr/linux-next/). If you
are tracking the linux-next tree using git, you should not use "git pull"
to do so as that will try to merge the new linux-next release with the
old one. You should use "git fetch" as mentioned in the FAQ on the wiki
(see below).
You can see which trees have been included by looking in the Next/Trees
file in the source. There are also quilt-import.log and merge.log files
in the Next directory. Between each merge, the tree was built with
a ppc64_defconfig for powerpc and an allmodconfig for x86_64. After the
final fixups, it is also built with powerpc allnoconfig,
44x_defconfig and allyesconfig and i386, sparc and sparc64 defconfig.
Below is a summary of the state of the merge.
We are up to 120 trees (counting Linus' and 14 trees of patches pending for
Linus' tree), more are welcome (even if they are currently empty).
Thanks to those who have contributed, and to those who haven't, please do.
Status of my local build tests will be at
http://kisskb.ellerman.id.au/linux-next . If maintainers want to give
advice about cross compilers/configs that work, we are always open to add
more builds.
Thanks to Jan Dittmer for adding the linux-next tree to his build tests
at http://l4x.org/k/ , the guys at http://test.kernel.org/ and Randy
Dunlap for doing many randconfig builds.
There is a wiki covering stuff to do with linux-next at
http://linux.f-seidel.de/linux-next/pmwiki/ . Thanks to Frank Seidel.
--
Cheers,
Stephen Rothwell [email protected]
$ git checkout master
$ git reset --hard stable
Merging origin/master
$ git cherry-pick c917a47312d1dcfadbb8d558fab121d4d6467d10
Created commit 5f21bf1: Revert "MIPS: DS1286: New RTC driver"
Created commit dbe292a: Revert "RTC: M48T35: new RTC driver"
Merging powerpc-merge/merge
Merging scsi-rc-fixes/master
Merging net-current/master
Merging sparc-current/master
Merging sound-current/for-linus
Merging arm-current/master
Merging pci-current/for-linus
Merging wireless-current/master
Merging kbuild-current/master
Merging quilt/driver-core.current
Merging quilt/usb.current
Merging cpufreq-current/fixes
Merging input-current/for-linus
Merging md-current/for-2.6.26
Merging dwmw2/master
Merging arm/devel
Merging avr32/avr32-arch
Merging blackfin/for-linus
Merging cris/for-next
Merging ia64/test
Merging quilt/m68k
Merging m68knommu/for-next
Merging mips/mips-for-linux-next
Merging parisc/master
CONFLICT (rename/delete): Renamed include/asm-parisc/a.out.h->arch/parisc/include/asm/a.out.h in parisc/master and deleted in HEAD
$ git rm -f arch/parisc/include/asm/a.out.h
Merging powerpc/next
Merging 4xx/next
Merging galak/powerpc-next
Merging pxa/for-next
Merging s390/features
Merging sh/master
Merging sparc/master
Merging x86/auto-x86-next
Merging xtensa/master
Merging quilt/driver-core
Merging quilt/usb
Created commit 12e0536: Revert "USB: ohci: add support for tmio-ohci cell"
Created commit e5065ec: Revert "USB: remove info() macro from usb.h"
Created commit 7ba38cf: Revert "USB: remove warn() macro from usb.h"
Merging tip-core/auto-core-next
CONFLICT (content): Merge conflict in arch/powerpc/include/asm/types.h
CONFLICT (content): Merge conflict in arch/powerpc/platforms/Kconfig.cputype
Merging cpus4096/auto-cpus4096-next
CONFLICT (content): Merge conflict in include/asm-x86/smp.h
Merging ftrace/auto-ftrace-next
CONFLICT (content): Merge conflict in init/main.c
CONFLICT (content): Merge conflict in kernel/module.c
CONFLICT (add/add): Merge conflict in scripts/bootgraph.pl
Merging genirq/auto-genirq-next
Merging safe-poison-pointers/auto-safe-poison-pointers-next
Merging sched/auto-sched-next
Merging stackprotector/auto-stackprotector-next
CONFLICT (content): Merge conflict in kernel/fork.c
Merging timers/auto-timers-next
Applying DECLARE_PER_CPU needs linux/percpu.h
Merging pci/linux-next
CONFLICT (content): Merge conflict in drivers/pci/pcie/aspm.c
Created commit ac06c0d: Revert "powerpc/PCI: Add legacy PCI access via sysfs"
Merging quilt/device-mapper
Merging hid/mm
CONFLICT (content): Merge conflict in drivers/hid/Kconfig
CONFLICT (content): Merge conflict in drivers/hid/Makefile
CONFLICT (content): Merge conflict in drivers/hid/hid-core.c
CONFLICT (add/add): Merge conflict in drivers/hid/hid-dell.c
CONFLICT (add/add): Merge conflict in drivers/hid/hid-dummy.c
CONFLICT (add/add): Merge conflict in drivers/hid/hid-ids.h
CONFLICT (content): Merge conflict in drivers/hid/usbhid/hid-core.c
CONFLICT (content): Merge conflict in include/linux/hid.h
$ git reset --hard
Merging quilt/i2c
Merging quilt/jdelvare-hwmon
Merging quilt/kernel-doc
Merging v4l-dvb/stable
CONFLICT (rename/add): Renamed arch/mips/au1000/mtx-1/init.c->arch/mips/pci/pci-bcm47xx.c in HEAD. arch/mips/pci/pci-bcm47xx.c added in v4l-dvb/stable
CONFLICT (content): Merge conflict in Documentation/usb/anchors.txt
CONFLICT (content): Merge conflict in Documentation/video4linux/CARDLIST.cx88
CONFLICT (content): Merge conflict in MAINTAINERS
CONFLICT (content): Merge conflict in arch/arm/include/asm/io.h
CONFLICT (content): Merge conflict in arch/arm/mach-omap1/mcbsp.c
CONFLICT (content): Merge conflict in arch/arm/mach-omap2/mcbsp.c
CONFLICT (content): Merge conflict in arch/arm/mach-versatile/core.c
CONFLICT (content): Merge conflict in arch/arm/plat-omap/devices.c
CONFLICT (content): Merge conflict in arch/arm/plat-omap/include/mach/mcbsp.h
CONFLICT (content): Merge conflict in arch/arm/plat-omap/mcbsp.c
CONFLICT (content): Merge conflict in arch/avr32/boards/atstk1000/atstk1002.c
CONFLICT (content): Merge conflict in arch/powerpc/include/asm/sections.h
CONFLICT (content): Merge conflict in arch/s390/lib/delay.c
CONFLICT (content): Merge conflict in arch/sparc64/kernel/pci_psycho.c
CONFLICT (content): Merge conflict in arch/x86/kernel/cpu/mtrr/main.c
CONFLICT (content): Merge conflict in arch/x86/kernel/process_32.c
CONFLICT (content): Merge conflict in arch/x86/kernel/process_64.c
CONFLICT (content): Merge conflict in arch/x86/kernel/setup.c
CONFLICT (content): Merge conflict in drivers/ata/pata_marvell.c
CONFLICT (content): Merge conflict in drivers/ide/ide-dma.c
CONFLICT (content): Merge conflict in drivers/ide/pci/hpt366.c
CONFLICT (content): Merge conflict in drivers/media/dvb/dvb-core/dvb_frontend.c
CONFLICT (content): Merge conflict in drivers/media/dvb/dvb-usb/Kconfig
CONFLICT (add/add): Merge conflict in drivers/media/dvb/dvb-usb/af9015.c
CONFLICT (content): Merge conflict in drivers/media/dvb/dvb-usb/dib0700_devices.c
CONFLICT (content): Merge conflict in drivers/media/dvb/dvb-usb/dvb-usb-ids.h
CONFLICT (content): Merge conflict in drivers/media/dvb/dvb-usb/dw2102.c
CONFLICT (add/add): Merge conflict in drivers/media/dvb/frontends/af9013.c
CONFLICT (add/add): Merge conflict in drivers/media/dvb/frontends/af9013_priv.h
CONFLICT (add/add): Merge conflict in drivers/media/dvb/frontends/cx24116.c
CONFLICT (add/add): Merge conflict in drivers/media/dvb/frontends/stb6000.c
CONFLICT (add/add): Merge conflict in drivers/media/dvb/frontends/stv0288.c
CONFLICT (add/add): Merge conflict in drivers/media/dvb/frontends/stv0288.h
CONFLICT (content): Merge conflict in drivers/media/video/cx88/cx88-cards.c
CONFLICT (content): Merge conflict in drivers/media/video/cx88/cx88-dvb.c
CONFLICT (content): Merge conflict in drivers/media/video/cx88/cx88.h
CONFLICT (content): Merge conflict in drivers/media/video/em28xx/em28xx-dvb.c
CONFLICT (content): Merge conflict in drivers/media/video/gspca/Kconfig
CONFLICT (content): Merge conflict in drivers/media/video/gspca/Makefile
CONFLICT (content): Merge conflict in drivers/media/video/gspca/gspca.c
CONFLICT (add/add): Merge conflict in drivers/media/video/gspca/m5602/m5602_bridge.h
CONFLICT (add/add): Merge conflict in drivers/media/video/gspca/m5602/m5602_core.c
CONFLICT (add/add): Merge conflict in drivers/media/video/gspca/m5602/m5602_mt9m111.c
CONFLICT (add/add): Merge conflict in drivers/media/video/gspca/m5602/m5602_mt9m111.h
CONFLICT (add/add): Merge conflict in drivers/media/video/gspca/m5602/m5602_ov9650.h
CONFLICT (add/add): Merge conflict in drivers/media/video/gspca/m5602/m5602_po1030.h
CONFLICT (add/add): Merge conflict in drivers/media/video/gspca/m5602/m5602_s5k4aa.h
CONFLICT (add/add): Merge conflict in drivers/media/video/gspca/m5602/m5602_s5k83a.c
CONFLICT (add/add): Merge conflict in drivers/media/video/gspca/m5602/m5602_s5k83a.h
CONFLICT (content): Merge conflict in drivers/media/video/gspca/sonixj.c
CONFLICT (content): Merge conflict in drivers/media/video/gspca/t613.c
CONFLICT (content): Merge conflict in drivers/media/video/ivtv/ivtv-ioctl.c
CONFLICT (content): Merge conflict in drivers/media/video/saa5249.c
CONFLICT (content): Merge conflict in drivers/media/video/v4l2-dev.c
CONFLICT (content): Merge conflict in drivers/media/video/zr364xx.c
CONFLICT (content): Merge conflict in drivers/memstick/core/mspro_block.c
CONFLICT (content): Merge conflict in drivers/mmc/host/atmel-mci.c
CONFLICT (content): Merge conflict in drivers/net/e1000e/ich8lan.c
CONFLICT (content): Merge conflict in drivers/net/wireless/ath9k/beacon.c
CONFLICT (content): Merge conflict in drivers/net/wireless/ath9k/core.h
CONFLICT (content): Merge conflict in drivers/net/wireless/ath9k/main.c
CONFLICT (content): Merge conflict in drivers/pci/intel-iommu.c
CONFLICT (content): Merge conflict in drivers/pci/pcie/aspm.c
CONFLICT (content): Merge conflict in drivers/pci/probe.c
CONFLICT (content): Merge conflict in drivers/pcmcia/ds.c
CONFLICT (content): Merge conflict in drivers/s390/scsi/zfcp_fc.c
CONFLICT (content): Merge conflict in drivers/s390/scsi/zfcp_fsf.c
CONFLICT (content): Merge conflict in drivers/s390/scsi/zfcp_qdio.c
CONFLICT (content): Merge conflict in drivers/usb/serial/option.c
CONFLICT (content): Merge conflict in fs/xfs/linux-2.6/xfs_super.c
CONFLICT (content): Merge conflict in fs/xfs/xfs_log.c
CONFLICT (delete/modify): include/asm-parisc/sections.h deleted in HEAD and modified in v4l-dvb/stable. Version v4l-dvb/stable of include/asm-parisc/sections.h left in tree.
CONFLICT (content): Merge conflict in include/asm-x86/cpufeature.h
CONFLICT (content): Merge conflict in include/asm-x86/idle.h
CONFLICT (content): Merge conflict in include/linux/dvb/frontend.h
CONFLICT (content): Merge conflict in include/linux/ide.h
CONFLICT (content): Merge conflict in include/media/ir-common.h
CONFLICT (content): Merge conflict in include/media/v4l2-dev.h
CONFLICT (content): Merge conflict in init/main.c
CONFLICT (content): Merge conflict in kernel/hrtimer.c
CONFLICT (content): Merge conflict in kernel/sched.c
CONFLICT (content): Merge conflict in lib/swiotlb.c
CONFLICT (content): Merge conflict in net/core/dev.c
CONFLICT (content): Merge conflict in net/ipv6/tcp_ipv6.c
CONFLICT (content): Merge conflict in net/key/af_key.c
CONFLICT (content): Merge conflict in net/netfilter/nf_conntrack_proto_gre.c
CONFLICT (content): Merge conflict in net/sctp/sm_statefuns.c
CONFLICT (content): Merge conflict in net/xfrm/xfrm_policy.c
CONFLICT (content): Merge conflict in net/xfrm/xfrm_state.c
$ git reset --hard
Merging jfs/next
Merging kbuild/master
Merging quilt/ide
Merging libata/NEXT
Merging nfs/linux-next
Merging xfs/master
Merging infiniband/for-next
Merging acpi/test
CONFLICT (content): Merge conflict in MAINTAINERS
CONFLICT (content): Merge conflict in drivers/acpi/Kconfig
CONFLICT (content): Merge conflict in drivers/acpi/scan.c
CONFLICT (content): Merge conflict in drivers/pnp/Makefile
Applying drivers has no idle subdirectory
Applying acpi: acpi_os_hotplug_execute needs to be exported
Merging nfsd/nfsd-next
Merging ieee1394/for-next
Merging ubi/linux-next
Merging kvm/master
CONFLICT (content): Merge conflict in arch/x86/kvm/i8254.c
Merging dlm/next
Merging scsi/master
Merging ocfs2/linux-next
Merging ext4/next
Merging async_tx/next
Merging udf/for_next
Merging net/master
Merging mtd/master
Merging wireless/master
Merging crypto/master
Merging vfs/for-next
CONFLICT (content): Merge conflict in fs/ext4/namei.c
Applying vfs: fix up merge of ext4
Merging sound/for-next
Merging cpufreq/next
Merging v9fs/for-next
Merging quilt/rr
CONFLICT (content): Merge conflict in kernel/module.c
Merging cifs/master
Merging mmc/next
Merging gfs2/master
Merging input/next
CONFLICT (content): Merge conflict in Documentation/kernel-parameters.txt
Merging semaphore/semaphore
Merging semaphore-removal/semaphore-removal
CONFLICT (content): Merge conflict in net/9p/trans_virtio.c
Merging bkl-removal/bkl-removal
Merging trivial/next
CONFLICT (content): Merge conflict in Documentation/edac.txt
CONFLICT (content): Merge conflict in include/linux/securebits.h
Merging ubifs/linux-next
Merging lsm/for-next
Merging block/for-next
CONFLICT (content): Merge conflict in include/linux/interrupt.h
CONFLICT (content): Merge conflict in kernel/softirq.c
Merging embedded/master
Merging firmware/master
CONFLICT (content): Merge conflict in drivers/scsi/qlogicpti.c
CONFLICT (content): Merge conflict in firmware/WHENCE
Merging pcmcia/master
Merging battery/master
CONFLICT (content): Merge conflict in drivers/power/Makefile
Merging leds/for-mm
Merging backlight/for-mm
Merging kgdb/kgdb-next
Merging slab/for-next
Merging uclinux/for-next
Merging md/for-next
CONFLICT (content): Merge conflict in drivers/md/md.c
Applying Fix do_mounts_md use of msleep
Merging kmemcheck/auto-kmemcheck-next
CONFLICT (content): Merge conflict in MAINTAINERS
CONFLICT (content): Merge conflict in init/main.c
CONFLICT (content): Merge conflict in mm/Makefile
CONFLICT (content): Merge conflict in mm/slab.c
CONFLICT (content): Merge conflict in mm/slub.c
Merging generic-ipi/auto-generic-ipi-next
Merging mfd/for-next
Merging hdlc/hdlc-next
Merging drm/drm-next
Merging voltage/for-linus
Merging security-testing/next
Merging lblnet/master
Merging quilt/ttydev
Merging agp/agp-next
Merging creds/next-creds-subsys
CONFLICT (content): Merge conflict in fs/namespace.c
CONFLICT (content): Merge conflict in fs/nfsd/nfs4recover.c
CONFLICT (content): Merge conflict in include/linux/sched.h
CONFLICT (content): Merge conflict in kernel/exit.c
CONFLICT (content): Merge conflict in kernel/fork.c
CONFLICT (content): Merge conflict in kernel/signal.c
CONFLICT (content): Merge conflict in net/9p/client.c
CONFLICT (content): Merge conflict in security/selinux/hooks.c
Merging oprofile/auto-oprofile-next
Merging fastboot/auto-fastboot-next
CONFLICT (content): Merge conflict in drivers/md/Kconfig
CONFLICT (content): Merge conflict in include/linux/init.h
CONFLICT (content): Merge conflict in init/main.c
CONFLICT (add/add): Merge conflict in scripts/bootgraph.pl
Merging sparseirq/auto-sparseirq-next
CONFLICT (content): merge conflict in arch/x86/kernel/traps.c
CONFLICT (delete/modify): arch/x86/kernel/apic_64.c deleted in sparseirq/auto-sparseirq-next and modified in HEAD. Version HEAD of arch/x86/kernel/apic_64.c left in tree.
CONFLICT (content): Merge conflict in arch/x86/kernel/cpu/common.c
CONFLICT (add/add): Merge conflict in arch/x86/kernel/dumpstack_32.c
CONFLICT (add/add): Merge conflict in arch/x86/kernel/dumpstack_64.c
CONFLICT (content): Merge conflict in arch/x86/kernel/process_32.c
CONFLICT (content): Merge conflict in arch/x86/kernel/process_64.c
CONFLICT (content): Merge conflict in arch/x86/kernel/smpboot.c
CONFLICT (content): Merge conflict in arch/x86/mm/ioremap.c
CONFLICT (content): Merge conflict in arch/x86/oprofile/nmi_int.c
CONFLICT (content): Merge conflict in drivers/serial/8250.c
CONFLICT (content): Merge conflict in include/asm-x86/fixmap_64.h
CONFLICT (content): Merge conflict in include/asm-x86/pgtable.h
CONFLICT (content): Merge conflict in include/linux/pci_ids.h
CONFLICT (content): Merge conflict in kernel/irq/chip.c
$ git reset --hard
Merging iommu/auto-iommu-next
Merging uwb/for-upstream
CONFLICT (content): Merge conflict in Documentation/ABI/testing/sysfs-bus-usb
Merging watchdog/master
Merging proc/proc
Applying sparc: qlogicpti fallout from sbus removal
Applying tip-core/powerpc: phys_addr_t has moved to linux/types.h
Applying v9fs: don't export static functions
Applying tpm: don't export static functions
Applying mfd/wm8350: don't export static functions
On Thu, 16 Oct 2008 21:18:11 +1100 Stephen Rothwell <[email protected]> wrote:
>
> New trees:
> iommu
> watchdog
> proc
uwb
--
Cheers,
Stephen Rothwell [email protected]
http://www.canb.auug.org.au/~sfr/
Hi Stephen,
next-20081016 kernel build fails on powerpc, with build error
drivers/net/ibm_newemac/mal.c: In function 'mal_txeob':
drivers/net/ibm_newemac/mal.c:284: error: implicit declaration of function 'mtdcri'
drivers/net/ibm_newemac/mal.c:284: error: 'SDR0' undeclared (first use in this function)
drivers/net/ibm_newemac/mal.c:284: error: (Each undeclared identifier is reported only once
drivers/net/ibm_newemac/mal.c:284: error: for each function it appears in.)
drivers/net/ibm_newemac/mal.c:285: error: implicit declaration of function 'mfdcri'
drivers/net/ibm_newemac/mal.c: In function 'mal_rxeob':
drivers/net/ibm_newemac/mal.c:302: error: 'SDR0' undeclared (first use in this function)
make[3]: *** [drivers/net/ibm_newemac/mal.o] Error 1
Signed-off-by: Kamalesh Babulal <[email protected]>
---
drivers/net/ibm_newemac/mal.c | 1 +
1 files changed, 1 insertions(+), 0 deletions(-)
diff --git a/drivers/net/ibm_newemac/mal.c b/drivers/net/ibm_newemac/mal.c
index 1839d3f..c5f91a6 100644
--- a/drivers/net/ibm_newemac/mal.c
+++ b/drivers/net/ibm_newemac/mal.c
@@ -29,6 +29,7 @@
#include "core.h"
#include <asm/dcr-regs.h>
+#include <asm/dcr-native.h>
static int mal_count;
--
Thanks & Regards,
Kamalesh Babulal,
Linux Technology Center,
IBM, ISTL.
On Fri, 17 Oct 2008 00:53:20 +0530
Kamalesh Babulal <[email protected]> wrote:
> Hi Stephen,
>
> next-20081016 kernel build fails on powerpc, with build error
>
> drivers/net/ibm_newemac/mal.c: In function 'mal_txeob':
> drivers/net/ibm_newemac/mal.c:284: error: implicit declaration of function 'mtdcri'
> drivers/net/ibm_newemac/mal.c:284: error: 'SDR0' undeclared (first use in this function)
> drivers/net/ibm_newemac/mal.c:284: error: (Each undeclared identifier is reported only once
> drivers/net/ibm_newemac/mal.c:284: error: for each function it appears in.)
> drivers/net/ibm_newemac/mal.c:285: error: implicit declaration of function 'mfdcri'
> drivers/net/ibm_newemac/mal.c: In function 'mal_rxeob':
> drivers/net/ibm_newemac/mal.c:302: error: 'SDR0' undeclared (first use in this function)
> make[3]: *** [drivers/net/ibm_newemac/mal.o] Error 1
>
> Signed-off-by: Kamalesh Babulal <[email protected]>
I sent a more complete fix earlier today.
http://patchwork.ozlabs.org/patch/4708/
josh
* Josh Boyer <[email protected]> [2008-10-16 15:27:55]:
> On Fri, 17 Oct 2008 00:53:20 +0530
> Kamalesh Babulal <[email protected]> wrote:
>
> > Hi Stephen,
> >
> > next-20081016 kernel build fails on powerpc, with build error
> >
> > drivers/net/ibm_newemac/mal.c: In function 'mal_txeob':
> > drivers/net/ibm_newemac/mal.c:284: error: implicit declaration of function 'mtdcri'
> > drivers/net/ibm_newemac/mal.c:284: error: 'SDR0' undeclared (first use in this function)
> > drivers/net/ibm_newemac/mal.c:284: error: (Each undeclared identifier is reported only once
> > drivers/net/ibm_newemac/mal.c:284: error: for each function it appears in.)
> > drivers/net/ibm_newemac/mal.c:285: error: implicit declaration of function 'mfdcri'
> > drivers/net/ibm_newemac/mal.c: In function 'mal_rxeob':
> > drivers/net/ibm_newemac/mal.c:302: error: 'SDR0' undeclared (first use in this function)
> > make[3]: *** [drivers/net/ibm_newemac/mal.o] Error 1
> >
> > Signed-off-by: Kamalesh Babulal <[email protected]>
>
> I sent a more complete fix earlier today.
>
> http://patchwork.ozlabs.org/patch/4708/
>
> josh
Hi Josh,
Thanks, I missed your earlier posting today. The patch fixes the build failure
for me.
Tested-by: Kamalesh Babulal <[email protected]>
--
Thanks & Regards,
Kamalesh Babulal,
Linux Technology Center,
IBM, ISTL.
Hi Stephen,
with the next-20081016 kernel, softlockup is detected while creating ext2
filesystem.
BUG: soft lockup - CPU#3 stuck for 61s! [mkfs.ext2:3399]
Modules linked in: nfsd lockd nfs_acl auth_rpcgss exportfs autofs4 hidp rfcomm l2cap bluetooth sunrpc ipv6 acpi_cpufreq dm_mirror dm_log dm_mod video output rfkill input_polldev sbs sbshc battery acpi_memhotplug ac parport_pc lp parport sg floppy ide_cd_mod tg3 cdrom libphy serio_raw button i2c_i801 e752x_edac edac_core shpchp i2c_core pcspkr aic79xx scsi_transport_spi sd_mod scsi_mod ext3 jbd ehci_hcd ohci_hcd uhci_hcd [last unloaded: microcode]
Modules linked in: nfsd lockd nfs_acl auth_rpcgss exportfs autofs4 hidp rfcomm l2cap bluetooth sunrpc ipv6 acpi_cpufreq dm_mirror dm_log dm_mod video output rfkill input_polldev sbs sbshc battery acpi_memhotplug ac parport_pc lp parport sg floppy ide_cd_mod tg3 cdrom libphy serio_raw button i2c_i801 e752x_edac edac_core shpchp i2c_core pcspkr aic79xx scsi_transport_spi sd_mod scsi_mod ext3 jbd ehci_hcd ohci_hcd uhci_hcd [last unloaded: microcode]
Call Trace:
<IRQ> [<ffffffff80319770>] blk_invoke_request_fn+0x69/0x109
[<ffffffffa006ffe3>] scsi_run_queue+0x2b5/0x2ba [scsi_mod]
[<ffffffffa00706db>] scsi_next_command+0x2d/0x39 [scsi_mod]
[<ffffffffa007090f>] scsi_end_request+0x86/0x97 [scsi_mod]
[<ffffffffa0071659>] scsi_io_completion+0x1b6/0x3cd [scsi_mod]
[<ffffffff8031d589>] blk_done_softirq+0x5c/0x6b
[<ffffffff8023cb50>] __do_softirq+0x7a/0x13d
[<ffffffff8021f9bd>] ack_apic_level+0x58/0xdc
[<ffffffff8020d09c>] call_softirq+0x1c/0x28
[<ffffffff8020decd>] do_softirq+0x2c/0x68
[<ffffffff8020e1f1>] do_IRQ+0x145/0x168
[<ffffffff8020c356>] ret_from_intr+0x0/0xa
<EOI> [<ffffffff80261cd5>] audit_syscall_entry+0xb6/0x160
[<ffffffff8020be94>] auditsys+0x19/0x4a
.
.
<above call trace was printed 8 times>
.
INFO: task kjournald:578 blocked for more than 480 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
ffff8801e50e1d30 0000000000000046 ffff8801e50e1cf8 ffffffff8031833d
ffff8801e5058c58 ffff8801e7360100 ffff8801e70f3470 ffff8801e7360458
00000001e596c500 00000000fffd66c8 ffffffffffffffff ffffffffffffffff
Call Trace:
[<ffffffff8031833d>] elv_next_request+0x155/0x220
[<ffffffff802b26ab>] sync_buffer+0x0/0x3f
[<ffffffff8048f5ee>] io_schedule+0x5d/0x9f
[<ffffffff802b26e6>] sync_buffer+0x3b/0x3f
[<ffffffff8048f849>] __wait_on_bit+0x40/0x6f
[<ffffffff802b26ab>] sync_buffer+0x0/0x3f
[<ffffffff8048f8e4>] out_of_line_wait_on_bit+0x6c/0x78
[<ffffffff80249620>] wake_bit_function+0x0/0x23
[<ffffffffa003125c>] journal_commit_transaction+0x7e4/0xc64 [jbd]
[<ffffffff80240857>] lock_timer_base+0x26/0x4c
[<ffffffffa0033c97>] kjournald+0xc1/0x1fb [jbd]
[<ffffffff802495f2>] autoremove_wake_function+0x0/0x2e
[<ffffffffa0033bd6>] kjournald+0x0/0x1fb [jbd]
[<ffffffff802494c4>] kthread+0x47/0x73
[<ffffffff80234192>] schedule_tail+0x27/0x6e
[<ffffffff8020cd39>] child_rip+0xa/0x11
[<ffffffff8024947d>] kthread+0x0/0x73
[<ffffffff8020cd2f>] child_rip+0x0/0x11
INFO: task syslogd:2650 blocked for more than 480 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
ffff8801e1587da8 0000000000000082 0000000000000000 0000000000000000
00000000003fbfc4 ffff8801e3926fe0 ffff8801e38c6f60 ffff8801e3927338
0000000100000000 ffff8801e59444c0 0000000000000000 0000000000000001
Call Trace:
[<ffffffffa0033577>] log_wait_commit+0x9f/0xed [jbd]
[<ffffffff802495f2>] autoremove_wake_function+0x0/0x2e
[<ffffffffa002f4f9>] journal_stop+0x165/0x18d [jbd]
[<ffffffff802adf7b>] __writeback_single_inode+0x17f/0x282
[<ffffffff802948d9>] do_readv_writev+0x176/0x18b
[<ffffffff802ae867>] sync_inode+0x24/0x31
[<ffffffffa00463ba>] ext3_sync_file+0x9e/0xb0 [ext3]
[<ffffffff802b0c92>] do_fsync+0x52/0xa4
[<ffffffff802b0d07>] __do_fsync+0x23/0x36
[<ffffffff8020bddb>] system_call_fastpath+0x16/0x1b
INFO: task lamb-payload:3400 blocked for more than 480 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
ffff8801b186daa8 0000000000000082 ffff8801b186da70 0000000000000000
0000000000000000 ffff8801e3834ee0 ffffffff805ad360 ffff8801e3835238
0000000000000000 00000000fffd50dd ffffffffffffffff ffffffffffffffff
Call Trace:
[<ffffffffa002f6fd>] do_get_write_access+0x1dc/0x3c3 [jbd]
[<ffffffff80249620>] wake_bit_function+0x0/0x23
[<ffffffff802b1e79>] __getblk+0x25/0x211
[<ffffffffa002f906>] journal_get_write_access+0x22/0x33 [jbd]
[<ffffffffa0053fa9>] __ext3_journal_get_write_access+0x1e/0x47 [ext3]
[<ffffffffa0047bf7>] ext3_reserve_inode_write+0x3d/0x76 [ext3]
[<ffffffffa0047c51>] ext3_mark_inode_dirty+0x21/0x3c [ext3]
[<ffffffffa004a74c>] ext3_dirty_inode+0x63/0x7b [ext3]
[<ffffffff802ae65f>] __mark_inode_dirty+0x29/0x16b
[<ffffffff802a55db>] touch_atime+0x109/0x112
[<ffffffff8026cba6>] generic_file_aio_read+0x4b8/0x515
[<ffffffff8029442c>] do_sync_read+0xc9/0x10c
[<ffffffff802495f2>] autoremove_wake_function+0x0/0x2e
[<ffffffff8027cf56>] __vma_link+0x42/0x4b
[<ffffffff8032a3d4>] __up_write+0x27/0xf3
[<ffffffff80294b4f>] vfs_read+0xaa/0x133
[<ffffffff80297f65>] kernel_read+0x38/0x4e
[<ffffffff802990a1>] do_execve+0x121/0x256
[<ffffffff8020a495>] sys_execve+0x35/0x4c
[<ffffffff8020c1fa>] stub_execve+0x6a/0xc0
INFO: task crond:3055 blocked for more than 480 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
ffff8801d8197d08 0000000000000086 ffff8801d8197cd0 ffff8801da800700
ffff8801da810a40 ffff8801e68481c0 ffff8801e70f3470 ffff8801e6848518
00000001da8aeaf0 00000000fffdf3b6 ffffffffffffffff ffffffffffffffff
Call Trace:
[<ffffffffa002f6fd>] do_get_write_access+0x1dc/0x3c3 [jbd]
[<ffffffff80249620>] wake_bit_function+0x0/0x23
[<ffffffff802b1e79>] __getblk+0x25/0x211
[<ffffffff802a014c>] filldir+0x0/0xb1
[<ffffffffa002f906>] journal_get_write_access+0x22/0x33 [jbd]
[<ffffffffa0053fa9>] __ext3_journal_get_write_access+0x1e/0x47 [ext3]
[<ffffffffa0047bf7>] ext3_reserve_inode_write+0x3d/0x76 [ext3]
[<ffffffffa0047c51>] ext3_mark_inode_dirty+0x21/0x3c [ext3]
[<ffffffffa004a74c>] ext3_dirty_inode+0x63/0x7b [ext3]
[<ffffffff802ae65f>] __mark_inode_dirty+0x29/0x16b
[<ffffffff802a014c>] filldir+0x0/0xb1
[<ffffffff802a55db>] touch_atime+0x109/0x112
[<ffffffff802a0287>] vfs_readdir+0x8a/0xa7
[<ffffffff802a04f1>] sys_getdents+0x75/0xc4
[<ffffffff8020bddb>] system_call_fastpath+0x16/0x1b
BUG: soft lockup - CPU#3 stuck for 61s! [mkfs.ext2:3399]
Modules linked in: nfsd lockd nfs_acl auth_rpcgss exportfs autofs4 hidp rfcomm l2cap bluetooth sunrpc ipv6 acpi_cpufreq dm_mirror dm_log dm_mod video output rfkill input_polldev sbs sbshc battery acpi_memhotplug ac parport_pc lp parport sg floppy ide_cd_mod tg3 cdrom libphy serio_raw button i2c_i801 e752x_edac edac_core shpchp i2c_core pcspkr aic79xx scsi_transport_spi sd_mod scsi_mod ext3 jbd ehci_hcd ohci_hcd uhci_hcd [last unloaded: microcode]
Modules linked in: nfsd lockd nfs_acl auth_rpcgss exportfs autofs4 hidp rfcomm l2cap bluetooth sunrpc ipv6 acpi_cpufreq dm_mirror dm_log dm_mod video output rfkill input_polldev sbs sbshc battery acpi_memhotplug ac parport_pc lp parport sg floppy ide_cd_mod tg3 cdrom libphy serio_raw button i2c_i801 e752x_edac edac_core shpchp i2c_core pcspkr aic79xx scsi_transport_spi sd_mod scsi_mod ext3 jbd ehci_hcd ohci_hcd uhci_hcd [last unloaded: microcode]
Call Trace:
<IRQ> [<ffffffff80319770>] blk_invoke_request_fn+0x69/0x109
[<ffffffffa006ffe3>] scsi_run_queue+0x2b5/0x2ba [scsi_mod]
[<ffffffffa00706db>] scsi_next_command+0x2d/0x39 [scsi_mod]
[<ffffffffa007090f>] scsi_end_request+0x86/0x97 [scsi_mod]
[<ffffffffa0071659>] scsi_io_completion+0x1b6/0x3cd [scsi_mod]
[<ffffffff8031d589>] blk_done_softirq+0x5c/0x6b
[<ffffffff8023cb50>] __do_softirq+0x7a/0x13d
[<ffffffff8021f9bd>] ack_apic_level+0x58/0xdc
[<ffffffff8020d09c>] call_softirq+0x1c/0x28
[<ffffffff8020decd>] do_softirq+0x2c/0x68
[<ffffffff8020e1f1>] do_IRQ+0x145/0x168
[<ffffffff8020c356>] ret_from_intr+0x0/0xa
<EOI> [<ffffffff80261cd5>] audit_syscall_entry+0xb6/0x160
[<ffffffff8020be94>] auditsys+0x19/0x4a
.
.
<snip>
0xffffffff80319770 is in blk_invoke_request_fn (include/linux/blkdev.h:456).
451 #define QUEUE_FLAG_NONROT 14 /* non-rotational device (SSD) */
452
453 static inline int queue_is_locked(struct request_queue *q)
454 {
455 #ifdef CONFIG_SMP
456 spinlock_t *lock = q->queue_lock;
457 return lock && spin_is_locked(lock);
458 #else
459 return 1;
460 #endif
0x4fe3 is in scsi_run_queue (drivers/scsi/scsi_lib.c:604).
599 flagset = test_bit(QUEUE_FLAG_REENTER, &q->queue_flags) &&
600 !test_bit(QUEUE_FLAG_REENTER,
601 &sdev->request_queue->queue_flags);
602 if (flagset)
603 queue_flag_set(QUEUE_FLAG_REENTER, sdev->request_queue);
604 __blk_run_queue(sdev->request_queue);
605 if (flagset)
606 queue_flag_clear(QUEUE_FLAG_REENTER, sdev->request_queue);
607 spin_unlock(sdev->request_queue->queue_lock);
608
--
Thanks & Regards,
Kamalesh Babulal,
Linux Technology Center,
IBM, ISTL.
On Fri, Oct 17 2008, Kamalesh Babulal wrote:
> Hi Stephen,
>
> with the next-20081016 kernel, softlockup is detected while creating ext2
> filesystem.
>
> BUG: soft lockup - CPU#3 stuck for 61s! [mkfs.ext2:3399]
> Modules linked in: nfsd lockd nfs_acl auth_rpcgss exportfs autofs4 hidp rfcomm l2cap bluetooth sunrpc ipv6 acpi_cpufreq dm_mirror dm_log dm_mod video output rfkill input_polldev sbs sbshc battery acpi_memhotplug ac parport_pc lp parport sg floppy ide_cd_mod tg3 cdrom libphy serio_raw button i2c_i801 e752x_edac edac_core shpchp i2c_core pcspkr aic79xx scsi_transport_spi sd_mod scsi_mod ext3 jbd ehci_hcd ohci_hcd uhci_hcd [last unloaded: microcode]
> Modules linked in: nfsd lockd nfs_acl auth_rpcgss exportfs autofs4 hidp rfcomm l2cap bluetooth sunrpc ipv6 acpi_cpufreq dm_mirror dm_log dm_mod video output rfkill input_polldev sbs sbshc battery acpi_memhotplug ac parport_pc lp parport sg floppy ide_cd_mod tg3 cdrom libphy serio_raw button i2c_i801 e752x_edac edac_core shpchp i2c_core pcspkr aic79xx scsi_transport_spi sd_mod scsi_mod ext3 jbd ehci_hcd ohci_hcd uhci_hcd [last unloaded: microcode]
> Call Trace:
> <IRQ> [<ffffffff80319770>] blk_invoke_request_fn+0x69/0x109
> [<ffffffffa006ffe3>] scsi_run_queue+0x2b5/0x2ba [scsi_mod]
> [<ffffffffa00706db>] scsi_next_command+0x2d/0x39 [scsi_mod]
> [<ffffffffa007090f>] scsi_end_request+0x86/0x97 [scsi_mod]
> [<ffffffffa0071659>] scsi_io_completion+0x1b6/0x3cd [scsi_mod]
> [<ffffffff8031d589>] blk_done_softirq+0x5c/0x6b
> [<ffffffff8023cb50>] __do_softirq+0x7a/0x13d
> [<ffffffff8021f9bd>] ack_apic_level+0x58/0xdc
> [<ffffffff8020d09c>] call_softirq+0x1c/0x28
> [<ffffffff8020decd>] do_softirq+0x2c/0x68
> [<ffffffff8020e1f1>] do_IRQ+0x145/0x168
> [<ffffffff8020c356>] ret_from_intr+0x0/0xa
> <EOI> [<ffffffff80261cd5>] audit_syscall_entry+0xb6/0x160
> [<ffffffff8020be94>] auditsys+0x19/0x4a
> ..
> ..
> <above call trace was printed 8 times>
> ..
> INFO: task kjournald:578 blocked for more than 480 seconds.
> "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
> ffff8801e50e1d30 0000000000000046 ffff8801e50e1cf8 ffffffff8031833d
> ffff8801e5058c58 ffff8801e7360100 ffff8801e70f3470 ffff8801e7360458
> 00000001e596c500 00000000fffd66c8 ffffffffffffffff ffffffffffffffff
> Call Trace:
> [<ffffffff8031833d>] elv_next_request+0x155/0x220
> [<ffffffff802b26ab>] sync_buffer+0x0/0x3f
> [<ffffffff8048f5ee>] io_schedule+0x5d/0x9f
> [<ffffffff802b26e6>] sync_buffer+0x3b/0x3f
> [<ffffffff8048f849>] __wait_on_bit+0x40/0x6f
> [<ffffffff802b26ab>] sync_buffer+0x0/0x3f
> [<ffffffff8048f8e4>] out_of_line_wait_on_bit+0x6c/0x78
> [<ffffffff80249620>] wake_bit_function+0x0/0x23
> [<ffffffffa003125c>] journal_commit_transaction+0x7e4/0xc64 [jbd]
> [<ffffffff80240857>] lock_timer_base+0x26/0x4c
> [<ffffffffa0033c97>] kjournald+0xc1/0x1fb [jbd]
> [<ffffffff802495f2>] autoremove_wake_function+0x0/0x2e
> [<ffffffffa0033bd6>] kjournald+0x0/0x1fb [jbd]
> [<ffffffff802494c4>] kthread+0x47/0x73
> [<ffffffff80234192>] schedule_tail+0x27/0x6e
> [<ffffffff8020cd39>] child_rip+0xa/0x11
> [<ffffffff8024947d>] kthread+0x0/0x73
> [<ffffffff8020cd2f>] child_rip+0x0/0x11
> INFO: task syslogd:2650 blocked for more than 480 seconds.
> "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
> ffff8801e1587da8 0000000000000082 0000000000000000 0000000000000000
> 00000000003fbfc4 ffff8801e3926fe0 ffff8801e38c6f60 ffff8801e3927338
> 0000000100000000 ffff8801e59444c0 0000000000000000 0000000000000001
> Call Trace:
> [<ffffffffa0033577>] log_wait_commit+0x9f/0xed [jbd]
> [<ffffffff802495f2>] autoremove_wake_function+0x0/0x2e
> [<ffffffffa002f4f9>] journal_stop+0x165/0x18d [jbd]
> [<ffffffff802adf7b>] __writeback_single_inode+0x17f/0x282
> [<ffffffff802948d9>] do_readv_writev+0x176/0x18b
> [<ffffffff802ae867>] sync_inode+0x24/0x31
> [<ffffffffa00463ba>] ext3_sync_file+0x9e/0xb0 [ext3]
> [<ffffffff802b0c92>] do_fsync+0x52/0xa4
> [<ffffffff802b0d07>] __do_fsync+0x23/0x36
> [<ffffffff8020bddb>] system_call_fastpath+0x16/0x1b
> INFO: task lamb-payload:3400 blocked for more than 480 seconds.
> "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
> ffff8801b186daa8 0000000000000082 ffff8801b186da70 0000000000000000
> 0000000000000000 ffff8801e3834ee0 ffffffff805ad360 ffff8801e3835238
> 0000000000000000 00000000fffd50dd ffffffffffffffff ffffffffffffffff
> Call Trace:
> [<ffffffffa002f6fd>] do_get_write_access+0x1dc/0x3c3 [jbd]
> [<ffffffff80249620>] wake_bit_function+0x0/0x23
> [<ffffffff802b1e79>] __getblk+0x25/0x211
> [<ffffffffa002f906>] journal_get_write_access+0x22/0x33 [jbd]
> [<ffffffffa0053fa9>] __ext3_journal_get_write_access+0x1e/0x47 [ext3]
> [<ffffffffa0047bf7>] ext3_reserve_inode_write+0x3d/0x76 [ext3]
> [<ffffffffa0047c51>] ext3_mark_inode_dirty+0x21/0x3c [ext3]
> [<ffffffffa004a74c>] ext3_dirty_inode+0x63/0x7b [ext3]
> [<ffffffff802ae65f>] __mark_inode_dirty+0x29/0x16b
> [<ffffffff802a55db>] touch_atime+0x109/0x112
> [<ffffffff8026cba6>] generic_file_aio_read+0x4b8/0x515
> [<ffffffff8029442c>] do_sync_read+0xc9/0x10c
> [<ffffffff802495f2>] autoremove_wake_function+0x0/0x2e
> [<ffffffff8027cf56>] __vma_link+0x42/0x4b
> [<ffffffff8032a3d4>] __up_write+0x27/0xf3
> [<ffffffff80294b4f>] vfs_read+0xaa/0x133
> [<ffffffff80297f65>] kernel_read+0x38/0x4e
> [<ffffffff802990a1>] do_execve+0x121/0x256
> [<ffffffff8020a495>] sys_execve+0x35/0x4c
> [<ffffffff8020c1fa>] stub_execve+0x6a/0xc0
> INFO: task crond:3055 blocked for more than 480 seconds.
> "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
> ffff8801d8197d08 0000000000000086 ffff8801d8197cd0 ffff8801da800700
> ffff8801da810a40 ffff8801e68481c0 ffff8801e70f3470 ffff8801e6848518
> 00000001da8aeaf0 00000000fffdf3b6 ffffffffffffffff ffffffffffffffff
> Call Trace:
> [<ffffffffa002f6fd>] do_get_write_access+0x1dc/0x3c3 [jbd]
> [<ffffffff80249620>] wake_bit_function+0x0/0x23
> [<ffffffff802b1e79>] __getblk+0x25/0x211
> [<ffffffff802a014c>] filldir+0x0/0xb1
> [<ffffffffa002f906>] journal_get_write_access+0x22/0x33 [jbd]
> [<ffffffffa0053fa9>] __ext3_journal_get_write_access+0x1e/0x47 [ext3]
> [<ffffffffa0047bf7>] ext3_reserve_inode_write+0x3d/0x76 [ext3]
> [<ffffffffa0047c51>] ext3_mark_inode_dirty+0x21/0x3c [ext3]
> [<ffffffffa004a74c>] ext3_dirty_inode+0x63/0x7b [ext3]
> [<ffffffff802ae65f>] __mark_inode_dirty+0x29/0x16b
> [<ffffffff802a014c>] filldir+0x0/0xb1
> [<ffffffff802a55db>] touch_atime+0x109/0x112
> [<ffffffff802a0287>] vfs_readdir+0x8a/0xa7
> [<ffffffff802a04f1>] sys_getdents+0x75/0xc4
> [<ffffffff8020bddb>] system_call_fastpath+0x16/0x1b
> BUG: soft lockup - CPU#3 stuck for 61s! [mkfs.ext2:3399]
> Modules linked in: nfsd lockd nfs_acl auth_rpcgss exportfs autofs4 hidp rfcomm l2cap bluetooth sunrpc ipv6 acpi_cpufreq dm_mirror dm_log dm_mod video output rfkill input_polldev sbs sbshc battery acpi_memhotplug ac parport_pc lp parport sg floppy ide_cd_mod tg3 cdrom libphy serio_raw button i2c_i801 e752x_edac edac_core shpchp i2c_core pcspkr aic79xx scsi_transport_spi sd_mod scsi_mod ext3 jbd ehci_hcd ohci_hcd uhci_hcd [last unloaded: microcode]
> Modules linked in: nfsd lockd nfs_acl auth_rpcgss exportfs autofs4 hidp rfcomm l2cap bluetooth sunrpc ipv6 acpi_cpufreq dm_mirror dm_log dm_mod video output rfkill input_polldev sbs sbshc battery acpi_memhotplug ac parport_pc lp parport sg floppy ide_cd_mod tg3 cdrom libphy serio_raw button i2c_i801 e752x_edac edac_core shpchp i2c_core pcspkr aic79xx scsi_transport_spi sd_mod scsi_mod ext3 jbd ehci_hcd ohci_hcd uhci_hcd [last unloaded: microcode]
> Call Trace:
> <IRQ> [<ffffffff80319770>] blk_invoke_request_fn+0x69/0x109
> [<ffffffffa006ffe3>] scsi_run_queue+0x2b5/0x2ba [scsi_mod]
> [<ffffffffa00706db>] scsi_next_command+0x2d/0x39 [scsi_mod]
> [<ffffffffa007090f>] scsi_end_request+0x86/0x97 [scsi_mod]
> [<ffffffffa0071659>] scsi_io_completion+0x1b6/0x3cd [scsi_mod]
> [<ffffffff8031d589>] blk_done_softirq+0x5c/0x6b
> [<ffffffff8023cb50>] __do_softirq+0x7a/0x13d
> [<ffffffff8021f9bd>] ack_apic_level+0x58/0xdc
> [<ffffffff8020d09c>] call_softirq+0x1c/0x28
> [<ffffffff8020decd>] do_softirq+0x2c/0x68
> [<ffffffff8020e1f1>] do_IRQ+0x145/0x168
> [<ffffffff8020c356>] ret_from_intr+0x0/0xa
> <EOI> [<ffffffff80261cd5>] audit_syscall_entry+0xb6/0x160
> [<ffffffff8020be94>] auditsys+0x19/0x4a
> ..
> ..
> <snip>
>
> 0xffffffff80319770 is in blk_invoke_request_fn (include/linux/blkdev.h:456).
> 451 #define QUEUE_FLAG_NONROT 14 /* non-rotational device (SSD) */
> 452
> 453 static inline int queue_is_locked(struct request_queue *q)
> 454 {
> 455 #ifdef CONFIG_SMP
> 456 spinlock_t *lock = q->queue_lock;
> 457 return lock && spin_is_locked(lock);
> 458 #else
> 459 return 1;
> 460 #endif
>
> 0x4fe3 is in scsi_run_queue (drivers/scsi/scsi_lib.c:604).
> 599 flagset = test_bit(QUEUE_FLAG_REENTER, &q->queue_flags) &&
> 600 !test_bit(QUEUE_FLAG_REENTER,
> 601 &sdev->request_queue->queue_flags);
> 602 if (flagset)
> 603 queue_flag_set(QUEUE_FLAG_REENTER, sdev->request_queue);
> 604 __blk_run_queue(sdev->request_queue);
> 605 if (flagset)
> 606 queue_flag_clear(QUEUE_FLAG_REENTER, sdev->request_queue);
> 607 spin_unlock(sdev->request_queue->queue_lock);
> 608
Huh, this makes very little sense to me... Can I talk you into trying
the for-linus branch of the block tree?
git://git.kernel.dk/linux-2.6-block.git for-linus
just to see if it reproduces with that. I'm assuming 2.6-git is fine?
--
Jens Axboe
* Jens Axboe <[email protected]> [2008-10-17 08:55:59]:
> On Fri, Oct 17 2008, Kamalesh Babulal wrote:
> > Hi Stephen,
> >
> > with the next-20081016 kernel, softlockup is detected while creating ext2
> > filesystem.
> >
> > BUG: soft lockup - CPU#3 stuck for 61s! [mkfs.ext2:3399]
> > Modules linked in: nfsd lockd nfs_acl auth_rpcgss exportfs autofs4 hidp rfcomm l2cap bluetooth sunrpc ipv6 acpi_cpufreq dm_mirror dm_log dm_mod video output rfkill input_polldev sbs sbshc battery acpi_memhotplug ac parport_pc lp parport sg floppy ide_cd_mod tg3 cdrom libphy serio_raw button i2c_i801 e752x_edac edac_core shpchp i2c_core pcspkr aic79xx scsi_transport_spi sd_mod scsi_mod ext3 jbd ehci_hcd ohci_hcd uhci_hcd [last unloaded: microcode]
> > Modules linked in: nfsd lockd nfs_acl auth_rpcgss exportfs autofs4 hidp rfcomm l2cap bluetooth sunrpc ipv6 acpi_cpufreq dm_mirror dm_log dm_mod video output rfkill input_polldev sbs sbshc battery acpi_memhotplug ac parport_pc lp parport sg floppy ide_cd_mod tg3 cdrom libphy serio_raw button i2c_i801 e752x_edac edac_core shpchp i2c_core pcspkr aic79xx scsi_transport_spi sd_mod scsi_mod ext3 jbd ehci_hcd ohci_hcd uhci_hcd [last unloaded: microcode]
> > Call Trace:
> > <IRQ> [<ffffffff80319770>] blk_invoke_request_fn+0x69/0x109
> > [<ffffffffa006ffe3>] scsi_run_queue+0x2b5/0x2ba [scsi_mod]
> > [<ffffffffa00706db>] scsi_next_command+0x2d/0x39 [scsi_mod]
> > [<ffffffffa007090f>] scsi_end_request+0x86/0x97 [scsi_mod]
> > [<ffffffffa0071659>] scsi_io_completion+0x1b6/0x3cd [scsi_mod]
> > [<ffffffff8031d589>] blk_done_softirq+0x5c/0x6b
> > [<ffffffff8023cb50>] __do_softirq+0x7a/0x13d
> > [<ffffffff8021f9bd>] ack_apic_level+0x58/0xdc
> > [<ffffffff8020d09c>] call_softirq+0x1c/0x28
> > [<ffffffff8020decd>] do_softirq+0x2c/0x68
> > [<ffffffff8020e1f1>] do_IRQ+0x145/0x168
> > [<ffffffff8020c356>] ret_from_intr+0x0/0xa
> > <EOI> [<ffffffff80261cd5>] audit_syscall_entry+0xb6/0x160
> > [<ffffffff8020be94>] auditsys+0x19/0x4a
> > ..
> > ..
> > <above call trace was printed 8 times>
> > ..
> > INFO: task kjournald:578 blocked for more than 480 seconds.
> > "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
> > ffff8801e50e1d30 0000000000000046 ffff8801e50e1cf8 ffffffff8031833d
> > ffff8801e5058c58 ffff8801e7360100 ffff8801e70f3470 ffff8801e7360458
> > 00000001e596c500 00000000fffd66c8 ffffffffffffffff ffffffffffffffff
> > Call Trace:
> > [<ffffffff8031833d>] elv_next_request+0x155/0x220
> > [<ffffffff802b26ab>] sync_buffer+0x0/0x3f
> > [<ffffffff8048f5ee>] io_schedule+0x5d/0x9f
> > [<ffffffff802b26e6>] sync_buffer+0x3b/0x3f
> > [<ffffffff8048f849>] __wait_on_bit+0x40/0x6f
> > [<ffffffff802b26ab>] sync_buffer+0x0/0x3f
> > [<ffffffff8048f8e4>] out_of_line_wait_on_bit+0x6c/0x78
> > [<ffffffff80249620>] wake_bit_function+0x0/0x23
> > [<ffffffffa003125c>] journal_commit_transaction+0x7e4/0xc64 [jbd]
> > [<ffffffff80240857>] lock_timer_base+0x26/0x4c
> > [<ffffffffa0033c97>] kjournald+0xc1/0x1fb [jbd]
> > [<ffffffff802495f2>] autoremove_wake_function+0x0/0x2e
> > [<ffffffffa0033bd6>] kjournald+0x0/0x1fb [jbd]
> > [<ffffffff802494c4>] kthread+0x47/0x73
> > [<ffffffff80234192>] schedule_tail+0x27/0x6e
> > [<ffffffff8020cd39>] child_rip+0xa/0x11
> > [<ffffffff8024947d>] kthread+0x0/0x73
> > [<ffffffff8020cd2f>] child_rip+0x0/0x11
> > INFO: task syslogd:2650 blocked for more than 480 seconds.
> > "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
> > ffff8801e1587da8 0000000000000082 0000000000000000 0000000000000000
> > 00000000003fbfc4 ffff8801e3926fe0 ffff8801e38c6f60 ffff8801e3927338
> > 0000000100000000 ffff8801e59444c0 0000000000000000 0000000000000001
> > Call Trace:
> > [<ffffffffa0033577>] log_wait_commit+0x9f/0xed [jbd]
> > [<ffffffff802495f2>] autoremove_wake_function+0x0/0x2e
> > [<ffffffffa002f4f9>] journal_stop+0x165/0x18d [jbd]
> > [<ffffffff802adf7b>] __writeback_single_inode+0x17f/0x282
> > [<ffffffff802948d9>] do_readv_writev+0x176/0x18b
> > [<ffffffff802ae867>] sync_inode+0x24/0x31
> > [<ffffffffa00463ba>] ext3_sync_file+0x9e/0xb0 [ext3]
> > [<ffffffff802b0c92>] do_fsync+0x52/0xa4
> > [<ffffffff802b0d07>] __do_fsync+0x23/0x36
> > [<ffffffff8020bddb>] system_call_fastpath+0x16/0x1b
> > INFO: task lamb-payload:3400 blocked for more than 480 seconds.
> > "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
> > ffff8801b186daa8 0000000000000082 ffff8801b186da70 0000000000000000
> > 0000000000000000 ffff8801e3834ee0 ffffffff805ad360 ffff8801e3835238
> > 0000000000000000 00000000fffd50dd ffffffffffffffff ffffffffffffffff
> > Call Trace:
> > [<ffffffffa002f6fd>] do_get_write_access+0x1dc/0x3c3 [jbd]
> > [<ffffffff80249620>] wake_bit_function+0x0/0x23
> > [<ffffffff802b1e79>] __getblk+0x25/0x211
> > [<ffffffffa002f906>] journal_get_write_access+0x22/0x33 [jbd]
> > [<ffffffffa0053fa9>] __ext3_journal_get_write_access+0x1e/0x47 [ext3]
> > [<ffffffffa0047bf7>] ext3_reserve_inode_write+0x3d/0x76 [ext3]
> > [<ffffffffa0047c51>] ext3_mark_inode_dirty+0x21/0x3c [ext3]
> > [<ffffffffa004a74c>] ext3_dirty_inode+0x63/0x7b [ext3]
> > [<ffffffff802ae65f>] __mark_inode_dirty+0x29/0x16b
> > [<ffffffff802a55db>] touch_atime+0x109/0x112
> > [<ffffffff8026cba6>] generic_file_aio_read+0x4b8/0x515
> > [<ffffffff8029442c>] do_sync_read+0xc9/0x10c
> > [<ffffffff802495f2>] autoremove_wake_function+0x0/0x2e
> > [<ffffffff8027cf56>] __vma_link+0x42/0x4b
> > [<ffffffff8032a3d4>] __up_write+0x27/0xf3
> > [<ffffffff80294b4f>] vfs_read+0xaa/0x133
> > [<ffffffff80297f65>] kernel_read+0x38/0x4e
> > [<ffffffff802990a1>] do_execve+0x121/0x256
> > [<ffffffff8020a495>] sys_execve+0x35/0x4c
> > [<ffffffff8020c1fa>] stub_execve+0x6a/0xc0
> > INFO: task crond:3055 blocked for more than 480 seconds.
> > "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
> > ffff8801d8197d08 0000000000000086 ffff8801d8197cd0 ffff8801da800700
> > ffff8801da810a40 ffff8801e68481c0 ffff8801e70f3470 ffff8801e6848518
> > 00000001da8aeaf0 00000000fffdf3b6 ffffffffffffffff ffffffffffffffff
> > Call Trace:
> > [<ffffffffa002f6fd>] do_get_write_access+0x1dc/0x3c3 [jbd]
> > [<ffffffff80249620>] wake_bit_function+0x0/0x23
> > [<ffffffff802b1e79>] __getblk+0x25/0x211
> > [<ffffffff802a014c>] filldir+0x0/0xb1
> > [<ffffffffa002f906>] journal_get_write_access+0x22/0x33 [jbd]
> > [<ffffffffa0053fa9>] __ext3_journal_get_write_access+0x1e/0x47 [ext3]
> > [<ffffffffa0047bf7>] ext3_reserve_inode_write+0x3d/0x76 [ext3]
> > [<ffffffffa0047c51>] ext3_mark_inode_dirty+0x21/0x3c [ext3]
> > [<ffffffffa004a74c>] ext3_dirty_inode+0x63/0x7b [ext3]
> > [<ffffffff802ae65f>] __mark_inode_dirty+0x29/0x16b
> > [<ffffffff802a014c>] filldir+0x0/0xb1
> > [<ffffffff802a55db>] touch_atime+0x109/0x112
> > [<ffffffff802a0287>] vfs_readdir+0x8a/0xa7
> > [<ffffffff802a04f1>] sys_getdents+0x75/0xc4
> > [<ffffffff8020bddb>] system_call_fastpath+0x16/0x1b
> > BUG: soft lockup - CPU#3 stuck for 61s! [mkfs.ext2:3399]
> > Modules linked in: nfsd lockd nfs_acl auth_rpcgss exportfs autofs4 hidp rfcomm l2cap bluetooth sunrpc ipv6 acpi_cpufreq dm_mirror dm_log dm_mod video output rfkill input_polldev sbs sbshc battery acpi_memhotplug ac parport_pc lp parport sg floppy ide_cd_mod tg3 cdrom libphy serio_raw button i2c_i801 e752x_edac edac_core shpchp i2c_core pcspkr aic79xx scsi_transport_spi sd_mod scsi_mod ext3 jbd ehci_hcd ohci_hcd uhci_hcd [last unloaded: microcode]
> > Modules linked in: nfsd lockd nfs_acl auth_rpcgss exportfs autofs4 hidp rfcomm l2cap bluetooth sunrpc ipv6 acpi_cpufreq dm_mirror dm_log dm_mod video output rfkill input_polldev sbs sbshc battery acpi_memhotplug ac parport_pc lp parport sg floppy ide_cd_mod tg3 cdrom libphy serio_raw button i2c_i801 e752x_edac edac_core shpchp i2c_core pcspkr aic79xx scsi_transport_spi sd_mod scsi_mod ext3 jbd ehci_hcd ohci_hcd uhci_hcd [last unloaded: microcode]
> > Call Trace:
> > <IRQ> [<ffffffff80319770>] blk_invoke_request_fn+0x69/0x109
> > [<ffffffffa006ffe3>] scsi_run_queue+0x2b5/0x2ba [scsi_mod]
> > [<ffffffffa00706db>] scsi_next_command+0x2d/0x39 [scsi_mod]
> > [<ffffffffa007090f>] scsi_end_request+0x86/0x97 [scsi_mod]
> > [<ffffffffa0071659>] scsi_io_completion+0x1b6/0x3cd [scsi_mod]
> > [<ffffffff8031d589>] blk_done_softirq+0x5c/0x6b
> > [<ffffffff8023cb50>] __do_softirq+0x7a/0x13d
> > [<ffffffff8021f9bd>] ack_apic_level+0x58/0xdc
> > [<ffffffff8020d09c>] call_softirq+0x1c/0x28
> > [<ffffffff8020decd>] do_softirq+0x2c/0x68
> > [<ffffffff8020e1f1>] do_IRQ+0x145/0x168
> > [<ffffffff8020c356>] ret_from_intr+0x0/0xa
> > <EOI> [<ffffffff80261cd5>] audit_syscall_entry+0xb6/0x160
> > [<ffffffff8020be94>] auditsys+0x19/0x4a
> > ..
> > ..
> > <snip>
> >
> > 0xffffffff80319770 is in blk_invoke_request_fn (include/linux/blkdev.h:456).
> > 451 #define QUEUE_FLAG_NONROT 14 /* non-rotational device (SSD) */
> > 452
> > 453 static inline int queue_is_locked(struct request_queue *q)
> > 454 {
> > 455 #ifdef CONFIG_SMP
> > 456 spinlock_t *lock = q->queue_lock;
> > 457 return lock && spin_is_locked(lock);
> > 458 #else
> > 459 return 1;
> > 460 #endif
> >
> > 0x4fe3 is in scsi_run_queue (drivers/scsi/scsi_lib.c:604).
> > 599 flagset = test_bit(QUEUE_FLAG_REENTER, &q->queue_flags) &&
> > 600 !test_bit(QUEUE_FLAG_REENTER,
> > 601 &sdev->request_queue->queue_flags);
> > 602 if (flagset)
> > 603 queue_flag_set(QUEUE_FLAG_REENTER, sdev->request_queue);
> > 604 __blk_run_queue(sdev->request_queue);
> > 605 if (flagset)
> > 606 queue_flag_clear(QUEUE_FLAG_REENTER, sdev->request_queue);
> > 607 spin_unlock(sdev->request_queue->queue_lock);
> > 608
>
> Huh, this makes very little sense to me... Can I talk you into trying
> the for-linus branch of the block tree?
>
> git://git.kernel.dk/linux-2.6-block.git for-linus
>
> just to see if it reproduces with that. I'm assuming 2.6-git is fine?
>
> --
> Jens Axboe
>
I applied the for-linus branch on top of 2.6.27-git7 kernel and I was not able to
reproduce with it.
--
Thanks & Regards,
Kamalesh Babulal,
Linux Technology Center,
IBM, ISTL.
On Fri, Oct 17 2008, Kamalesh Babulal wrote:
> * Jens Axboe <[email protected]> [2008-10-17 08:55:59]:
>
> > On Fri, Oct 17 2008, Kamalesh Babulal wrote:
> > > Hi Stephen,
> > >
> > > with the next-20081016 kernel, softlockup is detected while creating ext2
> > > filesystem.
> > >
> > > BUG: soft lockup - CPU#3 stuck for 61s! [mkfs.ext2:3399]
> > > Modules linked in: nfsd lockd nfs_acl auth_rpcgss exportfs autofs4 hidp rfcomm l2cap bluetooth sunrpc ipv6 acpi_cpufreq dm_mirror dm_log dm_mod video output rfkill input_polldev sbs sbshc battery acpi_memhotplug ac parport_pc lp parport sg floppy ide_cd_mod tg3 cdrom libphy serio_raw button i2c_i801 e752x_edac edac_core shpchp i2c_core pcspkr aic79xx scsi_transport_spi sd_mod scsi_mod ext3 jbd ehci_hcd ohci_hcd uhci_hcd [last unloaded: microcode]
> > > Modules linked in: nfsd lockd nfs_acl auth_rpcgss exportfs autofs4 hidp rfcomm l2cap bluetooth sunrpc ipv6 acpi_cpufreq dm_mirror dm_log dm_mod video output rfkill input_polldev sbs sbshc battery acpi_memhotplug ac parport_pc lp parport sg floppy ide_cd_mod tg3 cdrom libphy serio_raw button i2c_i801 e752x_edac edac_core shpchp i2c_core pcspkr aic79xx scsi_transport_spi sd_mod scsi_mod ext3 jbd ehci_hcd ohci_hcd uhci_hcd [last unloaded: microcode]
> > > Call Trace:
> > > <IRQ> [<ffffffff80319770>] blk_invoke_request_fn+0x69/0x109
> > > [<ffffffffa006ffe3>] scsi_run_queue+0x2b5/0x2ba [scsi_mod]
> > > [<ffffffffa00706db>] scsi_next_command+0x2d/0x39 [scsi_mod]
> > > [<ffffffffa007090f>] scsi_end_request+0x86/0x97 [scsi_mod]
> > > [<ffffffffa0071659>] scsi_io_completion+0x1b6/0x3cd [scsi_mod]
> > > [<ffffffff8031d589>] blk_done_softirq+0x5c/0x6b
> > > [<ffffffff8023cb50>] __do_softirq+0x7a/0x13d
> > > [<ffffffff8021f9bd>] ack_apic_level+0x58/0xdc
> > > [<ffffffff8020d09c>] call_softirq+0x1c/0x28
> > > [<ffffffff8020decd>] do_softirq+0x2c/0x68
> > > [<ffffffff8020e1f1>] do_IRQ+0x145/0x168
> > > [<ffffffff8020c356>] ret_from_intr+0x0/0xa
> > > <EOI> [<ffffffff80261cd5>] audit_syscall_entry+0xb6/0x160
> > > [<ffffffff8020be94>] auditsys+0x19/0x4a
> > > ..
> > > ..
> > > <above call trace was printed 8 times>
> > > ..
> > > INFO: task kjournald:578 blocked for more than 480 seconds.
> > > "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
> > > ffff8801e50e1d30 0000000000000046 ffff8801e50e1cf8 ffffffff8031833d
> > > ffff8801e5058c58 ffff8801e7360100 ffff8801e70f3470 ffff8801e7360458
> > > 00000001e596c500 00000000fffd66c8 ffffffffffffffff ffffffffffffffff
> > > Call Trace:
> > > [<ffffffff8031833d>] elv_next_request+0x155/0x220
> > > [<ffffffff802b26ab>] sync_buffer+0x0/0x3f
> > > [<ffffffff8048f5ee>] io_schedule+0x5d/0x9f
> > > [<ffffffff802b26e6>] sync_buffer+0x3b/0x3f
> > > [<ffffffff8048f849>] __wait_on_bit+0x40/0x6f
> > > [<ffffffff802b26ab>] sync_buffer+0x0/0x3f
> > > [<ffffffff8048f8e4>] out_of_line_wait_on_bit+0x6c/0x78
> > > [<ffffffff80249620>] wake_bit_function+0x0/0x23
> > > [<ffffffffa003125c>] journal_commit_transaction+0x7e4/0xc64 [jbd]
> > > [<ffffffff80240857>] lock_timer_base+0x26/0x4c
> > > [<ffffffffa0033c97>] kjournald+0xc1/0x1fb [jbd]
> > > [<ffffffff802495f2>] autoremove_wake_function+0x0/0x2e
> > > [<ffffffffa0033bd6>] kjournald+0x0/0x1fb [jbd]
> > > [<ffffffff802494c4>] kthread+0x47/0x73
> > > [<ffffffff80234192>] schedule_tail+0x27/0x6e
> > > [<ffffffff8020cd39>] child_rip+0xa/0x11
> > > [<ffffffff8024947d>] kthread+0x0/0x73
> > > [<ffffffff8020cd2f>] child_rip+0x0/0x11
> > > INFO: task syslogd:2650 blocked for more than 480 seconds.
> > > "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
> > > ffff8801e1587da8 0000000000000082 0000000000000000 0000000000000000
> > > 00000000003fbfc4 ffff8801e3926fe0 ffff8801e38c6f60 ffff8801e3927338
> > > 0000000100000000 ffff8801e59444c0 0000000000000000 0000000000000001
> > > Call Trace:
> > > [<ffffffffa0033577>] log_wait_commit+0x9f/0xed [jbd]
> > > [<ffffffff802495f2>] autoremove_wake_function+0x0/0x2e
> > > [<ffffffffa002f4f9>] journal_stop+0x165/0x18d [jbd]
> > > [<ffffffff802adf7b>] __writeback_single_inode+0x17f/0x282
> > > [<ffffffff802948d9>] do_readv_writev+0x176/0x18b
> > > [<ffffffff802ae867>] sync_inode+0x24/0x31
> > > [<ffffffffa00463ba>] ext3_sync_file+0x9e/0xb0 [ext3]
> > > [<ffffffff802b0c92>] do_fsync+0x52/0xa4
> > > [<ffffffff802b0d07>] __do_fsync+0x23/0x36
> > > [<ffffffff8020bddb>] system_call_fastpath+0x16/0x1b
> > > INFO: task lamb-payload:3400 blocked for more than 480 seconds.
> > > "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
> > > ffff8801b186daa8 0000000000000082 ffff8801b186da70 0000000000000000
> > > 0000000000000000 ffff8801e3834ee0 ffffffff805ad360 ffff8801e3835238
> > > 0000000000000000 00000000fffd50dd ffffffffffffffff ffffffffffffffff
> > > Call Trace:
> > > [<ffffffffa002f6fd>] do_get_write_access+0x1dc/0x3c3 [jbd]
> > > [<ffffffff80249620>] wake_bit_function+0x0/0x23
> > > [<ffffffff802b1e79>] __getblk+0x25/0x211
> > > [<ffffffffa002f906>] journal_get_write_access+0x22/0x33 [jbd]
> > > [<ffffffffa0053fa9>] __ext3_journal_get_write_access+0x1e/0x47 [ext3]
> > > [<ffffffffa0047bf7>] ext3_reserve_inode_write+0x3d/0x76 [ext3]
> > > [<ffffffffa0047c51>] ext3_mark_inode_dirty+0x21/0x3c [ext3]
> > > [<ffffffffa004a74c>] ext3_dirty_inode+0x63/0x7b [ext3]
> > > [<ffffffff802ae65f>] __mark_inode_dirty+0x29/0x16b
> > > [<ffffffff802a55db>] touch_atime+0x109/0x112
> > > [<ffffffff8026cba6>] generic_file_aio_read+0x4b8/0x515
> > > [<ffffffff8029442c>] do_sync_read+0xc9/0x10c
> > > [<ffffffff802495f2>] autoremove_wake_function+0x0/0x2e
> > > [<ffffffff8027cf56>] __vma_link+0x42/0x4b
> > > [<ffffffff8032a3d4>] __up_write+0x27/0xf3
> > > [<ffffffff80294b4f>] vfs_read+0xaa/0x133
> > > [<ffffffff80297f65>] kernel_read+0x38/0x4e
> > > [<ffffffff802990a1>] do_execve+0x121/0x256
> > > [<ffffffff8020a495>] sys_execve+0x35/0x4c
> > > [<ffffffff8020c1fa>] stub_execve+0x6a/0xc0
> > > INFO: task crond:3055 blocked for more than 480 seconds.
> > > "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
> > > ffff8801d8197d08 0000000000000086 ffff8801d8197cd0 ffff8801da800700
> > > ffff8801da810a40 ffff8801e68481c0 ffff8801e70f3470 ffff8801e6848518
> > > 00000001da8aeaf0 00000000fffdf3b6 ffffffffffffffff ffffffffffffffff
> > > Call Trace:
> > > [<ffffffffa002f6fd>] do_get_write_access+0x1dc/0x3c3 [jbd]
> > > [<ffffffff80249620>] wake_bit_function+0x0/0x23
> > > [<ffffffff802b1e79>] __getblk+0x25/0x211
> > > [<ffffffff802a014c>] filldir+0x0/0xb1
> > > [<ffffffffa002f906>] journal_get_write_access+0x22/0x33 [jbd]
> > > [<ffffffffa0053fa9>] __ext3_journal_get_write_access+0x1e/0x47 [ext3]
> > > [<ffffffffa0047bf7>] ext3_reserve_inode_write+0x3d/0x76 [ext3]
> > > [<ffffffffa0047c51>] ext3_mark_inode_dirty+0x21/0x3c [ext3]
> > > [<ffffffffa004a74c>] ext3_dirty_inode+0x63/0x7b [ext3]
> > > [<ffffffff802ae65f>] __mark_inode_dirty+0x29/0x16b
> > > [<ffffffff802a014c>] filldir+0x0/0xb1
> > > [<ffffffff802a55db>] touch_atime+0x109/0x112
> > > [<ffffffff802a0287>] vfs_readdir+0x8a/0xa7
> > > [<ffffffff802a04f1>] sys_getdents+0x75/0xc4
> > > [<ffffffff8020bddb>] system_call_fastpath+0x16/0x1b
> > > BUG: soft lockup - CPU#3 stuck for 61s! [mkfs.ext2:3399]
> > > Modules linked in: nfsd lockd nfs_acl auth_rpcgss exportfs autofs4 hidp rfcomm l2cap bluetooth sunrpc ipv6 acpi_cpufreq dm_mirror dm_log dm_mod video output rfkill input_polldev sbs sbshc battery acpi_memhotplug ac parport_pc lp parport sg floppy ide_cd_mod tg3 cdrom libphy serio_raw button i2c_i801 e752x_edac edac_core shpchp i2c_core pcspkr aic79xx scsi_transport_spi sd_mod scsi_mod ext3 jbd ehci_hcd ohci_hcd uhci_hcd [last unloaded: microcode]
> > > Modules linked in: nfsd lockd nfs_acl auth_rpcgss exportfs autofs4 hidp rfcomm l2cap bluetooth sunrpc ipv6 acpi_cpufreq dm_mirror dm_log dm_mod video output rfkill input_polldev sbs sbshc battery acpi_memhotplug ac parport_pc lp parport sg floppy ide_cd_mod tg3 cdrom libphy serio_raw button i2c_i801 e752x_edac edac_core shpchp i2c_core pcspkr aic79xx scsi_transport_spi sd_mod scsi_mod ext3 jbd ehci_hcd ohci_hcd uhci_hcd [last unloaded: microcode]
> > > Call Trace:
> > > <IRQ> [<ffffffff80319770>] blk_invoke_request_fn+0x69/0x109
> > > [<ffffffffa006ffe3>] scsi_run_queue+0x2b5/0x2ba [scsi_mod]
> > > [<ffffffffa00706db>] scsi_next_command+0x2d/0x39 [scsi_mod]
> > > [<ffffffffa007090f>] scsi_end_request+0x86/0x97 [scsi_mod]
> > > [<ffffffffa0071659>] scsi_io_completion+0x1b6/0x3cd [scsi_mod]
> > > [<ffffffff8031d589>] blk_done_softirq+0x5c/0x6b
> > > [<ffffffff8023cb50>] __do_softirq+0x7a/0x13d
> > > [<ffffffff8021f9bd>] ack_apic_level+0x58/0xdc
> > > [<ffffffff8020d09c>] call_softirq+0x1c/0x28
> > > [<ffffffff8020decd>] do_softirq+0x2c/0x68
> > > [<ffffffff8020e1f1>] do_IRQ+0x145/0x168
> > > [<ffffffff8020c356>] ret_from_intr+0x0/0xa
> > > <EOI> [<ffffffff80261cd5>] audit_syscall_entry+0xb6/0x160
> > > [<ffffffff8020be94>] auditsys+0x19/0x4a
> > > ..
> > > ..
> > > <snip>
> > >
> > > 0xffffffff80319770 is in blk_invoke_request_fn (include/linux/blkdev.h:456).
> > > 451 #define QUEUE_FLAG_NONROT 14 /* non-rotational device (SSD) */
> > > 452
> > > 453 static inline int queue_is_locked(struct request_queue *q)
> > > 454 {
> > > 455 #ifdef CONFIG_SMP
> > > 456 spinlock_t *lock = q->queue_lock;
> > > 457 return lock && spin_is_locked(lock);
> > > 458 #else
> > > 459 return 1;
> > > 460 #endif
> > >
> > > 0x4fe3 is in scsi_run_queue (drivers/scsi/scsi_lib.c:604).
> > > 599 flagset = test_bit(QUEUE_FLAG_REENTER, &q->queue_flags) &&
> > > 600 !test_bit(QUEUE_FLAG_REENTER,
> > > 601 &sdev->request_queue->queue_flags);
> > > 602 if (flagset)
> > > 603 queue_flag_set(QUEUE_FLAG_REENTER, sdev->request_queue);
> > > 604 __blk_run_queue(sdev->request_queue);
> > > 605 if (flagset)
> > > 606 queue_flag_clear(QUEUE_FLAG_REENTER, sdev->request_queue);
> > > 607 spin_unlock(sdev->request_queue->queue_lock);
> > > 608
> >
> > Huh, this makes very little sense to me... Can I talk you into trying
> > the for-linus branch of the block tree?
> >
> > git://git.kernel.dk/linux-2.6-block.git for-linus
> >
> > just to see if it reproduces with that. I'm assuming 2.6-git is fine?
> >
> > --
> > Jens Axboe
> >
>
> I applied the for-linus branch on top of 2.6.27-git7 kernel and I was not able to
> reproduce with it.
OK, I'm guessing it's a merge mess in linux-next. I tried to look at the
diff, but it was pretty much impossible to read and even included lots
of things in -git already.
--
Jens Axboe
Hi Jens,
On Fri, 17 Oct 2008 12:57:55 +0200 Jens Axboe <[email protected]> wrote:
>
> OK, I'm guessing it's a merge mess in linux-next. I tried to look at the
> diff, but it was pretty much impossible to read and even included lots
> of things in -git already.
If you are looking at the linux-next patch on kernel.org, then it is
relative to 2.6.27, so will contain a lot of stuff in Linus' tree. Its
purpose is to allow people to recreate the linux-next tree from a kernel
tarball.
In the linux-next git tree, the point in Linus' tree that it is based on
the the "stable" branch. If necessary, people should be able to bisect
between the "stabel" and "master" branches of a linux-next tree. Or, I
am told, between one linux-next tree and another (but that sounds painful
to me).
--
Cheers,
Stephen Rothwell [email protected]
http://www.canb.auug.org.au/~sfr/
On Sat, Oct 18 2008, Stephen Rothwell wrote:
> Hi Jens,
>
> On Fri, 17 Oct 2008 12:57:55 +0200 Jens Axboe <[email protected]> wrote:
> >
> > OK, I'm guessing it's a merge mess in linux-next. I tried to look at the
> > diff, but it was pretty much impossible to read and even included lots
> > of things in -git already.
>
> If you are looking at the linux-next patch on kernel.org, then it is
> relative to 2.6.27, so will contain a lot of stuff in Linus' tree. Its
> purpose is to allow people to recreate the linux-next tree from a kernel
> tarball.
>
> In the linux-next git tree, the point in Linus' tree that it is based on
> the the "stable" branch. If necessary, people should be able to bisect
> between the "stabel" and "master" branches of a linux-next tree. Or, I
> am told, between one linux-next tree and another (but that sounds painful
> to me).
OK, I'll try the -git tree next time I have to lookup changes in -next.
Thanks for the explanation!
--
Jens Axboe