From: rwhron@earthlink.net Subject: livelock running bonnie++ on nfs on 2.5.40-mm1 Date: Thu, 3 Oct 2002 19:44:46 -0400 Sender: nfs-admin@lists.sourceforge.net Message-ID: <20021003234446.GA32092@rushmore> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Return-path: Received: from hawk.mail.pas.earthlink.net ([207.217.120.22]) by usw-sf-list1.sourceforge.net with esmtp (Exim 3.31-VA-mm2 #1 (Debian)) id 17xFb7-0005K6-00 for ; Thu, 03 Oct 2002 16:41:37 -0700 Received: from user-38lc4p6.dialup.mindspring.com ([209.86.19.38] helo=earthlink.net) by hawk.mail.pas.earthlink.net with smtp (Exim 3.33 #1) id 17xFb4-0007jV-00 for nfs@lists.sourceforge.net; Thu, 03 Oct 2002 16:41:35 -0700 To: nfs@lists.sourceforge.net Errors-To: nfs-admin@lists.sourceforge.net List-Help: List-Post: List-Subscribe: , List-Id: Discussion of NFS under Linux development, interoperability, and testing. List-Unsubscribe: , List-Archive: AMD k6/2 running 2.5.40-mm1 locked up just as bonnie++ started to run. Using nfs-utils-1.0.1. Underlying fs is ext2. bonnie++ ran fine when it wasn't on nfs. nfs client and server are the same machine. The system wouldn't allow a login. Console was dead. cat /etc/exports /opt/testing/nfs 192.168.0.0/24(rw,root_squash,no_wdelay,anonuid=18008,anongid=18008,async) grep ^C .config|egrep 'NFS|RPC' CONFIG_NFS_FS=y CONFIG_NFS_V3=y CONFIG_NFSD=y CONFIG_NFSD_V3=y CONFIG_SUNRPC=y SysRq : Show Regs Pid: 2895, comm: nfsd EIP: 0060:[] CPU: 0EIP is at d_lookup+0xda/0xf0 EFLAGS: 00000217 Not tainted EAX: d7f20ca0 EBX: d7a9ef60 ECX: 00000010 EDX: b9011e78 ESI: c29c0120 EDI: cb815e30 EBP: d7a9ef78 DS: 0068 ES: 0068 CR0: 8005003b CR2: 40167000 CR3: 0dfaf000 CR4: 00000090 Call Trace: []cached_lookup+0xe/0x50 []lookup_hash+0x44/0x9c []lookup_one_len+0x53/0x64 []find_exported_dentry+0x321/0x5a0 []__getblk+0x18/0x3c []ext2_alloc_branch+0x29/0x194 []ext2_get_block+0x256/0x2f0 []ext2_get_block+0xc5/0x2f0 []default_wake_function+0x1d/0x2c []__wake_up_common+0x36/0x50 []skb_release_data+0x8a/0x90 []__kfree_skb+0xd8/0xe0 []skb_free_datagram+0x1c/0x20 []udp_data_ready+0x143/0x174 []udp_queue_rcv_skb+0x5f/0xa4 []udp_rcv+0x120/0x268 []ip_local_deliver+0xb1/0x12c []ip_rcv+0x2df/0x340 []netif_receive_skb+0xfd/0x128 []process_backlog+0x71/0x114 []net_rx_action+0x6e/0x108 []export_decode_fh+0x67/0x6f []nfsd_acceptable+0x0/0xb8 []fh_verify+0x286/0x404 []nfsd_acceptable+0x0/0xb8 []ip_build_xmit+0x2b6/0x340 []nfsd_open+0x36/0x130 []nfsd_write+0x2e/0x2b4 []default_wake_function+0x1d/0x2c []__wake_up_common+0x36/0x50 []nfsd3_proc_write+0xee/0x10c []nfsd_dispatch+0xce/0x19c []svc_process+0x28d/0x4d8 []nfsd+0x15e/0x29c []nfsd+0x0/0x29c []kernel_thread_helper+0x5/0xc SysRq : Show Memory Mem-info: Free pages: 3584kB ( 0kB HighMem) Zone:DMA freepages: 384kB min: 128kB low: 256kB high: 384kB active: 1332kB inactive: 10724kB Zone:Normal freepages: 3200kB min: 1020kB low: 2040kB high: 3060kB active: 58840kB inactive:292512kB Zone:HighMem freepages: 0kB min: 0kB low: 0kB high: 0kB active: 0kB inactive: 0kB ( Active:15043 inactive:75809 dirty:3625 writeback:0 free:896 ) 56*4kB 20*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 384kB) 306*4kB 225*8kB 9*16kB 1*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3200kB) Swap cache: add 205468, delete 189967, find 139427/156002, race 0+11 Free swap: 19296kB 98304 pages of RAM 0 pages of HIGHMEM 1932 reserved pages 48898 pages shared 15501 pages swap cached SysRq : Show State free sibling task PC stack pid father child younger older init R C14FFF24 0 1 0 2 (NOTLB) Call Trace: []schedule_timeout+0x8c/0xac []process_timeout+0x0/0xc []do_select+0x1a6/0x1e0 []sys_select+0x346/0x490 []syscall_call+0x7/0xb ksoftirqd_CPU S C14FA000 4 2 1 3 (L-TLB) Call Trace: []ksoftirqd+0x81/0xc8 []ksoftirqd+0x0/0xc8 []kernel_thread_helper+0x5/0xc keventd R C14F9FC0 0 3 1 4 2 (L-TLB) Call Trace: []context_thread+0xe1/0x1c4 []context_thread+0x0/0x1c4 []default_wake_function+0x0/0x2c []kernel_thread_helper+0x5/0xc kswapd0 S C0274338 4 4 1 25 3 (L-TLB) Call Trace: []kswapd+0xcc/0xf8 []kswapd+0x0/0xf8 []autoremove_wake_function+0x0/0x38 []autoremove_wake_function+0x0/0x38 []kernel_thread_helper+0x5/0xc syslogd R 7FFFFFFF 4 25 1 28 4 (NOTLB) Call Trace: []datagram_poll+0x22/0xbc []schedule_timeout+0x14/0xac []sock_poll+0x1b/0x20 []do_select+0xe5/0x1e0 []do_select+0x1a6/0x1e0 []sys_select+0x346/0x490 []syscall_call+0x7/0xb klogd R D7A1E000 10052 28 1 32 25 (NOTLB) Call Trace: []do_syslog+0xe8/0x370 []default_wake_function+0x0/0x2c []kmsg_read+0xf/0x14 []vfs_read+0xb2/0xf8 []sys_read+0x28/0x3c []syscall_call+0x7/0xb eth0 R CE44BF94 0 32 1 39 28 (L-TLB) Call Trace: []schedule_timeout+0x8c/0xac []process_timeout+0x0/0xc []interruptible_sleep_on_timeout+0x4d/0x74 []default_wake_function+0x0/0x2c []rtl8139_thread+0x8f/0x198 []rtl8139_thread+0x0/0x198 []kernel_thread_helper+0x5/0xc sshd S 7FFFFFFF 0 39 1 392 390 32 (NOTLB) Call Trace: []schedule_timeout+0x14/0xac []sock_poll+0x1b/0x20 []do_select+0xe5/0x1e0 []do_select+0x1a6/0x1e0 []sys_select+0x346/0x490 []schedule+0x24c/0x270 []syscall_call+0x7/0xb agetty S 7FFFFFFF 4 390 1 391 39 (NOTLB) Call Trace: []schedule_timeout+0x14/0xac []write_chan+0x195/0x204 []read_chan+0x3c4/0x78c []read_chan+0x414/0x78c []default_wake_function+0x0/0x2c []default_wake_function+0x0/0x2c []tty_read+0xaa/0xcc []vfs_read+0xb2/0xf8 []sys_read+0x28/0x3c []syscall_call+0x7/0xb agetty S 7FFFFFFF 4 391 1 2395 390 (NOTLB) Call Trace: []schedule_timeout+0x14/0xac []write_chan+0x195/0x204 []read_chan+0x3c4/0x78c []read_chan+0x414/0x78c []default_wake_function+0x0/0x2c []default_wake_function+0x0/0x2c []tty_read+0xaa/0xcc []vfs_read+0xb2/0xf8 []sys_read+0x28/0x3c []syscall_call+0x7/0xb sshd R 7FFFFFFF 0 392 39 393 (NOTLB) Call Trace: []schedule_timeout+0x14/0xac []do_select+0xe5/0x1e0 []do_select+0x1a6/0x1e0 []sys_select+0x346/0x490 []syscall_call+0x7/0xb bash S FFFFFE00 384 393 392 398 (NOTLB) Call Trace: []sys_wait4+0xb6/0x3a0 []sys_wait4+0x36d/0x3a0 []default_wake_function+0x0/0x2c []default_wake_function+0x0/0x2c []syscall_call+0x7/0xb bash S FFFFFE00 0 398 393 403 (NOTLB) Call Trace: []sys_wait4+0xb6/0x3a0 []sys_wait4+0x36d/0x3a0 []default_wake_function+0x0/0x2c []default_wake_function+0x0/0x2c []syscall_call+0x7/0xb runtests S FFFFFE00 4 403 398 405 (NOTLB) Call Trace: []sys_wait4+0xb6/0x3a0 []sys_wait4+0x36d/0x3a0 []default_wake_function+0x0/0x2c []default_wake_function+0x0/0x2c []syscall_call+0x7/0xb vmstat R D76C9F90 0 405 403 406 (NOTLB) Call Trace: []schedule_timeout+0x8c/0xac []process_timeout+0x0/0xc []sys_nanosleep+0xa3/0xf8 []syscall_call+0x7/0xb tee S D76A7F48 0 406 403 2914 405 (NOTLB) Call Trace: []pipe_wait+0x70/0xac []default_wake_function+0x0/0x2c []default_wake_function+0x0/0x2c []pipe_read+0xc7/0x23c []vfs_read+0xb2/0xf8 []sys_read+0x28/0x3c []syscall_call+0x7/0xb postmaster R D5C53F24 4 2395 1 2400 2479 391 (NOTLB) Call Trace: []schedule_timeout+0x8c/0xac []process_timeout+0x0/0xc []do_select+0x1a6/0x1e0 []sys_select+0x346/0x490 []syscall_call+0x7/0xb postmaster S 7FFFFFFF 0 2400 2395 2402 (NOTLB) Call Trace: []schedule_timeout+0x14/0xac []do_select+0xe5/0x1e0 []do_select+0x1a6/0x1e0 []sys_select+0x346/0x490 []syscall_call+0x7/0xb postmaster S 7FFFFFFF 160 2402 2400 (NOTLB) Call Trace: []schedule_timeout+0x14/0xac []do_select+0xe5/0x1e0 []do_select+0x1a6/0x1e0 []sys_select+0x346/0x490 []syscall_call+0x7/0xb pdflush R C2852000 4 2479 1 2486 2395 (L-TLB) Call Trace: []__pdflush+0xb5/0x17c []pdflush+0x0/0x14 []pdflush+0xb/0x14 []wb_kupdate+0x0/0xfc []kernel_thread_helper+0x5/0xc pdflush S C95CC000 4 2486 1 2878 2479 (L-TLB) Call Trace: []__pdflush+0xb5/0x17c []pdflush+0x0/0x14 []pdflush+0xb/0x14 []kernel_thread_helper+0x5/0xc portmap S 7FFFFFFF 0 2878 1 2880 2486 (NOTLB) Call Trace: []do_pollfd+0x48/0x88 []schedule_timeout+0x14/0xac []do_poll+0x85/0xe8 []do_poll+0xc0/0xe8 []sys_poll+0x18c/0x274 []syscall_call+0x7/0xb rpc.mountd S 7FFFFFFF 4 2880 1 2882 2878 (NOTLB) Call Trace: []do_pollfd+0x48/0x88 []schedule_timeout+0x14/0xac []do_poll+0x85/0xe8 []do_poll+0xc0/0xe8 []sys_poll+0x18c/0x274 []syscall_call+0x7/0xb nfsd R D2449F60 0 2882 1 2883 2880 (L-TLB) Call Trace: []schedule_timeout+0x8c/0xac []process_timeout+0x0/0xc []svc_recv+0x216/0x448 []default_wake_function+0x0/0x2c []default_wake_function+0x0/0x2c []nfsd+0xa8/0x29c []nfsd+0x0/0x29c []kernel_thread_helper+0x5/0xc nfsd R C7ED5F60 0 2883 1 2884 2882 (L-TLB) Call Trace: []schedule_timeout+0x8c/0xac []process_timeout+0x0/0xc []svc_recv+0x216/0x448 []default_wake_function+0x0/0x2c []default_wake_function+0x0/0x2c []nfsd+0xa8/0x29c []nfsd+0x0/0x29c []kernel_thread_helper+0x5/0xc nfsd R D781DF60 4 2884 1 2885 2883 (L-TLB) Call Trace: []schedule_timeout+0x8c/0xac []process_timeout+0x0/0xc []svc_recv+0x216/0x448 []default_wake_function+0x0/0x2c []default_wake_function+0x0/0x2c []nfsd+0xa8/0x29c []nfsd+0x0/0x29c []kernel_thread_helper+0x5/0xc nfsd R D117DF60 4 2885 1 2886 2884 (L-TLB) Call Trace: []schedule_timeout+0x8c/0xac []process_timeout+0x0/0xc []svc_recv+0x216/0x448 []default_wake_function+0x0/0x2c []default_wake_function+0x0/0x2c []nfsd+0xa8/0x29c []nfsd+0x0/0x29c []kernel_thread_helper+0x5/0xc nfsd R D45FFF60 4 2886 1 2887 2885 (L-TLB) Call Trace: []schedule_timeout+0x8c/0xac []process_timeout+0x0/0xc []svc_recv+0x216/0x448 []default_wake_function+0x0/0x2c []default_wake_function+0x0/0x2c []nfsd+0xa8/0x29c []nfsd+0x0/0x29c []kernel_thread_helper+0x5/0xc nfsd R CFA1BF60 0 2887 1 2888 2886 (L-TLB) Call Trace: []schedule_timeout+0x8c/0xac []process_timeout+0x0/0xc []svc_recv+0x216/0x448 []default_wake_function+0x0/0x2c []default_wake_function+0x0/0x2c []nfsd+0xa8/0x29c []nfsd+0x0/0x29c []kernel_thread_helper+0x5/0xc nfsd R C9FA7F60 4 2888 1 2889 2887 (L-TLB) Call Trace: []schedule_timeout+0x8c/0xac []process_timeout+0x0/0xc []svc_recv+0x216/0x448 []default_wake_function+0x0/0x2c []default_wake_function+0x0/0x2c []nfsd+0xa8/0x29c []nfsd+0x0/0x29c []kernel_thread_helper+0x5/0xc nfsd R C75A3F60 4 2889 1 2890 2888 (L-TLB) Call Trace: []schedule_timeout+0x8c/0xac []process_timeout+0x0/0xc []svc_recv+0x216/0x448 []default_wake_function+0x0/0x2c []default_wake_function+0x0/0x2c []nfsd+0xa8/0x29c []nfsd+0x0/0x29c []kernel_thread_helper+0x5/0xc nfsd R D2AB7F60 4 2890 1 2891 2889 (L-TLB) Call Trace: []schedule_timeout+0x8c/0xac []process_timeout+0x0/0xc []svc_recv+0x216/0x448 []default_wake_function+0x0/0x2c []default_wake_function+0x0/0x2c []nfsd+0xa8/0x29c []nfsd+0x0/0x29c []kernel_thread_helper+0x5/0xc nfsd R C45BBF60 4 2891 1 2892 2890 (L-TLB) Call Trace: []schedule_timeout+0x8c/0xac []process_timeout+0x0/0xc []svc_recv+0x216/0x448 []default_wake_function+0x0/0x2c []default_wake_function+0x0/0x2c []nfsd+0xa8/0x29c []nfsd+0x0/0x29c []kernel_thread_helper+0x5/0xc nfsd R C51CFF60 4 2892 1 2893 2891 (L-TLB) Call Trace: []schedule_timeout+0x8c/0xac []process_timeout+0x0/0xc []svc_recv+0x216/0x448 []default_wake_function+0x0/0x2c []default_wake_function+0x0/0x2c []nfsd+0xa8/0x29c []nfsd+0x0/0x29c []kernel_thread_helper+0x5/0xc nfsd R C426FF60 4 2893 1 2894 2892 (L-TLB) Call Trace: []schedule_timeout+0x8c/0xac []process_timeout+0x0/0xc []svc_recv+0x216/0x448 []default_wake_function+0x0/0x2c []default_wake_function+0x0/0x2c []nfsd+0xa8/0x29c []nfsd+0x0/0x29c []kernel_thread_helper+0x5/0xc nfsd R D2E43F60 0 2894 1 2895 2893 (L-TLB) Call Trace: []schedule_timeout+0x8c/0xac []process_timeout+0x0/0xc []svc_recv+0x216/0x448 []default_wake_function+0x0/0x2c []default_wake_function+0x0/0x2c []nfsd+0xa8/0x29c []nfsd+0x0/0x29c []kernel_thread_helper+0x5/0xc nfsd R current 4 2895 1 2896 2894 (L-TLB) Call Trace: []nfsd3_proc_write+0xee/0x10c []nfsd_dispatch+0xce/0x19c []svc_process+0x28d/0x4d8 []nfsd+0x15e/0x29c []nfsd+0x0/0x29c []kernel_thread_helper+0x5/0xc nfsd R D6067F60 4 2896 1 2897 2895 (L-TLB) Call Trace: []schedule_timeout+0x8c/0xac []process_timeout+0x0/0xc []svc_recv+0x216/0x448 []default_wake_function+0x0/0x2c []default_wake_function+0x0/0x2c []nfsd+0xa8/0x29c []nfsd+0x0/0x29c []kernel_thread_helper+0x5/0xc nfsd R C23D7F60 4 2897 1 2898 2896 (L-TLB) Call Trace: []schedule_timeout+0x8c/0xac []process_timeout+0x0/0xc [