From: Bart Trojanowski Subject: Re: [v2.6.30 nfs+fscache] lockdep: inconsistent lock state Date: Thu, 18 Jun 2009 09:20:20 -0400 Message-ID: <20090618132020.GA21444@jukie.net> References: <20090615123658.GC4721@jukie.net> <20090613182721.GA24072@jukie.net> <25357.1245068384@redhat.com> <25124.1245074627@redhat.com> <20090617120451.GF30951@jukie.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Cc: linux-cachefs@redhat.com, linux-nfs@vger.kernel.org, linux-mm@kvack.org To: David Howells , linux-kernel@vger.kernel.org Return-path: In-Reply-To: <20090617120451.GF30951@jukie.net> Sender: owner-linux-mm@kvack.org List-ID: Hi David, I moved the cachedfilesd dir to an ext3 filesystem. # grep '^dir' /etc/cachefilesd.conf dir /var/cache/fscache # mount | grep /var/cache/fscache /dev/mapper/vg-fscache on /var/cache/fscache type ext3 (rw,user_xattr) Here is the latest lockdep event. I'd blame xfs, but I run other systems with xfs, but without fscache... maybe they just don't play well together. -Bart ================================= [ INFO: inconsistent lock state ] 2.6.30-kvm4-dirty #5 --------------------------------- inconsistent {RECLAIM_FS-ON-W} -> {IN-RECLAIM_FS-W} usage. kswapd1/426 [HC0[0]:SC0[0]:HE1:SE1] takes: (&(&ip->i_lock)->mr_lock){++++?+}, at: [] xfs_ilock+0x60/0x7e {RECLAIM_FS-ON-W} state was registered at: [] mark_held_locks+0x4d/0x6b [] lockdep_trace_alloc+0xae/0xcf [] kmem_cache_alloc+0x27/0x10d [] kmem_zone_alloc+0x6c/0xb7 [] kmem_zone_zalloc+0x14/0x35 [] xfs_da_state_alloc+0x1a/0x1c [] xfs_dir2_node_lookup+0x1c/0xee [] xfs_dir_lookup+0x10b/0x158 [] xfs_lookup+0x50/0xb3 [] xfs_vn_lookup+0x44/0x83 [] do_lookup+0xdc/0x1c0 [] __link_path_walk+0x96a/0xdf9 [] path_walk+0x6e/0xd9 [] do_path_lookup+0x185/0x1a6 [] do_filp_open+0x108/0x8ee [] do_sys_open+0x5b/0xe2 [] sys_open+0x20/0x22 [] init_post+0x3a/0x18d [] kernel_init+0x181/0x18c [] child_rip+0xa/0x20 [] 0xffffffffffffffff irq event stamp: 228127 hardirqs last enabled at (228127): [] free_hot_cold_page+0x1ae/0x26b hardirqs last disabled at (228126): [] free_hot_cold_page+0x231/0x26b softirqs last enabled at (227688): [] __do_softirq+0x189/0x198 softirqs last disabled at (227683): [] call_softirq+0x1c/0x28 other info that might help us debug this: 2 locks held by kswapd1/426: #0: (shrinker_rwsem){++++..}, at: [] shrink_slab+0x3d/0x159 #1: (iprune_mutex){+.+.-.}, at: [] shrink_icache_memory+0x50/0x246 stack backtrace: Pid: 426, comm: kswapd1 Not tainted 2.6.30-kvm4-dirty #5 Call Trace: [] print_usage_bug+0x1bc/0x1cd [] ? save_stack_trace+0x2f/0x4d [] ? check_usage_forwards+0x0/0x9c [] mark_lock+0x2f8/0x53d [] __lock_acquire+0x812/0x16b4 [] lock_acquire+0xc7/0xf3 [] ? xfs_ilock+0x60/0x7e [] down_write_nested+0x34/0x67 [] ? xfs_ilock+0x60/0x7e [] xfs_ilock+0x60/0x7e [] xfs_reclaim+0x64/0xae [] xfs_fs_destroy_inode+0x3c/0x5c [] destroy_inode+0x3f/0x54 [] dispose_list+0xdf/0x113 [] shrink_icache_memory+0x210/0x246 [] shrink_slab+0xe4/0x159 [] kswapd+0x4a7/0x646 [] ? isolate_pages_global+0x0/0x232 [] ? autoremove_wake_function+0x0/0x3d [] ? trace_hardirqs_on+0xd/0xf [] ? kswapd+0x0/0x646 [] ? kswapd+0x0/0x646 [] kthread+0x5b/0x88 [] child_rip+0xa/0x20 [] ? restore_args+0x0/0x30 [] ? finish_task_switch+0x40/0x111 [] ? kthreadd+0x10f/0x134 [] ? kthread+0x0/0x88 [] ? child_rip+0x0/0x20 Pid: 29607, comm: kslowd Not tainted 2.6.30-kvm4-dirty #5 Call Trace: [] ? __wake_up+0x27/0x55 [] cachefiles_read_waiter+0x5d/0x102 [cachefiles] [] __wake_up_common+0x4b/0x7a [] __wake_up+0x3d/0x55 [] __wake_up_bit+0x31/0x33 [] unlock_page+0x27/0x2b [] ext3_truncate+0x4bb/0x8fd [ext3] [] ? unmap_mapping_range+0x232/0x241 [] ? trace_hardirqs_on+0xd/0xf [] vmtruncate+0xc4/0xe4 [] inode_setattr+0x30/0x12a [] ext3_setattr+0x198/0x1ff [ext3] [] notify_change+0x199/0x2e4 [] cachefiles_attr_changed+0x10c/0x181 [cachefiles] [] ? cachefiles_walk_to_object+0x68b/0x798 [cachefiles] [] cachefiles_lookup_object+0xac/0xd4 [cachefiles] [] fscache_lookup_object+0x136/0x14e [fscache] [] fscache_object_slow_work_execute+0x243/0x814 [fscache] [] slow_work_thread+0x278/0x43a [] ? autoremove_wake_function+0x0/0x3d [] ? slow_work_thread+0x0/0x43a [] ? slow_work_thread+0x0/0x43a [] kthread+0x5b/0x88 [] child_rip+0xa/0x20 [] ? _spin_unlock_irq+0x30/0x3b [] ? restore_args+0x0/0x30 [] ? finish_task_switch+0x40/0x111 [] ? kthreadd+0x10f/0x134 [] ? kthread+0x0/0x88 [] ? child_rip+0x0/0x20 CacheFiles: I/O Error: Readpage failed on backing file c0000000000830 FS-Cache: Cache cachefiles stopped due to I/O error -- WebSig: http://www.jukie.net/~bart/sig/ -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to majordomo@kvack.org. For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: email@kvack.org