From: Holger Kiehl Subject: Re: Performance of ext4 Date: Wed, 25 Jun 2008 09:09:24 +0000 (GMT) Message-ID: References: <20080619155645.GA8582@mit.edu> <485A8C2D.1090806@redhat.com> <20080619174211.GB9119@mit.edu> <20080620085922.GH9119@mit.edu> <20080623174508.GA7216@skywalker> <1214267492.27507.285.camel@BVR-FS.beaverton.ibm.com> <20080624030721.GB10469@skywalker> <20080624033349.GD10469@skywalker> <1214348318.27507.330.camel@BVR-FS.beaverton.ibm.com> Mime-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: "Aneesh Kumar K.V" , Theodore Tso , Eric Sandeen , Jan Kara , Solofo.Ramangalahy@bull.net, Nick Dokos , linux-ext4@vger.kernel.org, linux-kernel To: Mingming Return-path: Received: from dwdmx4.dwd.de ([141.38.3.230]:60023 "EHLO dwdmx4.dwd.de" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1754065AbYFYJJ3 (ORCPT ); Wed, 25 Jun 2008 05:09:29 -0400 Received: from localhost (localhost [127.0.0.1]) by node3.dwd.de (Postfix) with ESMTP id BD8E26B8455 for ; Wed, 25 Jun 2008 09:09:27 +0000 (UTC) Received: from localhost ([127.0.0.1]) by localhost (node3.csg-cluster.lan [127.0.0.1]) (amavisd-new, port 2525) with SMTP id 22103-58 for ; Wed, 25 Jun 2008 09:09:27 +0000 (UTC) In-Reply-To: <1214348318.27507.330.camel@BVR-FS.beaverton.ibm.com> Sender: linux-ext4-owner@vger.kernel.org List-ID: On Tue, 24 Jun 2008, Mingming wrote: > > On Tue, 2008-06-24 at 21:12 +0000, Holger Kiehl wrote: >> Yes, with this patch applied on top of latest patch queue I no longer >> get truncated files, after running a short test. Tomorrow I will do some >> more thorough testing and use the patch you have send to me in a separate >> mail. The above patch did not apply but it was easy to apply by hand. > > > Thanks for quick response and test. I have updated the patch queue with > above patch merged. Please let me know if you still see apply issue and > file size update issue with current patch queue. > Thanks, it applies without any problems. However I still hit an oops. What I find strange is that I got the oops just as the benchmark is done and all process where shutting down. The same behaviour I reported here: http://www.ussg.iu.edu/hypermail/linux/kernel/0806.2/2113.html Only this time I got just one oops. This is on x86_64 system (4 Opteron CPU's and SW Raid 1+0). I have not seen this on my home system x86 (1 Dual Core and HW Raid). Anyway, here the dmesg output: kjournald2 starting. Commit interval 15 seconds EXT4 FS on md7, internal journal EXT4-fs: mounted filesystem with ordered data mode. EXT4-fs: file extents enabled EXT4-fs: mballoc enabled JBD: barrier-based sync failed on md7 - disabling barriers ------------[ cut here ]------------ kernel BUG at fs/ext4/inode.c:1667! invalid opcode: 0000 [1] SMP CPU 3 Modules linked in: w83627hf lm85 hwmon_vid bonding nf_conntrack_ftp ipt_REJECT xt_tcpudp nf_conntrack_ipv4 xt_state nf_conntrack iptable_filter ip_tables x_tables binfmt_misc sg floppy k8temp ohci_hcd i2c_amd756 i2c_core button usbcore Pid: 2661, comm: kjournald2 Not tainted 2.6.26-rc6 #1 RIP: 0010:[] [] ext4_da_writepage+0x30/0xf4 RSP: 0018:ffff81027d737c10 EFLAGS: 00010246 RAX: 010000000001002d RBX: ffffe200017e9218 RCX: 00000000ffffffe8 RDX: 0000000000004278 RSI: ffff81027d737e00 RDI: ffffe200017e9218 RBP: ffff81021dad66e8 R08: ffff81027ff05440 R09: ffff81027d737b50 R10: ffff81020fe54480 R11: ffff81020fe54400 R12: ffff81027d737e00 R13: 0000000000000001 R14: 0000000000000000 R15: ffff8101ff0b8120 FS: 00007f53ed10b6f0(0000) GS:ffff81027ff13000(0000) knlGS:0000000000000000 CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b CR2: 000000000081a000 CR3: 0000000166f03000 CR4: 00000000000006e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Process kjournald2 (pid: 2661, threadinfo ffff81027d736000, task ffff81027ed93210) Stack: ffff81021dad67f8 ffff81027d737e00 0000000000000000 ffffffff80261816 ffffe200017e9218 ffffffff80261f8c ffff81021dad67f8 ffffffff8026180c ffff81021dad67f8 0000000280224f0c 0000000000000004 000000007d737fd8 Call Trace: [] ? __writepage+0xa/0x27 [] ? write_cache_pages+0x174/0x2be [] ? __writepage+0x0/0x27 [] ? jbd2_journal_commit_transaction+0x343/0xe6a [] ? hrtimer_start+0x100/0x122 [] ? try_to_del_timer_sync+0x52/0x5b [] ? kjournald2+0xdf/0x202 [] ? autoremove_wake_function+0x0/0x2e [] ? kjournald2+0x0/0x202 [] ? kthread+0x47/0x73 [] ? child_rip+0xa/0x12 [] ? kthread+0x0/0x73 [] ? child_rip+0x0/0x12 Code: 55 53 48 8b 47 18 48 89 fb 48 8b 28 65 48 8b 04 25 00 00 00 00 48 83 b8 d0 04 00 00 00 75 5f 48 8b 07 48 8b 55 68 f6 c4 08 75 04 <0f> 0b eb fe 48 89 d0 81 e2 ff 0f 00 00 48 8b 77 10 48 c1 f8 0c RIP [] ext4_da_writepage+0x30/0xf4 RSP ---[ end trace efaf3891d582feb1 ]--- SysRq : Show Blocked State task PC stack pid father pdflush D 00000000ffffffff 0 242 2 ffff81007f319bb8 0000000000000046 ffffffff8031682e 000000000000000e ffffffff80600cc0 000000000000000e ffff81007f319bf0 ffff81007fbbbd30 ffff8101fff33210 ffff81007fbbbf68 00000002802aa2a6 ffff81007fbbbf68 Call Trace: [] submit_bio+0xc4/0xcb [] __mutex_lock_slowpath+0x6a/0xa0 [] mutex_lock+0xa/0xb [] __jbd2_log_wait_for_space+0x52/0xac [] start_this_handle+0x2eb/0x370 [] jbd2_journal_stop+0x191/0x19d [] jbd2_journal_start+0x9a/0xce [] ext4_da_writepages+0x75/0x173 [] do_writepages+0x20/0x2d [] __writeback_single_inode+0x16f/0x35e [] sync_sb_inodes+0x283/0x3b8 [] writeback_inodes+0x89/0xde [] wb_kupdate+0x9f/0x116 [] pdflush+0x122/0x1c9 [] wb_kupdate+0x0/0x116 [] pdflush+0x0/0x1c9 [] kthread+0x47/0x73 [] schedule_tail+0x27/0x5c [] child_rip+0xa/0x12 [] kthread+0x0/0x73 [] child_rip+0x0/0x12 init_afd D 00000000ffffffff 0 7974 1 ffff8101050d3b30 0000000000000082 ffff810055f08230 0000000000080768 ffffffff80600cc0 ffff8101ff8509c0 ffffffff802a38d5 ffff8101050aac80 ffff8101fff342c0 ffff8101050aaeb8 000000038023e66b ffff8101050aaeb8 Call Trace: [] __find_get_block_slow+0xcf/0xdb [] do_get_write_access+0x3ab/0x3ed [] __mutex_lock_slowpath+0x6a/0xa0 [] mutex_lock+0xa/0xb [] __jbd2_log_wait_for_space+0x52/0xac [] start_this_handle+0x2eb/0x370 [] __wake_up+0x38/0x4f [] jbd2_journal_start+0x9a/0xce [] ext4_dirty_inode+0x28/0x7b [] __mark_inode_dirty+0x29/0x187 [] file_update_time+0xaf/0xf4 [] do_wp_page+0x45b/0x4ba [] handle_mm_fault+0x62d/0x6a3 [] hrtick_set+0x8b/0x10a [] do_page_fault+0x435/0x825 [] getnstimeofday+0x38/0x92 [] lock_hrtimer_base+0x1b/0x3c [] hrtimer_try_to_cancel+0x61/0x6a [] hrtimer_cancel+0xc/0x16 [] do_nanosleep+0x6c/0xa6 [] audit_syscall_exit+0x2ee/0x30c [] error_exit+0x0/0x51 system_log D 00000000ffffffff 0 7975 7974 ffff81002d533ad0 0000000000000086 ffffffff8028fce8 ffff81007ed55e90 ffffffff80600cc0 0000000000000100 ffff81027d7cae40 ffff81007ed55e90 ffff8101fff342c0 ffff81007ed560c8 000000032d533f50 ffff81007ed560c8 Call Trace: [] poll_freewait+0x36/0x87 [] __mutex_lock_slowpath+0x6a/0xa0 [] mutex_lock+0xa/0xb [] __jbd2_log_wait_for_space+0x52/0xac [] start_this_handle+0x2eb/0x370 [] generic_file_buffered_write+0x22c/0x658 [] ext4_mark_inode_dirty+0x134/0x147 [] jbd2_journal_start+0x9a/0xce [] ext4_dirty_inode+0x28/0x7b [] __mark_inode_dirty+0x29/0x187 [] file_update_time+0xaf/0xf4 [] __generic_file_aio_write_nolock+0x265/0x37e [] touch_atime+0x12/0xfa [] __wake_up_sync+0x3a/0x56 [] generic_file_aio_write+0x64/0xc4 [] ext4_file_write+0x96/0x11a [] do_sync_write+0xce/0x113 [] do_page_fault+0x471/0x825 [] mmap_region+0x41a/0x505 [] autoremove_wake_function+0x0/0x2e [] vfs_write+0xad/0x136 [] sys_write+0x45/0x6e [] tracesys+0xd5/0xda receive_log D 00000000ffffffff 0 7977 7974 ffff81002d4ffad0 0000000000000082 ffffffff8028fce8 ffff81007ed55900 ffffffff80600cc0 0000000000000100 ffff81007e86ed80 ffff81007ed55900 ffffffff8054d350 ffff81007ed55b38 000000002d4fff50 ffff81007ed55b38 Call Trace: [] poll_freewait+0x36/0x87 [] __mutex_lock_slowpath+0x6a/0xa0 [] mutex_lock+0xa/0xb [] __jbd2_log_wait_for_space+0x52/0xac [] start_this_handle+0x2eb/0x370 [] __ext4_journal_dirty_metadata+0x1e/0x46 [] jbd2_journal_start+0x9a/0xce [] ext4_dirty_inode+0x28/0x7b [] __mark_inode_dirty+0x29/0x187 [] file_update_time+0xaf/0xf4 [] __generic_file_aio_write_nolock+0x265/0x37e [] do_lookup+0x63/0x1a1 [] dput+0x21/0x10a [] generic_file_aio_write+0x64/0xc4 [] ext4_file_write+0x96/0x11a [] do_sync_write+0xce/0x113 [] cp_new_stat+0xe9/0xfc [] autoremove_wake_function+0x0/0x2e [] vfs_write+0xad/0x136 [] sys_write+0x45/0x6e [] tracesys+0xd5/0xda archive_watch D 00000000ffffffff 0 7980 7974 ffff81007ecabce0 0000000000000082 ffffffff802de7cd ffff810000000001 ffffffff80600cc0 ffff810000000001 ffffffff8027ce42 ffff81007ed537a0 ffff8101fff33210 ffff81007ed539d8 00000002802d9b7a ffff81007ed539d8 Call Trace: [] ext4_getblk+0xb4/0x170 [] get_partial_node+0x15/0x78 [] __d_lookup+0xbd/0x107 [] __mutex_lock_slowpath+0x6a/0xa0 [] mutex_lock+0xa/0xb [] __jbd2_log_wait_for_space+0x52/0xac [] start_this_handle+0x2eb/0x370 [] __link_path_walk+0x6e0/0xdd4 [] jbd2_journal_start+0x9a/0xce [] ext4_unlink+0x3f/0x1fe [] may_delete+0x5e/0x135 [] vfs_unlink+0x5e/0xa3 [] do_unlinkat+0xc1/0x142 [] audit_syscall_exit+0x2ee/0x30c [] tracesys+0x71/0xda [] tracesys+0xd5/0xda amg D ffff81007e8b3cf8 0 7986 7974 ffff81002d50bb60 0000000000000086 0000000000000000 0000000000000100 ffffffff80600cc0 0000000000000000 0000000000000000 ffff81007ed50000 ffff8101050acde0 ffff81007ed50238 0000000100000000 ffff81007ed50238 Call Trace: [] default_wake_function+0x0/0xe [] __mutex_lock_slowpath+0x6a/0xa0 [] mutex_lock+0xa/0xb [] __jbd2_log_wait_for_space+0x52/0xac [] start_this_handle+0x2eb/0x370 [] jbd2_journal_start+0x9a/0xce [] ext4_dirty_inode+0x28/0x7b [] __mark_inode_dirty+0x29/0x187 [] file_update_time+0xaf/0xf4 [] pipe_write+0x4bc/0x4ce [] mntput_no_expire+0x27/0x11e [] path_walk+0xaf/0xb9 [] do_sync_write+0xce/0x113 [] cp_new_stat+0xe9/0xfc [] autoremove_wake_function+0x0/0x2e [] vfs_write+0xad/0x136 [] sys_write+0x45/0x6e [] tracesys+0xd5/0xda dir_check D ffff81007e8b1690 0 7988 7986 ffff81002d625d70 0000000000000082 ffff81002d625d38 ffff81007edfcb00 ffffffff80600cc0 0000000000000101 ffffffff80293dd5 ffff81007ed542c0 ffff81007ed574d0 ffff81007ed544f8 000000028028c917 ffff81007ed544f8 Call Trace: [] dput+0x21/0x10a [] __link_path_walk+0xca9/0xdd4 [] mntput_no_expire+0x27/0x11e [] __mutex_lock_slowpath+0x6a/0xa0 [] mutex_lock+0xa/0xb [] lock_rename+0x35/0xc5 [] do_rename+0x98/0x1b2 [] cp_new_stat+0xe9/0xfc [] audit_syscall_exit+0x2ee/0x30c [] sys_renameat+0x4c/0x6b [] tracesys+0xd5/0xda afd_stat D 00000000ffffffff 0 7989 7974 ffff81002d461b30 0000000000000082 ffff81002d461da8 ffff81002d461da8 ffffffff80600cc0 ffff81002d461da8 ffffffff802a38d5 ffff81007ed57a60 ffffffff8054d350 ffff81007ed57c98 000000008023e66b ffff81007ed57c98 Call Trace: [] __find_get_block_slow+0xcf/0xdb [] __pollwait+0x0/0xe3 [] do_get_write_access+0x3ab/0x3ed [] getnstimeofday+0x38/0x92 [] __mutex_lock_slowpath+0x6a/0xa0 [] mutex_lock+0xa/0xb [] __jbd2_log_wait_for_space+0x52/0xac [] start_this_handle+0x2eb/0x370 [] pdflush_operation+0x93/0x9d [] jbd2_journal_start+0x9a/0xce [] ext4_dirty_inode+0x28/0x7b [] __mark_inode_dirty+0x29/0x187 [] file_update_time+0xaf/0xf4 [] do_wp_page+0x45b/0x4ba [] handle_mm_fault+0x62d/0x6a3 [] hrtick_set+0xa1/0x10a [] do_page_fault+0x435/0x825 [] do_notify_resume+0x81f/0x840 [] hrtimer_start+0x100/0x122 [] hrtick_start_fair+0x139/0x18a [] hrtick_set+0xa1/0x10a [] audit_syscall_exit+0x2ee/0x30c [] error_exit+0x0/0x51 init_afd D ffff81007e8b3cf8 0 7997 1 ffff81027ee41b30 0000000000000086 ffff81027ee41dd0 ffff81027ee41da8 ffffffff80600cc0 ffff81027ee41db8 0000000000000010 ffff81027ecca160 ffff8101bbec1640 ffff81027ecca398 0000000000000000 ffff81027ecca398 Call Trace: [] __pollwait+0x0/0xe3 [] __mutex_lock_slowpath+0x6a/0xa0 [] mutex_lock+0xa/0xb [] __jbd2_log_wait_for_space+0x52/0xac [] start_this_handle+0x2eb/0x370 [] jbd2_journal_start+0x9a/0xce [] ext4_dirty_inode+0x28/0x7b [] __mark_inode_dirty+0x29/0x187 [] file_update_time+0xaf/0xf4 [] do_wp_page+0x45b/0x4ba [] handle_mm_fault+0x62d/0x6a3 [] do_page_fault+0x435/0x825 [] mntput_no_expire+0x27/0x11e [] cp_new_stat+0xe9/0xfc [] audit_syscall_exit+0x2ee/0x30c [] error_exit+0x0/0x51 transfer_log D 00000000ffffffff 0 8001 7997 ffff81002d681ad0 0000000000000082 ffffffff8028fce8 ffff81007fb8f4d0 ffffffff80600cc0 0000000000000100 ffff8101b1362540 ffff81007fb8f4d0 ffff8101fff33210 ffff81007fb8f708 000000022d681f50 ffff81007fb8f708 Call Trace: [] poll_freewait+0x36/0x87 [] __mutex_lock_slowpath+0x6a/0xa0 [] mutex_lock+0xa/0xb [] __jbd2_log_wait_for_space+0x52/0xac [] start_this_handle+0x2eb/0x370 [] generic_file_buffered_write+0x22c/0x658 [] jbd2_journal_start+0x9a/0xce [] ext4_dirty_inode+0x28/0x7b [] __mark_inode_dirty+0x29/0x187 [] file_update_time+0xaf/0xf4 [] __generic_file_aio_write_nolock+0x265/0x37e [] touch_atime+0x12/0xfa [] __wake_up_sync+0x3a/0x56 [] generic_file_aio_write+0x64/0xc4 [] ext4_file_write+0x96/0x11a [] do_sync_write+0xce/0x113 [] do_page_fault+0x471/0x825 [] autoremove_wake_function+0x0/0x2e [] vfs_write+0xad/0x136 [] sys_write+0x45/0x6e [] tracesys+0xd5/0xda archive_watch D 00000000ffffffff 0 8003 7997 ffff81002d49dce0 0000000000000086 ffffffff802de7cd ffff810000000001 ffffffff80600cc0 ffff810000000001 ffffffff8027ce42 ffff81007fb8ef40 ffff8101fff32160 ffff81007fb8f178 00000001802d9b7a ffff81007fb8f178 Call Trace: [] ext4_getblk+0xb4/0x170 [] get_partial_node+0x15/0x78 [] __d_lookup+0xbd/0x107 [] __mutex_lock_slowpath+0x6a/0xa0 [] mutex_lock+0xa/0xb [] __jbd2_log_wait_for_space+0x52/0xac [] start_this_handle+0x2eb/0x370 [] __link_path_walk+0x6e0/0xdd4 [] jbd2_journal_start+0x9a/0xce [] ext4_unlink+0x3f/0x1fe [] may_delete+0x5e/0x135 [] vfs_unlink+0x5e/0xa3 [] do_unlinkat+0xc1/0x142 [] audit_syscall_exit+0x2ee/0x30c [] tracesys+0x71/0xda [] tracesys+0xd5/0xda input_log D 00000000ffffffff 0 8004 7997 ffff81002d419ad0 0000000000000086 ffffffff8028fce8 ffff81007fb8de90 ffffffff80600cc0 0000000000000100 ffff81027f76aa80 ffff81007fb8de90 ffff8101fff32160 ffff81007fb8e0c8 000000012d419f50 ffff81007fb8e0c8 Call Trace: [] poll_freewait+0x36/0x87 [] __mutex_lock_slowpath+0x6a/0xa0 [] mutex_lock+0xa/0xb [] __jbd2_log_wait_for_space+0x52/0xac [] start_this_handle+0x2eb/0x370 [] generic_file_buffered_write+0x22c/0x658 [] ext4_mark_inode_dirty+0x134/0x147 [] jbd2_journal_start+0x9a/0xce [] ext4_dirty_inode+0x28/0x7b [] __mark_inode_dirty+0x29/0x187 [] file_update_time+0xaf/0xf4 [] __generic_file_aio_write_nolock+0x265/0x37e [] touch_atime+0x12/0xfa [] __wake_up_sync+0x3a/0x56 [] generic_file_aio_write+0x64/0xc4 [] ext4_file_write+0x96/0x11a [] do_sync_write+0xce/0x113 [] autoremove_wake_function+0x0/0x2e [] vfs_write+0xad/0x136 [] sys_write+0x45/0x6e [] tracesys+0xd5/0xda output_log D ffff81007e8b3cf8 0 8005 7997 ffff81002d4fdad0 0000000000000086 ffffffff8028fce8 ffff81007fbbc2c0 ffffffff80600cc0 0000000000000100 ffff81017ff649c0 ffff81007fbbc2c0 ffff81001ce46420 ffff81007fbbc4f8 000000012d4fdf50 ffff81007fbbc4f8 Call Trace: [] poll_freewait+0x36/0x87 [] __mutex_lock_slowpath+0x6a/0xa0 [] mutex_lock+0xa/0xb [] __jbd2_log_wait_for_space+0x52/0xac [] start_this_handle+0x2eb/0x370 [] generic_file_buffered_write+0x22c/0x658 [] ext4_mark_inode_dirty+0x134/0x147 [] jbd2_journal_start+0x9a/0xce [] ext4_dirty_inode+0x28/0x7b [] __mark_inode_dirty+0x29/0x187 [] file_update_time+0xaf/0xf4 [] __generic_file_aio_write_nolock+0x265/0x37e [] touch_atime+0x12/0xfa [] __wake_up_sync+0x3a/0x56 [] generic_file_aio_write+0x64/0xc4 [] ext4_file_write+0x96/0x11a [] do_sync_write+0xce/0x113 [] autoremove_wake_function+0x0/0x2e [] vfs_write+0xad/0x136 [] sys_write+0x45/0x6e [] tracesys+0xd5/0xda production_lo D ffff81007e8b3cf8 0 8007 7997 ffff81002d615ad0 0000000000000082 ffffffff8028fce8 ffff81007d939bd0 ffffffff80600cc0 0000000000000100 ffff81027f76a3c0 ffff81007d939bd0 ffff81007ed50590 ffff81007d939e08 000000012d615f50 ffff81007d939e08 Call Trace: [] poll_freewait+0x36/0x87 [] __mutex_lock_slowpath+0x6a/0xa0 [] mutex_lock+0xa/0xb [] __jbd2_log_wait_for_space+0x52/0xac [] start_this_handle+0x2eb/0x370 [] generic_file_buffered_write+0x22c/0x658 [] ext4_mark_inode_dirty+0x134/0x147 [] jbd2_journal_start+0x9a/0xce [] ext4_dirty_inode+0x28/0x7b [] __mark_inode_dirty+0x29/0x187 [] file_update_time+0xaf/0xf4 [] __generic_file_aio_write_nolock+0x265/0x37e [] touch_atime+0x12/0xfa [] __wake_up_sync+0x3a/0x56 [] generic_file_aio_write+0x64/0xc4 [] ext4_file_write+0x96/0x11a [] do_sync_write+0xce/0x113 [] mmap_region+0x41a/0x505 [] autoremove_wake_function+0x0/0x2e [] vfs_write+0xad/0x136 [] sys_write+0x45/0x6e [] tracesys+0xd5/0xda distribution_ D 00000000ffffffff 0 8008 7997 ffff81002d53fad0 0000000000000086 ffffffff8028fce8 ffff81007d93ac80 ffffffff80600cc0 0000000000000100 ffff81007f300600 ffff81007d93ac80 ffff8101fff33210 ffff81007d93aeb8 000000022d53ff50 ffff81007d93aeb8 Call Trace: [] poll_freewait+0x36/0x87 [] __mutex_lock_slowpath+0x6a/0xa0 [] mutex_lock+0xa/0xb [] __jbd2_log_wait_for_space+0x52/0xac [] start_this_handle+0x2eb/0x370 [] generic_file_buffered_write+0x22c/0x658 [] jbd2_journal_start+0x9a/0xce [] ext4_dirty_inode+0x28/0x7b [] __mark_inode_dirty+0x29/0x187 [] file_update_time+0xaf/0xf4 [] __generic_file_aio_write_nolock+0x265/0x37e [] touch_atime+0x12/0xfa [] __wake_up_sync+0x3a/0x56 [] generic_file_aio_write+0x64/0xc4 [] ext4_file_write+0x96/0x11a [] do_sync_write+0xce/0x113 [] autoremove_wake_function+0x0/0x2e [] hrtick_set+0xa1/0x10a [] vfs_write+0xad/0x136 [] sys_write+0x45/0x6e [] tracesys+0xd5/0xda dir_check D ffff81007e8b1690 0 8011 8009 ffff8101e1359d70 0000000000000082 ffff8101e1359d38 ffff81007edfcb00 ffffffff80600cc0 0000000000000101 ffffffff80293dd5 ffff8101bbec10b0 ffff81007fb8de90 ffff8101bbec12e8 000000018028c917 ffff8101bbec12e8 Call Trace: [] dput+0x21/0x10a [] __link_path_walk+0xca9/0xdd4 [] mntput_no_expire+0x27/0x11e [] __mutex_lock_slowpath+0x6a/0xa0 [] mutex_lock+0xa/0xb [] lock_rename+0x35/0xc5 [] do_rename+0x98/0x1b2 [] cp_new_stat+0xe9/0xfc [] audit_syscall_exit+0x2ee/0x30c [] sys_renameat+0x4c/0x6b [] tracesys+0xd5/0xda afd_stat D ffff81007e8b3cf8 0 8012 7997 ffff81002d69bb30 0000000000000082 ffff81002d69bda8 ffff81002d69bda8 ffffffff80600cc0 ffff81002d69bda8 ffffffff802a38d5 ffff81007d93c2c0 ffff81027eccd900 ffff81007d93c4f8 000000008023e66b ffff81007d93c4f8 Call Trace: [] __find_get_block_slow+0xcf/0xdb [] __pollwait+0x0/0xe3 [] do_get_write_access+0x3ab/0x3ed [] __mutex_lock_slowpath+0x6a/0xa0 [] mutex_lock+0xa/0xb [] __jbd2_log_wait_for_space+0x52/0xac [] start_this_handle+0x2eb/0x370 [] __wake_up+0x38/0x4f [] jbd2_journal_start+0x9a/0xce [] ext4_dirty_inode+0x28/0x7b [] __mark_inode_dirty+0x29/0x187 [] file_update_time+0xaf/0xf4 [] do_wp_page+0x45b/0x4ba [] handle_mm_fault+0x62d/0x6a3 [] hrtick_set+0xa1/0x10a [] do_page_fault+0x435/0x825 [] do_notify_resume+0x81f/0x840 [] hrtimer_start+0x100/0x122 [] hrtick_start_fair+0x139/0x18a [] hrtick_set+0xa1/0x10a [] audit_syscall_exit+0x2ee/0x30c [] error_exit+0x0/0x51 init_afd D 00000000ffffffff 0 8020 1 ffff8101bbdd5b30 0000000000000086 ffff8101bbdd5dd0 ffff8101bbdd5da8 ffffffff80600cc0 ffff8101bbdd5db8 0000000000000010 ffff8101bbec1640 ffffffff8054d350 ffff8101bbec1878 0000000000000000 ffff8101bbec1878 Call Trace: [] __pollwait+0x0/0xe3 [] __mutex_lock_slowpath+0x6a/0xa0 [] mutex_lock+0xa/0xb [] __jbd2_log_wait_for_space+0x52/0xac [] start_this_handle+0x2eb/0x370 [] jbd2_journal_start+0x9a/0xce [] ext4_dirty_inode+0x28/0x7b [] __mark_inode_dirty+0x29/0x187 [] file_update_time+0xaf/0xf4 [] do_wp_page+0x45b/0x4ba [] handle_mm_fault+0x62d/0x6a3 [] do_page_fault+0x435/0x825 [] mntput_no_expire+0x27/0x11e [] cp_new_stat+0xe9/0xfc [] audit_syscall_exit+0x2ee/0x30c [] error_exit+0x0/0x51 receive_log D 00000000ffffffff 0 8023 8020 ffff81027ee1bad0 0000000000000086 ffffffff8028fce8 ffff81027eccc2c0 ffffffff80600cc0 0000000000000100 ffff81007f300000 ffff81027eccc2c0 ffff8101fff33210 ffff81027eccc4f8 000000027ee1bf50 ffff81027eccc4f8 Call Trace: [] poll_freewait+0x36/0x87 [] __mutex_lock_slowpath+0x6a/0xa0 [] mutex_lock+0xa/0xb [] __jbd2_log_wait_for_space+0x52/0xac [] start_this_handle+0x2eb/0x370 [] __ext4_journal_dirty_metadata+0x1e/0x46 [] jbd2_journal_start+0x9a/0xce [] ext4_dirty_inode+0x28/0x7b [] __mark_inode_dirty+0x29/0x187 [] file_update_time+0xaf/0xf4 [] __generic_file_aio_write_nolock+0x265/0x37e [] do_lookup+0x63/0x1a1 [] touch_atime+0x12/0xfa [] __wake_up_sync+0x3a/0x56 [] generic_file_aio_write+0x64/0xc4 [] ext4_file_write+0x96/0x11a [] do_sync_write+0xce/0x113 [] cp_new_stat+0xe9/0xfc [] autoremove_wake_function+0x0/0x2e [] vfs_write+0xad/0x136 [] sys_write+0x45/0x6e [] tracesys+0xd5/0xda transfer_log D 00000000ffffffff 0 8024 8020 ffff81027f799ad0 0000000000000086 ffffffff8028fce8 ffff81027eccc850 ffffffff80600cc0 0000000000000100 ffff81027d7443c0 ffff81027eccc850 ffffffff8054d350 ffff81027eccca88 000000007f799f50 ffff81027eccca88 Call Trace: [] poll_freewait+0x36/0x87 [