Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1753894Ab3H1GFN (ORCPT ); Wed, 28 Aug 2013 02:05:13 -0400 Received: from mail-pa0-f41.google.com ([209.85.220.41]:43208 "EHLO mail-pa0-f41.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752390Ab3H1GFK (ORCPT ); Wed, 28 Aug 2013 02:05:10 -0400 Date: Tue, 27 Aug 2013 23:05:21 -0700 From: Kent Overstreet To: kernel neophyte Cc: Stefan Priebe , Jens Axboe , linux-kernel@vger.kernel.org, linux-bcache@vger.kernel.org Subject: Re: bcache: Fix a writeback performance regression Message-ID: <20130828060521.GC8032@kmo-pixel> References: <52132243.8050803@profihost.ag> <521323D1.1070503@profihost.ag> <20130821234715.GA4630@moria.home.lan> <5215A130.9080508@profihost.ag> <20130822054336.GA14935@kmo-pixel> <5215A8A8.90900@profihost.ag> <20130822060215.GB14935@kmo-pixel> <5215BEA4.6040101@profihost.ag> <521BAACB.4070003@profihost.ag> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 22244 Lines: 401 On Tue, Aug 27, 2013 at 08:37:54PM -0700, kernel neophyte wrote: > Hi Kent, > > I am still seeing deadlock: Seeing blk_throtl_bio (what asshole misspells words in their function names, so when you go to grep for them you grep for the wrong thing?) in the backtrace - is that what it takes to hit it? > > [ 930.169234] bcache: bch_cached_dev_attach() Caching sda3 as bcache0 > on set 06496904-10ca-489a-ae75-68c6a07d3db1 > [ 2522.956188] INFO: task bcache_writebac:2058 blocked for more than > 120 seconds. > [ 2522.956199] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" > disables this message. > [ 2522.956205] bcache_writebac D ffffffff81813a60 0 2058 2 0x00000000 > [ 2522.956212] ffff881c39c1fcd8 0000000000000046 0000000000000001 > 0000000000000001 > [ 2522.956218] ffff882f8b56b320 ffff881c39c1ffd8 ffff881c39c1ffd8 > ffff881c39c1ffd8 > [ 2522.956222] ffff882fa6aeb320 ffff882f8b56b320 ffff882f8b56b320 > ffff882f8b56b320 > [ 2522.956227] Call Trace: > [ 2522.956241] [] schedule+0x29/0x70 > [ 2522.956247] [] rwsem_down_write_failed+0xf5/0x1a0 > [ 2522.956255] [] call_rwsem_down_write_failed+0x13/0x20 > [ 2522.956261] [] ? down_write+0x31/0x40 > [ 2522.956269] [] bch_writeback_thread+0x62/0x7f0 > [ 2522.956278] [] ? idle_balance+0xeb/0x150 > [ 2522.956284] [] ? write_dirty+0xc0/0xc0 > [ 2522.956290] [] kthread+0xc0/0xd0 > [ 2522.956294] [] ? flush_kthread_worker+0xb0/0xb0 > [ 2522.956302] [] ret_from_fork+0x7c/0xb0 > [ 2522.956306] [] ? flush_kthread_worker+0xb0/0xb0 > [ 2522.956313] INFO: task kworker/u64:1:2433 blocked for more than 120 seconds. > [ 2522.956317] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" > disables this message. > [ 2522.956322] kworker/u64:1 D ffffffff81813a60 0 2433 2 0x00000000 > [ 2522.956332] Workqueue: writeback bdi_writeback_workfn (flush-252:0) > [ 2522.956336] ffff882f899d1560 0000000000000046 ffffffff81120635 > 0000000000000100 > [ 2522.956340] ffff88219b488000 ffff882f899d1fd8 ffff882f899d1fd8 > ffff882f899d1fd8 > [ 2522.956345] ffff882fa6aeb320 ffff88219b488000 ffffffff8131ad55 > ffff88219b488000 > [ 2522.956349] Call Trace: > [ 2522.956359] [] ? mempool_alloc_slab+0x15/0x20 > [ 2522.956367] [] ? blk_throtl_bio+0x3b5/0x540 > [ 2522.956372] [] schedule+0x29/0x70 > [ 2522.956378] [] rwsem_down_read_failed+0x9d/0xe5 > [ 2522.956383] [] call_rwsem_down_read_failed+0x14/0x30 > [ 2522.956388] [] ? down_read+0x24/0x2b > [ 2522.956394] [] cached_dev_make_request+0x752/0xf00 > [ 2522.956400] [] ? generic_make_request_checks+0x1e8/0x3a0 > [ 2522.956405] [] generic_make_request+0xca/0x100 > [ 2522.956409] [] submit_bio+0x79/0x160 > [ 2522.956417] [] ? bio_alloc_bioset+0xa0/0x1d0 > [ 2522.956421] [] _submit_bh+0x13f/0x200 > [ 2522.956425] [] submit_bh+0x10/0x20 > [ 2522.956430] [] __block_write_full_page+0x1d8/0x360 > [ 2522.956439] [] ? scsi_request_fn+0xbb/0x530 > [ 2522.956444] [] ? end_buffer_async_read+0x130/0x130 > [ 2522.956449] [] ? I_BDEV+0x10/0x10 > [ 2522.956454] [] ? I_BDEV+0x10/0x10 > [ 2522.956459] [] block_write_full_page_endio+0xca/0x100 > [ 2522.956464] [] block_write_full_page+0x15/0x20 > [ 2522.956469] [] blkdev_writepage+0x18/0x20 > [ 2522.956473] [] __writepage+0x17/0x40 > [ 2522.956477] [] write_cache_pages+0x20e/0x460 > [ 2522.956481] [] ? set_page_dirty_lock+0x60/0x60 > [ 2522.956486] [] ? __set_page_dirty+0x71/0xc0 > [ 2522.956490] [] generic_writepages+0x4a/0x70 > [ 2522.956495] [] do_writepages+0x20/0x40 > [ 2522.956501] [] __writeback_single_inode+0x45/0x280 > [ 2522.956507] [] ? __alloc_pages_nodemask+0x152/0x9b0 > [ 2522.956513] [] writeback_sb_inodes+0x19d/0x3c0 > [ 2522.956518] [] __writeback_inodes_wb+0x9e/0xd0 > [ 2522.956523] [] wb_writeback+0x27b/0x320 > [ 2522.956529] [] ? get_nr_dirty_inodes+0x58/0x80 > [ 2522.956534] [] wb_check_old_data_flush+0x9f/0xb0 > [ 2522.956539] [] wb_do_writeback+0x151/0x1d0 > [ 2522.956547] [] ? set_worker_desc+0x6f/0x80 > [ 2522.956552] [] bdi_writeback_workfn+0x7a/0x200 > [ 2522.956557] [] process_one_work+0x174/0x490 > [ 2522.956562] [] worker_thread+0x11b/0x370 > [ 2522.956567] [] ? manage_workers.isra.23+0x2d0/0x2d0 > [ 2522.956571] [] kthread+0xc0/0xd0 > [ 2522.956575] [] ? flush_kthread_worker+0xb0/0xb0 > [ 2522.956581] [] ret_from_fork+0x7c/0xb0 > [ 2522.956585] [] ? flush_kthread_worker+0xb0/0xb0 > [ 2522.956588] INFO: task iozone:2435 blocked for more than 120 seconds. > [ 2522.956593] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" > disables this message. > [ 2522.956597] iozone D 0000000000000001 0 2435 1545 0x00000000 > [ 2522.956602] ffff882a75671978 0000000000000082 ffff882a75671938 > ffffffff81301d7a > [ 2522.956606] ffff882f88dc1990 ffff882a75671fd8 ffff882a75671fd8 > ffff882a75671fd8 > [ 2522.956611] ffff882f8ec91990 ffff882f88dc1990 ffff882a75671978 > ffff882fbf2539f8 > [ 2522.956615] Call Trace: > [ 2522.956619] [] ? generic_make_request+0xca/0x100 > [ 2522.956625] [] schedule+0x29/0x70 > [ 2522.956630] [] io_schedule+0x8f/0xd0 > [ 2522.956636] [] do_blockdev_direct_IO+0x1a7c/0x1fb0 > [ 2522.956645] [] ? ext2_get_blocks+0xa60/0xa60 [ext2] > [ 2522.956652] [] __blockdev_direct_IO+0x55/0x60 > [ 2522.956658] [] ? ext2_get_blocks+0xa60/0xa60 [ext2] > [ 2522.956662] [] ? update_curr+0x141/0x1f0 > [ 2522.956669] [] ext2_direct_IO+0x79/0xe0 [ext2] > [ 2522.956674] [] ? ext2_get_blocks+0xa60/0xa60 [ext2] > [ 2522.956680] [] ? current_fs_time+0x16/0x60 > [ 2522.956685] [] generic_file_direct_write+0xc6/0x180 > [ 2522.956690] [] __generic_file_aio_write+0x2dd/0x3b0 > [ 2522.956696] [] generic_file_aio_write+0x69/0xd0 > [ 2522.956702] [] do_sync_write+0x7a/0xb0 > [ 2522.956706] [] ? fsnotify+0x1f8/0x2b0 > [ 2522.956712] [] vfs_write+0xce/0x1e0 > [ 2522.956716] [] SyS_write+0x52/0xa0 > [ 2522.956722] [] system_call_fastpath+0x16/0x1b > [ 2522.956726] INFO: task kworker/2:1:2470 blocked for more than 120 seconds. > [ 2522.956730] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" > disables this message. > [ 2522.956735] kworker/2:1 D ffffffff81813d40 0 2470 2 0x00000000 > [ 2522.956743] Workqueue: bcache bch_data_insert_keys > [ 2522.956745] ffff882a5b0c9628 0000000000000046 ffff882a5b0c9648 > 0000004000000000 > [ 2522.956749] ffff882f8ec91990 ffff882a5b0c9fd8 ffff882a5b0c9fd8 > ffff882a5b0c9fd8 > [ 2522.956754] ffff882fa6489990 ffff882f8ec91990 ffff882f8ec91990 > ffff8828dba00d98 > [ 2522.956758] Call Trace: > [ 2522.956763] [] schedule+0x29/0x70 > [ 2522.956769] [] schedule_preempt_disabled+0xe/0x10 > [ 2522.956774] [] __mutex_lock_slowpath+0x112/0x1b0 > [ 2522.956779] [] mutex_lock+0x2a/0x50 > [ 2522.956783] [] bch_mca_shrink+0x1b5/0x2f0 > [ 2522.956791] [] ? prune_super+0x162/0x1b0 > [ 2522.956799] [] shrink_slab+0x154/0x300 > [ 2522.956805] [] ? resched_task+0x68/0x70 > [ 2522.956810] [] ? check_preempt_curr+0x75/0xa0 > [ 2522.956816] [] ? fragmentation_index+0x19/0x70 > [ 2522.956822] [] do_try_to_free_pages+0x20f/0x4b0 > [ 2522.956827] [] try_to_free_pages+0xe4/0x1a0 > [ 2522.956833] [] __alloc_pages_nodemask+0x60c/0x9b0 > [ 2522.956843] [] alloc_pages_current+0xba/0x170 > [ 2522.956848] [] __get_free_pages+0xe/0x40 > [ 2522.956852] [] mca_data_alloc+0x73/0x1d0 > [ 2522.956857] [] mca_bucket_alloc+0x14a/0x1f0 > [ 2522.956861] [] mca_alloc+0x360/0x470 > [ 2522.956866] [] ? __bch_bset_search+0x1d1/0x480 > [ 2522.956871] [] bch_btree_node_get+0x10e/0x280 > [ 2522.956875] [] bch_btree_map_nodes_recurse+0xe2/0x170 > [ 2522.956880] [] ? bch_btree_insert_node+0x2f0/0x2f0 > [ 2522.956886] [] ? dio_bio_end_io+0x5a/0x90 > [ 2522.956890] [] ? update_curr+0x141/0x1f0 > [ 2522.956895] [] __bch_btree_map_nodes+0x13e/0x1c0 > [ 2522.956899] [] ? bch_btree_insert_node+0x2f0/0x2f0 > [ 2522.956905] [] ? bch_journal+0x42f/0x4b0 > [ 2522.956909] [] bch_btree_insert+0xb4/0x120 > [ 2522.956915] [] bch_data_insert_keys+0x3e/0x160 > [ 2522.956920] [] process_one_work+0x174/0x490 > [ 2522.956925] [] worker_thread+0x11b/0x370 > [ 2522.956930] [] ? manage_workers.isra.23+0x2d0/0x2d0 > [ 2522.956933] [] kthread+0xc0/0xd0 > [ 2522.956938] [] ? flush_kthread_worker+0xb0/0xb0 > [ 2522.956943] [] ret_from_fork+0x7c/0xb0 > [ 2522.956947] [] ? flush_kthread_worker+0xb0/0xb0 > [ 2522.956951] INFO: task kworker/3:2:2471 blocked for more than 120 seconds. > [ 2522.956955] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" > disables this message. > [ 2522.956959] kworker/3:2 D ffffffff81813a60 0 2471 2 0x00000000 > [ 2522.956966] Workqueue: events update_writeback_rate > [ 2522.956968] ffff882a5d125cd0 0000000000000046 0000000000000003 > ffff882a5d125d68 > [ 2522.956972] ffff882f8ec94cb0 ffff882a5d125fd8 ffff882a5d125fd8 > ffff882a5d125fd8 > [ 2522.956977] ffff882fa6aeb320 ffff882f8ec94cb0 0000000200000003 > ffff882f8ec94cb0 > [ 2522.956981] Call Trace: > [ 2522.956987] [] schedule+0x29/0x70 > [ 2522.956992] [] rwsem_down_read_failed+0x9d/0xe5 > [ 2522.956997] [] call_rwsem_down_read_failed+0x14/0x30 > [ 2522.957002] [] ? down_read+0x24/0x2b > [ 2522.957007] [] update_writeback_rate+0x30/0x230 > [ 2522.957011] [] process_one_work+0x174/0x490 > [ 2522.957017] [] worker_thread+0x11b/0x370 > [ 2522.957021] [] ? manage_workers.isra.23+0x2d0/0x2d0 > [ 2522.957025] [] kthread+0xc0/0xd0 > [ 2522.957030] [] ? flush_kthread_worker+0xb0/0xb0 > [ 2522.957035] [] ret_from_fork+0x7c/0xb0 > [ 2522.957039] [] ? flush_kthread_worker+0xb0/0xb0 > [ 2522.957048] INFO: task kworker/u64:2:2540 blocked for more than 120 seconds. > [ 2522.957052] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" > disables this message. > [ 2522.957056] kworker/u64:2 D ffffffff81813a60 0 2540 2 0x00000000 > [ 2522.957062] Workqueue: bch_btree_io btree_node_write_work > [ 2522.957064] ffff882a4fdc9778 0000000000000046 ffff882a4fdc9738 > ffff882f86e3be58 > [ 2522.957069] ffff882fa4bc1990 ffff882a4fdc9fd8 ffff882a4fdc9fd8 > ffff882a4fdc9fd8 > [ 2522.957073] ffff882fa6aeb320 ffff882fa4bc1990 ffff882f86e3be00 > ffff8828dba00d98 > [ 2522.957078] Call Trace: > [ 2522.957083] [] schedule+0x29/0x70 > [ 2522.957088] [] schedule_preempt_disabled+0xe/0x10 > [ 2522.957092] [] __mutex_lock_slowpath+0x112/0x1b0 > [ 2522.957102] [] ? ata_scsiop_mode_sense+0x380/0x380 > [ 2522.957107] [] mutex_lock+0x2a/0x50 > [ 2522.957111] [] bch_mca_shrink+0x1b5/0x2f0 > [ 2522.957116] [] ? prune_super+0x162/0x1b0 > [ 2522.957121] [] shrink_slab+0x154/0x300 > [ 2522.957126] [] ? resched_task+0x68/0x70 > [ 2522.957130] [] ? check_preempt_curr+0x75/0xa0 > [ 2522.957135] [] ? fragmentation_index+0x19/0x70 > [ 2522.957140] [] do_try_to_free_pages+0x20f/0x4b0 > [ 2522.957146] [] try_to_free_pages+0xe4/0x1a0 > [ 2522.957152] [] __alloc_pages_nodemask+0x60c/0x9b0 > [ 2522.957158] [] alloc_pages_current+0xba/0x170 > [ 2522.957163] [] __get_free_pages+0xe/0x40 > [ 2522.957168] [] __btree_sort+0x48/0x230 > [ 2522.957173] [] ? __bch_btree_iter_init+0x7c/0xc0 > [ 2522.957178] [] bch_btree_sort_partial+0x101/0x120 > [ 2522.957182] [] ? __btree_node_write_done+0x100/0x100 > [ 2522.957187] [] bch_btree_sort_lazy+0x68/0x90 > [ 2522.957191] [] bch_btree_node_write+0x36a/0x4a0 > [ 2522.957196] [] ? idle_balance+0xeb/0x150 > [ 2522.957201] [] ? pwq_activate_delayed_work+0x4c/0xb0 > [ 2522.957205] [] btree_node_write_work+0x57/0x80 > [ 2522.957210] [] process_one_work+0x174/0x490 > [ 2522.957215] [] worker_thread+0x11b/0x370 > [ 2522.957219] [] ? manage_workers.isra.23+0x2d0/0x2d0 > [ 2522.957223] [] kthread+0xc0/0xd0 > [ 2522.957228] [] ? flush_kthread_worker+0xb0/0xb0 > [ 2522.957233] [] ret_from_fork+0x7c/0xb0 > [ 2522.957237] [] ? flush_kthread_worker+0xb0/0xb0 > > > I can easily reproduce this, please let me know if you require any > info/test any patch. > > Thanks, > Neo > > On Mon, Aug 26, 2013 at 12:21 PM, Stefan Priebe wrote: > > Hi Kent, > > > > a new one under 3.10: > > > > 2013-08-26 21:05:30 INFO: task ceph-osd:8939 blocked for more than 120 > > seconds. > > 2013-08-26 21:05:30 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" > > disables this message. > > 2013-08-26 21:05:30 ceph-osd D ffffffff8160f760 0 8939 1 0x00000000 > > 2013-08-26 21:05:30 ffff880bd9a61820 0000000000000086 ffff880bd9a61fd8 > > 0000000000012c80 > > 2013-08-26 21:05:30 ffff880bd9a60010 0000000000012c80 0000000000012c80 > > 0000000000012c80 > > 2013-08-26 21:05:30 ffff880bd9a61fd8 0000000000012c80 ffff880bd7abb1c0 > > ffff880c48dee380 > > 2013-08-26 21:05:29 [] xfs_vm_readpages+0x18/0x20 > > 2013-08-26 21:05:29 [] read_pages+0x43/0x100 > > 2013-08-26 21:05:29 [] ? __page_cache_alloc+0x9f/0xc0 > > 2013-08-26 21:05:29 [] > > __do_page_cache_readahead+0x14b/0x160 > > 2013-08-26 21:05:29 [] ra_submit+0x1c/0x20 > > 2013-08-26 21:05:29 [] ondemand_readahead+0x115/0x240 > > 2013-08-26 21:05:29 [] > > page_cache_sync_readahead+0x2e/0x40 > > 2013-08-26 21:05:29 [] T.1003+0x33e/0x430 > > 2013-08-26 21:05:29 [] > > generic_file_aio_read+0xe0/0x220 > > 2013-08-26 21:05:29 [] xfs_file_aio_read+0x15a/0x2a0 > > 2013-08-26 21:05:29 [] do_sync_read+0x7a/0xb0 > > 2013-08-26 21:05:29 [] vfs_read+0xb1/0x130 > > 2013-08-26 21:05:29 [] SyS_pread64+0x97/0xa0 > > 2013-08-26 21:05:29 [] system_call_fastpath+0x16/0x1b > > 2013-08-26 21:05:29 INFO: task ceph-osd:8896 blocked for more than 120 > > seconds. > > 2013-08-26 21:05:29 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" > > disables this message. > > 2013-08-26 21:05:29 ceph-osd D ffffffff8160f760 0 8896 1 0x00000000 > > 2013-08-26 21:05:29 ffff880bd9a9dc28 0000000000000086 ffff880bd9a9dfd8 > > 0000000000012c80 > > 2013-08-26 21:05:29 ffff880bd9a9c010 0000000000012c80 0000000000012c80 > > 0000000000012c80 > > 2013-08-26 21:05:29 ffff880bd9a9dfd8 0000000000012c80 ffff880bd79298e0 > > ffff880c48dd6380 > > 2013-08-26 21:05:29 Call Trace: > > 2013-08-26 21:05:29 [] ? __lock_page+0x70/0x70 > > 2013-08-26 21:05:28 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" > > disables this message. > > 2013-08-26 21:05:28 ceph-osd D ffffffff8160f760 0 8798 1 0x00000000 > > 2013-08-26 21:05:28 ffff880bd998b740 0000000000000086 ffff880bd998bfd8 > > 0000000000012c80 > > 2013-08-26 21:05:28 ffff880bd998a010 0000000000012c80 0000000000012c80 > > 0000000000012c80 > > 2013-08-26 21:05:28 ffff880bd998bfd8 0000000000012c80 ffff880bd99c0000 > > ffff880c48dd6380 > > 2013-08-26 21:05:28 Call Trace: > > 2013-08-26 21:05:28 [] schedule+0x24/0x70 > > 2013-08-26 21:05:28 [] > > rwsem_down_read_failed+0x9d/0xe5 > > 2013-08-26 21:05:28 [] > > call_rwsem_down_read_failed+0x14/0x30 > > 2013-08-26 21:05:28 [] ? down_read+0x12/0x20 > > 2013-08-26 21:05:28 [] btree_read_async+0xa2/0x1a0 > > [bcache] > > 2013-08-26 21:05:28 [] closure_queue+0x43/0x60 > > [bcache] > > 2013-08-26 21:05:28 [] T.1050+0x63/0x70 [bcache] > > 2013-08-26 21:05:28 [] > > cached_dev_make_request+0x20a/0x350 [bcache] > > 2013-08-26 21:05:28 [] generic_make_request+0xc2/0x100 > > 2013-08-26 21:05:28 [] submit_bio+0x67/0x130 > > 2013-08-26 21:05:28 [] do_mpage_readpage+0x2a0/0x660 > > 2013-08-26 21:05:28 [] ? > > __inc_zone_page_state+0x2e/0x30 > > 2013-08-26 21:05:28 [] ? > > add_to_page_cache_locked+0x81/0x110 > > 2013-08-26 21:05:28 [] mpage_readpages+0xfa/0x150 > > 2013-08-26 21:05:28 [] ? > > xfs_get_blocks_direct+0x20/0x20 > > 2013-08-26 21:05:28 [] ? > > xfs_get_blocks_direct+0x20/0x20 > > 2013-08-26 21:05:28 [] ? > > __alloc_pages_nodemask+0x123/0x240 > > 2013-08-26 21:05:27 [] ? __close_fd+0x43/0x80 > > 2013-08-26 21:05:27 [] SyS_fdatasync+0xe/0x20 > > 2013-08-26 21:05:27 [] system_call_fastpath+0x16/0x1b > > 2013-08-26 21:05:27 INFO: task ceph-osd:8746 blocked for more than 120 > > seconds. > > 2013-08-26 21:05:27 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" > > disables this message. > > 2013-08-26 21:05:27 ceph-osd D ffffffff8160f760 0 8746 1 0x00000000 > > 2013-08-26 21:05:27 ffff880c2dde1d38 0000000000000086 ffff880c2dde1fd8 > > 0000000000012c80 > > 2013-08-26 21:05:27 ffff880c2dde0010 0000000000012c80 0000000000012c80 > > 0000000000012c80 > > 2013-08-26 21:05:27 ffff880c2dde1fd8 0000000000012c80 ffff880c239eb1c0 > > ffff880c48dd6380 > > 2013-08-26 21:05:27 Call Trace: > > 2013-08-26 21:05:27 [] schedule+0x24/0x70 > > 2013-08-26 21:05:27 [] schedule_timeout+0x16d/0x200 > > 2013-08-26 21:05:27 [] ? > > __queue_delayed_work+0xaa/0x1a0 > > 2013-08-26 21:05:27 [] ? > > try_to_grab_pending+0x109/0x190 > > 2013-08-26 21:05:27 [] wait_for_completion+0x95/0x110 > > 2013-08-26 21:05:27 [] ? try_to_wake_up+0x2a0/0x2a0 > > 2013-08-26 21:05:27 [] ? bdi_queue_work+0x77/0xc0 > > 2013-08-26 21:05:27 [] > > writeback_inodes_sb_nr+0x83/0xb0 > > 2013-08-26 21:05:27 [] writeback_inodes_sb+0x5a/0x70 > > 2013-08-26 21:05:27 [] __sync_filesystem+0x4a/0x50 > > 2013-08-26 21:05:27 [] sync_filesystem+0x32/0x60 > > 2013-08-26 21:05:27 [] SyS_syncfs+0x50/0x90 > > 2013-08-26 21:05:27 [] system_call_fastpath+0x16/0x1b > > 2013-08-26 21:05:27 INFO: task ceph-osd:8798 blocked for more than 120 > > seconds. > > > > Stefan > > > > Am 22.08.2013 09:32, schrieb Stefan Priebe - Profihost AG: > > > >> great! > >> > >> Everything seems to work fine now! Except read_dirty always going to > >> negative values after a reboot. > >> > >> Stefan > >> > >> Am 22.08.2013 08:02, schrieb Kent Overstreet: > >>> > >>> On Thu, Aug 22, 2013 at 07:59:04AM +0200, Stefan Priebe wrote: > >>>> > >>>> > >>>>> schedule_timeout() is not the same as > >>>>> schedule_timeout_interruptible(). > >>>> > >>>> > >>>> just search and replace? So i can try on my own. > >>> > >>> > >>> The one in read_dirty(), line ~330 > >>> -- > >>> To unsubscribe from this list: send the line "unsubscribe linux-bcache" > >>> in > >>> the body of a message to majordomo@vger.kernel.org > >>> More majordomo info at http://vger.kernel.org/majordomo-info.html > >>> > > -- > > To unsubscribe from this list: send the line "unsubscribe linux-bcache" in > > the body of a message to majordomo@vger.kernel.org > > More majordomo info at http://vger.kernel.org/majordomo-info.html -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/