From: Tony Luck Subject: Re: Re: EXT4 panic at jbd2_journal_put_journal_head() in 3.9+ Date: Fri, 10 May 2013 10:27:58 -0700 Message-ID: References: <6719519.5821368147110937.JavaMail.weblogic@epml17> Mime-Version: 1.0 Content-Type: multipart/mixed; boundary=089e0139ff30fa85b004dc607cdf Cc: "Theodore Ts'o" , "linux-ext4@vger.kernel.org" , "linux-kernel@vger.kernel.org" To: eunb.song@samsung.com Return-path: Received: from mail-vc0-f182.google.com ([209.85.220.182]:53119 "EHLO mail-vc0-f182.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1755671Ab3EJR17 (ORCPT ); Fri, 10 May 2013 13:27:59 -0400 In-Reply-To: <6719519.5821368147110937.JavaMail.weblogic@epml17> Sender: linux-ext4-owner@vger.kernel.org List-ID: --089e0139ff30fa85b004dc607cdf Content-Type: text/plain; charset=ISO-8859-1 I think I have the same (or highly similar) thing happening on ia64. Similarities: seeing assertions fail for b_transaction Differences: I only have ext3 filesystems mounted, no ext4 See attached trace. I'm pretty certain that the highly unhelpful bugcheck! 0 [1] comes from the J_ASSERT_JH(jh, jh->b_transaction == NULL); from disassembling __journal_remove_journal_head(). The instruction pointer points to the 2nd "break" instruction in the function. The problem shows up after 30 minutes to a couple of hours of stress (kernel builds with "make -j32"). I'm pretty sure this problem didn't occur in plain v3.9 (it can run for a full 24 hours). Trying to bisect - but it takes a while to be convinced that a good kernel is actually good (since I don't have a clear picture of how long to run before deciding that the bug isn't going to show) -Tony --089e0139ff30fa85b004dc607cdf Content-Type: application/octet-stream; name=bug Content-Disposition: attachment; filename=bug Content-Transfer-Encoding: base64 X-Attachment-Id: f_hgjmj3tb0 V2VsY29tZSB0byBTVVNFIExpbnV4IEVudGVycHJpc2UgU2VydmVyIDExIFNQMSAgKGlhNjQpIC0g S2VybmVsIDMuOS4wLWdlbmVyaWMtc21wLTEwOTk2LWcwZjQ3Yzk0ICh0dHlTMCkuCgoKbGludXgt YnhiMSBsb2dpbjogbGRbMTYzMTBdOiBidWdjaGVjayEgMCBbMV0KTW9kdWxlcyBsaW5rZWQgaW46 IG5mcyBkbnNfcmVzb2x2ZXIgbG9ja2Qgc3VucnBjIGJpbmZtdF9taXNjIGxvb3Agc3JfbW9kIGRt X21vZCB1c2Jfc3RvcmFnZSBlaGNpX3BjaSBzZyBidXR0b24gdXNiaGlkIHVoY2lfaGNkIGVoY2lf aGNkIHVzYmNvcmUgdXNiX2NvbW1vbiBmYW4gcHJvY2Vzc29yIHRoZXJtYWwgdGhlcm1hbF9zeXMK CkNQVTogMjkgUElEOiAxNjMxMCBDb21tOiBsZCBOb3QgdGFpbnRlZCAzLjkuMC1nZW5lcmljLXNt cC0xMDk5Ni1nMGY0N2M5NCAjMTYKSGFyZHdhcmUgbmFtZTogU3VwZXJtaWNybyBJOFFCSC9JOFFC SCwgQklPUyBJOFFCSCAxNS4wMDYuMDA0UkFTIDIwMTAvMDUvMTAKdGFzazogZTAwMDAwMDMxNmU1 MDAwMCB0aTogZTAwMDAwMDMxNmU1MGUxMCB0YXNrLnRpOiBlMDAwMDAwMzE2ZTUwZTEwCnBzciA6 IDAwMDAxMDEwMDg1MjYwMzggaWZzIDogODAwMDAwMDAwMDAwMDM4YSBpcCAgOiBbPGEwMDAwMDAx MDAzZDY2OTA+XSAgICBOb3QgdGFpbnRlZCAoMy45LjAtZ2VuZXJpYy1zbXAtMTA5OTYtZzBmNDdj OTQpCmlwIGlzIGF0IF9fam91cm5hbF9yZW1vdmVfam91cm5hbF9oZWFkKzB4NTMwLzB4NmMwCnVu YXQ6IDAwMDAwMDAwMDAwMDAwMDAgcGZzIDogMDAwMDAwMDAwMDAwMDM4YSByc2MgOiAwMDAwMDAw MDAwMDAwMDAzCnJuYXQ6IDAwMDAwMDAwMDAwMDAwMDAgYnNwczogMDAwMDAwMDAwMDAwMDAwMCBw ciAgOiA1OTUxOWFhNjY1YTk5NTU1CmxkcnM6IDAwMDAwMDAwMDAwMDAwMDAgY2N2IDogMDAwMDAw MDAwMDAwMDAwNiBmcHNyOiAwMDA5ODA0YzhhNzAwMzNmCmNzZCA6IDAwMDAwMDAwMDAwMDAwMDAg c3NkIDogMDAwMDAwMDAwMDAwMDAwMApiMCAgOiBhMDAwMDAwMTAwM2Q2NjkwIGI2ICA6IGEwMDAw MDAxMDA1N2ZhYzAgYjcgIDogYTAwMDAwMDEwMDAxMDNmMApmNiAgOiAwMDAwMDAwMDAwMDAwMDAw MDAwMDAgZjcgIDogMTAwM2UwMDAwMDAwMTM3MGY2MzJhCmY4ICA6IDEwMDNlMDA0NGI4MmZhMDli NWE1MyBmOSAgOiAxMDAzZTAwMDAwMWYxYzg5NzNhNmEKZjEwIDogMTAwM2U4ZWFmNDgxNjc5YzVh ZjNlIGYxMSA6IDEwMDNlMDAwMDAwMDAwMDAwMDA5YgpyMSAgOiBhMDAwMDAwMTAxNzlkNDkwIHIy ICA6IDAwMDAwMDAwMDAwMDAwMDcgcjMgIDogYTAwMDAwMDEwMTU5ZTA1OApyOCAgOiAwMDAwMDAw MDAwMDAwMDI0IHI5ICA6IDAwMDAwMDAwMDAwMDAwMDEgcjEwIDogZTAwMDAwMDAwMTg0MDljOApy MTEgOiAwMDAwMDAwMDAwMDAwMDAxIHIxMiA6IGUwMDAwMDAzMTZlNWZiYzAgcjEzIDogZTAwMDAw MDMxNmU1MDAwMApyMTQgOiAwMDAwMDAwMDAwMDAwMDA2IHIxNSA6IDAwMDAwMDAwMDAwMDAwMDcg cjE2IDogMDAwMDAwMDAwMDAwMDAwMApyMTcgOiBlMDAwMDAwMDAxODgwMDAwIHIxOCA6IGZmZmZm ZmZmZmZmYzA0MjggcjE5IDogZmZmZmZmZmZmZmZjMDljOApyMjAgOiAwMDAwMDAxMDA4NTIyMDM4 IHIyMSA6IDAwMDAwMDAwMDAwMDQwMDAgcjIyIDogODIwMDAwMDAwMDI0MDAzOApyMjMgOiAwMDAw MDAwMDAwMDAwMDM5IHIyNCA6IDAwMDAwMDAwMDAwMDAwMzkgcjI1IDogMDAwMDAwMDAwMDAwMDAz MQpyMjYgOiAwMDAwMDAwMDAwMDAwMDAyIHIyNyA6IDgyMDAwMDAwMDAyNDAwMzggcjI4IDogMDAw MDAwMDAwMDAwMDJkYwpyMjkgOiAwMDAwMDAwMDAwMDAwMmRiIHIzMCA6IDAwMDAwMDAwMDAwMTAw NjggcjMxIDogMDAwMDAwMDAwMDAwMDAzOAoKQ2FsbCBUcmFjZToKIFs8YTAwMDAwMDEwMDAxNWQy MD5dIHNob3dfc3RhY2srMHg4MC8weGEwCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg c3A9ZTAwMDAwMDMxNmU1Zjc4MCBic3A9ZTAwMDAwMDMxNmU1MWI2MAogWzxhMDAwMDAwMTAwMDE2 MzgwPl0gc2hvd19yZWdzKzB4NjQwLzB4OTIwCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgc3A9ZTAwMDAwMDMxNmU1Zjk1MCBic3A9ZTAwMDAwMDMxNmU1MWIwOAogWzxhMDAwMDAwMTAw MDQxNTQwPl0gZGllKzB4MWEwLzB4MmUwCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg c3A9ZTAwMDAwMDMxNmU1Zjk2MCBic3A9ZTAwMDAwMDMxNmU1MWFjOAogWzxhMDAwMDAwMTAwMDQx NmQwPl0gZGllX2lmX2tlcm5lbCsweDUwLzB4ODAKICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICBzcD1lMDAwMDAwMzE2ZTVmOTYwIGJzcD1lMDAwMDAwMzE2ZTUxYTk4CiBbPGEwMDAwMDAx MDAwNDI5ZjA+XSBpYTY0X2JhZF9icmVhaysweDNkMC8weDZlMAogICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgIHNwPWUwMDAwMDAzMTZlNWY5NjAgYnNwPWUwMDAwMDAzMTZlNTFhNzAKIFs8 YTAwMDAwMDEwMDAwYmU2MD5dIGlhNjRfbmF0aXZlX2xlYXZlX2tlcm5lbCsweDAvMHgyNzAKICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICBzcD1lMDAwMDAwMzE2ZTVmOWYwIGJzcD1lMDAw MDAwMzE2ZTUxYTcwCiBbPGEwMDAwMDAxMDAzZDY2OTA+XSBfX2pvdXJuYWxfcmVtb3ZlX2pvdXJu YWxfaGVhZCsweDUzMC8weDZjMAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHNwPWUw MDAwMDAzMTZlNWZiYzAgYnNwPWUwMDAwMDAzMTZlNTFhMjAKIFs8YTAwMDAwMDEwMDNkNjljMD5d IGpvdXJuYWxfcHV0X2pvdXJuYWxfaGVhZCsweDFhMC8weDI2MAogICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgIHNwPWUwMDAwMDAzMTZlNWZiYzAgYnNwPWUwMDAwMDAzMTZlNTE5ZjAKIFs8 YTAwMDAwMDEwMDNjYjlkMD5dIGpvdXJuYWxfZ2V0X3VuZG9fYWNjZXNzKzB4MzMwLzB4M2UwCiAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgc3A9ZTAwMDAwMDMxNmU1ZmJjMCBic3A9ZTAw MDAwMDMxNmU1MTlhMAogWzxhMDAwMDAwMTAwM2EzZTEwPl0gX19leHQzX2pvdXJuYWxfZ2V0X3Vu ZG9fYWNjZXNzKzB4MzAvMHhhMAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHNwPWUw MDAwMDAzMTZlNWZiYzAgYnNwPWUwMDAwMDAzMTZlNTE5NjgKIFs8YTAwMDAwMDEwMDM3OWE5MD5d IGV4dDNfdHJ5X3RvX2FsbG9jYXRlX3dpdGhfcnN2KzB4NzAvMHg3MjAKICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICBzcD1lMDAwMDAwMzE2ZTVmYmMwIGJzcD1lMDAwMDAwMzE2ZTUxOGMw CiBbPGEwMDAwMDAxMDAzN2E0NjA+XSBleHQzX25ld19ibG9ja3MrMHgzMjAvMHhkNjAKICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICBzcD1lMDAwMDAwMzE2ZTVmYmUwIGJzcD1lMDAwMDAw MzE2ZTUxN2QwCiBbPGEwMDAwMDAxMDAzODRiZDA+XSBleHQzX2FsbG9jX2JyYW5jaCsweDkwLzB4 OGUwCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgc3A9ZTAwMDAwMDMxNmU1ZmMwMCBi c3A9ZTAwMDAwMDMxNmU1MTcyMAogWzxhMDAwMDAwMTAwMzg2MzYwPl0gZXh0M19nZXRfYmxvY2tz X2hhbmRsZSsweGY0MC8weGZlMAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHNwPWUw MDAwMDAzMTZlNWZjMzAgYnNwPWUwMDAwMDAzMTZlNTE2OTAKIFs8YTAwMDAwMDEwMDM4NjU5MD5d IGV4dDNfZ2V0X2Jsb2NrKzB4MTkwLzB4MjAwCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgc3A9ZTAwMDAwMDMxNmU1ZmNiMCBic3A9ZTAwMDAwMDMxNmU1MTYyOAogWzxhMDAwMDAwMTAw Mjg5ZjgwPl0gX19ibG9ja193cml0ZV9iZWdpbisweDU2MC8weGIwMAogICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgIHNwPWUwMDAwMDAzMTZlNWZjYjAgYnNwPWUwMDAwMDAzMTZlNTE1MzgK IFs8YTAwMDAwMDEwMDM4YTA3MD5dIGV4dDNfd3JpdGVfYmVnaW4rMHgxMTAvMHg0MjAKICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICBzcD1lMDAwMDAwMzE2ZTVmY2QwIGJzcD1lMDAwMDAw MzE2ZTUxNDU4CiBbPGEwMDAwMDAxMDAxNjYwYzA+XSBnZW5lcmljX3BlcmZvcm1fd3JpdGUrMHgx MjAvMHg0ZTAKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBzcD1lMDAwMDAwMzE2ZTVm Y2UwIGJzcD1lMDAwMDAwMzE2ZTUxMzkwCiBbPGEwMDAwMDAxMDAxNjY1MTA+XSBnZW5lcmljX2Zp bGVfYnVmZmVyZWRfd3JpdGUrMHg5MC8weGUwCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgc3A9ZTAwMDAwMDMxNmU1ZmNmMCBic3A9ZTAwMDAwMDMxNmU1MTMzOAogWzxhMDAwMDAwMTAw MTZiNzIwPl0gX19nZW5lcmljX2ZpbGVfYWlvX3dyaXRlKzB4NDQwLzB4NzIwCiAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgc3A9ZTAwMDAwMDMxNmU1ZmQxMCBic3A9ZTAwMDAwMDMxNmU1 MTJjOAogWzxhMDAwMDAwMTAwMTZiYTkwPl0gZ2VuZXJpY19maWxlX2Fpb193cml0ZSsweDkwLzB4 MWEwCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgc3A9ZTAwMDAwMDMxNmU1ZmQzMCBi c3A9ZTAwMDAwMDMxNmU1MTI3MAogWzxhMDAwMDAwMTAwMjE4NmYwPl0gZG9fc3luY193cml0ZSsw eDEzMC8weDI0MAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHNwPWUwMDAwMDAzMTZl NWZkMzAgYnNwPWUwMDAwMDAzMTZlNTEyMTgKIFs8YTAwMDAwMDEwMDIxYWJlMD5dIHZmc193cml0 ZSsweDIwMC8weDQwMAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHNwPWUwMDAwMDAz MTZlNWZlMjAgYnNwPWUwMDAwMDAzMTZlNTExYzAKIFs8YTAwMDAwMDEwMDIxYWZiMD5dIFN5U193 cml0ZSsweDkwLzB4ZTAKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBzcD1lMDAwMDAw MzE2ZTVmZTIwIGJzcD1lMDAwMDAwMzE2ZTUxMTQ4CiBbPGEwMDAwMDAxMDAwMGJjZTA+XSBpYTY0 X3JldF9mcm9tX3N5c2NhbGwrMHgwLzB4MjAKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICBzcD1lMDAwMDAwMzE2ZTVmZTMwIGJzcD1lMDAwMDAwMzE2ZTUxMTQ4CiBbPGEwMDAwMDAwMDAw NDA3MjA+XSBfX2tlcm5lbF9zeXNjYWxsX3ZpYV9icmVhaysweDAvMHgyMAogICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgIHNwPWUwMDAwMDAzMTZlNjAwMDAgYnNwPWUwMDAwMDAzMTZlNTEx NDgKRGlzYWJsaW5nIGxvY2sgZGVidWdnaW5nIGR1ZSB0byBrZXJuZWwgdGFpbnQKSU5GTzogcmN1 X3NjaGVkIHNlbGYtZGV0ZWN0ZWQgc3RhbGwgb24gQ1BVSU5GTzogcmN1X3NjaGVkIHNlbGYtZGV0 ZWN0ZWQgc3RhbGwgb24gQ1BVIHsgMzB9ICAodD01MjUwIGppZmZpZXMgZz0yMDgzMjQgYz0yMDgz MjMgcT03NjAyKQo= --089e0139ff30fa85b004dc607cdf--