Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S942146AbcJZXXF (ORCPT ); Wed, 26 Oct 2016 19:23:05 -0400 Received: from mx0b-00082601.pphosted.com ([67.231.153.30]:50717 "EHLO mx0a-00082601.pphosted.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S935068AbcJZXW7 (ORCPT ); Wed, 26 Oct 2016 19:22:59 -0400 Subject: Re: bio linked list corruption. To: Chris Mason , Linus Torvalds , Dave Jones , Andy Lutomirski , Andy Lutomirski , Al Viro , "Josef Bacik" , David Sterba , linux-btrfs , Linux Kernel , Dave Chinner References: <20161026184201.6ofblkd3j5uxystq@codemonkey.org.uk> <488f9edc-6a1c-2c68-0d33-d3aa32ece9a4@fb.com> <20161026224025.mou27kki4bslftli@codemonkey.org.uk> <2bdc068d-afd5-7a78-f334-26970c91aaca@fb.com> <20161026231950.GB15247@clm-mbp.thefacebook.com> From: Jens Axboe Message-ID: <2951bc27-2453-203a-009d-260bccf2d038@fb.com> Date: Wed, 26 Oct 2016 17:21:22 -0600 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.3.0 MIME-Version: 1.0 In-Reply-To: <20161026231950.GB15247@clm-mbp.thefacebook.com> Content-Type: text/plain; charset="windows-1252"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [66.29.164.166] X-ClientProxiedBy: BY2PR03CA040.namprd03.prod.outlook.com (10.141.249.13) To BN6PR15MB1188.namprd15.prod.outlook.com (10.172.205.142) X-MS-Office365-Filtering-Correlation-Id: f75f7d02-c706-4af1-545b-08d3fdf6d090 X-Microsoft-Exchange-Diagnostics: 1;BN6PR15MB1188;2:Azy/Uh2+LuOf5Ia9FXoh5QknHn/11heJZ+/mTgsXFkDlYJyi3y9N9K+swMZ5Xn5YvRlls1XTg+VJD9B1gABYKE9hLjqqvnbsc3YAgSbMzCYs6dcSrf2ksH5W8jYbCX8YZ5UgE8XVAvuN4Yzzl/yqngRci3VSq/jH+fHOjWpTYTWcckoeoXwz3m7kK/Rl0bVjVthXV6frI7O5ws0z/qhdow==;3:IhHAyXKGHmx19AvQjSkXcB2NPB3uSlE7PDtFFFLYVp+ci7LJb9zfEaNJeauElfDbTbH6yUnsiU5RnL8+9d656FvDtS6FrmqY/Els5vS8gb7Jlq7zF5OFMzySKXrakFzHB2xWWcIuiMR3HRiPlUlNSg== X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:BN6PR15MB1188; X-Microsoft-Exchange-Diagnostics: 1;BN6PR15MB1188;25:Njy3pwyYVj+xOcIGUklVRB4w95WUWEX7mdpoRMUOybAR5WUI3rBM1Q7e5fhB7lQ1lQTbTJbDqY1eKikcUNdhPBJt5p8HDsCma7oOWPY39ZHafWfbRD7fCy5KQQZ2r/EeDWRXVSLIxk4IS8m4973XtRC3zkI8EGrSZDDEjVHeO574o7fomgKqYNYvngz/qRGzOO8wgiy60NmactH6L37Lz8LM1p9FAWlphHJx8BCTL4ayxVc0rmikTbXw7zKabwP4FDMWzODAsUVEwN1SQeIUaL6BznGhjZ+2CCveaWhN7ZbgdKfwxE8G+/R5zoUZJL/I6Gvo12L+XMtZMbE/iafSg36BI0NVc7zS2cv6vGcNemO7RfXMivGS1XM7VxjmQOq4ORrnqqUt4Qgbt/BQgC642ZKdJD9aq0hzSGR2EkqQmvtP3fMoupq95GpZhjioiLCFu2jS9kgWIcnBGCzWOhJHKxz/EYqeLc+QhpcWmz/rScljCbKcUO5/SnpfjGt8XF2rkfqfeRBftTUSlcM7nip/U4yzuQPdeCs2RR71FcejnAxK41gkUxE/LUUGpp/UwNZ1AOc+EDoJppLVyMwx6lMH3o9VmWavu1kEfazso/UGwAZzA4q3hY1nTeq0GTTj3rYz1QHrlO/A5jrMm40Puqd7cz3WtXqoxUA+RNoWxIJmaigYtnTPz8ox5XHsb9MWK9fAo2hwBM/zwL/sKWUPhwkIiMwwQObrOHQZB/PnrlAtyStlOhGXvT+ycvpJPaIeBc9C0LXa47mwIaqp+xNfjVMrsQ== X-Microsoft-Exchange-Diagnostics: 1;BN6PR15MB1188;31:Yu7tBi+V/Eh8m3bK3T2FAUZfvyHTP59GIsU6sws3kbhAygqSR6dGu7/ZGO1kZRyIg34R9SuMWB3mzOb6Q8vUtMcd24hrJf3bDKO9Y7sVUfj6d7l2Y98tx9bKhwJfFZZLAD22i4dYTEnpnNODEYlNh80GRrXmVlscQGBxzFyp49xZELBDi87k9fMr2qqyUBQXqCIsbvECrXA6s8R3nGN3leS/DlVuWen/bIfE/UgKUo7eULFK3j+auaD8+bVy4wit;20:dLZmNABVUSWuk40uDsjWzYa02yPnJSTVuEcTJaCbJBZg4NG3p8tis1uWS3HacbpnRg5qFp8QTwS9gemHCrxjKZSZL9FoZvH+bsPCzRWbUX3NNAij7jsfjKq/fQ1P2MK9Iz1UYJ1h4re4iezmsWap/MsfMFbccbGphXxoGpKpd0I=;4:qNL8DB1MMbMPxRRHrjH63p2sVBbrL3bUNo1ZKG2079FMzlUSFgUKIMOamTqZ7jFgpNhVfRfHFq/iFHpj4HCQbcBJKCWYGPT1ve9apNDM8Q84yBJwYoEgNQE/tYsvXqeVi7JjPooo0TX3EeUA4FgKjRG/oZzGJ5LUEpNkRvb958ilWt/cRsm0q8gO1sAHPsS3Xqej2fDBzIoZRZqXYd0BkZm/44iG79+8fHBCHXWzJV8eh+zOhS1XbLCRfn4+shRMJQcGvQPkpht1ybjMDpR7q9jp2Q7Cpjabn5AlXpH2PyYtIr3BuNcoAVyqWiZPRJXfDgFH9cnFAZcDCoMQ6Y1TuFs5fOHOhswKxOVKP8g00MkgzzYPhqxko99c0RKdyFyG73CnpAmUeISz3wbgPduLmg== X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0;PCL:0;RULEID:(6040176)(601004)(2401047)(5005006)(8121501046)(10201501046)(3002001);SRVR:BN6PR15MB1188;BCL:0;PCL:0;RULEID:;SRVR:BN6PR15MB1188; X-Forefront-PRVS: 0107098B6C X-Forefront-Antispam-Report: SFV:NSPM;SFS:(10019020)(4630300001)(6049001)(6009001)(7916002)(189002)(377454003)(24454002)(199003)(305945005)(64126003)(50986999)(31686004)(586003)(6666003)(7736002)(230700001)(83506001)(86362001)(42186005)(7846002)(81166006)(2906002)(5660300001)(81156014)(6116002)(33646002)(8676002)(2950100002)(3480700004)(3846002)(50466002)(66066001)(19580395003)(36756003)(189998001)(65806001)(23746002)(68736007)(31696002)(101416001)(19580405001)(117156001)(65826007)(106356001)(47776003)(76176999)(93886004)(65956001)(54356999)(77096005)(4001350100001)(92566002)(97736004)(107886002)(5001770100001)(105586002)(921003)(1121003);DIR:OUT;SFP:1102;SCL:1;SRVR:BN6PR15MB1188;H:[192.168.1.176];FPR:;SPF:None;PTR:InfoNoRecords;MX:1;A:1;LANG:en; X-Microsoft-Exchange-Diagnostics: =?Windows-1252?Q?1;BN6PR15MB1188;23:/Dwk6O/Oe/QQr2BcjUooilkryYYK0StBk9scJ?= =?Windows-1252?Q?IAJLWzo4gVCIqQcHeUzmP+4nWgWFf8CO1+G7P5yQ2HZXRpT3q9DeopUw?= =?Windows-1252?Q?m9wCLB/h1018CJOHg68XQ5bYuIIqFicRPBkMdr5Q12RAP7q/XLqekNSF?= =?Windows-1252?Q?Dwd6Xs5Ju23MwQM2M6YOYD5i+X+ct9JRyhUmloNkAfeN4uEHEOcBprZv?= =?Windows-1252?Q?LlNImbO0j0ozN/iZ6p5wHiNC8ueQ42jgFR17rg6G0mosF2jYYQ7TtL2R?= =?Windows-1252?Q?e2iFOyOt6hFaqbQiTWdzd4Z+0ucKct4KhT2VqjT1AbNe6deNgSa2v5DJ?= =?Windows-1252?Q?dCygkWZ/TdgC3M785EiHf1MR2Ne627EJy8p41tHD0v0it86Ev0xX20dS?= =?Windows-1252?Q?xYZPl3xu8hwt3bGNBsaR5LJEdIS7DEaYWgU4YB9eXwIMSvhTSGelOBq7?= =?Windows-1252?Q?XNmYr0ZUD2f0S400zx+PHCYudTxswaboC+CPeGPkjxG+cU9KztGnbji5?= =?Windows-1252?Q?a/v3GyD05zo7EUyT2Wy3Z+0v5dMmHoD+Pfz7xaZcPdro16rZXo2eVnq3?= =?Windows-1252?Q?ayuLKlWwfL82xRw1EuOO7VLGo0KnHw4t58qg7nVseLruYjLN1PWSuHSA?= =?Windows-1252?Q?SRBk3lr4I1Outs0T9WtP68xvWzuv5prSUi8v2njVapK0tItR76B+fRfa?= =?Windows-1252?Q?CbUtfuAZhD1I2NlYslPLSkWtiOVEMpu6Cwf6rls92xMxhgsmxyOsA9F5?= =?Windows-1252?Q?pdHkhXAPP6zvBYaIStWlr9egJsR9cPfu6v813eUNlx/PoHw77pPJnoEt?= =?Windows-1252?Q?ecNLuTmiJRWvPjHhXtTHZOb0wYwJxeLZSaVGKcES9AAcAYZ79TOZacPu?= =?Windows-1252?Q?vMCFDjOGLzINfRQpj7+w6yCGDYXRfOPwR7B2hme23ghjYagC1gkAHaMg?= =?Windows-1252?Q?NNlXj2eTTvJojtD0oViXKo6UnWD8kMIzmuEhgmp9gRgiBj3FNg4P7nME?= =?Windows-1252?Q?mUY5yW/TL+zBzcmxB0vfYGhz7pqjufIbgjR3wbkehn48OnvyYLsyBiLp?= =?Windows-1252?Q?ofds6An+hWKk3k5nMJtIiGslIRNtpVZUaUqi3x8FW9c2PCtV6OZgkTOw?= =?Windows-1252?Q?4r91ykKhO6+mITPP7rd8zpeT3v9cGIlhDEig/CsJBJ31SxWC+sdN0oND?= =?Windows-1252?Q?1wj3FtYgvUCOAm2gcoj77xe1n9d9ChKcHiqu9ok/Hg8dtvzvaZOAroTE?= =?Windows-1252?Q?Fiqh8v8q+zcaVS0HeOyhaTYTeRJkSXeVgRIEXH+gbDj7Pqdmk+YXSbDW?= =?Windows-1252?Q?x7A26Ha7eG8+q9gA5w3tqWkFaZ59MSfkIotWzeZ7JAWgAqCtI8glUpn4?= =?Windows-1252?Q?dmSypgybnMVJgfdtbV41qjVtpqQ50UZxwUXqj7bx/n9MJedtzEmOtt2V?= =?Windows-1252?Q?IYSwOFr3Fztd9bG/R4Dz7ByRxUSt/FqcjcNxd6be9eyVji/Rha6jP5OV?= =?Windows-1252?Q?3n6dZCefO2jWalGdoKxIgqurbk7hcYPbndKyqr8J+zFIDqqzA=3D=3D?= X-Microsoft-Exchange-Diagnostics: 1;BN6PR15MB1188;6:05Ppdckk41wTWMoVxlDyEskBC0G2iKmNihzpVTMAtU2lqandDhkow5F2kvxROfii3NZS2r51i5zaRJ75LmTZfSVG5iUR8JVX3yRehd0Flqkprx5q0MA0uN1rBDpuxE+M6CtJkvPIzapYv7szdGamAtnZZSLynWFBRBvw+jd7mo47/DVBYvMj2o85FmVD6CKk1CtiBET8V8nig/Vi5PNmEylTwAW6eHKOrJO3Xxh8WSPgRBF8PJRJ2SQApNLkWP8osJ7dShPZTEdKyh4dBEPJbn3ovJXSJW941GXPZj655QQwpUzykBPwTgCnO2sEYBoh;5:OBEoWiGORl/NUoyBzxDSwg7+c9mQmQhKrBVX4GLIOm4qDfghJqSykCKYJV3aSPq5OprSBlx3/BhoZWnhjOUr+DnLF1onY7FNMLI0ynccLi/ZaomgSxuF6OAZPbTwXp1s6sMadfaVXtT0Cl8qg1Qgqg==;24:VxCDcjcIY0US813EK795uo5GsT4i0qCJefvxSure8jbDxB7IWZcxydvsz7iGI/c+rEHDohE+AfxA1ZdajMB6s0+3nUe3ic3pP/GXmT123eQ=;7:E88VrFiZaumKNJceYU6qA8yoEMw3nJTABjgIc68ztOnUMz5TdAVINJoSCQiiQRzpT5rRs2jE4/yL7E4L2UVu03C0uYZEFaMxCMbv33BHKgY7svvOMj9YBbNDzuqSneZwr+vgkHuttNwffWOjBzcOAd0pb6LMPAvWVk4ZWwqoZYdnM1B9iQeiwFQZg5uocLs+EKHjWSlTJWTU3CKw4Zi1Pje2YqXfdH9Bh29OddGuiXQnyuV6fs2kSJqqjCQXuDejnbEOrP0S7QAHVtcVeojHqbRi9Q4xyqHvLNWSNYNcwubrAl4yn4nF3L96q3yhkiTMkoy9xvsetu06S+8XPV7jfHvO3CJgaDMrhevbI2rwuGU= SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-Microsoft-Exchange-Diagnostics: 1;BN6PR15MB1188;20:P5D/FqN+AWLmEeJQMDJDuqc4ktzl8ykDKZoiyYnXwAieKIQeafj6OXcUyuhmm6Nh1bltW8OCtF7b04VV+wVS2DCH7GpgGr78mDIkqYZsZh8Mgq7x8FbuW/IoqwMEM42vL9zkqxJiEkJChonxceogykt3vvNkRPfGwaSBd1CoLmI= X-MS-Exchange-CrossTenant-OriginalArrivalTime: 26 Oct 2016 23:21:27.8942 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN6PR15MB1188 X-OriginatorOrg: fb.com X-Proofpoint-Spam-Reason: safe X-FB-Internal: Safe X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:,, definitions=2016-10-26_14:,, signatures=0 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 1200 Lines: 31 On 10/26/2016 05:19 PM, Chris Mason wrote: > On Wed, Oct 26, 2016 at 05:03:45PM -0600, Jens Axboe wrote: >> On 10/26/2016 04:58 PM, Linus Torvalds wrote: >>> On Wed, Oct 26, 2016 at 3:51 PM, Linus Torvalds >>> wrote: >>>> >>>> Dave: it might be a good idea to split that "WARN_ON_ONCE()" in >>>> blk_mq_merge_queue_io() into two >>> >>> I did that myself too, since Dave sees this during boot. >>> >>> But I'm not getting the warning ;( >>> >>> Dave gets it with ext4, and thats' what I have too, so I'm not sure >>> what the required trigger would be. >> >> Actually, I think I see what might trigger it. You are on nvme, iirc, >> and that has a deep queue. Dave, are you testing on a sata drive or >> something similar with a shallower queue depth? If we end up sleeping >> for a request, I think we could trigger data->ctx being different. >> >> Dave, can you hit the warnings with this? Totally untested... > > Confirmed, totally untested ;) Don't try this one at home folks > (working this out with Jens offlist) Ahem, I did say untested! The one I just sent in reply to Linus should be better. Though that one is completely untested as well... -- Jens Axboe