Received: by 2002:ac0:a5a7:0:0:0:0:0 with SMTP id m36-v6csp751787imm; Fri, 27 Jul 2018 05:36:40 -0700 (PDT) X-Google-Smtp-Source: AAOMgpfgux1g7NXn7lL0PddRztxATooiQBkQzne+E/w8avImZ+EzsEQ7sMbvWk+8yO+Y8CCq6vvE X-Received: by 2002:a63:a011:: with SMTP id r17-v6mr5819770pge.90.1532694999967; Fri, 27 Jul 2018 05:36:39 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1532694999; cv=none; d=google.com; s=arc-20160816; b=M6JnsbLgY9ofJ1zglVbFi1a9k3CDXprTRLHRd7a/y0gSvhgg1YShTtc020xIPr1qNh H/xkTgszbfexG8wWRiHI8PNTso8NG9mUr5+IAbAAl+sXYdhKAYs1jhSHwf2Yz/xoEgzP 2AKVNPNIlhAc0JmF1Ahu27C2/Suc5DK4FBYsFIKSpcAxBG4rruvAY1fGShxQh2YR01GV BrLGKj1eigL+9oLgT6c587/Wl+aYA8Bbb+bMJXPOMCc1LgMQSZkP7i7LTmRyCUyqmgMV xItlotr2oEGvdoYEtH5X5Ey94YsNj1jVyS6CqexLZ045bEXSPR+fOeXkpq3Cqti1kr+k 80GQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:in-reply-to:content-disposition :mime-version:references:message-id:subject:cc:to:from:date :dkim-signature:dkim-signature:arc-authentication-results; bh=vF3menxjS6gxJiKkhetGlh61vF3ZpI7HE0do/xoBWOw=; b=lb7Wrxe1ZImaNQ2baBf9DRdCFkpsI2wlKorDLuaFWk09EUKgnBxlevekZoxUl3aPi3 4Ls1ZvcB05e0re/lujmWG/0QJ1MAtpWlZrzt77X20DjF0nsTFU8dxaZVUpG+3qoSKS/S mUj5yW44SqPCDSy7Xbjs+uAHUYpel+Iatr7HJfU0+pwJdlUGJFxRa50Mqb42lVohWrE5 A/FfsrJWqGCDEdDdG1Biw5k+Op0u4Xu7anN9/aux2kMtUGLNHlAiy4ZuPAMnFtbtRBtu dWsLopNgp/riCm+N/XBhgwSVUOT6vTufUTTxWRPTBnyXSx7x2vKeksay6i5ERJYO6W/2 TJpg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@pks.im header.s=fm1 header.b=GdjheoEZ; dkim=pass header.i=@messagingengine.com header.s=fm3 header.b=muTOSKuZ; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id g92-v6si3689365plg.66.2018.07.27.05.36.24; Fri, 27 Jul 2018 05:36:39 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@pks.im header.s=fm1 header.b=GdjheoEZ; dkim=pass header.i=@messagingengine.com header.s=fm3 header.b=muTOSKuZ; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1730568AbeG0N5U (ORCPT + 99 others); Fri, 27 Jul 2018 09:57:20 -0400 Received: from out1-smtp.messagingengine.com ([66.111.4.25]:45599 "EHLO out1-smtp.messagingengine.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1728384AbeG0N5U (ORCPT ); Fri, 27 Jul 2018 09:57:20 -0400 Received: from compute1.internal (compute1.nyi.internal [10.202.2.41]) by mailout.nyi.internal (Postfix) with ESMTP id B907D215AC; Fri, 27 Jul 2018 08:35:34 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute1.internal (MEProxy); Fri, 27 Jul 2018 08:35:34 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=pks.im; h=cc :content-type:date:from:in-reply-to:message-id:mime-version :references:subject:to:x-me-sender:x-me-sender:x-sasl-enc; s= fm1; bh=vF3menxjS6gxJiKkhetGlh61vF3ZpI7HE0do/xoBWOw=; b=GdjheoEZ B52RMs/b+naQ0czycDbsDGJ1DXgeeq0ScuklWb/80yojTlX9GTDzImUhNbnvIczy AJZzIdPXWTT3OWUtUZcVtQkDVJsi8gsyQWxHTqBVEzmokOXnWi32FfYXqXpxVHBB Kcf74bP+D/lHmlPdDZZhczEP8P3bdsFW/QrUVE+WSyuPGdaJlDPXWoPIqpvBfpV6 Kh7CBwoSRgxiQtIlOwM8Nk2bEeHMJBVLtdNqNzIJ1Z9wzuOaXfwH5KHGqm8ZKClO 1rDUDqeJb4hXNgFKKS3p1IIJwHch8QdB1MEkRf9nVT56BBD1JN0WQtuo3qcbthJQ 5RRo1rBCZo1igw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-sender :x-me-sender:x-sasl-enc; s=fm3; bh=vF3menxjS6gxJiKkhetGlh61vF3Zp I7HE0do/xoBWOw=; b=muTOSKuZXw4vl9CzUAzC2i61IFl/TU4YRMR0kUJdB4odg X97/BnTFOLjNn063lHj4F5XZosDtxoZAIU3N3C2jCSqUJcgOUL8FY+M2cb6uQLhe FSsBkvrX7F3DKY7VZHk2sGaAXEijZN0lNwzUTNbR3bCnKBvY/yvx2sUKOMOWl47O 4VSci2408DTmqiVZpPJJmh0rJUrn52MgHz0DeaYe022cuPEmubYGBDc/TTSbDW9f YdYYcMmcqx3Sf4/dvHU7zAig8lY5x3IUt3A0uVGtDoQjJW5ZD2JdTHWUgx2dyctp t72vkcyOKwmwdjI1S/2tIA21GQkgnzt7aiyyv/0cA== X-ME-Proxy: X-ME-Sender: Received: from apu2.pks.im (x4e33de9d.dyn.telefonica.de [78.51.222.157]) by mail.messagingengine.com (Postfix) with ESMTPA id D781F10268; Fri, 27 Jul 2018 08:35:32 -0400 (EDT) Received: from localhost (10.192.0.12 [10.192.0.12]) by apu2.pks.im (OpenSMTPD) with ESMTPSA id c557e295 (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256:NO); Fri, 27 Jul 2018 12:35:32 +0000 (UTC) Date: Fri, 27 Jul 2018 14:35:33 +0200 From: Patrick Steinhardt To: Bart Van Assche Cc: "linux-kernel@vger.kernel.org" , "linux-block@vger.kernel.org" , "axboe@kernel.dk" , "ming.lei@redhat.com" Subject: Re: [PATCH] block: fix NPE when resuming SCSI devices using blk-mq Message-ID: <20180727123533.GA1588@xps> References: <20180726083850.GB1674@ncase> <62ddc886d005b91bd6a1bd8775259bb0b5cbe2b2.camel@wdc.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="AqsLC8rIMeq19msA" Content-Disposition: inline In-Reply-To: <62ddc886d005b91bd6a1bd8775259bb0b5cbe2b2.camel@wdc.com> Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org --AqsLC8rIMeq19msA Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Jul 26, 2018 at 01:51:48PM +0000, Bart Van Assche wrote: > On Thu, 2018-07-26 at 10:38 +-0200, Patrick Steinhardt wrote: > +AD4- That still leaves the other problem of broken suspend. I've just > +AD4- checked with v4.17.10, and it's still there: as soon as I resume > +AD4- from suspend, the kernel oopses and reboots the machine. I guess > +AD4- I'll have to do another debugging session and see where it fails > +AD4- exactly (and no, this time there are no more changes to the > +AD4- kernel tree). >=20 > Can you share the kernel oops details before you start running a bisect? I've already done the bisect a few months ago, which resulted in commit 765e40b675a9 (block: disable runtime-pm for blk-mq July 2017). I've never been able to get the Oops, as the screen was blank, but I tried a little harder with pstore today and finally got hold of it. Please see below for the Oops and previous dmesg entries. Kernel version was v4.17.10. Thanks Patrick <6>[ 49.088931] PM: suspend entry (deep) <6>[ 49.088933] PM: Syncing filesystems ... done. <6>[ 49.093066] Freezing user space processes ... (elapsed 0.001 seconds)= done. <6>[ 49.094283] OOM killer disabled. <6>[ 49.094284] Freezing remaining freezable tasks ... (elapsed 0.001 sec= onds) done. <6>[ 49.095470] Suspending console(s) (use no_console_suspend to debug) <6>[ 50.350548] ACPI: EC: interrupt blocked <6>[ 50.383913] ACPI: Preparing to enter system sleep state S3 <6>[ 50.397529] ACPI: EC: EC stopped <6>[ 50.397529] ACPI: EC: event blocked <6>[ 50.397530] PM: Saving platform NVS memory <6>[ 50.397605] Disabling non-boot CPUs ... <6>[ 50.414940] smpboot: CPU 1 is now offline <6>[ 50.445153] smpboot: CPU 2 is now offline <6>[ 50.471702] smpboot: CPU 3 is now offline <6>[ 50.473710] ACPI: Low-level resume complete <6>[ 50.473770] ACPI: EC: EC started <6>[ 50.473771] PM: Restoring platform NVS memory <6>[ 50.476149] Enabling non-boot CPUs ... <6>[ 50.476175] x86: Booting SMP configuration: <6>[ 50.476176] smpboot: Booting Node 0 Processor 1 APIC 0x2 <4>[ 50.478031] cache: parent cpu1 should not be sleeping <6>[ 50.478333] CPU1 is up <6>[ 50.478348] smpboot: Booting Node 0 Processor 2 APIC 0x1 <4>[ 50.478950] cache: parent cpu2 should not be sleeping <6>[ 50.479194] CPU2 is up <6>[ 50.479206] smpboot: Booting Node 0 Processor 3 APIC 0x3 <4>[ 50.479824] cache: parent cpu3 should not be sleeping <6>[ 50.480470] CPU3 is up <6>[ 50.490620] ACPI: Waking up from system sleep state S3 <6>[ 53.334256] ACPI: EC: interrupt unblocked <6>[ 53.411349] ACPI: EC: event unblocked <1>[ 53.411700] BUG: unable to handle kernel NULL pointer dereference at = 00000000000001a8 <6>[ 53.411705] PGD 0 P4D 0=20 <4>[ 53.411711] Oops: 0002 [#1] SMP DEBUG_PAGEALLOC PTI <4>[ 53.411716] CPU: 3 PID: 1600 Comm: kworker/u8:48 Tainted: G U = 4.17.10 #9 <4>[ 53.411717] Hardware name: Dell Inc. XPS 13 9343/0310JH, BIOS A15 01/= 23/2018 <4>[ 53.411724] Workqueue: events_unbound async_run_entry_fn <4>[ 53.411733] RIP: 0010:blk_set_runtime_active+0x2d/0x50 <4>[ 53.411736] RSP: 0000:ffff88020ef37df0 EFLAGS: 00010046 <4>[ 53.411739] RAX: 0000000000000000 RBX: ffff880210a9a000 RCX: 00000000= 00000000 <4>[ 53.411742] RDX: 00000000fffedf06 RSI: 0000000000000009 RDI: ffff8802= 10a9a1b0 <4>[ 53.411745] RBP: ffffffff815158d0 R08: ffffffff81c13ce0 R09: 00000000= 00000000 <4>[ 53.411747] R10: 0000000000004400 R11: 0000000000005cd3 R12: ffff8802= 141671e8 <4>[ 53.411749] R13: 0000000000000000 R14: ffff880215414c98 R15: 00000000= 00000000 <4>[ 53.411753] FS: 0000000000000000(0000) GS:ffff88021e780000(0000) knl= GS:0000000000000000 <4>[ 53.411755] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4>[ 53.411757] CR2: 00000000000001a8 CR3: 000000000300a003 CR4: 00000000= 003606e0 <4>[ 53.411758] Call Trace: <4>[ 53.411766] scsi_bus_resume_common+0xf8/0x110 <4>[ 53.411771] ? scsi_bus_thaw+0x10/0x10 <4>[ 53.411776] dpm_run_callback.isra.16+0x27/0x70 <4>[ 53.411781] device_resume+0xab/0x170 <4>[ 53.411785] async_resume+0x14/0x40 <4>[ 53.411788] async_run_entry_fn+0x34/0x100 <4>[ 53.411793] process_one_work+0x14d/0x2c0 <4>[ 53.411797] worker_thread+0x29/0x370 <4>[ 53.411800] ? process_one_work+0x2c0/0x2c0 <4>[ 53.411803] kthread+0x109/0x120 <4>[ 53.411806] ? __kthread_create_on_node+0x190/0x190 <4>[ 53.411810] ret_from_fork+0x35/0x40 <4>[ 53.411813] Code: 89 fb 48 8b bf b8 01 00 00 e8 30 8c 4e 00 48 8b 83 = 40 02 00 00 be 09 00 00 00 c7 83 48 02 00 00 00 00 00 00 48 8b 15 03 31 cf = 00 <48> 89 90 a8 01 00 00 48 8b bb 40 02 00 00 e8 00 1e 1e 00 48 8b=20 <1>[ 53.411873] RIP: blk_set_runtime_active+0x2d/0x50 RSP: ffff88020ef37d= f0 <4>[ 53.411874] CR2: 00000000000001a8 <4>[ 53.411877] ---[ end trace bbd10b6fcf31d6c4 ]--- --AqsLC8rIMeq19msA Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEtmscHsieVjl9VyNUEXxntp6r8SwFAltbEZUACgkQEXxntp6r 8SwtlxAAi7rfRRnAONQcEGDOtUbMU1X5JE8POORiRCpmjIP9E5AkXJY89IpF8XJU 8iAYCyhfMePH4q5kGPp41SdIV6vpvuGLyL+4qA1mw3rk1cke6VGARKS1KfMkBdZr dnuY/aPPDbk9NtvMV+MLV6BrfIVv7M4BXo6l5XKb8SrczGDRlg4n3UxPnQAmY58G Kdd182KrvWxg1spSjjPCMa9qOzDBV8YFnRzGREtyt4oemFZbrNZJdtTBcqIhtiRJ nfe3QAZiuf4NsekBj3CzyJdqfPbaYrU81IMEeR8dJELTRdfYr9bI/0A9TnWfhnPw QajcAKd6pYjocQdz1WgDYTpiarpR2INWrVPUK+49q1pLE5808hnSfUzK2poXiMmc CnLXc+tDDzpn+qUaud7uhK1M3GgiAq0NZC9W2eKck2PcD8KKxervpN1qu2GyMXLB EYg/+492vC+zHU5Fm2vMQpMg9PA4mA08RL+d1F6onmNHmJ2bS3ACa8uzZ3BWQWCF 0tEBeydrvwIiOvTYc63E+bo52p0NhrZESm12OzbU9gq1A3p8nqjFrxCLJbXh4pmP 42jw+5S9ly6PhJNXnQHpzpOQDyWr/9v33fXXpHrR373CTjIpWT85FOC7ysWnM7yI oq0/6VSos6FvGdvGz7tykK2w1RDUFJC9repxFyfVvXqUSgw1wF8= =YebW -----END PGP SIGNATURE----- --AqsLC8rIMeq19msA--