Received: by 2002:ad5:474a:0:0:0:0:0 with SMTP id i10csp8435375imu; Thu, 15 Nov 2018 11:30:11 -0800 (PST) X-Google-Smtp-Source: AJdET5d83g5fMJzkadFhp12QuJdl2bWiAZwPvTg26hzNEv7hBRzHFQq+125u6udFUCD7wIzNMGbe X-Received: by 2002:a62:14d1:: with SMTP id 200mr7891075pfu.103.1542310211265; Thu, 15 Nov 2018 11:30:11 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1542310211; cv=none; d=google.com; s=arc-20160816; b=bdHZ/f6KB+nkAgk7pMRglHZIqlfEoJw1+p0L5lv6zw0LPhGaRMDEQYr/b4nHGP7fJq GxaXrG1T+/gbtKoAARx5EezgQcWS57695G1fyQxUMAXA/MisbPoilZ6TKAcX5yvi67VI Fokr3ih6PnYpyS7i7X0LVSHzEO/FlF4Ur1It8QfvF3H24uIHrilNQfcLDmqezMPXRneh JvO8PFFgPChsWQGvYIDMKnNEhn1tmDU2N82SRMc9NsrUuA7M7bWtYgn1Wm3ttqGd2Sd0 IhOkJBpL+RTy8Gu402J5M+qLmYTFr/7LOWGB/PANICs63HaKlo9YtiIa+9obdOWT0n0j igiQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:from:references:cc:to:subject:dkim-signature; bh=Eqc/Pon4MNVoaIo8PdTa/Xx833WtBJojuWOPFGIysf0=; b=u7GUXrMsfBH4F+k1usMR4s3FNZz7oesamshPuRlsHcQH1npkfcDM0+Inq1LhxBk4LJ hqWA3n5hSmhZrCjBEfq/5AXU+gvL9k7dUrmeuEqYSGIaSs5a0RS0kz8A8j2Yxb7AJPig ZkI5YzlLKWF3WT0PuZiKyi83KKz1MudTg5h+y4BAnVRmc2zZRt+zCN8v4DsSMyAXqWoh vkXJKuqQ7MLTBFRJaks7CVbj5FmSKMgUXvXURKk7pavRfYuQUAYU/BDe+Yd1iVXMGRMT OtwWUeAM3jJzC535sK1bKfHvbRwWov/IWlADSPPWnOIPpYqLFwVj2SzkPkCRPNMDt+Ga w4gQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@kernel-dk.20150623.gappssmtp.com header.s=20150623 header.b=oBxBTm31; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id s84si11170324pgs.306.2018.11.15.11.29.56; Thu, 15 Nov 2018 11:30:11 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel-dk.20150623.gappssmtp.com header.s=20150623 header.b=oBxBTm31; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726047AbeKPFiO (ORCPT + 99 others); Fri, 16 Nov 2018 00:38:14 -0500 Received: from mail-pf1-f195.google.com ([209.85.210.195]:34484 "EHLO mail-pf1-f195.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1725769AbeKPFiO (ORCPT ); Fri, 16 Nov 2018 00:38:14 -0500 Received: by mail-pf1-f195.google.com with SMTP id h3so3619675pfg.1 for ; Thu, 15 Nov 2018 11:29:08 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kernel-dk.20150623.gappssmtp.com; s=20150623; h=subject:to:cc:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=Eqc/Pon4MNVoaIo8PdTa/Xx833WtBJojuWOPFGIysf0=; b=oBxBTm31MjNMefXDlRqs0KFrhOFAfAjAZdxoPZxCVWw6K42TTe1XI9BRvSO8Pja7d0 O/SQVY+8RFcoMoPFlo+V9GMXHopeZT/wx1Dr80j7z9Ob0GBrecQZfF5sK2bO+yexY/uz FNXchY7SE3evI9sGFeTpm1KlWzjCzkyck1lsUhRCR36viNdYvyzb5Tmsw2M/pJWtdEBF DqXihBsMBHml6qnaJET375kVKcISXuZv2+RqFDqU8bQSSvfw5Ndg4aPpNIGeHr4b0hW6 GrUjVoii07AqRtAEBit0cqz/Q6jCjBZzn+MEbS9dGRAYEl7FlKMIsmRakb/YRUPE6quW LWYQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=Eqc/Pon4MNVoaIo8PdTa/Xx833WtBJojuWOPFGIysf0=; b=psCYI1ZzT6siJa3XuDT90mkpOScw2Ebb1iB2KogSCzbr7BO2WPVifIvsnt0TLAUWuR d9OER7Est2oRhmNgwsUZfHzeuGu9u/diCc5aqXQQARF1jjrDu1byTJaFBpdTiCTTvAvJ hiQ3qPEGJScTHJPTMPn1vsGHMv2mpgamB3kp1iAXnBhti6P6neVICM7h/ImhYho2QOSP KGsUQbAoBNAoa7aDvmb3jZDU0PnefxvaNIe2/bvoP9mMBFS5ytu2trDID9Eb3pRhtsW8 /qu64prvDHayH1GrnjjvhQr5ItFypEp+rF7nVOsoFjqu1Hr9gx0QypCISXrJuQAM9CgK HVzw== X-Gm-Message-State: AGRZ1gI6a7gPvvUwb7AiPHQKYy32WfMl43ei1NTUgD9SPVb5IReyzYu7 9mrlBnax/DK3yhcJ6ZCIa4lhRDEbYFo= X-Received: by 2002:a62:1f9d:: with SMTP id l29mr7824538pfj.14.1542310147013; Thu, 15 Nov 2018 11:29:07 -0800 (PST) Received: from ?IPv6:2620:10d:c081:1130::11f6? ([2620:10d:c090:180::1:7813]) by smtp.gmail.com with ESMTPSA id v84-v6sm38179382pfd.182.2018.11.15.11.29.05 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 15 Nov 2018 11:29:06 -0800 (PST) Subject: Re: [PATCH] nvme: utilize two queue maps, one for reads and one for writes To: Guenter Roeck Cc: Keith Busch , Sagi Grimberg , linux-nvme@lists.infradead.org, linux-kernel@vger.kernel.org References: <20181115191126.GA16973@roeck-us.net> From: Jens Axboe Message-ID: Date: Thu, 15 Nov 2018 12:29:04 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.2.1 MIME-Version: 1.0 In-Reply-To: <20181115191126.GA16973@roeck-us.net> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 11/15/18 12:11 PM, Guenter Roeck wrote: > On Wed, Nov 14, 2018 at 10:12:44AM -0700, Jens Axboe wrote: >> >> I think the below patch should fix it. >> > > I spoke too early. sparc64, next-20181115: > > [ 14.204370] nvme nvme0: pci function 0000:02:00.0 > [ 14.249956] nvme nvme0: Removing after probe failure status: -5 > [ 14.263496] ------------[ cut here ]------------ > [ 14.263913] WARNING: CPU: 0 PID: 15 at kernel/irq/manage.c:1597 __free_irq+0xa4/0x320 > [ 14.264265] Trying to free already-free IRQ 9 > [ 14.264519] Modules linked in: > [ 14.264961] CPU: 0 PID: 15 Comm: kworker/u2:1 Not tainted 4.20.0-rc2-next-20181115 #1 > [ 14.265555] Workqueue: nvme-reset-wq nvme_reset_work > [ 14.265899] Call Trace: > [ 14.266118] [000000000046944c] __warn+0xcc/0x100 > [ 14.266375] [00000000004694b0] warn_slowpath_fmt+0x30/0x40 > [ 14.266635] [00000000004d4ce4] __free_irq+0xa4/0x320 > [ 14.266867] [00000000004d4ff8] free_irq+0x38/0x80 > [ 14.267092] [00000000007b1874] pci_free_irq+0x14/0x40 > [ 14.267327] [00000000008a5444] nvme_dev_disable+0xe4/0x520 > [ 14.267576] [00000000008a69b8] nvme_reset_work+0x138/0x1c60 > [ 14.267827] [0000000000488dd0] process_one_work+0x230/0x6e0 > [ 14.268079] [00000000004894f4] worker_thread+0x274/0x520 > [ 14.268321] [0000000000490624] kthread+0xe4/0x120 > [ 14.268544] [00000000004060c4] ret_from_fork+0x1c/0x2c > [ 14.268825] [0000000000000000] (null) > [ 14.269089] irq event stamp: 32796 > [ 14.269350] hardirqs last enabled at (32795): [<0000000000b624a4>] _raw_spin_unlock_irqrestore+0x24/0x80 > [ 14.269757] hardirqs last disabled at (32796): [<0000000000b622f4>] _raw_spin_lock_irqsave+0x14/0x60 > [ 14.270566] softirqs last enabled at (32780): [<0000000000b64c18>] __do_softirq+0x238/0x520 > [ 14.271206] softirqs last disabled at (32729): [<000000000042ceec>] do_softirq_own_stack+0x2c/0x40 > [ 14.272288] ---[ end trace cb79ccd2a0a03f3c ]--- > > Looks like an error during probe followed by an error cleanup problem. Did it previous probe fine? Or is the new thing just the fact that we spew a warning on trying to free a non-existing vector? -- Jens Axboe