Received: by 2002:a25:b323:0:0:0:0:0 with SMTP id l35csp196940ybj; Thu, 19 Sep 2019 12:54:40 -0700 (PDT) X-Google-Smtp-Source: APXvYqzFIs9akjccP0zn+2dBJY6uTNKWbYe3bkT1mpg1Q9s6svMuG4SbqlMJPDYiFGwDpghnjmO/ X-Received: by 2002:a17:906:4c4c:: with SMTP id d12mr15777421ejw.174.1568922879952; Thu, 19 Sep 2019 12:54:39 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1568922879; cv=pass; d=google.com; s=arc-20160816; b=KIMSoCWjb6Ywf/H+eHTHbTNP6mgUTtpHTDmGr4hEKNM4vj8OAfODpAgwGbZhZabgvd hIaLc4Q6IS/dplV4gFGW6YXIiYWtVK+9vA4AYlbzgtl+kT9yay2MzBHPIlNyDMQQaETW kqDTO9JZsDLWqQ8SPZPQC7mye6Uxvcyj3tc7fW+Mbe0fx5Lk6vm4T94O3PYH/0z3/hZF FvbapLqMlcB+A7nnw6+VsGWqWgnQAYpOtaWJoUc7JBHPUgEncoQ+LocFN8zDiIyXRp/G nQWRchmE2cPIeuWMipwpCijplJB07312QqLolEr/v6f8tMYIMqPYhHnIxnxpcNT08tJ3 A1XA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:mime-version:content-transfer-encoding :content-language:accept-language:message-id:date:thread-index :thread-topic:subject:cc:to:from:dkim-signature; bh=Lc/7Mo0S82K3XXn6045fwkE9Hs6ORlZCBm3PlGRa5uo=; b=d/hrnVBkLBvNQ56cCFhfOaSTWl2LEDBBSjgkqBlYaPxy98+/ENdjrMatpIj01/9QKB K7tgob0M9Jj1dRqs+dnUMXOY1wirqtX5DqA44ddainLJN+QnMeJGXGZCZ56iIqGQc4jJ 2JBwkbi3/XB+OzVgjl6lmD0fIe1h4rdI257Yvv222PpVaDRxDEvQPd+Tqn7o3H4NG5C7 wfQLJ/pNq2D/mba3L5KyAg1KysBcAqAP0qbPNbqr6cslDUcVbuM0RMAJjAy0y4Ikg659 X4IZIyJFssAgoNWmt6mr0dEA0CP4t7bgsZWpr4ZjqICPkmUZc+RRKUGOVLsITW2tSBLT iy1w== ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@xilinx.onmicrosoft.com header.s=selector2-xilinx-onmicrosoft-com header.b=kckn+cRd; arc=pass (i=1 spf=pass spfdomain=xilinx.com dkim=pass dkdomain=xilinx.com dmarc=pass fromdomain=xilinx.com); spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id j14si5796928eda.181.2019.09.19.12.53.31; Thu, 19 Sep 2019 12:54:39 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@xilinx.onmicrosoft.com header.s=selector2-xilinx-onmicrosoft-com header.b=kckn+cRd; arc=pass (i=1 spf=pass spfdomain=xilinx.com dkim=pass dkdomain=xilinx.com dmarc=pass fromdomain=xilinx.com); spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1732113AbfISNrw (ORCPT + 99 others); Thu, 19 Sep 2019 09:47:52 -0400 Received: from mail-eopbgr750082.outbound.protection.outlook.com ([40.107.75.82]:57762 "EHLO NAM02-BL2-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1729629AbfISNrw (ORCPT ); Thu, 19 Sep 2019 09:47:52 -0400 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=j9d+NIXY9g1RFgg34/p8UkdRvXf+BdVB6s+MlE8n0XnXM24uqcgf3kMkBKzwM2HU7YR/A3X8R0vNm9H5nGkBMjveYVvqT2/9qzkLQ5hY5zwHFUxaeQ1I4V3UlwO6VWuybrQDbAGhd1JBxI4CkMn685A3U6iFiaeqYY2uSFe2qTMsL674XA4gq5GePf8TKPbTLiNZQz3PhwEpbVoiTfuAS7cpH7neCgCRA7Enia45vRpNFkj6Qzqmo9d4BQMT+MfcQFBx4ldgJAV9W7+YPwXPikgz8PxlEd8xCqB90MG1N3qurmZ2mlorN2OUM2NHzK7Ed3y1j5IIu/y1238Aduv4TA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Lc/7Mo0S82K3XXn6045fwkE9Hs6ORlZCBm3PlGRa5uo=; b=lfxO2jTfDxp8MIK1QvX7ur0mo64AuS0gtES6mYuVnrXW56bOWqyukqQv/GTTPw993JLeQkcypC1F+g2jk1LSbHgCpm63wYwDt4a5qoyUo4KAFh86ZaoDJl9Eerd+OhCFM9MWxG/trtqX2wuq+UrD4Qf+QjZtFlUUUrPJeeHz8HlagpdFyVidXggUg7fQKkeiFdThodkEc0s27WzcwKnXi+oaqyICs3EJCWdqc2hEkthdwy3shtVARIcOil35dDhZHXDMNbfIXKJpEvKPDRXXPfFpT6L60++0RdImDg9xtZQgxKYFXzqUtmRbGoMd9ZiWAJOx9WFNNLtjhhoEeA1iAA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=xilinx.com; dmarc=pass action=none header.from=xilinx.com; dkim=pass header.d=xilinx.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=xilinx.onmicrosoft.com; s=selector2-xilinx-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Lc/7Mo0S82K3XXn6045fwkE9Hs6ORlZCBm3PlGRa5uo=; b=kckn+cRdzfeXr5xZHLqFmesylMQpUecI5X64PNDRjGHulrI9PUYPkpfzR0LtN5BrP4wuXTpzxTJRoqCdJI634R8KnhRz1VCm7IDMku88UIWQRKuRFxRbcOwgv5/D4OefgtrUzSGm/DS8xIo2zK+FhOuaNWYmtYcwP7g1fXAIEqI= Received: from MN2PR02MB6336.namprd02.prod.outlook.com (52.132.175.93) by MN2PR02MB7022.namprd02.prod.outlook.com (20.179.223.15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2284.20; Thu, 19 Sep 2019 13:47:50 +0000 Received: from MN2PR02MB6336.namprd02.prod.outlook.com ([fe80::5c7e:59ac:afbc:2196]) by MN2PR02MB6336.namprd02.prod.outlook.com ([fe80::5c7e:59ac:afbc:2196%3]) with mapi id 15.20.2284.009; Thu, 19 Sep 2019 13:47:50 +0000 From: Bharat Kumar Gogada To: "linux-kernel@vger.kernel.org" , "linux-nvme@lists.infradead.org" CC: Keith Busch , "keith.busch@intel.com" Subject: NVMe Poll CQ on timeout Thread-Topic: NVMe Poll CQ on timeout Thread-Index: AdVu7wdM7XQNFN1FSKya+9NO0ckL4A== Date: Thu, 19 Sep 2019 13:47:50 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=bharatku@xilinx.com; x-originating-ip: [149.199.50.133] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: d1bc17e6-a024-48f1-ab2e-08d73d07f641 x-ms-office365-filtering-ht: Tenant x-microsoft-antispam: BCL:0;PCL:0;RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600167)(711020)(4605104)(1401327)(4618075)(2017052603328)(7193020);SRVR:MN2PR02MB7022; x-ms-traffictypediagnostic: MN2PR02MB7022: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:6430; x-forefront-prvs: 016572D96D x-forefront-antispam-report: SFV:NSPM;SFS:(10009020)(4636009)(346002)(136003)(396003)(366004)(376002)(39860400002)(53754006)(189003)(199004)(74316002)(55016002)(7736002)(25786009)(9686003)(305945005)(66946007)(66476007)(6506007)(64756008)(2906002)(66446008)(66556008)(102836004)(4744005)(256004)(99286004)(76116006)(7696005)(3846002)(14454004)(476003)(478600001)(86362001)(486006)(5660300002)(26005)(186003)(6116002)(71190400001)(6436002)(8936002)(2501003)(66066001)(71200400001)(54906003)(110136005)(33656002)(316002)(81166006)(4326008)(8676002)(52536014)(81156014);DIR:OUT;SFP:1101;SCL:1;SRVR:MN2PR02MB7022;H:MN2PR02MB6336.namprd02.prod.outlook.com;FPR:;SPF:None;LANG:en;PTR:InfoNoRecords;MX:1;A:1; received-spf: None (protection.outlook.com: xilinx.com does not designate permitted sender hosts) x-ms-exchange-senderadcheck: 1 x-microsoft-antispam-message-info: Wc67vZ6JEyj6xfObK1WTURL8Ebc+yjvqyLzDhmv5hddfrfm1tRxpCJc898IqcAGIWCT/Dmxs83p5FAS/p/k6xPaAbWZFsdCRmwJFW+nVeZy+J1l9nHIGU76K/g5ERsu+3jCYirp3OGHJFheRte1LwmoRM3SOyqFZi3xcz2js8a4Z2bNPsX29/kFN+wmgi5A8YQhNP4QmQltWgDXpTUpqua2kt4RpHBaOmLme8boQ4Yb6lYlktRCYPEvOqcWgveBZfRx5q/VCh0Z8y4jAcFIrB6elCJQF0j+SD1d/QaI4tfwtEtQ14x9flBPh3Y6pLihgv1FEA44BHs1UwUc7WCIuoe7PknUxj4ZonGGvJF30s16WmztKqWWM6nsSgI/Iw6TPv8AKXkwhpSnZGTe8l1xENweVwsWuQqrZnQfdfLLX4CE= x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: xilinx.com X-MS-Exchange-CrossTenant-Network-Message-Id: d1bc17e6-a024-48f1-ab2e-08d73d07f641 X-MS-Exchange-CrossTenant-originalarrivaltime: 19 Sep 2019 13:47:50.0259 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 657af505-d5df-48d0-8300-c31994686c5c X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: 4a33QhzktERdiu5GVlm8LS8JD74ZW+31NNVaIv57XGNDyCSPkDLMd6KpBae7yDgSBaeElOHclxU5wYJF6c2hgQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN2PR02MB7022 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hi All, We are testing NVMe cards on ARM64 platform, the card uses MSI-X interrupts= . We are hitting following case in drivers/nvme/host/pci.c /* * Did we miss an interrupt? */ if (__nvme_poll(nvmeq, req->tag)) { dev_warn(dev->ctrl.device, "I/O %d QID %d timeout, completion polled\n", req->tag, nvmeq->qid); return BLK_EH_DONE; } Can anyone tell when does nvme_timeout gets invoked ? In what cases we see this interrupt miss ? We are seeing this issue only for reads with following fio command=20 fio --name=3Drandwrite --ioengine=3Dlibaio --iodepth=3D1 --rw=3Drandread --= bs=3D128k --direct=3D0 \ --size=3D128M --numjobs=3D3 --group_reporting --filename=3D/dev/nvme0n1 We are not seeing issue with --rw=3Drandwrite for same size. Please let us know what can cause this issue.=20 Regards, Bharat