Received: by 2002:ac0:a5a7:0:0:0:0:0 with SMTP id m36-v6csp1753916imm; Thu, 19 Jul 2018 07:22:16 -0700 (PDT) X-Google-Smtp-Source: AAOMgpdyF9jfnpzyyxGkn42QLMk41o9vFSHC8pKu0/E8S/FBFG6YTafmn9pxUoCJVL2+mnVXlMVF X-Received: by 2002:a63:743:: with SMTP id 64-v6mr10538548pgh.216.1532010136454; Thu, 19 Jul 2018 07:22:16 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1532010136; cv=none; d=google.com; s=arc-20160816; b=GTPgjOTFPA6WjppBoP28dRrwHNPsL7q1zR2w3z1P+S6fJHAMN4RL+n8wrdjUWok1aB 3KbgzagyKejbCaPNUAaSWzsh7UjERD0FdYOnt714oVO90sh1ya3O1+deC6TUrdmFMKtl 4NgI6EV3Mwj4UEhUladWCKZUNBnOhDzcLMlV1PDSqZv3vQkYH8OqiEtbwlQr6W9wTWKp 2gHOnfO623epovNYNTvrfTFLHmGEInD1lyNZxxvsjbpxwb73qDF4AsPi6NL+e33AY1Tu 4m0U7shn7VSsRxVCMz0YMBlN/waqXsgy9rf/9F8q4VDEUmCxwmWpkvNYdueEY/Nk7uS5 K0Gw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-disposition:mime-version:references:message-id:subject:cc :to:from:date:arc-authentication-results; bh=fhk0FjdgeCW1ULxf+B+75SF3mLq1lYP0XI5sScBUDLk=; b=rj78hPfW146pJJW5SNF1EFSK2zKh+2LqdenVKOZR79b3K0igVFR6kA/Uj5MlNffh6G APUohZRqhw4k6bm7808G9ApZiV2wP/qA59tC4JG+ikopB/gJc+1YhzFXLfsQZnmXtOkS 0sjQjGgnCPdGMgqWgvDV24oDLgls2XfLWZ/RXJSsxn+qUs5DFTaSUr+r/AHpjnxjI3zv ewzFVaHrzLcwDsbjeit7Flt5IzTMpUAYkyPALyRDsIRXYyYkjRO23xyxn4OCIU/NqRw6 XYbU5eC9CcI9Xnnnu5uevcMIO2W8t3ouk9MfXmNidQguWFEdjESARAwAQw5NePdOW+9A l1nw== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id g35-v6si6182242pgm.54.2018.07.19.07.22.01; Thu, 19 Jul 2018 07:22:16 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1731538AbeGSPEb (ORCPT + 99 others); Thu, 19 Jul 2018 11:04:31 -0400 Received: from verein.lst.de ([213.95.11.211]:33722 "EHLO newverein.lst.de" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727575AbeGSPEb (ORCPT ); Thu, 19 Jul 2018 11:04:31 -0400 Received: by newverein.lst.de (Postfix, from userid 2407) id 879FE68D43; Thu, 19 Jul 2018 16:23:55 +0200 (CEST) Date: Thu, 19 Jul 2018 16:23:55 +0200 From: Christoph Hellwig To: Johannes Thumshirn Cc: Christoph Hellwig , Sagi Grimberg , Keith Busch , James Smart , Hannes Reinecke , Ewan Milne , Max Gurtovoy , Linux NVMe Mailinglist , Linux Kernel Mailinglist Subject: Re: [PATCH 0/4] Rework NVMe abort handling Message-ID: <20180719142355.GA18800@lst.de> References: <20180719132838.15556-1-jthumshirn@suse.de> <20180719134203.GA15212@lst.de> <20180719141025.yveza2svhvc2r4lw@linux-x5ow.site> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20180719141025.yveza2svhvc2r4lw@linux-x5ow.site> User-Agent: Mutt/1.5.17 (2007-11-01) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, Jul 19, 2018 at 04:10:25PM +0200, Johannes Thumshirn wrote: > The problem I'm trying to solve here is really just single commands > timing out because of i.e. a bad switch in between which causes frame > loss somewhere. And that is exactly the case where NVMe abort does not actually work in any sensible way. Remember that while NVMe guarantes ordered delivery inside a given queue it does not guarantee anything between multiple queues. So now you have your buggy FC setup where an I/O command times out because your switch delayed it for two hours due to a firmware bug. After 30 seconds we send an abort over the admin queue, which happens to pass through just fine. The controller will tell you: no command found as it has never seen it. No with the the code following what we have in PCIe that just means we'll eventually controller reset after the I/O command times out the second time as we still won't have seen a completion for it. If you incorrectly just continue and resend the command we'll actually get the command sent twice and thus a potential bug once the original command just gets sent along.