Received: by 2002:ac0:bc90:0:0:0:0:0 with SMTP id a16csp3826837img; Mon, 25 Mar 2019 19:42:09 -0700 (PDT) X-Google-Smtp-Source: APXvYqwvY7T7LGnKm9zYRcnlgFzkvO36nPch78oDC/UpG/voOWWZCDahcwZqME4LOPN3xon9zPPm X-Received: by 2002:a63:6a42:: with SMTP id f63mr42106pgc.207.1553568129795; Mon, 25 Mar 2019 19:42:09 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1553568129; cv=none; d=google.com; s=arc-20160816; b=X7Roi5V8xx073yGnP91i7mSTli4wbOSCgdV5G78r8npIwSSw3CuIIYdy4Kqhhu1cBv YJnLY/HOUEekbcr2ivl1ne4OnAbOS0jh1KdIztO856hPY+a0JurKQKw+fbn9+Qo9WP9H QtHzdjTpjisxYIdOFMZG5IuayU5WPnO2qij78M3Pd7lSQnE8FB5C0c2SvDSOE1MMuVlQ P8PYKopp2gnzfXZlM32gQtUtKOfprk7ugFGIrWix/OFaGqvFfVBgjMVhlHUNCv9uI1lG SkCSUH4naQ11aNK077I/uUZC0aQLTSQ59Lfp1IyhYA8s/5vvFQnnUOiBZ/MVAmzSwpqb trrA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:dkim-signature; bh=nl4uLBWGWBQQZjK3Yu6yXtDWXpPkFHrwhXjK2wY0KMI=; b=Bo+3qr8fmNCoyuqTKMVEczZevtTDbARxUK/f9N/jXcvBQZ6ccOtLty7YmpTQ7OCdvV Erv2ioy/dptANcz1GK81GA1jibnmdg6fqlXfvs1wnoyBDp+uFwbI2eiqjr1BZY/9ktsT eoLPXj/M/aubbNc4Xf83n1Bmmb49/UeT/ArpW0LGBjvkK2R0kCfA92QgDDp3WlhyOriX O3iHPhuXqKkNSJRpyOebEgLTFG+JMdkShs0tgwp6hsXd9aukxnL/qMnqRhtxjOCEfovh kzgiXCmRYcQKe1Cn2YpNjR1gDoMCDpWgBrkxkJRVBLqTOgziQ41tttmu5gfjKTjj6ike LPBw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=ZyWnwjjf; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id a64si15429888pfb.56.2019.03.25.19.41.52; Mon, 25 Mar 2019 19:42:09 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=ZyWnwjjf; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1730273AbfCZClO (ORCPT + 99 others); Mon, 25 Mar 2019 22:41:14 -0400 Received: from mail-wr1-f66.google.com ([209.85.221.66]:44483 "EHLO mail-wr1-f66.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726186AbfCZClO (ORCPT ); Mon, 25 Mar 2019 22:41:14 -0400 Received: by mail-wr1-f66.google.com with SMTP id y7so8368382wrn.11; Mon, 25 Mar 2019 19:41:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=nl4uLBWGWBQQZjK3Yu6yXtDWXpPkFHrwhXjK2wY0KMI=; b=ZyWnwjjfhvlF9nfujwlIMS+9kPItIf6R2sYDUrOJbO7bHWg18+c+Ta123y0ZhnNJ+h eROUUpXhTZKhJ0RjrPigzslV2d7H3zWV4eGLxMeS/o6M++ucrqYpdGK8wtPk7EEU9UnC BZ+o4Pg/IZSR/kzwtltnP0ULRmR8lAKbk65DKIi2bY9zGNa+1lDjcpdkvpDWDIV2+Ltq K/rDyYDmjlvpnBftBqfEBMYNIaAae995bFNnTJXVetLcW7aJxiutYffjaYCNVQDHsUmV 64KRGbJJnT0dCKg7K+EILPIUmsRFGgkhEJjTk4QO0lJ1Gadhx7gIBfHxJ1Cc/Gdadm8z iAvQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=nl4uLBWGWBQQZjK3Yu6yXtDWXpPkFHrwhXjK2wY0KMI=; b=UGKEJDHR/h/5AJQJYvZ2xq4eC3YK+efwt3EnpQkWKtKwK4aRkkSMgfFnYMZb3/UbFU N8YZIwbcQ+6XqXU9wjtbTeezG5kVD/Bksg0YvZEXbbm7WgKI/X0Q8RX3nCgoTaxFFnUh h/Tv6ZAlJH8mf+/vGIii8PxXUr9UlGjweH7nAhBMvgSM8xmzwva3+VetaQTor3LKCIOM Y/eeAntKkCRhpsfFDfdnPz7UQjnudK77u3vk5usV+dmVflTRXFIqxnN9Wyby9HLu5rp9 DFJlpK+nqTjIyPe9j6Ehs10Ly6my3QRMwPWXDTM7V8YH0GSXJ6k6tOfTb6ZHyYR3WruB NYRg== X-Gm-Message-State: APjAAAV5WPvNPTD8t6MtpB7rQpLheZMFvRAdBoPM4XutWd4QlCEumf4C G05J56xOxjDxW9N4JkIQIuEqQj5sNeLJ93LM3Ek= X-Received: by 2002:adf:d848:: with SMTP id k8mr19531326wrl.185.1553568072236; Mon, 25 Mar 2019 19:41:12 -0700 (PDT) MIME-Version: 1.0 References: <1553492318-1810-1-git-send-email-jianchao.w.wang@oracle.com> <1553492318-1810-8-git-send-email-jianchao.w.wang@oracle.com> <20190325134917.GA4328@localhost.localdomain> <70e14e12-2ffc-37db-dd8f-229bc580546e@oracle.com> In-Reply-To: <70e14e12-2ffc-37db-dd8f-229bc580546e@oracle.com> From: Ming Lei Date: Tue, 26 Mar 2019 10:41:00 +0800 Message-ID: Subject: Re: [PATCH V2 7/8] nvme: use blk_mq_queue_tag_inflight_iter To: "jianchao.wang" Cc: Keith Busch , Jens Axboe , Keith Busch , James Smart , Bart Van Assche , Josef Bacik , linux-nvme , Linux Kernel Mailing List , linux-block , Hannes Reinecke , Johannes Thumshirn , Christoph Hellwig , Sagi Grimberg Content-Type: text/plain; charset="UTF-8" Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Tue, Mar 26, 2019 at 9:18 AM jianchao.wang wrote: > > Hi Keith > > On 3/25/19 9:49 PM, Keith Busch wrote: > > On Mon, Mar 25, 2019 at 01:38:37PM +0800, Jianchao Wang wrote: > >> blk_mq_tagset_inflight_iter is not safe that it could get stale request > >> in tags->rqs[]. Use blk_mq_queue_tag_inflight_iter here. A new helper > >> interface nvme_iterate_inflight_rqs is introduced to iterate > >> all of the ns under a ctrl. > > > > Nak, NVMe only iterates tags when new requests can't enter, allocated > > requests can't dispatch, and dispatched commands can't complete. So > > it is perfectly safe to iterate if the driver takes reasonable steps > > beforehand. > > nvme_dev_disable just quiesce and freeze the request_queue, but not drain the enters. > So there still could be someone escapes the queue freeze checking and tries to allocate > request. The rq->state is just IDLE for these allocated request, so there shouldn't be issue in NVMe's case. Thanks, Ming