Received: by 2002:ad5:474a:0:0:0:0:0 with SMTP id i10csp6098095imu; Tue, 13 Nov 2018 17:29:13 -0800 (PST) X-Google-Smtp-Source: AJdET5dFj4yTn9WCEC7QNZdY55+YBfeucR2jRYAh+JZE9wK/M/DSLo4hzX29coB6KeGFwxugGDEa X-Received: by 2002:a63:ef47:: with SMTP id c7mr7005893pgk.386.1542158953110; Tue, 13 Nov 2018 17:29:13 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1542158953; cv=none; d=google.com; s=arc-20160816; b=yBGunPSWhbEO+jjk1K0qIBxXxUvqN5t8WPGB3LkKowVDgcq1ETOYhiPmrStGu9RJJ0 NQJIDJ7BN7333NJ7+lpjHVwNT1/UjmDV4YVFstCVBJtcP2KHWbELB/tWrUOt4YjqhTou G5Aq84h6zmSh0lx9HgvKAVrzS5EY2VXfD/yEu0F/5aPy+4UxJLpfDGefpikiQTFPSoYo UHRaC6Dcz0q4NR1CMwSAV13vgw56xPgRr1MViLwNjobZN+gYhalqsN3+DNPW8aUbQmSm 0VrY/QrIjjb5KjsSz6ts5CMUEknyUGx3EeyHSraVkLu8mAP7Of1k5s0nINkhnjM3fvt+ G+MQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-disposition:mime-version:references:message-id:subject:cc :to:from:date; bh=4qm1q4NZFH3y93tYRqQEQBk/QOsYgg9pD4ItajyaFJM=; b=uY9ZnoeF3L6WledhkqtPCCfH8JJUrFfrfJvEdqSM/17oHluyZUODelKNyjZHEBBq6r pqPr2fQgobCxdutLYcouiC57giI10gWCkccaaQEh9GcAmzSOggpkc9UpKFtZlkjXi78m 5xY9yTTY7iJpwT91JSLfQpksMw110UgfhL7MGeRKuDcCzceYgl9eXAdE63cztArprKsj xNhlZ6+b8jZbLMcC+0pdSA7WKIQuBngICsxn417QEa4FcHDvVTrpFI9sE5OJR+YfGDOC tCzbCN5yQLpOwacx990HirBOvxLSpKU50SIYLNlFzdOywupfgQIUutmuXi91HYrca/cZ sJJw== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id g6-v6si22431405plt.212.2018.11.13.17.28.44; Tue, 13 Nov 2018 17:29:13 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1730977AbeKNL3H (ORCPT + 99 others); Wed, 14 Nov 2018 06:29:07 -0500 Received: from mx1.redhat.com ([209.132.183.28]:50336 "EHLO mx1.redhat.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727005AbeKNL3H (ORCPT ); Wed, 14 Nov 2018 06:29:07 -0500 Received: from smtp.corp.redhat.com (int-mx05.intmail.prod.int.phx2.redhat.com [10.5.11.15]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id B18FA89AF4; Wed, 14 Nov 2018 01:28:11 +0000 (UTC) Received: from localhost (unknown [10.18.25.149]) by smtp.corp.redhat.com (Postfix) with ESMTPS id 5F41A5D6A6; Wed, 14 Nov 2018 01:28:11 +0000 (UTC) Date: Tue, 13 Nov 2018 20:28:10 -0500 From: Mike Snitzer To: Jens Axboe Cc: Guenter Roeck , Keith Busch , Sagi Grimberg , linux-nvme@lists.infradead.org, linux-kernel@vger.kernel.org Subject: Re: nvme: utilize two queue maps, one for reads and one for writes Message-ID: <20181114012810.GA14592@redhat.com> References: <20181114004148.GA29545@roeck-us.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) X-Scanned-By: MIMEDefang 2.79 on 10.5.11.15 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.5.110.26]); Wed, 14 Nov 2018 01:28:12 +0000 (UTC) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Tue, Nov 13 2018 at 7:51pm -0500, Jens Axboe wrote: > On 11/13/18 5:41 PM, Guenter Roeck wrote: > > Hi, > > > > On Wed, Oct 31, 2018 at 08:36:31AM -0600, Jens Axboe wrote: > >> NVMe does round-robin between queues by default, which means that > >> sharing a queue map for both reads and writes can be problematic > >> in terms of read servicing. It's much easier to flood the queue > >> with writes and reduce the read servicing. > >> > >> Implement two queue maps, one for reads and one for writes. The > >> write queue count is configurable through the 'write_queues' > >> parameter. > >> > >> By default, we retain the previous behavior of having a single > >> queue set, shared between reads and writes. Setting 'write_queues' > >> to a non-zero value will create two queue sets, one for reads and > >> one for writes, the latter using the configurable number of > >> queues (hardware queue counts permitting). > >> > >> Reviewed-by: Hannes Reinecke > >> Reviewed-by: Keith Busch > >> Signed-off-by: Jens Axboe > > > > This patch causes hangs when running recent versions of > > -next with several architectures; see the -next column at > > kerneltests.org/builders for details. Bisect log below; this > > was run with qemu on alpha. Reverting this patch as well as > > "nvme: add separate poll queue map" fixes the problem. > > I don't see anything related to what hung, the trace, and so on. > Can you clue me in? Where are the test results with dmesg? > > How to reproduce? Think Guenter should've provided a full kerneltests.org url, but I had a look and found this for powerpc with -next: https://kerneltests.org/builders/next-powerpc-next/builds/998/steps/buildcommand/logs/stdio Has useful logs of the build failure due to block. (not seeing any -next failure for alpha but Guenter said he was using qemu so the build failure could've been any arch qemu supports) Mike