Received: by 2002:a05:6a10:22f:0:0:0:0 with SMTP id 15csp1163026pxk; Fri, 4 Sep 2020 02:13:52 -0700 (PDT) X-Google-Smtp-Source: ABdhPJwu3vkbXXfYqyHr56cVe5V2vXkkFbuSE77N1BzuDonj7qpeXIESFKPcHHXw6eUsDi9IeR5u X-Received: by 2002:a17:906:8c1:: with SMTP id o1mr6614044eje.478.1599210832669; Fri, 04 Sep 2020 02:13:52 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1599210832; cv=none; d=google.com; s=arc-20160816; b=RPST8Ql735MwGcP/wEB4YHOPJboiKu/pIE9ApIdwJ2qhcm2IUgQ7JduyAr2mjrUQS8 R0AsZ7fj/OhQTl26qNODm/n3UfW1NsimPK2ayy3rSuT68WS/MQ0xj0xWAYs2ysdzAnRa Qi4rsM4YplUH5HU1EjHc2Wx4ikkNHJx3q5+GWVCPGmn0dKdJPxrpVcVcbf0ei6lS5Fqz SQUwXK8e+acIEBwTIViLP9EReDPH5JQ/iqPNORa/k7U6Sz4XS1eDGf1tO80w5Ib4F9gd Vz8xcRZ4fuz/dzLec9M3XYRC4et22geJnI/uCDGPPgPqQj+QJlddUwGWqcBFjCz/jO8S XdhA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:from:references:cc:to:subject; bh=2g5WqsRZTs4HT2JEr5C+tomadrkc2VQAh8wLEG/VWo8=; b=ndy/wgHGOOFCypeNgrojQQ2OJGlhUmqP+YaQw6oKcn43LJaEJnF9Kzpx/YG7aeFjB/ 1wHn2wzpjp2V+uY2otjTiJpQZwoB06pGjsJ9ErD3PuaiBqFkX2yDU0gBbLYZh3z8CQA4 mixwPZcnpoT3iAzYPOOk6CSTaSoQs0D42qCUUVUJRzWUn8mMNRbEdPw3t4uTDT1LbXGM VQWVgnD2XBBonycx6dUCVV4EdutRv76bHU/Rm4HBq5GH1W47zE6AKeoQ4FiZReWIpsWe RnSkMSvVRQjXQb/jNUYkUOb/7EgYa8URjLd68gRLvbd6+B9rF0MUmy2WllN7QEO5H6ik AUzg== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id dr7si3044449ejc.447.2020.09.04.02.13.29; Fri, 04 Sep 2020 02:13:52 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1730025AbgIDJML (ORCPT + 99 others); Fri, 4 Sep 2020 05:12:11 -0400 Received: from lhrrgout.huawei.com ([185.176.76.210]:2752 "EHLO huawei.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1729712AbgIDJMJ (ORCPT ); Fri, 4 Sep 2020 05:12:09 -0400 Received: from lhreml724-chm.china.huawei.com (unknown [172.18.7.106]) by Forcepoint Email with ESMTP id 3FDB791929569A201FCF; Fri, 4 Sep 2020 10:12:07 +0100 (IST) Received: from [127.0.0.1] (10.47.1.112) by lhreml724-chm.china.huawei.com (10.201.108.75) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256) id 15.1.1913.5; Fri, 4 Sep 2020 10:12:05 +0100 Subject: Re: [PATCH v8 00/18] blk-mq/scsi: Provide hostwide shared tags for SCSI HBAs To: Jens Axboe , , , , , , , , , , CC: , , , , , , , References: <1597850436-116171-1-git-send-email-john.garry@huawei.com> From: John Garry Message-ID: <379ef8a4-5042-926a-b8a0-2d0a684a0e01@huawei.com> Date: Fri, 4 Sep 2020 10:09:27 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:68.0) Gecko/20100101 Thunderbird/68.1.2 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset="utf-8"; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Originating-IP: [10.47.1.112] X-ClientProxiedBy: lhreml702-chm.china.huawei.com (10.201.108.51) To lhreml724-chm.china.huawei.com (10.201.108.75) X-CFilter-Loop: Reflected Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 03/09/2020 22:23, Jens Axboe wrote: > On 8/19/20 9:20 AM, John Garry wrote: >> Hi all, >> >> Here is v8 of the patchset. >> >> In this version of the series, we keep the shared sbitmap for driver tags, >> and introduce changes to fix up the tag budgeting across request queues. >> We also have a change to count requests per-hctx for when an elevator is >> enabled, as an optimisation. I also dropped the debugfs changes - more on >> that below. >> >> Some performance figures: >> >> Using 12x SAS SSDs on hisi_sas v3 hw. mq-deadline results are included, >> but it is not always an appropriate scheduler to use. >> >> Tag depth 4000 (default) 260** >> >> Baseline (v5.9-rc1): >> none sched: 2094K IOPS 513K >> mq-deadline sched: 2145K IOPS 1336K >> >> Final, host_tagset=0 in LLDD *, ***: >> none sched: 2120K IOPS 550K >> mq-deadline sched: 2121K IOPS 1309K >> >> Final ***: >> none sched: 2132K IOPS 1185 >> mq-deadline sched: 2145K IOPS 2097 >> >> * this is relevant as this is the performance in supporting but not >> enabling the feature >> ** depth=260 is relevant as some point where we are regularly waiting for >> tags to be available. Figures were are a bit unstable here. >> *** Included "[PATCH V4] scsi: core: only re-run queue in >> scsi_end_request() if device queue is busy" >> >> A copy of the patches can be found here: >> https://github.com/hisilicon/kernel-dev/tree/private-topic-blk-mq-shared-tags-v8 >> >> The hpsa patch depends on: >> https://lore.kernel.org/linux-scsi/20200430131904.5847-1-hare@suse.de/ >> >> And the smartpqi patch is not to be accepted. >> >> Comments (and testing) welcome, thanks! > > I applied 1-11, leaving the SCSI core bits and drivers to Martin. I can > also carry them, just let me know. > Great, thanks! So the SCSI parts depend on the block parts for building, so I guess it makes sense if you could carry them also. hpsa and smartpqi patches are pending for now, but the rest could be picked up. Martin/James may want more review of the SCSI core bits, though. Thanks again, John