Received: by 2002:ac0:a5b6:0:0:0:0:0 with SMTP id m51-v6csp4677722imm; Wed, 30 May 2018 09:50:38 -0700 (PDT) X-Google-Smtp-Source: ADUXVKLx6s+XFe3gIYOB626y9LKLG0i36VkgmacXJiXjoIXCfvLQ1lNGDneI+Ijr0GrdF6qe8eXX X-Received: by 2002:a17:902:b216:: with SMTP id t22-v6mr3542554plr.199.1527699038618; Wed, 30 May 2018 09:50:38 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1527699038; cv=none; d=google.com; s=arc-20160816; b=dundoOB56uhKX685zLMrD0/IbE2trrNQPhoDO6tR559SkjtVbhpMyQtaJaURAWMygN JFVNYBL68Ehudu/0alDRaSMbVBDsg4anpPoPvbiyAOnuY2GitOXWtfEHqdydCeDIP8iV WDu8V04Dah5QqhtlKJF7OM8CUb+RWQUtqpcSBRCxo2XHyrB5C6HaVbQoxWa5kHEN1DA9 OeGtFIB6aH37P3mKTswQtWBC55b0L+fZdQyJtL+kiv6M4LM3+NyzrAqCHT1oDN4EX/6M b3nZaecywHcv/3oA8QhTV67SXt7lxhlYAWBou/AfenxwpU5jpOg+UU3/6CADYzOqF5uh Gg2g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:from:references:cc:to:subject:dkim-signature :arc-authentication-results; bh=AIHE9Z9Ei5RT1D3ciCmBPph5sY/EqVg1kFZrhy/h91o=; b=mLpI8L1vA9s5gNu7wMZM5PvPUWkiZYhlQiYGgo528CpoEjppjuCKFC9S0H6qAD7+jF JjBMYR1b1WHOnlvCC/EqOnbNxl5BXWMNH9M/4O/h0i8vc5s7ZsZs/iImBs/RH6HAPHZF chh3RQVVJ0xTfizHB/hopY5ZTYvRubaMuqW90stN3/Vl7GJcn7MgLafPZyQoaXlCcg+l zCAt2g+Z0og9T1xp5YU5ZTxdLCaYgzyxXLDcLKj4qW/tLlMdBW5kyAdp+sJvUis6nju3 bS/geTNIwg7hpLsXQQQo88ziu6FCyzNIpQMjOITsW52M3fSEyx7nURlZEYfKQEkzWxCI pjIg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@kernel-dk.20150623.gappssmtp.com header.s=20150623 header.b=1OXNdqZW; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id 2-v6si35855607pfk.287.2018.05.30.09.50.24; Wed, 30 May 2018 09:50:38 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel-dk.20150623.gappssmtp.com header.s=20150623 header.b=1OXNdqZW; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1753741AbeE3Qs4 (ORCPT + 99 others); Wed, 30 May 2018 12:48:56 -0400 Received: from mail-io0-f172.google.com ([209.85.223.172]:40556 "EHLO mail-io0-f172.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1753238AbeE3Qsy (ORCPT ); Wed, 30 May 2018 12:48:54 -0400 Received: by mail-io0-f172.google.com with SMTP id g14-v6so22429750ioc.7 for ; Wed, 30 May 2018 09:48:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kernel-dk.20150623.gappssmtp.com; s=20150623; h=subject:to:cc:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=AIHE9Z9Ei5RT1D3ciCmBPph5sY/EqVg1kFZrhy/h91o=; b=1OXNdqZWiHXAHWrbRg/dYpBqQ9Dp405T23omzYldLHo5wsK5RSHCbMXG2Wta3OQUUC Ql1vlsR2snP4zuuA/jfePvSixN2VoztH+NskA40RoxtATUL6qxQQwbV95af84iDt+waV Qko9l1dvrKAsvBJHSaD2KLWKv+np9raPJCoHubqODDEKb8YuqHWZY9hqONA08PW8jRvF eROB9ojIve40vIbvyCNo+fpmU1PW9j+OeJTD6OepoaMtHaNTQOHjArOo2NornKhFPMW7 jglmL4wJFsnV3Jmpcv/5S7KmN2ykPxCZ+0Or523Wf4N7paGc40c/AwMnoP2WaHM6pNKM AG3Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=AIHE9Z9Ei5RT1D3ciCmBPph5sY/EqVg1kFZrhy/h91o=; b=TX2VByTUC3h3o6LuhHrNwh5DptUhVDGSOgJQNncNk7n57pLGxJF3ROaxezBBVQc+n2 xAeTEFmW9+LIK+C3odA3RdGlZacHipH6+45c6Cvrbe0RI8Di/0OsGhRxC+djE8vpFZQH SAv78/rHA7Ka6bIL5VjIVsKuW7ZOCh6Jq59Hq7i/EZvFW3C6Q/jy63DzWEaJyjdt+Igo 9H/PkNhyWI/aEI3S50yIRYHsbxVTi1TIF9zKm3pERNrfbV9Bl3AA6WjHMS0qHraBbGX0 1sfpYEI9ZQ2HrsTz0Bh8kT+zCoNfkynUr0dJsHpGuniaSDfnMqU0IeaQRmb9LvAa1kE+ th8g== X-Gm-Message-State: APt69E2om1Jwmimzmn0D+Ci+TKpFY/Q7sVXYCIH/DPKu/iB4tzBnpkYM Yq+YUE2gXoZZI/1EaSNB9caEkFA76q0= X-Received: by 2002:a6b:2c4f:: with SMTP id s76-v6mr3089051ios.132.1527698933035; Wed, 30 May 2018 09:48:53 -0700 (PDT) Received: from [192.168.1.168] ([216.160.245.98]) by smtp.gmail.com with ESMTPSA id o137-v6sm19237332ioe.3.2018.05.30.09.48.51 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 30 May 2018 09:48:51 -0700 (PDT) Subject: Re: [PATCH V3 0/2] block: kyber: make kyber more friendly with merging To: Jianchao Wang , osandov@osandov.com Cc: linux-block@vger.kernel.org, linux-kernel@vger.kernel.org References: <1527665168-1965-1-git-send-email-jianchao.w.wang@oracle.com> From: Jens Axboe Message-ID: <3f44d1dc-6b81-9f51-9e2d-68f1faba1684@kernel.dk> Date: Wed, 30 May 2018 10:48:50 -0600 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.0 MIME-Version: 1.0 In-Reply-To: <1527665168-1965-1-git-send-email-jianchao.w.wang@oracle.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 5/30/18 1:26 AM, Jianchao Wang wrote: > Hi Jens > > This is the 3rd version patchset to make the kyber io scheduler more firendly > with merging. > > Most of time, kyber io scheduler will not leave any requests in ctx rq_list, > this is because even if tokens of one domain is used up, kyber will try to > dispatch requests from other domain and flush the rq_list there. So there is not > any change to do merge. > > To improve this, setup kyber_ctx_queue (kcq) which is similar with blk_mq_ctx but has > rq_list for every domain, and build mapping between kcq and khd as ctx and hctx. > Then we could merge, insert and dispatch on rq_list of different domains separately. > At the same time, only flush the rq_list of kcq after get domain token > successfully, then the requests could be left in the rq_list of that domain and > maybe merged with following io. In my local test on NVMe card, the sequential io > performance could be improved a lot, especially on high workload. More details > please refer to the second patch. Great work, thanks Jianchao - applied for 4.18. -- Jens Axboe