Received: by 2002:ab2:7855:0:b0:1f9:5764:f03e with SMTP id m21csp799564lqp; Wed, 22 May 2024 23:23:59 -0700 (PDT) X-Forwarded-Encrypted: i=3; AJvYcCWY/0z0nAcQgBxTwKlgGeqmUsnw3eToWXUA2c+rxhTq/2zgD3iNyEsKBIx9PEVJeehL2uyOZvUKfZXXB/qPtQtoRAtg0uyKPiVEVcohfw== X-Google-Smtp-Source: AGHT+IF9aKQGyxHDjN/0LSKy4BrjrsfPqV+i9jP7D2f4ghjBhG0QJKlLaLBN5KfdhV0mgqc/HIJa X-Received: by 2002:aca:130b:0:b0:3c9:6a50:95f5 with SMTP id 5614622812f47-3cdb949ab4dmr3783023b6e.56.1716445438765; Wed, 22 May 2024 23:23:58 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1716445438; cv=pass; d=google.com; s=arc-20160816; b=yMrRXit+z7cvpu7VUu/Xz6VoVLbW7iHM4qrqm/to/BAyxmsnEZQfUQOCVnyTZhhDWR g6avHYURrXy2bNFkTSPxmJaGgYDeJkIfMaTPTgSxgztgrCXJFS5uY4PNMzNK76gUQICP azjCJ7xqLVKVoXIbvpHJ6hCcxCbkd+ixO9U1qmAf8NhEJ2FzTVEiDyLamjMt7RVGxAWH lmA/s9Y6ql5USuA5o8QvdGaNu4mOf/aWzQBIb+FhS9kgHxWErE+UI6qrw8MsffOUSXX5 YvY3kEn17RkpWhqcB9ZkgLumOhIjfqIcngXmmEGsWGwOvfIIVoBSXT2KKicDEuflgrQ2 L/kg== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:date:message-id:dkim-signature :dkim-signature:dkim-signature:dkim-signature; bh=/7Gts9Vg8RtGmmioiiv1kJL4aLEq43DIkM9Z5kvDsLU=; fh=6SPKR4u+tbCaeWdnhAcD0LdUQi8F/jJaLs/7hLnuI+w=; b=AdSVJm34rB5ayUncvWMnh1+EOrr70t713tm7IVWDMWIqJlLMbg4N4ZS/YTp59rjL5X MBmq3lm0rq3WZf3WpmR7Iodtp3M4WY8RDgPhgQEmb/jKxqdF4YGk91rRAHo12kU+3xh/ DViqHEB9zFrWtnMrhXsPB+063QuvP0qn6VWxlvfP02yG8FQl3yCZyYKL8Nr898Aa3Vjt TR5x7XmuWmGkGO2/EqStARJwSpggBHSnhg6kOaG3tsLMhrtED7LEOijyoAJh5tzx2zob sgm6Vc4zP3qxMhDft6r//3GqEoqVYVkS0quqIJrnWBYsplR6Yco7KO/Vgs+fOTxC5BNA NYUA==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@suse.de header.s=susede2_rsa header.b=0lU0AnUz; dkim=neutral (no key) header.i=@suse.de header.s=susede2_ed25519 header.b="6lp5MI/h"; dkim=pass header.i=@suse.de header.s=susede2_rsa header.b=0lU0AnUz; dkim=neutral (no key) header.i=@suse.de header.s=susede2_ed25519; arc=pass (i=1 spf=pass spfdomain=suse.de dkim=pass dkdomain=suse.de dkim=pass dkdomain=suse.de dmarc=pass fromdomain=suse.de); spf=pass (google.com: domain of linux-kernel+bounces-187046-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45d1:ec00::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-187046-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=suse.de Return-Path: Received: from ny.mirrors.kernel.org (ny.mirrors.kernel.org. [2604:1380:45d1:ec00::1]) by mx.google.com with ESMTPS id af79cd13be357-792bf3732f9si128235985a.687.2024.05.22.23.23.58 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 22 May 2024 23:23:58 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel+bounces-187046-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45d1:ec00::1 as permitted sender) client-ip=2604:1380:45d1:ec00::1; Authentication-Results: mx.google.com; dkim=pass header.i=@suse.de header.s=susede2_rsa header.b=0lU0AnUz; dkim=neutral (no key) header.i=@suse.de header.s=susede2_ed25519 header.b="6lp5MI/h"; dkim=pass header.i=@suse.de header.s=susede2_rsa header.b=0lU0AnUz; dkim=neutral (no key) header.i=@suse.de header.s=susede2_ed25519; arc=pass (i=1 spf=pass spfdomain=suse.de dkim=pass dkdomain=suse.de dkim=pass dkdomain=suse.de dmarc=pass fromdomain=suse.de); spf=pass (google.com: domain of linux-kernel+bounces-187046-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45d1:ec00::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-187046-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=suse.de Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ny.mirrors.kernel.org (Postfix) with ESMTPS id 6EDF91C21D1E for ; Thu, 23 May 2024 06:23:58 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 3162513B5A7; Thu, 23 May 2024 06:23:41 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=suse.de header.i=@suse.de header.b="0lU0AnUz"; dkim=permerror (0-bit key) header.d=suse.de header.i=@suse.de header.b="6lp5MI/h"; dkim=pass (1024-bit key) header.d=suse.de header.i=@suse.de header.b="0lU0AnUz"; dkim=permerror (0-bit key) header.d=suse.de header.i=@suse.de header.b="6lp5MI/h" Received: from smtp-out2.suse.de (smtp-out2.suse.de [195.135.223.131]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 61DE913B59C for ; Thu, 23 May 2024 06:23:38 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=195.135.223.131 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1716445420; cv=none; b=E8L9K4EoxGz7qxyijOwtHXOf2uUTc2SskHrzj80Y2tm08btCA8LkOyGzAzwv8hKyKX/TC6UEVcPmITQaRmZLV5yM6J4gf2YPwEDd0l9vvV5aSO8Nho0loWTxfJpNg6CEQSZqhUcjtosVNF5r2kqweKkJMjM0q2caOMVhwxnjdP4= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1716445420; c=relaxed/simple; bh=BsMXxU2oDvNb0FaRJ1CDaOlj6Db2mw0DLOdkJ4DqKDU=; h=Message-ID:Date:MIME-Version:Subject:To:Cc:References:From: In-Reply-To:Content-Type; b=n4j7J52lyHKdg6uT8neStxvZDoA8fao4sx0v2d51WakLKLYocnvK9YAyChCE0sXPnMQEIOMECelbstPJk5CMNaXJ091P3Z3cK5vNvrRc9GonyWDVGUZI1pakvoAtoWpanoulg7TVXt95YG/xGzcBxqF5+Ir6MYHzxHcuNyqcjDs= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=suse.de; spf=pass smtp.mailfrom=suse.de; dkim=pass (1024-bit key) header.d=suse.de header.i=@suse.de header.b=0lU0AnUz; dkim=permerror (0-bit key) header.d=suse.de header.i=@suse.de header.b=6lp5MI/h; dkim=pass (1024-bit key) header.d=suse.de header.i=@suse.de header.b=0lU0AnUz; dkim=permerror (0-bit key) header.d=suse.de header.i=@suse.de header.b=6lp5MI/h; arc=none smtp.client-ip=195.135.223.131 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=suse.de Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=suse.de Received: from imap1.dmz-prg2.suse.org (imap1.dmz-prg2.suse.org [IPv6:2a07:de40:b281:104:10:150:64:97]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by smtp-out2.suse.de (Postfix) with ESMTPS id 533B01FF36; Thu, 23 May 2024 06:23:35 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_rsa; t=1716445415; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=/7Gts9Vg8RtGmmioiiv1kJL4aLEq43DIkM9Z5kvDsLU=; b=0lU0AnUzGoUPbqFIEi9C1bRROOQLa/YFMWhecRgQ7Xt7DQPSe1hFNxa73R3/wMtXHIdkvW nbRoyPnKT66A0skaI/WAwnHOwSDS8aE+ivmXbp+WHuUIyeWjxAj2CJyGDIlZQqQ/1LNoIe fifsrwj9nTH4y9g8QSLktavGPykMRpU= DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_ed25519; t=1716445415; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=/7Gts9Vg8RtGmmioiiv1kJL4aLEq43DIkM9Z5kvDsLU=; b=6lp5MI/h/l7kqkNgOoBe5IpKTTLWdRzWtlBTcQtPpwI+WgarnsqFHRy3s0zsYKs6TMP1Ui kPYKE+pbv5k/JbDw== Authentication-Results: smtp-out2.suse.de; dkim=pass header.d=suse.de header.s=susede2_rsa header.b=0lU0AnUz; dkim=pass header.d=suse.de header.s=susede2_ed25519 header.b="6lp5MI/h" DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_rsa; t=1716445415; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=/7Gts9Vg8RtGmmioiiv1kJL4aLEq43DIkM9Z5kvDsLU=; b=0lU0AnUzGoUPbqFIEi9C1bRROOQLa/YFMWhecRgQ7Xt7DQPSe1hFNxa73R3/wMtXHIdkvW nbRoyPnKT66A0skaI/WAwnHOwSDS8aE+ivmXbp+WHuUIyeWjxAj2CJyGDIlZQqQ/1LNoIe fifsrwj9nTH4y9g8QSLktavGPykMRpU= DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_ed25519; t=1716445415; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=/7Gts9Vg8RtGmmioiiv1kJL4aLEq43DIkM9Z5kvDsLU=; b=6lp5MI/h/l7kqkNgOoBe5IpKTTLWdRzWtlBTcQtPpwI+WgarnsqFHRy3s0zsYKs6TMP1Ui kPYKE+pbv5k/JbDw== Received: from imap1.dmz-prg2.suse.org (localhost [127.0.0.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by imap1.dmz-prg2.suse.org (Postfix) with ESMTPS id E86EB13A6B; Thu, 23 May 2024 06:23:34 +0000 (UTC) Received: from dovecot-director2.suse.de ([2a07:de40:b281:106:10:150:64:167]) by imap1.dmz-prg2.suse.org with ESMTPSA id cxggN+bgTmaRUAAAD6G6ig (envelope-from ); Thu, 23 May 2024 06:23:34 +0000 Message-ID: Date: Thu, 23 May 2024 08:23:34 +0200 Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [PATCH v4 1/1] nvme: multipath: Implemented new iopolicy "queue-depth" Content-Language: en-US To: John Meneghini , kbusch@kernel.org, hch@lst.de, sagi@grimberg.me, emilne@redhat.com Cc: linux-nvme@lists.infradead.org, linux-kernel@vger.kernel.org, jrani@purestorage.com, randyj@purestorage.com, hare@kernel.org References: <20240522154212.643572-1-jmeneghi@redhat.com> <20240522154212.643572-2-jmeneghi@redhat.com> From: Hannes Reinecke In-Reply-To: <20240522154212.643572-2-jmeneghi@redhat.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spam-Flag: NO X-Spam-Score: -4.50 X-Rspamd-Action: no action X-Rspamd-Queue-Id: 533B01FF36 X-Spam-Level: X-Rspamd-Server: rspamd2.dmz-prg2.suse.org X-Spamd-Result: default: False [-4.50 / 50.00]; BAYES_HAM(-3.00)[100.00%]; NEURAL_HAM_LONG(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[suse.de:s=susede2_rsa,suse.de:s=susede2_ed25519]; NEURAL_HAM_SHORT(-0.20)[-1.000]; MIME_GOOD(-0.10)[text/plain]; MX_GOOD(-0.01)[]; XM_UA_NO_VERSION(0.01)[]; RECEIVED_SPAMHAUS_BLOCKED_OPENRESOLVER(0.00)[2a07:de40:b281:106:10:150:64:167:received]; RBL_SPAMHAUS_BLOCKED_OPENRESOLVER(0.00)[2a07:de40:b281:104:10:150:64:97:from]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_SEVEN(0.00)[10]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; TO_DN_SOME(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; FUZZY_BLOCKED(0.00)[rspamd.com]; RCVD_COUNT_TWO(0.00)[2]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DBL_BLOCKED_OPENRESOLVER(0.00)[imap1.dmz-prg2.suse.org:helo,imap1.dmz-prg2.suse.org:rdns,suse.de:dkim,suse.de:email]; DKIM_SIGNED(0.00)[suse.de:s=susede2_rsa,suse.de:s=susede2_ed25519]; DKIM_TRACE(0.00)[suse.de:+] On 5/22/24 17:42, John Meneghini wrote: > From: "Ewan D. Milne" > > The round-robin path selector is inefficient in cases where there is a > difference in latency between paths. In the presence of one or more > high latency paths the round-robin selector continues to use the high > latency path equally. This results in a bias towards the highest latency > path and can cause a significant decrease in overall performance as IOs > pile on the highest latency path. This problem is acute with NVMe-oF > controllers. > > The queue-depth policy instead sends I/O requests down the path with the > least amount of requests in its request queue. Paths with lower latency > will clear requests more quickly and have less requests in their queues > compared to higher latency paths. The goal of this path selector is to > make more use of lower latency paths which will bring down overall IO > latency and increase throughput and performance. > > Signed-off-by: Thomas Song > [emilne: patch developed by Thomas Song @ Pure Storage, fixed whitespace > and compilation warnings, updated MODULE_PARM description, and > fixed potential issue with ->current_path[] being used] > Signed-off-by: Ewan D. Milne > [jmeneghi: vairious changes and improvements, addressed review comments] > Signed-off-by: John Meneghini > Link: https://lore.kernel.org/linux-nvme/20240509202929.831680-1-jmeneghi@redhat.com/ > Tested-by: Marco Patalano > Reviewed-by: Randy Jennings > Tested-by: Jyoti Rani > --- > drivers/nvme/host/core.c | 2 +- > drivers/nvme/host/multipath.c | 91 +++++++++++++++++++++++++++++++++-- > drivers/nvme/host/nvme.h | 8 +++ > 3 files changed, 96 insertions(+), 5 deletions(-) > Reviewed-by: Hannes Reinecke Cheers, Hannes -- Dr. Hannes Reinecke Kernel Storage Architect hare@suse.de +49 911 74053 688 SUSE Software Solutions GmbH, Frankenstr. 146, 90461 Nürnberg HRB 36809 (AG Nürnberg), GF: I. Totev, A. McDonald, W. Knoblich