Received: by 2002:a05:6358:4e97:b0:b3:742d:4702 with SMTP id ce23csp5172590rwb; Wed, 17 Aug 2022 12:23:48 -0700 (PDT) X-Google-Smtp-Source: AA6agR7fGmfrq2WVtrvQuCoGfEK2WV8il15g2Ml3b7YpjlBzNvAYn2WlbONsebKTBKWeElrKuk10 X-Received: by 2002:a05:6402:44c:b0:445:f2f1:4add with SMTP id p12-20020a056402044c00b00445f2f14addmr1854124edw.257.1660764227955; Wed, 17 Aug 2022 12:23:47 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1660764227; cv=none; d=google.com; s=arc-20160816; b=QoBdxwxb8ur9jDI4UKnPVz5bXKS+KnudkgKNOW++omP5ZGgtFftp5vXcEZoXxo2/YX Y3Dcg4PLwSITv2v6FLGqb/VatDMX07BUVwiTnibQk6iDOdBZK4ASuFx8pR0q/IccDsX1 awnY9Qp/KJiHMjejJw3jnbU7HXGn63C6WE3P+FCntxdZD32QH88fXpHPOv7DisDL9oDP FGLiKC99YPagoByulXA/Ccjzn3W4PB2Wnq/z9GuHGXJl+pqGck1DhUrD+K4JN6rX47SP +BYTUHayolEzMMQ/5qfMtnmpb/al7AlpZb5Tz1n3drn9ZBbbZ1UNrBammBpv/99hJRI6 aANA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:in-reply-to:content-disposition:mime-version :references:message-id:subject:cc:to:from:date:dkim-signature :dkim-signature; bh=xCmrD3/yiFypiLuh4pQOWKPUE9hNFGZ5QazT35uSFjg=; b=e9FuPEPafKzdyU+Oc/I8Bn0XnGo4LFUYUdojXdySXWgaLIAn9McS21kNSM7ReLz2Cb JeMbZwloVAFF4mYbJi6XswvN9KmQePghPChfOcg0uSTRlBQSKBZekEnc+iR4CuydLLBt 5cnU/I5QUGIgf3hsHu68l0hMnwErCwrHFkzTa+WpH0t45tgDRHbQItFgrWg/r9K8AYs7 FXba/JiX+h8Jztvwvywnr87v2+6NA1h3gdHbgu2MSIT2CP1H1teXWoPqWH3XXcz0gNPe jMCUgLyXbhtxTmRqGp993zfb8nl62qyPODIncHjqbOlcLHfFmM7uc1DngezbqSrxSCeQ o5xw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@suse.cz header.s=susede2_rsa header.b=yIKNDOJU; dkim=neutral (no key) header.i=@suse.cz; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id ds11-20020a170907724b00b00726b8366590si984653ejc.944.2022.08.17.12.23.22; Wed, 17 Aug 2022 12:23:47 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@suse.cz header.s=susede2_rsa header.b=yIKNDOJU; dkim=neutral (no key) header.i=@suse.cz; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S236957AbiHQSdl (ORCPT + 99 others); Wed, 17 Aug 2022 14:33:41 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:39228 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S238497AbiHQSdj (ORCPT ); Wed, 17 Aug 2022 14:33:39 -0400 Received: from smtp-out1.suse.de (smtp-out1.suse.de [IPv6:2001:67c:2178:6::1c]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 43AC7753B5; Wed, 17 Aug 2022 11:33:38 -0700 (PDT) Received: from relay2.suse.de (relay2.suse.de [149.44.160.134]) by smtp-out1.suse.de (Postfix) with ESMTP id EE0D2382FC; Wed, 17 Aug 2022 18:33:36 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.cz; s=susede2_rsa; t=1660761216; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=xCmrD3/yiFypiLuh4pQOWKPUE9hNFGZ5QazT35uSFjg=; b=yIKNDOJUZPKa8vP3/+bRK2QylzHK16xgqBb4pJqdDuPV9LM92D2cbkJRiijDo7k2La+rpK rBptaUJRhalud8iHi2+M+ljtpw4jwCBvNteDF3FCXFxhBH/2Rl1KsrgQCFM3mzoCX0r+Do bse/8/LbLyVvVX4xNinT4/t201eGYzU= DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=suse.cz; s=susede2_ed25519; t=1660761216; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=xCmrD3/yiFypiLuh4pQOWKPUE9hNFGZ5QazT35uSFjg=; b=oUociQbIlOSoobQoQ9AUzboMOWloX+lDnG0xaoJrsP4KyIhTAwWy3oVByzHV8UppNs4J9p CTcPa5wC0mANThBw== Received: from quack3.suse.cz (unknown [10.100.224.230]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by relay2.suse.de (Postfix) with ESMTPS id B79F42C177; Wed, 17 Aug 2022 18:33:36 +0000 (UTC) Received: by quack3.suse.cz (Postfix, from userid 1000) id AC4A9A066B; Wed, 17 Aug 2022 20:33:35 +0200 (CEST) Date: Wed, 17 Aug 2022 20:33:35 +0200 From: Jan Kara To: Chris Murphy Cc: Jan Kara , Holger =?utf-8?Q?Hoffst=C3=A4tte?= , Nikolay Borisov , Jens Axboe , Paolo Valente , Linux-RAID , linux-block , linux-kernel , Josef Bacik Subject: Re: stalling IO regression since linux 5.12, through 5.18 Message-ID: <20220817183335.47a4ao26wjopavo2@quack3> References: <2b8a38fa-f15f-45e8-8caa-61c5f8cd52de@www.fastmail.com> <7c830487-95a6-b008-920b-8bc4a318f10a@applied-asynchrony.com> <20220817114933.66c4g4xjsi4df2tg@quack3> <85a141ae-56a7-4dcd-b75a-04be4b276b3a@www.fastmail.com> <20220817163059.kigrvdfmxfswmhls@quack3> <51cd43f9-ab6b-4dd6-814f-e0c1ace3143c@www.fastmail.com> <20220817181554.znqljc6mmci45ukd@quack3> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Spam-Status: No, score=-1.4 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,SPF_HELO_NONE,SPF_SOFTFAIL, T_SCC_BODY_TEXT_LINE,URIBL_BLOCKED autolearn=no autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Wed 17-08-22 14:18:01, Chris Murphy wrote: > > > On Wed, Aug 17, 2022, at 2:15 PM, Jan Kara wrote: > > > OK, if this indeed passes then b6e68ee82585 ("blk-mq: Improve performance > > of non-mq IO schedulers with multiple HW queues") might be what's causing > > issues (although I don't know how yet...). > > I can revert it from 5.12.0 and try. Let me know which next test is preferred :) Let's try to revert this first so that we have it narrowed down what started causing the issues. Honza -- Jan Kara SUSE Labs, CR