Received: by 2002:a05:6359:322:b0:b3:69d0:12d8 with SMTP id ef34csp502577rwb; Wed, 10 Aug 2022 11:48:08 -0700 (PDT) X-Google-Smtp-Source: AA6agR7ZWL6cOvGAw+bble/Dktt/WPUBtNd+IxkG/BV7wAyn6o8RubpE/KwOppNDWh1ieYt3Nol+ X-Received: by 2002:a63:4566:0:b0:41d:353:46b4 with SMTP id u38-20020a634566000000b0041d035346b4mr21376523pgk.316.1660157288057; Wed, 10 Aug 2022 11:48:08 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1660157288; cv=none; d=google.com; s=arc-20160816; b=gJEcGUScRQvIHAHI2WJWBZLSCll/N0h68vozrQhu8rT7yTqAiDcw8c2X2D3GhASiUx 40Z06SDbgaNRn2NvIPCYSFdDwUlYjusRoohFwkU4uKEpijqTxm1eMdxopWYkUmIaFnIj OBWG6lyiJPeEqWOu9WKUTyztkTkXEP2EUGt3x5kR4wNH1155y42RdwSiu1S9IOrw/L7h MEWETTXkfm6dPSl6Lz0S2uo225OjPSHXLF3j+Z4BvCIxlEHF+Dw/9zH/DUsXSVG9ORUu wxD1u2y0KgdRj+oR8rtWEWiWXTdfORoEOajUWNDC4rN5kri3plNskP7tREGfU6a2b0YD 4q/g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:subject:cc:to:from:date:references:in-reply-to :message-id:mime-version:user-agent:feedback-id:dkim-signature :dkim-signature; bh=s937p5S+ceUeuGttr8ilCz3uf4ZJwae9ficmCjs8F74=; b=etUo4gQ7eDRkilmAVrGamkXveUE5r2risWlkP6KcEINPEY8PbrnI8Lm8kFV+Tf5dM5 wt/pG1zaDRBB3czlqOGe8dTBvtjoPbBvdAZxCTywlJ3tohw2Iufv72K/97aVjSB5Q2zc n6hejAldsuXfp1cJtllaLlSmMzICZqbOpeN7jBC7RTVZZ+z47Q22oHPACH407x6Rhbb7 ewIy/Gech5AQHTmJG+gWlIdUVmbiS1Cu+eCud6lpSNatRQQT7TWCmhpkInBSV/2cOfHT sBbWdtNGgax3Nl0iJwVljf/NDIN3JI42cwjJFLyfnRfjHFCuxFarrTNPjkm3wlE88fxF fwKw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@colorremedies.com header.s=fm1 header.b=aNMKIxVi; dkim=pass header.i=@messagingengine.com header.s=fm1 header.b=Sr7lag5w; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id 5-20020a630c45000000b0041dff983839si1279267pgm.453.2022.08.10.11.47.52; Wed, 10 Aug 2022 11:48:08 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@colorremedies.com header.s=fm1 header.b=aNMKIxVi; dkim=pass header.i=@messagingengine.com header.s=fm1 header.b=Sr7lag5w; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S233693AbiHJSeZ (ORCPT + 99 others); Wed, 10 Aug 2022 14:34:25 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:38262 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S233808AbiHJSeC (ORCPT ); Wed, 10 Aug 2022 14:34:02 -0400 Received: from new3-smtp.messagingengine.com (new3-smtp.messagingengine.com [66.111.4.229]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id B7E4D8C025; Wed, 10 Aug 2022 11:34:01 -0700 (PDT) Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailnew.nyi.internal (Postfix) with ESMTP id 43E275806F4; Wed, 10 Aug 2022 14:33:59 -0400 (EDT) Received: from imap50 ([10.202.2.100]) by compute3.internal (MEProxy); Wed, 10 Aug 2022 14:33:59 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= colorremedies.com; h=cc:cc:content-type:date:date:from:from :in-reply-to:in-reply-to:message-id:mime-version:references :reply-to:sender:subject:subject:to:to; s=fm1; t=1660156439; x= 1660160039; bh=s937p5S+ceUeuGttr8ilCz3uf4ZJwae9ficmCjs8F74=; b=a NMKIxViWmetgN3koeks1gxsuPGBEYp6vfI1oIkwcxq5nVjr6dt5uX2SPqCIv+ytp 0dCgFrB13TluAJBVVakaxNkRZRTyDBvy0TQ/QXGsCN/kU/O9B/3lhEV+itpFGqOQ JoW4EYo7K/8fco/N2FciiGon1/9MpymrzcGSLsmW+8e2wOmIicQzBVyBiIUwG0AT tvv65YHVYJ/cLCJskw2QiGPsfYyBOtqRlsWaPDwhRZCDJqANFTMoiHqT8f3p5BE1 4jqjJYd5KDhFi7JB+3gnyY0/XZ1q4BLWcFMGF50DYXF8s6B32duwM9YmlW8wnUhm AtNd5NiRHjhBVbRWZ9Irg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-type:date:date:feedback-id :feedback-id:from:from:in-reply-to:in-reply-to:message-id :mime-version:references:reply-to:sender:subject:subject:to:to :x-me-proxy:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s= fm1; t=1660156439; x=1660160039; bh=s937p5S+ceUeuGttr8ilCz3uf4ZJ wae9ficmCjs8F74=; b=Sr7lag5wE7wLcDL52FWeJg1TXR9hMWX/ZaWoLGbk4+pc ZxgtMWG0FmXZUiCHgnDnO175vswE961Q5uesBG9lA5gyTau3VVzPJTayINIs+14I T8rrVKqgwvyP4kA2mBPgmVnN7pky1jP/bHsL3IaxjR1/AI0+qlJNKX99b/CsAWwM g0zwGuJh8OzH5nBBQ6uSfFk0CcPCGZNheyzjQQJYAKIADfn9OT2kezgx98g4yq88 AVJxPtC1ziZiUJuQPPVXOM0Unoke4QapWewxtbkyHqyz6zLEpNiWXuq/FGBlNXvQ OwbSgVD8gLrOMCTYnh/ImFXcEgzacxffYwMg4q/VCQ== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvfedrvdegvddguddvgecutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfgh necuuegrihhlohhuthemuceftddtnecusecvtfgvtghiphhivghnthhsucdlqddutddtmd enucfjughrpefofgggkfgjfhffhffvvefutgesthdtredtreertdenucfhrhhomhepfdev hhhrihhsucfouhhrphhhhidfuceolhhishhtshestgholhhorhhrvghmvgguihgvshdrtg homheqnecuggftrfgrthhtvghrnhepgfdvueektdefgfefgfdtleffvdeileetgfefuddt ffelueeiveeiveekhedtheeunecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpe hmrghilhhfrhhomheplhhishhtshestgholhhorhhrvghmvgguihgvshdrtghomh X-ME-Proxy: Feedback-ID: i06494636:Fastmail Received: by mailuser.nyi.internal (Postfix, from userid 501) id 00DA91700083; Wed, 10 Aug 2022 14:33:58 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface User-Agent: Cyrus-JMAP/3.7.0-alpha0-811-gb808317eab-fm-20220801.001-gb808317e Mime-Version: 1.0 Message-Id: <2220d403-e443-4e60-b7c3-d149e402c13e@www.fastmail.com> In-Reply-To: References: Date: Wed, 10 Aug 2022 14:33:38 -0400 From: "Chris Murphy" To: "Josef Bacik" Cc: "Btrfs BTRFS" , Linux-RAID , linux-block@vger.kernel.org, linux-kernel Subject: Re: stalling IO regression in linux 5.12 Content-Type: text/plain X-Spam-Status: No, score=-2.8 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_LOW,SPF_HELO_PASS, SPF_PASS,T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Wed, Aug 10, 2022, at 1:48 PM, Josef Bacik wrote: > To help narrow this down can you disable any IO controller you've got enabled > and see if you can reproduce? If you can sysrq+w is super helpful as it'll > point us in the next direction to look. Thanks, I'm not following, sorry. I can boot with systemd.unified_cgroup_hierarchy=0 to make sure it's all off, but we're not using an IO cgroup controllers specifically as far as I'm aware. -- Chris Murphy