Received: by 2002:ab2:2994:0:b0:1ef:ca3e:3cd5 with SMTP id n20csp422234lqb; Thu, 14 Mar 2024 15:37:07 -0700 (PDT) X-Forwarded-Encrypted: i=3; AJvYcCXSBVsccrg9WSlqVpaAZi6gn4EFz3HAZcJpVlMkrNJ67oRx/UmQCZD0jwo8OFBy13iAWK8jYoErEToX2zZ/jEo5k1yO+D3k6AKpLa2M3A== X-Google-Smtp-Source: AGHT+IGd2DtBnDPRuqjsRXoMTHB2Vnt38/NZl9aGG2EWb3W9GqixCM1uzYk4W0R4j/GzD8ORyqNP X-Received: by 2002:a50:ed14:0:b0:568:a189:75ca with SMTP id j20-20020a50ed14000000b00568a18975camr1717098eds.38.1710455827257; Thu, 14 Mar 2024 15:37:07 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1710455827; cv=pass; d=google.com; s=arc-20160816; b=cCFxe6kLT1g5QBhHmAvvxRN6FHKJfi8NKTCf1FbZZct0a+qeeFxmW1T61W7lj02C1A 8yOhoE6p6M8fdnx4AXycVQGeTrbSdpFs1yt4/5tde3CIX4lLJCOH8pOW5/iKzyqOr70R QSkCW7Sb/Dg0Pgjesf/yQH8tbdqrYxopRi/ocal3dQWXDT6rNNbLCtPPUHk97i5k9gQZ xnN8Y6bmsJKxK39G/7jtc0X8Y0W0QFj/qCBRFbwPEn9oiz3PQ/vYptC/ufGqK7vh6dcI moAek5WMPwwlS90JaI7mWPkELXSWDkqnX0GgVV9dRMB4QwakHKD/zPxcHCHTPLAwG1gN ezqQ== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:list-unsubscribe:list-subscribe :list-id:precedence:dkim-signature; bh=fbNb5wcqEZU5SnCBUM6reim3vrCnqaK/WfSKJQJ0njg=; fh=XZt+34I5+FKdae5O4uCBWqzScr/3zSXd9UlBYDduTDA=; b=os/H2bpqCPm9dszgZgfYJQ1CC47G8ARJ/XAiM+acn+g6GkjthOXSCHKjRImsXWAvhi wPTE/D1o6VFtvlKuDe6D7QFfoGZu/9q2BISkH03nnaL7OUs++9tKDLVOKmQ6U2c8GTRK eFNiQsAA3EP/swud2OBExsBHqZ0JeX+adx83ZDhGBSZPB1pR34+L1UYmdVMWiVUrmYQ9 DxOEXorzvDuSwOk2STVIpBsNwXezQ6oaIt46s5ulvsf9c79y+3YF/RkyUoYsYxuNTSpN jgQbge6934JCPZAwCQzN8RuDiHesog6VO60XoeXEfgnNjfsB1p3n5Fhvv/aNIOGT9HWQ vH+w==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=eX0FkPV2; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-103838-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) smtp.mailfrom="linux-kernel+bounces-103838-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from am.mirrors.kernel.org (am.mirrors.kernel.org. [147.75.80.249]) by mx.google.com with ESMTPS id eo10-20020a056402530a00b0056878a50d9csi1208762edb.431.2024.03.14.15.37.07 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 14 Mar 2024 15:37:07 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel+bounces-103838-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) client-ip=147.75.80.249; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=eX0FkPV2; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-103838-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) smtp.mailfrom="linux-kernel+bounces-103838-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by am.mirrors.kernel.org (Postfix) with ESMTPS id 8E6CA1F218B3 for ; Thu, 14 Mar 2024 22:37:04 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id C31A8BE62; Thu, 14 Mar 2024 22:36:52 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="eX0FkPV2" Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id DF780DDAD; Thu, 14 Mar 2024 22:36:51 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1710455812; cv=none; b=ORPyVkB578nU+uxcvNI+9rYq9cRLxL2a4CJsPR4YL+vUwSgmYVo5eYpGAKZFXmkqVnP3OQIrvSTQP44lT1ploqtB1onqEkTQTOMLQn/Whe0f5uF93XEVaMxCt6P0hF6VuNnE7mQNd2fkQFvs6KWocFE30cQQlPkRR/9a8bDfMQY= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1710455812; c=relaxed/simple; bh=fbNb5wcqEZU5SnCBUM6reim3vrCnqaK/WfSKJQJ0njg=; h=MIME-Version:References:In-Reply-To:From:Date:Message-ID:Subject: To:Cc:Content-Type; b=fIw0ZuuiaR1tUk1fZTX2RJHN7EFb8ZRBpXgVVWf5ze6J1SjHsA41r5OPONlDWQ7wdXubQ+RshDutlBgISL252JNGVH0q4wCIFWNsqKvKkMZlIR1WkOTAUYjswiPyXRN89TkiLRmsLpnuFyEFi/CqhjSl6p8eSrU00EEyEKLswI4= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=eX0FkPV2; arc=none smtp.client-ip=10.30.226.201 Received: by smtp.kernel.org (Postfix) with ESMTPSA id 8296BC43399; Thu, 14 Mar 2024 22:36:51 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1710455811; bh=fbNb5wcqEZU5SnCBUM6reim3vrCnqaK/WfSKJQJ0njg=; h=References:In-Reply-To:From:Date:Subject:To:Cc:From; b=eX0FkPV29BtRH+YQ2XMihobim0z38t5NXP5yWvokl1Ow+kh5NDpOuNHMh8NIqtO4E MlbvzYFjojFJqVU4bCAjf0oc44Pdg2OMgade2Dfjuvi5IMm20v1Z3z5EpzVF2dWEkP VkzASyUbYjj+5TpfpNeG8KXFXZCMmS88XFOuPQB37hKXhVjjjD71fnlez/rlPdy6lF l0YkbIQOveYU6f2L8QW9sFolAhX0qqfJg0M3r9ts1PwyRpD2MHEc4FE1wjwqxgGIrT zHqPdaJvbdPGLSwJmBcDnVYMYTrGepyL3katyh7vL+COLjv3MYNzn14scUBcrly/SN qxtA2OvlgsR5g== Received: by mail-lj1-f175.google.com with SMTP id 38308e7fff4ca-2d27184197cso18029701fa.1; Thu, 14 Mar 2024 15:36:51 -0700 (PDT) X-Forwarded-Encrypted: i=1; AJvYcCV3t2zuuH/HRqxUHFU0PL4U0Dg5HR8S7ZcQegl0/Z5o7ScsIS6FZzBvjxz854xrPGLAGT/45GJ3tzrgFLOAjpG/0iSp4ujmNKU/4P2JPm97dTPOyiksDjObBmaPGvUydHpwuhzCndV+VeQOqPn4zcUzOqeguQwkmYwzcws1ztDFiA== X-Gm-Message-State: AOJu0YzQqUN3r5iGAQWWGma/2vmt7LwdMvctzYWSkOazo40Uj6JYvKA0 HksqPNwSp4PG2yUVFqxrMVv3IjFHn0S/9cN84t17HZpLPeGQHCxL1AzifVeccr7aAQ5qTxNaSIc Cx7nBMInB7viJRXpzVVPp/pNfT88= X-Received: by 2002:a2e:bba5:0:b0:2d4:72c1:d2dd with SMTP id y37-20020a2ebba5000000b002d472c1d2ddmr2106863lje.8.1710455809914; Thu, 14 Mar 2024 15:36:49 -0700 (PDT) Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 References: <20240123005700.9302-1-dan@danm.net> <20240220230658.11069-1-dan@danm.net> <7efac6e0-32df-457e-9d21-4945c69328f8@leemhuis.info> <739634c3-3e21-44dd-abb1-356cf54e54fd@oracle.com> In-Reply-To: From: Song Liu Date: Thu, 14 Mar 2024 15:36:38 -0700 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: [REGRESSION] 6.7.1: md: raid5 hang and unresponsive system; successfully bisected To: junxiao.bi@oracle.com Cc: Yu Kuai , Linux regressions mailing list , gregkh@linuxfoundation.org, linux-kernel@vger.kernel.org, linux-raid@vger.kernel.org, stable@vger.kernel.org, Dan Moulding , "yukuai (C)" Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Thu, Mar 14, 2024 at 11:20=E2=80=AFAM wrote: > [...] > >> > >> This patch eliminated the benefit of blk_plug, i think it will not be > >> good for IO performance perspective? > > > > There is only one daemon thread, so IO should not be handled here as > > much as possible. The IO should be handled by the thread that is > > submitting the IO, and let daemon to hanldle the case that IO failed or > > can't be submitted at that time. raid5 can have multiple threads calling handle_stripe(). See raid5_do_work(= ). Only chunk_aligned_read() can be handled in raid5_make_request. > > I am not sure how much it will impact regarding drop the blk_plug. > > Song, what's your take on this? I think we need to evaluate the impact of (removing) blk_plug. We had some performance regressions related to blk_plug a couple years ago. Thanks, Song