Received: by 2002:a05:6358:c692:b0:131:369:b2a3 with SMTP id fe18csp96150rwb; Thu, 27 Jul 2023 09:51:09 -0700 (PDT) X-Google-Smtp-Source: APBJJlEJzuA3fiR+h8R0+Hq4BXutvHKkJzOCP6+yYJdxnoPsSh/6AtMqrS5yTpehDX08BH2hIs92 X-Received: by 2002:a05:651c:106:b0:2b9:20fe:4bcc with SMTP id a6-20020a05651c010600b002b920fe4bccmr2392636ljb.21.1690476668787; Thu, 27 Jul 2023 09:51:08 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1690476668; cv=none; d=google.com; s=arc-20160816; b=SBYraYgSe3/ZJ6O2w21UbMDAxtxe2TE4QHhbIy+KqQ3FTtAxiG824EAp+QizYwkYZh u3vr7PDVVDxpDpdDayZGOxv132oB44lvKgF7LyQOWVeBHuijEEIZ4S075bfboOAgIZ9Z pTQeT67vegl9uVTDDSzPq8Kk5f985PorXgP2/xeZzhktFTJHUVC7mcreiubxPG7nxMks FqLZgidHogOjS3NUu6TqdZE7ywjrh1MHxsgfYCLKJGyPkSP6v8D6UoI+ga6kMVAx0qhy xeVXBXEvRzm9WFDAd5S8/NFRkA31VPOD9WJAnlhRSnngLk8jaiUhikRFDCylzgsx0UNq wRJA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:in-reply-to:content-transfer-encoding :content-disposition:mime-version:references:reply-to:message-id :subject:cc:to:from:date:dkim-signature; bh=xoyLjvmucUOUGrxTZAczFfiQ3RK4oJSBFgC2mSXhp0w=; fh=auw/a1EyNS/DSzOt2Jlmyrw3GcYEW/j6UXhNakOu4gc=; b=Yf7Mf0rfuyy8ADg8+kjiIrdCxISx8fWpSf/nrR7kTR8mx+8yhbOVTlFf0FdibIsqKE nQokZoj356Uydo/N9PFeW2Kh9RELjB55o48Q+kzrWB6JummkJeknzsiMGnlZjSYA61Xa NczjRmxBLkrxWOCpn6ypc5F444cf4Nh3c7xB5Ib0/QxwleMnc4B8PSoLlhlo3pwGeO9Q /xvGKAhzy01tjvIV1vktilQkEm3pvDOg9vyqeiSW381vpyog2lDLeO5g/BJ7+zNQQLHt 8QDlgyGw3ildPKDjkP2TVWHoVTeaKoWMXnefI3FNuPmGKBLQFBBkXs39xCN3i2tSzJsg e77Q== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=RYz+SK6Z; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id v15-20020a170906564f00b009930253bc69si715508ejr.1011.2023.07.27.09.50.43; Thu, 27 Jul 2023 09:51:08 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=RYz+SK6Z; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S234165AbjG0QH3 (ORCPT + 99 others); Thu, 27 Jul 2023 12:07:29 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:60688 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S233470AbjG0QH0 (ORCPT ); Thu, 27 Jul 2023 12:07:26 -0400 Received: from dfw.source.kernel.org (dfw.source.kernel.org [139.178.84.217]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id E86C9359A; Thu, 27 Jul 2023 09:07:09 -0700 (PDT) Received: from smtp.kernel.org (relay.kernel.org [52.25.139.140]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by dfw.source.kernel.org (Postfix) with ESMTPS id 5D40C61EEA; Thu, 27 Jul 2023 16:07:09 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id BCFBBC433C8; Thu, 27 Jul 2023 16:07:08 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1690474028; bh=uBvzXfHO1nsSRjLcionOhLpZMwIec1LCVD6wwCarigE=; h=Date:From:To:Cc:Subject:Reply-To:References:In-Reply-To:From; b=RYz+SK6ZEzLzz1Mdh24O+2stfplmHIts9XxT584v30nxRw0nUPQc6XakHgC9iMd7n pBUkiritFqLokBmoWgQ0P7Hh+mjz5+KZ2Tkqf/KACVUkVKX8ww2DMg7L7y7eKqsb3M UGben2x0vnCsT4p3UJDQjMrvKLX0ddut/p7gPmhBeb5DEsp1QzXINvdytZZ6udQX49 YCGjV5+fy1hEdtaU5ABOsUqrT4Ky8ITEea9kbNnHA8RDeMj9jBWTvArHq+yrGNsKxA cRcSJJ7lEWQYvzY6H2Y9PLW53FfW4zmH/NaJqS4kjZrr4yXi5LiZv+UtWpTAXiEAY/ TWS7V31i+PJLA== Received: by paulmck-ThinkPad-P17-Gen-1.home (Postfix, from userid 1000) id 53053CE0B66; Thu, 27 Jul 2023 09:07:08 -0700 (PDT) Date: Thu, 27 Jul 2023 09:07:08 -0700 From: "Paul E. McKenney" To: Guenter Roeck Cc: Joel Fernandes , Pavel Machek , Greg Kroah-Hartman , stable@vger.kernel.org, patches@lists.linux.dev, linux-kernel@vger.kernel.org, torvalds@linux-foundation.org, akpm@linux-foundation.org, shuah@kernel.org, patches@kernelci.org, lkft-triage@lists.linaro.org, jonathanh@nvidia.com, f.fainelli@gmail.com, sudipm.mukherjee@gmail.com, srw@sladewatkins.net, rwarsow@gmx.de, conor@kernel.org, rcu@vger.kernel.org Subject: Re: [PATCH 6.4 000/227] 6.4.7-rc1 review Message-ID: Reply-To: paulmck@kernel.org References: <78722041-D1F7-45FA-BA1C-41B92209BA6C@joelfernandes.org> <0751f5a8-2727-4a08-8bb8-50bbd4244c9c@paulmck-laptop> <67eba84a-ae24-2983-a756-463f39f3ca71@roeck-us.net> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <67eba84a-ae24-2983-a756-463f39f3ca71@roeck-us.net> X-Spam-Status: No, score=-7.1 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_HI, SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, Jul 27, 2023 at 07:39:54AM -0700, Guenter Roeck wrote: > On 7/27/23 07:06, Paul E. McKenney wrote: > > On Thu, Jul 27, 2023 at 09:26:52AM -0400, Joel Fernandes wrote: > > > > > > > > > > On Jul 27, 2023, at 7:35 AM, Pavel Machek wrote: > > > > > > > > Hi! > > > > > > > > > > This is the start of the stable review cycle for the 6.4.7 release. > > > > > > There are 227 patches in this series, all will be posted as a response > > > > > > to this one. If anyone has any issues with these being applied, please > > > > > > let me know. > > > > > > > > > > > > Responses should be made by Thu, 27 Jul 2023 10:44:26 +0000. > > > > > > Anything received after that time might be too late. > > > > > > > > > > > > The whole patch series can be found in one patch at: > > > > > > https://www.kernel.org/pub/linux/kernel/v6.x/stable-review/patch-6.4.7-rc1.gz > > > > > > or in the git tree and branch at: > > > > > > git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable-rc.git linux-6.4.y > > > > > > and the diffstat can be found below. > > > > > > > > > > I saw this when running rcutorture, this one happened in the TREE04 > > > > > configuration. This is likely due to the stuttering issues we are discussing > > > > > in the other thread. Anyway I am just making a note here while I am > > > > > continuing to look into it. > > > > > > > > So is the stuttering new in 6.4.7? > > > > > > No it is an old feature in RCU torture tests. But is dependent on timing. Something > > > changed in recent kernels that is making the issues with it more likely. Its hard to bisect as failure sometimes takes hours. > > > > > > > > > > > > Other than that, all tests pass: > > > > > Tested-by: Joel Fernandes (Google) > > > > > > > > ...or you still believe 6.4.7 is okay to release? > > > > > > As such, it should be Ok. However naturally I am not happy that the RCU testing > > > is intermittently failing. These issues have been seen in last several 6.4 stable releases > > > so since those were released, maybe this one can be too? > > > The fix for stuttering is currently being reviewed. > > > > Or, to look at it another way, the stuttering fix is specific to torture > > testing. Would we really want to hold up a -stable release only because > > rcutorture occasionally gives a false-positive failure on certain types > > of systems? > > > > No. However, (unrelated) in linux-next, rcu tests sometimes result in apparent hangs > or long runtime. > > [ 0.778841] Mount-cache hash table entries: 512 (order: 0, 4096 bytes, linear) > [ 0.779011] Mountpoint-cache hash table entries: 512 (order: 0, 4096 bytes, linear) > [ 0.797998] Running RCU synchronous self tests > [ 0.798209] Running RCU synchronous self tests > [ 0.912368] smpboot: CPU0: AMD Opteron 63xx class CPU (family: 0x15, model: 0x2, stepping: 0x0) > [ 0.923398] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1. > [ 0.925419] Running RCU-tasks wait API self tests > > (hangs until aborted). This is primarily with Opteron CPUs, but also with others such as Haswell, > Icelake-Server, and pentium3. It is all but impossible to bisect because it doesn't happen > all the time. All I was able to figure out was that it has to do with rcu changes in linux-next. > I'd be much more concerned about that. First I have heard of this, so thank you for letting me know. About what fraction of the time does this happen? Thanx, Paul