Received: by 2002:a05:6358:bb9e:b0:b9:5105:a5b4 with SMTP id df30csp1971563rwb; Sun, 4 Sep 2022 06:00:37 -0700 (PDT) X-Google-Smtp-Source: AA6agR6ydqBu6mqWINSnsZS+mo6LKWky/6hdwr/TRsi5zMvMXl5E2M9gEON9t7H7cR39HqMH7Hlf X-Received: by 2002:a17:90b:4b8f:b0:1fb:10e2:5c99 with SMTP id lr15-20020a17090b4b8f00b001fb10e25c99mr14606665pjb.194.1662296437105; Sun, 04 Sep 2022 06:00:37 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1662296437; cv=none; d=google.com; s=arc-20160816; b=jM0rtUmNpRg6E8jjyTdJpJ4PXpF1iPJE83xvQ3KdVRzoG2UJhjU521vye0glpqosnS 88lAb1gBBJnFfB6H0rSs4Mz1cX3tQ631HD1Khm4wfLC5jdY1ux0WjCB60PCeniP6wLWQ HupF7GmQiDjTuCKlr0pAAnQizELkiUPhYyU4ocv5YdjoshuUjkk1wFv00wLPEoWgyRNc J0KLUXRiHpIQJ2De9l846Lsk0DSYs49Q6kRmIcj+84Pcgc+Zp6HE3Emf5yGn5jPmdORe Yp7iZpVqbfxGGBrVslsaRYCTwcuEJL6l/JDRsbedHFQb/oJgpOmM4F0aL+OLsLk2bus+ hTUQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:in-reply-to:content-disposition:mime-version :references:message-id:subject:cc:to:from:date:dkim-signature; bh=wJJ2xk6KJ1yVceSY2TU4J8PUoHuCxZ0ytCiEr+dN1K8=; b=Q8PsE939ltslqQn5BjLWVLiTGYnOGC8zMtBP7e+DQrVJULRcCoTUF2JB6qIqCFraRS RCl/ukXNLi5l7cttJdB4QH1MohC24nqG6ZqIM9u5DZYdGIO3R4tLb0heXebJfF5yMnCK fwiuHLYMUe+glXfZs8/nWHFqwPYC5lA1pV7HriIVNTVZlbwKKQ+ZCT7wnWAZQV83UAH9 rrh7jNN5ark4fTUh/KvpSaNeNyQ6IV8r3Xfe10ylukpiN/PUyjsojQWX3byTZzCLl9yj KxOi/IK82wNETeSpT6Rymq9NQF9hX+wA7aB5XK5ShNK1l5HTH1JRW7gx9vDZ17geVdk/ 7O4Q== ARC-Authentication-Results: i=1; mx.google.com; dkim=fail header.i=@mit.edu header.s=outgoing header.b=JuDyiahJ; spf=pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-nfs-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=mit.edu Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id e9-20020a170903240900b00172f12565c1si7486428plo.231.2022.09.04.06.00.04; Sun, 04 Sep 2022 06:00:37 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=fail header.i=@mit.edu header.s=outgoing header.b=JuDyiahJ; spf=pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-nfs-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=mit.edu Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230290AbiIDMs5 (ORCPT + 99 others); Sun, 4 Sep 2022 08:48:57 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:56094 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S230119AbiIDMsy (ORCPT ); Sun, 4 Sep 2022 08:48:54 -0400 Received: from outgoing.mit.edu (outgoing-auth-1.mit.edu [18.9.28.11]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 0DFC33DBCF; Sun, 4 Sep 2022 05:48:52 -0700 (PDT) Received: from letrec.thunk.org (guestnat-104-133-160-97.corp.google.com [104.133.160.97] (may be forged)) (authenticated bits=0) (User authenticated as tytso@ATHENA.MIT.EDU) by outgoing.mit.edu (8.14.7/8.12.4) with ESMTP id 284CmkFC028819 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Sun, 4 Sep 2022 08:48:48 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=mit.edu; s=outgoing; t=1662295728; bh=wJJ2xk6KJ1yVceSY2TU4J8PUoHuCxZ0ytCiEr+dN1K8=; h=Date:From:To:Cc:Subject:References:In-Reply-To; b=JuDyiahJtXDJgOvnzRxWPlNyJiB0eXxs1+urVEQlvgawDSbakRAIzQDaxI9oSJnRz JPe/T/fCLloxD61B3ddlR0wO5jz7hvD7I8H4BuM9ks2F2QI8nPHo4MvmR1slV3PA2v 2DXHhdtNHVWgyb+4Uwcdaftff8GmdG7GaVdVBvszJ4NxsHBVQz8RECYK7jmiozSuOp QuTndUFazxxpFpgphkfVE77h9y/7pIsY70Q00o6pjd4ypcmZ5zVRSMv+vJpMW9kxMC NHHye+34geNEJf9U3buEm/cq2iuFYEX9HtdcjZ3mZHIVQGZ0UmxreFdvPLgiiMuyyR /iez4QRkPVr1Q== Received: by letrec.thunk.org (Postfix, from userid 15806) id 0A9F78C2D14; Sun, 4 Sep 2022 08:48:42 -0400 (EDT) Date: Sun, 4 Sep 2022 08:48:42 -0400 From: "Theodore Ts'o" To: Chuck Lever III Cc: Linux NFS Mailing List , "fstests@vger.kernel.org" Subject: Re: generic/650 makes v6.0-rc client unusable Message-ID: References: <3E21DFEA-8DF7-484B-8122-D578BFF7F9E0@oracle.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <3E21DFEA-8DF7-484B-8122-D578BFF7F9E0@oracle.com> X-Spam-Status: No, score=-3.0 required=5.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,MAY_BE_FORGED,RCVD_IN_DNSWL_MED,SPF_HELO_NONE,SPF_NONE, T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-nfs@vger.kernel.org On Sat, Sep 03, 2022 at 06:43:29PM +0000, Chuck Lever III wrote: > While investigating some of the other issues that have been > reported lately, I've found that my v6.0-rc3 NFS/TCP client > goes off the rails often (but not always) during generic/650. > > This is the test that runs a workload while offlining and > onlining CPUs. My test client has 12 physical cores. > > The test appears to start normally, but then after a bit > the NFS server workload drops to zero and the NFS mount > disappears. I can't run programs (sudo, for example) on > the client. Can't log in, even on the console. The console > has a constant stream of "can't rotate log: Input/Output > error" type messages. I've noticed problems with generic/650 for quite a while, but only when running tests on GCE (but not KVM). I noted this not when running xfstests on ext4; IIRC, it was was causing the VM to reboot when testing any file system. - Ted commit 6e7867469bd3b135125a76e633e0bb50045ccb3c Author: Theodore Ts'o Date: Fri Oct 22 23:24:31 2021 -0400 test-appliance: allow tests to be excluded based on the appliance flavor The generic/650 test causes an instant reboot on GCE, so add infrastructure to exclude a test based on the test appliance flavor (i.e., android, gce, or kvm). Signed-off-by: Theodore Ts'o