Received: by 2002:a05:6a10:a0d1:0:0:0:0 with SMTP id j17csp332237pxa; Tue, 4 Aug 2020 06:47:34 -0700 (PDT) X-Google-Smtp-Source: ABdhPJzI5N+CBONw69lczcnzON7pLFwQgauKMpZIb8k2p3JROMAJdCI35r93iOC+IrlseNLLgKgQ X-Received: by 2002:a17:907:42cd:: with SMTP id nz21mr21931094ejb.395.1596548854135; Tue, 04 Aug 2020 06:47:34 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1596548854; cv=none; d=google.com; s=arc-20160816; b=LRN0yjbPaiLgMtbcqOZaeE2FbGXiXiDZygIQqhHGdSvQmtau6oDEa1A7qECaxB5Tpq 9vr6S6Hbt1uf7C7yvhPXFnNK5FoEm3tXKuQHWrR9LxZ7BNpjipuuT36gjcVtXWuZ0FAy 2AKaHLJZUnm7LnEwbuLdSa1v52KEidYW4EFAohsjU24i+lg2/e1wET2h6aAUBA3eUKtA dOe9XpsV6OVvteC7gd997iG4BwB5asXftNRb+M0Q/HYTDsvXZyqbeHxnZfqg42OkvxnP BT2dpMdWdxlhla8gIafKuOF26ZsnJw3Fl+xV/y2dGkUp4KIsjRDf/PrzjzDqUhgmp1O5 Yl7w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:in-reply-to:content-disposition :mime-version:references:message-id:subject:cc:to:from:date :dkim-signature; bh=XKnskYodvqAU8IeYcr7b/Q4x54TUcMl5mCwg3k2tzmQ=; b=tCsG0M9tgVhP7RpPiVo8vfZkE6nwyV0iGsF7cGKH6DI/OiZ9m9fAskdsyKyvdwsEvo 5A3Cwjzvdp2mQVungYLXeQF6uMzIt4dpGyl+EVKwEAZ3oJxLBz2PTyOyLFVekxEA6ZGz BHVtvleZDOTChPe9rra/B3g93Uf9rNClOXegvYm8F9I7sSZ0mYpQoIJQky0fy1J6A+Mo B3R0xSp2xlkcQgKWiWTj6N07+KpfaCNnHPARPFzHgDouJOoJq33kGeiyPLYICjsdKuXw YDDHc5Zw5ftOxUYuiTGKlCnoyEhcSfUAB4KM2I0RKhMp+192mXhYsi1kdbi8nkxYIgbA 3wbA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@kernel.org header.s=default header.b=bfCqYAAy; spf=pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-nfs-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id bd9si7353888edb.340.2020.08.04.06.47.06; Tue, 04 Aug 2020 06:47:34 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=default header.b=bfCqYAAy; spf=pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-nfs-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727982AbgHDNqq (ORCPT + 99 others); Tue, 4 Aug 2020 09:46:46 -0400 Received: from mail.kernel.org ([198.145.29.99]:51380 "EHLO mail.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1725826AbgHDNqq (ORCPT ); Tue, 4 Aug 2020 09:46:46 -0400 Received: from localhost (unknown [213.57.247.131]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id 856AC2075D; Tue, 4 Aug 2020 13:46:45 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1596548806; bh=XKnskYodvqAU8IeYcr7b/Q4x54TUcMl5mCwg3k2tzmQ=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=bfCqYAAy6qdjYWSv0vEYyrk6iNYP6H9qPQMObK5pC45/xDz69H7PmqIyVigbFCvTX 1pgzPpKXmYsVzi4+szUqwK+ckKpQfEtCRvj5wm0+6L1zEDw8LLfrc4zZUKI/fwOcMT c74Vuqmkzvnjuk8gcwpcc4QKuzz1D6H5veBQwSSE= Date: Tue, 4 Aug 2020 16:46:42 +0300 From: Leon Romanovsky To: Chuck Lever Cc: Timo Rothenpieler , Linux NFS Mailing List , linux-rdma Subject: Re: NFS over RDMA issues on Linux 5.4 Message-ID: <20200804134642.GC4432@unreal> References: <8a1087d3-9add-dfe1-da0c-edab74fcca51@rothenpieler.org> <20200804093635.GA4432@unreal> <92a5a932-b843-eed3-555e-7557ccc1f308@rothenpieler.org> <20200804122557.GB4432@unreal> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: Sender: linux-nfs-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-nfs@vger.kernel.org On Tue, Aug 04, 2020 at 09:12:55AM -0400, Chuck Lever wrote: > > > > On Aug 4, 2020, at 9:08 AM, Timo Rothenpieler wrote: > > > > On 04.08.2020 14:49, Chuck Lever wrote: > >> Timo, I tend to think this is not a configuration issue. > >> Do you know of a known working kernel? > > > > This is a brand new system, it's never been running with any kernel older than 5.4, and downgrading it to 4.19 or something else while in operation is unfortunately not easily possible. For a client it would definitely not be out of the question, but the main nfs server I cannot easily downgrade. > > > > Also keep in mind that the dmesg spam happens on both server and client simultaneously. > > Let's start with the client only, since restarting it seems to clear the problem. It is client because according to the server CQE errors, it is Remote_Invalid_Request_Error with "9.7.5.2.2 NAK CODES" from IBTA. Thanks