Received: by 2002:a05:6a10:a0d1:0:0:0:0 with SMTP id j17csp317066pxa; Tue, 4 Aug 2020 06:27:27 -0700 (PDT) X-Google-Smtp-Source: ABdhPJzBjOoVT0TuXV9efW+6ZHKiKe508DlqypyX3W1CRTn2fXOmCVNrhLv+Uk1btKHsucRz4DGK X-Received: by 2002:aa7:cc10:: with SMTP id q16mr8058819edt.298.1596547647411; Tue, 04 Aug 2020 06:27:27 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1596547647; cv=none; d=google.com; s=arc-20160816; b=XWsvMcHh7hxIs9uwqtIj165U8aalaDiepxpyz+uL8x8Fd8nrdaaZNynBcLEv6Wfi9N v7uphealS5ylKvm7gq3IFcoW0jXl8LWLqYEGLCy50orEOcj3+/erJHIWJhWtzyEXP5R6 W4Kdxxw9HXHQOUpRnmuldxUORJbCm6q1AmXfByuc5NqPMZAl5E9R9d5Aypyf6dypbAgj j9xxMyFksHuwq/Yy4i3MXSGR90FDc3xBcO2DT6FzD0+sQ8Vy5WDjfxorjl3U4sTfJKN7 HwGYUyhQE3jjEZT3SdPkN8gM2+k9Joh5DCcupyWVN29IwZ+mjPjD9TBMVgaDsIVG9faj SrQQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:to:references:message-id :content-transfer-encoding:cc:date:in-reply-to:from:subject :mime-version:dkim-signature; bh=GwJKj3LexDiDQMKswaaevhmeoLvEChAPfWdQ0FjDPIQ=; b=waAlXlKc+7jmUY+FLKZ77z0dh2yn7XdqjY7k7oozDqCmaFT3u+orQMeHVUwJqQwq0W Tacu5IBUS0NjJnlQ62RHwnB7oMSNH2peoi8GOa28lSDE1qSpM7HAo0fROOde3pkCfHBE xEUJko4PTRgnjsh5Wc4JDWnZxgKeKdydy6mDQJK36B7xKghaRIkpo5TPuyP8ujU78n2j iOZL+onyy1HKzVbiamTT34MYSs30XWUPYPXB4IVVCQiOhZ22IfXzuGRQhWhMai+wMpGx ReRTU9HkmyS/GoMH2OXJS+eHHFl1/tUzOx8lg+LvD1niseYfJf1LlQGSf1WlR7aIPl3k R9lA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@oracle.com header.s=corp-2020-01-29 header.b=n2LNycQ6; spf=pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-nfs-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=oracle.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id a26si12052410eds.337.2020.08.04.06.27.02; Tue, 04 Aug 2020 06:27:27 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@oracle.com header.s=corp-2020-01-29 header.b=n2LNycQ6; spf=pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-nfs-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=oracle.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728501AbgHDNY5 (ORCPT + 99 others); Tue, 4 Aug 2020 09:24:57 -0400 Received: from aserp2120.oracle.com ([141.146.126.78]:48500 "EHLO aserp2120.oracle.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1728451AbgHDNYt (ORCPT ); Tue, 4 Aug 2020 09:24:49 -0400 Received: from pps.filterd (aserp2120.oracle.com [127.0.0.1]) by aserp2120.oracle.com (8.16.0.42/8.16.0.42) with SMTP id 074DLxpC142369; Tue, 4 Aug 2020 13:24:42 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h=content-type : mime-version : subject : from : in-reply-to : date : cc : content-transfer-encoding : message-id : references : to; s=corp-2020-01-29; bh=GwJKj3LexDiDQMKswaaevhmeoLvEChAPfWdQ0FjDPIQ=; b=n2LNycQ6lO44tfU0vXlgCG814eimR6KV1vEmKgTTZdAm+vOhrv1FS3wzFtwbPZQe93qF UfJ7vi7cTFKyaVIsoyOv8TUXuahn49UPTABqjK/yLt0NcWNYX7aXmfkhbviIF2UyBqS2 e57/TzdqikL2Kmy+UrkUDSuW2mgXmo6mK3e6rRTq/QzCqJoeax4ieBpYHoUiJGembm+Y qj2AdzXnvNzQjeKYg/i1a31jBvZ4tccBOUdsRrjJEkeZBqwu4fJp3f8K7tIgqtgFzQAV d3+XMEOEpetBuAEYakvBpNaiVHX1N2XiabIe9bIfEwlMNtOVi3PYU2ByaamV/AD5Aqzw tA== Received: from aserp3030.oracle.com (aserp3030.oracle.com [141.146.126.71]) by aserp2120.oracle.com with ESMTP id 32nc9yjusw-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Tue, 04 Aug 2020 13:24:42 +0000 Received: from pps.filterd (aserp3030.oracle.com [127.0.0.1]) by aserp3030.oracle.com (8.16.0.42/8.16.0.42) with SMTP id 074DJ9Fn049745; Tue, 4 Aug 2020 13:24:42 GMT Received: from aserv0122.oracle.com (aserv0122.oracle.com [141.146.126.236]) by aserp3030.oracle.com with ESMTP id 32p5gs6s56-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Tue, 04 Aug 2020 13:24:42 +0000 Received: from abhmp0019.oracle.com (abhmp0019.oracle.com [141.146.116.25]) by aserv0122.oracle.com (8.14.4/8.14.4) with ESMTP id 074DOfGD000557; Tue, 4 Aug 2020 13:24:41 GMT Received: from anon-dhcp-152.1015granger.net (/68.61.232.219) by default (Oracle Beehive Gateway v4.0) with ESMTP ; Tue, 04 Aug 2020 06:24:41 -0700 Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.80.23.2.2\)) Subject: Re: NFS over RDMA issues on Linux 5.4 From: Chuck Lever In-Reply-To: <371c526c-eaf5-e708-8e7f-0b2c21ae2300@rothenpieler.org> Date: Tue, 4 Aug 2020 09:24:40 -0400 Cc: Linux NFS Mailing List , linux-rdma Content-Transfer-Encoding: quoted-printable Message-Id: References: <8a1087d3-9add-dfe1-da0c-edab74fcca51@rothenpieler.org> <20200804093635.GA4432@unreal> <92a5a932-b843-eed3-555e-7557ccc1f308@rothenpieler.org> <20200804122557.GB4432@unreal> <371c526c-eaf5-e708-8e7f-0b2c21ae2300@rothenpieler.org> To: Timo Rothenpieler X-Mailer: Apple Mail (2.3608.80.23.2.2) X-Proofpoint-Virus-Version: vendor=nai engine=6000 definitions=9702 signatures=668679 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 malwarescore=0 mlxscore=0 bulkscore=0 phishscore=0 spamscore=0 adultscore=0 suspectscore=0 mlxlogscore=999 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2006250000 definitions=main-2008040099 X-Proofpoint-Virus-Version: vendor=nai engine=6000 definitions=9702 signatures=668679 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 priorityscore=1501 mlxscore=0 suspectscore=0 phishscore=0 lowpriorityscore=0 spamscore=0 impostorscore=0 adultscore=0 clxscore=1015 malwarescore=0 bulkscore=0 mlxlogscore=999 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2006250000 definitions=main-2008040099 Sender: linux-nfs-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-nfs@vger.kernel.org > On Aug 4, 2020, at 9:19 AM, Timo Rothenpieler = wrote: >=20 > On 04.08.2020 15:12, Chuck Lever wrote: >>> On Aug 4, 2020, at 9:08 AM, Timo Rothenpieler = wrote: >>>=20 >>> On 04.08.2020 14:49, Chuck Lever wrote: >>>> Timo, I tend to think this is not a configuration issue. >>>> Do you know of a known working kernel? >>>=20 >>> This is a brand new system, it's never been running with any kernel = older than 5.4, and downgrading it to 4.19 or something else while in = operation is unfortunately not easily possible. For a client it would = definitely not be out of the question, but the main nfs server I cannot = easily downgrade. >>>=20 >>> Also keep in mind that the dmesg spam happens on both server and = client simultaneously. >> Let's start with the client only, since restarting it seems to clear = the problem. >>> I'll see if I can borrow two of the nodes to turn into a temporary = test system for this. >>>=20 >>> The Kernel for this system is self-built and not any distribution = kernel. >> Would it be easy to try a kernel earlier in the 5.4.y stable series? >=20 > Yes, that should be very straight forward, since I can just use the = same config. > Got any specific version in mind? Start with an early one, like 5.4.16. -- Chuck Lever