Received: by 2002:ab2:1689:0:b0:1f7:5705:b850 with SMTP id d9csp2042287lqa; Tue, 30 Apr 2024 06:58:39 -0700 (PDT) X-Forwarded-Encrypted: i=3; AJvYcCXKl6yOX+f3cFN5y5i3gbmMEb5MX1JcTfEpGhNgEBHw3FSus1fTMIm+HDlH61982sb2EasahrEXiRvgfaawV3sDWy+orpC7H4d/iaTslQ== X-Google-Smtp-Source: AGHT+IFEoGjtbzJJSg/+pQ6xLDrliHmHrwvF77p+CpuzM2IOnGviTSFbXJUBeY1BCM3F3baDNqMZ X-Received: by 2002:a17:902:8d8d:b0:1e4:dcfe:848f with SMTP id v13-20020a1709028d8d00b001e4dcfe848fmr12367603plo.16.1714485518972; Tue, 30 Apr 2024 06:58:38 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1714485518; cv=pass; d=google.com; s=arc-20160816; b=RRz/95YyI+hWC5EpEZsa8f8lV+LWJPqWtfeO0Q60VRdCbxwFZJ3rGvDNlXcz8wqIUD SKk6b5nbIPgljR3J21ZdejvLkJx6JIKaN2J7k/7rdqx16bpkwBmXXDwQYzrD0kAqIc2+ PgqVXvq0HPqHWLsxPeeNhxq31watf8UurY2VUP39pZs+V7+XuuFoVkOo47gaXkql3v62 INRiXYMPH7d0Iug1XvcWz3X9ZVX7Ru5rejKVd2WLZhAQfgfEMbFhOMZsRRuqi1ccGRcN EC62fjSy2GEw0/vhhm0tfko8lTOXmrq2GEPbV/RPNE5wUasJ1UawJ+OxaMMJIz5BmqIi Q2rg== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:in-reply-to:from:content-language :references:cc:to:subject:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:date:dkim-signature:message-id; bh=QvfwCJ+RgLeRC4X/8MiA5B3A6uRx1S5K79NhE6HyKs8=; fh=7g55ff38/6pqdJmexnlHmmPvpBF78ABFE/nJJDTYaBI=; b=0VDOGz+RCX8x9u19fgXqr+rncgGkq719PwoTeVL/rBQLjaDTQ6nUGeN4EzpHPeNtKr SvfT8uc5M87XNDMw/rTj8ecXkll921CbEXI+qHODh9svlf9xM7NUD8wAQJ076D47nTp0 60I6AN8AtPPrEcDl+HpsS7EpBlKpMUHBfO1/BV5E1jSD32GMfpGIDmkvPbyG/NcvE6nT exSFEGnOa0oz+tMXC+iF/xJ1pzTPNNKapQkPT5QW7SSwoRYoswjQXIFNIdPgnZUZJ06z 7w6fPiVeQQzgaEIuMM2pu2XEdmO5fP0GRtLXF96I/i0skEIeESqP0PCaVJOQQA9Us/Lh +CFg==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@linux.dev header.s=key1 header.b=QPIll1BR; arc=pass (i=1 spf=pass spfdomain=linux.dev dkim=pass dkdomain=linux.dev dmarc=pass fromdomain=linux.dev); spf=pass (google.com: domain of linux-nfs+bounces-3075-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.48.161 as permitted sender) smtp.mailfrom="linux-nfs+bounces-3075-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linux.dev Return-Path: Received: from sy.mirrors.kernel.org (sy.mirrors.kernel.org. [147.75.48.161]) by mx.google.com with ESMTPS id lm6-20020a170903298600b001ec290362e9si1948486plb.533.2024.04.30.06.58.38 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 30 Apr 2024 06:58:38 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-nfs+bounces-3075-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.48.161 as permitted sender) client-ip=147.75.48.161; Authentication-Results: mx.google.com; dkim=pass header.i=@linux.dev header.s=key1 header.b=QPIll1BR; arc=pass (i=1 spf=pass spfdomain=linux.dev dkim=pass dkdomain=linux.dev dmarc=pass fromdomain=linux.dev); spf=pass (google.com: domain of linux-nfs+bounces-3075-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.48.161 as permitted sender) smtp.mailfrom="linux-nfs+bounces-3075-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linux.dev Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by sy.mirrors.kernel.org (Postfix) with ESMTPS id B9711B20E8B for ; Tue, 30 Apr 2024 13:58:37 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id E230A172BA6; Tue, 30 Apr 2024 13:58:32 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=linux.dev header.i=@linux.dev header.b="QPIll1BR" X-Original-To: linux-nfs@vger.kernel.org Received: from out-186.mta1.migadu.com (out-186.mta1.migadu.com [95.215.58.186]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 8E5E0171E67 for ; Tue, 30 Apr 2024 13:58:29 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=95.215.58.186 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1714485512; cv=none; b=KT8gB5hr0E1uw3AlbZM9q4WVKfK5c500bCII9SMCPXVnEMa7ED3wrc6jf0eKAO/KHbHYuZbaqRXCN/e+5kDr+V3cjSRqV776p0NVcNWxf/u4EqUMb5pg+BZIADzLVw63bs35IvzEYcKnfdH1wkPaeUFlsdxGp6d3OYDtWOhBqfU= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1714485512; c=relaxed/simple; bh=Q7DztjgnnS2dKaOJFO8saO6Zu9czk7JFRZs24thNvU4=; h=Message-ID:Date:MIME-Version:Subject:To:Cc:References:From: In-Reply-To:Content-Type; b=acp62f6vWpkCb3R88Cp60n2UnetYenmmlynHimBWAA25kNmYqfLp4jf+kHEZ+6FAwZoFP6TcJMdutSWzIYTamFu0JaqcB7fVRLaVq1vuBB7pLp00H+1oFnYCV2ao5wNEdm1k0JWiYt5CSJKT9VvIUMDz9CmolV98LK6U3SHwwhI= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linux.dev; spf=pass smtp.mailfrom=linux.dev; dkim=pass (1024-bit key) header.d=linux.dev header.i=@linux.dev header.b=QPIll1BR; arc=none smtp.client-ip=95.215.58.186 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linux.dev Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=linux.dev Message-ID: DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linux.dev; s=key1; t=1714485507; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=QvfwCJ+RgLeRC4X/8MiA5B3A6uRx1S5K79NhE6HyKs8=; b=QPIll1BRqFjc4AOsZW4wL+aTiBs6j8I7Ts/OtWPrtlxTTehUIku2ajrq0Sc4egVfrSV409 AGlDTHE+w4ydCkYuVGtQ9pJYBkK5afdmBt3qLrFZUbI4lwb2WW/AJH3Jd3FHuAIASfWlP8 ek78TYOXqYgggp2ZVI1K5YGsEtzad0U= Date: Tue, 30 Apr 2024 15:58:23 +0200 Precedence: bulk X-Mailing-List: linux-nfs@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Subject: Re: [RFC PATCH 0/4] NFS: Fix another 'check_flush_dependency' splat To: Chuck Lever III Cc: Chuck Lever , Linux NFS Mailing List , "linux-rdma@vger.kernel.org" References: <20240429152537.212958-6-cel@kernel.org> <90F6A893-5315-4E53-B54E-1CF8D7D4AC4D@oracle.com> Content-Language: en-US X-Report-Abuse: Please report any abuse attempt to abuse@migadu.com and include these headers. From: Zhu Yanjun In-Reply-To: <90F6A893-5315-4E53-B54E-1CF8D7D4AC4D@oracle.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Migadu-Flow: FLOW_OUT On 30.04.24 15:42, Chuck Lever III wrote: > >> On Apr 30, 2024, at 3:26 AM, Zhu Yanjun wrote: >> >> On 29.04.24 17:25, cel@kernel.org wrote: >>> From: Chuck Lever >>> Avoid getting work queue splats in the system journal by moving >>> client-side RPC/RDMA transport tear-down into a background process. >>> I've done some testing of this series, now looking for review >>> comments. >> How to make tests with nfs && rdma? Can you provide some steps or tools? > We are building NFS tests into kdevops: > > https://github.com/linux-kdevops/kdevops.git > > and there is a config option to use soft iWARP instead of TCP. Thanks a lot. It is interesting. Have you made tests with RXE instead of iWARP? If yes, does nfs work well with RXE? I am just curious with nfs && RXE. Normally nfs works with TCP. Now nfs will use RDMA instead of TCP. The popular RDMA implementation is RoCEv2 which is based on UDP protocol. So I am curious if NFS can work well with RXE (RoCEv2 emulation driver) or not. If the user wants to use nfs in his production hosts, it is possible that nfs will work with RoCEv2 (UDP). Best Regards, Zhu Yanjun > > kdevops includes workflows for fstests, Mora's nfstest, the > git regression suite, and ltp, all of which we use regularly > to test the Linux NFS client and server implementations. > > >> I am interested in nfs && rdma. >> >> Thanks, >> Zhu Yanjun >> >>> Chuck Lever (4): >>> xprtrdma: Remove temp allocation of rpcrdma_rep objects >>> xprtrdma: Clean up synopsis of frwr_mr_unmap() >>> xprtrdma: Delay releasing connection hardware resources >>> xprtrdma: Move MRs to struct rpcrdma_ep >>> net/sunrpc/xprtrdma/frwr_ops.c | 13 ++- >>> net/sunrpc/xprtrdma/rpc_rdma.c | 3 +- >>> net/sunrpc/xprtrdma/transport.c | 20 +++- >>> net/sunrpc/xprtrdma/verbs.c | 173 ++++++++++++++++---------------- >>> net/sunrpc/xprtrdma/xprt_rdma.h | 21 ++-- >>> 5 files changed, 125 insertions(+), 105 deletions(-) >>> base-commit: e67572cd2204894179d89bd7b984072f19313b03 > -- > Chuck Lever > > -- Best Regards, Yanjun.Zhu