Received: by 2002:a05:7412:b995:b0:f9:9502:5bb8 with SMTP id it21csp7674289rdb; Thu, 4 Jan 2024 04:22:59 -0800 (PST) X-Google-Smtp-Source: AGHT+IG8pO3O8ceM6Cvkbr05x/ejthWH1EJR8j64Q7bPKCDaoOaKp+Ggy49SkLEXvz32F4/zgVQg X-Received: by 2002:a05:600c:5194:b0:40d:9240:77aa with SMTP id fa20-20020a05600c519400b0040d924077aamr275800wmb.81.1704370978929; Thu, 04 Jan 2024 04:22:58 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1704370978; cv=none; d=google.com; s=arc-20160816; b=qBNY5cLAkqteK4vWbfqGiKMmKoOc8x1ySPAwyiSI6dXouuZfOSFi9H17SKplYSz9XC s5U9iruaYgwOnGbZEPR7Dkam9xXt5bBc7zKf1sEKhE6r1SJXb/MluRQcflM9vIrL2l5N Dsc/mHsUcxdKV1nDxkEgp3PZJ/sQI4CD5yVs0HWaiaSfgseODtEyBinsCPi78wXDnQsE 6plnVsfbviFiC3FrcUDj9NL/vQElUaluW6i3dIsB4nN2/dz81Xwv4oJtUoIYWWtIe+We pBclVD9O03vD7jXqqj5HEi4bUsTQJwbKikOP7Gg8pcbDyusH3qv+oxYwJqUL+JvL8uE2 wJzA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:references:in-reply-to:message-id :date:subject:cc:to:from:dkim-signature; bh=iiBMkZq2XMy0qt4hr0cDRU/ATU0snhiihOeJjiralw0=; fh=qSjftfhAMQDHn6glUVRmFBoAFI/UHJo2UyzkxfyClKE=; b=NfVKncweKpi11UHVq07+dwFHmEqpvamRc7czWyTd5F+6cLPzItc9mwoVHKof2OTYI6 ceDircle5Z7ayAFARP5DtwgtewHtJL28r7EH7ZdXirYIpibLF1bdGzKO6Pw7brvZ5XpS 2hDcbr56IKjcp+6WweCMh3rKrlInyw5cjycOZuCPT30c0ODL/FJfQmjp1BFbz9d2Dckf NgZVr3CtJC/u943sFsyT7fEmm9Gwmv/VUfxz91YEOln5J8C01/bkPwXgTrMCYm11Ql9o R1XN+QXuDt0n/QRWch4yNcRqDuSJtqFAjHKS5vqxC+fT8NLujSVmLNqWCy16anfIAzDA RC+w== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=fI0+sBFd; spf=pass (google.com: domain of linux-nfs+bounces-924-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:4601:e00::3 as permitted sender) smtp.mailfrom="linux-nfs+bounces-924-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from am.mirrors.kernel.org (am.mirrors.kernel.org. [2604:1380:4601:e00::3]) by mx.google.com with ESMTPS id yr5-20020a170907334500b00a27c67ed1a0si4195182ejb.114.2024.01.04.04.22.58 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 04 Jan 2024 04:22:58 -0800 (PST) Received-SPF: pass (google.com: domain of linux-nfs+bounces-924-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:4601:e00::3 as permitted sender) client-ip=2604:1380:4601:e00::3; Authentication-Results: mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=fI0+sBFd; spf=pass (google.com: domain of linux-nfs+bounces-924-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:4601:e00::3 as permitted sender) smtp.mailfrom="linux-nfs+bounces-924-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by am.mirrors.kernel.org (Postfix) with ESMTPS id A94A01F250C0 for ; Thu, 4 Jan 2024 12:22:58 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 0EDE222310; Thu, 4 Jan 2024 12:22:25 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=redhat.com header.i=@redhat.com header.b="fI0+sBFd" X-Original-To: linux-nfs@vger.kernel.org Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 93AE722301 for ; Thu, 4 Jan 2024 12:22:23 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=redhat.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=redhat.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1704370942; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=iiBMkZq2XMy0qt4hr0cDRU/ATU0snhiihOeJjiralw0=; b=fI0+sBFdggr1z0WHquVoNuH3g90OMpj4k0+kyK/NJbxZcrxM3owQA5m9MKYQX0TXUd9oLr YYn4WBs7B8iwSe9ZpM2EhEgr6EIG7zh+RzmHf7MtS3ZEmooKVfbytZQRXgMe4QKnDt22Ft TPgOWJEPp1zSfR2kkoXYxfTiLxBbKG0= Received: from mimecast-mx02.redhat.com (mimecast-mx02.redhat.com [66.187.233.88]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-530-U6PTA6rqP7aFtCqNjfjk1w-1; Thu, 04 Jan 2024 07:22:21 -0500 X-MC-Unique: U6PTA6rqP7aFtCqNjfjk1w-1 Received: from smtp.corp.redhat.com (int-mx07.intmail.prod.int.rdu2.redhat.com [10.11.54.7]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by mimecast-mx02.redhat.com (Postfix) with ESMTPS id A9E2D848528; Thu, 4 Jan 2024 12:22:20 +0000 (UTC) Received: from [100.85.132.103] (ovpn-0-5.rdu2.redhat.com [10.22.0.5]) by smtp.corp.redhat.com (Postfix) with ESMTPS id 1786E1C060AF; Thu, 4 Jan 2024 12:22:19 +0000 (UTC) From: Benjamin Coddington To: Chuck Lever III Cc: Jeff Layton , Linux NFS Mailing List Subject: Re: hangs during fstests testing with TLS Date: Thu, 04 Jan 2024 07:22:18 -0500 Message-ID: <8C3DFB5D-B967-4D59-BFC5-7B25315DB9AB@redhat.com> In-Reply-To: References: <117352d5dc94d8f31bc6770e4bbb93a357982a93.camel@kernel.org> Precedence: bulk X-Mailing-List: linux-nfs@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Scanned-By: MIMEDefang 3.4.1 on 10.11.54.7 On 3 Jan 2024, at 16:46, Chuck Lever III wrote: >> On Jan 3, 2024, at 3:16=E2=80=AFPM, Benjamin Coddington wrote: >> >> On 3 Jan 2024, at 14:12, Chuck Lever III wrote: >> >>>> On Jan 3, 2024, at 1:47=E2=80=AFPM, Benjamin Coddington wrote: >>>> >>>> This looks like it started out as the problem I've been sending patc= hes to >>>> fix on 6.7, latest here: >>>> https://lore.kernel.org/linux-nfs/e28038fba1243f00b0dd66b7c5296a1e18= 1645ea.1702496910.git.bcodding@redhat.com/ >>>> >>>> .. however whenever I encounter the issue, the client reconnects the= >>>> transport again - so I think there might be an additional problem he= re. >>> >>> I'm looking at the same problem as you, Ben. It doesn't seem to be >>> similar to what Jeff reports. >>> >>> But I'm wondering if gerry-rigging the timeouts is the right answer >>> for backchannel replies. The problem, fundamentally, is that when a >>> forechannel RPC task holds the transport lock, the backchannel's repl= y >>> transmit path thinks that means the transport connection is down and >>> triggers a transport disconnect. >> >> Why shouldn't backchannel replies have normal timeout values? > > RPC Replies are "send and forget". The server forechannel sends > its Replies without a timeout. There is no such thing as a > retransmitted RPC Reply (though a reliable transport might > retransmit portions of it, the RPC server itself is not aware of > that). > > And I don't see anything in the client's backchannel path that > makes me think there's a different protocol-level requirement > in the backchannel. Its not strictly a protocol thing, the timeouts are used to decide what t= o do with a req or flag the transport state even if the request doesn't mak= e it to the wire. That's why the zero timeout values for this req improper= ly resets the transport. Ben