Received-SPF: pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18;
MIME-Version: 1.0
From:   gaurav gangalwar <gaurav.gangalwar@gmail.com>
Date:   Wed, 29 Apr 2020 17:32:57 +0530
Message-ID: <CAJiE4OnMQE7b7bzj=rnMBZ5xRrzTfHqqgyNOSGguuDFk3G=z1Q@mail.gmail.com>
Subject: [Problem] Client discarding data, mount hung.
To:     linux-nfs@vger.kernel.org
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
Sender: linux-nfs-owner@vger.kernel.org
Precedence: bulk

I am getting these logs in rpcdebug, client is discarding replies for
FSINFO and FSSTAT.
Mount point is not accessible, but I am able to mount and access from other=
 ips.

C02W91BDHV2R:jita-hang-discard gaurav.gangalwar$ grep "discarded" syslog.1

Apr 28 16:12:16 jita_tester_host_12 kernel: [2345446.783761] RPC:
 discarded 172 bytes

Apr 28 16:13:09 jita_tester_host_12 kernel: [2345499.393657] RPC:
 discarded 168 bytes

Apr 28 16:13:16 jita_tester_host_12 kernel: [2345507.216440] RPC:
 discarded 172 bytes

Apr 28 16:13:44 jita_tester_host_12 kernel: [2345534.412376] RPC:
 discarded 168 bytes


I am not sure what could be the reason for discarding, I am using tcp
as mount option, as per code looks like tcp_flags on transport may not
be set.
I am clueless, how to debug, as I couldn=E2=80=99t find any failure in serv=
er
logs and tcpdump.
Please let me know how to debug this issue further?

Pasting more log snippet and kernel version

nutanix@jita_tester_host_12:~$ uname -a

Linux jita_tester_host_12 4.15.0-38-generic #41-Ubuntu SMP Wed Oct 10
10:59:38 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux


Apr 28 16:12:16 jita_tester_host_12 kernel: [2345446.782554] RPC:
61642 xprt_transmit(72)

Apr 28 16:12:16 jita_tester_host_12 kernel: [2345446.782606] RPC:
 xs_tcp_send_request(72) =3D 0

Apr 28 16:12:16 jita_tester_host_12 kernel: [2345446.782607] RPC:
61642 xmit complete

Apr 28 16:12:16 jita_tester_host_12 kernel: [2345446.782609] RPC:
61642 sleep_on(queue "xprt_pending" time 4881255675)

Apr 28 16:12:16 jita_tester_host_12 kernel: [2345446.782610] RPC:
61642 added to queue 00000000d869a80a "xprt_pending"

Apr 28 16:12:16 jita_tester_host_12 kernel: [2345446.782611] RPC:
61642 setting alarm for 60000 ms

Apr 28 16:12:16 jita_tester_host_12 kernel: [2345446.782612] RPC:
 wake_up_first(00000000ae52133b "xprt_sending")

Apr 28 16:12:16 jita_tester_host_12 kernel: [2345446.782613] RPC:
61642 sync task going to sleep

Apr 28 16:12:16 jita_tester_host_12 kernel: [2345446.783719] RPC:
 xs_data_ready...

Apr 28 16:12:16 jita_tester_host_12 kernel: [2345446.783759] RPC:
 xs_tcp_data_recv started

Apr 28 16:12:16 jita_tester_host_12 kernel: [2345446.783761] RPC:
 discarded 172 bytes

Apr 28 16:12:16 jita_tester_host_12 kernel: [2345446.783761] RPC:
 xs_tcp_data_recv done


Regards,
Gaurav