Return-Path: <linux-kernel-owner+w=401wt.eu-S1757988AbZGQWvd@vger.kernel.org>
Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand
	id S1757988AbZGQWvd (ORCPT <rfc822;w@1wt.eu>);
	Fri, 17 Jul 2009 18:51:33 -0400
Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1757957AbZGQWvc
	(ORCPT <rfc822;linux-kernel-outgoing>);
	Fri, 17 Jul 2009 18:51:32 -0400
Received: from mail-out2.uio.no ([129.240.10.58]:42808 "EHLO mail-out2.uio.no"
	rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP
	id S1757929AbZGQWvb (ORCPT <rfc822;linux-kernel@vger.kernel.org>);
	Fri, 17 Jul 2009 18:51:31 -0400
Subject: Re: [2.6.30.1] Significant latency playing video file from NFS4
 share
From: Trond Myklebust <trond.myklebust@fys.uio.no>
To: Frans Pop <elendil@planet.nl>
Cc: linux-nfs@vger.kernel.org,
       Linux Kernel Mailing List <linux-kernel@vger.kernel.org>,
       netdev@vger.kernel.org
In-Reply-To: <200907172250.51504.elendil@planet.nl>
References: <200907172250.51504.elendil@planet.nl>
Content-Type: text/plain
Date: Fri, 17 Jul 2009 18:51:26 -0400
Message-Id: <1247871086.4945.38.camel@heimdal.trondhjem.org>
Mime-Version: 1.0
X-Mailer: Evolution 2.26.1 
Content-Transfer-Encoding: 7bit
X-UiO-Ratelimit-Test: rcpts/h 4 msgs/h 1 sum rcpts/h 4 sum msgs/h 1 total rcpts 894 max rcpts/h 27 ratelimit 0
X-UiO-Spam-info: not spam, SpamAssassin (score=-5.0, required=5.0, autolearn=disabled, UIO_MAIL_IS_INTERNAL=-5, uiobl=NO, uiouri=_URIID_)
X-UiO-Scanned: 8FA3E75DBBB1BAF34EB171BB2987F0D6DF54C4CB
X-UiO-SPAM-Test: remote_host: 68.40.207.222 spam_score: -49 maxlevel 80 minaction 2 bait 0 mail/h: 1 total 70 max/h 5 blacklist 0 greylist 0 ratelimit 0
Sender: linux-kernel-owner@vger.kernel.org
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org
Content-Length: 2555
Lines: 60

On Fri, 2009-07-17 at 22:50 +0200, Frans Pop wrote:
> While playing a video (avi) file from an nfs4 share using vlc I'm getting 
> significant latencies on the client resulting in video skips every 10-30 
> seconds. latencytop gives me for example:
> 
> Cause                                      Maximum     Percentage
> rpc_wait_bit_killable __rpc_execute
>    rpc_execute rp[...]                 2638.5 msec         46.1 %
> Scheduler: waiting for cpu               25.1 msec         19.9 %
> Waiting for event (select)                5.0 msec         23.0 %
> Waiting for event (poll)                  4.8 msec          0.3 %
> Userspace lock contention                 4.6 msec          9.9 %
> Waiting for data on unix socket           1.7 msec          0.8 %
> 
> Process vlc (6681)              Total: 2790.2 msec
> rpc_wait_bit_killable __rpc_execute
>    rpc_execute rp[...]                 2638.5 msec         94.6 % [1]
> Scheduler: waiting for cpu                9.3 msec          1.5 %
> Waiting for event (poll)                  4.8 msec          0.6 %
> Userspace lock contention                 4.3 msec          3.3 %
> Waiting for event (select)                0.6 msec          0.1 %
> 
> [1] nfs4_proc_getattr nfs4_proc_getattr __nfs_revalidate_inode nfs_getattr 
> vfs_geta[...]
> 
> There is no other NFS access going on at the time; just reading the single 
> file. No significant other processes running on either the client or the 
> server. latencytop on the server does not show any significant latencies.
> 
> Both server and client are dual core x86_64 running 2.6.30.1 with 
> identical configs (attached); Debian stable.
> 
> From /etc/exports on the server:
> /srv/exports            10.19.66.0/24(rw,fsid=0,subtree_check,sync)
> /srv/exports/myshare    10.19.66.0/24(rw,subtree_check,sync,mp,nohide)
> 
> mount on the client:
> elrond:/myshare on /srv/<mountpoint> type nfs4 (rw,addr=10.19.66.2)
> 
> Cheers,
> FJP

Have you tried running nfs-iostat from the nfs-utils package to try and
figure out what the latency is on each READ request from the client?

http://git.linux-nfs.org/?p=steved/nfs-utils.git;a=blob_plain;f=tools/nfs-iostat/nfs-iostat.py;hb=HEAD

You need to run something like

    nfs-iostat --page 20 10 /src/<mountpoint>

while running the vlc app.

Trond

--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/