MIME-Version: 1.0
In-Reply-To: <20120626125953.GA22557@redhat.com>
References: <CAKA=qzY+u64vVZmbiH4zp_Fij2zejQBFUSNENKF=PZBT0G7xrQ@mail.gmail.com>
	<20120622204207.GA22063@redhat.com>
	<CAKA=qzbycm0cjLyiuKaKkD8sxDm5DvX9WVqSxN2QVT2WZOzU0Q@mail.gmail.com>
	<CAKA=qza_s6zr+wZzfFTVPSzgPQAov=K63jf-SJOTDcrnDELY5w@mail.gmail.com>
	<CAKA=qzYea71A5VQOQgrqzaZtVFadjhcghgH+Z9n4ivS7vUgW0g@mail.gmail.com>
	<20120625133047.GA9394@redhat.com>
	<CAKA=qzbXm7LaDziH=cms1W5X+cwNNRkG0LNFfWKEppr2oht6_w@mail.gmail.com>
	<20120625211850.GC10916@redhat.com>
	<CAKA=qzaU=wKLrprgJ4z32tqqyO6W0+SBcaV=ArWAdKh_9c=Zew@mail.gmail.com>
	<CAKA=qzY+J-Ab8NC-+r1Dw_-giVzC=z8SnxJhSWHF-ud8j3yg6A@mail.gmail.com>
	<20120626125953.GA22557@redhat.com>
Date: Tue, 26 Jun 2012 10:18:04 -0500
Message-ID: <CAKA=qzZ_KhRbH6F4-TWvSAWiJyDsDrz4oUO5WppoMgWNEhyZmg@mail.gmail.com>
Subject: Re: multi-second application stall in open()
From: Josh Hunt <joshhunt00@gmail.com>
To: Tejun Heo <tj@kernel.org>
Cc: Jens Axboe <axboe@kernel.dk>, linux-kernel@vger.kernel.org,
        Vivek Goyal <vgoyal@redhat.com>
Content-Type: text/plain; charset=ISO-8859-1
Sender: linux-kernel-owner@vger.kernel.org
Content-Length: 1132
Lines: 32

On Tue, Jun 26, 2012 at 7:59 AM, Vivek Goyal <vgoyal@redhat.com> wrote:
> On Mon, Jun 25, 2012 at 11:01:48PM -0500, Josh Hunt wrote:
>
> [..]
>> So this really seems like a problem with kblockd not kicking in. I've
>> instrumented every path in select_queue and it's not getting hit after
>> schedule dispatch. Everything seems to stall at that point until a new
>> request comes in.
>
> Ok, that's cool. So now we need to find out why queued work is not being
> scheduled.
>
> I think there are some workqueue related trace points. If you enable those
> along with blktraces, that should give tejun some data to look at.
>
> Thanks
> Vivek

Tejun

Do you have any suggestions on how to debug this?

I did "perf record -a -e workqueue:*" and grabbed some tracepoint
data, but it's hard to correlate when these events are occurring in
the blktrace logs. Will keep investigating.
-- 
Josh
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/