Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1755643AbXFOPJa (ORCPT ); Fri, 15 Jun 2007 11:09:30 -0400 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1751529AbXFOPJW (ORCPT ); Fri, 15 Jun 2007 11:09:22 -0400 Received: from srv5.dvmed.net ([207.36.208.214]:56784 "EHLO mail.dvmed.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1750852AbXFOPJV (ORCPT ); Fri, 15 Jun 2007 11:09:21 -0400 Message-ID: <4672AB7F.7030702@garzik.org> Date: Fri, 15 Jun 2007 11:08:47 -0400 From: Jeff Garzik User-Agent: Thunderbird 1.5.0.12 (X11/20070530) MIME-Version: 1.0 To: Tejun Heo CC: Jens Axboe , David Greaves , "Rafael J. Wysocki" , Linus Torvalds , David Chinner , xfs@oss.sgi.com, "'linux-kernel@vger.kernel.org'" , linux-pm , Neil Brown Subject: Re: [PATCH] block: always requeue !fs requests at the front References: <200706020122.49989.rjw@sisk.pl> <46706968.7000703@dgreaves.com> <200706140115.58733.rjw@sisk.pl> <46714ECF.8080203@gmail.com> <46715A66.8030806@suse.de> <20070615094246.GN29122@htj.dyndns.org> <20070615110544.GR6149@kernel.dk> <20070615111728.GO29122@htj.dyndns.org> In-Reply-To: <20070615111728.GO29122@htj.dyndns.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Spam-Score: -4.3 (----) X-Spam-Report: SpamAssassin version 3.1.8 on srv5.dvmed.net summary: Content analysis details: (-4.3 points, 5.0 required) Sender: linux-kernel-owner@vger.kernel.org X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 2166 Lines: 57 Tejun Heo wrote: > SCSI marks internal commands with REQ_PREEMPT and push it at the front > of the request queue using blk_execute_rq(). When entering suspended > or frozen state, SCSI devices are quiesced using > scsi_device_quiesce(). In quiesced state, only REQ_PREEMPT requests > are processed. This is how SCSI blocks other requests out while > suspending and resuming. As all internal commands are pushed at the > front of the queue, this usually works. > > Unfortunately, this interacts badly with ordered requeueing. To > preserve request order on requeueing (due to busy device, active EH or > other failures), requests are sorted according to ordered sequence on > requeue if IO barrier is in progress. > > The following sequence deadlocks. > > 1. IO barrier sequence issues. > > 2. Suspend requested. Queue is quiesced with part or all of IO > barrier sequence at the front. > > 3. During suspending or resuming, SCSI issues internal command which > gets deferred and requeued for some reason. As the command is > issued after the IO barrier in #1, ordered requeueing code puts the > request after IO barrier sequence. > > 4. The device is ready to process requests again but still is in > quiesced state and the first request of the queue isn't > REQ_PREEMPT, so command processing is deadlocked - > suspending/resuming waits for the issued request to complete while > the request can't be processed till device is put back into > running state by resuming. > > This can be fixed by always putting !fs requests at the front when > requeueing. > > The following thread reports this deadlock. > > http://thread.gmane.org/gmane.linux.kernel/537473 > > Signed-off-by: Tejun Heo > Cc: Jenn Axboe > Cc: David Greaves Acked-by: Jeff Garzik Thanks Tejun, you kick ass as usual. Jeff - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/