Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1756857AbZAVCPt (ORCPT ); Wed, 21 Jan 2009 21:15:49 -0500 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1755538AbZAVCPi (ORCPT ); Wed, 21 Jan 2009 21:15:38 -0500 Received: from fg-out-1718.google.com ([72.14.220.157]:56247 "EHLO fg-out-1718.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1755279AbZAVCPh (ORCPT ); Wed, 21 Jan 2009 21:15:37 -0500 DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; b=R0PaEyIwX4knTt9slZUQMKqG/u41eUb9f0j5HncPcws9zRLT7NUZxeJZaXESI2RGnZ hxGa+Lb4MxeKt3PM4N2J21w4VjxhQ9xHxQFI+NZTPGdVSOVMcMYyQm/6tbBv7gqPEpxw sDJfGw2ayvG0gHxjGIzoQNOBGaUPDsCNwidfM= MIME-Version: 1.0 In-Reply-To: <20090120165131.GB21339@alice> References: <20090113142147.GE16333@alice> <1231857643.29164.28.camel@think.oraclecorp.com> <20090113144307.GF16333@alice> <20090118174035.GG1944@ucw.cz> <20090120063150.GC5854@alice> <1232457065.15042.2.camel@think.oraclecorp.com> <20090120165131.GB21339@alice> Date: Thu, 22 Jan 2009 02:15:21 +0000 Message-ID: Subject: Re: Warning and BUG with btrfs and corrupted image From: Phillip Lougher To: Eric Sesterhenn Cc: Chris Mason , Pavel Machek , linux-kernel@vger.kernel.org, linux-btrfs@vger.kernel.org, Phil Lougher Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 2466 Lines: 52 On Tue, Jan 20, 2009 at 4:51 PM, Eric Sesterhenn wrote: > I already tested squashfs. One issue is basically a problem with > the zlib-api for which i just posted a patch here > http://marc.info/?t=123212807300003&r=1&w=2 > Thanks for testing Squashfs. I've not ignored your emails, but I've been busy job hunting, and so have not had time to look into this until now. I hardened Squashfs against fsfuzzer back in November 2006 (remember the month of kernel bugs, or MOKB, which highlighted a number of issues with Squashfs). Your testing has thrown up a regression that I inadvertently put in last month! > The other is an overwritten redzone (also reported in this thread > http://marc.info/?l=linux-fsdevel&m=123212794425497&w=2) > Looks like a length parameter is passed to squashfs_read_data > which is bigger than ((msblk->block_size >> msblk->devblksize_log2) + > 1), so the kcalloced buffer gets overwritten later. As part of the mainlining effort I changed Squashfs to allocate buffers in 4K page sizes rather than use vmalloced large buffers. As far as zlib goes, it means zlib_inflate now decompresses into a sequence of 4K buffers rather than one large buffer. What this means is zlib_inflate is called repeatedly moving to the next 4K page whenever zlib_inflate asks for another buffer (stream.avail_out == 0). Your testing have thrown up the case where zlib_inflate is asking for too many output buffers, i.e. it has returned with Z_OK, stream.avail_in !=0 (more input data to be processed), and stream.avail_out == 0 (I'd like another output buffer). but it has consumed all the output buffers. This isn't checked (the code assumes zlib will do the right thing on corrupt data and bomb out). My guess is either zlib_inflate is getting confused with corrupt data, or fsfuzzer gets lucky sometimes and corrupts the filesystem to point to another valid but larger compressed block (i.e. in your test filesystems the 4K datablock is being corrupted to point to an 8K metadata block). This ultimately leads to an oops in zlib_inflate where it has been passed a bogus or NULL steam.next_out pointer. I'll create a patch and send it to you if you're happy to test it. Phillip -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/