Received: by 2002:ad5:474a:0:0:0:0:0 with SMTP id i10csp349800imu; Tue, 27 Nov 2018 13:24:07 -0800 (PST) X-Google-Smtp-Source: AFSGD/VIuZJMN+Ohij1oYTbv8TmTW21YyKSrnkdED7nges+HiSdpe2HvqLkmpedEJ56yqFxYLBZF X-Received: by 2002:a17:902:8e8b:: with SMTP id bg11mr34605148plb.332.1543353847337; Tue, 27 Nov 2018 13:24:07 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1543353847; cv=none; d=google.com; s=arc-20160816; b=jPlVlpx0mAfKo11kGY++8zrmTbY62euxsg8Zv6sDIBQI+MNNI/EPzCM7GOmgZnhoxz 17bg2B17SvUPOFTTFwUCM60wTVUq+u2LFVqS5eQPq8McuwYGsv2FTYxEEYK642jRE+RN F5iG5WItA2iVWMBKkq305htLA989R1//UnuA+7qJ4n+Ky+25bDQ/hjJ7PtJTqiJujrcp NhAw104oJb9xGGDh1Yweytzr5RbK7SB5AlmoED5vWsVKdFUbpeIwK4XF8/DpwBDEf6+g eNhnw80dVR4kBG5bCjwTkuFHWPqO3qVNzuprN5QzTArkWBb+8OzT3ah6WUADo0ROb0m0 72WA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-disposition:mime-version:references:message-id:subject:cc :to:from:date:dkim-signature; bh=drFtW+xdbjqWu8Rc2hIkFzGLk/Fk1q7VOcLCOOYtVNs=; b=vS8342swkDbiUjYblcWwIw6OaFbOWC6V4scVrouwOAtWg6cmC0ijMvdz4GUFcktlhJ 1VqB4vLNygYmDRCCQ94I6S9G1ZBDQOka0erBj5efK4jGHq5ajc2SAzKJtehLK6hclB1t 6rbnPKQrQ9mvsIRHqjNrBdACKy5VGtA37/6X0K7zkeHBKOQulXLO7Rg2FRJdMgK9rPui qrYOA/CvMqFFHgM1JZYV+E93Z9itv6hK+DgT5OtVwEu1LfGUPvIi9HYKFS7LrI+6XcIA gUpEaTioxiiQHeMiWHMx8m1hwpaWY4gc1P3gcvTxAvo45BfEE33ZKZI5YxDvirTUARor uy5w== ARC-Authentication-Results: i=1; mx.google.com; dkim=fail header.i=@gmail.com header.s=20161025 header.b=i3wywJnR; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id q73si5089180pfi.205.2018.11.27.13.23.52; Tue, 27 Nov 2018 13:24:07 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=fail header.i=@gmail.com header.s=20161025 header.b=i3wywJnR; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726772AbeK1IWK (ORCPT + 99 others); Wed, 28 Nov 2018 03:22:10 -0500 Received: from mail-pf1-f195.google.com ([209.85.210.195]:34035 "EHLO mail-pf1-f195.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726273AbeK1IWK (ORCPT ); Wed, 28 Nov 2018 03:22:10 -0500 Received: by mail-pf1-f195.google.com with SMTP id h3so9030531pfg.1; Tue, 27 Nov 2018 13:22:57 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=drFtW+xdbjqWu8Rc2hIkFzGLk/Fk1q7VOcLCOOYtVNs=; b=i3wywJnRuLsf8sn84ps9xtF4gThH9K2aK3KDBmEarNpwia72RkYrzEJNR5y6Y7TwZl XZcMwlgasIb1dCibz+hN3TxqQ/wM4OU6jGwzxhjkQ32SbW2xg9nh3zmPt6xwZ9E5ySlW S+VPuPtOPNXR1i2Peb9G2swACwkrAbla3EqfkkDSkuCkAV/1QTxfut+36hJjBspnurLT 7Ijb+Ondzdm9xm8wMOFERna5kQIqt3V7zvePZuUND6chfghrvTkyhv73cq/rdbM/bwdR irC8Fvpp6LtwRFfkqxuB0NId5Uj8MD9J/pLBBxbui6LZsTzFwdzoa4CK+1mIoT7wxwPJ IE6Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition:in-reply-to:user-agent; bh=drFtW+xdbjqWu8Rc2hIkFzGLk/Fk1q7VOcLCOOYtVNs=; b=A/jhNSc2YFPmJeAAeDrdhDFqZa8ds8IFA1PJnMpGeKY9nb4dmvFTbyUnIpOdXlUGAe XJ1mI8FPAYJf3onchBqMxPMjh79Noe8x2amHbmdcCEbFaUoP/QWgeKQ0ui9HV09csVNK GHXZc0gz7pYOqA1bIWOxFKkUuOQV7nfgIzi8ZFu5bmTrnd7e+aJTg8RIGrlhSERdkrMx p97mMupYDRleJD2nK1HXfYdALvuxnjgErnh2CE6vzQ6B5DTtg6s2HYhpboYbKVmsz42L cpu8ueBfWZveo3zNVElLf5yQJ5hST9B2dzhHVdqe5KeYp2rcOmGq+v63i84sdhhF2qKi 3uZg== X-Gm-Message-State: AA+aEWZyHwRiDSVbSwO4lE6puD+vW+uq54U5xFDfPMOhumEbB/aQvkLP pRZXQXVAVhzN/HYRXUZuM2mUxU3s X-Received: by 2002:a63:6bc1:: with SMTP id g184mr31354971pgc.25.1543353777008; Tue, 27 Nov 2018 13:22:57 -0800 (PST) Received: from localhost ([2600:1700:e321:62f0:329c:23ff:fee3:9d7c]) by smtp.gmail.com with ESMTPSA id d2-v6sm7415478pfj.106.2018.11.27.13.22.55 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 27 Nov 2018 13:22:56 -0800 (PST) Date: Tue, 27 Nov 2018 13:22:55 -0800 From: Guenter Roeck To: Rainer Fiebig Cc: linux-kernel@vger.kernel.org, grendel@twistedcode.net, Theodore Ts'o , Andreas Dilger , linux-ext4@vger.kernel.org Subject: Re: ext4 file system corruption with v4.19.3 / v4.19.4 Message-ID: <20181127212255.GA2987@roeck-us.net> References: <065643a0-f9aa-a361-715a-03ca978d9228@roeck-us.net> <5d94f857-b31d-a02c-5a20-2796076f447e@twistedcode.net> <2157925.3ZPi3Rj3bs@siriux> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <2157925.3ZPi3Rj3bs@siriux> User-Agent: Mutt/1.5.24 (2015-08-30) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Tue, Nov 27, 2018 at 07:55:01PM +0100, Rainer Fiebig wrote: > Am Dienstag, 27. November 2018, 15:48:19 schrieb Marek Habersack: > > On 27/11/2018 15:32, Guenter Roeck wrote: > > Hi, > > > > You might try to see if you have CONFIG_SCSI_MQ_DEFAULT=yes in your kernel > > config. Starting with 4.19.1 it somehow interferes with ext4 and causes > > problems similar to the ones you list below. Ever since I disabled MQ > > (either recompile your kernel or add `scsi_mod.use_blk_mq=0` to the kernel > > command line) none of those errors came back. > > > > hope it helps, > > > > marek > > Unfortunately, this doesn't seem to work in every case: > https://bugzilla.kernel.org/show_bug.cgi?id=201685#c54 > > And I'm using a defconfig-4.19.3 (meaning: CONFIG_SCSI_MQ_DEFAULT=yes) in a VM > and I'm not seeing those errors there. OK, it's a VM - but anyway. > Agreed. I disabled CONFIG_SCSI_MQ_DEFAULT, but the problem is still seen at least on one of my servers, so disabling it does not help, at least not in my case. If the problem is somehow related to CONFIG_SCSI_MQ_DEFAULT, you might have to explicitly use a scsi drive (virtio-scsi-pci or similar) to trigger its use in a VM. Guenter > The definite cause of this can only be found by bisecting, IMO. And it needs > to be pinned down because else some feeling of insecurity will remain. > > So long! > > Rainer Fiebig > > > > > > [trying again, this time with correct kernel.org address] > > > > > > Hi, > > > > > > I have seen the following and similar problems several times, > > > with both v4.19.3 and v4.19.4: > > > > > > Nov 23 04:32:25 mars kernel: [112668.673671] EXT4-fs error (device sdb1): > > > ext4_iget:4831: inode #12602889: comm git: bad extra_isize 33661 (inode > > > size 256) > > > Nov 23 04:32:25 mars kernel: [112668.675217] Aborting journal on device > > > sdb1-8. Nov 23 04:32:25 mars kernel: [112668.676681] EXT4-fs (sdb1): > > > Remounting filesystem read-only Nov 23 04:32:25 mars kernel: > > > [112668.808886] EXT4-fs error (device sdb1): ext4_iget:4831: inode > > > #12602881: comm rm: bad extra_isize 33685 (inode size 256) > > > ... > > > > > > Nov 25 00:12:43 saturn kernel: [59377.725984] EXT4-fs error (device sda1): > > > ext4_lookup:1578: inode #238034131: comm updatedb.mlocat: deleted inode > > > referenced: 238160407 > > > Nov 25 00:12:43 saturn kernel: [59377.766638] Aborting journal on device > > > sda1-8. Nov 25 00:12:43 saturn kernel: [59377.779372] EXT4-fs (sda1): > > > Remounting filesystem read-only ... > > > > > > Nov 24 01:52:31 saturn kernel: [189085.240016] EXT4-fs error (device > > > sda1): ext4_lookup:1578: inode #52038457: comm nfsd: deleted inode > > > referenced: 52043796 > > > Nov 24 01:52:31 saturn kernel: [189085.263427] Aborting journal on device > > > sda1-8. Nov 24 01:52:31 saturn kernel: [189085.275313] EXT4-fs (sda1): > > > Remounting filesystem read-only > > > > > > > > > The same systems running v4.18.6 never experienced a problem. > > > > > > Has anyone else seen similar problems ? Is there anything I can do > > > to help tracking down the problem ? > > > > > > Thanks, > > > Guenter > > -- > The truth always turns out to be simpler than you thought. > Richard Feynman