Received-SPF: pass (google.com: domain of linux-ext4-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
From:   Andreas Dilger <adilger@dilger.ca>
Message-Id: <4D64D012-A469-41FA-9ADC-35EF78BCBD55@dilger.ca>
Content-Type: multipart/signed;
 boundary="Apple-Mail=_ECF11A78-5228-4826-8464-6AAC063EA299";
 protocol="application/pgp-signature"; micalg=pgp-sha256
Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\))
Subject: Re: ext4 superblock checksum invalid after running resize2fs
Date:   Tue, 3 Jan 2023 14:17:04 -0700
In-Reply-To: <VI1PR0302MB2685C0378F00C4CC413B85E6C9F49@VI1PR0302MB2685.eurprd03.prod.outlook.com>
Cc:     "linux-ext4@vger.kernel.org" <linux-ext4@vger.kernel.org>
To:     Zsolt Murzsa <thxer@thxer.hu>
References: <VI1PR0302MB2685C0378F00C4CC413B85E6C9F49@VI1PR0302MB2685.eurprd03.prod.outlook.com>
Precedence: bulk


--Apple-Mail=_ECF11A78-5228-4826-8464-6AAC063EA299
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=us-ascii

On Jan 2, 2023, at 5:35 PM, Zsolt Murzsa <thxer@thxer.hu> wrote:
>=20
> Hi!
>=20
> I've had the same issue with twice in the last couple of days with the =
resize2fs online expand function.
> I have a md raid 1, with an LVM volume, which is formatted with ext4. =
I resized the volume (from 4T to 5T), then I ran resize2fs, which ran =
without error, the file system got bigger.
>=20
> After a few hours, I reset the machine (unsafely), due to some zombie =
processes, but after restarting, the system could not mount the =
filesystem.
> I checked the disks, and ran some hardware checks, but I didn't find =
anything wrong. I thought the hard reset caused some problem.
>=20
> That was the problem: "Superblock checksum does not match superblock". =
I tried several superblocks, e2fsck, testdisk, but nothing helped, =
dumpe2fs showed all the data about the superblock.
> I started to restore from a backup.
>=20
> In the meantime, I found the debugfs tool, with which I could skip the =
checksum check and thus see all the folders and files that I restored to =
a separate disk.
> I replaced the two drives, recreated md RAID 1, LVM, then reformatted =
with ext4, started copying the data back.
>=20
> I ran out of space so expanded the LV and ran resize2fs again (from 3T =
to 5T). It ran successfully again, the attached file system is 5T.
> Then I ran an e2fsck.
>=20
> "e2fsck -n /dev/vg1/data
> e2fsck 1.46.5 (30-Dec-2021)
> Warning!  /dev/vg1/data is mounted.
> ext2fs_open2: Superblock checksum does not match superblock
> e2fsck: Superblock invalid, trying backup blocks...
> e2fsck: Superblock checksum does not match superblock while trying to =
open /dev/vg1/data
>=20
> The superblock could not be read or does not describe a valid =
ext2/ext3/ext4
> filesystem.  If the device is valid and it really contains an =
ext2/ext3/ext4
> filesystem (and not swap or ufs or something else), then the =
superblock
> is corrupt, and you might try running e2fsck with an alternate =
superblock:
>    e2fsck -b 8193 <device>
> or
>    e2fsck -b 32768 <device>"

Did you try "e2fsck -fy" to fix the checksum?

> I'm shocked it happened again.
> I can currently write / read the files, but it is suspicious that I =
will not be able to mount the filesystem again.
> In the first case, I couldn't find a simple solution, but is it =
possible to fix the checksum somehow?
> It takes a lot of time to use debugfs to copy everything to another =
drive and back again.
>=20
> My current kernel version: 5.19.17-1-pve.
> I can attach all the superblocks (Both the first and second case), or =
any other information, if needed.


Cheers, Andreas


--Apple-Mail=_ECF11A78-5228-4826-8464-6AAC063EA299
Content-Transfer-Encoding: 7bit
Content-Disposition: attachment;
	filename=signature.asc
Content-Type: application/pgp-signature;
	name=signature.asc
Content-Description: Message signed with OpenPGP

-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - http://gpgtools.org

iQIzBAEBCAAdFiEEDb73u6ZejP5ZMprvcqXauRfMH+AFAmO0m1AACgkQcqXauRfM
H+A/BhAAiGvX0jbF3ZKFmUUwnvaQaSo9mxFesxVrDZp4TyGvvzlITyD66lbNM19K
Y2fgJihqC3IAVJwYfPpqPdZWgAZLP1sPIxSReWsjh9s0Jv3bza8opxTOprDeY6WD
U8AS34J4xn+alnNthki82eM43hVKS1KeWolaHPfQnGEcm703KLwwr6dkIHOt2Y+u
eYdH/nt09CDEG+qBsXSh5/9g+cP1ah8BncKESAs64BncHbTVnyCNWH0Vlq1P96AV
71hjo4ZNJke5HyvnBLrm7gnrXnsIBr5BIh5dkXOtFUZOxsuyGPR3pHmsayy6QVsP
LgKU01ZYn12Qf8rCL/rXMVyIGmwaOu/e1ycSpdLzDuFfiNPl+KhF4Kx390iF/7qH
SjqG7OV42hF5WioPht2v3jLuvPUP7mdaflPpRgHqDyo9O9E32/OYb/VxsAieI+oG
p4rn8Ouo55/wVcUdiGYsJm5/rWVVnxGgVFUOQ3j+OxCvY7uxi/2DopR/NeLpVR+T
JPulfp28Zu0UuKQlVZ9Nvg7I0O89wkN4wYB1u18CIEIU2G9uEJ95mymATPyOHvLi
VW16AMvPR/bcGq2slHh8SnnhPm/vFkQaqArtnS7DOGn2cKLTIBd8aYWwvdf7O5MN
FThJOIvkgWh+06//Ow5zOLyrYovigZus0zFr32IEyp+pP64QQNE=
=OS+H
-----END PGP SIGNATURE-----

--Apple-Mail=_ECF11A78-5228-4826-8464-6AAC063EA299--