Received: by 2002:a25:4158:0:0:0:0:0 with SMTP id o85csp671700yba; Wed, 15 May 2019 08:02:58 -0700 (PDT) X-Google-Smtp-Source: APXvYqzLFR4b4bPWUBiNlbS8N5VzhPEFMkDk69O/SBfjrxQ7tPdhTUIudMjXTYWi6768p/CdE1Fr X-Received: by 2002:a63:d756:: with SMTP id w22mr44904046pgi.382.1557932578406; Wed, 15 May 2019 08:02:58 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1557932578; cv=none; d=google.com; s=arc-20160816; b=TRneg6UAoiAiZrExEcHt0SaxY/wDOgcig5pJ5M9mkrAY5o8/XyHNwDWBTJrdsdqyO6 eseOamUB5IsyVor0NnauLfrXYmJTxtQp4bw8EyCxFOhwaTmyRDNQZnbx3hqHCg9S5nFo wO0wY3juSY1DDQyOvkfZdrB/gCL0Te6C+13G8f7BdrlrCFrygH5toONZl44kEq0kUc7+ H4733DGaoNRVy1+2A/tVIxankSXYPpDzUDVfS0ScLUXatHoP+PrB+ldZoQ9iudVigiKY CgTjv1bwZ4Xsgn2R+IkVJEkJ8t9EnSjc6YbFkZxtnHYK/EoqKRtDA7M16Dr3b+Kf1Z4n 1jsA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:message-id:date:subject:cc:to:from :dkim-signature; bh=B1IFWwgG1uRkFnW1QBc6sOJo5jz4cADtUGrPvdmaUI8=; b=lPMojm1Zg/lpb6q/h10wVo3l9qZzWX2f5z7Eyre37f+DWMX2ZruqlJNSttDA0bWZkq Yw+tuIakElBTempWkJVdkNSv11eNJ+QsYj93PFzC4IzLiIbu1L6fBx8i0PE1nV74NQ7G j4D72OO0I3vtrmOt35zCLNpSCRpHX02bjnPz7bDV/fkbBLF44TE42fTEblV4Nq/FEHhG i+fRimF6TaHWXHU1PuBmmLRgOpTRAeeo7Q7e6kh8oktcxPG67SZKPHeyxrnkslvkmPoy yoS93G1XA/zYMVtuhlEzcimXFySPX5+qTBTahrvR5tUhFKopvUzLKr0GSgdCEhyMry2s hbGA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@kernel.org header.s=default header.b="fk/zgETl"; spf=pass (google.com: best guess record for domain of linux-ext4-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-ext4-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id m7si1858659pll.403.2019.05.15.08.02.35; Wed, 15 May 2019 08:02:58 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-ext4-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=default header.b="fk/zgETl"; spf=pass (google.com: best guess record for domain of linux-ext4-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-ext4-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726491AbfEOPCb (ORCPT + 99 others); Wed, 15 May 2019 11:02:31 -0400 Received: from mail.kernel.org ([198.145.29.99]:56044 "EHLO mail.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1725939AbfEOPCb (ORCPT ); Wed, 15 May 2019 11:02:31 -0400 Received: from localhost.localdomain (bl8-197-74.dsl.telepac.pt [85.241.197.74]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id AB26620815; Wed, 15 May 2019 15:02:28 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1557932549; bh=IGNIfkjfFzi8uBJ6MxS/yUZ4wKNhr2LxIXocL9a3F70=; h=From:To:Cc:Subject:Date:From; b=fk/zgETlKzPzEQT/7conuXGBKqiE0Kha0Zx2cr80FS2ZyqZGbXgO0f8JrmXPkanOg A32HHJum0Y0FpVMOJyXK5U36t5NwWaqzIS0rcZ8j7IGFCj3tkgsSoysHOHWElJd5n9 n44FLdQ0GEkBqjS1uTR5mLeMeifLVJgzqEQZpDNg= From: fdmanana@kernel.org To: fstests@vger.kernel.org Cc: linux-btrfs@vger.kernel.org, linux-ext4@vger.kernel.org, jack@suse.cz, Filipe Manana Subject: [PATCH] fstests: generic, fsync fuzz tester with fsstress Date: Wed, 15 May 2019 16:02:21 +0100 Message-Id: <20190515150221.16647-1-fdmanana@kernel.org> X-Mailer: git-send-email 2.11.0 Sender: linux-ext4-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-ext4@vger.kernel.org From: Filipe Manana Run fsstress, fsync every file and directory, simulate a power failure and then verify the all files and directories exist, with the same data and metadata they had before the power failure. This tes has found already 2 bugs in btrfs, that caused mtime and ctime of directories not being preserved after replaying the log/journal and loss of a directory's attributes (such a UID and GID) after replaying the log. The patches that fix the btrfs issues are titled: "Btrfs: fix wrong ctime and mtime of a directory after log replay" "Btrfs: fix fsync not persisting changed attributes of a directory" Running this test 1000 times: - on xfs, no issues were found - on ext4 it has resulted in about a dozen journal checksum errors (on a 5.0 kernel) that resulted in failure to mount the filesystem after the simulated power failure with dmflakey, which produces the following error in dmesg/syslog: [Mon May 13 12:51:37 2019] JBD2: journal checksum error [Mon May 13 12:51:37 2019] EXT4-fs (dm-0): error loading journal Signed-off-by: Filipe Manana --- tests/generic/547 | 72 +++++++++++++++++++++++++++++++++++++++++++++++++++ tests/generic/547.out | 2 ++ tests/generic/group | 1 + 3 files changed, 75 insertions(+) create mode 100755 tests/generic/547 create mode 100644 tests/generic/547.out diff --git a/tests/generic/547 b/tests/generic/547 new file mode 100755 index 00000000..577b0e9b --- /dev/null +++ b/tests/generic/547 @@ -0,0 +1,72 @@ +#! /bin/bash +# SPDX-License-Identifier: GPL-2.0 +# Copyright (C) 2019 SUSE Linux Products GmbH. All Rights Reserved. +# +# FS QA Test No. 547 +# +# Run fsstress, fsync every file and directory, simulate a power failure and +# then verify the all files and directories exist, with the same data and +# metadata they had before the power failure. +# +seq=`basename $0` +seqres=$RESULT_DIR/$seq +echo "QA output created by $seq" +tmp=/tmp/$$ +status=1 # failure is the default! +trap "_cleanup; exit \$status" 0 1 2 3 15 + +_cleanup() +{ + _cleanup_flakey + cd / + rm -f $tmp.* +} + +# get standard environment, filters and checks +. ./common/rc +. ./common/filter +. ./common/dmflakey + +# real QA test starts here +_supported_fs generic +_supported_os Linux +_require_scratch +_require_fssum +_require_dm_target flakey + +rm -f $seqres.full + +fssum_files_dir=$TEST_DIR/generic-test-$seq +rm -fr $fssum_files_dir +mkdir $fssum_files_dir + +_scratch_mkfs >>$seqres.full 2>&1 +_require_metadata_journaling $SCRATCH_DEV +_init_flakey +_mount_flakey + +mkdir $SCRATCH_MNT/test +args=`_scale_fsstress_args -p 4 -n 100 $FSSTRESS_AVOID -d $SCRATCH_MNT/test` +args="$args -f mknod=0 -f symlink=0" +echo "Running fsstress with arguments: $args" >>$seqres.full +$FSSTRESS_PROG $args >>$seqres.full + +# Fsync every file and directory. +find $SCRATCH_MNT/test -type f,d -exec $XFS_IO_PROG -c "fsync" {} \; + +# Compute a digest of the filesystem (using the test directory only, to skip +# fs specific directories such as "lost+found" on ext4 for example). +$FSSUM_PROG -A -f -w $fssum_files_dir/fs_digest $SCRATCH_MNT/test + +# Simulate a power failure and mount the filesystem to check that all files and +# directories exist and have all data and metadata preserved. +_flakey_drop_and_remount + +# Compute a new digest and compare it to the one we created previously, they +# must match. +$FSSUM_PROG -r $fssum_files_dir/fs_digest $SCRATCH_MNT/test + +_unmount_flakey + +status=0 +exit diff --git a/tests/generic/547.out b/tests/generic/547.out new file mode 100644 index 00000000..0f6f1131 --- /dev/null +++ b/tests/generic/547.out @@ -0,0 +1,2 @@ +QA output created by 547 +OK diff --git a/tests/generic/group b/tests/generic/group index 47e81d96..49639fc9 100644 --- a/tests/generic/group +++ b/tests/generic/group @@ -549,3 +549,4 @@ 544 auto quick clone 545 auto quick cap 546 auto quick clone enospc log +547 auto quick log -- 2.11.0