Received: by 2002:a05:6a10:206:0:0:0:0 with SMTP id 6csp923408pxj; Wed, 2 Jun 2021 15:19:43 -0700 (PDT) X-Google-Smtp-Source: ABdhPJwFbVecOe4arZz1FFhSnyFYfNy6PZJ6DUtRbH5bfOGQYow+7cY3/+paJZl5kouHGlNT3pNz X-Received: by 2002:a17:906:1113:: with SMTP id h19mr26834450eja.398.1622672383391; Wed, 02 Jun 2021 15:19:43 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1622672383; cv=none; d=google.com; s=arc-20160816; b=e4qvCMATL1tGsNt/grZXHsX8TXP/P+gFiyOV9E4v9brKag0CG72sVtCvnZTmh7nuQq yXZIJIbMXR2JG51S9RYDRGqLNy9O4xZD0O2PK3DhbNgDy0uxpN1sV+knqWMNFEVrt/rL Gx/n+RhlS4JrnGPLAqfFnGEboVWn6gBFhz4MIe8C7zbk0OunZOYejNpu8qFsNotdmz6B 3KiolRvBr0nXFfbZEqSSmUywmD9GGXDIGr5kGbXOKUoq9OeTVP7oCJVraAfo0mH6eN6i WEvnJ63JBgQml5jiyKLa1J05kLGtwlULvn4MLDNEkFtHu/LVtJmxUgwHHZZC/exmSt7S /U7g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=oRWbuW4KyQ0mUMDl1jlxQ1JisSxL8K2tnMYd+3ZLzn8=; b=A7/YXzkFavekCyO4hRUbhT7WSN/BstFukx4DQBQ0/MqXgO0Hp8Ie5SF8dezP7UjcNM +g8Pi4P6EwPX+PDRI2USeJprbVhAGEMV58G2sj5RxQBHx/ZvCMuWktOxd+4VMCSF0Rt/ H39vIlXahgVh2SfpRvq62Q85dtI+P6n6mOiMg/sbsJpvvQPLymUSc5G3nTusdkWGEtgk REZ68Tc4GCYKuuZeG7LuFvCM2Dev6YEVP/HnLntewjn807Ux4rhKKVm2ZvKRdDadm4Zs oiy11CbLPcCzSwIJrHsm7ApL/yGTvL1NDYs6g+1Qgs4OXY1ca2WpEj3x8QfcC2adzUwy w2sA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=UFxQudZV; spf=pass (google.com: domain of linux-ext4-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-ext4-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id l6si806669ejr.184.2021.06.02.15.19.11; Wed, 02 Jun 2021 15:19:43 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-ext4-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=UFxQudZV; spf=pass (google.com: domain of linux-ext4-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-ext4-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229587AbhFBWUE (ORCPT + 99 others); Wed, 2 Jun 2021 18:20:04 -0400 Received: from mail-ua1-f44.google.com ([209.85.222.44]:37425 "EHLO mail-ua1-f44.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229576AbhFBWUD (ORCPT ); Wed, 2 Jun 2021 18:20:03 -0400 Received: by mail-ua1-f44.google.com with SMTP id w28so2201234uae.4; Wed, 02 Jun 2021 15:18:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=oRWbuW4KyQ0mUMDl1jlxQ1JisSxL8K2tnMYd+3ZLzn8=; b=UFxQudZVhOF7yqsT5G6DcJtGKJIPo3pAG9qdu4ZTIGQnbKxyMJwAfqAEvN1LaLrQRJ CDgkLbjIUo90pKezJJuOhYoWmzwQok3tlBKTnzUxdwe+scHYtJueFuelk8V3Knc4Egl9 ananJHqr1Bg6Qj4CloFFKUfSCQaAdq/RkzEGH1qdrOkfgaV+f32PL4ERmDfYI3DoECP5 FoKmJe5YJf+5FTdOXX1jLXz67Pl06q3YfOq6fcd88KFOZpKVe09e/2BRYocCtYUlYPeN yAzpLDz8c2OG3aT5SWeWOs/L9fR9j1V2CMUGe6yrvDwXtNrijPb+JOMX0Iid4Ezs8xgh HXuQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=oRWbuW4KyQ0mUMDl1jlxQ1JisSxL8K2tnMYd+3ZLzn8=; b=Erxb7/euUBDUDN/wG/HJfDTVWkGRCFKsRbBNQOjSUYf9d7dabkNHI0OEFrh09xAc3n U9yWc4sZoSx9+IM/vH9sEn85pPEn6lNICZpuZnAQrmAhikgSfVOaMe/ea28OS8jWO5Ok CZtkodbrK8C8OkBQgBHrzE//VZcJlu0wG2ai7fQnTsmwkXbn42kcQ6Fhp94Ml59bR6rv NWeMC0NJVjBiuSVS7C8WJjcAwtbun22VL8umy8DfxckKb0/GSuPkQA1/yY5mezthaTqQ 4QcJm1tLYstTNP9UjlH0hSLluClAQV/rRjFff6B9OkNk4BsrAjZXT9m6ZnlvkrD1nLNa kkjw== X-Gm-Message-State: AOAM531DOwolOZwic9ciZJeJi4jTWOHir92q+uQw5tT1fcTVBjIXY8q+ JYI6U0+SOIJETd2a51RFBYJu/336k7M= X-Received: by 2002:ab0:5fd8:: with SMTP id g24mr20811653uaj.14.1622672226923; Wed, 02 Jun 2021 15:17:06 -0700 (PDT) Received: from leah-cloudtop2.c.googlers.com.com (241.36.196.104.bc.googleusercontent.com. [104.196.36.241]) by smtp.googlemail.com with ESMTPSA id u17sm205746vke.14.2021.06.02.15.17.06 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 02 Jun 2021 15:17:06 -0700 (PDT) From: Leah Rumancik To: fstests@vger.kernel.org, linux-ext4@vger.kernel.org Cc: Leah Rumancik Subject: [v2] ext4/310: test journal checkpoint ioctl Date: Wed, 2 Jun 2021 22:17:04 +0000 Message-Id: <20210602221704.2312894-1-leah.rumancik@gmail.com> X-Mailer: git-send-email 2.32.0.rc1.229.g3e70b5a671-goog MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: linux-ext4@vger.kernel.org Test for commit "ext4: add ioctl EXT4_IOC_CHECKPOINT". Tests journal checkpointing and journal erasing via EXT4_IOC_CHECKPOINT with flag EXT4_IOC_CHECKPOINT_FLAG_ZEROOUT set. Signed-off-by: Leah Rumancik --- .gitignore | 1 + src/Makefile | 3 +- src/checkpoint_journal.c | 95 ++++++++++++++++++++++++++++++++ tests/ext4/310 | 115 +++++++++++++++++++++++++++++++++++++++ tests/ext4/310.out | 2 + tests/ext4/group | 1 + 6 files changed, 216 insertions(+), 1 deletion(-) create mode 100644 src/checkpoint_journal.c create mode 100755 tests/ext4/310 create mode 100644 tests/ext4/310.out diff --git a/.gitignore b/.gitignore index 4cc9c807..cb7e17bf 100644 --- a/.gitignore +++ b/.gitignore @@ -182,6 +182,7 @@ /src/idmapped-mounts/mount-idmapped /src/log-writes/replay-log /src/perf/*.pyc +/src/checkpoint_journal # Symlinked files /tests/generic/035.out diff --git a/src/Makefile b/src/Makefile index cc0b9579..e0e7006b 100644 --- a/src/Makefile +++ b/src/Makefile @@ -17,7 +17,8 @@ TARGETS = dirstress fill fill2 getpagesize holes lstat64 \ t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro \ t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption \ t_ofd_locks t_mmap_collision mmap-write-concurrent \ - t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc + t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc \ + checkpoint_journal LINUX_TARGETS = xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader \ preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest \ diff --git a/src/checkpoint_journal.c b/src/checkpoint_journal.c new file mode 100644 index 00000000..0347e0c0 --- /dev/null +++ b/src/checkpoint_journal.c @@ -0,0 +1,95 @@ +#include +#include +#include +#include +#include +#include +#include +#include +#include + +/* + * checkpoint_journal.c + * + * Flush journal log and checkpoint journal for ext4 file system and + * optionally, issue discard or zeroout for the journal log blocks. + * + * Arguments: + * 1) mount point for device + * 2) flags (optional) + * set --erase=discard to enable discarding journal blocks + * set --erase=zeroout to enable zero-filling journal blocks + * set --dry-run flag to only perform input checking + */ + +#if defined(__linux__) && !defined(EXT4_IOC_CHECKPOINT) +#define EXT4_IOC_CHECKPOINT _IOW('f', 43, __u32) +#endif + + +#if defined(__linux__) && !defined(EXT4_IOC_CHECKPOINT_FLAG_DISCARD) +#define EXT4_IOC_CHECKPOINT_FLAG_DISCARD 1 +#define EXT4_IOC_CHECKPOINT_FLAG_ZEROOUT 2 +#define EXT4_IOC_CHECKPOINT_FLAG_DRY_RUN 4 +#endif + + +int main(int argc, char** argv) { + int fd, c, ret = 0, option_index = 0; + char* rpath; + unsigned int flags = 0; + + static struct option long_options[] = + { + {"dry-run", no_argument, 0, 'd'}, + {"erase", required_argument, 0, 'e'}, + {0, 0, 0, 0} + }; + + /* get optional flags */ + while ((c = getopt_long(argc, argv, "de:", long_options, + &option_index)) != -1) { + switch (c) { + case 'd': + flags |= EXT4_IOC_CHECKPOINT_FLAG_DRY_RUN; + break; + case 'e': + if (strcmp(optarg, "discard") == 0) { + flags |= EXT4_IOC_CHECKPOINT_FLAG_DISCARD; + } else if (strcmp(optarg, "zeroout") == 0) { + flags |= EXT4_IOC_CHECKPOINT_FLAG_ZEROOUT; + } else { + fprintf(stderr, "Error: invalid erase option\n"); + return 1; + } + break; + default: + return 1; + } + } + + if (optind != argc - 1) { + fprintf(stderr, "Error: invalid number of arguments\n"); + return 1; + } + + /* get fd to file system */ + rpath = realpath(argv[optind], NULL); + fd = open(rpath, O_RDONLY); + free(rpath); + + if (fd == -1) { + fprintf(stderr, "Error: unable to open device %s: %s\n", + argv[optind], strerror(errno)); + return 1; + } + + ret = ioctl(fd, EXT4_IOC_CHECKPOINT, &flags); + + if (ret) + fprintf(stderr, "checkpoint ioctl returned error: %s\n", strerror(errno)); + + close(fd); + return ret; +} + diff --git a/tests/ext4/310 b/tests/ext4/310 new file mode 100755 index 00000000..dd30c782 --- /dev/null +++ b/tests/ext4/310 @@ -0,0 +1,115 @@ +#!/bin/bash +# SPDX-License-Identifier: GPL-2.0 +# Copyright (c) 2021 Google, Inc. All Rights Reserved. +# +# FS QA Test No. 310 +# +# Test checkpoint and zeroout of journal via ioctl EXT4_IOC_CHECKPOINT +# + +seq=`basename $0` +seqres=$RESULT_DIR/$seq +echo "QA output created by $seq" + +status=1 # failure is the default! + +# get standard environment, filters and checks +. ./common/rc +. ./common/filter + +# remove previous $seqres.full before test +rm -f $seqres.full + +# real QA test starts here +_supported_fs ext4 + +_require_scratch +_require_command "$DEBUGFS_PROG" debugfs + +checkpoint_journal=$here/src/checkpoint_journal +_require_test_program "checkpoint_journal" + +# convert output from stat to list of block numbers +get_journal_extents() { + inode_info=$($DEBUGFS_PROG $SCRATCH_DEV -R "stat <8>" 2>> $seqres.full) + echo -e "\nJournal info:" >> $seqres.full + echo "$inode_info" >> $seqres.full + + extents_line=$(echo "$inode_info" | awk '/EXTENTS:/{ print NR; exit }') + get_extents=$(echo "$inode_info" | sed -n "$(($extents_line + 1))"p) + + # get just the physical block numbers + get_extents=$(echo "$get_extents" | perl -pe 's|\(.*?\):||g' | sed -e 's/, /\n/g' | perl -pe 's|(\d+)-(\d+)|\1 \2|g') + + echo "$get_extents" +} + + +# checks all extents are zero'd out except for the superblock +# arg 1: extents (output of get_journal_extents()) +check_extents() { + echo -e "\nChecking extents:" >> $seqres.full + echo "$1" >> $seqres.full + + super_block="true" + echo "$1" | while IFS= read line; do + start_block=$(echo $line | cut -f1 -d' ') + end_block=$(echo $line | cut -f2 -d' ' -s) + + # if first block of journal, shouldn't be wiped + if [ "$super_block" == "true" ]; then + super_block="false" + + #if super block only block in this extent, skip extent + if [ -z "$end_block" ]; then + continue; + fi + start_block=$(($start_block + 1)) + fi + + if [ ! -z "$end_block" ]; then + blocks=$(($end_block - $start_block + 1)) + else + blocks=1 + fi + + check=$(od $SCRATCH_DEV --skip-bytes=$(($start_block * $blocksize)) --read-bytes=$(($blocks * $blocksize)) -An -v | sed -e 's/[0 \t\n\r]//g') + + [ ! -z "$check" ] && echo "error" && break + done +} + +testdir="${SCRATCH_MNT}/testdir" + +_scratch_mkfs_sized $((64 * 1024 * 1024)) >> $seqres.full 2>&1 +_require_metadata_journaling $SCRATCH_DEV +_scratch_mount >> $seqres.full 2>&1 +blocksize=$(_get_block_size $SCRATCH_MNT) +mkdir $testdir + +# check if ioctl present, skip test if not present +$checkpoint_journal $SCRATCH_MNT --dry-run || _notrun "journal checkpoint ioctl not present on device" + +# create some files to add some entries to journal +for i in {1..100}; do + echo > $testdir/$i +done + +# make sure these files get to the journal +sync --file-system $testdir/1 + +# call ioctl to checkpoint and zero-fill journal blocks +$checkpoint_journal $SCRATCH_MNT --erase=zeroout || _fail "ioctl returned error" + +extents=$(get_journal_extents) + +# check journal blocks zeroed out +ret=$(check_extents "$extents") +[ "$ret" = "error" ] && _fail "Journal was not zero-filled" + +_scratch_unmount >> $seqres.full 2>&1 + +echo "Silence is golden" + +status=0 +exit diff --git a/tests/ext4/310.out b/tests/ext4/310.out new file mode 100644 index 00000000..7b9eaf78 --- /dev/null +++ b/tests/ext4/310.out @@ -0,0 +1,2 @@ +QA output created by 310 +Silence is golden diff --git a/tests/ext4/group b/tests/ext4/group index e7ad3c24..622590a9 100644 --- a/tests/ext4/group +++ b/tests/ext4/group @@ -60,3 +60,4 @@ 307 auto ioctl rw defrag 308 auto ioctl rw prealloc quick defrag 309 auto quick dir +310 auto ioctl quick -- 2.32.0.rc1.229.g3e70b5a671-goog