Received: by 2002:ac0:a5a7:0:0:0:0:0 with SMTP id m36-v6csp2338949imm; Thu, 9 Aug 2018 11:07:45 -0700 (PDT) X-Google-Smtp-Source: AA+uWPwPm3yzD6ScNrsg8d1EDCz1fF2JYKXAUNiusi+8mnO8maNIgh0Ms09kaIUFfSR7cacTXKH/ X-Received: by 2002:a17:902:25ab:: with SMTP id y40-v6mr3040646pla.120.1533838065800; Thu, 09 Aug 2018 11:07:45 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1533838065; cv=none; d=google.com; s=arc-20160816; b=Xfm8pKmtrkJ/Kg9smY8o91KH1C03bbSHLRaV06foA6S28qK4bnoprHhZUi86yVtcTo sTAwC1soKmYyH4GJmsH2lvIVJOUY6h+Xpp6n7NEQZk2ixEAd4t8eEfdDD5DzWkrTd03n W4asKKYyQAXoVJLDKvmTySdVX6Xi5IhtVl165rB4E4SCxR/8m9k5ard1sCK5M5U0x6Iu 3Ug3rK9/uIcOrVV+S7gP9SUfWpOGPjsgCrJK58dFzt4r8HsruS7FMNs8ix2WFh6fJVzb n3UyC6kDvtjHipWf3SwBDsblbXhi4+yTxq2pJBllYNe+N79nmiSLcWtv4MuOq45O1CpH LDtQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:references:in-reply-to:message-id:date :subject:cc:to:from:dkim-signature:arc-authentication-results; bh=xcCotWz9K0Ns7M/AxzovGJojVJo03cr+h2Au5S0VhgI=; b=dk5wKNsJUlzqbPpPPTjGEVg2nw/k3TckkSACcf99LHl9mxij5oSMmjAPnZpHt5+3UG 6DeFKTu0iuSHhms8xBf7oIWYmjeMb8AwIrdvKzv31UovZCCUGC4RSe+zAPneUqjR+ZFz smn12OIIPKs31EONqYsgXtWBb5SlbHUCchemSt3slod0gLyvDJiKOolpgNVmjojjIceU tc7aCTJBcgK4Js+EuALXaPPLWziLOtuSD1HKPjxEcz+Jbrst2WVyQElPECfyky5UDeWI fYn3BLKexGPSTuk4elgP83oDnsZtWojq68dUgtLLmXF0spl0ZmQyZR13L81UgJv/t+48 Hofw== ARC-Authentication-Results: i=1; mx.google.com; dkim=fail header.i=@gmail.com header.s=20161025 header.b=ZkWBxTnq; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id 14-v6si7643157pgc.179.2018.08.09.11.07.31; Thu, 09 Aug 2018 11:07:45 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=fail header.i=@gmail.com header.s=20161025 header.b=ZkWBxTnq; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727219AbeHIUbz (ORCPT + 99 others); Thu, 9 Aug 2018 16:31:55 -0400 Received: from mail-pg1-f193.google.com ([209.85.215.193]:35931 "EHLO mail-pg1-f193.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726944AbeHIUby (ORCPT ); Thu, 9 Aug 2018 16:31:54 -0400 Received: by mail-pg1-f193.google.com with SMTP id h12-v6so3115271pgs.3; Thu, 09 Aug 2018 11:05:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:from:to:cc:subject:date:message-id:in-reply-to:references; bh=xcCotWz9K0Ns7M/AxzovGJojVJo03cr+h2Au5S0VhgI=; b=ZkWBxTnqvU24gvn3otMvu5/sl5jEIVDefT1K27v0LDJPIS5LvikHp+UTzoaQB4e/id ojAym84JeXtt43kXOL3BdVaimlxiL7AaliNhWhIWjZ//s2lhqJiM1mrB56hGgkpRuyPt tE4W+AN0eq8pkdP9kya2KfMFFhUK4QW6FL++DPwabf9UX/4PmkmNyuWO0JQlqwQu6R8c XI7pPBNPSnE6L6/sMHV4aJeAgYsG1X90JMbgUMA1KJowTII8GhTZ26BkqJKcXks3ahzl aqoT6DMtc+ZyMN5vU3yP+41Ije8dS1sFs0hpozfeg5pSzOIr9qJ2zFAP8Hr+sRIFaJWl rIZA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:from:to:cc:subject:date:message-id :in-reply-to:references; bh=xcCotWz9K0Ns7M/AxzovGJojVJo03cr+h2Au5S0VhgI=; b=tsfI/l8ZJxPmpMm72jIH8QiDBqQDCd+wTyh4FdR1snHXlUNI956uoAKzeHd+ks+S6f Iailf9xveAhM6mfA1FWsdv+vz0jRq0mV/IBZ0DOHOa9ri9WXgv3NbfsBssDzUe0wZHEJ fd7J7Xd+Sr5gq52yO39ajp0q3IVS1xXwguMJ/GViV6EEPpn2R6XN7K/wAbYr7KCKvWOB VD5Oqlqq6Kn00wajzZ8j1T0lIhnKBwUVI8xPuwPzbWB3kbpqQqopGpJqFfvhd/Cb6oql TSV3TZEj0tTsm2sXZsLqYmYqTFneFvh3NPDgpY8eDijpRSz4r3ucUf89z9LuyLq0Z3om KHbg== X-Gm-Message-State: AOUpUlHELHGXPTs50tYtH79qKN2/2ZRvrndsIc46+clxjWryzo1GrS23 Ydkj1yEHZbc/EZ651CI6hPg= X-Received: by 2002:a63:614d:: with SMTP id v74-v6mr3118505pgb.328.1533837955541; Thu, 09 Aug 2018 11:05:55 -0700 (PDT) Received: from localhost (h101-111-148-072.catv02.itscom.jp. [101.111.148.72]) by smtp.gmail.com with ESMTPSA id l185-v6sm7788706pga.65.2018.08.09.11.05.54 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 09 Aug 2018 11:05:54 -0700 (PDT) From: Naohiro Aota To: David Sterba , linux-btrfs@vger.kernel.org Cc: Chris Mason , Josef Bacik , linux-kernel@vger.kernel.org, Hannes Reinecke , Damien Le Moal , Bart Van Assche , Matias Bjorling , Naohiro Aota Subject: [RFC PATCH 03/17] btrfs: Check and enable HMZONED mode Date: Fri, 10 Aug 2018 03:04:36 +0900 Message-Id: <20180809180450.5091-4-naota@elisp.net> X-Mailer: git-send-email 2.18.0 In-Reply-To: <20180809180450.5091-1-naota@elisp.net> References: <20180809180450.5091-1-naota@elisp.net> Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org HMZONED mode cannot be used together with the RAID5/6 profile. Introduce the function btrfs_check_hmzoned_mode() to check this. This function will also check if HMZONED flag is enabled on the file system and if the file system consists of zoned devices with equal zone size. Additionally, as updates to the space cache are in-place, the space cache cannot be located over sequential zones and there is no guarantees that the device will have enough conventional zones to store this cache. Resolve this problem by disabling completely the space cache. This does not introduces any problems with sequential block groups: all the free space is located after the allocation pointer and no free space before the pointer. There is no need to have such cache. Signed-off-by: Damien Le Moal Signed-off-by: Naohiro Aota --- fs/btrfs/ctree.h | 3 ++ fs/btrfs/dev-replace.c | 7 ++++ fs/btrfs/disk-io.c | 7 ++++ fs/btrfs/super.c | 12 +++--- fs/btrfs/volumes.c | 87 ++++++++++++++++++++++++++++++++++++++++++ fs/btrfs/volumes.h | 1 + 6 files changed, 112 insertions(+), 5 deletions(-) diff --git a/fs/btrfs/ctree.h b/fs/btrfs/ctree.h index 66f1d3895bca..14f880126532 100644 --- a/fs/btrfs/ctree.h +++ b/fs/btrfs/ctree.h @@ -763,6 +763,9 @@ struct btrfs_fs_info { struct btrfs_root *uuid_root; struct btrfs_root *free_space_root; + /* Zone size when in HMZONED mode */ + u64 zone_size; + /* the log root tree is a directory of all the other log roots */ struct btrfs_root *log_root_tree; diff --git a/fs/btrfs/dev-replace.c b/fs/btrfs/dev-replace.c index dec01970d8c5..839a35008fd8 100644 --- a/fs/btrfs/dev-replace.c +++ b/fs/btrfs/dev-replace.c @@ -202,6 +202,13 @@ static int btrfs_init_dev_replace_tgtdev(struct btrfs_fs_info *fs_info, return PTR_ERR(bdev); } + if ((bdev_zoned_model(bdev) == BLK_ZONED_HM && + !btrfs_fs_incompat(fs_info, HMZONED)) || + (!bdev_is_zoned(bdev) && btrfs_fs_incompat(fs_info, HMZONED))) { + ret = -EINVAL; + goto error; + } + filemap_write_and_wait(bdev->bd_inode->i_mapping); devices = &fs_info->fs_devices->devices; diff --git a/fs/btrfs/disk-io.c b/fs/btrfs/disk-io.c index 5124c15705ce..14f284382ba7 100644 --- a/fs/btrfs/disk-io.c +++ b/fs/btrfs/disk-io.c @@ -3057,6 +3057,13 @@ int open_ctree(struct super_block *sb, btrfs_free_extra_devids(fs_devices, 1); + ret = btrfs_check_hmzoned_mode(fs_info); + if (ret) { + btrfs_err(fs_info, "failed to init hmzoned mode: %d", + ret); + goto fail_block_groups; + } + ret = btrfs_sysfs_add_fsid(fs_devices, NULL); if (ret) { btrfs_err(fs_info, "failed to init sysfs fsid interface: %d", diff --git a/fs/btrfs/super.c b/fs/btrfs/super.c index 5fdd95e3de05..cc812e459197 100644 --- a/fs/btrfs/super.c +++ b/fs/btrfs/super.c @@ -435,11 +435,13 @@ int btrfs_parse_options(struct btrfs_fs_info *info, char *options, bool saved_compress_force; int no_compress = 0; - cache_gen = btrfs_super_cache_generation(info->super_copy); - if (btrfs_fs_compat_ro(info, FREE_SPACE_TREE)) - btrfs_set_opt(info->mount_opt, FREE_SPACE_TREE); - else if (cache_gen) - btrfs_set_opt(info->mount_opt, SPACE_CACHE); + if (!btrfs_fs_incompat(info, HMZONED)) { + cache_gen = btrfs_super_cache_generation(info->super_copy); + if (btrfs_fs_compat_ro(info, FREE_SPACE_TREE)) + btrfs_set_opt(info->mount_opt, FREE_SPACE_TREE); + else if (cache_gen) + btrfs_set_opt(info->mount_opt, SPACE_CACHE); + } /* * Even the options are empty, we still need to do extra check diff --git a/fs/btrfs/volumes.c b/fs/btrfs/volumes.c index 35b3a2187653..ba7ebb80de4d 100644 --- a/fs/btrfs/volumes.c +++ b/fs/btrfs/volumes.c @@ -1293,6 +1293,80 @@ int btrfs_open_devices(struct btrfs_fs_devices *fs_devices, return ret; } +int btrfs_check_hmzoned_mode(struct btrfs_fs_info *fs_info) +{ + struct btrfs_fs_devices *fs_devices = fs_info->fs_devices; + struct btrfs_device *device; + u64 hmzoned_devices = 0; + u64 nr_devices = 0; + u64 zone_size = 0; + int incompat_hmzoned = btrfs_fs_incompat(fs_info, HMZONED); + int ret = 0; + + /* Count zoned devices */ + list_for_each_entry(device, &fs_devices->devices, dev_list) { + if (!device->bdev) + continue; + if (bdev_zoned_model(device->bdev) == BLK_ZONED_HM || + (bdev_zoned_model(device->bdev) == BLK_ZONED_HA && + incompat_hmzoned)) { + hmzoned_devices++; + if (!zone_size) { + zone_size = device->zone_size; + } else if (device->zone_size != zone_size) { + btrfs_err(fs_info, + "Zoned block devices must have equal zone sizes"); + ret = -EINVAL; + goto out; + } + } + nr_devices++; + } + + if (!hmzoned_devices && incompat_hmzoned) { + /* No zoned block device, disable HMZONED */ + btrfs_err(fs_info, "HMZONED enabled file system should have zoned devices"); + ret = -EINVAL; + goto out; + } + + fs_info->zone_size = zone_size; + + if (hmzoned_devices != nr_devices) { + btrfs_err(fs_info, + "zoned devices mixed with regular devices"); + ret = -EINVAL; + goto out; + } + + /* RAID56 is not allowed */ + if (btrfs_fs_incompat(fs_info, RAID56)) { + btrfs_err(fs_info, "HMZONED mode does not support RAID56"); + ret = -EINVAL; + goto out; + } + + /* + * SPACE CACHE writing is not cowed. Disable that to avoid + * write errors in sequential zones. + */ + if (btrfs_test_opt(fs_info, SPACE_CACHE)) { + btrfs_info(fs_info, + "disabling disk space caching with HMZONED mode"); + btrfs_clear_opt(fs_info->mount_opt, SPACE_CACHE); + } + + btrfs_set_and_info(fs_info, NOTREELOG, + "disabling tree log with HMZONED mode"); + + btrfs_info(fs_info, "HMZONED mode enabled, zone size %llu B", + fs_info->zone_size); + +out: + + return ret; +} + static void btrfs_release_disk_super(struct page *page) { kunmap(page); @@ -2471,6 +2545,13 @@ int btrfs_init_new_device(struct btrfs_fs_info *fs_info, const char *device_path if (IS_ERR(bdev)) return PTR_ERR(bdev); + if ((bdev_zoned_model(bdev) == BLK_ZONED_HM && + !btrfs_fs_incompat(fs_info, HMZONED)) || + (!bdev_is_zoned(bdev) && btrfs_fs_incompat(fs_info, HMZONED))) { + ret = -EINVAL; + goto error; + } + if (fs_devices->seeding) { seeding_dev = 1; down_write(&sb->s_umount); @@ -2584,6 +2665,12 @@ int btrfs_init_new_device(struct btrfs_fs_info *fs_info, const char *device_path } } + ret = btrfs_check_hmzoned_mode(fs_info); + if (ret) { + btrfs_abort_transaction(trans, ret); + goto error_sysfs; + } + if (seeding_dev) { mutex_lock(&fs_info->chunk_mutex); ret = init_first_rw_device(trans, fs_info); diff --git a/fs/btrfs/volumes.h b/fs/btrfs/volumes.h index 13d59bff204f..58053d2e24aa 100644 --- a/fs/btrfs/volumes.h +++ b/fs/btrfs/volumes.h @@ -416,6 +416,7 @@ int btrfs_open_devices(struct btrfs_fs_devices *fs_devices, fmode_t flags, void *holder); int btrfs_get_dev_zone(struct btrfs_device *device, u64 pos, struct blk_zone *zone, gfp_t gfp_mask); +int btrfs_check_hmzoned_mode(struct btrfs_fs_info *fs_info); struct btrfs_device *btrfs_scan_one_device(const char *path, fmode_t flags, void *holder); int btrfs_close_devices(struct btrfs_fs_devices *fs_devices); -- 2.18.0