Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1755517AbbLXAAZ (ORCPT ); Wed, 23 Dec 2015 19:00:25 -0500 Received: from ipmail05.adl6.internode.on.net ([150.101.137.143]:45792 "EHLO ipmail05.adl6.internode.on.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751095AbbLXAAY (ORCPT ); Wed, 23 Dec 2015 19:00:24 -0500 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2BXCgBjNHtWPGu7LXlegzqBP4Jig36BeaFLAQEBAQEGi1GJQxiFcQICAQECgSVNAQEBAQEBBwEBAQFBP4Q0AQEBBAECNxwjDAQIAxEEAQEBCR4HDwUNBxEDBwMJDhOIGgMRvQkNg3UBAQEBAQEBAwEBAQEBAR0ZhXWFR4JPhm4FlwOKX3WBb4FljR2GYYNmg3SFAyo0hSgBAQE Date: Thu, 24 Dec 2015 11:00:21 +1100 From: Dave Chinner To: "Elliott, Robert (Persistent Memory)" Cc: Dan Williams , Cholerae Hu , Ted Tso , "adilger.kernel@dilger.ca" , "linux-nvdimm@lists.01.org" , "linux-ext4@vger.kernel.org" , "xfs@oss.sgi.com" , "linux-kernel@vger.kernel.org" Subject: Re: A blocksize problem about dax and ext4 Message-ID: <20151224000021.GU19802@dastard> References: <94D0CD8314A33A4D9D801C0FE68B40295BEC985F@G9W0745.americas.hpqcorp.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <94D0CD8314A33A4D9D801C0FE68B40295BEC985F@G9W0745.americas.hpqcorp.net> User-Agent: Mutt/1.5.21 (2010-09-15) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 3314 Lines: 76 On Wed, Dec 23, 2015 at 09:18:05PM +0000, Elliott, Robert (Persistent Memory) wrote: > > > -----Original Message----- > > From: Linux-nvdimm [mailto:linux-nvdimm-bounces@lists.01.org] On Behalf Of > > Dan Williams > > Sent: Wednesday, December 23, 2015 11:16 AM > > To: Cholerae Hu > > Cc: linux-nvdimm@lists.01.org > > Subject: Re: A blocksize problem about dax and ext4 > > > > On Wed, Dec 23, 2015 at 4:03 AM, Cholerae Hu > > wrote: > ... > > > [root@localhost cholerae]# mount -o dax /dev/pmem0 /mnt/mem > > > mount: wrong fs type, bad option, bad superblock on /dev/pmem0, > > > missing codepage or helper program, or other error > > > > > > In some cases useful info is found in syslog - try > > > dmesg | tail or so. > > > [root@localhost cholerae]# dmesg | tail > ... > > > [ 81.779582] EXT4-fs (pmem0): error: unsupported blocksize for dax > ... > > > What's the fs block size? For example: > > # dumpe2fs -h /dev/pmem0 | grep "Block size" > > dumpe2fs 1.42.9 (28-Dec-2013) > > Block size: 4096 > > Depending on the size of /dev/pmem0 it may have automatically set it > > to a block size less than 4 KiB which is incompatible with "-o dax". > > I noticed a few things while trying that out on both ext4 and xfs. > > $ sudo mkfs.ext4 -F -b 1024 /dev/pmem0 > $ sudo mount -o dax /dev/pmem0 /mnt/ext4-pmem0 > $ sudo mkfs.xfs -f -b size=1024 /dev/pmem0 > $ sudo mount -o dax /dev/pmem0 /mnt/xfs-pmem0 > > [ 199.679195] EXT4-fs (pmem0): DAX enabled. Warning: EXPERIMENTAL, use at your own risk > [ 199.724931] EXT4-fs (pmem0): error: unsupported block size 1024 for dax > [ 859.077766] XFS (pmem0): DAX enabled. Warning: EXPERIMENTAL, use at your own risk > [ 859.118106] XFS (pmem0): Filesystem block size invalid for DAX Turning DAX off. > [ 859.156950] XFS (pmem0): Mounting V4 Filesystem > [ 859.183626] XFS (pmem0): Ending clean mount > > 1. ext4 fails to mount the filesystem, while xfs just disables DAX. > It seems like they should they be the same. I don't really care what is done to ext4 here, but I'm not changing XFS behaviour. I'm expecting mixed dax/non-dax fileystems to be a thing, with DAX turned on by an inode flag on disk. Indeed, I see the mount option going away permanently for XFS, and DAX being controlled completely from on-disk flags. E.g. ext4 encrypted files need to turn off DAX, while clear text files can be accessed using DAX. This should happen completely transparently to the user.... In the situation of block size < page size, there's things we can do to ensure that XFS will allocate page size aligned/sized extents (extent size hints FTW). This is the same mechanism that we'll use to ensure that extents are aligned/sized for reliable huge page mappings. Hence while DAX /as a global option/ needs to be turned off for sub-page block size filesystems, there's no reason why we can't turn DAX on for files that will always allocate blocks according to DAX constraints. Cheers, Dave. -- Dave Chinner david@fromorbit.com -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/