2008-07-14 19:24:07

by Theodore Ts'o

[permalink] [raw]
Subject: Making it easier for end users to use ext4


So I got a comment on my recent blog posting about using ext4 that
Googling ext4 results in a lot of ancient status reports and not a lot
of good information about how to get started with ext4. The comment was
fair, so I took a few minutes to update this web page:

http://ext4.wiki.kernel.org/index.php/Ext4_Howto

with some getting started information.

Eric, when you have a chance, could you take a quick peek at the Fedora
Core section of that page and update it appropriately. It would
probably be a good idea to include the yum repository with the latest
1.41 e2fsprogs RPM's, etc. One other thought is if we start encouraging
people to use ext4 on FC9, whether it might be a good idea to take all
of the patches to ext4 since 2.6.25, add them to the patch queue, and
then back port the resulting stack of patches to 2.6.25 so that FC9
users who are interested in testing ext4 would get the benefit of the
latest ext4 code, and also so any bug reports we get would also be
against the latest code. Alternatively, the repository could just
simply include 2.6.26 plus the latest ext4 patch set, whichever would be
easier.

If other ext4 developers have a chance, it would be a good idea to go
through the http://ext4.wiki.kernel.org site, and do some grooming of
the site. Some of the pages like the FAQ, which were originally
targetted primarily at ext4 developers, may need to have some of the
more developer-centric content moved to other pages now that we will
start having more users coming to look at that site. And of course,
there is some very badly out-of-date information on that site as well!

- Ted


2008-07-14 19:35:19

by Eric Sandeen

[permalink] [raw]
Subject: Re: Making it easier for end users to use ext4

Theodore Ts'o wrote:
> So I got a comment on my recent blog posting about using ext4 that
> Googling ext4 results in a lot of ancient status reports and not a lot
> of good information about how to get started with ext4. The comment was
> fair, so I took a few minutes to update this web page:
>
> http://ext4.wiki.kernel.org/index.php/Ext4_Howto
>
> with some getting started information.
>
> Eric, when you have a chance, could you take a quick peek at the Fedora
> Core section of that page and update it appropriately.

Sure, first I'll remove "core" since that terminology doesn't exist
anymore ;)

> It would
> probably be a good idea to include the yum repository with the latest
> 1.41 e2fsprogs RPM's, etc. One other thought is if we start encouraging
> people to use ext4 on FC9, whether it might be a good idea to take all
> of the patches to ext4 since 2.6.25, add them to the patch queue, and
> then back port the resulting stack of patches to 2.6.25 so that FC9
> users who are interested in testing ext4 would get the benefit of the
> latest ext4 code, and also so any bug reports we get would also be
> against the latest code.

well, left to its own devices, F9 will see 2.6.26 at least as a testing
kernel pretty soon I think. Waiting for that seems reasonable vs. the
above patch gyrations....

> Alternatively, the repository could just
> simply include 2.6.26 plus the latest ext4 patch set, whichever would be
> easier.

I think very soon just saying "run the latest kernel + e2fsprogs from F9
updates-testing" will be a good start. It won't have delalloc yet,
though. Do we want to try to make that more widely available to people
who can't/don't build their own kernels? I'm slightly hesitant I guess
both for the extra work of maintaining the repo & complete kernel
builds, as well as providing too much rope to people who may not know
just how much rope they've got ...

For pre-built fedora stuff I'd rather those users just follow what gets
packaged from upstream unless someone really, really thinks we should do
otherwise.

-Eric

> If other ext4 developers have a chance, it would be a good idea to go
> through the http://ext4.wiki.kernel.org site, and do some grooming of
> the site. Some of the pages like the FAQ, which were originally
> targetted primarily at ext4 developers, may need to have some of the
> more developer-centric content moved to other pages now that we will
> start having more users coming to look at that site. And of course,
> there is some very badly out-of-date information on that site as well!
>
> - Ted
> --
> To unsubscribe from this list: send the line "unsubscribe linux-ext4" in
> the body of a message to [email protected]
> More majordomo info at http://vger.kernel.org/majordomo-info.html


2008-07-14 19:55:28

by Theodore Ts'o

[permalink] [raw]
Subject: Re: Making it easier for end users to use ext4

On Mon, Jul 14, 2008 at 02:35:07PM -0500, Eric Sandeen wrote:
> > Eric, when you have a chance, could you take a quick peek at the Fedora
> > Core section of that page and update it appropriately.
>
> Sure, first I'll remove "core" since that terminology doesn't exist
> anymore ;)

Is "FC" acronym as in "FC9" going away as well? :-)

> I think very soon just saying "run the latest kernel + e2fsprogs from F9
> updates-testing" will be a good start. It won't have delalloc yet,
> though. Do we want to try to make that more widely available to people
> who can't/don't build their own kernels? I'm slightly hesitant I guess
> both for the extra work of maintaining the repo & complete kernel
> builds, as well as providing too much rope to people who may not know
> just how much rope they've got ...

Well, there are two reasons why I was thinking it might be nice to
synch up the ext4 code base. One was the "more testers good"
argument. The other was is that while *most* of the various races and
bug fixes that have gone in since 2.6.26 were delalloc related, some
are real bugs that might bite 2.6.25 users if they start using the
ext4 code in a more demanding workload. That would result in perhaps
preventable data loss, plus which we could end up spending time
debugging a problem which had already been solved.

If Fedora is going to be putting out another test kernel shortly, any
chance we can get the 2.6.26-ext4-1 or 2.6.26-ext4-2 (with mingming's
latest patch, to be released shortly) included in that test kernel?
Again, the goal is to make it as easy as possible for people to test
the latest version of ext4, so we can get those bugs fixed.

Regards,

- Ted

2008-07-14 21:27:35

by Eric Sandeen

[permalink] [raw]
Subject: Re: Making it easier for end users to use ext4

Theodore Tso wrote:
> On Mon, Jul 14, 2008 at 02:35:07PM -0500, Eric Sandeen wrote:
>>> Eric, when you have a chance, could you take a quick peek at the Fedora
>>> Core section of that page and update it appropriately.
>> Sure, first I'll remove "core" since that terminology doesn't exist
>> anymore ;)
>
> Is "FC" acronym as in "FC9" going away as well? :-)

the "fc9" you see in rpms now stands for "Fedora Collection" - becase,
well, rpm got confused otherwise ;)

I probably forget this from time to time as well ;)

>
>> I think very soon just saying "run the latest kernel + e2fsprogs from F9
>> updates-testing" will be a good start. It won't have delalloc yet,
>> though. Do we want to try to make that more widely available to people
>> who can't/don't build their own kernels? I'm slightly hesitant I guess
>> both for the extra work of maintaining the repo & complete kernel
>> builds, as well as providing too much rope to people who may not know
>> just how much rope they've got ...
>
> Well, there are two reasons why I was thinking it might be nice to
> synch up the ext4 code base. One was the "more testers good"
> argument. The other was is that while *most* of the various races and
> bug fixes that have gone in since 2.6.26 were delalloc related, some
> are real bugs that might bite 2.6.25 users if they start using the
> ext4 code in a more demanding workload. That would result in perhaps
> preventable data loss, plus which we could end up spending time
> debugging a problem which had already been solved.

Sounds reasonable. Should said fixes also go into the 2.6.2[56].x
stable trees for the same reasons, do you think? And, well, if they
did, Fedora would also get them rather quickly. :)

> If Fedora is going to be putting out another test kernel shortly, any
> chance we can get the 2.6.26-ext4-1 or 2.6.26-ext4-2 (with mingming's
> latest patch, to be released shortly) included in that test kernel?
> Again, the goal is to make it as easy as possible for people to test
> the latest version of ext4, so we can get those bugs fixed.

I've gone back and forth about how bleeding-edge to make the Fedora ext4
code, especially for F9. Putting it all into rawhide would be fine,
that's what it's for. But for F9 I'd like to stay on that fine line
between "fix the bugs & add the features quickly" and "don't push
unstable or barely-stable code into the release too soon and cause new
problems."

I don't mind pushing the stable patches into F9 on the early side, and
for rawhide we can push as much as is desired.

Thanks,
-Eric

> Regards,
>
> - Ted


2008-07-15 05:22:38

by Goswin von Brederlow

[permalink] [raw]
Subject: Re: Making it easier for end users to use ext4

"Theodore Ts'o" <[email protected]> writes:

> So I got a comment on my recent blog posting about using ext4 that
> Googling ext4 results in a lot of ancient status reports and not a lot
> of good information about how to get started with ext4. The comment was
> fair, so I took a few minutes to update this web page:
>
> http://ext4.wiki.kernel.org/index.php/Ext4_Howto
>
> with some getting started information.

Many thanks. Going through various pages I found the information to be
seriously out of date ranging from one to two years.

Some thoughts about missing bits from a first read through:

Getting Ext4 code:
- add ext4 and e2fsprogs git repositories
- Add Debian section

64 bit block support:
- limits without it
- state of it
- where to get patches

MfG
Goswin