2009-12-07 08:39:21

by Phillip Lougher

[permalink] [raw]
Subject: [PATCH 0/9] Squashfs: Add support for LZMA compressed filesystems

Hi,

The following patches add LZMA decompression support to Squashfs, using the
in-kernel LZMA decompression library.

The patches also add a decompression framework to Squashfs.
This allows LZMA decompression to be added cleanly, and it allows
additional decompressors to be easily added in the future.

To enable the in-kernel LZMA decompression code to be used by Squashfs,
there are two patches to the lzma code itself: one to make lzma available
to non-init code, and one to make lzma reentrant. These are obviously
not restricted to Squashfs, but are needed by any non-init code that
may wish to use lzma compression.

These patches are available in my squashfs-devel git tree in a slightly
different format (these patches have been refactored for posting, they'll
be put into a git tree ASAP).

http://git.kernel.org/?p=linux/kernel/git/pkl/squashfs-devel.git;a=summary

I would like to thank the CE Linux Forum (CELF) for supporting this work.

Thanks

Phillip


2009-12-12 05:37:13

by Bruno Wolff III

[permalink] [raw]
Subject: Re: [PATCH 0/9] Squashfs: Add support for LZMA compressed filesystems

On Mon, Dec 07, 2009 at 08:37:48 +0000,
Phillip Lougher <[email protected]> wrote:
> Hi,
>
> The following patches add LZMA decompression support to Squashfs, using the
> in-kernel LZMA decompression library.

I am a member of the Spins SIG and the Games Spin maintainer for Fedora.
Thanks for working to get LZMA squashfs included in 2.6.33. If this
gets accepted, we will have livecd-creator using it in F13 in order
to include more packages in size limited images (such as the Games Spin)
or reduce the size other images.
Possibly it will be mentioned as a "feature" for the F13 release. I have
a proposed feature page set up and waiting for these patches to be accepted at:
https://fedoraproject.org/wiki/Features/LZMA_for_Live_Images

2009-12-13 01:12:18

by Ozan Çağlayan

[permalink] [raw]
Subject: Re: [PATCH 0/9] Squashfs: Add support for LZMA compressed filesystems

Bruno Wolff III wrote:
> On Mon, Dec 07, 2009 at 08:37:48 +0000,
> Phillip Lougher <[email protected]> wrote:
>
>> Hi,
>>
>> The following patches add LZMA decompression support to Squashfs, using the
>> in-kernel LZMA decompression library.
>>
>
> I am a member of the Spins SIG and the Games Spin maintainer for Fedora.
> Thanks for working to get LZMA squashfs included in 2.6.33. If this
> gets accepted, we will have livecd-creator using it in F13 in order
> to include more packages in size limited images (such as the Games Spin)
> or reduce the size other images
>

Similar, I was looking forward to squashfs-lzma to use it on our
distribution's installation/live medium. I once digged into the openwrt
patches and failed. Now I tested your patches (on top of 2.6.30.9) +
userspace from CVS patched with lzma 4.65, it's working flawlessly. With
lzma, our live cd image's size decreased from 820mb to 692mb.

Thanks a lot for your work
Ozan Caglayan

2009-12-13 20:14:27

by Arkadiusz Miśkiewicz

[permalink] [raw]
Subject: Re: [PATCH 0/9] Squashfs: Add support for LZMA compressed filesystems

Phillip Lougher wrote:

> Peter Korsgaard wrote:

>> Nice, do you also have an mksquashfs with lzma support?
>>
>
> Yes, in Squashfs CVS (http://sourceforge.net/projects/squashfs/develop).

Any reason for not using much nicer xz library instead of lzma sdk ?

http://tukaani.org/xz/

> Phillip


--
Arkadiusz Miśkiewicz PLD/Linux Team
arekm / maven.pl http://ftp.pld-linux.org/

2009-12-21 23:18:46

by Bruno Wolff III

[permalink] [raw]
Subject: Re: [PATCH 0/9] Squashfs: Add support for LZMA compressed filesystems

On Mon, Dec 07, 2009 at 08:37:48 +0000,
Phillip Lougher <[email protected]> wrote:
> Hi,
>
> The following patches add LZMA decompression support to Squashfs, using the
> in-kernel LZMA decompression library.

Do these still have a chance to make 2.6.33?

2009-12-21 23:48:32

by Phillip Lougher

[permalink] [raw]
Subject: Re: [PATCH 0/9] Squashfs: Add support for LZMA compressed filesystems

Bruno Wolff III wrote:
> On Mon, Dec 07, 2009 at 08:37:48 +0000,
> Phillip Lougher <[email protected]> wrote:
>> Hi,
>>
>> The following patches add LZMA decompression support to Squashfs, using the
>> in-kernel LZMA decompression library.
>
> Do these still have a chance to make 2.6.33?
>

It's very unlikely. Andrew wanted it to spend a cycle in linux-next. I'll then
try for 2.6.34 merge. I'm happy with that.

Phillip

2009-12-21 23:58:05

by Bruno Wolff III

[permalink] [raw]
Subject: Re: [PATCH 0/9] Squashfs: Add support for LZMA compressed filesystems

On Mon, Dec 21, 2009 at 23:47:30 +0000,
Phillip Lougher <[email protected]> wrote:
> Bruno Wolff III wrote:
> >On Mon, Dec 07, 2009 at 08:37:48 +0000,
> > Phillip Lougher <[email protected]> wrote:
> >>Hi,
> >>
> >>The following patches add LZMA decompression support to Squashfs, using the
> >>in-kernel LZMA decompression library.
> >
> >Do these still have a chance to make 2.6.33?
> >
>
> It's very unlikely. Andrew wanted it to spend a cycle in linux-next. I'll then
> try for 2.6.34 merge. I'm happy with that.

I hadn't seen it show up there yet either. But maybe its a bit too early
for that. If it gets there I might have a chance of convincing one of
the Fedora kernel guys of back porting it, since F13 is likely to be released
with the 2,6,34 kernel in any case. (Along with some actual numbers for
our live iso images to show it's important to have. But I can get those
using the devel version of squashfs without the kernel changes.)
I'll keep an eye out for it showing up in linux-next. Thanks for the update.

2009-12-31 12:09:10

by Bruno Wolff III

[permalink] [raw]
Subject: Re: [PATCH 0/9] Squashfs: Add support for LZMA compressed filesystems

On Mon, Dec 21, 2009 at 23:47:30 +0000,
Phillip Lougher <[email protected]> wrote:
>
> It's very unlikely. Andrew wanted it to spend a cycle in linux-next. I'll then
> try for 2.6.34 merge. I'm happy with that.
>
> Phillip

linux-next still hasn't picked these patches up. It would give me more leverage
in getting the patches into Fedora 13 if they were to be in linux-next.

2010-01-01 09:13:47

by Bruno Wolff III

[permalink] [raw]
Subject: Re: [PATCH 0/9] Squashfs: Add support for LZMA compressed filesystems

On Thu, Dec 31, 2009 at 06:06:34 -0600,
Bruno Wolff III <[email protected]> wrote:
> On Mon, Dec 21, 2009 at 23:47:30 +0000,
> Phillip Lougher <[email protected]> wrote:
> >
> > It's very unlikely. Andrew wanted it to spend a cycle in linux-next. I'll then
> > try for 2.6.34 merge. I'm happy with that.
> >
> > Phillip
>
> linux-next still hasn't picked these patches up. It would give me more leverage
> in getting the patches into Fedora 13 if they were to be in linux-next.

I see that they made it into the January 1st linux-next tree. Thanks.