2007-11-01 04:14:46

by Jan-Simon Möller

[permalink] [raw]
Subject: kbuild: modules_install regression ? - depmod

Hi!

I compiled kernel 2.6.24-rc1 (latest git as of today) on a Box with 256MB Ram.
During "make modules_install" I got these errors:

DEPMOD 2.6.24-rc1-default
WARNING: Can't read
module /lib/modules/2.6.24-rc1-default/kernel/net/bridge/bridge.ko: Cannot
allocate memory
WARNING: Can't read
module /lib/modules/2.6.24-rc1-default/kernel/net/bridge/netfilter/ebt_redirect.ko:
Cannot allocate memory
[...]
FATAL: Memory allocation failure depmod.c line 158: realloc(mod->deps,
sizeof(mod->deps[0])*(mod->num_deps+1)).
make: *** [_modinst_post] Fehler 1


Depmod used too much memory and exits. Tried a 2nd time and checked with top.

IMHO this is a regression.

best regards
jan-simon


2007-12-28 15:08:31

by Roland

[permalink] [raw]
Subject: Re: kbuild: modules_install regression ? - depmod

i have the same issue, but with 2.6.24-rc6 on a box with 512MB RAM

System is openSUSE 10.3

on "make modules_install" , depmod reproduceably dies with out of memory error when it is ~800MB VSZ and ~350MB RSS
this happens on different hardware.

any clue what`s going wrong?
how much memory should i expect being needed with "make modules_install" , e.g. with allmodconfig ?


Subject: kbuild: modules_install regression ? - depmod
From: Jan-Simon =?utf-8?q?M=C3=B6ller?= <dl9pf () gmx ! de>
Date: 2007-11-01 4:14:34
Message-ID: 200711010514.34469.dl9pf () gmx ! de
[Download message RAW]

Hi!

I compiled kernel 2.6.24-rc1 (latest git as of today) on a Box with 256MB Ram.
During "make modules_install" I got these errors:

DEPMOD 2.6.24-rc1-default
WARNING: Can't read
module /lib/modules/2.6.24-rc1-default/kernel/net/bridge/bridge.ko: Cannot
allocate memory
WARNING: Can't read
module /lib/modules/2.6.24-rc1-default/kernel/net/bridge/netfilter/ebt_redirect.ko:
Cannot allocate memory
[...]
FATAL: Memory allocation failure depmod.c line 158: realloc(mod->deps,
sizeof(mod->deps[0])*(mod->num_deps+1)).
make: *** [_modinst_post] Fehler 1


Depmod used too much memory and exits. Tried a 2nd time and checked with top.

IMHO this is a regression.

best regards
jan-simon

__________________________________________________________________________
Erweitern Sie FreeMail zu einem noch leistungsst?rkeren E-Mail-Postfach!
Mehr Infos unter http://produkte.web.de/club/?mc=021131

2007-12-29 00:01:41

by Jan-Simon Möller

[permalink] [raw]
Subject: Re: kbuild: modules_install regression ? - depmod

Am Freitag 28 Dezember 2007 16:08:19 schrieb [email protected]:
> i have the same issue, but with 2.6.24-rc6 on a box with 512MB RAM
>
> System is openSUSE 10.3
>
> on "make modules_install" , depmod reproduceably dies with out of memory
> error when it is ~800MB VSZ and ~350MB RSS this happens on different
> hardware.
>
> any clue what`s going wrong?
> how much memory should i expect being needed with "make modules_install" ,
> e.g. with allmodconfig ?
>
>
No news/progress on this issue afaik !

2007-12-29 01:42:18

by Jan Engelhardt

[permalink] [raw]
Subject: Re: kbuild: modules_install regression ? - depmod


[Adding jcm to Cc]

On Dec 28 2007 16:08, [email protected] wrote:
>
>i have the same issue, but with 2.6.24-rc6 on a box with 512MB RAM
>
>System is openSUSE 10.3
>
>on "make modules_install" , depmod reproduceably dies with out of memory error when it is ~800MB VSZ and ~350MB RSS
>this happens on different hardware.
>
>any clue what`s going wrong?
>how much memory should i expect being needed with "make modules_install" , e.g. with allmodconfig ?


If you enable CONFIG_DEBUG_INFO, don't be surprised.

Though I'd say depmod should ignore the debug sections.

>
>
>Subject: kbuild: modules_install regression ? - depmod
>From: Jan-Simon =?utf-8?q?M=C3=B6ller?= <dl9pf () gmx ! de>
>Date: 2007-11-01 4:14:34
>Message-ID: 200711010514.34469.dl9pf () gmx ! de
>[Download message RAW]
>
>Hi!
>
>I compiled kernel 2.6.24-rc1 (latest git as of today) on a Box with 256MB Ram.
>During "make modules_install" I got these errors:
>
> DEPMOD 2.6.24-rc1-default
>WARNING: Can't read
>module /lib/modules/2.6.24-rc1-default/kernel/net/bridge/bridge.ko: Cannot
>allocate memory
>WARNING: Can't read
>module /lib/modules/2.6.24-rc1-default/kernel/net/bridge/netfilter/ebt_redirect.ko:
>Cannot allocate memory
>[...]
>FATAL: Memory allocation failure depmod.c line 158: realloc(mod->deps,
>sizeof(mod->deps[0])*(mod->num_deps+1)).
>make: *** [_modinst_post] Fehler 1
>
>
>Depmod used too much memory and exits. Tried a 2nd time and checked with top.
>
>IMHO this is a regression.
>
>best regards
>jan-simon
>
>__________________________________________________________________________
>Erweitern Sie FreeMail zu einem noch leistungsstärkeren E-Mail-Postfach!
>Mehr Infos unter http://produkte.web.de/club/?mc=021131
>
>--
>To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
>the body of a message to [email protected]
>More majordomo info at http://vger.kernel.org/majordomo-info.html
>Please read the FAQ at http://www.tux.org/lkml/
>

2007-12-29 09:49:42

by Jon Masters

[permalink] [raw]
Subject: Re: kbuild: modules_install regression ? - depmod


On Sat, 2007-12-29 at 02:42 +0100, Jan Engelhardt wrote:
> [Adding jcm to Cc]
>
> On Dec 28 2007 16:08, [email protected] wrote:
> >
> >i have the same issue, but with 2.6.24-rc6 on a box with 512MB RAM
> >
> >System is openSUSE 10.3
> >
> >on "make modules_install" , depmod reproduceably dies with out of memory error when it is ~800MB VSZ and ~350MB RSS
> >this happens on different hardware.
> >
> >any clue what`s going wrong?
> >how much memory should i expect being needed with "make modules_install" , e.g. with allmodconfig ?
>
>
> If you enable CONFIG_DEBUG_INFO, don't be surprised.
>
> Though I'd say depmod should ignore the debug sections.

Thanks for the head's up. I'll look at that, and adding the module
ordering stuff over the weekend - been unplugged for the holidays.

Jon.

2007-12-29 13:30:20

by Roland

[permalink] [raw]
Subject: Re: kbuild: modules_install regression ? - depmod

> [Adding jcm to Cc]
>
> On Dec 28 2007 16:08, [email protected] wrote:
> >
> >i have the same issue, but with 2.6.24-rc6 on a box with 512MB RAM
> >
> >System is openSUSE 10.3
> >
> >on "make modules_install" , depmod reproduceably dies with out of memory error when it is ~800MB VSZ and ~350MB RSS
> >this happens on different hardware.
> >
> >any clue what`s going wrong?
> >how much memory should i expect being needed with "make modules_install" , e.g. with allmodconfig ?
>
>
> If you enable CONFIG_DEBUG_INFO, don't be surprised.
>

oh yes, that`s it!

apparently CONFIG_DEBUG_KERNEL, CONFIG_DEBUG_BUGVERBOSE and CONFIG_DEBUG_INFO defaults to "y" on my distro`s kernel, and i just copied config from /proc/config.gz and did a "make oldconfig".

after disabling those, all is fine now !

thanks for the hint!

> Though I'd say depmod should ignore the debug sections.

so depmod is acting sort of "stupid" here ?

regards
roland


>
> >
> >
> >Subject: kbuild: modules_install regression ? - depmod
> >From: Jan-Simon =?utf-8?q?M=C3=B6ller?= <dl9pf () gmx ! de>
> >Date: 2007-11-01 4:14:34
> >Message-ID: 200711010514.34469.dl9pf () gmx ! de
> >[Download message RAW]
> >
> >Hi!
> >
> >I compiled kernel 2.6.24-rc1 (latest git as of today) on a Box with 256MB Ram.
> >During "make modules_install" I got these errors:
> >
> > DEPMOD 2.6.24-rc1-default
> >WARNING: Can't read
> >module /lib/modules/2.6.24-rc1-default/kernel/net/bridge/bridge.ko: Cannot
> >allocate memory
> >WARNING: Can't read
> >module /lib/modules/2.6.24-rc1-default/kernel/net/bridge/netfilter/ebt_redirect.ko:
> >Cannot allocate memory
> >[...]
> >FATAL: Memory allocation failure depmod.c line 158: realloc(mod->deps,
> >sizeof(mod->deps[0])*(mod->num_deps+1)).
> >make: *** [_modinst_post] Fehler 1
> >
> >
> >Depmod used too much memory and exits. Tried a 2nd time and checked with top.
> >
> >IMHO this is a regression.
> >
> >best regards
> >jan-simon
> >
> >__________________________________________________________________________
> >Erweitern Sie FreeMail zu einem noch leistungsst?rkeren E-Mail-Postfach!
> >Mehr Infos unter http://produkte.web.de/club/?mc=021131
> >
> >--
> >To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
> >the body of a message to [email protected]
> >More majordomo info at http://vger.kernel.org/majordomo-info.html
> >Please read the FAQ at http://www.tux.org/lkml/
> >
>
>


__________________________________________________________________________
Erweitern Sie FreeMail zu einem noch leistungsst?rkeren E-Mail-Postfach!
Mehr Infos unter http://produkte.web.de/club/?mc=021131

2007-12-29 13:46:54

by Jon Masters

[permalink] [raw]
Subject: Re: kbuild: modules_install regression ? - depmod


On Sat, 2007-12-29 at 14:30 +0100, [email protected] wrote:

> > Though I'd say depmod should ignore the debug sections.
>
> so depmod is acting sort of "stupid" here ?

depmod has a bunch of issues that need taking care of, this is just one
of them, but yeah, for now it should just ignore these additional sects.
I'd rewrite the thing but I need some more time to do that in the new
year (and there's lots of special casing for cross-building for
32/64/little/big endian that would need a lot of testing).

I'll push a new release over the weekend.

Jon.

2007-12-29 14:07:30

by Jan Engelhardt

[permalink] [raw]
Subject: Re: kbuild: modules_install regression ? - depmod


On Dec 29 2007 14:30, [email protected] wrote:
>> On Dec 28 2007 16:08, [email protected] wrote:
>> >
>> >i have the same issue, but with 2.6.24-rc6 on a box with 512MB RAM
>> >
>> >System is openSUSE 10.3
>>
>> If you enable CONFIG_DEBUG_INFO, don't be surprised.
>
>oh yes, that`s it!
>
>apparently CONFIG_DEBUG_KERNEL, CONFIG_DEBUG_BUGVERBOSE and CONFIG_DEBUG_INFO
>defaults to "y" on my distro`s kernel, and i just copied config from
>/proc/config.gz and did a "make oldconfig".

Erm... same system here -

$ gzip -cd /proc/config.gz | grep DEBUG_INFO
# CONFIG_DEBUG_INFO is not set

I think you managed to snafu something during building.

2007-12-29 15:51:19

by Roland

[permalink] [raw]
Subject: Re: kbuild: modules_install regression ? - depmod

> Erm... same system here -
>
> $ gzip -cd /proc/config.gz | grep DEBUG_INFO
> # CONFIG_DEBUG_INFO is not set
>
> I think you managed to snafu something during building.

mhh - i have kernel-default-2.6.22.13-0.3 kernel (didn`t touch that since online update) and this has CONFIG_DEBUG_INFO=y
wondering about that, i installed shipping kernel (kernel-default-2.6.22.5-31 from http://download.opensuse.org/distribution/openSUSE-current/repo/oss/suse/i586/ )

but:

opensuse103:~ # uname -a
Linux opensuse103 2.6.22.5-31-default #1 SMP 2007/09/21 22:29:00 UTC i686 i686 i386 GNU/Linux

opensuse103:~ # zcat /proc/config.gz |grep DEBUG_INFO
CONFIG_DEBUG_INFO=y

so i don`t plead guilty.......



> -----Urspr?ngliche Nachricht-----
> Von: "Jan Engelhardt" <[email protected]>
> Gesendet: 29.12.07 15:08:10
> An: [email protected]
> CC: [email protected], [email protected], Linux Kernel Mailing List <[email protected]>
> Betreff: Re: kbuild: modules_install regression ? - depmod


>
>
> On Dec 29 2007 14:30, [email protected] wrote:
> >> On Dec 28 2007 16:08, [email protected] wrote:
> >> >
> >> >i have the same issue, but with 2.6.24-rc6 on a box with 512MB RAM
> >> >
> >> >System is openSUSE 10.3
> >>
> >> If you enable CONFIG_DEBUG_INFO, don't be surprised.
> >
> >oh yes, that`s it!
> >
> >apparently CONFIG_DEBUG_KERNEL, CONFIG_DEBUG_BUGVERBOSE and CONFIG_DEBUG_INFO
> >defaults to "y" on my distro`s kernel, and i just copied config from
> >/proc/config.gz and did a "make oldconfig".
>
> Erm... same system here -
>
> $ gzip -cd /proc/config.gz | grep DEBUG_INFO
> # CONFIG_DEBUG_INFO is not set
>
> I think you managed to snafu something during building.
>


______________________________________________________________________________
Jetzt neu! Im riesigen WEB.DE Club SmartDrive Dateien freigeben und mit
Freunden teilen! http://www.freemail.web.de/club/smartdrive_ttc.htm/?mc=021134

2007-12-29 16:01:34

by Jan Engelhardt

[permalink] [raw]
Subject: Re: kbuild: modules_install regression ? - depmod


On Dec 29 2007 16:51, [email protected] wrote:
>
>> Erm... same system here -
>>
>> $ gzip -cd /proc/config.gz | grep DEBUG_INFO
>> # CONFIG_DEBUG_INFO is not set
>>
>> I think you managed to snafu something during building.
>
>mhh - i have kernel-default-2.6.22.13-0.3 kernel (didn`t touch that since online update) and this has CONFIG_DEBUG_INFO=y
>wondering about that, i installed shipping kernel (kernel-default-2.6.22.5-31 from http://download.opensuse.org/distribution/openSUSE-current/repo/oss/suse/i586/ )
>
>but:
>
>opensuse103:~ # uname -a
>Linux opensuse103 2.6.22.5-31-default #1 SMP 2007/09/21 22:29:00 UTC i686 i686 i386 GNU/Linux
>
>opensuse103:~ # zcat /proc/config.gz |grep DEBUG_INFO
>CONFIG_DEBUG_INFO=y
>
>so i don`t plead guilty.......
>

Well, either way.

rpm2cpio /lnk/103/i586/kernel-default-2.6.22.5-31.i586.rpm [...] grep
DEBUG_INFO ./boot/config-2.6.22.5-31-default

says =y

vs

rpm2cpio /lnk/103/src/kernel-default-2.6.22.5-31.src.rpm [...]
tar -xf config.tar.bz2 [...] grep DEBUG_INFO ./config/i386/default

says =n.

Anyway, it's that option that causes the kernel to be built with -g
and m-i-t does not gracefully handle all that debug info yet.
If /lib is 800 MB, well, expect some serious swapping. Or just
compile without it. Or if you are lazy, find /lib/modules -type f
-iname '*.ko' -print0 | xargs -0 strip -g && depmod. :-)