[Bug c/55808] New: excessive memory usage from gcc 4.7.2 when compiling mame source code

[Bug c/55808] New: excessive memory usage from gcc 4.7.2 when compiling mame source code

[mister.freeman at laposte dot net]

http://gcc.gnu.org/bugzilla/show_bug.cgi?id=55808

             Bug #: 55808
           Summary: excessive memory usage from gcc 4.7.2 when compiling
                    mame source code
    Classification: Unclassified
           Product: gcc
           Version: 4.7.2
            Status: UNCONFIRMED
          Severity: normal
          Priority: P3
         Component: c
        AssignedTo: unassigned@gcc.gnu.org
        ReportedBy: mister.freeman@laposte.net


I notice that gcc 4.7.2 uses very excessive amount of memory when I compile the
mame source code ( an arcade emulator ) :

http://mamedev.org/release.html

I have archlinux 32 bits on a virtualbox ( 4.2.6 version ) virtual machine (
CPU dual core 3.3 Ghz, 1 Gb ram and 512 Mb swap partition ),

with PC configuration who have little memory ( 1 Gb for example ) and little
swap partition ( 512 Mb ) it is impossible to compile mame, because the memory
usage is excessive, I monitored the usage of the memory and gcc often takes
almost 2 Gb of ram,

if the system memory is too low ( 1 Gb physical ram and 512 Mb swap partition )
it will cause a fail with this error message :

Compiling src/emu/cpu/tms32051/tms32051.c...
Generating TMS57002 source file...
obj/sdl/build/tmsmake src/emu/cpu/tms57002/tmsinstr.lst
obj/sdl/emu/cpu/tms57002/tms57002.inc
Compiling src/emu/cpu/tms57002/tms57002.c...
{standard input}: Assembler messages:
{standard input}:3066: Warning: end of file not at end of a line; newline
inserted
{standard input}: Error: open CFI at the end of file; missing .cfi_endproc
directive
gcc: internal compiler error: Killed (program cc1plus)
Please submit a full bug report,
with preprocessed source if appropriate.
See <https://bugs.archlinux.org/> for instructions.
make: *** [obj/sdl/emu/cpu/tms57002/tms57002.o] Error 4
==> ERROR: A failure occurred in build().
Aborting... 


if I use an older version of GCC ( for example : gcc 4.4.5 ) I can compile mame
without problems on systems who have low memory ( 1 Gb and 512 Mb swap
partition ), so it's clearly a regression bug in gcc 4.7.2,

and check the first comment here ( padremayi ), same error with gcc 4.7.2 :

https://aur.archlinux.org/packages/sdlmame-wout-gconf/?setlang=fr

we need to improve the memory consumption of gcc

[Bug c/55808] excessive memory usage from gcc 4.7.2 when compiling mame source code

[pinskia at gcc dot gnu.org]

http://gcc.gnu.org/bugzilla/show_bug.cgi?id=55808

Andrew Pinski <pinskia at gcc dot gnu.org> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|UNCONFIRMED                 |WAITING
   Last reconfirmed|                            |2012-12-31
     Ever Confirmed|0                           |1

--- Comment #1 from Andrew Pinski <pinskia at gcc dot gnu.org> 2012-12-31 10:28:30 UTC ---
Can you attach the preprocessed source?

[Bug middle-end/55808] excessive memory usage from gcc 4.7.2 when compiling mame source code

[pinskia at gcc dot gnu.org]

http://gcc.gnu.org/bugzilla/show_bug.cgi?id=55808

Andrew Pinski <pinskia at gcc dot gnu.org> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
          Component|c                           |middle-end

--- Comment #2 from Andrew Pinski <pinskia at gcc dot gnu.org> 2012-12-31 10:31:09 UTC ---
>See <https://bugs.archlinux.org/> for instructions.

Also it says to report this to archlinux first.

What options are being used to compile the source?

[Bug middle-end/55808] excessive memory usage from gcc 4.7.2 when compiling mame source code

[mister.freeman at laposte dot net]

http://gcc.gnu.org/bugzilla/show_bug.cgi?id=55808

--- Comment #3 from Patrick <mister.freeman at laposte dot net> 2012-12-31 15:06:03 UTC ---
the options for compiling mame are :

make NOWERROR=1 OPTIMIZE=2 PYTHON=python2

but I did also a test with no options ( by typing "make" ), each time the
problem occurs if the system memory ( physical memory and swap memory ) is less
than 1.5 Gb,

it's easy to reproduce the problem by creating a virtual machine with
virtualbox ( 1 Gb ram, 512 swap ), download the source code of mame and then
compile it with gcc 4.7.2, after a long time the compilation will fail at this
stage :

Compiling src/emu/cpu/tms32051/tms32051.c...
Generating TMS57002 source file...
obj/sdl/build/tmsmake src/emu/cpu/tms57002/tmsinstr.lst
obj/sdl/emu/cpu/tms57002/tms57002.inc
Compiling src/emu/cpu/tms57002/tms57002.c...
{standard input}: Assembler messages:
{standard input}:3066: Warning: end of file not at end of a line; newline
inserted
{standard input}: Error: open CFI at the end of file; missing .cfi_endproc
directive
gcc: internal compiler error: Killed (program cc1plus)


it fails because there was not sufficient memory to do the compilation, I can
check it by typing "free -m" often in a console,

but with an older version of gcc ( 4.4.5 ) there is no problem

[Bug middle-end/55808] excessive memory usage from gcc 4.7.2 when compiling mame source code

[pinskia at gcc dot gnu.org]

http://gcc.gnu.org/bugzilla/show_bug.cgi?id=55808

--- Comment #4 from Andrew Pinski <pinskia at gcc dot gnu.org> 2012-12-31 21:11:41 UTC ---
(In reply to comment #3)
> the options for compiling mame are :
> 
> make NOWERROR=1 OPTIMIZE=2 PYTHON=python2

I mean which are used to invoke gcc.  I am not going out of my way to create a
vm and try to compile mame, you already have it compiling already.

Please read http://gcc.gnu.org/bugs.html and provide all the needed information
listed on that page.

[Bug middle-end/55808] excessive memory usage from gcc 4.7.2 when compiling mame source code

[mister.freeman at laposte dot net]

http://gcc.gnu.org/bugzilla/show_bug.cgi?id=55808

--- Comment #5 from Patrick <mister.freeman at laposte dot net> 2013-01-01 04:41:07 UTC ---
here are the options :

gcc -DCRLF=2 -DINLINE=static inline -DLSB_FIRST -DNDEBUG -DFLAC__NO_DLL
-DSDLMAME_SDL2=0 -D_LFS64_LARGEFILE=0 -DDISTRO=generic -DSDLMAME_ARCH=
-DSYNC_IMPLEMENTATION=tc -DSDLMAME_UNIX -DUSE_OPENGL=1
-DUSE_DISPATCH_GL=1 -DSDLMAME_X11 -DUSE_XINPUT=0 -DNATIVE_DRC=drcbe_x86
-save-temps -pipe -O3 -Werror -fno-strict-aliasing -Wall -Wcast-align
-Wundef -Wformat-security -Wwrite-strings -Wno-sign-compare
-Wno-conversion -Wno-narrowing -Wno-attributes -D_GNU_SOURCE=1
-D_REENTRANT -pthread -pthread

I will post later the  preprocessed files (*.i*) that trigger the bug

Le 01/01/2013 05:04, pinskia at gcc dot gnu.org a écrit :

> 
> I mean which are used to invoke gcc.  I am not going out of my way to create a
> vm and try to compile mame, you already have it compiling already.
> 
> Please read http://gcc.gnu.org/bugs.html and provide all the needed information
> listed on that page.
>

[Bug middle-end/55808] excessive memory usage from gcc 4.7.2 when compiling mame source code

[mister.freeman at laposte dot net]

http://gcc.gnu.org/bugzilla/show_bug.cgi?id=55808

--- Comment #6 from Patrick <mister.freeman at laposte dot net> 2013-01-01 16:24:05 UTC ---
Created attachment 29071
  --> http://gcc.gnu.org/bugzilla/attachment.cgi?id=29071
the preprocessed source when gcc fails to compile mame

here is the preprocessed source when gcc 4.7.2 fails to compile mame,

output :

gcc: erreur interne du compilateur: Processus arrêté (program cc1plus)
Veuillez soumettre un rapport complet d'anomalies,
avec le source pré-traité si nécessaire.
Consultez <https://bugs.archlinux.org/> pour plus de détail.
make: *** [obj/sdl/emu/cpu/tms57002/tms57002.o] Erreur 4

CFLAGS :
-save-temps -pipe -O3 -Werror -fno-strict-aliasing -Wall -Wcast-align -Wundef
-Wformat-security -Wwrite-strings -Wno-sign-compare -Wno-conversion
-Wno-narrowing -Wno-attributes -D_GNU_SOURCE=1 -D_REENTRANT -pthread -pthread
-Isrc/mame -Iobj/sdl/mame/layout -Isrc/emu -Iobj/sdl/emu -Iobj/sdl/emu/layout
-Isrc/lib/util -Isrc/lib -Isrc/osd -Isrc/osd/sdl -Isrc/lib/expat -Isrc/lib/zlib
-Isrc/lib/util -Isrc/lib/libjpeg -Isrc/debug -include src/osd/sdl/sdlprefix.h
-I/usr/include -I/usr/include/gtk-2.0 -I/usr/lib/gtk-2.0/include
-I/usr/include/atk-1.0 -I/usr/include/cairo -I/usr/include/gdk-pixbuf-2.0
-I/usr/include/pango-1.0 -I/usr/include/glib-2.0 -I/usr/lib/glib-2.0/include
-I/usr/include/pixman-1 -I/usr/include/freetype2 -I/usr/include/libpng15
-I/usr/include/harfbuzz -I/usr/include/gconf/2 -I/usr/include/dbus-1.0
-I/usr/lib/dbus-1.0/include -I/usr/include/glib-2.0 -I/usr/lib/glib-2.0/include
-I/usr/X11/include -I/usr/X11R6/include -I/usr/openwin/include -x c++
-std=gnu++98 -Woverloaded-virtual

the problem seems to be related to low memory ( 1 Gb ram, 512 Mb swap )