[Bug driver/46750] New: Parallel build doesn't work --with-build-config=bootstrap-lto in a gcc+binutils combined tree

[Bug driver/46750] New: Parallel build doesn't work --with-build-config=bootstrap-lto in a gcc+binutils combined tree

[hjl.tools at gmail dot com]

http://gcc.gnu.org/bugzilla/show_bug.cgi?id=46750

           Summary: Parallel build doesn't work
                    --with-build-config=bootstrap-lto in a gcc+binutils
                    combined tree
           Product: gcc
           Version: 4.6.0
            Status: UNCONFIRMED
          Severity: normal
          Priority: P3
         Component: driver
        AssignedTo: unassigned@gcc.gnu.org
        ReportedBy: hjl.tools@gmail.com
                CC: bonzini@gnu.org


I got

make[7]: *** read jobs pipe EOF.  Stop.
make[7]: *** Waiting for unfinished jobs....
lto-wrapper: make returned 2 exit status
lto-wrapper failedcollect2: ld returned 1 exit status
make[6]: *** [objdump] Error 1
make[6]: *** Waiting for unfinished jobs....
make[7]: *** read jobs pipe EOF.  Stop.
make[7]: *** Waiting for unfinished jobs....
lto-wrapper: make returned 2 exit status
lto-wrapper failedcollect2: ld returned 1 exit status
make[6]: *** [nm-new] Error 1
make[7]: *** read jobs pipe EOF.  Stop.

[Bug driver/46750] Parallel build doesn't work --with-build-config=bootstrap-lto in a gcc+binutils combined tree

[rguenth at gcc dot gnu.org]

http://gcc.gnu.org/bugzilla/show_bug.cgi?id=46750

Richard Guenther <rguenth at gcc dot gnu.org> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|UNCONFIRMED                 |WAITING
   Last reconfirmed|                            |2010.12.01 19:06:23
     Ever Confirmed|0                           |1

--- Comment #1 from Richard Guenther <rguenth at gcc dot gnu.org> 2010-12-01 19:06:23 UTC ---
That's very much useless information ;)

[Bug driver/46750] Parallel build doesn't work --with-build-config=bootstrap-lto in a gcc+binutils combined tree

[hjl.tools at gmail dot com]

http://gcc.gnu.org/bugzilla/show_bug.cgi?id=46750

--- Comment #2 from H.J. Lu <hjl.tools at gmail dot com> 2010-12-02 00:55:16 UTC ---
In a combined gcc + binutils tree configured with
-with-build-config=bootstrap-lto, I got

cd gas
make -j8
...
libtool: link: /export/build/gnu/gcc-lto/build-x86_64-linux/./prev-gcc/xgcc
-B/export/build/gnu/gcc-lto/build-x86_64-linux/./prev-gcc/
-B/usr/gcc-4.6.0/x86_64-unknown-linux-gnu/bin/
-B/usr/gcc-4.6.0/x86_64-unknown-linux-gnu/bin/
-B/usr/gcc-4.6.0/x86_64-unknown-linux-gnu/lib/ -isystem
/usr/gcc-4.6.0/x86_64-unknown-linux-gnu/include -isystem
/usr/gcc-4.6.0/x86_64-unknown-linux-gnu/sys-include -W -Wall
-Wstrict-prototypes -Wmissing-prototypes -Wshadow -Werror -g -O2
-flto=jobserver -fuse-linker-plugin -frandom-seed=1 -o .libs/as-new app.o as.o
atof-generic.o compress-debug.o cond.o depend.o dwarf2dbg.o dw2gencfi.o ecoff.o
ehopt.o expr.o flonum-copy.o flonum-konst.o flonum-mult.o frags.o hash.o
input-file.o input-scrub.o listing.o literal.o macro.o messages.o output-file.o
read.o remap.o sb.o stabs.o subsegs.o symbols.o write.o tc-i386.o obj-elf.o
atof-ieee.o  -L/export/build/gnu/gcc-lto/build-x86_64-linux/./ld
../opcodes/.libs/libopcodes.so
-L/export/build/gnu/gcc-lto/build-x86_64-linux/opcodes/../libiberty/pic
../bfd/.libs/libbfd.so
-L/export/build/gnu/gcc-lto/build-x86_64-linux/bfd/../libiberty/pic -liberty
../libiberty/libiberty.a -lz -Wl,-rpath -Wl,/usr/gcc-4.6.0/lib
make[3]: *** read jobs pipe EOF.  Stop.
make[3]: *** Waiting for unfinished jobs....
lto-wrapper: make returned 2 exit status
lto-wrapper failedcollect2: ld returned 1 exit status
make[2]: *** [as-new] Error 1
make[2]: Leaving directory `/export/build/gnu/gcc-lto/build-x86_64-linux/gas'
make[1]: *** [all-recursive] Error 1

It seems that "make -j8" doesn't work with binutils Makefile and
LTO.  Replace -flto=jobserver with -flto fixes the problem.

[Bug driver/46750] Parallel build doesn't work --with-build-config=bootstrap-lto in a gcc+binutils combined tree

[hjl.tools at gmail dot com]

http://gcc.gnu.org/bugzilla/show_bug.cgi?id=46750

H.J. Lu <hjl.tools at gmail dot com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|WAITING                     |UNCONFIRMED
     Ever Confirmed|1                           |0

--- Comment #3 from H.J. Lu <hjl.tools at gmail dot com> 2010-12-02 01:08:35 UTC ---
---
     You can also specify `-flto=jobserver' to use GNU make's job
     server mode to determine the number of parallel jobs. This is
     useful when the Makefile calling GCC is already executing in
     parallel.  The parent Makefile will need a `+' prepended to the
     command recipe for this to work. This will likely only work if
     `MAKE' is GNU make.
---

Binutils Makefiles don't have `+' and failed.

[Bug driver/46750] Parallel build doesn't work --with-build-config=bootstrap-lto in a gcc+binutils combined tree

[hjl.tools at gmail dot com]

http://gcc.gnu.org/bugzilla/show_bug.cgi?id=46750

H.J. Lu <hjl.tools at gmail dot com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|UNCONFIRMED                 |RESOLVED
         Resolution|                            |INVALID

--- Comment #4 from H.J. Lu <hjl.tools at gmail dot com> 2010-12-02 01:12:32 UTC ---
Binutils Makefile problem.

[Bug driver/46750] Parallel build doesn't work --with-build-config=bootstrap-lto in a gcc+binutils combined tree

[bonzini at gnu dot org]

http://gcc.gnu.org/bugzilla/show_bug.cgi?id=46750

--- Comment #5 from Paolo Bonzini <bonzini at gnu dot org> 2010-12-02 01:50:39 UTC ---
More like, everyone's Makefiles problem.  This is a serious limitation of
-flto=jobserver, I wonder if it makes sense to keep the option at all.

[Bug driver/46750] Parallel build doesn't work --with-build-config=bootstrap-lto in a gcc+binutils combined tree

[Joost.VandeVondele at pci dot uzh.ch]

http://gcc.gnu.org/bugzilla/show_bug.cgi?id=46750

Joost VandeVondele <Joost.VandeVondele at pci dot uzh.ch> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|RESOLVED                    |UNCONFIRMED
         Resolution|INVALID                     |

--- Comment #6 from Joost VandeVondele <Joost.VandeVondele at pci dot uzh.ch> 2010-12-21 13:03:24 UTC ---
Maybe the bug here is the absolutely unclear error message that is produced ?
How is a user supposed to find that 'read jobs pipe' is related to a makefile
issue. The lto-wrapper should somehow be able to diagnose this issue instead of
failing like this.

[Bug driver/46750] Parallel build doesn't work --with-build-config=bootstrap-lto in a gcc+binutils combined tree

[pinskia at gcc dot gnu.org]

https://gcc.gnu.org/bugzilla/show_bug.cgi?id=46750

Andrew Pinski <pinskia at gcc dot gnu.org> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
         Resolution|---                         |FIXED
   Target Milestone|---                         |10.0
             Status|UNCONFIRMED                 |RESOLVED

--- Comment #7 from Andrew Pinski <pinskia at gcc dot gnu.org> ---
Fixed for GCC 10 by r10-2165, r10-2223 (and a few other followup patches).