[Bug build/29167] New: build failures with make --shuffle -j N

[Bug build/29167] New: build failures with make --shuffle -j N

[i at maskray dot me]

https://sourceware.org/bugzilla/show_bug.cgi?id=29167

            Bug ID: 29167
           Summary: build failures with make --shuffle -j N
           Product: glibc
           Version: unspecified
            Status: UNCONFIRMED
          Severity: normal
          Priority: P2
         Component: build
          Assignee: unassigned at sourceware dot org
          Reporter: i at maskray dot me
                CC: carlos at redhat dot com
  Target Milestone: ---

See https://trofi.github.io/posts/238-new-make-shuffle-mode.html for a pending
--shuffle option to GNU make to detect brittle dependencies.
I have patched my local repo ~/Dev/make with
v6-0001-Add-shuffle-argument-support.patch

glibc currently has a number of missing dependency issues:

% mkdir -p out/play && cd out/play
% ../../configure --prefix=/tmp/glibc/play --enable-static-pie &&
~/Dev/make/out/release/make --shuffle=1653253310 -j 20
...
gcc wcstombs.c -c -std=gnu11 -fgnu89-inline  -g -O2 -Wall -Wwrite-strings
-Wundef -Werror -fmerge-all-constants -frounding-math -fno-stack-protector
-fno-common -Wstrict-prototypes -Wold-style-definition -fmath-errno    -fpie  
-ftls-model=initial-exec      -I../include
-I/home/maskray/Dev/glibc/out/play/stdlib  -I/home/maskray/Dev/glibc/out/play 
-I../sysdeps/unix/sysv/linux/x86_64/64  -I../sysdeps/unix/sysv/linux/x86_64 
-I../sysdeps/unix/sysv/linux/x86/include -I../sysdeps/unix/sysv/linux/x86 
-I../sysdeps/x86/nptl  -I../sysdeps/unix/sysv/linux/wordsize-64 
-I../sysdeps/x86_64/nptl  -I../sysdeps/unix/sysv/linux/include
-I../sysdeps/unix/sysv/linux  -I../sysdeps/nptl  -I../sysdeps/pthread 
-I../sysdeps/gnu  -I../sysdeps/unix/inet  -I../sysdeps/unix/sysv 
-I../sysdeps/unix/x86_64  -I../sysdeps/unix  -I../sysdeps/posix 
-I../sysdeps/x86_64/64  -I../sysdeps/x86_64/fpu/multiarch 
-I../sysdeps/x86_64/fpu  -I../sysdeps/x86/fpu  -I../sysdeps/x86_64/multiarch 
-I../sysdeps/x86_64  -I../sysdeps/x86/include -I../sysdeps/x86 
-I../sysdeps/ieee754/float128  -I../sysdeps/ieee754/ldbl-96/include
-I../sysdeps/ieee754/ldbl-96  -I../sysdeps/ieee754/dbl-64 
-I../sysdeps/ieee754/flt-32  -I../sysdeps/wordsize-64  -I../sysdeps/ieee754 
-I../sysdeps/generic  -I.. -I../libio -I.  -D_LIBC_REENTRANT -include
/home/maskray/Dev/glibc/out/play/libc-modules.h -DMODULE_NAME=libc -include
../include/libc-symbols.h  -DPIC     -DTOP_NAMESPACE=glibc -o
/home/maskray/Dev/glibc/out/play/stdlib/wcstombs.o -MD -MP -MF
/home/maskray/Dev/glibc/out/play/stdlib/wcstombs.o.dt -MT
/home/maskray/Dev/glibc/out/play/stdlib/wcstombs.o
../sysdeps/unix/sysv/linux/x86_64/getcontext.S:22:10: fatal error:
ucontext_i.h: No such file or directory
   22 | #include "ucontext_i.h"
      |          ^~~~~~~~~~~~~~
compilation terminated.
make[2]: *** [/home/maskray/Dev/glibc/out/play/sysd-rules:41:
/home/maskray/Dev/glibc/out/play/stdlib/getcontext.o] Error 1
--shuffle=1653253310
make[2]: *** Waiting for unfinished jobs....
../sysdeps/unix/sysv/linux/x86_64/makecontext.c:29:10: fatal error:
ucontext_i.h: No such file or directory
   29 | #include "ucontext_i.h"
      |          ^~~~~~~~~~~~~~

In another fresh build with --shuffle=reverse 

% ~/Dev/make/out/release/make --shuffle=reverse -j 20
...
make[2]: Entering directory '/home/maskray/Dev/glibc/elf'
python3 -B ../scripts/dso-ordering-test.py --description-file
dso-sort-tests-1.def --objpfx /home/maskray/Dev/glibc/out/reverse/elf/
--output-makefile
/home/maskray/Dev/glibc/out/reverse/elf/dso-sort-tests-1.def.generated-makefileT
python3 -B ../scripts/dso-ordering-test.py --description-file
dso-sort-tests-2.def --objpfx /home/maskray/Dev/glibc/out/reverse/elf/
--output-makefile
/home/maskray/Dev/glibc/out/reverse/elf/dso-sort-tests-2.def.generated-makefileT
mv
/home/maskray/Dev/glibc/out/reverse/elf/dso-sort-tests-1.def.generated-makefileT
/home/maskray/Dev/glibc/out/reverse/elf/dso-sort-tests-1.def.generated-makefile
mv
/home/maskray/Dev/glibc/out/reverse/elf/dso-sort-tests-2.def.generated-makefileT
/home/maskray/Dev/glibc/out/reverse/elf/dso-sort-tests-2.def.generated-makefile
make[2]: *** No rule to make target
'/home/maskray/Dev/glibc/out/reverse/stamp.oS', needed by
'/home/maskray/Dev/glibc/out/reverse/libc_nonshared.a'.  Stop.
make[2]: Leaving directory '/home/maskray/Dev/glibc/elf'
make[1]: *** [Makefile:483: elf/others] Error 2 --shuffle=reverse
make[1]: Leaving directory '/home/maskray/Dev/glibc'

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug build/29167] build failures with make --shuffle -j N

[sam at gentoo dot org]

https://sourceware.org/bugzilla/show_bug.cgi?id=29167

Sam James <sam at gentoo dot org> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |sam at gentoo dot org

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug build/29167] build failures with make --shuffle -j N

[schwab@linux-m68k.org]

https://sourceware.org/bugzilla/show_bug.cgi?id=29167

--- Comment #1 from Andreas Schwab <schwab@linux-m68k.org> ---
The toplevel Makefile uses .NOTPARALLEL: to force sequential build.

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug build/29167] build failures with make --shuffle -j N

[i at maskray dot me]

https://sourceware.org/bugzilla/show_bug.cgi?id=29167

Fangrui Song <i at maskray dot me> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|UNCONFIRMED                 |RESOLVED
         Resolution|---                         |INVALID

--- Comment #2 from Fangrui Song <i at maskray dot me> ---
Using v7 from https://savannah.gnu.org/bugs/index.php?62100 does not have the
issue. Closing

Tested several configurations:
../../configure --prefix=/tmp/glibc/play --with-default-link=yes
--enable-static-pie && /tmp/p/make/out/release/make --shuffle=1653253310 -j 20
../../configure --prefix=/tmp/glibc/play --with-default-link=yes
--enable-static-pie && /tmp/p/make/out/release/make --shuffle=reverse -j 20
../../configure --prefix=/tmp/glibc/play --with-default-link=yes &&
/tmp/p/make/out/release/make --shuffle=reverse -j 40

-- 
You are receiving this mail because:
You are on the CC list for the bug.