public inbox for glibc-bugs@sourceware.org help / color / mirror / Atom feed
From: "vincent-srcware at vinc17 dot net" <sourceware-bugzilla@sourceware.org> To: glibc-bugs@sourceware.org Subject: [Bug build/30157] New: parallel "make check" randomly skips tests Date: Thu, 23 Feb 2023 13:35:34 +0000 [thread overview] Message-ID: <bug-30157-131@http.sourceware.org/bugzilla/> (raw) https://sourceware.org/bugzilla/show_bug.cgi?id=30157 Bug ID: 30157 Summary: parallel "make check" randomly skips tests Product: glibc Version: unspecified Status: UNCONFIRMED Severity: normal Priority: P2 Component: build Assignee: unassigned at sourceware dot org Reporter: vincent-srcware at vinc17 dot net CC: carlos at redhat dot com Target Milestone: --- I did several "make check" yesterday (2023-02-22), and I did another one today (2023-02-23), and I can notice that some *.out files have not been rebuilt, so if they were incorrect in the past, they are still incorrect, and at the end of the tests, "make check" considers the associated tests as failing: [...] -rw-r--r-- 1 50 2023-02-23 13:10:44 elf/tst-glibc-hwcaps.out -rw-r--r-- 1 43 2023-02-23 13:10:44 elf/tst-glibc-hwcaps-2.out -rw-r--r-- 1 68 2023-02-23 13:10:45 elf/tst-glibc-hwcaps-2-cache.out -rw-r--r-- 1 75 2023-02-23 13:10:45 elf/tst-glibc-hwcaps-cache.out -rw-r--r-- 1 0 2023-02-22 17:12:19 elf/tst-glibc-hwcaps-mask.out -rw-r--r-- 1 0 2023-02-22 17:12:19 elf/tst-glibc-hwcaps-prepend.out -rw-r--r-- 1 25 2023-02-23 13:10:45 elf/tst-glibc-hwcaps-prepend-cache.out -rw-r--r-- 1 12 2023-02-23 13:10:44 elf/tst-global1.out -rw-r--r-- 1 16 2023-02-23 13:10:44 elf/tst-global2.out -rw-r--r-- 1 5 2023-02-23 13:10:44 elf/tst-gnu2-tls1.out -rw-r--r-- 1 583 2023-02-22 17:12:20 elf/tst-ifunc-fault-bindnow.out -rw-r--r-- 1 583 2023-02-22 17:12:20 elf/tst-ifunc-fault-lazy.out -rw-r--r-- 1 0 2023-02-23 13:10:44 elf/tst-ifunc-isa-1.out -rw-r--r-- 1 0 2023-02-23 13:10:43 elf/tst-ifunc-isa-1-static.out [...] Note: "make" is actually a shell wrapper that adds the appropriate -j option for parallelization (here -j12 as I have 12 cores) and colorizes the output. Yesterday, I initially did a "make check" where LD_PRELOAD was set to some library in the environment (as this is the case by default on my Debian account), and got 8 failures. Some of these failures were due to the LD_PRELOAD, so I tried again with LD_PRELOAD unset, but I got the same failures; however, I noticed that the corresponding *.out files had not been regenerated by the tests (their timestamp remained the same as before this new test). Today I did a "make check" again with LD_PRELOAD unset, and this time I got only 5 failures. 3 of them are unrelated to LD_PRELOAD. But elf/tst-ifunc-fault-bindnow and elf/tst-ifunc-fault-lazy are due to LD_PRELOAD, and the timestamp of their .out files corresponds to the time when I did the "make check" with LD_PRELOAD set. I suppose that 3 tests that now succeed have been redone, so that their .out files have been rebuilt and are now correct. I suspect that the random behavior is due to the parallelized make. Possibly related to bug 22346 about another parallel "make check" issue. In the summary of bug 29596 (for check-sim, now fixed): "unexpectedly passes without actually testing", which is more or less what happens here, except that this is for me: unexpectedly fails without actually testing. -- You are receiving this mail because: You are on the CC list for the bug.
next reply other threads:[~2023-02-23 13:35 UTC|newest] Thread overview: 14+ messages / expand[flat|nested] mbox.gz Atom feed top 2023-02-23 13:35 vincent-srcware at vinc17 dot net [this message] 2023-02-23 13:39 ` [Bug build/30157] " vincent-srcware at vinc17 dot net 2023-02-23 13:43 ` vincent-srcware at vinc17 dot net 2023-02-23 14:03 ` sam at gentoo dot org 2023-02-23 14:10 ` schwab@linux-m68k.org 2023-02-23 14:15 ` vincent-srcware at vinc17 dot net 2023-02-23 14:54 ` vincent-srcware at vinc17 dot net 2023-02-23 16:18 ` schwab@linux-m68k.org 2023-02-23 17:38 ` vincent-srcware at vinc17 dot net 2023-02-23 19:05 ` carlos at redhat dot com 2023-02-24 9:02 ` vincent-srcware at vinc17 dot net 2023-02-24 9:22 ` vincent-srcware at vinc17 dot net 2023-02-25 19:04 ` carlos at redhat dot com 2023-02-25 20:47 ` vincent-srcware at vinc17 dot net
Reply instructions: You may reply publicly to this message via plain-text email using any one of the following methods: * Save the following mbox file, import it into your mail client, and reply-to-all from there: mbox Avoid top-posting and favor interleaved quoting: https://en.wikipedia.org/wiki/Posting_style#Interleaved_style * Reply using the --to, --cc, and --in-reply-to switches of git-send-email(1): git send-email \ --in-reply-to=bug-30157-131@http.sourceware.org/bugzilla/ \ --to=sourceware-bugzilla@sourceware.org \ --cc=glibc-bugs@sourceware.org \ /path/to/YOUR_REPLY https://kernel.org/pub/software/scm/git/docs/git-send-email.html * If your mail client supports setting the In-Reply-To header via mailto: links, try the mailto: linkBe sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).