From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: by sourceware.org (Postfix, from userid 48) id 5ED85385840F; Fri, 24 Feb 2023 09:02:28 +0000 (GMT) DKIM-Filter: OpenDKIM Filter v2.11.0 sourceware.org 5ED85385840F DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sourceware.org; s=default; t=1677229348; bh=GwGjmlHnTR++UsQFGHp6R/fRvgpJZvkY5+sQ4ORt2Dk=; h=From:To:Subject:Date:In-Reply-To:References:From; b=NCnODxSR/LWeW2pkjkj7DYJESZCBeolFXp0VQ2PDxMCjvBw6Qgcu+QKXjadb65Tru kli59eSjO+qYeYPj1Ysgw7KkuxmW3eGS/ZOk2aV2Kb7QfxF6Bu15pR9MM7UFliXdLb dnqDn5/VqcDAjJ5t+Muw6n6y1l7AWjmZdc8324N4= From: "vincent-srcware at vinc17 dot net" To: glibc-bugs@sourceware.org Subject: [Bug build/30157] parallel "make check" randomly skips tests Date: Fri, 24 Feb 2023 09:02:28 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: glibc X-Bugzilla-Component: build X-Bugzilla-Version: unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: normal X-Bugzilla-Who: vincent-srcware at vinc17 dot net X-Bugzilla-Status: UNCONFIRMED X-Bugzilla-Resolution: X-Bugzilla-Priority: P2 X-Bugzilla-Assigned-To: unassigned at sourceware dot org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: http://sourceware.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 List-Id: https://sourceware.org/bugzilla/show_bug.cgi?id=3D30157 --- Comment #9 from Vincent Lef=C3=A8vre --- (In reply to Carlos O'Donell from comment #8) > I agree it doesn't answer your question, but it does set the expectation > that anything you find that is not driven by dependencies is a mistake > (barring some complexity around tests-container). Tests are there to find bugs, and bugs may depend on the run-time environme= nt in a broad sense (this may be environment variables, but also the current t= ime, the scheduling, in case of race conditions). So it does not make much sense= to say that if a test gave some result in some run, it will always give the sa= me result just because the source files have not changed. > Have you seen tests that were incorrectly executed based on their > dependencies? Yes, for instance, with 3 "make check" without a change of the source files (thus needing a build of everything only after the first one[*]), but LD_PRELOAD was unset after the first one, elf/tst-audit23 * was executed after the first one (obviously) and failed due to the LD_PRELOAD; * was not executed after the second one; * was executed after the third one (and no longer failed as LD_PRELOAD was = no longer set). [*] unless there is a bug in the dependencies for the build. --=20 You are receiving this mail because: You are on the CC list for the bug.=