From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (qmail 22938 invoked by alias); 9 Feb 2015 14:36:35 -0000 Mailing-List: contact gcc-bugs-help@gcc.gnu.org; run by ezmlm Precedence: bulk List-Id: List-Archive: List-Post: List-Help: Sender: gcc-bugs-owner@gcc.gnu.org Received: (qmail 22847 invoked by uid 48); 9 Feb 2015 14:36:31 -0000 From: "dominiq at lps dot ens.fr" To: gcc-bugs@gcc.gnu.org Subject: [Bug testsuite/64983] Incomplete summary when regtesting with dejagnu 1.5.2. Date: Mon, 09 Feb 2015 14:36:00 -0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: gcc X-Bugzilla-Component: testsuite X-Bugzilla-Version: 5.0 X-Bugzilla-Keywords: X-Bugzilla-Severity: normal X-Bugzilla-Who: dominiq at lps dot ens.fr X-Bugzilla-Status: NEW X-Bugzilla-Priority: P3 X-Bugzilla-Assigned-To: unassigned at gcc dot gnu.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cf_reconfirmed_on cc everconfirmed Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: http://gcc.gnu.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-SW-Source: 2015-02/txt/msg00819.txt.bz2 https://gcc.gnu.org/bugzilla/show_bug.cgi?id=64983 Dominique d'Humieres changed: What |Removed |Added ---------------------------------------------------------------------------- Status|UNCONFIRMED |NEW Last reconfirmed| |2015-02-09 CC| |howarth at bromo dot med.uc.edu, | |iains at gcc dot gnu.org, | |mrs at gcc dot gnu.org Ever confirmed|0 |1 --- Comment #1 from Dominique d'Humieres --- With dejagnu 1.5.1, the summary looks like ... === g++ tests === Running target unix/-m32 FAIL: g++.dg/debug/dwarf2/imported-decl-2.C -std=gnu++11 scan-assembler-times ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*. DW_TAG_imported_declaration 1 FAIL: g++.dg/debug/dwarf2/imported-decl-2.C -std=gnu++14 scan-assembler-times ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*. DW_TAG_imported_declaration 1 FAIL: g++.dg/debug/dwarf2/imported-decl-2.C -std=gnu++98 scan-assembler-times ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*. DW_TAG_imported_declaration 1 FAIL: g++.dg/pch/pch.C -O2 -I. -Dwith_PCH (test for excess errors) FAIL: g++.dg/pch/pch.C -O2 assembly comparison WARNING: program timed out. FAIL: g++.dg/tm/pr47573.C -std=gnu++11 (test for excess errors) FAIL: g++.dg/tm/pr47573.C -std=gnu++14 (test for excess errors) FAIL: g++.dg/tm/pr47573.C -std=gnu++98 (test for excess errors) === g++ Summary for unix/-m32 === # of expected passes 88065 # of unexpected failures 8 # of expected failures 320 # of unsupported tests 3647 Running target unix/-m64 FAIL: g++.dg/debug/dwarf2/imported-decl-2.C -std=gnu++11 scan-assembler-times ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*. DW_TAG_imported_declaration 1 FAIL: g++.dg/debug/dwarf2/imported-decl-2.C -std=gnu++14 scan-assembler-times ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*. DW_TAG_imported_declaration 1 FAIL: g++.dg/debug/dwarf2/imported-decl-2.C -std=gnu++98 scan-assembler-times ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*. DW_TAG_imported_declaration 1 FAIL: g++.dg/pch/pch.C -O2 -g -I. -Dwith_PCH (test for excess errors) FAIL: g++.dg/pch/pch.C -g -I. -Dwith_PCH (internal compiler error) FAIL: g++.dg/pch/pch.C -g -I. -Dwith_PCH (test for excess errors) FAIL: g++.dg/pch/pch.C -g assembly comparison FAIL: g++.dg/pch/pch.C -O2 -g assembly comparison WARNING: program timed out. FAIL: g++.dg/tm/pr47573.C -std=gnu++11 (test for excess errors) FAIL: g++.dg/tm/pr47573.C -std=gnu++14 (test for excess errors) FAIL: g++.dg/tm/pr47573.C -std=gnu++98 (test for excess errors) === g++ Summary for unix/-m64 === # of expected passes 89465 # of unexpected failures 11 # of expected failures 320 # of unsupported tests 3888 === g++ Summary === # of expected passes 177530 # of unexpected failures 19 # of expected failures 640 # of unsupported tests 7535 /opt/gcc/build_w/gcc/testsuite/g++/../../xg++ version 5.0.0 20150207 (experimental) [trunk revision 220502p20] (GCC) ... as in https://gcc.gnu.org/ml/gcc-testresults/2015-02/msg00877.html. With dejagnu 1.5.2, it looks like ... === g++ tests === Running target unix/-m32 FAIL: g++.dg/debug/dwarf2/imported-decl-2.C -std=gnu++11 scan-assembler-times ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*. DW_TAG_imported_declaration 1 FAIL: g++.dg/debug/dwarf2/imported-decl-2.C -std=gnu++14 scan-assembler-times ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*. DW_TAG_imported_declaration 1 FAIL: g++.dg/debug/dwarf2/imported-decl-2.C -std=gnu++98 scan-assembler-times ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*. DW_TAG_imported_declaration 1 FAIL: g++.dg/tm/pr47573.C -std=gnu++11 (test for excess errors) FAIL: g++.dg/tm/pr47573.C -std=gnu++14 (test for excess errors) FAIL: g++.dg/tm/pr47573.C -std=gnu++98 (test for excess errors) === g++ Summary for unix/-m32 === # of expected passes 20311 # of expected failures 61 # of unsupported tests 62 Running target unix/-m64 FAIL: g++.dg/debug/dwarf2/imported-decl-2.C -std=gnu++11 scan-assembler-times ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*. DW_TAG_imported_declaration 1 FAIL: g++.dg/debug/dwarf2/imported-decl-2.C -std=gnu++14 scan-assembler-times ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*. DW_TAG_imported_declaration 1 FAIL: g++.dg/debug/dwarf2/imported-decl-2.C -std=gnu++98 scan-assembler-times ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*. DW_TAG_imported_declaration 1 FAIL: g++.dg/tm/pr47573.C -std=gnu++11 (test for excess errors) FAIL: g++.dg/tm/pr47573.C -std=gnu++14 (test for excess errors) FAIL: g++.dg/tm/pr47573.C -std=gnu++98 (test for excess errors) === g++ Summary for unix/-m64 === # of expected passes 20191 # of expected failures 61 # of unsupported tests 80 === g++ Summary === # of expected passes 40502 # of expected failures 122 # of unsupported tests 142 /opt/gcc/build_w/gcc/testsuite/g++/../../xg++ version 5.0.0 20150207 (experimental) [trunk revision 220502p20] (GCC) ... as in https://gcc.gnu.org/ml/gcc-testresults/2015-02/msg01002.html. AFAICT the *.log files contain the right information which are not processed the same way by dejagnu 1.5.1 and 1.5.2 when using contrib/test_summary.