public inbox for gcc-bugs@sourceware.org
help / color / mirror / Atom feed
From: "dominiq at lps dot ens.fr" <gcc-bugzilla@gcc.gnu.org>
To: gcc-bugs@gcc.gnu.org
Subject: [Bug testsuite/64983] Incomplete summary when regtesting with dejagnu 1.5.2.
Date: Mon, 09 Feb 2015 14:36:00 -0000	[thread overview]
Message-ID: <bug-64983-4-KcqtpKEOa6@http.gcc.gnu.org/bugzilla/> (raw)
In-Reply-To: <bug-64983-4@http.gcc.gnu.org/bugzilla/>

https://gcc.gnu.org/bugzilla/show_bug.cgi?id=64983

Dominique d'Humieres <dominiq at lps dot ens.fr> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|UNCONFIRMED                 |NEW
   Last reconfirmed|                            |2015-02-09
                 CC|                            |howarth at bromo dot med.uc.edu,
                   |                            |iains at gcc dot gnu.org,
                   |                            |mrs at gcc dot gnu.org
     Ever confirmed|0                           |1

--- Comment #1 from Dominique d'Humieres <dominiq at lps dot ens.fr> ---
With dejagnu 1.5.1, the summary looks like

...
        === g++ tests ===


Running target unix/-m32
FAIL: g++.dg/debug/dwarf2/imported-decl-2.C  -std=gnu++11  scan-assembler-times
ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*.
DW_TAG_imported_declaration 1
FAIL: g++.dg/debug/dwarf2/imported-decl-2.C  -std=gnu++14  scan-assembler-times
ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*.
DW_TAG_imported_declaration 1
FAIL: g++.dg/debug/dwarf2/imported-decl-2.C  -std=gnu++98  scan-assembler-times
ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*.
DW_TAG_imported_declaration 1
FAIL: g++.dg/pch/pch.C  -O2 -I. -Dwith_PCH (test for excess errors)
FAIL: g++.dg/pch/pch.C -O2 assembly comparison
WARNING: program timed out.
FAIL: g++.dg/tm/pr47573.C  -std=gnu++11 (test for excess errors)
FAIL: g++.dg/tm/pr47573.C  -std=gnu++14 (test for excess errors)
FAIL: g++.dg/tm/pr47573.C  -std=gnu++98 (test for excess errors)

        === g++ Summary for unix/-m32 ===

# of expected passes        88065
# of unexpected failures    8
# of expected failures        320
# of unsupported tests        3647

Running target unix/-m64
FAIL: g++.dg/debug/dwarf2/imported-decl-2.C  -std=gnu++11  scan-assembler-times
ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*.
DW_TAG_imported_declaration 1
FAIL: g++.dg/debug/dwarf2/imported-decl-2.C  -std=gnu++14  scan-assembler-times
ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*.
DW_TAG_imported_declaration 1
FAIL: g++.dg/debug/dwarf2/imported-decl-2.C  -std=gnu++98  scan-assembler-times
ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*.
DW_TAG_imported_declaration 1
FAIL: g++.dg/pch/pch.C  -O2 -g -I. -Dwith_PCH (test for excess errors)
FAIL: g++.dg/pch/pch.C  -g -I. -Dwith_PCH (internal compiler error)
FAIL: g++.dg/pch/pch.C  -g -I. -Dwith_PCH (test for excess errors)
FAIL: g++.dg/pch/pch.C  -g assembly comparison
FAIL: g++.dg/pch/pch.C -O2 -g assembly comparison
WARNING: program timed out.
FAIL: g++.dg/tm/pr47573.C  -std=gnu++11 (test for excess errors)
FAIL: g++.dg/tm/pr47573.C  -std=gnu++14 (test for excess errors)
FAIL: g++.dg/tm/pr47573.C  -std=gnu++98 (test for excess errors)

        === g++ Summary for unix/-m64 ===

# of expected passes        89465
# of unexpected failures    11
# of expected failures        320
# of unsupported tests        3888

        === g++ Summary ===

# of expected passes        177530
# of unexpected failures    19
# of expected failures        640
# of unsupported tests        7535
/opt/gcc/build_w/gcc/testsuite/g++/../../xg++  version 5.0.0 20150207
(experimental) [trunk revision 220502p20] (GCC) 

...

as in https://gcc.gnu.org/ml/gcc-testresults/2015-02/msg00877.html.

With dejagnu 1.5.2, it looks like

...
        === g++ tests ===


Running target unix/-m32
FAIL: g++.dg/debug/dwarf2/imported-decl-2.C  -std=gnu++11  scan-assembler-times
ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*.
DW_TAG_imported_declaration 1
FAIL: g++.dg/debug/dwarf2/imported-decl-2.C  -std=gnu++14  scan-assembler-times
ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*.
DW_TAG_imported_declaration 1
FAIL: g++.dg/debug/dwarf2/imported-decl-2.C  -std=gnu++98  scan-assembler-times
ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*.
DW_TAG_imported_declaration 1
FAIL: g++.dg/tm/pr47573.C  -std=gnu++11 (test for excess errors)
FAIL: g++.dg/tm/pr47573.C  -std=gnu++14 (test for excess errors)
FAIL: g++.dg/tm/pr47573.C  -std=gnu++98 (test for excess errors)

        === g++ Summary for unix/-m32 ===

# of expected passes        20311
# of expected failures        61
# of unsupported tests        62

Running target unix/-m64
FAIL: g++.dg/debug/dwarf2/imported-decl-2.C  -std=gnu++11  scan-assembler-times
ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*.
DW_TAG_imported_declaration 1
FAIL: g++.dg/debug/dwarf2/imported-decl-2.C  -std=gnu++14  scan-assembler-times
ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*.
DW_TAG_imported_declaration 1
FAIL: g++.dg/debug/dwarf2/imported-decl-2.C  -std=gnu++98  scan-assembler-times
ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*.
DW_TAG_imported_declaration 1
FAIL: g++.dg/tm/pr47573.C  -std=gnu++11 (test for excess errors)
FAIL: g++.dg/tm/pr47573.C  -std=gnu++14 (test for excess errors)
FAIL: g++.dg/tm/pr47573.C  -std=gnu++98 (test for excess errors)

        === g++ Summary for unix/-m64 ===

# of expected passes        20191
# of expected failures        61
# of unsupported tests        80

        === g++ Summary ===

# of expected passes        40502
# of expected failures        122
# of unsupported tests        142
/opt/gcc/build_w/gcc/testsuite/g++/../../xg++  version 5.0.0 20150207
(experimental) [trunk revision 220502p20] (GCC) 

...

as in https://gcc.gnu.org/ml/gcc-testresults/2015-02/msg01002.html.

AFAICT the *.log files contain the right information which are not processed
the same way by dejagnu 1.5.1 and 1.5.2 when using contrib/test_summary.


  reply	other threads:[~2015-02-09 14:36 UTC|newest]

Thread overview: 13+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2015-02-09 14:24 [Bug testsuite/64983] New: " dominiq at lps dot ens.fr
2015-02-09 14:36 ` dominiq at lps dot ens.fr [this message]
2015-02-18 17:55 ` [Bug testsuite/64983] " howarth at bromo dot med.uc.edu
2015-02-18 19:37 ` iains at gcc dot gnu.org
2015-02-18 20:15 ` howarth at bromo dot med.uc.edu
2015-02-18 20:21 ` iains at gcc dot gnu.org
2015-03-28 18:07 ` howarth at bromo dot med.uc.edu
2015-03-28 20:56 ` howarth at bromo dot med.uc.edu
2015-03-29  7:17 ` howarthjw at gmail dot com
2015-03-29 15:10 ` howarth.at.gcc at gmail dot com
2015-03-29 15:39 ` dominiq at lps dot ens.fr
2015-03-31  5:09 ` howarth.at.gcc at gmail dot com
2015-03-31  9:34 ` dominiq at lps dot ens.fr

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=bug-64983-4-KcqtpKEOa6@http.gcc.gnu.org/bugzilla/ \
    --to=gcc-bugzilla@gcc.gnu.org \
    --cc=gcc-bugs@gcc.gnu.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).