From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [216.205.24.124]) by sourceware.org (Postfix) with ESMTP id C5C063833014 for ; Wed, 18 Aug 2021 19:26:47 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.1 sourceware.org C5C063833014 Received: from mimecast-mx01.redhat.com (mimecast-mx01.redhat.com [209.132.183.4]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-517-WPRC5z3CN0ieCEUEc5T-aA-1; Wed, 18 Aug 2021 15:26:46 -0400 X-MC-Unique: WPRC5z3CN0ieCEUEc5T-aA-1 Received: from smtp.corp.redhat.com (int-mx02.intmail.prod.int.phx2.redhat.com [10.5.11.12]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx01.redhat.com (Postfix) with ESMTPS id 735F81018F70 for ; Wed, 18 Aug 2021 19:26:45 +0000 (UTC) Received: from guittard.uglyboxes.com (ovpn-115-36.phx2.redhat.com [10.3.115.36]) by smtp.corp.redhat.com (Postfix) with ESMTP id 4C6C918A49 for ; Wed, 18 Aug 2021 19:26:45 +0000 (UTC) From: Keith Seitz To: bunsen@sourceware.org Subject: [PATCH 3/4] Add new outcomes to summarize script Date: Wed, 18 Aug 2021 12:26:38 -0700 Message-Id: <20210818192639.2362335-4-keiths@redhat.com> In-Reply-To: <20210818192639.2362335-1-keiths@redhat.com> References: <20210818192639.2362335-1-keiths@redhat.com> MIME-Version: 1.0 X-Scanned-By: MIMEDefang 2.79 on 10.5.11.12 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset="US-ASCII" X-Spam-Status: No, score=-13.3 required=5.0 tests=BAYES_00, DKIMWL_WL_HIGH, DKIM_SIGNED, DKIM_VALID, DKIM_VALID_AU, DKIM_VALID_EF, GIT_PATCH_0, RCVD_IN_DNSWL_LOW, RCVD_IN_MSPIKE_H2, SPF_HELO_NONE, SPF_NONE, TXREP autolearn=ham autolearn_force=no version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on server2.sourceware.org X-BeenThere: bunsen@sourceware.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Bunsen mailing list List-Unsubscribe: , List-Archive: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 18 Aug 2021 19:26:58 -0000 GDB has a number of custom test outcomes which occasionally appear in test results. This patch adds the appropriate DejaGNU output string for these outcomes. This patch also outputs a footnote whenever the DUPLICATE outcome is seen. For GDB, this number will not be the same as the number reported in gdb.sum, since that reported number is the number of unique duplicates. The number we record in Bunsen is the total number of tests that have the DUPLICATE outcome. $ grep "of duplicate test names" gdb.sum # of duplicate test names 357 vs $ grep ^DUPLICATE gdb.log | wc -l 428 It is this last number that the script reports. --- scripts-main/summarize.py | 10 +++++++++- 1 file changed, 9 insertions(+), 1 deletion(-) diff --git a/scripts-main/summarize.py b/scripts-main/summarize.py index 1e30135..f338b53 100755 --- a/scripts-main/summarize.py +++ b/scripts-main/summarize.py @@ -30,6 +30,8 @@ outcome_labels = { 'UNTESTED' : 'untested testcases', 'UNRESOLVED' : 'unresolved testcases', 'UNSUPPORTED' : 'unsupported tests', + 'PATH' : "paths in test names", + 'DUPLICATE' : "duplicate test names", 'ERROR' : 'errors', 'WARNING' : 'warnings' } @@ -72,6 +74,12 @@ if __name__ == '__main__': # us the same output order as DejaGNU itself. for l in outcome_labels: if c[l] != 0: - print('# of %-26s %d' % (outcome_labels[l], c[l])) + print('# of %-26s %d' % (outcome_labels[l], c[l]), "*" if l == 'DUPLICATE' else "") + + # Output the footnote explaining that reported DUPLICATE numbers are different than + # what GDB reports. + if c['DUPLICATE'] != 0: + print("\n* This number is the total number of tests with duplicate names, not") + print(" the number of unique duplicate names seen.") else: print(f'found no tests matching \"{opts.tests}\"') -- 2.31.1