From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [216.205.24.124]) by sourceware.org (Postfix) with ESMTP id E729F384B13D for ; Fri, 6 Aug 2021 19:35:59 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.1 sourceware.org E729F384B13D Received: from mimecast-mx01.redhat.com (mimecast-mx01.redhat.com [209.132.183.4]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-405-cwdzn_VQNcWNpa1weGeAJw-1; Fri, 06 Aug 2021 15:35:58 -0400 X-MC-Unique: cwdzn_VQNcWNpa1weGeAJw-1 Received: from smtp.corp.redhat.com (int-mx05.intmail.prod.int.phx2.redhat.com [10.5.11.15]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx01.redhat.com (Postfix) with ESMTPS id 58705802B9E for ; Fri, 6 Aug 2021 19:35:57 +0000 (UTC) Received: from [10.3.115.36] (ovpn-115-36.phx2.redhat.com [10.3.115.36]) by smtp.corp.redhat.com (Postfix) with ESMTPS id 3A81B5D6AD for ; Fri, 6 Aug 2021 19:35:57 +0000 (UTC) To: bunsen@sourceware.org From: Keith Seitz Subject: Unusual test_outcome_map keys Message-ID: Date: Fri, 6 Aug 2021 12:35:56 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.11.0 MIME-Version: 1.0 X-Scanned-By: MIMEDefang 2.79 on 10.5.11.15 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-7.1 required=5.0 tests=BAYES_00, DKIMWL_WL_HIGH, DKIM_SIGNED, DKIM_VALID, DKIM_VALID_AU, DKIM_VALID_EF, RCVD_IN_DNSWL_LOW, RCVD_IN_MSPIKE_H2, SPF_HELO_NONE, SPF_NONE, TXREP autolearn=ham autolearn_force=no version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on server2.sourceware.org X-BeenThere: bunsen@sourceware.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Bunsen mailing list List-Unsubscribe: , List-Archive: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Aug 2021 19:36:01 -0000 Hi, While working on fixing up the gdb.sum parser, I've encountered `test_outcome_map', defined in common/parse_dejagnu.py. This is defined: test_outcome_map = {'PASS':'PASS', 'XPASS':'XPASS', 'IPASS':'IPASS', 'FAIL':'FAIL', 'KFAIL':'KFAIL', 'XFAIL':'XFAIL', 'ERROR: tcl error sourcing':'ERROR', 'UNTESTED':'UNTESTED', 'UNSUPPORTED':'UNSUPPORTED', 'UNRESOLVED':'UNRESOLVED'} Can you fill me in on these two unusual keys? IPASS: This is not a standard DejaGNU test result. Is this supposed to be KPASS (which is missing from the map)? ERROR: tcl error sourcing: That's a pretty unusual definition of ERROR. Was this added in order to specifically catch Tcl errors? What about "normal" errors? What's the preferred method for adding members to this map? In GDB, we have a special "DUPLICATE" outcome, and right now my plan is to simply add definitions for this (and any other additions) to our own gdb.parse_dejagnu_sum function, e.g., test_outcome_map['DUPLICATE'] = 'DUPLICATE' I'm not a huge fan of modifying global data like this, but since Bunsen doesn't run over multiple tools at the same time, this shouldn't be an issue. Keith