From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) by sourceware.org (Postfix) with ESMTPS id F3A6E3856DE1 for ; Thu, 21 Apr 2022 15:18:27 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.1 sourceware.org F3A6E3856DE1 Received: from mimecast-mx02.redhat.com (mx3-rdu2.redhat.com [66.187.233.73]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id us-mta-46-Daxrr7ssOci8BuEe6bRsMA-1; Thu, 21 Apr 2022 11:18:26 -0400 X-MC-Unique: Daxrr7ssOci8BuEe6bRsMA-1 Received: from smtp.corp.redhat.com (int-mx01.intmail.prod.int.rdu2.redhat.com [10.11.54.1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx02.redhat.com (Postfix) with ESMTPS id E4BCF2808560; Thu, 21 Apr 2022 15:18:25 +0000 (UTC) Received: from redhat.com (unknown [10.2.16.77]) by smtp.corp.redhat.com (Postfix) with ESMTPS id C954A4087D70; Thu, 21 Apr 2022 15:18:25 +0000 (UTC) Received: from fche by redhat.com with local (Exim 4.94.2) (envelope-from ) id 1nhYZc-0004tw-TA; Thu, 21 Apr 2022 11:18:25 -0400 Date: Thu, 21 Apr 2022 11:18:24 -0400 From: "Frank Ch. Eigler" To: Keith Seitz Cc: Serhei Makarov , Bunsen Subject: Re: [RFC] GDB sanity test Message-ID: <20220421151824.GD21143@redhat.com> References: <20220419190117.903678-1-keiths@redhat.com> <21b838a8-1744-4c3b-8f41-f2c44ffcc9e3@www.fastmail.com> <41037236-1123-9d34-178e-65a840ff3617@redhat.com> MIME-Version: 1.0 In-Reply-To: <41037236-1123-9d34-178e-65a840ff3617@redhat.com> User-Agent: Mutt/1.12.0 (2019-05-25) X-Scanned-By: MIMEDefang 2.84 on 10.11.54.1 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Spam-Status: No, score=-5.3 required=5.0 tests=BAYES_00, DKIMWL_WL_HIGH, DKIM_SIGNED, DKIM_VALID, DKIM_VALID_AU, DKIM_VALID_EF, RCVD_IN_DNSWL_LOW, SPF_HELO_NONE, SPF_NONE, TXREP autolearn=ham autolearn_force=no version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on server2.sourceware.org X-BeenThere: bunsen@sourceware.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Bunsen mailing list List-Unsubscribe: , List-Archive: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Apr 2022 15:18:29 -0000 Hi - > [...] > I guess if we rely on DejaGNU .log/.sum files as test data, we could write up > a function to grok the results at the end of the .sum file to compare with what > the actual bunsen parsers read. That is essentially how/why I wrote summarize.py. > > Any other ideas how we might want to do this? If this kind of ongoing sanity checking were valuable -- comparing final .sum "# of FOOBAR" counts from dejagnu to parser output data, then the parser could do that itself every time it runs, as a confirmatory self-check. > [...] > The one obvious missing bit is being able to easily invoke tests. Right now, > I just rely on "python3 -m pytest tests" to run all tests. Maybe a makefile > or shell script to do this would be appropriate. In the fche/bunsenql branch, there is now autoconf/automake machinery that lets you run "configure; make; make check" and run the bulk of your test in the automake style. - FChE