From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from gnu.wildebeest.org (gnu.wildebeest.org [45.83.234.184]) by sourceware.org (Postfix) with ESMTPS id 95B92384F027; Fri, 13 May 2022 08:21:19 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.1 sourceware.org 95B92384F027 Authentication-Results: sourceware.org; dmarc=none (p=none dis=none) header.from=klomp.org Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=klomp.org Received: from tarox.wildebeest.org (83-87-18-245.cable.dynamic.v4.ziggo.nl [83.87.18.245]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by gnu.wildebeest.org (Postfix) with ESMTPSA id 41ABD3000599; Fri, 13 May 2022 10:21:18 +0200 (CEST) Received: by tarox.wildebeest.org (Postfix, from userid 1000) id 7F48C400E91A; Fri, 13 May 2022 10:21:16 +0200 (CEST) Message-ID: <6ee4c888c35b58b48ddb3c5fac21a99a439cbad9.camel@klomp.org> Subject: Re: gdb builder status (Was: Adding binutils to the GNU Toolchain buildbot on sourceware) From: Mark Wielaard To: "gdb@sourceware.org" Cc: Overseers mailing list , Thomas Fitzsimmons , Dan =?ISO-8859-1?Q?Hor=E1k?= , "Frank Ch. Eigler" Date: Fri, 13 May 2022 10:21:16 +0200 In-Reply-To: <20220429200422.GB7305@gnu.wildebeest.org> References: <5c1f217a-109c-2973-6c69-abf412133dee@arm.com> <524b04b7-a78c-7aae-4605-b40f61e6830c@arm.com> <16fe426d-c436-f030-dc43-0e81e7f0e853@arm.com> <20220428141957.GB23335@gnu.wildebeest.org> <20220428162803.GD23335@gnu.wildebeest.org> <20220429200422.GB7305@gnu.wildebeest.org> Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Mailer: Evolution 3.28.5 (3.28.5-10.el7) Mime-Version: 1.0 X-Spam-Status: No, score=-3.7 required=5.0 tests=BAYES_00, JMQ_SPF_NEUTRAL, KAM_DMARC_STATUS, SPF_HELO_NONE, SPF_PASS, TXREP, T_SCC_BODY_TEXT_LINE autolearn=no autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org X-BeenThere: gdb@sourceware.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Gdb mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 May 2022 08:21:21 -0000 Hi gdb hackers, On Fri, 2022-04-29 at 22:04 +0200, Mark Wielaard wrote: > https://builder.sourceware.org now has 6 build only builders. > centos-x86_64, fedora-x86_64, debian-armhf, debian-arm64, fedora-s390x an= d debian-ppc64. > I like to add a fedora-ppc64le one once that one has enough disk space. >=20 > These builders are fairly quick, a few minutes at most. And all except > the fedora-s390x one build fine. They should sent email once a new > failure occurs. > [...] > There is also one build and check everything builder > https://builder.sourceware.org/buildbot/#/builders/binutils-gdb-fedrawhid= e-x86_64 > I haven't looked at the test results yet, but they are all stored in > the bunsendb.git for later analysis. This builder doesn't sent emails > on bad builds. >=20 > One issue with the build-check-everything builder might be the widely > varying build times which range from 1 to 7 hours. There are now 7 "quick" CI builders: https://builder.sourceware.org/buildbot/#/builders?tags=3Dgdb gdb-fedora-ppc64le has been added, which failed to compile at first, but that has been fixed now. Also it does a very minimal make gdb-check=20 now: # Only a small subset of tests that are fast and known to PASS. gdb_factory.addStep(steps.Test( workdir=3D'gdb-build', command=3D['make', util.Interpolate('-j%(prop:ncpus)s'), 'check-gdb', ("TESTS=3D " "gdb.gdb/selftest.exp " "gdb.gdb/unittest.exp " "gdb.server/unittest.exp ")], name=3D'make check-gdb', logfiles=3D{ "gdb.sum": "gdb/testsuite/gdb.sum", "gdb.log": "gdb/testsuite/gdb.log" }, haltOnFailure=3DTrue)) There was some skepticism on irc that this could ever be expanded to a set of tests that was really useful. But I am keeping some hope. And even the compile only part already caught bad commits, so I do think it is useful. My goal is to turn these builders into try-builders at some point so people can submit patches and see they at least pass a compile and test for a reasonable (fast) subset without having to go through known failing or flaky testcases. Also Frank seems to have gotten a handle on the widely varying full tests builds. They seem to take about ~1 hour each now. And he added a full "clang" builder so you can more easily compare test results with an alternative compiler: https://builder.sourceware.org/buildbot/#/builders/binutils-gdb-fedrawhide-= x86_64 https://builder.sourceware.org/buildbot/#/builders/binutils-gdb-clang-fedra= whide-x86_64 The sum and log files are put into the bunsendb.git repository. Only the stdio output is available in the builder itself for now. Cheers, Mark