From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from gnu.wildebeest.org (gnu.wildebeest.org [45.83.234.184]) by sourceware.org (Postfix) with ESMTPS id 16B7F3858429 for ; Thu, 11 Aug 2022 20:39:57 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.1 sourceware.org 16B7F3858429 Authentication-Results: sourceware.org; dmarc=none (p=none dis=none) header.from=klomp.org Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=klomp.org Received: by gnu.wildebeest.org (Postfix, from userid 1000) id 38C1230012BF; Thu, 11 Aug 2022 22:39:56 +0200 (CEST) Date: Thu, 11 Aug 2022 22:39:56 +0200 From: Mark Wielaard To: Christophe Lyon Cc: buildbot@sourceware.org Subject: Re: Arm GCC buildbot workers Message-ID: <20220811203956.GE5520@gnu.wildebeest.org> References: <84fe482f-0b5e-face-9a7a-bb04ac162686@arm.com> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="FL5UXtIhxfXey3p5" Content-Disposition: inline In-Reply-To: <84fe482f-0b5e-face-9a7a-bb04ac162686@arm.com> User-Agent: Mutt/1.5.21 (2010-09-15) X-Spam-Status: No, score=-11.3 required=5.0 tests=BAYES_00, GIT_PATCH_0, JMQ_SPF_NEUTRAL, KAM_DMARC_STATUS, SPF_HELO_NONE, SPF_PASS, TXREP, T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org X-BeenThere: buildbot@sourceware.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "The https://builder.sourceware.org/ buildbot" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Aug 2022 20:40:02 -0000 --FL5UXtIhxfXey3p5 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Hi Christophe, On Thu, Aug 11, 2022 at 09:54:35AM +0200, Christophe Lyon wrote: > I'd like to start 2 more workers, for GCC: one for armhf, one for arm64. > They will be running ubuntu-22.04, 20 CPUs each. > > So: > ncpus:20 > maxcpus:20 > max_builds:1 > > I'd like them to run "gcc_full", which should take ~2h according to my > experiments. Cool. I did add a "gcc-full" build for x86_64 last week to use one of the workers that has 12 or 16 cores. It takes ~50 to ~140 minutes depending on which worker it picks and the other load on the machine. When a build takes this long you cannot really test each commit separately. 12 patches and you have a whole day of building. So you either only build periodically, or you collapse the pending build requests. The existing gcc-full builders collapse the builds. So I'll suggest these new builders do too, but let me know if you rather have them try a build only periodically (say every 8 hours?) > Looking at https://builder.sourceware.org/buildbot/#/workers, I suspect > there may be at least a naming problem since the other workers have > "generic names" (I mean we already have similar workers, dedicated to gdb). > > BTW, I'm wondering whether it was a mistake to have our other workers > named armXX-ubuntu-YY, since the other ones are named distro-arch? Naming isn't 100% consistent, and it doesn't really matter much for worker names. It does matter a little for the builder names, sadly those also aren't fully consistent. But as long as we are somewhat consitent in the tag names hopefully people can still sort interesting builds together. Renaming the workers would mean changing them on both sides, so lets stick with the original names for now. Then we can name these the other way around: ubuntu22_04-arm64 ubuntu22_04-armhf See the attached patch. Cheers, Mark --FL5UXtIhxfXey3p5 Content-Type: text/plain; charset=us-ascii Content-Disposition: attachment; filename="0001-Add-ubuntu22_04-arm64-and-ubuntu22_04-armhf-workers-.patch" >From 5b16ab1d7a8e0fbc3ec2218a6087ad292dba41dd Mon Sep 17 00:00:00 2001 From: Mark Wielaard Date: Thu, 11 Aug 2022 22:36:42 +0200 Subject: [PATCH] Add ubuntu22_04-arm64 and ubuntu22_04-armhf workers for gcc Two more workers from the Works on Arm initiative to do full gcc builds (bootstrap plus make check). --- buildbot.config.sample | 2 ++ builder/master.cfg | 39 ++++++++++++++++++++++++++++++++++++++- htdocs/index.html.post | 4 ++-- 3 files changed, 42 insertions(+), 3 deletions(-) diff --git a/buildbot.config.sample b/buildbot.config.sample index b4c3f11..7986c6a 100644 --- a/buildbot.config.sample +++ b/buildbot.config.sample @@ -20,6 +20,8 @@ arm64-ubuntu20_04=frob arm64-ubuntu22_04=frob armhf-ubuntu20_04=frob armhf-ubuntu22_04=frob +ubuntu22_04-arm64=frob +ubuntu22_04-armhf=frob fedora-arm64=frob # Users diff --git a/builder/master.cfg b/builder/master.cfg index 55f8d3b..f945b14 100644 --- a/builder/master.cfg +++ b/builder/master.cfg @@ -241,6 +241,8 @@ ibm_power10_worker = worker.Worker("ibm_power10", 'cel@us.ibm.com']); c['workers'].append(ibm_power10_worker) +# Various arm64/armhf workers provided by the Works on Arm initiative +# 4 used for gdb arm64_ubuntu20_04_worker = worker.Worker("arm64-ubuntu20_04", getpw("arm64-ubuntu20_04"), max_builds=1, @@ -269,6 +271,23 @@ armhf_ubuntu22_04_worker = worker.Worker("armhf-ubuntu22_04", notify_on_missing=['christophe.lyon@arm.com']); c['workers'].append(armhf_ubuntu22_04_worker) +# 2 used for gcc +ubuntu20_04_armhf_worker = worker.Worker("ubuntu22_04-armhf", + getpw("ubuntu22_04-armhf"), + properties={'ncpus': 20, + 'maxcpus': 20}, + max_builds=1, + notify_on_missing=['christophe.lyon@arm.com']); +c['workers'].append(ubuntu20_04_armhf_worker) + +ubuntu20_04_arm64_worker = worker.Worker("ubuntu22_04-arm64", + getpw("ubuntu22_04-arm64"), + properties={'ncpus': 20, + 'maxcpus': 20}, + max_builds=1, + notify_on_missing=['christophe.lyon@arm.com']); +c['workers'].append(ubuntu20_04_arm64_worker) + # 8 core arm64 server hosted by osuosl fedora_arm64_worker = worker.Worker("fedora-arm64", getpw("fedora-arm64"), @@ -788,7 +807,9 @@ gcc_scheduler = schedulers.SingleBranchScheduler( branch="master"), reason="gcc project master branch update", builderNames=["gcc-fedrawhide-x86_64", - "gcc-full-debian-amd64"]) + "gcc-full-debian-amd64", + "gcc-full-ubuntu-armhf", + "gcc-full-ubuntu-arm64"]) c['schedulers'].append(gcc_scheduler) systemtap_scheduler = schedulers.SingleBranchScheduler( @@ -3002,6 +3023,22 @@ gcc_full_debian_amd64_builder = util.BuilderConfig( factory=gcc_full_build_factory) c['builders'].append(gcc_full_debian_amd64_builder) +gcc_full_ubuntu_armhf_builder = util.BuilderConfig( + name="gcc-full-ubuntu-armhf", + collapseRequests=True, + workernames=["ubuntu22_04-armhf"], + tags=["gcc-full", "ubuntu", "armhf"], + factory=gcc_full_build_factory) +c['builders'].append(gcc_full_ubuntu_armhf_builder) + +gcc_full_ubuntu_arm64_builder = util.BuilderConfig( + name="gcc-full-ubuntu-arm64", + collapseRequests=True, + workernames=["ubuntu22_04-arm64"], + tags=["gcc-full", "ubuntu", "arm64"], + factory=gcc_full_build_factory) +c['builders'].append(gcc_full_ubuntu_arm64_builder) + # glibc build steps, factory, builders diff --git a/htdocs/index.html.post b/htdocs/index.html.post index 56cf675..c9767c6 100644 --- a/htdocs/index.html.post +++ b/htdocs/index.html.post @@ -12,8 +12,8 @@
  • Frank Eigler for the fedrawhide-x86_64 worker
  • IBM for the ibm_power8, ibm_power9 and ibm_power10 workers
  • The Works on Arm initiative for the arm64-ubuntu20_04, - arm64-ubuntu22_04, armhf-ubuntu20_04 and - armhf-ubuntu22_04 workers
    • + arm64-ubuntu22_04, armhf-ubuntu20_04, armhf-ubuntu22_04 + ubuntu22_04-arm64 and ubuntu22_04-armhf workers
  • OSUOSL for the fedora-arm64 worker

    • -- 2.31.1 --FL5UXtIhxfXey3p5--