[PATCH] Add full roster of fedora/rhel/centos-stream stap workers and builders

[PATCH] Add full roster of fedora/rhel/centos-stream stap workers and builders

[Serhei Makarov]

The full set of buildbots will take a bit more time to bring up,
but I'm sending them in one patch now for simplicity's sake.
---
 buildbot.config.sample |   7 +++
 builder/master.cfg     | 130 ++++++++++++++++++++++++++++++++++++++++-
 2 files changed, 134 insertions(+), 3 deletions(-)

diff --git a/buildbot.config.sample b/buildbot.config.sample
index 10ff37c..1f6304d 100644
--- a/buildbot.config.sample
+++ b/buildbot.config.sample
@@ -33,6 +33,13 @@ starfive-2=frob
 starfive-3=frob
 starfive-4=frob
 stap-fedrawhide-x86_64=frob
+stap-fedora41-x86_64=frob
+stap-fedora40-x86_64=frob
+stap-fedora39-x86_64=frob
+stap-rhel9-x86_64=frob
+stap-rhel8-x86_64=frob
+stap-c10s-x86_64=frob
+stap-c9s-x86_64=frob

 # Users
 bb_admin=frob
diff --git a/builder/master.cfg b/builder/master.cfg
index b952922..22102b5 100644
--- a/builder/master.cfg
+++ b/builder/master.cfg
@@ -177,7 +177,8 @@ fedrawhide_x86_64_worker = worker.Worker("fedrawhide-x86_64",
                                     notify_on_missing=['fche@elastic.org']);
 c['workers'].append(fedrawhide_x86_64_worker)

-# fedrawhide worker exclusively for privileged systemtap testing
+# workers exclusively for privileged systemtap testing
+
 fedrawhide_x86_64_systemtap_privileged_worker = worker.Worker(
         "stap-fedrawhide-x86_64",
         getpw("stap-fedrawhide-x86_64"),
@@ -186,6 +187,63 @@ fedrawhide_x86_64_systemtap_privileged_worker = worker.Worker(
         notify_on_missing=['smakarov@redhat.com'])
 c['workers'].append(fedrawhide_x86_64_systemtap_privileged_worker)

+fedora41_x86_64_systemtap_privileged_worker = worker.Worker(
+        "stap-fedora41-x86_64",
+        getpw("stap-fedora41-x86_64"),
+        max_builds=1,
+        properties={'ncpus': 2, 'maxcpus': 2},
+        notify_on_missing=['smakarov@redhat.com'])
+c['workers'].append(fedora41_x86_64_systemtap_privileged_worker)
+
+fedora40_x86_64_systemtap_privileged_worker = worker.Worker(
+        "stap-fedora40-x86_64",
+        getpw("stap-fedora40-x86_64"),
+        max_builds=1,
+        properties={'ncpus': 2, 'maxcpus': 2},
+        notify_on_missing=['smakarov@redhat.com'])
+c['workers'].append(fedora40_x86_64_systemtap_privileged_worker)
+
+fedora39_x86_64_systemtap_privileged_worker = worker.Worker(
+        "stap-fedora39-x86_64",
+        getpw("stap-fedora39-x86_64"),
+        max_builds=1,
+        properties={'ncpus': 2, 'maxcpus': 2},
+        notify_on_missing=['smakarov@redhat.com'])
+c['workers'].append(fedora39_x86_64_systemtap_privileged_worker)
+
+rhel9_x86_64_systemtap_privileged_worker = worker.Worker(
+        "stap-rhel9-x86_64",
+        getpw("stap-rhel9-x86_64"),
+        max_builds=1,
+        properties={'ncpus': 2, 'maxcpus': 2},
+        notify_on_missing=['smakarov@redhat.com'])
+c['workers'].append(rhel9_x86_64_systemtap_privileged_worker)
+
+rhel8_x86_64_systemtap_privileged_worker = worker.Worker(
+        "stap-rhel8-x86_64",
+        getpw("stap-rhel8-x86_64"),
+        max_builds=1,
+        properties={'ncpus': 2, 'maxcpus': 2},
+        notify_on_missing=['smakarov@redhat.com'])
+c['workers'].append(rhel8_x86_64_systemtap_privileged_worker)
+
+c10s_x86_64_systemtap_privileged_worker = worker.Worker(
+        "stap-c10s-x86_64",
+        getpw("stap-c10s-x86_64"),
+        max_builds=1,
+        properties={'ncpus': 2, 'maxcpus': 2},
+        notify_on_missing=['smakarov@redhat.com'])
+c['workers'].append(c10s_x86_64_systemtap_privileged_worker)
+
+c9s_x86_64_systemtap_privileged_worker = worker.Worker(
+        "stap-c9s-x86_64",
+        getpw("stap-c9s-x86_64"),
+        max_builds=1,
+        properties={'ncpus': 2, 'maxcpus': 2},
+        notify_on_missing=['smakarov@redhat.com'])
+c['workers'].append(c9s_x86_64_systemtap_privileged_worker)
+
+
 # 2 gentoo sparc workers, running on the same machine in different
 # containers. The big one does only one build at a time. Larger builds
 # are only put on the big worker to not hold up quicker/smaller builds.
@@ -1000,17 +1058,27 @@ systemtap_scheduler2 = schedulers.Nightly(
         dayOfWeek=0, hour=0, minute=0) # monday morning midnight
 c['schedulers'].append(systemtap_scheduler2)

+systemtap_privileged_buildernames = [
+        "stap-fedrawhide-x86_64",
+        "stap-fedora41-x86_64",
+        "stap-fedora40-x86_64",
+        "stap-fedora39-x86_64",
+        "stap-rhel9-x86_64",
+        "stap-rhel8-x86_64",
+        "stap-c10s-x86_64",
+        "stap-c9s-x86_64"]
+
 systemtap_privileged_scheduler = schedulers.SingleBranchScheduler(
         name="systemtap privileged",
         change_filter=util.ChangeFilter(project="systemtap",
                                         branch="master"),
         reason="systemtap project master branch update",
-        builderNames=["stap-fedrawhide-x86_64"])
+        builderNames=systemtap_privileged_buildernames)
 c['schedulers'].append(systemtap_privileged_scheduler)

 systemtap_privileged_scheduler2 = schedulers.Nightly(
         name='weekly systemtap privileged rebuild',
-        builderNames=["stap-fedrawhide-x86_64"],
+        builderNames=systemtap_privileged_buildernames,
         dayOfWeek=0, hour=0, minute=0) # monday morning midnight
 c['schedulers'].append(systemtap_privileged_scheduler2)

@@ -4692,6 +4760,62 @@ systemtap_fedrawhide_x86_64_privileged_builder = util.BuilderConfig(
         factory=systemtap_privileged_factory)
 c['builders'].append(systemtap_fedrawhide_x86_64_privileged_builder)

+systemtap_fedora41_x86_64_privileged_builder = util.BuilderConfig(
+        name="stap-fedora41-x86_64",
+        collapseRequests=True,
+        workernames=["stap-fedora41-x86_64"],
+        tags=["systemtap", "fedora", "x86_64"],
+        factory=systemtap_privileged_factory)
+c['builders'].append(systemtap_fedora41_x86_64_privileged_builder)
+
+systemtap_fedora40_x86_64_privileged_builder = util.BuilderConfig(
+        name="stap-fedora40-x86_64",
+        collapseRequests=True,
+        workernames=["stap-fedora40-x86_64"],
+        tags=["systemtap", "fedora", "x86_64"],
+        factory=systemtap_privileged_factory)
+c['builders'].append(systemtap_fedora40_x86_64_privileged_builder)
+
+systemtap_fedora39_x86_64_privileged_builder = util.BuilderConfig(
+        name="stap-fedora39-x86_64",
+        collapseRequests=True,
+        workernames=["stap-fedora39-x86_64"],
+        tags=["systemtap", "fedora", "x86_64"],
+        factory=systemtap_privileged_factory)
+c['builders'].append(systemtap_fedora39_x86_64_privileged_builder)
+
+systemtap_rhel9_x86_64_privileged_builder = util.BuilderConfig(
+        name="stap-rhel9-x86_64",
+        collapseRequests=True,
+        workernames=["stap-rhel9-x86_64"],
+        tags=["systemtap", "fedora", "x86_64"],
+        factory=systemtap_privileged_factory)
+c['builders'].append(systemtap_rhel9_x86_64_privileged_builder)
+
+systemtap_rhel8_x86_64_privileged_builder = util.BuilderConfig(
+        name="stap-rhel8-x86_64",
+        collapseRequests=True,
+        workernames=["stap-rhel8-x86_64"],
+        tags=["systemtap", "fedora", "x86_64"],
+        factory=systemtap_privileged_factory)
+c['builders'].append(systemtap_rhel8_x86_64_privileged_builder)
+
+systemtap_c10s_x86_64_privileged_builder = util.BuilderConfig(
+        name="stap-c10s-x86_64",
+        collapseRequests=True,
+        workernames=["stap-c10s-x86_64"],
+        tags=["systemtap", "fedora", "x86_64"],
+        factory=systemtap_privileged_factory)
+c['builders'].append(systemtap_c10s_x86_64_privileged_builder)
+
+systemtap_c9s_x86_64_privileged_builder = util.BuilderConfig(
+        name="stap-c9s-x86_64",
+        collapseRequests=True,
+        workernames=["stap-c9s-x86_64"],
+        tags=["systemtap", "fedora", "x86_64"],
+        factory=systemtap_privileged_factory)
+c['builders'].append(systemtap_c9s_x86_64_privileged_builder)
+

 # GNU poke builders and factories

--
2.43.0

Re: [PATCH] Add full roster of fedora/rhel/centos-stream stap workers and builders

[Frank Ch. Eigler]

Hi -

> The full set of buildbots will take a bit more time to bring up,
> but I'm sending them in one patch now for simplicity's sake.

Thanks, pushed (with tiny tweaks to the tags).

- FChE

Re: [PATCH] Add full roster of fedora/rhel/centos-stream stap workers and builders

[Serhei Makarov]

On Tue, Apr 23, 2024, at 5:12 PM, Frank Ch. Eigler wrote:
> Thanks, pushed (with tiny tweaks to the tags).
Oh, whoops. Thanks for the catch!
My mistake for grepping things like "fedrawhide" while skimming over that field.

Re: [PATCH] Add full roster of fedora/rhel/centos-stream stap workers and builders

[Mark Wielaard]

Hi Serhei,

On Tue, Apr 23, 2024 at 04:56:58PM -0400, Serhei Makarov wrote:
> The full set of buildbots will take a bit more time to bring up,
> but I'm sending them in one patch now for simplicity's sake.
> ---
>  buildbot.config.sample |   7 +++
>  builder/master.cfg     | 130 ++++++++++++++++++++++++++++++++++++++++-
>  2 files changed, 134 insertions(+), 3 deletions(-)
> 
> diff --git a/buildbot.config.sample b/buildbot.config.sample
> index 10ff37c..1f6304d 100644
> --- a/buildbot.config.sample
> +++ b/buildbot.config.sample
> @@ -33,6 +33,13 @@ starfive-2=frob
>  starfive-3=frob
>  starfive-4=frob
>  stap-fedrawhide-x86_64=frob
> +stap-fedora41-x86_64=frob
> +stap-fedora40-x86_64=frob
> +stap-fedora39-x86_64=frob

So 41 is current rawhide, 40 is the latest stable fedora release and
39 is old stable. Would it make sense to name "rawhide",
"fedora-latest" and "fedora-old-stable" or something like that? Then
you don't have to rename them every few months.

The x86_64 containers are called debian-stable, debian-testing,
fedora-rawhide and fedora-latest.

Cheers,

Mark

Re: [PATCH] Add full roster of fedora/rhel/centos-stream stap workers and builders

[Frank Ch. Eigler]

Hi -

> [...] Would it make sense to name "rawhide", "fedora-latest" and
> "fedora-old-stable" or something like that? Then you don't have to
> rename them every few months. [...]

I was thinking about that too.  OTOH:

- Only downside seemed to be 6-monthly new worker additions
- I couldn't think of any other downside in terms of storage or UI
- This lets us keep these older workers as long as we like.  (Heck,
  I'm still interested in fedora 30, which is the last one that had
  a 32-bit i686 kernel.)

- FChE

Re: [PATCH] Add full roster of fedora/rhel/centos-stream stap workers and builders

[Serhei Makarov]

On Tue, Apr 23, 2024, at 5:24 PM, Frank Ch. Eigler wrote:
> Hi -
>
>> [...] Would it make sense to name "rawhide", "fedora-latest" and
>> "fedora-old-stable" or something like that? Then you don't have to
>> rename them every few months. [...]
>
> I was thinking about that too.  OTOH:
>
> - Only downside seemed to be 6-monthly new worker additions
> - I couldn't think of any other downside in terms of storage or UI
> - This lets us keep these older workers as long as we like.  (Heck,
>   I'm still interested in fedora 30, which is the last one that had
>   a 32-bit i686 kernel.)

Another option I was pondering on orthogonal lines 
was workers that run an upstream kernel that can be rebuilt
and rebooted with older / newer versions as needed for particular
testsuite runs.

This is needed to make any kind of retrospective testing work properly
(since older versions of systemtap can only work with older kernels).
Though I might stick to experimenting with that on the non-public
buildbots.

Re: [PATCH] Add full roster of fedora/rhel/centos-stream stap workers and builders

[Mark Wielaard]

Hi Frank,

On Tue, Apr 23, 2024 at 05:24:06PM -0400, Frank Ch. Eigler wrote:
> > [...] Would it make sense to name "rawhide", "fedora-latest" and
> > "fedora-old-stable" or something like that? Then you don't have to
> > rename them every few months. [...]
> 
> I was thinking about that too.  OTOH:
> 
> - Only downside seemed to be 6-monthly new worker additions
> - I couldn't think of any other downside in terms of storage or UI

The friction is low, but if we can avoid unnecessary churn that would
be good imho.

> - This lets us keep these older workers as long as we like.  (Heck,
>   I'm still interested in fedora 30, which is the last one that had
>   a 32-bit i686 kernel.)

I don't think it makes much sense to try to support retired distros
that don't see any (security) updates anymore. There are debian-i386
workers.

Cheers,

Mark