From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from wfout2-smtp.messagingengine.com (wfout2-smtp.messagingengine.com [64.147.123.145]) by sourceware.org (Postfix) with ESMTPS id 3E7C5385840F; Wed, 17 Apr 2024 14:54:46 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org 3E7C5385840F Authentication-Results: sourceware.org; dmarc=none (p=none dis=none) header.from=serhei.io Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=serhei.io ARC-Filter: OpenARC Filter v1.0.0 sourceware.org 3E7C5385840F Authentication-Results: server2.sourceware.org; arc=none smtp.remote-ip=64.147.123.145 ARC-Seal: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1713365688; cv=none; b=a/XrwvLU/an2X6zBS+Z+OY8BPAYCw/igV8tAyalHxhMqq5QR1uDZrmjqrhVbJxhbJ9lScUnuKAL7/FwN1QK5B3SD88Vgs+abxHkQHNzDFt9gwDPP0/G2c2h9TqgX6qNJesIPR0OnVV6PSK2n5HS6QcYXItrOBIQL9CPdH50Kd+8= ARC-Message-Signature: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1713365688; c=relaxed/simple; bh=NUmcEukkxMAcZ83CyGrKx9HLAHFyLlzs/B5+BqOI3O0=; h=DKIM-Signature:DKIM-Signature:MIME-Version:Message-Id:Date:From: To:Subject; b=M6akGq8edvTMX3ol+L+HjN/MKVymAvzrZMODSwABqyIdI4Le3ggmX0qE1TTSOjdI0UDu97i/1qXa3xXROaAKkwxaDI9oZLoZ4E7Xgob9fGC9quwkMe0sJyberB9ps2vdF1lFELFbjE8YFaj5Hw29VPhM9AU4Ge8DhxTYcA9AGuo= ARC-Authentication-Results: i=1; server2.sourceware.org Received: from compute1.internal (compute1.nyi.internal [10.202.2.41]) by mailfout.west.internal (Postfix) with ESMTP id 73B0D1C00096; Wed, 17 Apr 2024 10:54:43 -0400 (EDT) Received: from imap50 ([10.202.2.100]) by compute1.internal (MEProxy); Wed, 17 Apr 2024 10:54:43 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=serhei.io; h=cc :cc:content-type:content-type:date:date:from:from:in-reply-to :message-id:mime-version:reply-to:subject:subject:to:to; s=fm3; t=1713365682; x=1713452082; bh=5e0YorJwz4yX0K4QgCcJRyEuveVFW23y 5guum6KKf/0=; b=n3dod2TjWm8eCEyFgggXn1eh2pqng+Lz0WvNaAaD6eSYD6V3 +RoWQxY7RoVEnGEKmmybsoyYm8yfMWChLUcYgUQTR8F8K7hfZ/aNpSQserxlBGxt LUvn1+NLky/Y0d4AvtscrPqDfWaHd1q1pJdATDt6QQmbfNZyOFFjc6Ak8DLxiOjq +dTzC3HF4/xS/+AsSDinGSEsbPifXbnh00sOA6P/nSWQghAnIY03LeHa9uxHqZ2i 2zXNkRzCu06cIZdifw9YP+06+KAROu9xhEGwkH5wbw6oJz+GEYeBYqVutDzJkBpl f9Erx5T7cWjZAEme/wbuOK6HG/r2vE72AnVJXA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:message-id :mime-version:reply-to:subject:subject:to:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm3; t= 1713365682; x=1713452082; bh=5e0YorJwz4yX0K4QgCcJRyEuveVFW23y5gu um6KKf/0=; b=CY7/NlV1VJMVvmIDI02OrUivw3ehHSoi7k3nk4MW2KSYlk+sGoX AQZ/PID94mLFuTEs+KG9JwtneyMjlSiMUYxyVNfcKg8kGhxB5bnLs5SOQkxYLNEZ Nh67mSg4+N6Sp26E9sxTlEZ+Em+ImwnVBc3UuH8Y6yUUM5MGnJFs9oe5nn3Ctu6p zSVRmcSUz/ajpu1uYX7VFfAAFrJcRLLdUKIjoy5JNtP+gmPkGMhkPdvc0nfjYpfj BCjZZ2ofSksfjg8DtZcf5tUKYqrz5PERclbKHC+iu3GrA+URBZpmgOq3JCZbm8og tC2kJwtfYc68+xURHRPDuPEOCQRdQJ8OmpQ== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvledrudejkedgkedvucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefofgggkfffhffvvefutgesthdtre dtreertdenucfhrhhomhepfdfuvghrhhgvihcuofgrkhgrrhhovhdfuceoshgvrhhhvghi sehsvghrhhgvihdrihhoqeenucggtffrrghtthgvrhhnpeegudejteetfefgieefuefhfe ejvdekueeihffftdehueetveevuefgkeeijeefhfenucffohhmrghinhepvghlfhhuthhi lhhsrdhorhhgnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrh homhepshgvrhhhvghisehsvghrhhgvihdrihho X-ME-Proxy: Feedback-ID: i572946fc:Fastmail Received: by mailuser.nyi.internal (Postfix, from userid 501) id A5E9C1700093; Wed, 17 Apr 2024 10:54:42 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface User-Agent: Cyrus-JMAP/3.11.0-alpha0-379-gabd37849b7-fm-20240408.001-gabd37849 MIME-Version: 1.0 Message-Id: <7f6e756d-3e47-476f-b997-50b4960b837d@app.fastmail.com> Date: Wed, 17 Apr 2024 10:54:22 -0400 From: "Serhei Makarov" To: buildbot@sourceware.org Cc: "Frank Ch. Eigler" , systemtap Subject: [PATCH] Add systemtap privileged fedrawhide worker and builder Content-Type: text/plain X-Spam-Status: No, score=-10.5 required=5.0 tests=BAYES_00,DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,GIT_PATCH_0,JMQ_SPF_NEUTRAL,RCVD_IN_DNSWL_LOW,SPF_HELO_NONE,SPF_PASS,TXREP,URIBL_SBL_A autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org List-Id: Hello, I'd like to commit the following patch (or something similar) to the sourceware builder config and get a buildbot vm hooked up, so we can start taking our SystemTap buildbots and test results public. As one of the steps, could I have a worker pw for 'systemtap-fedrawhide-x86_64-privileged'? All the best, Serhei Makarov --- This is an initial commit to see how well my SystemTap buildbots would work with the Sourceware builder infrastructure and public bunsen instance. If all goes well, it will be possible to expand the public testing setup to cover multiple distros and architectures. The fedrawhide worker is an exclusive vm for full-privileged systemtap testing (hence other builder runs should not be scheduled on it). --- builder/master.cfg | 85 ++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 85 insertions(+) diff --git a/builder/master.cfg b/builder/master.cfg index b53e56f..4f8fd2b 100644 --- a/builder/master.cfg +++ b/builder/master.cfg @@ -177,6 +177,15 @@ fedrawhide_x86_64_worker = worker.Worker("fedrawhide-x86_64", notify_on_missing=['fche@elastic.org']); c['workers'].append(fedrawhide_x86_64_worker) +# fedrawhide worker exclusively for privileged systemtap testing +fedrawhide_x86_64_systemtap_privileged_worker = worker.Worker( + "fedrawhide-x86_64-systemtap-privileged", + getpw("fedrawhide-x86_64-systemtap-privileged"), + max_builds=1, + properties={'ncpus': 2, 'maxcpus': 2}, + notify_on_missing=['smakarov@redhat.com']) +c['workers'].append(fedrawhide_x86_64_systemtap_privileged_worker) + # 2 gentoo sparc workers, running on the same machine in different # containers. The big one does only one build at a time. Larger builds # are only put on the big worker to not hold up quicker/smaller builds. @@ -998,6 +1007,20 @@ systemtap_scheduler2 = schedulers.Nightly( dayOfWeek=0, hour=0, minute=0) # monday morning midnight c['schedulers'].append(systemtap_scheduler2) +systemtap_privileged_scheduler = schedulers.SingleBranchScheduler( + name="systemtap privileged", + change_filter=util.ChangeFilter(project="systemtap", + branch="master"), + reason="systemtap project master branch update", + builderNames=["systemtap-fedrawhide-x86_64-privileged"]) +c['schedulers'].append(systemtap_privileged_scheduler) + +systemtap_privileged_scheduler2 = schedulers.Nightly( + name='weekly systemtap privileged rebuild', + builderNames=["systemtap-fedrawhide-x86_64-privileged"], + dayOfWeek=0, hour=0, minute=0) # monday morning midnight +c['schedulers'].append(systemtap_privileged_scheduler2) + # Quick build only scheduler gcc_build_scheduler = schedulers.SingleBranchScheduler( name="gcc-build", @@ -4614,6 +4637,68 @@ systemtap_gentoo_sparc_builder = util.BuilderConfig( factory=systemtap_factory) c['builders'].append(systemtap_gentoo_sparc_builder) + +# caution: runs systemtap testsuite with full-privileges +systemtap_scripts_path = "/opt/worker-scripts/" +systemtap_privileged_factory = util.BuildFactory() +systemtap_privileged_factory.addStep(steps.Git( + repourl=systemtap_repourl, + workdir='systemtap', + mode='full', method='fresh', + retryFetch=True, retry=(30,3), + getDescription={'tags':True, 'always':True}, + name="git checkout", + haltOnFailure=True)) +systemtap_privileged_factory.append(steps.ShellCommand( + command=["rm", "-rf", + util.Interpolate ("%(prop:builddir)s/stap-build")], + name="rm -rf stap-build", + haltOnFailure=True)) +systemtap_privileged_factory.append(steps.ShellCommand( + workdir='stap-build', + command=[systemtap_scripts_path+"stap-test-prepare.sh"], + name='check kernel version + prepare testing scripts', + haltOnFailure=False, flunkOnFailure=False)) # some failures are normal for stap +systemtap_privileged_factory.append(steps.Configure( + workdir="stap-build", + command=["../systemtap/configure", util.Interpolate ("--prefix=%(prop:builddir)s/stap-build/INST")], + name="configure", + haltOnFailure=True, + logfiles={"config.log": "config.log"})) +systemtap_privileged_factory.append(steps.Compile( + workdir='stap-build', + command=addOutputSync.withArgs(['make', 'V=1']), + name='make', + haltOnFailure=True)) +systemtap_privileged_factory.append(steps.Compile( + workdir='stap-build', + command=['make', 'V=1', 'install'], + name='make install', + haltOnFailure=True)) +systemtap_privileged_factory.append(steps.Test( + workdir='stap-build', + #command=['env', 'DEBUGINFOD_URLS=https://debuginfod.elfutils.org/', 'make', 'V=1', 'installcheck'], # this is the full, privileged testsuite + command=[systemtap_scripts_path+"stap-test.sh"], # this is the full, privileged testsuite with dmesg collection + name='make installcheck', + haltOnFailure=False, flunkOnFailure=False)) # some failures are normal for stap +systemtap_privileged_factory.append(steps.ShellCommand( + workdir="stap-build", + command=["rm", "-rf", "testsuite/.systemtap-buildbot/cache"], # ugly hardcoding bot username :-( + name="cleanup caches", + haltOnFailure=True)) +systemtap_privileged_factory.addSteps(bunsen_logfile_upload_cpio_steps( + ["*.sum", "*.log", "*.dmesg"], + workdir="stap-build")) + +systemtap_fedrawhide_x86_64_privileged_builder = util.BuilderConfig( + name="systemtap-fedrawhide-x86_64-privileged", + collapseRequests=True, + workernames=["fedrawhide-x86_64-systemtap-privileged"], + tags=["systemtap", "fedora", "x86_64"], + factory=systemtap_privileged_factory) +c['builders'].append(systemtap_fedrawhide_x86_64_privileged_builder) + + # GNU poke builders and factories # publish file based on branch name, cut away all but last / element -- 2.43.0