From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-ej1-x62d.google.com (mail-ej1-x62d.google.com [IPv6:2a00:1450:4864:20::62d]) by sourceware.org (Postfix) with ESMTPS id 25BB43858C2D for ; Tue, 16 Jan 2024 10:28:23 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org 25BB43858C2D Authentication-Results: sourceware.org; dmarc=pass (p=none dis=none) header.from=linaro.org Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=linaro.org ARC-Filter: OpenARC Filter v1.0.0 sourceware.org 25BB43858C2D Authentication-Results: server2.sourceware.org; arc=none smtp.remote-ip=2a00:1450:4864:20::62d ARC-Seal: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1705400906; cv=none; b=j2D/Vg9mxnNNJe/ITxQY1keCVNznDRQ3YKARnEnZqyObdvfuKKHSWAUGbTV/g5dtSoWqRN0gAZfbm90FkFTen8cP9DoQ87dsF2uVwIOTR1dzMnLu+Phki9ura9eftsK/2If9tGtcP8zVgbbuk3FbV4Are2zIEWB7W20tkoDQDC4= ARC-Message-Signature: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1705400906; c=relaxed/simple; bh=k7x5sKWEQBpPt8S1VDnWi8FGcaDhAgR/x9Fp5g4cZ1I=; h=DKIM-Signature:Mime-Version:Subject:From:Date:Message-Id:To; b=TsGUtyI1uaNYDSHQ/U+mR226JLpUQ1wNts5wTSRz9f+plM1K8I2AA9iZNBE6zvXZ7sfK5qazMQpmMA811apB7o9XNi+Opc63SxIlqvaRT1RvuaJDGtx0oOTBaed0tCjatZrVLOTi4Ro+Y6uSfm6vQKRQRFAyM+EEvLXNeA2XZDo= ARC-Authentication-Results: i=1; server2.sourceware.org Received: by mail-ej1-x62d.google.com with SMTP id a640c23a62f3a-a2bea904e72so151970866b.0 for ; Tue, 16 Jan 2024 02:28:23 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; t=1705400902; x=1706005702; darn=sourceware.org; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=Ow8Oi/hIBthzd9M0hWs9PtGMoQHyOytNQmwEjJ/nyeY=; b=iyLxk2sJArEhtUuD7c+Ed9gW9CnRuXn1I3RL58/6Czn47pfI7zhR7qW2jMRVXPmkVe qOD2QsAs54i+ot/SVwBG3k5gb+kj4rDnRkrDU6pgtKYy6Y8dIrzrx6vM3rQLeqepS4vm PYTMUiBtFNn1HDFHNgFkD6rlS6vMvkShNYMV9TQeUk4d3IgAGfchySIowyU/mUeuk+12 pLCUcadJVpFCoc2asE+qVZRxysKHjjqvHkymaewEcRy+waE+O6nSPwDVjC/uqmWP5cQx 0W1se3UQWTwFTq86emGFRkm3mLxSbhPCOwlbtVRvcCJt/GiJKpIHMrVJ2Zb64ljsWALP GSNg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1705400902; x=1706005702; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=Ow8Oi/hIBthzd9M0hWs9PtGMoQHyOytNQmwEjJ/nyeY=; b=mM7ngfT/sH7OuRB2O1bhFqlOPhzexMKqGFkUfvIMLqLrYulc/AfcvUADUmvz24LCIJ sc3dDSlWzcIVfOnN1qGY/GKBQ9qJYqSID8A7AFosUzR/RYF9/FlKsnxeG7MHw7hBH5zS HV9WdljfabtbXyNJfHvCg788XHk68wiCT/SAyc1XNXOLqdJfjntpXvJclaAC6UnjqPOJ 22zDymIbghHpjfDuNNDLJSov/2WvDnjRcj7X+BfL4t2mlO/Qs61kAoLeKiP9fajcl4ur ETy7MDsgZufKZjsNelaHVDZUq25hcUSPgg4ttjgi/+h0h+xneLizN3fG5+F9jU5zAPX8 XGRw== X-Gm-Message-State: AOJu0Ywf3Kb3LTl+n1y1s8bKMSkhrd1mk/aEyVzX86wYyWkSah792UvM YdJ/OYQcjGuSYnLq+/W2bcw4YeXAdIJlJRC7hVjJPyXQGw== X-Google-Smtp-Source: AGHT+IFkUeuCBr2ot300QLPZ4oRI1yjDg726wYn2bHw3qngh2fcpmNA5ZRP0sLjNze62VtnyZik5hA== X-Received: by 2002:a17:907:7f07:b0:a28:aa33:62a2 with SMTP id qf7-20020a1709077f0700b00a28aa3362a2mr9400109ejc.4.1705400901774; Tue, 16 Jan 2024 02:28:21 -0800 (PST) Received: from smtpclient.apple ([37.252.81.122]) by smtp.gmail.com with ESMTPSA id i2-20020a170906090200b00a2a04c9226asm6268900ejd.194.2024.01.16.02.28.20 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Tue, 16 Jan 2024 02:28:20 -0800 (PST) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.300.61.1.2\)) Subject: Re: bunsen to assist ci/cd testsuite historical analysis needs From: Maxim Kuvyrkov In-Reply-To: <20240111175140.GI28684@redhat.com> Date: Tue, 16 Jan 2024 14:28:09 +0400 Cc: bunsen@sourceware.org, Christophe Lyon Content-Transfer-Encoding: quoted-printable Message-Id: <7AE27BD9-5332-496D-9A32-C49383A039B3@linaro.org> References: <20231212185006.GA21248@redhat.com> <86711582-4DD8-46F4-824C-583CB19EA58D@linaro.org> <87wmsrjsdd.fsf@redhat.com> <20240104023400.GA17157@redhat.com> <20240111175140.GI28684@redhat.com> To: "Frank Ch. Eigler" X-Mailer: Apple Mail (2.3774.300.61.1.2) X-Spam-Status: No, score=-2.4 required=5.0 tests=BAYES_00,DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_BARRACUDACENTRAL,RCVD_IN_DNSWL_NONE,SPF_HELO_NONE,SPF_PASS,TXREP,T_SCC_BODY_TEXT_LINE autolearn=no autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org List-Id: > On Jan 11, 2024, at 21:51, Frank Ch. Eigler wrote: >=20 > Hi - >=20 >>> OK, will check that out. Is the git repo with results also visible = somewhere? >> [...] >> [2] = https://git.linaro.org/toolchain/ci/base-artifacts/tcwg_gcc_check/master-a= arch64.git/ >=20 > Just for reference, after a quick glance at this, it's close to but > not quite verbatim usable by bunsen: >=20 > - the .xz compression/extension would interfere with extension based > matching We can fix that. >=20 > - separating the .log and .sum files into different directories stops > bunsen's crossmatching of the two; bunsen can accept the build tree > raw locations of these files, without the "sumfiles" / "00-sumfiles" > type of reorg We partially re-run the testsuites when results change unexpectedly. = This allows us to detect and ignore flaky tests. 00-sumfiles/ is an = auxiliary directory that contains all run and re-run logs and .sum = files; sumfiles/ directory contains the final [synthetic] .sum files = that are a merge of all re-run .sum files. All this is to say that we = don't necessarily have the matching logs for the final [synthetic] .sum = files. What information do you extract from the .log files? >=20 > - for buildbot builds on sourceware, we collect & parse the autoconf > config.log files as first class content, rather than just informal > console logs We can gather config.log files. >=20 > - bunsen would love to receive metadata about the build in little > .bunsen.FOO text files, e.g. see: > = https://sourceware.org/git/?p=3Dbunsendb.git;a=3Dcommit;h=3D613dd3b381b091= 0ebd5036fcf42761e2cead12ee >=20 Ack. >=20 > I assume you had good reasons for .xz compressing these files inside > the git repo ... but for what it's worth, we find that letting normal > git-repack transparently manage all the compression of plain text > payloads gives us excellent results. >=20 These are also uploaded outside of git repos, but it's not a problem to = push uncompressed files into git. Kind regards, -- Maxim Kuvyrkov https://www.linaro.org