From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <SRS0=2hpG=35=gnu.org=mnabipoor@sourceware.org>
Received: from eggs.gnu.org (eggs.gnu.org [IPv6:2001:470:142:3::10])
	by sourceware.org (Postfix) with ESMTPS id 0E7EE3858407
	for <buildbot@sourceware.org>; Tue, 29 Nov 2022 11:56:05 +0000 (GMT)
DMARC-Filter: OpenDMARC Filter v1.4.1 sourceware.org 0E7EE3858407
Authentication-Results: sourceware.org; dmarc=pass (p=none dis=none) header.from=gnu.org
Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=gnu.org
Received: from fencepost.gnu.org ([2001:470:142:3::e])
	by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
	(Exim 4.90_1)
	(envelope-from <mnabipoor@gnu.org>)
	id 1ozzDX-0000ii-W4; Tue, 29 Nov 2022 06:56:04 -0500
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org;
	s=fencepost-gnu-org; h=In-Reply-To:MIME-Version:References:Subject:To:From:
	Date; bh=8BKEORejc++psdo2zO6tBmE1ct+S5SvVlkoC5PCe1iE=; b=TkBHbh+zmk+jxMx4GqTn
	5TkuOJPOHgJ4ZiKiaD8IEsN/vzQoEbmv+n3I346MQOWV2NuQlE8cNvVd/SOjN2oZLstszsWqHmcll
	eaEEwDTn9gKeFs5dviiwvKjdwZTvUkO8nXvAWFgo8OTgydROpt8mPqw8s3qM7mPpfah4FjC9GkBDR
	T2SHBoUll0ZBu+zpUfKbW0hPdBF82svL1mfGHI+lS43f+9UrLxqrzeqwi1rgNRCREru0NuCk6T4dI
	a5cEooogVyKhWt6RAwgH3SrrWOm1lz3jl6RoFCW/9vBqpS3+lGL0S0EcjhgH+kwt06Y5tpxBgeWTT
	JlEE8DgtpiXfKw==;
Received: from ip-078-094-038-141.um19.pools.vodafone-ip.de ([78.94.38.141] helo=schwinger)
	by fencepost.gnu.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
	(Exim 4.90_1)
	(envelope-from <mnabipoor@gnu.org>)
	id 1ozzDV-0003TR-Nj; Tue, 29 Nov 2022 06:56:03 -0500
Date: Tue, 29 Nov 2022 12:55:58 +0100
From: Mohammad-Reza Nabipoor <mnabipoor@gnu.org>
To: "Frank Ch. Eigler" <fche@elastic.org>
Cc: Arsen =?utf-8?Q?Arsenovi=C4=87?= <arsen@aarsen.me>,
	Mark Wielaard <mark@klomp.org>, buildbot@sourceware.org,
	poke-devel@gnu.org
Subject: Re: [PATCH builder.git] master.cfg: add GNU poke builder
Message-ID: <Y4XzTlyMH+vOa6lm@schwinger>
References: <20221119233644.911898-1-arsen@aarsen.me>
 <Y31rOQoucGJJvbIf@wildebeest.org>
 <87ilj5zy24.fsf@gnu.org>
 <Y35b/PYp1mTan+rB@wildebeest.org>
 <Y36Apxjj/pYArZnV@schwinger>
 <b31833e713a76d57975033932f183918c8f562a2.camel@klomp.org>
 <Y4TmbYy+UO3KpvMg@elastic.org>
 <86a64aki12.fsf@aarsen.me>
 <Y4UtyjD0873RwaiI@elastic.org>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <Y4UtyjD0873RwaiI@elastic.org>
X-Spam-Status: No, score=1.7 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH,DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_BARRACUDACENTRAL,SPF_HELO_PASS,SPF_PASS,TXREP autolearn=no autolearn_force=no version=3.4.6
X-Spam-Level: *
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org
List-Id: <buildbot.sourceware.org>


Hi Frank.

On Mon, Nov 28, 2022 at 04:53:14PM -0500, Frank Ch. Eigler wrote:
> Another suggestion: change your dejagnu .exp files so that the
> test name strings passed to "pass" "fail" etc. are persistent
> and generic, and not contain irrelevant stuff like a local
> complete path name.
> 
> That's because having these paths in the test names makes those test
> cases different from run to run, and thus the results are not directly
> comparable.  For example:
> 
> https://builder.sourceware.org/testrun-diffs?mode=differences&commitish=4a4313189ff5c3e354c977f8eca6621329af3279&commitish=c6cb32e4a10b994e26e32266eaf7cce47f7128d5
> 
> It'd be better just to print the `basename $path` or something like that
> instead.
> 

I just fixed it in commit 68208454a874d6c03f79dbe191ed1f7b4de633fc.
Thanks.