From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (qmail 79723 invoked by alias); 17 Jun 2016 13:51:27 -0000 Mailing-List: contact libc-alpha-help@sourceware.org; run by ezmlm Precedence: bulk List-Id: List-Subscribe: List-Archive: List-Post: List-Help: , Sender: libc-alpha-owner@sourceware.org Received: (qmail 79712 invoked by uid 89); 17 Jun 2016 13:51:26 -0000 Authentication-Results: sourceware.org; auth=none X-Virus-Found: No X-Spam-SWARE-Status: No, score=-2.4 required=5.0 tests=AWL,BAYES_00,RCVD_IN_DNSWL_LOW autolearn=ham version=3.3.2 spammy= X-HELO: mail-qk0-f176.google.com X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:to:references:cc:from:organization :message-id:date:user-agent:mime-version:in-reply-to :content-transfer-encoding; bh=zgC84BQHkaW/moP/tlwJ1G7R1A2SP18bTbkiitTC6R4=; b=JiJW+jiVl98GHgHCCK/DCCAXGwlRgrAbM2ragICIB9l6YV79BEHQ1eSgeByhS/5xhD 5sxMhJqvPtituWRSXMlSj5qlq/cyHQfS7BTThLklWwu9A5FUXqCs2kzZL6u9a+w8l4Bn q+B6R1Blf3V+yVkkNkcTq8mf+L+DNW6w2AFEji+MpH9gySVFAOb2jciT7b+gn9xXzuUT DI0i+HXWsgW6NES1omN1vEl6KHXg4S5AQTLfYRiV3xs9SnEpvb7cLT1ah3E/A6GlhZ9R C7SkCJ/MVk4Ms0wFJJbvMcFAPTztVmoE0b6A3ec6rB8CcpjYoMZPGc1TRWkfSHGC8yM7 CIew== X-Gm-Message-State: ALyK8tJXQ62z02sCwgAHVz20rfNS1nSYm7x37rNshiU0l+rf5GiKWfIOUNyM2Eow5jbSYG2g X-Received: by 10.55.21.65 with SMTP id f62mr2405119qkh.109.1466171474462; Fri, 17 Jun 2016 06:51:14 -0700 (PDT) Subject: Re: [PATCH] Add compile testing to glibc test framework. To: Florian Weimer , Joseph Myers References: <575679A0.4090209@redhat.com> <5f651b7e-de54-3207-2a15-81e0ba1aea41@redhat.com> Cc: GNU C Library From: Carlos O'Donell Message-ID: <82e0dffc-bfd9-e06e-5798-e240ec7c8877@redhat.com> Date: Fri, 17 Jun 2016 13:51:00 -0000 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.1.0 MIME-Version: 1.0 In-Reply-To: <5f651b7e-de54-3207-2a15-81e0ba1aea41@redhat.com> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-SW-Source: 2016-06/txt/msg00658.txt.bz2 On 06/17/2016 07:27 AM, Florian Weimer wrote: > On 06/07/2016 07:28 PM, Joseph Myers wrote: >> On Tue, 7 Jun 2016, Carlos O'Donell wrote: >> >>> Previously these kinds of tests would result in the testsuite >>> failing to run to completion because compiler errors are treated >>> as harness failures. >> >> I don't actually see this as a problem - that is, I don't see why >> any compile failure should be hard to fix for some system-specific >> reason. I'd rather just add such tests as normal tests, that break >> the build if they fail. > > What's annoying with that is that you lose test summary reporting. > If this was somehow fixed (without impacting make running times, > please), I think there wouldn't much of an incentive to add such > compile-time testing. What would you like fixed? Summary reporting of failed compile and link? That's an interesting solution, wrap the compiles and link with something like evaluate-test.sh but designed to capture failed compiles and failed links and report them properly as a new kind of failed test code? -- Cheers, Carlos.