From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-qt1-x82c.google.com (mail-qt1-x82c.google.com [IPv6:2607:f8b0:4864:20::82c]) by sourceware.org (Postfix) with ESMTPS id D88183858C83 for ; Tue, 18 Oct 2022 12:22:19 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.1 sourceware.org D88183858C83 Authentication-Results: sourceware.org; dmarc=pass (p=quarantine dis=none) header.from=kitware.com Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=kitware.com Received: by mail-qt1-x82c.google.com with SMTP id cr19so6206801qtb.0 for ; Tue, 18 Oct 2022 05:22:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kitware.com; s=google; h=user-agent:in-reply-to:content-transfer-encoding :content-disposition:mime-version:references:message-id:subject:cc :to:from:date:from:to:cc:subject:date:message-id:reply-to; bh=FJrgVL2zMxCerYb6fToIWf18FMFwPA3/pWi7JtcPoVg=; b=KfjU2y6RADiclthnakCbsY8vYZPs/LK08j8VSGnn6GH3o8Junbvk0kYncpRvdVDmCH 7GnKsHt2XJBGcocKShfuuBktQxdxQTIU9Cb/TKX+1RMZ3dOgnTf93IIxzzzPzbpVnkSQ U4d3T0Q+50dPGo+2ZAr4gNH2iSZ2UQZUVOk3U= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=user-agent:in-reply-to:content-transfer-encoding :content-disposition:mime-version:references:message-id:subject:cc :to:from:date:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=FJrgVL2zMxCerYb6fToIWf18FMFwPA3/pWi7JtcPoVg=; b=P+J3M21UyMeEaWZiOEMXFMlAYaXS0xwE2Jqt8/EFZmrKaUseeHgNySXg9A3YSCbAP/ yTSPzOJXp/SMEOA27xvnnXLBM3Lk2NEuwqoh/fRAyBsL0CygCRRck2Gd3cWcTBszIAvM SVoGJGwXcAugjztKmBGqZ7PByeI/3JoCRoRuHXWGEgzEXUHxPDJNJvoDXRpvFTtMtRJS b8a3s8gJhSB4QDRMK9wJXqxLXNJFOvV2vBFFa2e3OH7t/Yd96eD3WnM4Zsaf+qEBOQIU VifeJAzrDiRnq2I/YnApvv+2yfDfdBygztq935OBQWy5tv6DrtvyBg/7nAMjQyJU6cAJ JwYA== X-Gm-Message-State: ACrzQf3fuva3bY8tZ4ppoagbI6Bjo7y2mW3/Q98A6CKN6R2q2MxYk4dp 7vOz+RI9J0kloxhHcBftBjixXzydmASaANZb X-Google-Smtp-Source: AMsMyM7OaelBzPUF0cHeBonRjx6mjFaIFoycfw2A/WlKKUQDkk6vWB26lojQZXeO2bVbiTijYD7CuA== X-Received: by 2002:ac8:5fc6:0:b0:39c:8993:88f1 with SMTP id k6-20020ac85fc6000000b0039c899388f1mr1867469qta.24.1666095739278; Tue, 18 Oct 2022 05:22:19 -0700 (PDT) Received: from localhost (cpe-142-105-146-128.nycap.res.rr.com. [142.105.146.128]) by smtp.gmail.com with ESMTPSA id bj3-20020a05620a190300b006eeca296c00sm2334762qkb.104.2022.10.18.05.22.18 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 18 Oct 2022 05:22:18 -0700 (PDT) Date: Tue, 18 Oct 2022 08:22:17 -0400 From: Ben Boeckel To: David Malcolm Cc: Jason Merrill , Ben Boeckel , gcc-patches@gcc.gnu.org, nathan@acm.org, fortran@gcc.gnu.org, gcc@gcc.gnu.org, brad.king@kitware.com, Martin Liska Subject: Re: [PATCH RESEND 0/1] RFC: P1689R5 support Message-ID: References: <20221004151200.1275636-1-ben.boeckel@kitware.com> <3bfbf143-d85e-cb93-68eb-686262e2acc3@redhat.com> <340d9872b51aebe8a7392b7122def32ed3ca279f.camel@redhat.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <340d9872b51aebe8a7392b7122def32ed3ca279f.camel@redhat.com> User-Agent: Mutt/2.2.7 (2022-08-07) X-Spam-Status: No, score=-2.8 required=5.0 tests=BAYES_00,DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_NONE,SPF_HELO_NONE,SPF_PASS,TXREP autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org List-Id: On Thu, Oct 13, 2022 at 13:08:46 -0400, David Malcolm wrote: > On Mon, 2022-10-10 at 16:21 -0400, Jason Merrill wrote: > > David Malcolm would probably know best about JSON wrangling. > > Unfortunately our JSON output doesn't make any guarantees about the > ordering of keys within an object, so the precise textual output > changes from run to run. I've coped with that in my test cases by > limiting myself to simple regexes of fragments of the JSON output. > > Martin Liska [CCed] went much further in > 4e275dccfc2467b3fe39012a3dd2a80bac257dd0 by adding a run-gcov-pytest > DejaGnu directive, allowing for test cases for gcov to be written in > Python, which can thus test much more interesting assertions about the > generated JSON. Ok, if Python is acceptable, I'll use its stdlib to do "fancy" things. Part of this is because I want to assert that unnecessary fields don't exist and that sounds…unlikely to be possible in any maintainable way (assuming it is possible) with regexen. `jq` could help immensely, but that is probably a bridge too far :) . Thanks, --Ben