From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-qt1-x82a.google.com (mail-qt1-x82a.google.com [IPv6:2607:f8b0:4864:20::82a]) by sourceware.org (Postfix) with ESMTPS id D8E763858C50 for ; Tue, 18 Oct 2022 12:22:19 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.1 sourceware.org D8E763858C50 Authentication-Results: sourceware.org; dmarc=pass (p=quarantine dis=none) header.from=kitware.com Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=kitware.com Received: by mail-qt1-x82a.google.com with SMTP id s3so9466553qtn.12 for ; Tue, 18 Oct 2022 05:22:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kitware.com; s=google; h=user-agent:in-reply-to:content-transfer-encoding :content-disposition:mime-version:references:message-id:subject:cc :to:from:date:from:to:cc:subject:date:message-id:reply-to; bh=FJrgVL2zMxCerYb6fToIWf18FMFwPA3/pWi7JtcPoVg=; b=KfjU2y6RADiclthnakCbsY8vYZPs/LK08j8VSGnn6GH3o8Junbvk0kYncpRvdVDmCH 7GnKsHt2XJBGcocKShfuuBktQxdxQTIU9Cb/TKX+1RMZ3dOgnTf93IIxzzzPzbpVnkSQ U4d3T0Q+50dPGo+2ZAr4gNH2iSZ2UQZUVOk3U= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=user-agent:in-reply-to:content-transfer-encoding :content-disposition:mime-version:references:message-id:subject:cc :to:from:date:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=FJrgVL2zMxCerYb6fToIWf18FMFwPA3/pWi7JtcPoVg=; b=SbpkiPvpoefsFxqcGrYS0hczUF91kzRW2MJwT8Nbk1ih75X+tEWAftVai1ydM7N94V mu8eRiQ9zSU1pGlEstMjTsG3aWWiUrGbPWEsSlOzgczdfHGrbrTwOPmdBOYldBMpyHDw wXMOm7sVKMKPrNjPZthnXaINJvPdxIib2dknHcP4GO+mFvnjL+C2Y4WkX4d8Qrr8k0vr 1qCGvRsRNtzTuArG7Oedo7XxX40KXtlQdMSih9Z2wJcrRUUoI/DhF1VNgmNIo3YvSINC hkMZVVarL2eTBFeQGyUkpsNxnWdeOllQGibfEmSpWB6W3EkkQc9dZM+cjN7MjzH8CRDD QQ/Q== X-Gm-Message-State: ACrzQf1caZRhhm0gtBfda5IdFG2vpGu2WddB6AlEif6NHHYf5gIJezmK pCpG5xRA8N4oSWqKh+hNAQp3Wg== X-Google-Smtp-Source: AMsMyM7OaelBzPUF0cHeBonRjx6mjFaIFoycfw2A/WlKKUQDkk6vWB26lojQZXeO2bVbiTijYD7CuA== X-Received: by 2002:ac8:5fc6:0:b0:39c:8993:88f1 with SMTP id k6-20020ac85fc6000000b0039c899388f1mr1867469qta.24.1666095739278; Tue, 18 Oct 2022 05:22:19 -0700 (PDT) Received: from localhost (cpe-142-105-146-128.nycap.res.rr.com. [142.105.146.128]) by smtp.gmail.com with ESMTPSA id bj3-20020a05620a190300b006eeca296c00sm2334762qkb.104.2022.10.18.05.22.18 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 18 Oct 2022 05:22:18 -0700 (PDT) Date: Tue, 18 Oct 2022 08:22:17 -0400 From: Ben Boeckel To: David Malcolm Cc: Jason Merrill , Ben Boeckel , gcc-patches@gcc.gnu.org, nathan@acm.org, fortran@gcc.gnu.org, gcc@gcc.gnu.org, brad.king@kitware.com, Martin Liska Subject: Re: [PATCH RESEND 0/1] RFC: P1689R5 support Message-ID: References: <20221004151200.1275636-1-ben.boeckel@kitware.com> <3bfbf143-d85e-cb93-68eb-686262e2acc3@redhat.com> <340d9872b51aebe8a7392b7122def32ed3ca279f.camel@redhat.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <340d9872b51aebe8a7392b7122def32ed3ca279f.camel@redhat.com> User-Agent: Mutt/2.2.7 (2022-08-07) X-Spam-Status: No, score=-4.2 required=5.0 tests=BAYES_00,DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_NONE,SPF_HELO_NONE,SPF_PASS,TXREP autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org List-Id: On Thu, Oct 13, 2022 at 13:08:46 -0400, David Malcolm wrote: > On Mon, 2022-10-10 at 16:21 -0400, Jason Merrill wrote: > > David Malcolm would probably know best about JSON wrangling. > > Unfortunately our JSON output doesn't make any guarantees about the > ordering of keys within an object, so the precise textual output > changes from run to run. I've coped with that in my test cases by > limiting myself to simple regexes of fragments of the JSON output. > > Martin Liska [CCed] went much further in > 4e275dccfc2467b3fe39012a3dd2a80bac257dd0 by adding a run-gcov-pytest > DejaGnu directive, allowing for test cases for gcov to be written in > Python, which can thus test much more interesting assertions about the > generated JSON. Ok, if Python is acceptable, I'll use its stdlib to do "fancy" things. Part of this is because I want to assert that unnecessary fields don't exist and that sounds…unlikely to be possible in any maintainable way (assuming it is possible) with regexen. `jq` could help immensely, but that is probably a bridge too far :) . Thanks, --Ben