From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) by sourceware.org (Postfix) with ESMTPS id 6CA553858D28 for ; Fri, 3 Nov 2023 14:58:26 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org 6CA553858D28 Authentication-Results: sourceware.org; dmarc=pass (p=none dis=none) header.from=redhat.com Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=redhat.com ARC-Filter: OpenARC Filter v1.0.0 sourceware.org 6CA553858D28 Authentication-Results: server2.sourceware.org; arc=none smtp.remote-ip=170.10.133.124 ARC-Seal: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1699023507; cv=none; b=Ctz2Fo/8eJF7h1Qcv+/YzEI8G/ko68RiE7vUMuc77F8DSnSu92r0IKvfvnU/wuPu31oBwaO+jI7A276iSTXOIHB43YpOGKwG67Tev+ajU5PF+5RozJ4s/155S1SqdGhoNOq2mHVknstxAAb5FNXwgnUBBa0/kIsgFI/6r9CJsxM= ARC-Message-Signature: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1699023507; c=relaxed/simple; bh=lBwH3Pjbt5b6S9L5NoWHhR9ukvOFqmZg1O+ir1SljO8=; h=DKIM-Signature:Date:From:To:Subject:Message-ID:MIME-Version; b=rBbXRl6f7LuDoQbrlYJ63mKlWQzbmSlYErerz/9ck0ukHlhUgSZQO1G8KKZTVWu6lE3ubgw34TX9BgCOUrrRSykZlNszcln4YgfLG1rPLyyhffqEnSDGk4Xzm+v2WveaStbUdh9UchARfAgPnZ5DCcpMm6ZibMRn4IigHIagp54= ARC-Authentication-Results: i=1; server2.sourceware.org DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1699023506; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=d6V2YPy0k+nz9kqVYmEnzecd1qWafD/5iq5xoYW3850=; b=MkMg+7/3wMvkEeGnuketI7j5Ii8Ni4ndCh/o44uJfgY+hXBqAyoE7WhUoc8WlvavAhmqni LcrSyPobFJRcG7wWx9tBFD7hUZnd1cNSEmO4ssxiKThfRu0CKXuqVJ8mP3y6bZmMpq4pMg MWsbjTKMq+i1/1qZm/wZsKsSghJsZ/A= Received: from mail-wr1-f70.google.com (mail-wr1-f70.google.com [209.85.221.70]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-196-q9lGTpPKPW2bFf4otkx4wA-1; Fri, 03 Nov 2023 10:58:24 -0400 X-MC-Unique: q9lGTpPKPW2bFf4otkx4wA-1 Received: by mail-wr1-f70.google.com with SMTP id ffacd0b85a97d-32f820c471fso999908f8f.0 for ; Fri, 03 Nov 2023 07:58:24 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1699023503; x=1699628303; h=user-agent:in-reply-to:content-disposition:mime-version:references :message-id:subject:cc:to:from:date:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=d6V2YPy0k+nz9kqVYmEnzecd1qWafD/5iq5xoYW3850=; b=VFa4StPrTdDrTSbeUJXp3MiSscAWEknINWkKcReJtOO5uUttagx1FGma/p7UtxGlr2 gadLvx6KO8Ym4gxP3JMSN11rVjl9cHK6+9SI+HIsmtJlFKEVS4cDdsiACytCHgkSMEnY rXu9M9VMmq9qPJOciKD5wwieEWk9Hn5wqM0P7274CV5igvogJOx8ZP5gxokpuQiWhtQm NTt4AY3iFOk+tel7wo2Lk/O4oMH6WAw7D3ZxLlO10J3rUhGt0dWZkec0smiFKwiEizNQ 3j3aI+rEeNSLMOUvotmRTM5D22wdYDx5JHGZmrtyBlMtRVC59NqPO2c0jCzNk7hgO9ej OM5g== X-Gm-Message-State: AOJu0Yx+XcZyZaBf8FtBHxrs4xDeyY6LEaaaOc5T6WXU2y4D6tdny+NY yVFkfMujm4L2U7bqEtWx6bbidDKehPshif6/w14vXumlcaWnHtK2d2Ry02CI+uHg5fFEw/SoVSW ha4zgHavKTwT5LhGPY9M= X-Received: by 2002:adf:f08f:0:b0:32d:8872:aac8 with SMTP id n15-20020adff08f000000b0032d8872aac8mr16667205wro.31.1699023503470; Fri, 03 Nov 2023 07:58:23 -0700 (PDT) X-Google-Smtp-Source: AGHT+IGI9C9VgCidq3t/w3xvLoK4yBDbbY37J/VKpcupEsyENDAzOixvdiD/Mjscilwj7lBIxqef7A== X-Received: by 2002:adf:f08f:0:b0:32d:8872:aac8 with SMTP id n15-20020adff08f000000b0032d8872aac8mr16667191wro.31.1699023503103; Fri, 03 Nov 2023 07:58:23 -0700 (PDT) Received: from lida.tpb.lab.eng.brq.redhat.com (nat-pool-brq-t.redhat.com. [213.175.37.10]) by smtp.gmail.com with ESMTPSA id z13-20020a5d4d0d000000b0032cc35c2ef7sm2046919wrt.29.2023.11.03.07.58.22 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 03 Nov 2023 07:58:22 -0700 (PDT) Date: Fri, 3 Nov 2023 15:58:21 +0100 From: Martin Cermak To: William Cohen Cc: systemtap@sourceware.org Subject: Re: Systmetap Testsuite results and areas to fix Message-ID: <20231103145821.ekt5wler6r74yqyj@lida.tpb.lab.eng.brq.redhat.com> References: <9f9d8e3a-fad6-4481-834b-d16771bcee3b@redhat.com> MIME-Version: 1.0 In-Reply-To: <9f9d8e3a-fad6-4481-834b-d16771bcee3b@redhat.com> User-Agent: NeoMutt/20180716 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Spam-Status: No, score=-3.5 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH,DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_NONE,RCVD_IN_MSPIKE_H3,RCVD_IN_MSPIKE_WL,SPF_HELO_NONE,SPF_NONE,TXREP,T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org List-Id: On Thu 2023-11-02 13:48 , William Cohen via Systemtap wrote: > Overall on x86_64 RHEL8/RHEL9/F38/rawhide the systemtap testsuite > complete. There are still on the order of 1500 failures on the x86_64 > machine, which is more than desired. > > I went looking for failures/issues in the testsuite that cause multiple > failures in the the test results. For example previously fixed > runtime to avoid conflicts with added glibc functions to allow dyninst > code to build without error on Fedora rawhide and turn off gcc warning > about string ops for the syscall tests to allow the test to be built. > > - A number of the syscall test fail because the syscall string > argument is not properly fetched and printed. This appears to be a > large portion of the 700 syscall.exp failures. > > > - About 200 of the "listing_mode" tests fail. They all reported: > > received: "child process exited abnormally" > > Going to investigate this more closely. > > > - About 150 of the tracepoints_list tests fail. Most are reporting > "not found by systemtap" but a few ('dlm', sof', and 'sof_int') fail > compilation because headers are not found. > > > - Approximately 130 failures in the tapset_functions.exp tests. > This looks like an issue with the test itself rather than > systemtap. A lot of messages of the form: > > FAIL: tapset_functions_stress (list_values(unknown)) > FAIL: tapset_functions_stress (default_value(unknown)) I've looked into this one. I've found some issues there, but none of them appeared to be a systemtap bug. After checking with Frank on the channel, however, I've dropped this testcase entirely. m. > > Think this might have been by conscious language initiative changes > (d1804e051dd) around november 2020. Going to check to see if > systemtap-4.4 built before these patches has the > systemtap.stress/tapset_functions.exp test work. > > -Will >