From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.129.124]) by sourceware.org (Postfix) with ESMTPS id 2A0903858D28 for ; Thu, 2 Nov 2023 17:48:17 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org 2A0903858D28 Authentication-Results: sourceware.org; dmarc=pass (p=none dis=none) header.from=redhat.com Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=redhat.com ARC-Filter: OpenARC Filter v1.0.0 sourceware.org 2A0903858D28 Authentication-Results: server2.sourceware.org; arc=none smtp.remote-ip=170.10.129.124 ARC-Seal: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1698947298; cv=none; b=F/GVwnWpmethF2B4+VEj93aCe2tZ98Sfccu6DX+7oOLamvB9RNLM0F/iDqx4bR13ApLOFXWAsH6nCjp6iLdKw/gJXUcwppaGa/Civzj5kzkhcgPbQc4s040YYu/QIWv1HV3gdNwgdfzi3Yei3xme4BNMAwss2h+hHPQN8aC4UFM= ARC-Message-Signature: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1698947298; c=relaxed/simple; bh=8BhGW7JhRzK6gvsnTv7SnHHzVOBuXR0pm1XDq6Ds1X4=; h=DKIM-Signature:Message-ID:Date:MIME-Version:To:From:Subject; b=XnGotr7NNogHeD0Ysi4TBsaid3q5u4AVH6DATWn3kJt3Gv08OfUgT5+qG3HccB0bKjbE57P1UBc+/Hi/RV681xBlGoYtGOKq0pxknm2FKdGqzeukiEZZYQdh7s8CA74pLkEFJ3857GMwDUThpXaLHekUZHJIY1QQWTrtRXoXtUA= ARC-Authentication-Results: i=1; server2.sourceware.org DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1698947296; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=e56BIuxYI49vuQWW+ZX7szmMHqpnXpHR4nYiyr5TdRo=; b=OyGkF23/h0UBlrxVP7dLtjVk9/am6uqckOSukzcqHwOilSLhiWlY5U/PINklLOUM+GVWsS f1v+Y0mV4rcEwEkGF6t9YgEnii5mODfeamm0dhuC1JWm0fWSJiZDZ/GOK4XRjZ6U6gbHts 1/VS6FZSt9qb58ZWhCZwwP1HqkrPbrU= Received: from mimecast-mx02.redhat.com (mx-ext.redhat.com [66.187.233.73]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-581-1fUEqt7gOvet0Zoe4Vqeew-1; Thu, 02 Nov 2023 13:48:15 -0400 X-MC-Unique: 1fUEqt7gOvet0Zoe4Vqeew-1 Received: from smtp.corp.redhat.com (int-mx05.intmail.prod.int.rdu2.redhat.com [10.11.54.5]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by mimecast-mx02.redhat.com (Postfix) with ESMTPS id 512603811F38 for ; Thu, 2 Nov 2023 17:48:15 +0000 (UTC) Received: from [10.13.129.81] (dhcp129-81.rdu.redhat.com [10.13.129.81]) by smtp.corp.redhat.com (Postfix) with ESMTP id 4569710102; Thu, 2 Nov 2023 17:48:15 +0000 (UTC) Message-ID: <9f9d8e3a-fad6-4481-834b-d16771bcee3b@redhat.com> Date: Thu, 2 Nov 2023 13:48:15 -0400 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird To: systemtap@sourceware.org Cc: wcohen@redhat.com From: William Cohen Subject: Systmetap Testsuite results and areas to fix X-Scanned-By: MIMEDefang 3.4.1 on 10.11.54.5 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Language: en-US Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-4.2 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH,DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_NONE,RCVD_IN_MSPIKE_H4,RCVD_IN_MSPIKE_WL,SPF_HELO_NONE,SPF_NONE,TXREP,T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org List-Id: Overall on x86_64 RHEL8/RHEL9/F38/rawhide the systemtap testsuite complete. There are still on the order of 1500 failures on the x86_64 machine, which is more than desired. I went looking for failures/issues in the testsuite that cause multiple failures in the the test results. For example previously fixed runtime to avoid conflicts with added glibc functions to allow dyninst code to build without error on Fedora rawhide and turn off gcc warning about string ops for the syscall tests to allow the test to be built. - A number of the syscall test fail because the syscall string argument is not properly fetched and printed. This appears to be a large portion of the 700 syscall.exp failures. - About 200 of the "listing_mode" tests fail. They all reported: received: "child process exited abnormally" Going to investigate this more closely. - About 150 of the tracepoints_list tests fail. Most are reporting "not found by systemtap" but a few ('dlm', sof', and 'sof_int') fail compilation because headers are not found. - Approximately 130 failures in the tapset_functions.exp tests. This looks like an issue with the test itself rather than systemtap. A lot of messages of the form: FAIL: tapset_functions_stress (list_values(unknown)) FAIL: tapset_functions_stress (default_value(unknown)) Think this might have been by conscious language initiative changes (d1804e051dd) around november 2020. Going to check to see if systemtap-4.4 built before these patches has the systemtap.stress/tapset_functions.exp test work. -Will