From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) by sourceware.org (Postfix) with ESMTPS id 3FD6E3858D1E for ; Wed, 17 May 2023 13:40:10 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org 3FD6E3858D1E Authentication-Results: sourceware.org; dmarc=pass (p=none dis=none) header.from=redhat.com Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=redhat.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1684330809; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=5X5o0F3zGsurECz944D5V4lZS4BB+czeWxzpmypkIHE=; b=UHloT1srYT5AVFBe//bPHPmaKGhxQoYXN2tkZKALKjwCjeXB89PBiDf9Hf52zAbvOYg9JQ wKZY2ym5gPSb8jRX3v93HHuAGUflvwVUiJ92HOoMYCPfQOxluasmgtbSymjwFAJHjBJ4Yb SO9Bc1SKfR5puUzsgBalrem8eJKIrhc= Received: from mail-qv1-f71.google.com (mail-qv1-f71.google.com [209.85.219.71]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-136-YcafTaGJOw275kv8VdQiGA-1; Wed, 17 May 2023 09:40:08 -0400 X-MC-Unique: YcafTaGJOw275kv8VdQiGA-1 Received: by mail-qv1-f71.google.com with SMTP id 6a1803df08f44-61b5af37298so4305876d6.2 for ; Wed, 17 May 2023 06:40:08 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1684330808; x=1686922808; h=content-transfer-encoding:in-reply-to:subject:from:references:to :content-language:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=5X5o0F3zGsurECz944D5V4lZS4BB+czeWxzpmypkIHE=; b=ivZpasucwl+155IuwDxp48PU7FrlcQ6rNnx8AJ8xHRNYu3GuhDOud/woTPX7Bjnxcr uI52lA2/juhnl9ZUwKpWCF1Ze53Gy1/q4EyO8ByZKfptmtRDBxlzEhNCnvZxLNNDsBrQ FCZ98d3q578Xr0ZCF6fyy3d2uuLXihdCKVTjekeNmvuYJw8shteK0/V1m6m2HshMT84K WMBqLw9/v6JjTMEgB79XxmSdMG8r+9Oep+pXcm/+APvGAMvz+S0Mn2ZbZTAeXEkatGKq Y0yMmR/2sr5krLqgaPPwGZWEZtxCC4SZlHUt+LVyBVz9/3Ey9neoEHjU8Ca0JrT34dVg iNoQ== X-Gm-Message-State: AC+VfDwrGJuoxJYBg7LszhI6IsLIunGvnAolNxJ7D0iKtbrDYziaYiib f5bGpaZHRfkiU4rb0JYkbB/xgQKg2l5iirX2Aec6ybwlxZ0IRoGcIeKw9+AU1cfEA2oRvxfZbI2 Fuxw72qbVJiMO2vkk8g== X-Received: by 2002:ad4:5dc8:0:b0:623:6822:ff6e with SMTP id m8-20020ad45dc8000000b006236822ff6emr15371110qvh.7.1684330808125; Wed, 17 May 2023 06:40:08 -0700 (PDT) X-Google-Smtp-Source: ACHHUZ64IBpfHMnpao0ZquDxYe7rOVeP45Nf4uaNwIISvLP9rwfWywJsCbvs1cJSclZnhP1VyjzIAw== X-Received: by 2002:ad4:5dc8:0:b0:623:6822:ff6e with SMTP id m8-20020ad45dc8000000b006236822ff6emr15371077qvh.7.1684330807821; Wed, 17 May 2023 06:40:07 -0700 (PDT) Received: from [192.168.1.7] ([79.123.86.193]) by smtp.gmail.com with ESMTPSA id i20-20020a0cf394000000b00621253d19f9sm6302849qvk.98.2023.05.17.06.40.06 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 17 May 2023 06:40:07 -0700 (PDT) Message-ID: <4192bd91-64fe-8786-f63d-ba4527653399@redhat.com> Date: Wed, 17 May 2023 14:40:04 +0100 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.10.0 To: Vladimir Mezentsev , "binutils@sourceware.org" References: <3b4cae18-3c42-d8e1-517d-09463c270d4d@oracle.com> <993188ec-0507-1f4d-0adc-cffe3dc7119f@redhat.com> <6fd65fe9-3b9a-7e8f-5b65-c0dfd7b64018@oracle.com> From: Nick Clifton Subject: Re: gprofng testing In-Reply-To: <6fd65fe9-3b9a-7e8f-5b65-c0dfd7b64018@oracle.com> X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Language: en-GB Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-3.7 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH,DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,NICE_REPLY_A,RCVD_IN_DNSWL_NONE,RCVD_IN_MSPIKE_H2,SPF_HELO_NONE,SPF_NONE,TXREP,T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org List-Id: Hi Vladimir, >>> The size of experiments can be big. >> With difficulty.  The size of the experiment files will be an obstacle >> I expect.  Is it possible to instead provide a source file and have the >> test compile it first instead ? > > This is exactly what we have now in binutils-gdb.git. > We compare the time for each function in the application output and the gprofng report. > The small discrepancy is OK. > > But we cannot check the correctness of the gprofng report, such as the correct alignment of metrics or the order of functions. Why not ? How about instead of compiling examples, you start with assembler sources (possibly based upon compiled source code). This would remove any dependencies upon compiler behaviour, code layout and so on. >> Assuming that the answer to that question is no, then is it possible >> to create smaller test cases, or to compress the test files files and >> then decompress them when they are being used ? >  Is 2-4 megabyte small ? No. :-( > In any case, it was only on large experiments that we saw problems with the synchronization and reallocation of our tables. Well at least you caught these problems yourselves. > Is there a big public test suite for gdb (or any other binutils/gcc components) ? No. Well unless you consider the various Linux and BSD distributions to testsuites. After all if you put a broken linker into the build root of a distribution you quickly get a lot of people complaining at you. (I speak from experience...) But basically the answer is that there is currently nowhere that hosts large tests of any of the GNU tools. It would be nice to have such a resource, of course, but I do not see one appearing soon. Cheers Nick