From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from EUR01-DB5-obe.outbound.protection.outlook.com (mail-eopbgr150071.outbound.protection.outlook.com [40.107.15.71]) by sourceware.org (Postfix) with ESMTPS id 1BCE53840C0B for ; Thu, 30 Jul 2020 13:29:12 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.3.2 sourceware.org 1BCE53840C0B Authentication-Results: sourceware.org; dmarc=none (p=none dis=none) header.from=arm.com Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=Wilco.Dijkstra@arm.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=armh.onmicrosoft.com; s=selector2-armh-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=p9xSEktaly7PY7yDcU/14GooN1ucvpPoqCUZs7zQhYY=; b=JgTRztD3KQ8e2Lcr9Zqofn3W2zPlVzoriUf9ul6zXrlIUkTn0tZBrwMNsi6oENyLMcwWJ8/XoMH/UGOstq2WkiQev8F2TaSz9eO4AQJnc9XxPJabsnGyztt0DFRLI9akK5p09orUF5hn7WEi4/fyj9mSMZX9Zh1eH8eH985C42k= Received: from MR2P264CA0116.FRAP264.PROD.OUTLOOK.COM (2603:10a6:500:33::32) by DBBPR08MB4284.eurprd08.prod.outlook.com (2603:10a6:10:d0::10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3216.23; Thu, 30 Jul 2020 13:29:10 +0000 Received: from VE1EUR03FT021.eop-EUR03.prod.protection.outlook.com (2603:10a6:500:33:cafe::b9) by MR2P264CA0116.outlook.office365.com (2603:10a6:500:33::32) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3239.17 via Frontend Transport; Thu, 30 Jul 2020 13:29:10 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 63.35.35.123) smtp.mailfrom=arm.com; sourceware.org; dkim=pass (signature was verified) header.d=armh.onmicrosoft.com; sourceware.org; dmarc=bestguesspass action=none header.from=arm.com; Received-SPF: Pass (protection.outlook.com: domain of arm.com designates 63.35.35.123 as permitted sender) receiver=protection.outlook.com; client-ip=63.35.35.123; helo=64aa7808-outbound-1.mta.getcheckrecipient.com; Received: from 64aa7808-outbound-1.mta.getcheckrecipient.com (63.35.35.123) by VE1EUR03FT021.mail.protection.outlook.com (10.152.18.117) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3239.17 via Frontend Transport; Thu, 30 Jul 2020 13:29:09 +0000 Received: ("Tessian outbound 2ae7cfbcc26c:v62"); Thu, 30 Jul 2020 13:29:09 +0000 X-CheckRecipientChecked: true X-CR-MTA-CID: 7cb44c89d23fe9d6 X-CR-MTA-TID: 64aa7808 Received: from a9a0ec4abe74.1 by 64aa7808-outbound-1.mta.getcheckrecipient.com id 00424ECE-50D1-4A23-8CB7-50A43AF06289.1; Thu, 30 Jul 2020 13:29:04 +0000 Received: from EUR04-DB3-obe.outbound.protection.outlook.com by 64aa7808-outbound-1.mta.getcheckrecipient.com with ESMTPS id a9a0ec4abe74.1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384); Thu, 30 Jul 2020 13:29:04 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=EnEAd260BWKn0PNY+0RoTI8At93ijOFyYz6wnYsp3W/ytC7Db54tSN4oacmV3CtIfJovjdhgrnJwzPHNMiIta7iRXxR7HuN65oE+luUdrSDEgHmz7eZtYie0aR728bW5Jblhy0gykl8mMP8eYlRxg0I8GjW9X5L67GBNej4EEfv9t65rpIL2kckxMoztwbXuJot/RNjzNaXqIc+KRfpKDkR+gaQgcv6sPlIJlexSWFZzF1TbUFma79SZrWwJ3tDOvKOcWrnZvtKQqt7yzoRYzsNEk1n26sY5Mch1fNsGrj6HUfktJU75OQVT+xcxMIWScEHa4gz5eX4j+uu46Pg4Lw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=p9xSEktaly7PY7yDcU/14GooN1ucvpPoqCUZs7zQhYY=; b=gsqhFVZUwgmnqtNDAGa+2Q8U2aGKU22zwhuuS2L/Nvptkau/6d9z+8ScWB8KjfcGHWW2aOgYw0rh9DLi6PAg9uL3YIABwqD7m4UOqsxbor1k5R24PXZPK/EHPZqIPPEdzzGvxtcXrYNUP9eJprJrEqJMtNr3wtWL+leM0Pk+3Amvm6Nc6F9gBDyJLNgDWsyo7CqkAaZZ4MFNJ7PEQVqWrbW9V9njAHaushbCqtOA+SdnxFQzKl8XtKGw4KJjvBEu3dsZRPq7EtFATlc0t94LFlr+0upTtEH00XAqCCpk8rPvE3O87t6QegmCsDKjQDQTGIbVxyFY64b5QQJxIdKUFw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=arm.com; dmarc=pass action=none header.from=arm.com; dkim=pass header.d=arm.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=armh.onmicrosoft.com; s=selector2-armh-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=p9xSEktaly7PY7yDcU/14GooN1ucvpPoqCUZs7zQhYY=; b=JgTRztD3KQ8e2Lcr9Zqofn3W2zPlVzoriUf9ul6zXrlIUkTn0tZBrwMNsi6oENyLMcwWJ8/XoMH/UGOstq2WkiQev8F2TaSz9eO4AQJnc9XxPJabsnGyztt0DFRLI9akK5p09orUF5hn7WEi4/fyj9mSMZX9Zh1eH8eH985C42k= Received: from DB8PR08MB5036.eurprd08.prod.outlook.com (2603:10a6:10:ed::20) by DB6PR0802MB2327.eurprd08.prod.outlook.com (2603:10a6:4:89::13) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3239.17; Thu, 30 Jul 2020 13:29:03 +0000 Received: from DB8PR08MB5036.eurprd08.prod.outlook.com ([fe80::f4dc:4cf1:70e:5b3f]) by DB8PR08MB5036.eurprd08.prod.outlook.com ([fe80::f4dc:4cf1:70e:5b3f%3]) with mapi id 15.20.3216.034; Thu, 30 Jul 2020 13:29:03 +0000 From: Wilco Dijkstra To: Paul Zimmermann CC: "libc-alpha@sourceware.org" Subject: Re: nonsense benchtests results Thread-Topic: nonsense benchtests results Thread-Index: AQHWZcwDHn78GnoQXUqF1ZjJMUSv6KkfwQvDgABYcdk= Date: Thu, 30 Jul 2020 13:29:03 +0000 Message-ID: References: , In-Reply-To: Accept-Language: en-GB, en-US Content-Language: en-GB X-MS-Has-Attach: X-MS-TNEF-Correlator: Authentication-Results-Original: inria.fr; dkim=none (message not signed) header.d=none;inria.fr; dmarc=none action=none header.from=arm.com; x-originating-ip: [82.24.199.97] x-ms-publictraffictype: Email X-MS-Office365-Filtering-HT: Tenant X-MS-Office365-Filtering-Correlation-Id: 2b90a17e-ec6d-43dc-0fbb-08d8348c8aa8 x-ms-traffictypediagnostic: DB6PR0802MB2327:|DBBPR08MB4284: X-Microsoft-Antispam-PRVS: x-checkrecipientrouted: true nodisclaimer: true x-ms-oob-tlc-oobclassifiers: OLM:7691;OLM:7691; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam-Untrusted: BCL:0; X-Microsoft-Antispam-Message-Info-Original: efGAetoTR5KB9ZjR5pViEzpavyGeRPOhI5Utduumi4H84MvjAvTYILjXJGydoilUlwtEvoQOIFEVPY4YkD6yrZ9Owa7c60E9NXHDK63iBn19AaJ6DTfMVy79bHCLhW8aGDpvTK5wqmxMPyh7MhpQsCnOqYqhiil00pUfiUVUgo/cGi45oiu3iN8lPTR1jZCRaoZrn6ABx7EPUTfY2vDxK+DREL8cvULYdSZ9QsNd8bIpCeLO4kpHECbfboPlTOfdd5UH+m9qVZoPssSOeiQeDfygIwTt5xjhqim3oHfH2kCbAIk8rA0luXlu2QaczaebrBgXg36cTaoaysW0glCpSg== X-Forefront-Antispam-Report-Untrusted: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DB8PR08MB5036.eurprd08.prod.outlook.com; PTR:; CAT:NONE; SFTY:; SFS:(4636009)(39860400002)(346002)(376002)(366004)(136003)(396003)(7116003)(7696005)(55016002)(478600001)(8676002)(3480700007)(8936002)(5660300002)(316002)(186003)(9686003)(6506007)(71200400001)(33656002)(4326008)(86362001)(26005)(52536014)(66556008)(64756008)(76116006)(6916009)(2906002)(66476007)(66446008)(4744005)(66946007); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata: YINQaXJTUbuBNudxm7BvZYFyPeMQpg4DtM0Zq6EKpxTqW7lbZ7NOkxytDXmDW/Am/QvI1DsT90BhO8Ei1BZGwRKVQc/6U8CgPb1nACK2QMlfjLfP5Kt5/mHczMa+ian6WjpOoKY7L96hzXPVQjELmV/HvXbEFozTMQqB0rNpGqm1mVVayY6KHMmG4viC5FbXtuEhZ1Tl+/smL0792QpX8FrZU2rKCxk/9F+zdMVkYLoiTCOHpc5mcKw2Q8vt3G9Jn8wSTH7xbNzeqrEJ1xXPruK0UB8EKycWs2dzjk0mYkg++9l9Io0cq5wNTzDrFZ+FYou4BonflJPUYUeGNGe6P/2nyLxGCPWc4IoNe/i7DZB4tishG5Exc8hGy3yPP+xmfGySJEbBFzhkeunWLDxzcYODweryFyru3wCYJ+kvPE2AATbXhJrvfvJNoopYCHA8VyU0ZnVUBw7p2fIbVLdsvy+GUjgSs8IfdL4qqrz59a8YPCRfvnjkC7RDkMWtYBKFmop6ylnPQGsYgZ5BT0qNPMgyAABeSYwQ0bCsikyAIPxJbk4nTbJxlxCEtncON4Dy0KaquIx3qct5dgK9FRa+60m1PjmxlZKJ/a+4OTIRd/qEbtDxVMbXTP6j64t20s9rdRrgTxGv8DfalvXhknlsQw== x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB6PR0802MB2327 Original-Authentication-Results: inria.fr; dkim=none (message not signed) header.d=none;inria.fr; dmarc=none action=none header.from=arm.com; X-EOPAttributedMessage: 0 X-MS-Exchange-Transport-CrossTenantHeadersStripped: VE1EUR03FT021.eop-EUR03.prod.protection.outlook.com X-MS-Office365-Filtering-Correlation-Id-Prvs: 62a1b8b5-055c-458d-5f47-08d8348c86db X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: b18kemLFCJFlmJMjwKd+wNichUW8/wkLXcdzdOypG3F2Dkag2o5mMdxV6GmmHL455OKDeYrOHBFCZKQePzbxo/jybhYh/tRsbIv4KB+s3yxxojGJ2/8lCLDmxTtWkVSrkld82YvN2f114XvYDK6Jh67/9v/JxSlmbQEcuBRW4AERQr5KidMj6WHdGnjY+KDK3+cC8eAXLQWTv3N/M3tU4Y+747RCxwu+VK+gqNpzVK1Yn2oTzrHdLPPBL5oMIVYVsqwhwHMa6xCiP8c7VAfmSfzXLfxE3//KjnwIw8Kfc/RX2YWMK3UO11ee25F27fSF5kf1POFJ1ZiECsS4fvHuGZVBq1IGjvvYigIIRYrZLCQxSCgYpkDjnnVTiqzbzd1rssgO7371IPpr9Sm8Ronh4g== X-Forefront-Antispam-Report: CIP:63.35.35.123; CTRY:IE; LANG:en; SCL:1; SRV:; IPV:CAL; SFV:NSPM; H:64aa7808-outbound-1.mta.getcheckrecipient.com; PTR:ec2-63-35-35-123.eu-west-1.compute.amazonaws.com; CAT:NONE; SFTY:; SFS:(4636009)(376002)(346002)(39860400002)(396003)(136003)(46966005)(478600001)(52536014)(9686003)(4326008)(316002)(70586007)(55016002)(336012)(6862004)(70206006)(36906005)(5660300002)(2906002)(7696005)(6506007)(7116003)(186003)(8936002)(82740400003)(81166007)(3480700007)(82310400002)(86362001)(33656002)(26005)(356005)(8676002)(47076004)(4744005); DIR:OUT; SFP:1101; X-OriginatorOrg: arm.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 30 Jul 2020 13:29:09.8191 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 2b90a17e-ec6d-43dc-0fbb-08d8348c8aa8 X-MS-Exchange-CrossTenant-Id: f34e5979-57d9-4aaa-ad4d-b122a662184d X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=f34e5979-57d9-4aaa-ad4d-b122a662184d; Ip=[63.35.35.123]; Helo=[64aa7808-outbound-1.mta.getcheckrecipient.com] X-MS-Exchange-CrossTenant-AuthSource: VE1EUR03FT021.eop-EUR03.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: DBBPR08MB4284 X-Spam-Status: No, score=-1.2 required=5.0 tests=BAYES_00, DKIM_SIGNED, DKIM_VALID, RCVD_IN_BARRACUDACENTRAL, RCVD_IN_DNSWL_LOW, RCVD_IN_MSPIKE_H2, SPF_HELO_PASS, SPF_PASS, TXREP, UNPARSEABLE_RELAY autolearn=no autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on server2.sourceware.org X-BeenThere: libc-alpha@sourceware.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Libc-alpha mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Jul 2020 13:29:13 -0000 Hi Paul,=0A= =0A= > thank you for your answer. I understand what I'm missing is how I can mak= e and=0A= > use another trace. And where is the "workload trace for the float version= "=0A= > located (I could not find it). I'd like to document this in benchtests/RE= ADME.=0A= =0A= grep workload benchtests/*-inputs shows the traces that have been committed= .=0A= You can create new traces by running representative code with a printf in t= he=0A= math function you're interested in. You could also generate randomized inpu= ts=0A= in an interval. They don't have to be very long, the key is to exercise a r= ange of=0A= common inputs rather than repeating the same input a million times.=0A= =0A= > PS: if traces can't have inputs that return NaN or infinity, maybe the=0A= > benchtests framework should check it?=0A= =0A= Well it could be checked, but traces from real applications won't use NaN. = Inf=0A= might happen in some math functions, but I haven't seen it in any traces so= far.=0A= =0A= Cheers,=0A= Wilco=