From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mx0a-00069f02.pphosted.com (mx0a-00069f02.pphosted.com [205.220.165.32]) by sourceware.org (Postfix) with ESMTPS id 59AEE3858406 for ; Wed, 23 Feb 2022 01:00:07 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.1 sourceware.org 59AEE3858406 Authentication-Results: sourceware.org; dmarc=pass (p=none dis=none) header.from=oracle.com Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=oracle.com Received: from pps.filterd (m0246617.ppops.net [127.0.0.1]) by mx0b-00069f02.pphosted.com (8.16.1.2/8.16.1.2) with SMTP id 21MMqnJ8000622 for ; Wed, 23 Feb 2022 01:00:06 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h=message-id : date : subject : to : references : from : in-reply-to : content-type : content-transfer-encoding : mime-version; s=corp-2021-07-09; bh=QwsjqTM/klMwh1GDohgGepYR9BDcuPxe//x0hRIKCe4=; b=FJ6BzhKVRYGbsnR6z+ROTiOnH7R8JnqLuaT3DKn/l7c6R+v1t42z4sRxxGLja4rzrdh3 Y+IzwtlyXSq2yWbqYja0O4m4GxbZge/JQrXAUO6gP2QOKymhdlkpIrAZAKMG0ro1JpnO hy4r/3EVhThxrwAXWQYLTouh4jLBkZeqVr2p4ydWsJ1+7EbkMmuhdkBN/oWDM8OY+FTe KNQQJhnhoZYDuM42c+VVOIETFJd2qv2PD0gib4fgkv2NExWFrQP2sJP8c1LaViAVisT/ AUBYkk9jvO8JXbhTIIOo8A1wbt+rcNzmQgMpvJPkHb7LZYR3fJsbymFV5+gGoNJjW3KG Aw== Received: from aserp3030.oracle.com (aserp3030.oracle.com [141.146.126.71]) by mx0b-00069f02.pphosted.com with ESMTP id 3ecxfat2ma-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK) for ; Wed, 23 Feb 2022 01:00:06 +0000 Received: from pps.filterd (aserp3030.oracle.com [127.0.0.1]) by aserp3030.oracle.com (8.16.1.2/8.16.1.2) with SMTP id 21N0KrsY058850 for ; Wed, 23 Feb 2022 01:00:05 GMT Received: from nam11-dm6-obe.outbound.protection.outlook.com (mail-dm6nam11lp2168.outbound.protection.outlook.com [104.47.57.168]) by aserp3030.oracle.com with ESMTP id 3eapkgtcf8-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK) for ; Wed, 23 Feb 2022 01:00:04 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=B1G1LhDf95kRnePUVDZDfNcWPolw3AXaX6Eegx8DsUs9EQGmNIcpSEvIIdxMu0Vel+F4dDl9nSNmcCJjnuVBqjRvuVtqajAs/yK/Q9enk8yV9tQ+trwsNISj1kOq4nxLxp/o0HsQwRhZaCRT63c49HuCn8j6qAIkbIC1zp/ZEAEzLW5O8LmeFd/Tt2DuZhK6/x66DYMzNklHCHFq4ctqPqqBOCGRvFrV7ucmgPqsdCTXIUQbV13CKsyfYK+PSZTMPigGH6bh4xKRcPXbMhsWTQS7cXv6PExGxQBWXY2d0rb+Y4qoXDbR3QFdnAxYKaAz7DDbb/mTUXIWb9yKNkj0ng== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=QwsjqTM/klMwh1GDohgGepYR9BDcuPxe//x0hRIKCe4=; b=gmfGU+UmqDiQoP2+On+yPLMG4Aa//p7Ite7h7z/P3mz0vY4Um/7Gy0b1H+unyFGQRdlHIpbQy/GsM1xppeBIlzNlp20olxsGCWxRHGNlaWC4PoJeagKPtiDdX0MzqKzM1NJdLVl6QOMqVCGqkP78rlxN5Y8KI8x1T7a2Q1cfEZio7GRiGAAHeRjreIVMdwXrzXEsrlfXRhnovS+z5KrOs87a6BiJWzBIyK487XOs20MIIK8NEhM4sUcb5EFBX30aveMaYBuXDMHza3VZnozQNEQNVjLKvj/x4msOWY0+b2j/3TcY+851t5+DxQsdSSYsQE/QSx3cSduYoA3AUumHBg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=oracle.com; dmarc=pass action=none header.from=oracle.com; dkim=pass header.d=oracle.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.onmicrosoft.com; s=selector2-oracle-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=QwsjqTM/klMwh1GDohgGepYR9BDcuPxe//x0hRIKCe4=; b=hS/5ROVY4XKVP7SWhOdM1OB+GVAeReGbYuOqoT+WYMRIlGcZC76nBRp3ahHHCxd61li9ITAhsxRdZlgYyrbDoDOJiRkQyGWADeI2OzU/yc0Ecav4yC5dUkrOsZCk7alhpe4R880+QWeexvPM1KsYrDHlALH8dBsAYtBlACL5RWg= Received: from BYAPR10MB3208.namprd10.prod.outlook.com (2603:10b6:a03:159::10) by DM8PR10MB5415.namprd10.prod.outlook.com (2603:10b6:8:35::23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5017.21; Wed, 23 Feb 2022 01:00:03 +0000 Received: from BYAPR10MB3208.namprd10.prod.outlook.com ([fe80::3d07:ffdd:63e2:a731]) by BYAPR10MB3208.namprd10.prod.outlook.com ([fe80::3d07:ffdd:63e2:a731%4]) with mapi id 15.20.4995.027; Wed, 23 Feb 2022 01:00:03 +0000 Message-ID: <8a9755e8-4b6f-4407-8331-529fce20a118@oracle.com> Date: Tue, 22 Feb 2022 18:59:59 -0600 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Thunderbird/91.6.0 Subject: Re: Benchmark recommendations needed Content-Language: en-US To: gcc@gcc.gnu.org References: <33a21357ddb10b187935cf4ea269bb5a7a800c1d.camel@tantosonline.com> <2216839E-05A8-4FBC-B86A-7C51E5DBCA90@comcast.net> From: Patrick McGehearty In-Reply-To: <2216839E-05A8-4FBC-B86A-7C51E5DBCA90@comcast.net> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-ClientProxiedBy: SN1PR12CA0059.namprd12.prod.outlook.com (2603:10b6:802:20::30) To BYAPR10MB3208.namprd10.prod.outlook.com (2603:10b6:a03:159::10) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 1841257b-36ab-42d3-7b1b-08d9f667d30a X-MS-TrafficTypeDiagnostic: DM8PR10MB5415:EE_ X-Microsoft-Antispam-PRVS: X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: gPtmayhTjs2XSjsrQ6ifSjFi/baw1g82aSjUsf4n0EstL0QAJpSIrD+rLOdtAiD9AXdHxayUP3Xzuf6G6TzzPOXy/suW466IaTMotqbL9wWMX6ZI1B74nExAyf/qBOHi+rYJvormSKNJJQEGkfAQjUrT3gjX9L7lw/F20B7RFt560jJ6qbqZB0ekwijSBmPtwoVjD2PMeAImFsWQLaUihfslVLoEFe2NLFu05+twsU/FgAbNOTyp+adqwjmWbREp1fGgIa3/qZJkOpYMnYnfG1G+TI4qb7qJ6cuObjN703JdpfB6ETLW3iuuVa42/FCL4zXysrKWwt0iGtSh+ULLHptHg6Jhp77tD+014KZuu9a8n2e8pI0aUiyAuje80Gnw3+o7063yIGxpuLaUadr0KBQ+TKV8Pz3SdCoK/27cOrcpM8q1UnkcKyXHHuCyqoC+q6fyzJ7h0dI9mDdPaTGeJyfrU1zt6SOiWhToRSyAoSNrGx65RQE+MlAyxCfVu2rOr7DlBx38UknKKmZPSnjCMZbgGsLIWCBK96QcRGVaLpjxklJZJb/qS8hX+y4xLsFXwfwGUpjBR5t4RnycN7JqdsYBn+MMfy5GKqlq5QCSAzsPf2CYdg/fqXXMo5Voq8VHqHt5KfE/3yn2lMvBdF8FXRe0NhF+D/A9/UeCMsXlzCrUwYblR9Bz0a6UUqItaWso55o6VEnCrB1lpHT7zCgKJHnu/ru8Zfefw17iAPZFGIzw+zbEZyc985UGNJiiSQ1s83/+S6ebdvaYOYklfYb/UkgQXC3Djg0dQG4x8BpTe4WissWsX0KoFb41lcZvpw2ZaK4R40F9YRq+Ymqypw9DfB5G1dDcfRk1XYs0vS9SM6/TNt8k7fzakNjo4D/dxzI2 X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:BYAPR10MB3208.namprd10.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230001)(366004)(26005)(186003)(2906002)(2616005)(19273905006)(6512007)(3480700007)(83380400001)(8936002)(38100700002)(6666004)(31696002)(6506007)(52116002)(53546011)(36756003)(966005)(66556008)(6486002)(66946007)(8676002)(316002)(66476007)(7116003)(6916009)(38350700002)(86362001)(31686004)(5660300002)(508600001)(45980500001)(43740500002)(563064011); DIR:OUT; SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?SU9xOVdqVFBtVllBdHFFZGJlY0NTZEM3SWlQWEFWSUhDREdLZWhITHpYQ2JS?= =?utf-8?B?Y09zMXJJZU5rbUR5ZFhPemNjdzhxczRiMm1QYzM4MHdWbVc5ZUU5a0x3R2M2?= =?utf-8?B?ZWZVWUhlMmVNa29QS3FRYTd5R1J2Uk12aGhvMk53ekVLU0F1dlV1MDVldEdE?= =?utf-8?B?VGkxbmU3cmVsZTN1ZmNHMEdoRGpQbWNDZGRuTHl1SnpBZ0NrUHNsSStrRlQx?= =?utf-8?B?NWlFMzdqV01lSWt5UzBjVVVZQnNLYTdNSkxtbUN5NDFCZ3lNMU9LWHkrYm1l?= =?utf-8?B?Z0VoTGQxcVhRdnB4akpEUG13SnJTeUI3NEJVVWMvRXhqNEZFOFZ1cUI1VXpI?= =?utf-8?B?TnpESG1yVCtEdDNNK2tmMWdRSzZTSTI0TGd6a1NQdTFSQytQZXFKZGNUSzRE?= =?utf-8?B?NjdtOGsvS2ZHd0Rzb1MySUJacHp4OEk5OGJSRURCcVZiaEk2aGZwNzQ0VERI?= =?utf-8?B?bFhUQnZxb012R1lZMzdqZXdQSy90ZktydUdVWllxYisxV3BBT0dFUEEyVWF5?= =?utf-8?B?YmpYZTkyZ3lrd0IydU5PSWxnY3B0SE9QWVNmdmpJZkU4SjVyeXU1QWx2K1c2?= =?utf-8?B?Mmh2K2hSZXI4N3ZnMzk5dkdpUXY0SnRYLzU1VHFoQXVNMVFER0NLcU1CaHo1?= =?utf-8?B?Snpjdlk1bmJkTys1akIyaUlDemZ5dU5hZlRnUjJUVlhuQXl5TGlTNXBaMlNM?= =?utf-8?B?TVlzMlhZUEU5M2p4ZkVrSzV1MUgzT3o5dG9OTkYrcWw1WVE3UmtYeE82YUhw?= =?utf-8?B?WlhPRWVvUTJtb2xqOVkzckVaTlpBMC9DbTJIRThoM3ZCNU54QlIzQlE1NzNE?= =?utf-8?B?NFEzTEo0aXlvK2s4c3JxYWZDclF3dTE1QmNUc3hFUVpxMVh1bEttWkdqeDla?= =?utf-8?B?dGpHUlR4NVFsLzdCSmJpcFhsUkFwR216T1hPSXJKVlZvcklKVEdWMFBHVml6?= =?utf-8?B?NjRpMkxIY041VzZIV1NpMVFpaFRHbW9DdG5hNk05NHJoOFM1UkRpVjY5Mk9r?= =?utf-8?B?NFV2b1AvcEV6ZGNSOEZrVTY4RGdaTG5QeHJRNldmdnJQM1NHMUR5UWpqcUQw?= =?utf-8?B?QW5ON3Q2cXJMVHRWR1VWWHhWZ1A5ZHRKdUJHMTBod3Y5SXJaLzFGVDFDci9L?= =?utf-8?B?bm1HNzdPTzVqcHk5OGZ2MWVuRjB2dTVZZjlOTmF3N1dkWFJ4S3hwUlpNTkVr?= =?utf-8?B?YjlnaTNnTU9QSnRTdWlJWWtDdVZidTVqSUI0bytaS3ZiM3l5RzJzbVZiT3gy?= =?utf-8?B?M1dwMGlhVnlueFltYWtwRnJzY0E3Y3BGWU95NTZMLzRqSU4xNmFKdi9yQVJt?= =?utf-8?B?VDRXVUJzZ0hocXVCMTBuZGZscVdLQ2xPU2l2NTlFKzhLRFlEd0UxSi9PRW1a?= =?utf-8?B?VjBYZmdwcDU0dG1lanNNNHkxTTNBWHJDSlZxVTc0czMrYjJ2TVN0NEk1eVlV?= =?utf-8?B?eUNZRFU2UmxWSlVwUnN1TGdrRXdya0l2aTU1TU5Xcm1mc3p3RHRua0wrTW4y?= =?utf-8?B?bXJNMzA2bXhEOTAvaVVOTjllMEJzKzNldWRPREk0bUh4MVk3bHFvL0liVTUy?= =?utf-8?B?S3lVOUROVS9mQkFnNTkyMEw5cXdFV3p0Yjc0a0F0RmpIK3VoQ2YvVTFiNG9m?= =?utf-8?B?UTN6elptcHNCeTRVMHJsUFlFS1JZR09rc1NwSUsxTHZKU3M1Z1NxaHdWTkpQ?= =?utf-8?B?cWFBL0lIaDdEOHZWUHA2L2FvckJ5RlJadTlJRGZkOTlTRzJVMmV1NCtCRDBs?= =?utf-8?B?eGIyUWE0TzJBQ3MvSmZYalR3b1d5VUVkOEY2L0c2eVhFZTZTSWcvMFRwMFFT?= =?utf-8?B?T2R1SWVUeTkzQ0Y2ekRxT011UFl6NkFPRW5wdW1rQ2dNc3VocDlBUVdXY0Vv?= =?utf-8?B?d1Q4cUlFZnFRcXFyaURwYnFLRUswN0N4RzgyTlRtcmh4RUczZ3JiLzMxNzEv?= =?utf-8?B?SWpMSlp0eDZSUWV0alVKeUZUbUZ6anRBL0V6bGpuYU1nYlpaNzFvM3BxWFpT?= =?utf-8?B?ajBWR1laRUhLamZ0cFZQSUZaYkZnNzFGTEZYS1hycjlVR0JJc2YvcDIrVitQ?= =?utf-8?B?UkpkaUowRjZ2OFdmNTUvTE56eDdCOWlMR0J6aExReUdCOUZrWHNHcEFoZm8r?= =?utf-8?B?MlpFMURoQ1hmWXBLZGF6cWlhejFUTmp6Mit5RFBoZk9BeS9DNXp0N25BL0Jv?= =?utf-8?B?NmU4bnRidXZTakdXR0Nlb1NmVFZBcXp3RnBzRUxIQkpnRk5seW56MUZtOVBm?= =?utf-8?B?LzlsME5oQUxwdThRMnZqOFNtZEVRPT0=?= X-OriginatorOrg: oracle.com X-MS-Exchange-CrossTenant-Network-Message-Id: 1841257b-36ab-42d3-7b1b-08d9f667d30a X-MS-Exchange-CrossTenant-AuthSource: BYAPR10MB3208.namprd10.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 23 Feb 2022 01:00:03.4410 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: qJInlZU23MHvRTWXYb4+liZOMBjGsXwQwCnk0J9UDDQ870zvcPHBWUBAItm5z7TSM8Jwr9sT0Y8G4NNieGEqRGbMRzG4JoNDkXP9mS3lHM4= X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM8PR10MB5415 X-Proofpoint-Virus-Version: vendor=nai engine=6300 definitions=10266 signatures=677939 X-Proofpoint-Spam-Details: rule=notspam policy=default score=1 bulkscore=0 suspectscore=0 mlxscore=1 spamscore=1 mlxlogscore=198 adultscore=0 phishscore=0 malwarescore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2201110000 definitions=main-2202230000 X-Proofpoint-GUID: 3R5TusBle8Vx2iITPnGBzPR1cVWNWGCI X-Proofpoint-ORIG-GUID: 3R5TusBle8Vx2iITPnGBzPR1cVWNWGCI X-Spam-Status: No, score=-5.4 required=5.0 tests=BAYES_00, DKIM_SIGNED, DKIM_VALID, DKIM_VALID_AU, DKIM_VALID_EF, NICE_REPLY_A, RCVD_IN_DNSWL_LOW, RCVD_IN_MSPIKE_H5, RCVD_IN_MSPIKE_WL, SPF_HELO_NONE, SPF_NONE, TXREP, T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on server2.sourceware.org X-BeenThere: gcc@gcc.gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Gcc mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 23 Feb 2022 01:00:09 -0000 I studied Dhrystone about 30 years ago and found it had a number of flaws back then. For example, most of the loops in the code are only executed 1-3 times, which minimizes the value of hoisting values out of inner loops. Read the Dhrystone wikipedia article for more information. Going back to what benchmarks might be useful... you might consider the Livermore Loops http://www.netlib.org/benchmark/livermorec These are 24 kernels (tight loops) originally in Fortran but ported to C 30 years ago. They are reasonably representative of floating point computational kernels. They are available without a fee. Even if you have no interest in floating point computation for your target architecture, examining the assembly output of these kernels will be helpful in finding where your port of gcc is doing well and where the machine architecture input to the various optimizer phases need some tuning. You also might review that code and write some modest test loops of your own for integer code patterns. Developing good benchmarks is a skill which requires the developer to know the intended purpose of the benchmark. I.e. is our goal to compare optimizer implementations? or different architectures (i.e. arm vs x86)? or different implementations of an architecture    (i.e. intel vs amd or early x86 vs current x86) or ... well, you get the idea. Good luck, - Patrick McGehearty On 2/22/2022 3:49 PM, Paul Koning via Gcc wrote: > >> On Feb 22, 2022, at 4:26 PM, Gary Oblock via Gcc wrote: >> >> Andras, >> >> The whole point of benchmarks is to judge a processor's performance. >> That being said, just crippling GCC is not reasonable because >> processors must be judged in the appropriate context and that >> includes the current state of the art compiler technology. If you have >> a new processor I'd benchmark it using the applications you built it >> for. > Exactly. Part of what you want to see is that GCC optimizes well for the new machine, i.e., that there aren't artifacts of the machine description that get in the way of optimization. > > So you'd want to use applications that are good exercises not just of the code generator but also the optimizer. Dhrystone isn't really that, because it has evolved into mostly an optimizer test, not a machine or code generator test. > > paul >