From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from EUR03-AM5-obe.outbound.protection.outlook.com (mail-eopbgr30046.outbound.protection.outlook.com [40.107.3.46]) by sourceware.org (Postfix) with ESMTPS id 3E53C3858D37; Tue, 26 Apr 2022 07:01:51 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.1 sourceware.org 3E53C3858D37 ARC-Seal: i=2; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=pass; b=e6qyQGqPDyHPJVuP97hAEhaSbIuS4Tk/h3k1jDrqzadyhmwwyH19fqQl2U2Dp4z/u6yZCQNLDOMV38nFl4Ov1nP/9VMQzGi6GnWnBOqS3hlZwJphD6utVk1RMZl/f+FJ7UltqiC7mlOrv3xgXkKFFFyHy9GhMsgwaHfqyC6b62cOYX9tNQS7csuGOMiwdroEbpwFOUE/my4o5xEeG2iQbjbhb9YkqpCF3GJnzKM0F85FBziWgcbWrX+D+GqLvMxHZD1/i8fPsTVQT7uDaVqcG7O80ocKA50cVVxfMTa3d4Gfn5pPR+FWwx5lnQqgLyutuxH5ivYfB/cNCIQZTzCrOA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=2f5+OWj2qXOiUrcGB/gqS4HpN3XX6vgp0TTZwdSlF08=; b=NWQV8pQfC8CXTE2sR/AboxvspZM9JITYporRqaaQDB/Y1GMJmmdHJR9mLFSKjZN4e3Kwfzgd72uhW2uC4o7nLcnehldMw4ZbeklFa81mNsA5vSgM7hErbqiVHpk2V7V+3WX/3WyUP+rayUPOmcdqKBtqzz38EvCii265Bl9CLI1fUIBE0u+pSSQDj21O4aZQeTBhQFOpdNx9zhxYUNTZMzKaKwyEoeOZZ41I/31njq5Qg+8+mKYpct5EaH1MyskgXxiDJSlpMjTDalG5i33W5Lgm3jH7fRk0Vs6DYKCFUJ6yVHCMYLqdshKypjwev6hJ4coIfXuePRIPMArnFV5mJw== ARC-Authentication-Results: i=2; mx.microsoft.com 1; spf=pass (sender ip is 63.35.35.123) smtp.rcpttodomain=sourceware.org smtp.mailfrom=arm.com; dmarc=pass (p=none sp=none pct=100) action=none header.from=arm.com; dkim=pass (signature was verified) header.d=armh.onmicrosoft.com; arc=pass (0 oda=1 ltdi=1 spf=[1,1,smtp.mailfrom=arm.com] dkim=[1,1,header.d=arm.com] dmarc=[1,1,header.from=arm.com]) Received: from DB8PR03CA0028.eurprd03.prod.outlook.com (2603:10a6:10:be::41) by AM6PR08MB3365.eurprd08.prod.outlook.com (2603:10a6:20b:42::24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5186.14; Tue, 26 Apr 2022 07:01:47 +0000 Received: from DB5EUR03FT053.eop-EUR03.prod.protection.outlook.com (2603:10a6:10:be:cafe::c4) by DB8PR03CA0028.outlook.office365.com (2603:10a6:10:be::41) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5186.21 via Frontend Transport; Tue, 26 Apr 2022 07:01:47 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 63.35.35.123) smtp.mailfrom=arm.com; dkim=pass (signature was verified) header.d=armh.onmicrosoft.com;dmarc=pass action=none header.from=arm.com; Received-SPF: Pass (protection.outlook.com: domain of arm.com designates 63.35.35.123 as permitted sender) receiver=protection.outlook.com; client-ip=63.35.35.123; helo=64aa7808-outbound-1.mta.getcheckrecipient.com; Received: from 64aa7808-outbound-1.mta.getcheckrecipient.com (63.35.35.123) by DB5EUR03FT053.mail.protection.outlook.com (10.152.21.119) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5186.14 via Frontend Transport; Tue, 26 Apr 2022 07:01:47 +0000 Received: ("Tessian outbound ac9bb5dd84f6:v118"); Tue, 26 Apr 2022 07:01:47 +0000 X-CheckRecipientChecked: true X-CR-MTA-CID: 37ed771400de7ed1 X-CR-MTA-TID: 64aa7808 Received: from be25b85d81c5.1 by 64aa7808-outbound-1.mta.getcheckrecipient.com id 4EBFF413-D15B-4C49-9AC6-F105417CC022.1; Tue, 26 Apr 2022 07:01:40 +0000 Received: from EUR04-DB3-obe.outbound.protection.outlook.com by 64aa7808-outbound-1.mta.getcheckrecipient.com with ESMTPS id be25b85d81c5.1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384); Tue, 26 Apr 2022 07:01:40 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=hIHYCmF/GYM1EHPtNSpg99qpHnZoFA87vyKIpm/2iGlXLEQpqm2NxqBTInwcMr30S5c/WLOruKCHzFKnhskKjSCOV+9CHtivG9xmAtDrbcYlWiXnMZFnFCL/5Rtzc2wX4zZtjxIfDYYcWJ8hLKjtRdA+6vz+YY2nc85wTPbgmRuNZ3OBgz4IDtjQ3G8ci+2TiSNfq24hW6pnZhpDCrPBI7KD4cv6K20rLNaZ4IjJB5IpgbMxUXNAPhIFf4x5w1SvbW6B1MDewKtel67zimljfFzD1Nv9W38TPExFTQ6RRjkxoAAr0l/M2ufRPoQ6kYa3hPJsqAcT5HQOjm0KkKGdvw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=2f5+OWj2qXOiUrcGB/gqS4HpN3XX6vgp0TTZwdSlF08=; b=ELGbsjGbq52cSHhJ2S0vyoWQTpDoMK6TD6t3ymud/Iz9Ngbu34TyHxkHa2x/kiuOMRnrabCD2zp1k4lrhmffVbEviw83rejNTXVwWcPDLtDi92N6M8Pxb1ZNymc65ZMtveZT7/i5CkHF+WCN95i/yg395yVVyzawvR7s/AYL5j+qQ+AQckWaKJE3rXjHjC8GT/kyTEWYRmV2Y2zSV336VJMgW5ZkKIh5Q6wgxUHBkk0vJKfEu6t3plQuPWUgts4hrdORHCoVQvJqQp97xB2Ru/tfRJImXFOAtImCHc5noFYuC4Qe6zw7elFsL8lkbi0Ybx49RMEKmY2F85igtho/NQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=arm.com; dmarc=pass action=none header.from=arm.com; dkim=pass header.d=arm.com; arc=none Authentication-Results-Original: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=arm.com; Received: from VI1PR08MB3919.eurprd08.prod.outlook.com (2603:10a6:803:c4::31) by VI1PR08MB3694.eurprd08.prod.outlook.com (2603:10a6:803:b6::26) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5186.14; Tue, 26 Apr 2022 07:01:36 +0000 Received: from VI1PR08MB3919.eurprd08.prod.outlook.com ([fe80::7080:6233:cf8f:a8a6]) by VI1PR08MB3919.eurprd08.prod.outlook.com ([fe80::7080:6233:cf8f:a8a6%7]) with mapi id 15.20.5186.021; Tue, 26 Apr 2022 07:01:35 +0000 Message-ID: <524b04b7-a78c-7aae-4605-b40f61e6830c@arm.com> Date: Tue, 26 Apr 2022 08:01:33 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Thunderbird/91.7.0 Subject: Re: Adding binutils to the GNU Toolchain buildbot on sourceware Content-Language: en-US To: Mark Wielaard Cc: "Frank Ch. Eigler" , Overseers mailing list , binutils@sourceware.org, "gdb@sourceware.org" References: <5c1f217a-109c-2973-6c69-abf412133dee@arm.com> From: Luis Machado In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-ClientProxiedBy: LO2P265CA0429.GBRP265.PROD.OUTLOOK.COM (2603:10a6:600:a0::33) To VI1PR08MB3919.eurprd08.prod.outlook.com (2603:10a6:803:c4::31) MIME-Version: 1.0 X-MS-Office365-Filtering-Correlation-Id: 5c67a1ac-4229-42fa-7716-08da2752a18a X-MS-TrafficTypeDiagnostic: VI1PR08MB3694:EE_|DB5EUR03FT053:EE_|AM6PR08MB3365:EE_ X-Microsoft-Antispam-PRVS: x-checkrecipientrouted: true NoDisclaimer: true X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam-Untrusted: BCL:0; X-Microsoft-Antispam-Message-Info-Original: fNWthHK65MCyAGaqwfFE8TCWRY8Xn8tUAw9R5TL8f3gA2s+AzXfPdPdJbnJA+34E3Cta5F2mqFzToRWEsHKS0NdE1pRzBeVcNcjylU3C/5B4ZCB7b0e7JS71wTMJ3qRiz0MSnHa7Wf+jzC61OTL9BDNJGnfbLfc5HGiFt3CHoXixBlXA44hGVrWb6fO8bxUpc7RO4H4RVzQXfbuZ7+lSjh7QOvF/aqn2LU8T1w+1LB3lqW9JGgdCIGkpdNTFpng5wrnV3KzbQdk7HZ6vShAtuUv8XnYuIP6LD46LMZQ3/gOh/akPmHJdD2/Y55V/dELxW2d9g2tNY6JaO7pQ8C2Dy+AdIdxZayZ1v3dDaviqxaCAZE19CEs4e3MCHLBA+sHbCU6fYV68zboAblN0l3nWChlqw+O1yCwDEqt/8/OQVBCx6mt7/gw16qDSa7wWpynpyZbCZV2QRRE8clqdFw3GNR+Qf1tzsmz5RlFA9IUWXDyT66unbLpJoJsQmeLSu+QNj5IhnUKQBSzrJyQaT2SaULre0ruiykzuSxzURVSJ9Qj2GbDhMghUgUJLkPsatCAwUXSnfaCHfnPT+jOYQnURkoJQsPVpGIGmvk450EtEc7HfBTzSIBCTyEezYuLmDDis1taCSYq1+iGcLEeMJsttON6NQ2DXI0hCt9mRyEGL4ITH21d6xIaEGXVBW14V3+1UEUT3q5GRVZXvZl3IzA0O5WGQ3TAhd9YtJpa+zOcdYurmTlYH6yZwLs0cYJU4ylozOqofq79rrRjESGxe6Ztv2Sx9cD5/8IYGdHe+vUc6DUhKb2joN23wxgumgjpYB9l6inyLygKhuK7JNxR1PXVbvg== X-Forefront-Antispam-Report-Untrusted: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:VI1PR08MB3919.eurprd08.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230001)(4636009)(366004)(2616005)(8676002)(4326008)(66476007)(186003)(36756003)(31686004)(316002)(86362001)(66946007)(66556008)(31696002)(44832011)(8936002)(5660300002)(26005)(6512007)(6916009)(966005)(6486002)(54906003)(6506007)(53546011)(508600001)(38100700002)(2906002)(45980500001)(43740500002); DIR:OUT; SFP:1101; X-MS-Exchange-Transport-CrossTenantHeadersStamped: VI1PR08MB3694 Original-Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=arm.com; X-EOPAttributedMessage: 0 X-MS-Exchange-Transport-CrossTenantHeadersStripped: DB5EUR03FT053.eop-EUR03.prod.protection.outlook.com X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id-Prvs: 02547965-e17d-4f20-b8cb-08da275299df X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: iGXtFSHX85ZEWjbineAzOCFAC5tF4t5VW58uB+Ih2RTX8sAF9LB3aC0hOjg4YoYOS/El6s+4gUbvXxbKyeD/eN/j+WJnaaln3U3/rjMluUxld9zQw3CxsK1G/jIM09juwzvCZIjP2/yStH++C8iyHkThF47ar8Et6Ycjb8OA/hdap2UlAOLq87+4fCC5aXxMJTTgmpLQzGlNYNrT6AnsA8Ibj1cXus1Uai9QRtPuLQ6kWxA22kswNd6lkVZzWnee2k8SNr2fo9oI95bU8YKbDYM1EiOzZiyiAfhl1EoWfvHblnbm5RQE7i5inaIj86hgEW+gJZ60QwoB6ImhhYzt6qzh5Td5mfnYzv/1054k30OlIMCfbDEzIcSaKvtqFsiio3U7xn/pgCeUTOSgQ5NR1MxUg77fNsoXGEoEBlDEqQeK65vNxL6iOxzwQ3mFIf1v7dnBv+dLYM8G6N9JiiSfIY8D3qUkCLfBiMHzSiZpY6epggCGAdODIliLW3Yl2WI5O0pWUO1oOpgjFJJKN/zAGt2tChM6fBeKB6EHnz3pMWkIFMG7VYI4fl/mtVhrSuPPaqdcxWIXSBt0n4W9E5EGJsIS36vcjCRHqHJvdtwDUZYVLAMVeEpQ38IUJ1Q/A1wJaHhRnygoiy3zbZEY3jETtbDdu1UXFKuJW7xeW44N8edQ0szcglqgGJrHREm5Q4cqVKn0gi10zZN0eQDWVOWiD1DXl+WT2wj8xADTQOy1zlKINFNtyyll9X7rV7pZbfPnDC96OhSMDESI0hnuK14F58uhz2DAQmgofZjyZiRJur0= X-Forefront-Antispam-Report: CIP:63.35.35.123; CTRY:IE; LANG:en; SCL:1; SRV:; IPV:CAL; SFV:NSPM; H:64aa7808-outbound-1.mta.getcheckrecipient.com; PTR:ec2-63-35-35-123.eu-west-1.compute.amazonaws.com; CAT:NONE; SFS:(13230001)(4636009)(36840700001)(46966006)(40470700004)(186003)(508600001)(5660300002)(8936002)(40460700003)(47076005)(966005)(44832011)(6486002)(36756003)(336012)(316002)(2616005)(82310400005)(54906003)(70586007)(2906002)(53546011)(356005)(70206006)(450100002)(31696002)(81166007)(86362001)(26005)(6506007)(36860700001)(6862004)(8676002)(6512007)(4326008)(31686004)(43740500002); DIR:OUT; SFP:1101; X-OriginatorOrg: arm.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 26 Apr 2022 07:01:47.7198 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 5c67a1ac-4229-42fa-7716-08da2752a18a X-MS-Exchange-CrossTenant-Id: f34e5979-57d9-4aaa-ad4d-b122a662184d X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=f34e5979-57d9-4aaa-ad4d-b122a662184d; Ip=[63.35.35.123]; Helo=[64aa7808-outbound-1.mta.getcheckrecipient.com] X-MS-Exchange-CrossTenant-AuthSource: DB5EUR03FT053.eop-EUR03.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM6PR08MB3365 X-Spam-Status: No, score=-7.9 required=5.0 tests=BAYES_00, DKIM_SIGNED, DKIM_VALID, NICE_REPLY_A, RCVD_IN_DNSWL_NONE, RCVD_IN_MSPIKE_H2, SPF_HELO_PASS, SPF_PASS, TXREP, UNPARSEABLE_RELAY autolearn=ham autolearn_force=no version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on server2.sourceware.org X-BeenThere: gdb@sourceware.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Gdb mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Apr 2022 07:01:54 -0000 Hi Mark, I see Frank has put together a worker, but I just wanted to reply to some points. On 4/25/22 19:20, Mark Wielaard wrote: > Hi Luis, > > On Mon, Apr 25, 2022 at 01:16:44PM +0100, Luis Machado wrote: >> On 4/25/22 11:43, Frank Ch. Eigler wrote: >>>> As a general comment, I think we should have a single buildbot entry for the >>>> whole of binutils-gdb. >>> >>> Perhaps! >>> >>>> Given changes to bfd and opcodes can affect gdb, why not build gdb alongside >>>> the other tools? You don't need to run the gdb testsuite, which should make >>>> things much more deterministic. >>> >>> But this is not an argument for building gdb as a part of testing binutils. >>> This is an argument for building & testing gdb if binutils changes. >>> That is: an additional buildbot job >> >> An additional buildbot job for gdb/gdbserver would be fine. It's just that a >> single build for everything is simpler, in my opinion. >> >> Is the idea to revive the old buildbot we had for GDB, but for binutils? > > We could provide some of the builds that the old buildbot did for > GDB. But the new builder is not GDB specific and I hope we can learn > from the old gdb buildbot. > > The problem with the old gdb buildbot is that it did too much and had > flaky test results. This caused people to not care, think the reports > were annoying, broken builds sometimes only got reported after hours or > even days. > > I think we should try to keep builds/checks under 10 minutes, that the > checks should be for things that the maintainers think should always > be green. So that you get a report about something important breaking > within 10 minutes while you still know what you did. Another reason to > keep build/check times short is so you can test multiple commits per > hour. I agree with the quick build idea. That's why I suggested only making sure gdb/gdbserver/sim builds properly. That's reasonably reliable. Unfortunately gdb's testsuite is not too reliable. It's been improved over the years, but still gives quite a bit of non-deterministic results based on distro version/compiler version etc. So I'd leave those out in favor of just making sure things build properly. If this effort can accomodate the gdb/gdbserver/sim builds, that would be great. I don't mean to broaden the scope of the initial proposed effort, but I think it is beneficial to make sure everything is building OK. > > If there are extra resources then we can also add builders that take > longer and/or run testsuites on arches/distros that are known > broken. But those would then probably not sent out reports but you > would use them to see the current status of some setup that might not > be 100% green. And that would probably mean adding more > hardware/workers. That makes sense, but gdb-wise I think that can wait. > > I assume that knowing that gdb and gdbserver still build OK, without > running any tests might be important to the gdb maintainers. And that > just a build of gdb and gdbserver will take < 10 minutes on most > setups. > > If so lets just pick one or more of the workers which seem like stable > distros/arches that should always build gdb: > https://builder.sourceware.org/buildbot/#/workers > (don't pick sourceware, which is special, debian-arm64, debian-armhf, > debian-i386 or fedora-ppc64 which are too slow) > > Provide a file list (directories) of files in the binutils-gdb.git > repo that should trigger a build. > > A configure and make line that does a quick build for just > gdb/gdbserver which should always build. I think the following will do: ./configure --enable-targets=all; make all-gdb all-gdbserver or ./configure --enable-targets=all --disable-sim; make all-gdb all-gdbserver gdbserver, unlike gdb, will only build natively, hence why it would benefit from being built everywhere. > > If the is a make check-something that can be executed quickly, < 5 > minutes runtime, and that should always be green please include > it. But please exclude anything that takes too long, isn't known > all-green or contains flaky tests. Some tests should always work, no matter what. We could hand-pick some tests from the GDB testsuite that we consider critical. I don't think we should focus on that at this point though. > > And the mailinglist to which to report any failing commits. > gdb-patches I assume? gdb-testers should be fine. > > Cheers, > > Mark >