From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from EUR04-HE1-obe.outbound.protection.outlook.com (mail-eopbgr70053.outbound.protection.outlook.com [40.107.7.53]) by sourceware.org (Postfix) with ESMTPS id 22D90385843E for ; Fri, 8 Jul 2022 10:11:38 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.1 sourceware.org 22D90385843E Authentication-Results: sourceware.org; dmarc=pass (p=none dis=none) header.from=arm.com Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=arm.com ARC-Seal: i=2; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=pass; b=Bp/7odtTJPUe4RGeAY9Y7FW209NkdaMd52EAr4fvkNBdq3GOFK4d/KZpklIulJChW+H++H85++hqqx+igHmd3DZmdijw7DJf9DdhR8EncA2aHy08ZlJRa8FverQDXmnqfQR5ZpnMdAFknPGoMKB/e/+f9X0g1WYwdIm+J1OAfIAyERKLZKmeaqqfJoVD+R1xCOP9JM44PMW5y0VkZmvbhz/lvvN/r6d6u77wUvQEP2CBtWlUj5eyTm0y8gj/HaTxkSShVrsCDvkau+yDlhHeOONTUbUERwscgxQB37rIfWmMvI1r4LEE72/Kndu9GPywd2b3GO7sppeVabS/kMwMrQ== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=bJIWW+Iz2jPiD543ukbX2L2VXSNyiLVBGXh/6ZzTtgg=; b=bcwZ7/SmzJPgmdFExAgpu26idtteRbPmSFiZoJDKNdhO870BeOwa5qukOXm4mumreLEp4QWTtdAYb3DfHZ08assIYDo0EJyF9A3W360bOtN2Gjodqp0xWRVUEnxohe+BYdG6Gy2AXqbSxWPwmg0517r6AkA2GggLlCWFHQRhFTUb/2mphyUYNHqcKW8vjXao3x3iSjOaljN9xQfv02fHQVOrnv8jCPfKWABVHbyQdznKJJdz0hd55N4Hfn+fMvsBOxOF8LJ2orHzccG0+z7A7iiNciMcs/cUvBiX1lIa2aYfbwG3I1RfVMOojJ3ctBfcSII4bG+sDXAvA5nb8pRkQQ== ARC-Authentication-Results: i=2; mx.microsoft.com 1; spf=pass (sender ip is 63.35.35.123) smtp.rcpttodomain=sourceware.org smtp.mailfrom=arm.com; dmarc=pass (p=none sp=none pct=100) action=none header.from=arm.com; dkim=pass (signature was verified) header.d=armh.onmicrosoft.com; arc=pass (0 oda=1 ltdi=1 spf=[1,1,smtp.mailfrom=arm.com] dkim=[1,1,header.d=arm.com] dmarc=[1,1,header.from=arm.com]) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=armh.onmicrosoft.com; s=selector2-armh-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=bJIWW+Iz2jPiD543ukbX2L2VXSNyiLVBGXh/6ZzTtgg=; b=UI9Tsh6tV0tQvRHVCb84ge9n9oh079coEZ5P4U0ocaJNrb6dpBH0b8i5LrAME7/dQDZ6xXIq+m0hGhAXsmG3+OyabOEnrfHB8DhC5IVGq8MJMkLMx3ZX762iKKBjF/7r2ny+59r83QrR/yW/s2REmMV4d2/tlyDEkqnYUfZ7+Y8= Received: from AS9PR01CA0024.eurprd01.prod.exchangelabs.com (2603:10a6:20b:540::29) by DU0PR08MB8186.eurprd08.prod.outlook.com (2603:10a6:10:3ed::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5395.21; Fri, 8 Jul 2022 10:11:34 +0000 Received: from VE1EUR03FT035.eop-EUR03.prod.protection.outlook.com (2603:10a6:20b:540:cafe::50) by AS9PR01CA0024.outlook.office365.com (2603:10a6:20b:540::29) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5417.15 via Frontend Transport; Fri, 8 Jul 2022 10:11:34 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 63.35.35.123) smtp.mailfrom=arm.com; dkim=pass (signature was verified) header.d=armh.onmicrosoft.com;dmarc=pass action=none header.from=arm.com; Received-SPF: Pass (protection.outlook.com: domain of arm.com designates 63.35.35.123 as permitted sender) receiver=protection.outlook.com; client-ip=63.35.35.123; helo=64aa7808-outbound-1.mta.getcheckrecipient.com; pr=C Received: from 64aa7808-outbound-1.mta.getcheckrecipient.com (63.35.35.123) by VE1EUR03FT035.mail.protection.outlook.com (10.152.18.110) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5417.15 via Frontend Transport; Fri, 8 Jul 2022 10:11:33 +0000 Received: ("Tessian outbound afad550a20c6:v122"); Fri, 08 Jul 2022 10:11:33 +0000 X-CheckRecipientChecked: true X-CR-MTA-CID: 8897c3212fba608c X-CR-MTA-TID: 64aa7808 Received: from 49d3b08b232c.2 by 64aa7808-outbound-1.mta.getcheckrecipient.com id 34E9E771-8E7F-479A-922D-54ED33254EA0.1; Fri, 08 Jul 2022 10:11:27 +0000 Received: from EUR01-HE1-obe.outbound.protection.outlook.com by 64aa7808-outbound-1.mta.getcheckrecipient.com with ESMTPS id 49d3b08b232c.2 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384); Fri, 08 Jul 2022 10:11:27 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=AxfRhcG96XYGkRPYL07aRBjplhZT0hJIU2wrHP0rUiL6PZClVoVIti1zpQXkGa7EMGuNb6Nw7fxlNjchzeY4LOdQGu6LOyWda5rWqPrwzjfdM/ANB7vjQ8P1gqfkP2BKYztAj4hefEL+xvtXF3viyn3NYL9LWIGN1HiMiRM9ZrcfIaOIZZLbSLHmBG7ipVvZG4K8RHpfmHzELF9viz1gs5VLgsjfymPPPWQtCTF3HFHpmyYefQ0gi7YrcgFq2N1DsFKosZ1NC/OfPZoOg9mOaDYalUTk/RKhxura/Nr2rNlmmPxN/lLWqI5TzAEouELL/ux/DHqGwbyRFVJtz3L1rA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=bJIWW+Iz2jPiD543ukbX2L2VXSNyiLVBGXh/6ZzTtgg=; b=Vlx48FJQddslawYr7u+34jONQbWFnJJ0Vcc5C+/FD5tobCU874+m7hjE2qQPVYmNaD2jn6gVVowOrZincv9Yh/NktTsT5wZvJbjrpgXJlUYv+d5cMYnzJUtVNgnDI9yNxgKFZj5/A+M0TCPAkLypQ1f1Vhyz+4bZs910AxN/+ukXWki6Ymr31NU0ZGRRQFr4m7VuK/pzl1DZkGgN2PQEikRstkbRkGqosPEWl0KR4KSGD/wIe1h+4Ef/g5bCJqGZAvU60yBk7ty/E75p7EyYO6fqgEBcNpF3AepKDtI15cesIlWec9vrtXcjkXJESWsfAn6Pkfaw/mIPG0Tui/uBnw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=arm.com; dmarc=pass action=none header.from=arm.com; dkim=pass header.d=arm.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=armh.onmicrosoft.com; s=selector2-armh-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=bJIWW+Iz2jPiD543ukbX2L2VXSNyiLVBGXh/6ZzTtgg=; b=UI9Tsh6tV0tQvRHVCb84ge9n9oh079coEZ5P4U0ocaJNrb6dpBH0b8i5LrAME7/dQDZ6xXIq+m0hGhAXsmG3+OyabOEnrfHB8DhC5IVGq8MJMkLMx3ZX762iKKBjF/7r2ny+59r83QrR/yW/s2REmMV4d2/tlyDEkqnYUfZ7+Y8= Authentication-Results-Original: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=arm.com; Received: from VI1PR08MB3390.eurprd08.prod.outlook.com (2603:10a6:803:7d::27) by AM0PR08MB3634.eurprd08.prod.outlook.com (2603:10a6:208:d6::22) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5417.16; Fri, 8 Jul 2022 10:11:17 +0000 Received: from VI1PR08MB3390.eurprd08.prod.outlook.com ([fe80::b950:397d:fea9:e8cc]) by VI1PR08MB3390.eurprd08.prod.outlook.com ([fe80::b950:397d:fea9:e8cc%7]) with mapi id 15.20.5395.021; Fri, 8 Jul 2022 10:11:16 +0000 Message-ID: Date: Fri, 8 Jul 2022 12:11:13 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Thunderbird/91.9.1 Subject: Re: Arm GDB buildbot workers Content-Language: en-US To: Mark Wielaard Cc: buildbot@sourceware.org, Szabolcs Nagy , Luis Machado References: From: Christophe Lyon In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable X-ClientProxiedBy: LO2P265CA0075.GBRP265.PROD.OUTLOOK.COM (2603:10a6:600:8::15) To VI1PR08MB3390.eurprd08.prod.outlook.com (2603:10a6:803:7d::27) MIME-Version: 1.0 X-MS-Office365-Filtering-Correlation-Id: da84baf0-8cd5-4a7d-333a-08da60ca3c66 X-MS-TrafficTypeDiagnostic: AM0PR08MB3634:EE_|VE1EUR03FT035:EE_|DU0PR08MB8186:EE_ x-checkrecipientrouted: true NoDisclaimer: true X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam-Untrusted: BCL:0; X-Microsoft-Antispam-Message-Info-Original: 4tyrqlZc+HM7DcOpOc0EwLiEgIB1a6CxN4TKGjcCcPgA0aiYd2tsFg5JejjO1bAIIuUPAEhh7HwSdOynI60vAjSDG0IsgJ5Rn/VBFsAC9Y36szzjftvl9h6+FFm2IyF0t2nBnZe06NMPowebwBqKNf6aVwQo5vGDRhEKFs2dvecWMrR1mpuHS1Eg03Y/t/Sz74H9btaRbE9OpfNE7iovm4r/fO8plBS9FRP6VrYW2f1GCPj9s5yh+BMExWwzD7+2FZnIaNCZUT+AMKoR2qAYhW1MXcqGJWL31gGJ31hC7fz9Az+i/nKQZCLktVbCihK7EegytVcsRd4zenuH/pJcDW3YJvufmJS3VQs1u65Rs6zsRvoUb5LQTxyoBhSVsHDE0vaV/UhXkjfKM8coNE6BldZwVZn3QvxGAsHLAIunsMxC1FngGGbDWZ7M6jRiXAZVWoXseyZJ1V1CQCmzKhCnmtWljw/rWV3i7oNSWQodpicEiIdg1MZruULh0qYdRwhgP8tSREDe8fCFcdFdcXRJnAOPObydbZQ4jQ3xB9VKzwvZqdXWCBmGGnQIC6BgN/wJf/WKM0jAGJB5+JDv7q08KGE+F4QHzH5x2MQH8eK93MbCnit8U3iTbLDCtvSXGi3WyhqD96uWH4kVj5Dca7MR82V4WUZTh1lm+lZFXEBhrrtKp+EKfTOH2HMv8d0P8ggypYsbdqsYW6tylxwX3W/BEIxL+WFkmuQl99kZ7du510iLLTepTm7qU/sEXJhpZlVr4nzyPjW2LnBokndJoFnPypGOrUXFH/QlxOk7Wt1bPxcdrbSqiwK08/gsE53aRK+rf38bWQt8pkAeCao9TGAlOQ== X-Forefront-Antispam-Report-Untrusted: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:VI1PR08MB3390.eurprd08.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230016)(4636009)(396003)(376002)(39860400002)(346002)(366004)(136003)(54906003)(36756003)(6916009)(3480700007)(83380400001)(186003)(38100700002)(316002)(31686004)(6666004)(41300700001)(478600001)(2616005)(4326008)(8676002)(66476007)(66946007)(44832011)(66556008)(86362001)(5660300002)(8936002)(6486002)(26005)(31696002)(2906002)(53546011)(6506007)(6512007)(45980500001)(43740500002); DIR:OUT; SFP:1101; X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM0PR08MB3634 Original-Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=arm.com; X-EOPAttributedMessage: 0 X-MS-Exchange-Transport-CrossTenantHeadersStripped: VE1EUR03FT035.eop-EUR03.prod.protection.outlook.com X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id-Prvs: da0f65cc-333f-4645-e3a4-08da60ca31fa X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 8ZktvzDrbLOav611vS/44zC7O9tizkSkFU4V6OQVZHD2Ps2XHcc8POby6wDv+WwzHsdxBYXyioAX8J2Kh31gUxYPAOjZy92J15StLAuynf2Cy1xEs7HLpyunOMRD5NdMKmqQYBwgDlfNYMRfzTNNYDYEosSDGSuIgWticLuw6+MueCeDfw3bpyUCgurnhHDQIkCbtuspoepz9YIYmOxevuWQMVP2XH/HbvDWRIXXyDiakXRl44hYIv2F1cS2AohNeBkF8wQDEzU/A9MK2SrMB8CPLuKLTR0iSblNp/wls2VPHDqwgixIO/oslFl2I+J3eErSDIkQ3NH+2sWzPsNAZml9bPB7PzGGSrNhrO9xkSo4Pa1Zs1D6sefJ5qh1Vy787GvRQ8kzZU1QusFWELcBpyDwN7mQ58O+r/hUfMB5uC7XwGm0l1UV23jWBRTLbZcZqrQEhZF37AVKhoaTs4kPsnmoZhaD/49u6dwZB2tdLJtQ86EAcGZhGHnXYRm+vf4OKt6P+ZbrVlI7RSJVedG2lus6vebndHGcqQAXnFiIFhXkHdRzn4qmjQYak2AqYSURydLranMPviTQj/uj8tt3zP9sjq3tY2Ny7w7usm4L8HrTW94tiQ7AcGXE5exUZC4Ldqi60NZmOWNJ/hU6tukIHHb9pZWYgnUZ8z1bXJUdzVQieuiuLwM+lfbCccq0I2iqJOg4mrLkKucnyvoOCWA6+4FDf2ueHaFWebRX7P1b1o+rNBZP0BkRCjmi0uzAhoZBp/4gaMI+k4WkxkhH/woyNomn2OkimaFZreliPlKEGle3cznLn7CBx+yTZL9BEqTjWZsKAsvOUOwPj3uN9h3GkxeNkZ4nP04vpS0YcwzA8cc= X-Forefront-Antispam-Report: CIP:63.35.35.123; CTRY:IE; LANG:en; SCL:1; SRV:; IPV:CAL; SFV:NSPM; H:64aa7808-outbound-1.mta.getcheckrecipient.com; PTR:ec2-63-35-35-123.eu-west-1.compute.amazonaws.com; CAT:NONE; SFS:(13230016)(4636009)(376002)(396003)(136003)(346002)(39860400002)(40470700004)(46966006)(36840700001)(2906002)(6486002)(82310400005)(86362001)(31696002)(478600001)(356005)(70206006)(4326008)(40460700003)(316002)(8676002)(82740400003)(40480700001)(81166007)(36860700001)(44832011)(70586007)(26005)(54906003)(3480700007)(2616005)(6512007)(53546011)(6506007)(41300700001)(186003)(336012)(47076005)(6666004)(83380400001)(8936002)(31686004)(6862004)(5660300002)(36756003)(43740500002); DIR:OUT; SFP:1101; X-OriginatorOrg: arm.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 08 Jul 2022 10:11:33.8243 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: da84baf0-8cd5-4a7d-333a-08da60ca3c66 X-MS-Exchange-CrossTenant-Id: f34e5979-57d9-4aaa-ad4d-b122a662184d X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=f34e5979-57d9-4aaa-ad4d-b122a662184d; Ip=[63.35.35.123]; Helo=[64aa7808-outbound-1.mta.getcheckrecipient.com] X-MS-Exchange-CrossTenant-AuthSource: VE1EUR03FT035.eop-EUR03.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: DU0PR08MB8186 X-Spam-Status: No, score=-13.0 required=5.0 tests=BAYES_00, DKIM_SIGNED, DKIM_VALID, FORGED_SPF_HELO, GIT_PATCH_0, KAM_DMARC_NONE, NICE_REPLY_A, RCVD_IN_DNSWL_NONE, RCVD_IN_MSPIKE_H2, SPF_HELO_PASS, SPF_NONE, TXREP, T_SCC_BODY_TEXT_LINE, UNPARSEABLE_RELAY autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org X-BeenThere: buildbot@sourceware.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "The https://builder.sourceware.org/ buildbot" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 08 Jul 2022 10:11:41 -0000 On 7/8/22 01:13, Mark Wielaard wrote: > Hi Christophe, > > On Thu, Jul 07, 2022 at 03:50:51PM +0200, Christophe Lyon wrote: >> As discussed on IRC we are going to enable workers on our Ampere "big" >> machine. >> >> For a start, we are going to try with GDB, having 4 different docker >> containers on the machine covering ubuntu-20.04/ubuntu-22.04 x >> arm64/armhf, using 4 CPUs each. >> >> I am not sure if we need a single password for all workers, or 4 of them= ? > > You need 4 names, in theory the passwords could be the same for each, > but I'll sent you 4 names with 4 different passwords (off-list). > > Lets name them arm64-ubuntu20_04, arm64-ubuntu22_04, armhf-ubuntu20_04 > and armhf-ubuntu22_04. > >> For each of them that means: >> ncpus:4 >> maxcpus:4 >> max_builds:1 > > OK. See the attached patch, 4 new workers each connected to a gdb CI > builder. > They are up and running! \o/ I'll probably stop/start them several time to make adjustments like "admin name". >> Once these work, I'll add more containers for glibc, binutils and >> hopefully GCC. > > Note that it might be helpful for keeping builds totally separate you > can use a worker for multiple builders. Depending on the number of I am not sure to follow? Why having a worker for multiple builders helps keeping the builds separate= ? My plan was to have 1 container running a single worker/builder. That is 4 containers for 4 GDB "configs (distro x target)", 4 containers for 4 binutils "configs", X containers for X "configs". But since these containers would use the same docker image, I think I'll need to adjust the worker_dir in bb-start.sh, otherwise for instance GDB and binutils containers/workers/builders would share the same dir, which won't work (they would compete for the twistd* files etc...) Do you instead recommend to have 1 (larger) container per distro x target, and run binutils/GDB/GCC builders inside this single container? > vcpus and memory available they can do the builds serially or in > parallal (with max_builds > 1). > >> I think this small patch is desirable: >> diff --git a/builder/containers/bb-start.sh b/builder/containers/bb-star= t.sh >> index 31cdbc9..220e82e 100755 >> --- a/builder/containers/bb-start.sh >> +++ b/builder/containers/bb-start.sh >> @@ -18,6 +18,7 @@ fi >> >> # Fill in the info visible in the buildbot website >> # objcopy gives us the binutils version, iconv the glibc version >> +mkdir -p $worker_dir/info >> echo buildbot@sourceware.org > $worker_dir/info/admin >> echo $IMAGE_NAME > $worker_dir/info/host >> gcc --version | head -1 >> $worker_dir/info/host > > The info dir should have been created by buildbot-worker create-worker. Indeed, now that I have the proper account/passwd, that works better :-) > > BTW. The containers and the bb-start.sh script are somewhat > over-complicated because they are written to be created and > instantiated by the buildbot and so have severa layers of abstraction > that aren't needed if you build the image and start the container > upfront. Ack. They are useful as a starting point. Thanks, Christophe > > Cheers, > > Mark IMPORTANT NOTICE: The contents of this email and any attachments are confid= ential and may also be privileged. If you are not the intended recipient, p= lease notify the sender immediately and do not disclose the contents to any= other person, use it for any purpose, or store or copy the information in = any medium. Thank you.