From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [216.205.24.124]) by sourceware.org (Postfix) with ESMTP id D6761385800D for ; Wed, 14 Jul 2021 20:43:59 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.1 sourceware.org D6761385800D Received: from mail-qk1-f200.google.com (mail-qk1-f200.google.com [209.85.222.200]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-555-HbrKSl_AO16xiHZodAPY7w-1; Wed, 14 Jul 2021 16:43:56 -0400 X-MC-Unique: HbrKSl_AO16xiHZodAPY7w-1 Received: by mail-qk1-f200.google.com with SMTP id e13-20020a37e50d0000b02903ad5730c883so2122590qkg.22 for ; Wed, 14 Jul 2021 13:43:56 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:organization :message-id:date:user-agent:mime-version:in-reply-to :content-language:content-transfer-encoding; bh=R/uiWl1s4TIlsoghBSXylWHWzzZmhVzkdaueti0T6Lo=; b=JZjyRXCMD21CauppRy3DPurvuAAjg4FRT/gUoEUdm9ajuShgeU4bTEPflNPQ+fO70/ weUKYci2LvuNWZjeSocs29HnB3A5udYEgJpNy51nGW5cwACHhwziDka13unxNJ8Lo2Le FAN41Mbsxj+ngTyiJ1cBvH0v3qhWZwAqdCoP/EVCCBNZNgA7i8LikVWbja/KoF9K3J6W /kWkQlRT1qhmMQJ7GA7YZPcEUFiZ7rxJo+umEcEZQ5cJ0aOr4IbL87kcEjTG3rLuBdne gk01qm9GCF4CnZrOb7MbBxOZMdmd0w3JCEynAiexGU4FATB6JQT5KtW5up0JfETWEvfs CgUg== X-Gm-Message-State: AOAM5317W5LWMHTMM1awdt2v/U5SjAwd5pNScXJQmnsKc/XKkbdwBFrc EmRIStKFAlBZYnXcmxyC3XAo9tFIjBpzx6jKai0+F34giwkMqhcLlGTZZeH5D7CK09SAX/DV/ZL +Q+QzziiVhkii9Mr5lJFg9/pjxj7sKpNns2sVhbxBPWx4yNtugfgBaOuZXh+t37LypKWmqw== X-Received: by 2002:a05:6214:20a6:: with SMTP id 6mr12578339qvd.13.1626295435690; Wed, 14 Jul 2021 13:43:55 -0700 (PDT) X-Google-Smtp-Source: ABdhPJxJJH9YAIz/SpUcU4zTtCsLeno6AGayTZ5MK4xdXUm/8+ZoDg+kkRvlbzTa1jvoP252PMRnjA== X-Received: by 2002:a05:6214:20a6:: with SMTP id 6mr12578323qvd.13.1626295435474; Wed, 14 Jul 2021 13:43:55 -0700 (PDT) Received: from [192.168.1.16] (198-84-214-74.cpe.teksavvy.com. [198.84.214.74]) by smtp.gmail.com with ESMTPSA id s3sm1209170qtn.4.2021.07.14.13.43.54 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 14 Jul 2021 13:43:54 -0700 (PDT) Subject: Re: Buildbot improvements To: DJ Delorie , Adhemerval Zanella Cc: libc-alpha@sourceware.org References: From: Carlos O'Donell Organization: Red Hat Message-ID: <5afdcee8-d5c5-9e7a-c7a5-4a9546393021@redhat.com> Date: Wed, 14 Jul 2021 16:43:53 -0400 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.11.0 MIME-Version: 1.0 In-Reply-To: X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-6.1 required=5.0 tests=BAYES_00, DKIMWL_WL_HIGH, DKIM_SIGNED, DKIM_VALID, DKIM_VALID_AU, DKIM_VALID_EF, NICE_REPLY_A, RCVD_IN_DNSWL_LOW, RCVD_IN_MSPIKE_H4, RCVD_IN_MSPIKE_WL, SPF_HELO_NONE, SPF_NONE, TXREP autolearn=ham autolearn_force=no version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on server2.sourceware.org X-BeenThere: libc-alpha@sourceware.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Libc-alpha mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 14 Jul 2021 20:44:01 -0000 On 7/13/21 3:15 PM, DJ Delorie wrote: >> Another nice thing to have would be to dump a line where one could use >> to download the container used to run the tests to reproduce it locally >> (it would still be subject to underlying kernel). > > That one's trickier, for various reasons. The container *description* > is trivial (it's in git) but the container is rebuilt *often* - every > time there's a git commit, the baseline is rebuilt, and that uses > whatever the latest Fedora baseline is. For security reasons, we > discard every build container after every build - there's no telling > what evil a patch in a mailing list might have - so those get rebuilt > for every patch. > > Plus, a built container is pretty big. I wouldn't want to have to store > and/or transmit those. About half a gig per build just for the > build-specific portions, plus whatever the Fedora baseline adds. > > So either it's a lot of data to move around, or I can't guarantee the > same contents as was built. In my case (the 32-bit builder) it's > trivial to just run your own local 32-bit builder. In the future, we > hope that build bots will be running on vendor-specific hardware that > might be difficult for the public to obtain, and then the reasoning > might differ in favor of storing built containers. OTOH we expect those > builds to be of interest to those vendors, who have easier access to > those containers anyway ;-) ... however, we could output a set of instructions that when used in a script could reconstitute the built container? This would mean that for each test we ran the developer could use the instruction steps to reconstitute the container. I think there is a good reproducibility argument here. -- Cheers, Carlos.