From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail.sergiodj.net (mail.sergiodj.net [IPv6:2607:5300:60:3666::3]) by sourceware.org (Postfix) with ESMTPS id 34D5E385780E for ; Wed, 14 Oct 2020 19:03:05 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.3.2 sourceware.org 34D5E385780E Received: from localhost (bras-base-toroon1016w-grc-22-76-65-45-3.dsl.bell.ca [76.65.45.3]) by mail.sergiodj.net (Postfix) with ESMTPSA id 54D0BA00E3; Wed, 14 Oct 2020 15:03:04 -0400 (EDT) From: Sergio Durigan Junior To: Simon Marchi Cc: Luis Machado , "gdb\@sourceware.org" Subject: Re: Regressions getting more common References: X-URL: http://blog.sergiodj.net Date: Wed, 14 Oct 2020 15:03:04 -0400 In-Reply-To: (Simon Marchi's message of "Wed, 14 Oct 2020 10:41:45 -0400") Message-ID: <87v9fcbpg7.fsf@paluero> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.3 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Status: No, score=-3.9 required=5.0 tests=BAYES_00, DKIM_SIGNED, DKIM_VALID, DKIM_VALID_AU, DKIM_VALID_EF, SPF_HELO_NONE, SPF_PASS, TXREP autolearn=ham autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on server2.sourceware.org X-BeenThere: gdb@sourceware.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Gdb mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 14 Oct 2020 19:03:06 -0000 On Wednesday, October 14 2020, Simon Marchi wrote: > Then, we can look at having try jobs work again. I never really liked > submitting try jobs through the buildbot command line tool, I always > found there was to little feedback (did my upload work? what jobs did I > initiate?). I would receive test results by email and would have a ahrd > time figuring out which result was for which patch. > > One idea would be to re-use the now abandonned Gerrit instance for this. > Those who have use Gerrit will probably agree that it integrates quite > well with CI. After pushing your patch for review, you can ask the CI > to test a given patch (often by setting a label on it). The CI posts a > comment on the patch with a link to the build, so you can follow it if > you want. Once it has ran, the CI posts comments on the patch to say > that version N of the patch has this result, again with a link to the > build. There is another idea, which is simpler to implement, which is to make the Buildbot monitor user branches with a special naming convention, like user/sergiodj/try-foobar or some such. When a new branch showed up, the Buildbot would then build it, test things, and then send the results via email to the author of the commit (bonus points if it can also send an email to the committer). One of the problems to be solved (not particular to this solution, but to the Buildbot in general) is to decide which upstream commit the Buildbot will compare the results against. If you're considering running one/two builds per day, this problem becomes easier to solve. I had a hard time solving it because I was running builds for every commit, as you know. This was next on my TODO list for the Buildbot (along with stop building separate commits, and start grouping them), but I could not find the time to implement it. -- Sergio GPG key ID: 237A 54B1 0287 28BF 00EF 31F4 D0EB 7628 65FC 5E36 Please send encrypted e-mail if possible https://sergiodj.net/