From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-ed1-x52e.google.com (mail-ed1-x52e.google.com [IPv6:2a00:1450:4864:20::52e]) by sourceware.org (Postfix) with ESMTPS id 57BD03847718 for ; Wed, 3 Apr 2024 08:22:33 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org 57BD03847718 Authentication-Results: sourceware.org; dmarc=pass (p=none dis=none) header.from=linaro.org Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=linaro.org ARC-Filter: OpenARC Filter v1.0.0 sourceware.org 57BD03847718 Authentication-Results: server2.sourceware.org; arc=none smtp.remote-ip=2a00:1450:4864:20::52e ARC-Seal: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1712132555; cv=none; b=ViTQr/WyC8uE1DQLbdXLKOt9TGgyDXCSy7eCflJoRwqPPd+im47hhYsKstVWkNjqLk6hdMM70L4G7pESYNjJSnqq2ehljGkcXp4CkB1laqGU/vFN0NbGINeAaF6QnSgsT78bir/Dyx7mOB1oqsIWdMalX+fxd6ntL7g854Pmuek= ARC-Message-Signature: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1712132555; c=relaxed/simple; bh=BZMn75XgI2+o4bDWSmaPZ0MfVUDUF0dnRa6LBpdY8Xw=; h=DKIM-Signature:MIME-Version:From:Date:Message-ID:Subject:To; b=ndkC6/RjjJJY5u87qtrBSR2bghEUnzG8Ur3QSnIkfhZw3fzCeKxlSQVMveRvQRtDAPH/JyP3QIVxOv7gQWWUdAY6coH50phpablL+9DLS1wlatwEY2BxTb5KwQMlpUaghIm/M4pR2FlWC97d63nxnFkxhYcCr9F645xhB6GJCUE= ARC-Authentication-Results: i=1; server2.sourceware.org Received: by mail-ed1-x52e.google.com with SMTP id 4fb4d7f45d1cf-56df87057bbso1435847a12.3 for ; Wed, 03 Apr 2024 01:22:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; t=1712132552; x=1712737352; darn=gcc.gnu.org; h=content-transfer-encoding:cc:to:subject:message-id:date:from :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=fZ0Ykr9db+CsTI6dwTuEYs30wV/BzbOIarwxpevxEnk=; b=pSBRQdarbhVqye3b1ndfEYwH/gJTu2HdzylLLYYG2OjyCDKxRSV4bKOSdDW4RZ2Lkl g6NZTWz0IWI/otugj0IbI/sEo80SXnfxbAcVIM7v2NsRtecujSdLb1Hd3+UE6kja8jaY KWJucl6qDd4+WQSpVkZlp9332q9Mv4X50YkBErfG1dexysoKBAh3YAF69b8H+x5hIOtI b/CCiIPj+hlFBn4T/fslj9XTOmkBFa4T8ZbqZAOzTlYfHjxq1cHuRfowuv8dnvySz70g kSHx6T1ziSBOTTehq0S+on3MwbgxMa0mxAeBMfPcbthxgl7SmldGA7ZYx+GnhJtK9VZa qxBw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1712132552; x=1712737352; h=content-transfer-encoding:cc:to:subject:message-id:date:from :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=fZ0Ykr9db+CsTI6dwTuEYs30wV/BzbOIarwxpevxEnk=; b=fzHiGFRb0mdUhyXS45XnCq8Yf3wFFqfKouAuRd7N5K3Qb1PX78Q5CzBqaZSptHVubU 5dF6rpdClxniUjeRAmCIburWqCLrKQVFlphhtvNK/hWyazGFYQa/E7K8njgTgo3gVf54 0EAGJEKHO0q5EVTREcR/nFdMvDgfkJ/s2tWKnC6sOUzGk9l+SyRbt3vJPjtL9RpYY/eJ Zy1JJYtHDGY6HTp0Hjgqmu09PeOCZvg3fPTEwSmI3bLXe/4eoEMUCI+SPYgui0hallJt QfD6eJtHBsefEU7rsAA6DwgKjT6SuOh2sOlUxZTTtr8noQJ/ARD4K+z7+fTDQv+cGDIh 4KaA== X-Forwarded-Encrypted: i=1; AJvYcCXhcKKvdwO/YKUqor4YhztOoJ+GGvJWwmDZTKY+Wf0mwuHTqEZREes0c7MqfM6ExkdAVIwQdVi6Bdz2HzylTu8= X-Gm-Message-State: AOJu0YxOv242bzXnoSHQFmi92f75T22Yi/tDFbCcG7VAXL4Adi9nJ97I pU0suC5wIa7LS7mIxITrBG7rRDvFoT82P0M+/JANsbQre3FdFSR3jOv4kh6jM/Zo6n02kn8mnG9 rzXKUPNOFRW3VV2ccbwCmVb2Tc5WSAuL1Do2XYw== X-Google-Smtp-Source: AGHT+IGwE6cRDJS1sZuSCAU4AwVp2Xge9Je31IaFtNfOd889wet/umuKawQcO4oNsdhUzkTNpZq5JKDEGR7e1pd5IkI= X-Received: by 2002:a17:906:7245:b0:a4e:2269:bc21 with SMTP id n5-20020a170906724500b00a4e2269bc21mr9653459ejk.1.1712132551828; Wed, 03 Apr 2024 01:22:31 -0700 (PDT) MIME-Version: 1.0 From: Christophe Lyon Date: Wed, 3 Apr 2024 10:22:24 +0200 Message-ID: Subject: Patches submission policy change To: binutils@sourceware.org, GCC Mailing List , gdb@sourceware.org, Nick Clifton , Richard Biener , Jakub Jelinek , Joel Brobecker , "Carlos O'Donell" Cc: Maxim Kuvyrkov , Thiago Bauermann , Adhemerval Zanella Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spam-Status: No, score=-3.9 required=5.0 tests=BAYES_00,DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,KAM_MANYTO,KAM_SHORT,RCVD_IN_DNSWL_NONE,SPF_HELO_NONE,SPF_PASS,TXREP autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org List-Id: Dear release managers and developers, TL;DR: For the sake of improving precommit CI coverage and simplifying workflows, I=E2=80=99d like to request a patch submission policy change, so that we now include regenerated files. This was discussed during the last GNU toolchain office hours meeting [1] (2024-03-28). Benefits or this change include: - Increased compatibility with precommit CI - No need to manually edit patches before submitting, thus the =E2=80=9Cgit send-email=E2=80=9D workflow is simplified - Patch reviewers can be confident that the committed patch will be exactly what they approved - Precommit CI can test exactly what has been submitted Any concerns/objections? As discussed on the lists and during the meeting, we have been facing issues with testing a class of patches: those which imply regenerating some files. Indeed, for binutils and gcc, the current patch submission policy is to *not* include the regenerated files (IIUC the policy is different for gdb [2]). This means that precommit CI receives an incomplete patch, leading to wrong and misleading regression reports, and complaints/frustration. (our notifications now include a warning, making it clear that we do not regenerate files ;-) ) I thought the solution was as easy as adding =E2=80=93enable-maintainer-mod= e to the configure arguments but this has proven to be broken (random failures with highly parallel builds). I tried to workaround that by adding new =E2=80=9Cregenerate=E2=80=9D rules in the makefiles, that we cou= ld build at -j1 before running the real build with a higher parallelism level, but this is not ideal, not to mention that in the case of gcc, configuring target libraries requires having built all-gcc before, which is quite slow at -j1. Another approach used in binutils and gdb builtbots is a dedicated script (aka autoregen.py) which calls autotools as appropriate. It could be extended to update other types of files, but this can be a bit tricky (eg. some opcodes files require to build a generator first, some doc fragments also use non-trivial build sequences), and it creates a maintenance issue: the build recipe is duplicated in the script and in the makefiles. Such a script has proven to be useful though in postcommit CI, to catch regeneration errors. Having said that, it seems that for the sake of improving usefulness of precommit CI, the simplest way forward is to change the policy to include regenerated files. This does not seem to be a burden for developers, since they have to regenerate the files before pushing their patches anyway, and it also enables reviewers to make sure the generated files are correct. Said differently, if you want to increase the chances of having your patches tested by precommit CI, make sure to include all the regenerated files, otherwise you might receive failure notifications. Any concerns/objections? Thanks, Christophe [1] https://gcc.gnu.org/wiki/OfficeHours#Meeting:_2024-03-28_.40_1100h_EST5= EDT [2] https://inbox.sourceware.org/gdb/cc0a5c86-a041-429a-9890-efd3937606e5@s= imark.ca/