[Bug web/39125] New: trunk revision 143992 - Too many Testsuite FAILs = email > 400K = bounce

[Bug web/39125] New: trunk revision 143992 - Too many Testsuite FAILs = email > 400K = bounce

[rob1weld at aol dot com]

I hope "Web" is the correct 'Component' as it is not the "Testsuite"
that is at fault but the mail-handler that needs some tweaking.


On the Platform i386-pc-solaris2.11 (and possibly others) there
are so many "test for excess errors" FAILs that the email created
by "contrib/test_summary" is over 400000 bytes (a little over 430k).


This causes a bounce reply message which _might_ mean that
tests with the most failures (and require fixing quicker)
will not be included in: http://gcc.gnu.org/ml/gcc-testresults/2009-02/


Here is the email:

Date:   Fri, 6 Feb 2009 5:15 am
Hi. This is the qmail-send program at sourceware.org.
I'm afraid I wasn't able to deliver your message to the following addresses.
This is a permanent error; I've given up. Sorry it didn't work out.

<gcc-testresults@gcc.gnu.org>:
ezmlm-reject: fatal: Sorry, I don't accept messages larger than 400000 bytes 
(#5.2.3)

--- Enclosed are the original headers of the message.

Attached Message
...


You actually need to make the email quite a bit less than 400k.

I tried ~390k and it was rejected too (and the "Attached Message"
headers were empty!). I ended up having to delete MANY results
to get the email down to a size of ~380k so it would be accepted.

Here is a Testsuite result (many libstdc++ FAILs deleted):
http://gcc.gnu.org/ml/gcc-testresults/2009-02/msg00709.html

Rob


-- 
           Summary: trunk revision 143992 - Too many Testsuite FAILs = email
                    > 400K = bounce
           Product: gcc
           Version: 4.4.0
            Status: UNCONFIRMED
          Severity: critical
          Priority: P3
         Component: web
        AssignedTo: unassigned at gcc dot gnu dot org
        ReportedBy: rob1weld at aol dot com


http://gcc.gnu.org/bugzilla/show_bug.cgi?id=39125

[Bug web/39125] trunk revision 143992 - Too many Testsuite FAILs = email > 400K = bounce

[joseph at codesourcery dot com]

------- Comment #1 from joseph at codesourcery dot com  2009-02-08 19:16 -------
Subject: Re:   New: trunk revision 143992 - Too many Testsuite
 FAILs = email > 400K = bounce

On Sat, 7 Feb 2009, rob1weld at aol dot com wrote:

> This causes a bounce reply message which _might_ mean that
> tests with the most failures (and require fixing quicker)
> will not be included in: http://gcc.gnu.org/ml/gcc-testresults/2009-02/

The purpose of the gcc-testresults list is not for humans to read and 
identify bugs to fix; it is so that if you have a failure you can do a 
search and see what subset of platforms it appears on and when it appeared 
on those platforms, and maybe learn more about the underlying cause that 
way.

If a target is *completely or substantially broken*, a failure of a test 
there is unlikely to be related to a failure of that test on a target that 
is not completely or substantially broken, so results for such targets add 
little value, and the filter serves a useful purpose in avoiding 
cluttering gcc-testresults with completely broken results and wasting 
bandwidth and disk space for copies of completely broken results.

If your tests show such substantial breakage that the results bounce, you 
should fix the problems shown until the results are clean enough, or file 
a clear and specific bug report about the issues shown *only if you can 
make sure it really is the target support that is broken, not the test 
environment on your specific system*.  (Such breakage can easily be a 
problem with your system, not with GCC.  For example, if you have a broken 
version of expect that truncates output, as discussed in bug 12096.)


-- 


http://gcc.gnu.org/bugzilla/show_bug.cgi?id=39125

[Bug web/39125] trunk revision 143992 - Too many Testsuite FAILs = email > 400K = bounce

[rob1weld at aol dot com]

------- Comment #2 from rob1weld at aol dot com  2009-02-09 13:50 -------
I tried to lower the "Priority" but I can not alter my own Bug Reports.

(In reply to comment #1)
> Subject: Re:   New: trunk revision 143992 - Too many Testsuite
>  FAILs = email > 400K = bounce
> On Sat, 7 Feb 2009, rob1weld at aol dot com wrote:
> > This causes a bounce reply message which _might_ mean that
> > tests with the most failures (and require fixing quicker)
> > will not be included in: http://gcc.gnu.org/ml/gcc-testresults/2009-02/
> 
> The purpose of the gcc-testresults list is not for humans to read and 
> identify bugs to fix; it is so that if you have a failure you can do a 
> ...
...
> If a target is *completely or substantially broken*, a failure of a test 
> there is unlikely to be related to a failure of that test on a target that 
> is not completely or substantially broken, so results for such targets add 
> little value, and the filter serves a useful purpose in avoiding 
> cluttering gcc-testresults with completely broken results and wasting 
> bandwidth and disk space for copies of completely broken results.
> 
> If your tests show such substantial breakage that the results bounce, you 
> should fix the problems shown until the results are clean enough, or file 

Hi Joseph,

I have investigated the reason behind the extra messages and combined with
your comments (even though you are !@gnu.org) I an going to reduce the
"Severity".

If someone who runs this website (and/or those scripts) desires to increase
the mail limit by 50k then they can; and if they do not desire to do so then
that is OK (if they want reports to bounce when over the limit they set).

Thanks,
Rob

----

On an unrelated note:

You can fix these messages by either "doing the wrong thing" and rolling
back recent changes in the Trunk which exposed this Bug (in ld) or you
can upgrade your Operating System to OpenSolaris 2009.06 (that may be 
tough for some people to do). So time for you to upgrade ...


-- 

rob1weld at aol dot com changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
           Severity|critical                    |major


http://gcc.gnu.org/bugzilla/show_bug.cgi?id=39125

[Bug web/39125] Too many Testsuite FAILs = email > 400K = bounce

[manu at gcc dot gnu dot org]

------- Comment #3 from manu at gcc dot gnu dot org  2009-02-12 15:06 -------
Closed as WONTFIX per Joseph comments. Thanks for the report nonetheless.


-- 

manu at gcc dot gnu dot org changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |manu at gcc dot gnu dot org
             Status|UNCONFIRMED                 |RESOLVED
         Resolution|                            |INVALID
            Summary|trunk revision 143992 - Too |Too many Testsuite FAILs =
                   |many Testsuite FAILs = email|email > 400K = bounce
                   |> 400K = bounce             |


http://gcc.gnu.org/bugzilla/show_bug.cgi?id=39125