Re: How to skip test when building glibc

[Letu Ren <fantasquex@gmail.com>]

On Thu, Jun 16, 2022 at 4:33 AM Adhemerval Zanella
<adhemerval.zanella@linaro.org> wrote:
>
> I think ideally we should either split the tests that are taking too much time
> or increase the minimum expected timeout (so TIMEOUT_FACTOR is not
> really needed as a default option).

Yes, I totally agree with you. I think I should only increase the
timeout limit to those tests which are necessary. Setting
TIMEOUTFACTOR of all tests to 300 is not a good idea. However I don't
know how to do that. I haven't figured out where the timeout limit is
set after looking through code and doc. Should I report those failures
to glibc bug mailing list, because some of them aren't mentioned in
release notes?

> For the tests that haven’t failed due a TIMEOUT, which are the *.out contents?

stdlib/test-bz22786 is another failure due to a timeout issue, It's
just my carelessness. So we have four failures left. Their *.out
contents are listed below.

# cat math/test-float-j0.out
testing float (without inline functions)
Failure: Test: j0_upward (0x2.67a2a4p+0)
Result:
is:          5.64343701e-08   0x1.e4c47ep-25
should be:   5.64344021e-08   0x1.e4c490p-25
difference:  3.19744232e-14   0x1.200000p-45
ulp       :  9.0000
max.ulp   :  8.0000
Maximal error of `j0_upward'
is      : 9 ulp
accepted: 8 ulp

Test suite completed:
 348 test cases plus 344 tests for exception flags and
   344 tests for errno executed.
 2 errors occurred.

# cat math/test-float32-j0.out
testing _Float32 (without inline functions)
Failure: Test: j0_upward (0x2.67a2a4p+0)
Result:
is:          5.64343701e-08   0x1.e4c47ep-25
should be:   5.64344021e-08   0x1.e4c490p-25
difference:  3.19744232e-14   0x1.200000p-45
ulp       :  9.0000
max.ulp   :  8.0000
Maximal error of `j0_upward'
is      : 9 ulp
accepted: 8 ulp

Test suite completed:
 348 test cases plus 344 tests for exception flags and
   344 tests for errno executed.
 2 errors occurred.

# cat stdlib/tst-strfrom.out
Testing in locale: C
strfromf: got NAN (3), expected -NAN (4)
strfromf32: got NAN (3), expected -NAN (4)
Testing in locale: en_US.ISO-8859-1
strfromf: got NAN (3), expected -NAN (4)
strfromf32: got NAN (3), expected -NAN (4)
Testing in locale: en_US.UTF-8
strfromf: got NAN (3), expected -NAN (4)
strfromf32: got NAN (3), expected -NAN (4)

# cat stdlib/tst-strfrom-locale.out
Testing in locale: de_DE.UTF-8
strfromf: got NAN (3), expected -NAN (4)
strfromf32: got NAN (3), expected -NAN (4)
Testing in locale: tr_TR.ISO-8859-9
strfromf: got NAN (3), expected -NAN (4)
strfromf32: got NAN (3), expected -NAN (4)
Testing in locale: tr_TR.UTF-8
strfromf: got NAN (3), expected -NAN (4)
strfromf32: got NAN (3), expected -NAN (4)