public inbox for glibc-bugs@sourceware.org
help / color / mirror / Atom feed
* [Bug math/18197] New: atan inaccuracy
@ 2015-04-02 23:34 jsm28 at gcc dot gnu.org
  2015-04-08 17:15 ` [Bug math/18197] " jsm28 at gcc dot gnu.org
  2015-04-08 17:15 ` cvs-commit at gcc dot gnu.org
  0 siblings, 2 replies; 3+ messages in thread
From: jsm28 at gcc dot gnu.org @ 2015-04-02 23:34 UTC (permalink / raw)
  To: glibc-bugs

https://sourceware.org/bugzilla/show_bug.cgi?id=18197

            Bug ID: 18197
           Summary: atan inaccuracy
           Product: glibc
           Version: 2.21
            Status: NEW
          Severity: normal
          Priority: P2
         Component: math
          Assignee: unassigned at sourceware dot org
          Reporter: jsm28 at gcc dot gnu.org

The dbl-64 version of atan is inaccurate in non-default rounding modes, with
errors exceeding the 9ulp maximum considered acceptable by libm-test.inc.  For
example (on x86_64):

Failure: Test: atan_upward (-0x3.b02d84p-4)
Result:
 is:         -2.26554758731449840114e-01  -0x1.cffbf0fc09b910000000p-3
 should be:  -2.26554758731449507047e-01  -0x1.cffbf0fc09b850000000p-3
 difference:  3.33066907387546962128e-16   0x1.80000000000000000000p-52
 ulp       :  12.0000
 max.ulp   :  1.0000

Failure: Test: atan_towardzero (-0x3.3fb708p-4)
Result:
 is:         -2.00331721927011846551e-01  -0x1.9a478490391a30000000p-3
 should be:  -2.00331721927011541239e-01  -0x1.9a478490391980000000p-3
 difference:  3.05311331771918048616e-16   0x1.60000000000000000000p-52
 ulp       :  11.0000
 max.ulp   :  1.0000

Failure: Test: atan_downward (-0x3.3fb708p-4)
Result:
 is:         -2.00331721927011846552e-01  -0x1.9a478490391a30000000p-3
 should be:  -2.00331721927011568996e-01  -0x1.9a478490391990000000p-3
 difference:  2.77555756156289135105e-16   0x1.40000000000000000000p-52
 ulp       :  10.0000
 max.ulp   :  1.0000

-- 
You are receiving this mail because:
You are on the CC list for the bug.


^ permalink raw reply	[flat|nested] 3+ messages in thread

end of thread, other threads:[~2015-04-08 17:15 UTC | newest]

Thread overview: 3+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2015-04-02 23:34 [Bug math/18197] New: atan inaccuracy jsm28 at gcc dot gnu.org
2015-04-08 17:15 ` [Bug math/18197] " jsm28 at gcc dot gnu.org
2015-04-08 17:15 ` cvs-commit at gcc dot gnu.org

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).