This is the mail archive of the libc-alpha@sourceware.org mailing list for the glibc project.


Index Nav: [Date Index] [Subject Index] [Author Index] [Thread Index]
Message Nav: [Date Prev] [Date Next] [Thread Prev] [Thread Next]
Other format: [Raw text]

Re: [PATCH] libm-test.inc: Correctly implement ulp().


On 05/26/2013 05:28 AM, Andreas Schwab wrote:
> "Carlos O'Donell" <carlos@redhat.com> writes:
> 
>> +        /* The next closest subnormal value is a constant distance away.  */
>> +	ulp = FUNC(ldexp) (1.0, 1 - (MAX_EXP + MANT_DIG));
> 
> This is wrong for IBM long double.  The smallest representable value is
> 2^-1074, not 2^-1127.

I'm looking into this ASAP. Getting a Power64 box to test on.

I simply expected the values of MAX_EXP and MANT_DIG for IBM long double
to be such that the equation would just work.

Cheers,
Carlos.


Index Nav: [Date Index] [Subject Index] [Author Index] [Thread Index]
Message Nav: [Date Prev] [Date Next] [Thread Prev] [Thread Next]