FLOAT PRECISSION

mike V mivori at hotmail.com
Mon Dec 15 15:47:22 EST 2003


What is the precission with which floating point operations are performed ?
The following example shows an incorrect answer in the second case ?
How can this problem be addressed i.e. the apparent precission seems to be a 
sevre limitation to any scientific computation ?

Prelude> 1000.11 - 0.1
1000.01
Prelude> 10000.11 - 0.1
10000.0

_________________________________________________________________
Browse styles for all ages, from the latest looks to cozy weekend wear at 
MSN Shopping.  And check out the beauty products! http://shopping.msn.com



More information about the Hugs-Bugs mailing list