FLOAT PRECISSION
mike V
mivori at hotmail.com
Mon Dec 15 15:47:22 EST 2003
What is the precission with which floating point operations are performed ?
The following example shows an incorrect answer in the second case ?
How can this problem be addressed i.e. the apparent precission seems to be a
sevre limitation to any scientific computation ?
Prelude> 1000.11 - 0.1
1000.01
Prelude> 10000.11 - 0.1
10000.0
_________________________________________________________________
Browse styles for all ages, from the latest looks to cozy weekend wear at
MSN Shopping. And check out the beauty products! http://shopping.msn.com
More information about the Hugs-Bugs
mailing list