On 3 May 2010 11:42:47 -0700, m42tom-ibmm...@yahoo.com (Tom Marchant) wrote:
>Common decimal numbers such as 0.1 can not be accurately >represented in binary. If you divide X'1' by X'A', you will get >X'0.19999999....'. Or try this with your favorite hexadecimal >calculator. Divide X'10000000' by X'A' and you will get >X'1999999'. Multiply that by X'A' and see what you get. >The windoze hex calculator gives X'FFFFFFA'. In the same way, we cannot accurately represent the number 1/3 in decimal. Except we're used to this bit of inaccuracy so it doesn't bother us. ---------------------------------------------------------------------- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
