On Dec 6, 2006, at 4:35 PM, John Randall wrote:
Henry Rich wrote:
Getting the last bit right is a challenge, see the end of
http://www.research.ibm.com/journal/rd/341/ibmrd3401N.pdf
This is the Table Maker's Dilemma. See also
http://perso.ens-lyon.fr/jean-michel.muller/Intro-to-TMD.htm
John
For computing square roots, see my paper "A Perfect Square Root
Routine" that appears in APL86 Proceedings, pp 289-294. It uses many
not-so-evident devices to get every bit accurate, using the
hexadecimal floating point math compelled by S/360. I believe that in
the more enlightened computers in use today, a similar algorithm can
be written.
Eugene
----------------------------------------------------------------------
For information about J forums see http://www.jsoftware.com/forums.htm
