Re: [math] numerical considerations

2003-06-18 Thread Mark R. Diggory
Phil Steitz wrote: More nitpicking. I don't see that multiplying top and bottom by values.length makes things better. In fact, it could reduce precision by inflating the magnitude of the first term before subtracting from it and dividing it. hmm, good points. this may be an ex

[math] numerical considerations

2003-06-18 Thread Phil Steitz
> > > > > > More nitpicking. I don't see that multiplying top and bottom by > values.length > > makes things better. In fact, it could reduce precision by inflating the > > magnitude of the first term before subtracting from it and dividing it. > > > > hmm, good points. this may be an examp