On Mon, 2012-07-09 at 13:18 -0700, Benjamin Segall wrote: > Correct, the sum is 1..n. The maximum was chosen as 516/46742 because > that is the point when the approximation of loop + fixed point math > being used reaches a maximum, even if the ideal y^n series would cap out > slightly differently.
Can you run a simple kid like me through the math here.. it seems strange that fixed point math would give a higher order term than the regular case. And by such a wide margin as well, (516-320)/32 ~ 6, so that's 1/64-th of the 320-th term. -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/