[sage-devel] Behaviour of n()

sage: n(pi - 3).n(prec=2) 0.12 sage: n(pi - 3, prec=2) 0.00 Why the difference? -- To post to this group, send an email to sage-devel@googlegroups.com To unsubscribe from this group, send an email to sage-devel+unsubscr...@googlegroups.com For more options, visit this group at http://groups.goo

Re: [sage-devel] Behaviour of n()

* Eviatar [2011-12-16 20:22:37 -0800]: > sage: n(pi - 3).n(prec=2) > 0.12 This approximates n(pi - 3) using two bits of precision so this should not be too surprising: sage: n(pi - 3) 0.141592653589793 sage: n(_, prec=2) 0.12 > sage: n(pi - 3, prec=2) > 0.00 This approximates both pi and 3 with t

Re: [sage-devel] Behaviour of n()

Oh, I see, thanks. It is definitely not "Due to numerical instability", though. This should be fixed in the patch. -- To post to this group, send an email to sage-devel@googlegroups.com To unsubscribe from this group, send an email to sage-devel+unsubscr...@googlegroups.com For more options, vi