Adrian Zając wrote:
>trace (0.27 + 0.03); // output --> 0.30004
>
> Can anyone tell me why I get this weird result in output window?
As people have said, it's a problem with decimals. It's not a problem with
Flash--it's a problem with binary numbers.
Integers are accurate bec
Thanks Zeh, now I understand.
So do we have to keep an eye on our variables so we don't have for
example:7.998 * 0,3004 ?
Because I think it is a little heavier for processors to count than: 8
* 0.3
W dniu 2010-12-14 16:36, Zeh Fernando pisze:
I like to quote t
tom rhodes skriver:
yup interesting that the old AVM gives you what you'd think...
Pure luck, you might have compiled against something that happened to
drop the decimal instead .
___
Flashcoders mailing list
Flashcoders@chattyfig.figleaf.com
http:
yup interesting that the old AVM gives you what you'd think...
On 14 December 2010 16:36, Zeh Fernando wrote:
> I like to quote this, from PHP.net's "Floating Point" documentation:
>
> "Floating point numbers have limited precision. Although it depends on the
> system, PHP typically uses the IE
Howdy Adrian,
Here is one way.
trace (int((0.27 + 0.03)*100)/100) // output --> 0.3
Later,
John
on 12/14/10 8:42 AM, Adrian Zając at zajac.adr...@gmail.com wrote:
> Hello,
>
> First of all, I want to say Hi to everyone here. This is my first post.
>
>
> Please, take a look at this part
I like to quote this, from PHP.net's "Floating Point" documentation:
"Floating point numbers have limited precision. Although it depends on the
system, PHP typically uses the IEEE 754 double precision format, which will
give a maximum relative error due to rounding in the order of 1.11e-16. Non
el
It's an issue with floating point accuracy/calculations,
Here is some info:
http://joshblog.net/2007/01/30/flash-floating-point-number-errors/
saw more about it somewhere else... don't think it's an issue with the FP tho'.
- Karim
On 14 Dec 2010, at 15:15, tom rhodes wrote:
> same here compil
If you need the addition to be accurate and you know that the numbers will
always be decimals you can multiply the numbers by 100 and then you will add 27
+ 3 which will return 30 and then divide it by 100 to get your .3 (or at least
I think that will work as I have not tried it)
Yes St
same here compiling for flash player 10 and flash player 9, 8 and below give
0.3 as expected
On 14 December 2010 15:42, Adrian Zając wrote:
> trace (0.27 + 0.03);
___
Flashcoders mailing list
Flashcoders@chattyfig.figleaf.com
http://chattyfig.figl
It has to do with the fact that computers have to convert all numbers to binary
then perform math on those numbers and then convert back to decimal. In the
process of this conversion you get results like these.
If you need the addition to be accurate and you know that the numbers will
always be
Hello,
First of all, I want to say Hi to everyone here. This is my first post.
Please, take a look at this part of code:
trace (0.27 + 0.03); // output --> 0.30004
Can anyone tell me why I get this weird result in output window?
Regards
Adrian
_
11 matches
Mail list logo
