: [firebird-support] Precision in stored procedures
No one? My (probably unjustified) fear is that since the variables
are stored in a four byte primitive instead of a packed-decimal like
format, I may randomly run in to this.
-Original Message-
From: firebird-support@yahoogroups.com
To: firebird-support@yahoogroups.com
Subject: [firebird-support] Precision in stored procedures
If a stored procedure has three variables
DECLARE VARIABLE A NUMERIC(18,3);
DECLARE VARIABLE B NUMERIC(18,3);
DECLARE VARIABLE C DOUBLE PRECISION;
And a function is evaluated with these values
Of Rick Debay
Sent: Tuesday, March 06, 2012 12:08 PM
To: firebird-support@yahoogroups.com
Subject: [firebird-support] Precision in stored procedures
If a stored procedure has three variables
DECLARE VARIABLE A NUMERIC(18,3);
DECLARE VARIABLE B NUMERIC(18,3);
DECLARE VARIABLE C DOUBLE PRECISION
] On Behalf Of Rick Debay
Sent: Tuesday, March 06, 2012 12:08 PM
To: firebird-support@yahoogroups.com
Subject: [firebird-support] Precision in stored procedures
If a stored procedure has three variables
DECLARE VARIABLE A NUMERIC(18,3);
DECLARE VARIABLE B NUMERIC(18,3);
DECLARE VARIABLE C DOUBLE
If a stored procedure has three variables
DECLARE VARIABLE A NUMERIC(18,3);
DECLARE VARIABLE B NUMERIC(18,3);
DECLARE VARIABLE C DOUBLE PRECISION;
And a function is evaluated with these values
A = B / C;
A = 7.3 / 0.839080459770115
Then the value stored in A will be 8.7 not 8.700119 (a
