...@webcontrolltd.co.uk]
Sent: Sunday, May 03, 2009 1:01 PM
To: u2-users@listserver.u2ug.org
Subject: Re: [U2] Unidata calculations incorrect
I think on Universe there is a parameter called 'WIDEZERO'. Not sure
about the setting.
regards
Martin Hutchinson
Eric Armstrong wrote:
Wally,
Would
-Original Message-
From: Wally Terhune [mailto:wal...@us.ibm.com]
Sent: Friday, May 01, 2009 6:00 AM
To: u2-users@listserver.u2ug.org
Subject: Re: [U2] Unidata calculations incorrect
look up the ECL statement FLOAT.PRECISION
Folks are often happiest with FLOAT.PRECISION 4
Wally Terhune
U2 Support
Hi All,
We have Unidata 7.2 running on Windows 2008 server making incorrect
calculations when numbers are close to zero. I understand there is a
'WIDEZERO' parameter on Univers but I don't think there is an equivalent
on Unidata. Below we have an example program and output.
001: BAL =
/support
From: Martin Hutchinson m.hutchin...@webcontrolltd.co.uk
To: u2 user group u2-users@listserver.u2ug.org
Date: 05/01/2009 05:21 AM
Subject:[U2] Unidata calculations incorrect
Sent by:owner-u2-us...@listserver.u2ug.org
Hi All,
We have Unidata 7.2
Yes, this is a long running feature of UniData. With a simple statement you
can change the results of many of your calculations. Which setting should you
use? Well that depends on your data and your calculations. Look at the
PRECISION and FLOAT.PRECISION statements (if you don't believe that IBM
[mailto:owner-u2-us...@listserver.u2ug.org] On Behalf Of Martin
Hutchinson
Sent: Friday, May 01, 2009 6:38 AM
To: u2 user group
Subject: [U2] Unidata calculations incorrect
Hi All,
We have Unidata 7.2 running on Windows 2008 server making incorrect
calculations when numbers are close to zero. I
-users@listserver.u2ug.org
Date: 05/01/2009 05:21 AM
Subject:[U2] Unidata calculations incorrect
Sent by:owner-u2-us...@listserver.u2ug.org
Hi All,
We have Unidata 7.2 running on Windows 2008 server making incorrect
calculations when numbers are close to zero. I
@listserver.u2ug.org
Subject: Re: [U2] Unidata calculations incorrect
look up the ECL statement FLOAT.PRECISION Folks are often happiest with
FLOAT.PRECISION 4
Wally Terhune
U2 Support Architect
IBM Information Management Software
Tel: (303) 773-7969 T/L 656-7969
Mobile: (303) 807-6222
Email
__
From: Horn, John jh...@healthlink.com
Sent: 5/1/2009 7:11 AM
To: u2-users@listserver.u2ug.org
Subject: Re: [U2] Unidata calculations incorrect
Interesting. This works as expected on our system. Unidata 6
: [U2] Unidata calculations incorrect
look up the ECL statement FLOAT.PRECISION
Folks are often happiest with FLOAT.PRECISION 4
Wally Terhune
U2 Support Architect
IBM Information Management Software
Tel: (303) 773-7969 T/L 656-7969
Mobile: (303) 807-6222
Email: wal...@us.ibm.com
http
10 matches
Mail list logo