RE: [U2] Unidata calculations incorrect

2009-05-04 Thread Eric Armstrong
...@webcontrolltd.co.uk] Sent: Sunday, May 03, 2009 1:01 PM To: u2-users@listserver.u2ug.org Subject: Re: [U2] Unidata calculations incorrect I think on Universe there is a parameter called 'WIDEZERO'. Not sure about the setting. regards Martin Hutchinson Eric Armstrong wrote: Wally, Would

Re: [U2] Unidata calculations incorrect

2009-05-03 Thread Martin Hutchinson
-Original Message- From: Wally Terhune [mailto:wal...@us.ibm.com] Sent: Friday, May 01, 2009 6:00 AM To: u2-users@listserver.u2ug.org Subject: Re: [U2] Unidata calculations incorrect look up the ECL statement FLOAT.PRECISION Folks are often happiest with FLOAT.PRECISION 4 Wally Terhune U2 Support

[U2] Unidata calculations incorrect

2009-05-01 Thread Martin Hutchinson
Hi All, We have Unidata 7.2 running on Windows 2008 server making incorrect calculations when numbers are close to zero. I understand there is a 'WIDEZERO' parameter on Univers but I don't think there is an equivalent on Unidata. Below we have an example program and output. 001: BAL =

Re: [U2] Unidata calculations incorrect

2009-05-01 Thread Wally Terhune
/support From: Martin Hutchinson m.hutchin...@webcontrolltd.co.uk To: u2 user group u2-users@listserver.u2ug.org Date: 05/01/2009 05:21 AM Subject:[U2] Unidata calculations incorrect Sent by:owner-u2-us...@listserver.u2ug.org Hi All, We have Unidata 7.2

RE: [U2] Unidata calculations incorrect

2009-05-01 Thread Colin Alfke
Yes, this is a long running feature of UniData. With a simple statement you can change the results of many of your calculations. Which setting should you use? Well that depends on your data and your calculations. Look at the PRECISION and FLOAT.PRECISION statements (if you don't believe that IBM

RE: [U2] Unidata calculations incorrect

2009-05-01 Thread Nick Gettino
[mailto:owner-u2-us...@listserver.u2ug.org] On Behalf Of Martin Hutchinson Sent: Friday, May 01, 2009 6:38 AM To: u2 user group Subject: [U2] Unidata calculations incorrect Hi All, We have Unidata 7.2 running on Windows 2008 server making incorrect calculations when numbers are close to zero. I

Re: [U2] Unidata calculations incorrect

2009-05-01 Thread Martin Hutchinson
-users@listserver.u2ug.org Date: 05/01/2009 05:21 AM Subject:[U2] Unidata calculations incorrect Sent by:owner-u2-us...@listserver.u2ug.org Hi All, We have Unidata 7.2 running on Windows 2008 server making incorrect calculations when numbers are close to zero. I

RE: [U2] Unidata calculations incorrect

2009-05-01 Thread Horn, John
@listserver.u2ug.org Subject: Re: [U2] Unidata calculations incorrect look up the ECL statement FLOAT.PRECISION Folks are often happiest with FLOAT.PRECISION 4 Wally Terhune U2 Support Architect IBM Information Management Software Tel: (303) 773-7969 T/L 656-7969 Mobile: (303) 807-6222 Email

Re: [U2] Unidata calculations incorrect

2009-05-01 Thread Bill Haskett
__ From: Horn, John jh...@healthlink.com Sent: 5/1/2009 7:11 AM To: u2-users@listserver.u2ug.org Subject: Re: [U2] Unidata calculations incorrect Interesting. This works as expected on our system. Unidata 6

RE: [U2] Unidata calculations incorrect

2009-05-01 Thread Eric Armstrong
: [U2] Unidata calculations incorrect look up the ECL statement FLOAT.PRECISION Folks are often happiest with FLOAT.PRECISION 4 Wally Terhune U2 Support Architect IBM Information Management Software Tel: (303) 773-7969 T/L 656-7969 Mobile: (303) 807-6222 Email: wal...@us.ibm.com http