We don't think WIDEZERO will help. Here's the issue. For two variables in the same program that are exactly the same; sometimes Universe returns they are equal and sometimes it doesn't. Very bizarre!
Eric Armstrong IT Dept -----Original Message----- From: Martin Hutchinson [mailto:m.hutchin...@webcontrolltd.co.uk] Sent: Sunday, May 03, 2009 1:01 PM To: u2-users@listserver.u2ug.org Subject: Re: [U2] Unidata calculations incorrect I think on Universe there is a parameter called 'WIDEZERO'. Not sure about the setting. regards Martin Hutchinson Eric Armstrong wrote: > Wally, > Would this also apply to Universe? FLOAT.PRECISION that is? We also have the > same issue with Universe 10.2.10. > > Eric Armstrong > IT Dept > > > -----Original Message----- > From: Wally Terhune [mailto:wal...@us.ibm.com] > Sent: Friday, May 01, 2009 6:00 AM > To: u2-users@listserver.u2ug.org > Subject: Re: [U2] Unidata calculations incorrect > > > look up the ECL statement FLOAT.PRECISION > Folks are often happiest with FLOAT.PRECISION 4 > > > Wally Terhune > U2 Support Architect > IBM Information Management Software > Tel: (303) 773-7969 T/L 656-7969 > Mobile: (303) 807-6222 > Email: wal...@us.ibm.com > http://www.ibm.com/software/data/u2/support > > > > From: "Martin Hutchinson" <m.hutchin...@webcontrolltd.co.uk> > > To: "u2 user group" <u2-users@listserver.u2ug.org> > > Date: 05/01/2009 05:21 AM > > Subject: [U2] Unidata calculations incorrect > > Sent by: owner-u2-us...@listserver.u2ug.org > > > > > > > Hi All, > > We have Unidata 7.2 running on Windows 2008 server making incorrect > calculations when numbers are close to zero. I understand there is a > 'WIDEZERO' parameter on Univers but I don't think there is an equivalent > on Unidata. Below we have an example program and output. > > 001: BAL = 856.19 > 002: VAL1 = 287.31 > 003: VAL2 = 568.88 > 004: BAL = BAL - VAL1 > 005: BAL = BAL - VAL2 > 006: * > 007: CRT "BAL [":BAL:"]" > 008: * > 009: IF BAL > 0 THEN > 010: CRT "BAL > 0" > 011: END ELSE > 012: CRT "BAL <= 0" > 013: END > 014: * > 015: IF INT(BAL) = BAL THEN > 016: CRT "Matches integer" > 017: END ELSE > 018: CRT "Does not match integer" > 019: END > 020: * > 021: IF ICONV(BAL,"MCN") > 0 THEN > 022: CRT "MCN BAL > 0" > 023: END ELSE > 024: CRT "MCN BAL <= 0" > 025: END > > When run this gives: > > BAL [0] > BAL > 0 > Does not match integer > MCN BAL <= 0 > > Has anyone come across this one or have any ideas? > > regards > > Martin Hutchinson > > ________________________ > Web Control (UK) Ltd > Atlantic House, > Michigan Drive, > Tongwell, > Milton Keynes, > MK15 8HQ > > T: +44(0)1908 216700 x4 > F: +44(0)1908 216300 > > http://www.webcontrolltd.co.uk > > Web Control (UK) Ltd is a company registered in England and Wales with > company number 4118558. VAT number: 770 3363 38 > ------- > u2-users mailing list > u2-users@listserver.u2ug.org > To unsubscribe please visit http://listserver.u2ug.org/ > > [demime 1.01d removed an attachment of type image/gif which had a name of > graycol.gif] > > [demime 1.01d removed an attachment of type image/gif which had a name of > ecblank.gif] > ------- > u2-users mailing list > u2-users@listserver.u2ug.org > To unsubscribe please visit http://listserver.u2ug.org/ > > LOBEL FINANCIAL PRIVACY NOTICE: > This communication may contain confidential company information that is protected by federal law. Federal regulations prohibit the disclosure (or re-disclosure) of confidential information without the written consent of the person(s) to whom it pertains. Additionally, the views or opinions presented in this email are solely those of the author and do not necessarily represent those of the company. > ------- > u2-users mailing list > u2-users@listserver.u2ug.org > To unsubscribe please visit http://listserver.u2ug.org/ > > > > ________________________ Web Control (UK) Ltd Atlantic House, Michigan Drive, Tongwell, Milton Keynes, MK15 8HQ T: +44(0)1908 216700 x4 F: +44(0)1908 216300 http://www.webcontrolltd.co.uk Web Control (UK) Ltd is a company registered in England and Wales with company number 4118558. VAT number: 770 3363 38 ------- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/ LOBEL FINANCIAL PRIVACY NOTICE: This communication may contain confidential company information that is protected by federal law. Federal regulations prohibit the disclosure (or re-disclosure) of confidential information without the written consent of the person(s) to whom it pertains. Additionally, the views or opinions presented in this email are solely those of the author and do not necessarily represent those of the company. ------- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/
