Donald,
Will Leshner <[EMAIL PROTECTED]>
14/10/2004 04:20 AM
Please respond to sqlite-users
To: [EMAIL PROTECTED]
cc:
Subject: Re: [sqlite] strange rounding problem
>The point is that the number is in the database as '358', but by
[EMAIL PROTECTED] wrote:
Can you come up with a minimal test case that exhibits this behaviour?
Ideally, it would be a series of SQL statements written into the sqlite
shell program that results in something visibly wrong. The second best
case would be a short (10-20 line) C program that uses t
Griggs, Donald wrote:
If I'm missing the (decimal) point, here, forgive me.
The point is that the number is in the database as '358', but by the time we get it back from a query it has become '357.999'. We aren't doing any floating point with the number. It is (apparently) happening for us in the S
35-7834
Opinions are not necessarily those of Misys Healthcare Systems nor its board
of directors.
-Original Message-
From: Will Leshner [mailto:[EMAIL PROTECTED]
Sent: Wednesday, October 13, 2004 1:44 PM
To: [EMAIL PROTECTED]
Subject: Re: [sqlite] strange rounding problem
I've tr
Will Leshner wrote:
I've tracked my rounding problem down to this line in vxprintf():
I'm sorry to say that is a false alarm. It turns out that we were being fooled by the debugger in Dev Studio. What is the case, however, is that a value is coming out of the database and at some point duing the pr
I've tracked my rounding problem down to this line in vxprintf():
while( realvalue>=10.0 && exp<=350 ){ realvalue *= .1; exp++; }
Apparently, on some hardware, sometimes, multiplying a number like '358' by .1 results
in a number like '35.79' or thereabouts. Now what's really strange is that
On Oct 13, 2004, at 3:00 AM, Bogusław Brandys wrote:
Not a solution, but ... get any sqlite manager like sqliteadmin or
sqliteexplorer and check what is really stored in database table.
Thanks. I did that and what's stored there is exactly what I expect to
be store there. In other words, the col
Hi,
Will Leshner wrote:
In version SQLite 2.8.15 I'm having a situation with a query that I
don't quite understand. This only happens on some machines. Basically I
have a table with an Integer field that contains integers. And I have a
query that is returning those integers as real numbers. So,
In version SQLite 2.8.15 I'm having a situation with a query that I don't quite understand. This only happens on some machines. Basically I have a table with an Integer field that contains integers. And I have a query that is returning those integers as real numbers. So, for example, if I have 234
9 matches
Mail list logo
