Re: [sqlite] make test on FreeBSD 6.2-R, SQLite 3.5.5

2008-01-31 Thread Alexander Batyrshin
Here is my errors on mac os 10.5 with 3.5.5 SQLite

lock4-1.3...
Error: database is locked

vtab6-2.2...
Expected: [1 2 3 {} 2 3 4 1 3 4 5 2]
 Got: [1 2 3 {} 2 3 4 {} 3 4 5 {}]
vtab6-2.4...
Expected: [1 2 3 {} {} {} 2 3 4 {} {} {} 3 4 5 1 2 3]
 Got: [1 2 3 {} {} {} 2 3 4 {} {} {} 3 4 5 {} {} {}]
vtab6-2.5...
Expected: [2 3 4 {} {} {} 3 4 5 1 2 3]
 Got: [2 3 4 {} {} {} 3 4 5 {} {} {}]
vtab6-2.6...
Expected: [1 2 3 {} {} {} 2 3 4 {} {} {}]
 Got: [1 2 3 {} {} {} 2 3 4 {} {} {} 3 4 5 {} {} {}]

vtab6-7.1...
Expected: [1 999 999 2 131 130 999]
 Got: [1 999 999 999 999 999 999]

vtab6-9.1.1...
Expected: []
 Got: [2 22 {}]
vtab6-9.2...
Expected: []
 Got: [2 22 {}]


On Jan 31, 2008 7:27 PM,  <[EMAIL PROTECTED]> wrote:
> "Alexander Batyrshin" <[EMAIL PROTECTED]> wrote:
> > How to get error messages from test? Scroll up and copy-paste? Or
> > there is some other more handy method?
>
> make test | tee testout.txt
>
>
> --
> D. Richard Hipp <[EMAIL PROTECTED]>
>
>
> -
> To unsubscribe, send email to [EMAIL PROTECTED]
> -
>
>



-- 
Alexander Batyrshin aka bash
bash = Biomechanica Artificial Sabotage Humanoid

-
To unsubscribe, send email to [EMAIL PROTECTED]
-



Re: [sqlite] make test on FreeBSD 6.2-R, SQLite 3.5.5

2008-01-31 Thread Rob Sciuk

On Thu, 31 Jan 2008, [EMAIL PROTECTED] wrote:


Date: Thu, 31 Jan 2008 18:27:35 +
From: [EMAIL PROTECTED]
Reply-To: sqlite-users@sqlite.org
To: sqlite-users@sqlite.org
Subject: Re: [sqlite] make test on FreeBSD 6.2-R, SQLite 3.5.5

"Alexander Batyrshin" <[EMAIL PROTECTED]> wrote:

How to get error messages from test? Scroll up and copy-paste? Or
there is some other more handy method?


make test | tee testout.txt


aha!  Take the simple approach, in keeping I re-ran the 3.5.5 test with:

make test | grep -v Ok | tee test.output

-=-=-=-=-=-=-=-=-= test.output -=-=-=-=-=-=-=-=-=-=
./testfixture ../test/quick.test
bind-4.4...
Error: floating point value is Not a Number
bind-4.5...
Expected: [null real real]
 Got: []
btree-2.1.1...CURSOR 8121088 rooted at1(rw) currently at 1.0 eof
PAGE 1:  flags=0x09  frag=0   parent=0
cell  0: i=913..1023  chld=0nk=2020 nd=1792 payload=*** This is a very 
PAGE 2:  flags=0x08  frag=0   parent=0

PAGE   1 addr=80F7894 nRef=2
cast-3.14...
Expected: [9223372036854774784]
 Got: [9223372036854773760]
cast-3.18...
Expected: [-9223372036854774784]
 Got: [-9223372036854773760]
cast-3.24...
Expected: [9223372036854774784]
 Got: [9223372036854773760]
Skipping crash5 tests: not compiled with -DSQLITE_MEMDEBUG...
Skipping malloc5 tests: not compiled with -DSQLITE_MEMDEBUG...
Skipping malloc6 tests: not compiled with -DSQLITE_MEMDEBUG...
Skipping malloc7 tests: not compiled with -DSQLITE_MEMDEBUG...
Skipping malloc8 tests: not compiled with -DSQLITE_MEMDEBUG...
Skipping malloc9 tests: not compiled with -DSQLITE_MEMDEBUG...
Skipping mallocA tests: not compiled with -DSQLITE_MEMDEBUG...
Skipping mallocB tests: not compiled with -DSQLITE_MEMDEBUG...
Skipping mallocC tests: not compiled with -DSQLITE_MEMDEBUG...
Skipping mallocD tests: not compiled with -DSQLITE_MEMDEBUG...
Skipping mallocE tests: not compiled with -DSQLITE_MEMDEBUG...
Skipping mallocF tests: not compiled with -DSQLITE_MEMDEBUG...
Skipping mallocG tests: not compiled with -DSQLITE_MEMDEBUG...
printf-1.7.6...
Expected: [Three integers: (100) ( f4240) (3641100)]
 Got: [Three integers: ( 100) ( f4240) (3641100)]
printf-1.8.6...
Expected: [Three integers: (9) (3b9ac9ff) (7346544777)]
 Got: [Three integers: ( 9) (3b9ac9ff) (7346544777)]
printf-1.9.7...
Expected: [Three integers: ( 0) (   0x0) ( 0)]
 Got: [Three integers: ( 0) ( 0) ( 0)]
Skipping safety tests since SQLITE_DEBUG is off
time with cache: 2292055 microseconds per iteration
time without cache: 7910271 microseconds per iteration
result=one 10 three 5 two 14
speed3-1.incrvacuum..   201285 uS   4968.08009 row/s
speed3-1.normal...  336842 uS   2968.75093 row/s
Incrvacuum: Read 1098, wrote 94
Normal: Read 10479, wrote 43
speed3-2.incrvacuum..   100244 uS   9975.65939 row/s
speed3-2.normal...  233531 uS   4282.08675 row/s
Incrvacuum: Read 2843, wrote 1
Normal: Read 10011, wrote 0
tcl-1.6...
Expected: [1 {syntax error in expression "x*"}]
 Got: [1 {invalid bareword "x"
in expression "x*";
should be "$x" or "{x}" or "x(...)" or ...}]
vtab6-2.2...
Expected: [1 2 3 {} 2 3 4 1 3 4 5 2]
 Got: [1 2 3 {} 2 3 4 {} 3 4 5 {}]
vtab6-2.4...
Expected: [1 2 3 {} {} {} 2 3 4 {} {} {} 3 4 5 1 2 3]
 Got: [1 2 3 {} {} {} 2 3 4 {} {} {} 3 4 5 {} {} {}]
vtab6-2.5...
Expected: [2 3 4 {} {} {} 3 4 5 1 2 3]
 Got: [2 3 4 {} {} {} 3 4 5 {} {} {}]
vtab6-2.6...
Expected: [1 2 3 {} {} {} 2 3 4 {} {} {}]
 Got: [1 2 3 {} {} {} 2 3 4 {} {} {} 3 4 5 {} {} {}]
vtab6-7.1...
Expected: [1 999 999 2 131 130 999]
 Got: [1 999 999 999 999 999 999]
vtab6-9.1.1...
Expected: []
 Got: [2 22 {}]
vtab6-9.2...
Expected: []
 Got: [2 22 {}]
16 errors out of 38961 tests
Failures on these tests: bind-4.4 bind-4.5 cast-3.14 cast-3.18 cast-3.24 
printf-1.7.6 printf-1.8.6 printf-1.9.7 tcl-1.6 vtab6-2.2 vtab6-2.4 vtab6-2.5 
vtab6-2.6 vtab6-7.1 vtab6-9.1.1 vtab6-9.2
All memory allocations freed - no leaks
Maximum memory usage: 14161974 bytes
Current memory usage: 0 bytes
*** Error code 1

Stop in /u0/sw/SQLite/sqlite-3.5.5/FreeBSD.

-
To unsubscribe, send email to [EMAIL PROTECTED]
-



Re: [sqlite] make test on FreeBSD 6.2-R, SQLite 3.5.5

2008-01-31 Thread drh
"Alexander Batyrshin" <[EMAIL PROTECTED]> wrote:
> Here is my "make test" on Mac OS 10.5.1:
> 
> 8 errors out of 38117 tests
> Failures on these tests: lock4-1.3 vtab6-2.2 vtab6-2.4 vtab6-2.5
> vtab6-2.6 vtab6-7.1 vtab6-9.1.1 vtab6-9.2
> All memory allocations freed - no leaks
> Maximum memory usage: 14161966 bytes
> Current memory usage: 0 bytes
> make: *** [test] Error 1
> 

We tested on Mac OS 10.4.11.  No errors there.

Once again, there is not much I can do to work on this problem
without seeing the text of the error messages

--
D. Richard Hipp <[EMAIL PROTECTED]>


-
To unsubscribe, send email to [EMAIL PROTECTED]
-



Re: [sqlite] make test on FreeBSD 6.2-R, SQLite 3.5.5

2008-01-31 Thread Rob Sciuk

On Thu, 31 Jan 2008, [EMAIL PROTECTED] wrote:

Rob Sciuk <[EMAIL PROTECTED]> wrote:

Ran the tests on Freebsd, the make test summary follows:
[delenda => ... Ok]

16 errors out of 38961 tests
Failures on these tests: bind-4.4 bind-4.5 cast-3.14 cast-3.18 cast-3.24
printf-1.7.6 printf-1.8.6 printf-1.9.7 tcl-1.6 vtab6-2.2 vtab6-2.4
vtab6-2.5 vtab6-2.6 vtab6-7.1 vtab6-9.1.1 vtab6-9.2
All memory allocations freed - no leaks
Maximum memory usage: 14161974 bytes
Current memory usage: 0 bytes
*** Error code 1



We get zero test failures on Linux.  I don't know if these are
significant or not without seeing the test error messages that
accompany each failure.

Probably this is things where your system is printing 3.4e+05
whereas SQLite is looking for 3.4e+005, in which case the errors
are benign.  But without seeing the actual errors, I cannot say
for sure.
--
D. Richard Hipp <[EMAIL PROTECTED]>



Hmmm ... by my reckoning, you have added 261 tests *JUST* for version 
3.5.5.  Pretty big effort I'd say, and much appreciated I'd like to add.


I re-ran the make test on 3.5.4, and there seems to be a significant 
overlap in those reporting failure (see below).  As I have not yet figured 
out how to run them individually (eg:  make test bind-4.4), nor did I find 
an output error file, I'll make the assumption that you are correct, and 
the diffs are indeed benign (since everything seems to work really well), 
at least until I have some time to re-visit.


Have you done any performance regression tests on the 3.5.5 VM yet??  I 
suspect that there will be an improvement ...


-=-=-=-=-=-=-=-=-=
FreeBSD 6.2-R (same hw), SQLite 3.5.4 reported:
[delendum ... Ok]

9 errors out of 38700 tests
Failures on these tests: bind-4.4 bind-4.5 cast-3.14 cast-3.18 cast-3.24 
printf-1.7.6 printf-1.8.6 printf-1.9.7 tcl-1.6

All memory allocations freed - no leaks
Maximum memory usage: 14165134 bytes
*** Error code 1

Stop in /u0/sw/SQLite/sqlite-3.5.4/FreeBSD.



-
To unsubscribe, send email to [EMAIL PROTECTED]
-



Re: [sqlite] make test on FreeBSD 6.2-R, SQLite 3.5.5

2008-01-31 Thread Alexander Batyrshin
How to get error messages from test? Scroll up and copy-pase? Or there
is some other more handy method?

On Jan 31, 2008 7:03 PM,  <[EMAIL PROTECTED]> wrote:
> Rob Sciuk <[EMAIL PROTECTED]> wrote:
> > Ran the tests on Freebsd, the make test summary follows:
> > [delenda => ... Ok]
> >
> > 16 errors out of 38961 tests
> > Failures on these tests: bind-4.4 bind-4.5 cast-3.14 cast-3.18 cast-3.24
> > printf-1.7.6 printf-1.8.6 printf-1.9.7 tcl-1.6 vtab6-2.2 vtab6-2.4
> > vtab6-2.5 vtab6-2.6 vtab6-7.1 vtab6-9.1.1 vtab6-9.2
> > All memory allocations freed - no leaks
> > Maximum memory usage: 14161974 bytes
> > Current memory usage: 0 bytes
> > *** Error code 1
> >
>
> We get zero test failures on Linux.  I don't know if these are
> significant or not without seeing the test error messages that
> accompany each failure.
>
> Probably this is things where your system is printing 3.4e+05
> whereas SQLite is looking for 3.4e+005, in which case the errors
> are benign.  But without seeing the actual errors, I cannot say
> for sure.
> --
> D. Richard Hipp <[EMAIL PROTECTED]>
>
>
>
> -
> To unsubscribe, send email to [EMAIL PROTECTED]
> -
>
>



-- 
Alexander Batyrshin aka bash
bash = Biomechanica Artificial Sabotage Humanoid

-
To unsubscribe, send email to [EMAIL PROTECTED]
-



Re: [sqlite] make test on FreeBSD 6.2-R, SQLite 3.5.5

2008-01-31 Thread Alexander Batyrshin
Here is my "make test" on Mac OS 10.5.1:

8 errors out of 38117 tests
Failures on these tests: lock4-1.3 vtab6-2.2 vtab6-2.4 vtab6-2.5
vtab6-2.6 vtab6-7.1 vtab6-9.1.1 vtab6-9.2
All memory allocations freed - no leaks
Maximum memory usage: 14161966 bytes
Current memory usage: 0 bytes
make: *** [test] Error 1

-- 
Alexander Batyrshin aka bash
bash = Biomechanica Artificial Sabotage Humanoid

-
To unsubscribe, send email to [EMAIL PROTECTED]
-



Re: [sqlite] make test on FreeBSD 6.2-R, SQLite 3.5.5

2008-01-31 Thread drh
"Alexander Batyrshin" <[EMAIL PROTECTED]> wrote:
> How to get error messages from test? Scroll up and copy-paste? Or
> there is some other more handy method?

make test | tee testout.txt

--
D. Richard Hipp <[EMAIL PROTECTED]>


-
To unsubscribe, send email to [EMAIL PROTECTED]
-



Re: [sqlite] make test on FreeBSD 6.2-R, SQLite 3.5.5

2008-01-31 Thread Alexander Batyrshin
How to get error messages from test? Scroll up and copy-paste? Or
there is some other more handy method?

On Jan 31, 2008 7:03 PM,  <[EMAIL PROTECTED]> wrote:
> Rob Sciuk <[EMAIL PROTECTED]> wrote:
> > Ran the tests on Freebsd, the make test summary follows:
> > [delenda => ... Ok]
> >
> > 16 errors out of 38961 tests
> > Failures on these tests: bind-4.4 bind-4.5 cast-3.14 cast-3.18 cast-3.24
> > printf-1.7.6 printf-1.8.6 printf-1.9.7 tcl-1.6 vtab6-2.2 vtab6-2.4
> > vtab6-2.5 vtab6-2.6 vtab6-7.1 vtab6-9.1.1 vtab6-9.2
> > All memory allocations freed - no leaks
> > Maximum memory usage: 14161974 bytes
> > Current memory usage: 0 bytes
> > *** Error code 1
> >
>
> We get zero test failures on Linux.  I don't know if these are
> significant or not without seeing the test error messages that
> accompany each failure.
>
> Probably this is things where your system is printing 3.4e+05
> whereas SQLite is looking for 3.4e+005, in which case the errors
> are benign.  But without seeing the actual errors, I cannot say
> for sure.
> --
> D. Richard Hipp <[EMAIL PROTECTED]>
>
>
>
> -
> To unsubscribe, send email to [EMAIL PROTECTED]
> -
>
>



-- 
Alexander Batyrshin aka bash
bash = Biomechanica Artificial Sabotage Humanoid

-
To unsubscribe, send email to [EMAIL PROTECTED]
-



Re: [sqlite] make test on FreeBSD 6.2-R, SQLite 3.5.5

2008-01-31 Thread drh
Rob Sciuk <[EMAIL PROTECTED]> wrote:
> Ran the tests on Freebsd, the make test summary follows:
> [delenda => ... Ok]
> 
> 16 errors out of 38961 tests
> Failures on these tests: bind-4.4 bind-4.5 cast-3.14 cast-3.18 cast-3.24 
> printf-1.7.6 printf-1.8.6 printf-1.9.7 tcl-1.6 vtab6-2.2 vtab6-2.4 
> vtab6-2.5 vtab6-2.6 vtab6-7.1 vtab6-9.1.1 vtab6-9.2
> All memory allocations freed - no leaks
> Maximum memory usage: 14161974 bytes
> Current memory usage: 0 bytes
> *** Error code 1
> 

We get zero test failures on Linux.  I don't know if these are
significant or not without seeing the test error messages that
accompany each failure.

Probably this is things where your system is printing 3.4e+05
whereas SQLite is looking for 3.4e+005, in which case the errors
are benign.  But without seeing the actual errors, I cannot say
for sure.
--
D. Richard Hipp <[EMAIL PROTECTED]>


-
To unsubscribe, send email to [EMAIL PROTECTED]
-