Re: [sqlite] make test on FreeBSD 6.2-R, SQLite 3.5.5
Here is my errors on mac os 10.5 with 3.5.5 SQLite lock4-1.3... Error: database is locked vtab6-2.2... Expected: [1 2 3 {} 2 3 4 1 3 4 5 2] Got: [1 2 3 {} 2 3 4 {} 3 4 5 {}] vtab6-2.4... Expected: [1 2 3 {} {} {} 2 3 4 {} {} {} 3 4 5 1 2 3] Got: [1 2 3 {} {} {} 2 3 4 {} {} {} 3 4 5 {} {} {}] vtab6-2.5... Expected: [2 3 4 {} {} {} 3 4 5 1 2 3] Got: [2 3 4 {} {} {} 3 4 5 {} {} {}] vtab6-2.6... Expected: [1 2 3 {} {} {} 2 3 4 {} {} {}] Got: [1 2 3 {} {} {} 2 3 4 {} {} {} 3 4 5 {} {} {}] vtab6-7.1... Expected: [1 999 999 2 131 130 999] Got: [1 999 999 999 999 999 999] vtab6-9.1.1... Expected: [] Got: [2 22 {}] vtab6-9.2... Expected: [] Got: [2 22 {}] On Jan 31, 2008 7:27 PM, <[EMAIL PROTECTED]> wrote: > "Alexander Batyrshin" <[EMAIL PROTECTED]> wrote: > > How to get error messages from test? Scroll up and copy-paste? Or > > there is some other more handy method? > > make test | tee testout.txt > > > -- > D. Richard Hipp <[EMAIL PROTECTED]> > > > - > To unsubscribe, send email to [EMAIL PROTECTED] > - > > -- Alexander Batyrshin aka bash bash = Biomechanica Artificial Sabotage Humanoid - To unsubscribe, send email to [EMAIL PROTECTED] -
Re: [sqlite] make test on FreeBSD 6.2-R, SQLite 3.5.5
On Thu, 31 Jan 2008, [EMAIL PROTECTED] wrote: Date: Thu, 31 Jan 2008 18:27:35 + From: [EMAIL PROTECTED] Reply-To: sqlite-users@sqlite.org To: sqlite-users@sqlite.org Subject: Re: [sqlite] make test on FreeBSD 6.2-R, SQLite 3.5.5 "Alexander Batyrshin" <[EMAIL PROTECTED]> wrote: How to get error messages from test? Scroll up and copy-paste? Or there is some other more handy method? make test | tee testout.txt aha! Take the simple approach, in keeping I re-ran the 3.5.5 test with: make test | grep -v Ok | tee test.output -=-=-=-=-=-=-=-=-= test.output -=-=-=-=-=-=-=-=-=-= ./testfixture ../test/quick.test bind-4.4... Error: floating point value is Not a Number bind-4.5... Expected: [null real real] Got: [] btree-2.1.1...CURSOR 8121088 rooted at1(rw) currently at 1.0 eof PAGE 1: flags=0x09 frag=0 parent=0 cell 0: i=913..1023 chld=0nk=2020 nd=1792 payload=*** This is a very PAGE 2: flags=0x08 frag=0 parent=0 PAGE 1 addr=80F7894 nRef=2 cast-3.14... Expected: [9223372036854774784] Got: [9223372036854773760] cast-3.18... Expected: [-9223372036854774784] Got: [-9223372036854773760] cast-3.24... Expected: [9223372036854774784] Got: [9223372036854773760] Skipping crash5 tests: not compiled with -DSQLITE_MEMDEBUG... Skipping malloc5 tests: not compiled with -DSQLITE_MEMDEBUG... Skipping malloc6 tests: not compiled with -DSQLITE_MEMDEBUG... Skipping malloc7 tests: not compiled with -DSQLITE_MEMDEBUG... Skipping malloc8 tests: not compiled with -DSQLITE_MEMDEBUG... Skipping malloc9 tests: not compiled with -DSQLITE_MEMDEBUG... Skipping mallocA tests: not compiled with -DSQLITE_MEMDEBUG... Skipping mallocB tests: not compiled with -DSQLITE_MEMDEBUG... Skipping mallocC tests: not compiled with -DSQLITE_MEMDEBUG... Skipping mallocD tests: not compiled with -DSQLITE_MEMDEBUG... Skipping mallocE tests: not compiled with -DSQLITE_MEMDEBUG... Skipping mallocF tests: not compiled with -DSQLITE_MEMDEBUG... Skipping mallocG tests: not compiled with -DSQLITE_MEMDEBUG... printf-1.7.6... Expected: [Three integers: (100) ( f4240) (3641100)] Got: [Three integers: ( 100) ( f4240) (3641100)] printf-1.8.6... Expected: [Three integers: (9) (3b9ac9ff) (7346544777)] Got: [Three integers: ( 9) (3b9ac9ff) (7346544777)] printf-1.9.7... Expected: [Three integers: ( 0) ( 0x0) ( 0)] Got: [Three integers: ( 0) ( 0) ( 0)] Skipping safety tests since SQLITE_DEBUG is off time with cache: 2292055 microseconds per iteration time without cache: 7910271 microseconds per iteration result=one 10 three 5 two 14 speed3-1.incrvacuum.. 201285 uS 4968.08009 row/s speed3-1.normal... 336842 uS 2968.75093 row/s Incrvacuum: Read 1098, wrote 94 Normal: Read 10479, wrote 43 speed3-2.incrvacuum.. 100244 uS 9975.65939 row/s speed3-2.normal... 233531 uS 4282.08675 row/s Incrvacuum: Read 2843, wrote 1 Normal: Read 10011, wrote 0 tcl-1.6... Expected: [1 {syntax error in expression "x*"}] Got: [1 {invalid bareword "x" in expression "x*"; should be "$x" or "{x}" or "x(...)" or ...}] vtab6-2.2... Expected: [1 2 3 {} 2 3 4 1 3 4 5 2] Got: [1 2 3 {} 2 3 4 {} 3 4 5 {}] vtab6-2.4... Expected: [1 2 3 {} {} {} 2 3 4 {} {} {} 3 4 5 1 2 3] Got: [1 2 3 {} {} {} 2 3 4 {} {} {} 3 4 5 {} {} {}] vtab6-2.5... Expected: [2 3 4 {} {} {} 3 4 5 1 2 3] Got: [2 3 4 {} {} {} 3 4 5 {} {} {}] vtab6-2.6... Expected: [1 2 3 {} {} {} 2 3 4 {} {} {}] Got: [1 2 3 {} {} {} 2 3 4 {} {} {} 3 4 5 {} {} {}] vtab6-7.1... Expected: [1 999 999 2 131 130 999] Got: [1 999 999 999 999 999 999] vtab6-9.1.1... Expected: [] Got: [2 22 {}] vtab6-9.2... Expected: [] Got: [2 22 {}] 16 errors out of 38961 tests Failures on these tests: bind-4.4 bind-4.5 cast-3.14 cast-3.18 cast-3.24 printf-1.7.6 printf-1.8.6 printf-1.9.7 tcl-1.6 vtab6-2.2 vtab6-2.4 vtab6-2.5 vtab6-2.6 vtab6-7.1 vtab6-9.1.1 vtab6-9.2 All memory allocations freed - no leaks Maximum memory usage: 14161974 bytes Current memory usage: 0 bytes *** Error code 1 Stop in /u0/sw/SQLite/sqlite-3.5.5/FreeBSD. - To unsubscribe, send email to [EMAIL PROTECTED] -
Re: [sqlite] make test on FreeBSD 6.2-R, SQLite 3.5.5
"Alexander Batyrshin" <[EMAIL PROTECTED]> wrote: > Here is my "make test" on Mac OS 10.5.1: > > 8 errors out of 38117 tests > Failures on these tests: lock4-1.3 vtab6-2.2 vtab6-2.4 vtab6-2.5 > vtab6-2.6 vtab6-7.1 vtab6-9.1.1 vtab6-9.2 > All memory allocations freed - no leaks > Maximum memory usage: 14161966 bytes > Current memory usage: 0 bytes > make: *** [test] Error 1 > We tested on Mac OS 10.4.11. No errors there. Once again, there is not much I can do to work on this problem without seeing the text of the error messages -- D. Richard Hipp <[EMAIL PROTECTED]> - To unsubscribe, send email to [EMAIL PROTECTED] -
Re: [sqlite] make test on FreeBSD 6.2-R, SQLite 3.5.5
On Thu, 31 Jan 2008, [EMAIL PROTECTED] wrote: Rob Sciuk <[EMAIL PROTECTED]> wrote: Ran the tests on Freebsd, the make test summary follows: [delenda => ... Ok] 16 errors out of 38961 tests Failures on these tests: bind-4.4 bind-4.5 cast-3.14 cast-3.18 cast-3.24 printf-1.7.6 printf-1.8.6 printf-1.9.7 tcl-1.6 vtab6-2.2 vtab6-2.4 vtab6-2.5 vtab6-2.6 vtab6-7.1 vtab6-9.1.1 vtab6-9.2 All memory allocations freed - no leaks Maximum memory usage: 14161974 bytes Current memory usage: 0 bytes *** Error code 1 We get zero test failures on Linux. I don't know if these are significant or not without seeing the test error messages that accompany each failure. Probably this is things where your system is printing 3.4e+05 whereas SQLite is looking for 3.4e+005, in which case the errors are benign. But without seeing the actual errors, I cannot say for sure. -- D. Richard Hipp <[EMAIL PROTECTED]> Hmmm ... by my reckoning, you have added 261 tests *JUST* for version 3.5.5. Pretty big effort I'd say, and much appreciated I'd like to add. I re-ran the make test on 3.5.4, and there seems to be a significant overlap in those reporting failure (see below). As I have not yet figured out how to run them individually (eg: make test bind-4.4), nor did I find an output error file, I'll make the assumption that you are correct, and the diffs are indeed benign (since everything seems to work really well), at least until I have some time to re-visit. Have you done any performance regression tests on the 3.5.5 VM yet?? I suspect that there will be an improvement ... -=-=-=-=-=-=-=-=-= FreeBSD 6.2-R (same hw), SQLite 3.5.4 reported: [delendum ... Ok] 9 errors out of 38700 tests Failures on these tests: bind-4.4 bind-4.5 cast-3.14 cast-3.18 cast-3.24 printf-1.7.6 printf-1.8.6 printf-1.9.7 tcl-1.6 All memory allocations freed - no leaks Maximum memory usage: 14165134 bytes *** Error code 1 Stop in /u0/sw/SQLite/sqlite-3.5.4/FreeBSD. - To unsubscribe, send email to [EMAIL PROTECTED] -
Re: [sqlite] make test on FreeBSD 6.2-R, SQLite 3.5.5
How to get error messages from test? Scroll up and copy-pase? Or there is some other more handy method? On Jan 31, 2008 7:03 PM, <[EMAIL PROTECTED]> wrote: > Rob Sciuk <[EMAIL PROTECTED]> wrote: > > Ran the tests on Freebsd, the make test summary follows: > > [delenda => ... Ok] > > > > 16 errors out of 38961 tests > > Failures on these tests: bind-4.4 bind-4.5 cast-3.14 cast-3.18 cast-3.24 > > printf-1.7.6 printf-1.8.6 printf-1.9.7 tcl-1.6 vtab6-2.2 vtab6-2.4 > > vtab6-2.5 vtab6-2.6 vtab6-7.1 vtab6-9.1.1 vtab6-9.2 > > All memory allocations freed - no leaks > > Maximum memory usage: 14161974 bytes > > Current memory usage: 0 bytes > > *** Error code 1 > > > > We get zero test failures on Linux. I don't know if these are > significant or not without seeing the test error messages that > accompany each failure. > > Probably this is things where your system is printing 3.4e+05 > whereas SQLite is looking for 3.4e+005, in which case the errors > are benign. But without seeing the actual errors, I cannot say > for sure. > -- > D. Richard Hipp <[EMAIL PROTECTED]> > > > > - > To unsubscribe, send email to [EMAIL PROTECTED] > - > > -- Alexander Batyrshin aka bash bash = Biomechanica Artificial Sabotage Humanoid - To unsubscribe, send email to [EMAIL PROTECTED] -
Re: [sqlite] make test on FreeBSD 6.2-R, SQLite 3.5.5
Here is my "make test" on Mac OS 10.5.1: 8 errors out of 38117 tests Failures on these tests: lock4-1.3 vtab6-2.2 vtab6-2.4 vtab6-2.5 vtab6-2.6 vtab6-7.1 vtab6-9.1.1 vtab6-9.2 All memory allocations freed - no leaks Maximum memory usage: 14161966 bytes Current memory usage: 0 bytes make: *** [test] Error 1 -- Alexander Batyrshin aka bash bash = Biomechanica Artificial Sabotage Humanoid - To unsubscribe, send email to [EMAIL PROTECTED] -
Re: [sqlite] make test on FreeBSD 6.2-R, SQLite 3.5.5
"Alexander Batyrshin" <[EMAIL PROTECTED]> wrote: > How to get error messages from test? Scroll up and copy-paste? Or > there is some other more handy method? make test | tee testout.txt -- D. Richard Hipp <[EMAIL PROTECTED]> - To unsubscribe, send email to [EMAIL PROTECTED] -
Re: [sqlite] make test on FreeBSD 6.2-R, SQLite 3.5.5
How to get error messages from test? Scroll up and copy-paste? Or there is some other more handy method? On Jan 31, 2008 7:03 PM, <[EMAIL PROTECTED]> wrote: > Rob Sciuk <[EMAIL PROTECTED]> wrote: > > Ran the tests on Freebsd, the make test summary follows: > > [delenda => ... Ok] > > > > 16 errors out of 38961 tests > > Failures on these tests: bind-4.4 bind-4.5 cast-3.14 cast-3.18 cast-3.24 > > printf-1.7.6 printf-1.8.6 printf-1.9.7 tcl-1.6 vtab6-2.2 vtab6-2.4 > > vtab6-2.5 vtab6-2.6 vtab6-7.1 vtab6-9.1.1 vtab6-9.2 > > All memory allocations freed - no leaks > > Maximum memory usage: 14161974 bytes > > Current memory usage: 0 bytes > > *** Error code 1 > > > > We get zero test failures on Linux. I don't know if these are > significant or not without seeing the test error messages that > accompany each failure. > > Probably this is things where your system is printing 3.4e+05 > whereas SQLite is looking for 3.4e+005, in which case the errors > are benign. But without seeing the actual errors, I cannot say > for sure. > -- > D. Richard Hipp <[EMAIL PROTECTED]> > > > > - > To unsubscribe, send email to [EMAIL PROTECTED] > - > > -- Alexander Batyrshin aka bash bash = Biomechanica Artificial Sabotage Humanoid - To unsubscribe, send email to [EMAIL PROTECTED] -
Re: [sqlite] make test on FreeBSD 6.2-R, SQLite 3.5.5
Rob Sciuk <[EMAIL PROTECTED]> wrote: > Ran the tests on Freebsd, the make test summary follows: > [delenda => ... Ok] > > 16 errors out of 38961 tests > Failures on these tests: bind-4.4 bind-4.5 cast-3.14 cast-3.18 cast-3.24 > printf-1.7.6 printf-1.8.6 printf-1.9.7 tcl-1.6 vtab6-2.2 vtab6-2.4 > vtab6-2.5 vtab6-2.6 vtab6-7.1 vtab6-9.1.1 vtab6-9.2 > All memory allocations freed - no leaks > Maximum memory usage: 14161974 bytes > Current memory usage: 0 bytes > *** Error code 1 > We get zero test failures on Linux. I don't know if these are significant or not without seeing the test error messages that accompany each failure. Probably this is things where your system is printing 3.4e+05 whereas SQLite is looking for 3.4e+005, in which case the errors are benign. But without seeing the actual errors, I cannot say for sure. -- D. Richard Hipp <[EMAIL PROTECTED]> - To unsubscribe, send email to [EMAIL PROTECTED] -
[sqlite] make test on FreeBSD 6.2-R, SQLite 3.5.5
Ran the tests on Freebsd, the make test summary follows: [delenda => ... Ok] 16 errors out of 38961 tests Failures on these tests: bind-4.4 bind-4.5 cast-3.14 cast-3.18 cast-3.24 printf-1.7.6 printf-1.8.6 printf-1.9.7 tcl-1.6 vtab6-2.2 vtab6-2.4 vtab6-2.5 vtab6-2.6 vtab6-7.1 vtab6-9.1.1 vtab6-9.2 All memory allocations freed - no leaks Maximum memory usage: 14161974 bytes Current memory usage: 0 bytes *** Error code 1 Stop in /u0/sw/SQLite/sqlite-3.5.5/FreeBSD. Any comments on the Failures?? Are these normal, or should I be worried?? Cheers, Rob. - To unsubscribe, send email to [EMAIL PROTECTED] -