Re: [sqlite] Speed Test Done !

2005-10-06 Thread Chris Schirlinger
You can load sqlite into memory? I do have 2GB of RAM. You can pass :memory: to the sqlite_open command to open a SQLite database in memory I think it is I imagine this will speed up your retrievals but without an index it will still be slower that it should be. With an index I imagine

RE: [sqlite] Speed Test Done !

2005-10-06 Thread Steve O'Hara
] [mailto:[EMAIL PROTECTED] rg] On Behalf Of Richard Sent: 06 October 2005 04:57 To: SQLite Users Mailing List Subject: [sqlite] Speed Test Done ! Importance: High Well, finally import 9,337,681 records into sqlite3 test2.db and ran the test. import sqtest4.txt : 2 min 28 seconds select

Re: [sqlite] Speed Test Done !

2005-10-06 Thread Bert Verhees
] rg] On Behalf Of Richard Sent: 06 October 2005 04:57 To: SQLite Users Mailing List Subject: [sqlite] Speed Test Done ! Importance: High Well, finally import 9,337,681 records into sqlite3 test2.db and ran the test. import sqtest4.txt : 2 min 28 seconds select A, '32.0833' From T ; 9 min

Re: [sqlite] Speed Test Done !

2005-10-06 Thread John Stanton
As I understand it Panorama is ram-based, and consequently unsuitable for large databases. Being memory resident naturally gives it greater speed, but limits it to small scale applications. I note that Dr Hipp quite clearly makes the point that Sqlite does not even map the Sqlite file into

Re: [sqlite] Speed Test Done !

2005-10-06 Thread Richard
Okay Steve, I try this, please note: in PAN, there is no way for me to deselect the other field ie: in this three field database, I do a search, PAN will display all three field but with the found set, of the search string. Richard On Thu, 06 Oct 2005 06:22:31 -0400, Steve O'Hara [EMAIL

Re: [sqlite] Speed Test Done !

2005-10-06 Thread Dennis Cote
Richard wrote: To find 32.0833 from field A, in Table T Richard, To correctly compare the speed of SQLite to Panorama running from memory you need to do the following. Start sqlite with no database file name. It will open a database in memory. sqlite3 Now create your table and import

Re: [sqlite] Speed Test Done !

2005-10-06 Thread Richard
Well, There must be something wrong with the test, you wanted me to run: Welcome to Darwin! G4:~ rn$ sqlite3 SQLite version 3.2.5 Enter .help for instructions sqlite create table T (A, B, C ); sqlite .separator , sqlite .import 'sqtest4.txt' T sqlite create index I on T (A) ; sqlite .output

Re: [sqlite] Speed Test Done !

2005-10-06 Thread Dennis Cote
Richard wrote: Well, There must be something wrong with the test, you wanted me to run: Welcome to Darwin! G4:~ rn$ sqlite3 SQLite version 3.2.5 Enter .help for instructions sqlite create table T (A, B, C ); sqlite .separator , sqlite .import 'sqtest4.txt' T sqlite create index I on T (A) ;

Re: [sqlite] Speed Test Done !

2005-10-06 Thread Robert L Cochran
select * from T where A = '32.0833'; (quote the 32.0833...'32.0833') If you happen to have the sqtest4.txt file available for downloading (via wget or http), I might try doing this myself. Bob Cochran Richard wrote: Well, Did the correction, and still the results text was nothing (zero)

Re: [sqlite] Speed Test Done !

2005-10-06 Thread Richard
Hey, I be more than happy to uploaded to anyone web site, for all to download. its just a test database based on the National Geological Study, its there data, however its huge. 175 MB text file. Richard On Thu, 06 Oct 2005 14:06:47 -0400, Robert L Cochran [EMAIL PROTECTED] wrote:

Re: [sqlite] Speed Test Done !

2005-10-06 Thread Dennis Cote
Richard wrote: Well, Did the correction, and still the results text was nothing (zero) there should be over 2000 hits... cron import time: 3 min 20 second and index time: 16 min 6 second. Again, correct the last part: select * from T where A = 32.0833 and A 32.0834; no results show in file.

Re: [sqlite] Speed Test Done !

2005-10-06 Thread Robert L Cochran
Can you post a link to the source of the text data. That is, a link to the web site where you got the data from. Bob Cochran Richard wrote: Hey, I be more than happy to uploaded to anyone web site, for all to download. its just a test database based on the National Geological Study, its

Re: [sqlite] Speed Test Done (RE )

2005-10-06 Thread Richard
Okay,, Thanks to all, thanks to Robert, for the tweak on select string. that work... However, the select * from T where A = '32.0833' ; work, and now the speed test report: It found 2161 records, in 0.0075 seconds. ( out of 9,337,681 records ) Memory, did not jump that much, from 177 MB to

[sqlite] Speed Test Done !

2005-10-05 Thread Richard
Well, finally import 9,337,681 records into sqlite3 test2.db and ran the test. import sqtest4.txt : 2 min 28 seconds select A, '32.0833' From T ; 9 min 20 seconds -- I use another database for MacOS X also works on Windows, Call Panorama Did another test, comparing database... import

Re: [sqlite] Speed Test Done !

2005-10-05 Thread Lindsay
Richard wrote: Still have found no sql program yet, that can beat Panorama in speed. Since Panorama is RAM based, how about if you did your speed test with a SQLite in memory database ? -- Lindsay

Re: [sqlite] Speed Test Done !

2005-10-05 Thread Puneet Kishor
On Oct 5, 2005, at 10:57 PM, Richard wrote: Well, finally import 9,337,681 records into sqlite3 test2.db and ran the test. import sqtest4.txt : 2 min 28 seconds select A, '32.0833' From T ; 9 min 20 seconds there is no constraint in the above statement... you are selecting A (which, I am

Re: [sqlite] Speed Test Done !

2005-10-05 Thread Richard
To find 32.0833 from field A, in Table T Richard PS: Nothing is index On Thu, 06 Oct 2005 01:17:35 -0400, Puneet Kishor [EMAIL PROTECTED] wrote: On Oct 5, 2005, at 10:57 PM, Richard wrote: Well, finally import 9,337,681 records into sqlite3 test2.db and ran the test. import

Re: [sqlite] Speed Test Done !

2005-10-05 Thread Richard
You can load sqlite into memory? I do have 2GB of RAM. Richar d On Thu, 06 Oct 2005 00:04:29 -0400, Lindsay [EMAIL PROTECTED] wrote: Richard wrote: Still have found no sql program yet, that can beat Panorama in speed. Since Panorama is RAM based, how about if you did your speed test