Re: [sqlite] SQLite & Big Database
In 03/17/2004 09:36 PM, Puneet Kishor wrote: Mateusz Łoskot wrote: [...] I am assuming that means it is a good thing. ;-) Certainly. -- Mateusz Łoskot, mateusz at loskot dot net GNU/Linux (Slackware 9.1) http://counter.li.org #220771 - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: [sqlite] SQLite & Big Database
On Wed, Mar 17, 2004 at 10:30:56AM -0800, Will Leshner wrote: > Mateusz £oskot wrote: > > > I've just moved one table from my "Big" database. There are about 11000 > > of records and as I see SQLite database takes about 2,7 MB. > > Actually, I consider that pretty small, as databases go. I've been working with > databases in the 300Mb range with upwards of 500,000 - 1,000,000 records, and I bet > others would consider *that* small. I'm using SQLite as a staging and etl database between a production operational database and and decision support database. I see sqlite.db sizes of 2-10gb on a regular basis. -- Tom Poindexter [EMAIL PROTECTED] http://www.nyx.net/~tpoindex/ - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: [sqlite] SQLite & Big Database
Mateusz Łoskot wrote: In 03/17/2004 07:30 PM, Will Leshner wrote: Mateusz Łoskot wrote: I've just moved one table from my "Big" database. There are about 11000 of records and as I see SQLite database takes about 2,7 MB. Actually, I consider that pretty small, as databases go. I've been working with databases in the 300Mb range with upwards of 500,000 - 1,000,000 records, and I bet others would consider *that* small. First, I'm exporting my three databases, each stores about 20-30 MB (about 110 tables). But I'm going to export much bigger - about 400-500 MB ;-) After a very little review (working with one table with 11000 recs) I've to say that SQLites is an evil in its speed. ^^ I am assuming that means it is a good thing. ;-) Yes, SQLite is definitely bad, verrry, verrry bad when it comes to speed. It beats most of 'em. - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: [sqlite] SQLite & Big Database
- Original Message - From: "Mateusz Łoskot" <[EMAIL PROTECTED]> Sent: Wednesday, March 17, 2004 12:33 PM Subject: [sqlite] SQLite & Big Database > So, has anyone work with such big databases in SQLite ? > I'm looking for some hints and tips about that. I posted a message last night about my "large" database test. I found that setting the synchronous = OFF pragma and, more importantly, using transactions when loading large amounts of data would result in the best performance. > I've just moved one table from my "Big" database. There are about 11000 > of records and as I see SQLite database takes about 2,7 MB. The test I ran consisted of about 2 million records and resulted in a database size of about 695 MB (one table, without any indexes). The "raw" data I was importing from consisted of about 360 MB. After using transactions I found the speed to be good, but the size overhead a little puzzling. // CHRIS - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: [sqlite] SQLite & Big Database
In 03/17/2004 07:30 PM, Will Leshner wrote: Mateusz Łoskot wrote: I've just moved one table from my "Big" database. There are about 11000 of records and as I see SQLite database takes about 2,7 MB. Actually, I consider that pretty small, as databases go. I've been working with databases in the 300Mb range with upwards of 500,000 - 1,000,000 records, and I bet others would consider *that* small. First, I'm exporting my three databases, each stores about 20-30 MB (about 110 tables). But I'm going to export much bigger - about 400-500 MB ;-) After a very little review (working with one table with 11000 recs) I've to say that SQLites is an evil in its speed. It is amazing for now. Let's make some other tests.. Regards -- Mateusz Łoskot, mateusz at loskot dot net GNU/Linux (Slackware 9.1) http://counter.li.org #220771 - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: [sqlite] SQLite & Big Database
Mateusz Łoskot wrote: I've just moved one table from my "Big" database. There are about 11000 of records and as I see SQLite database takes about 2,7 MB. Actually, I consider that pretty small, as databases go. I've been working with databases in the 300Mb range with upwards of 500,000 - 1,000,000 records, and I bet others would consider *that* small. - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
[sqlite] SQLite & Big Database
Hi, I'm using SQLite for some time, mainly on Windows CE but on Linux and Windows 2000 too. My databases are not very big and they consist of about 10-30 tables. Now, I'm going to move one of my big database currently in MDB format that consists of about 110 tables and some of them stores a few tousends records. There are mainly numerical data in my database stored. So, has anyone work with such big databases in SQLite ? I'm looking for some hints and tips about that. I've just moved one table from my "Big" database. There are about 11000 of records and as I see SQLite database takes about 2,7 MB. Kind regards -- Mateusz Łoskot, mateusz at loskot dot net GNU/Linux (Slackware 9.1) http://counter.li.org #220771 - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
