Re: [sqlite] Reading compressed database files

2014-05-28 Thread Roger Binns
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 28/05/14 02:26, Hadashi, Rinat wrote: > I have 13 tables, of which 2 are huge, 2 are medium and the rest are > very small. My huge tables have 3 columns: numeric, numeric and varchar > with millions of rows. I keep an index on the numeric columns. >

Re: [sqlite] Reading compressed database files

2014-05-28 Thread Richard Hipp
On Wed, May 28, 2014 at 11:33 AM, Hadashi, Rinat wrote: > Fixed data. I write the databases once in a different flow, and then I > only read them. > How well does gzip compress the database? In other words, if you do: ls -l original.db gzip original.db ls -l original.db.gz How m

Re: [sqlite] Reading compressed database files

2014-05-28 Thread Hadashi, Rinat
Database Subject: Re: [sqlite] Reading compressed database files On 28 May 2014, at 8:25am, Hadashi, Rinat wrote: > My databases are very big (almost 100 GB). > I am looking for a compression solution. Are these databases with fixed data which can be opened read-only ? Or do you have to be a

Re: [sqlite] Reading compressed database files

2014-05-28 Thread Simon Slavin
On 28 May 2014, at 8:25am, Hadashi, Rinat wrote: > My databases are very big (almost 100 GB). > I am looking for a compression solution. Are these databases with fixed data which can be opened read-only ? Or do you have to be able to make changes to them ? It makes a huge difference in how

Re: [sqlite] Reading compressed database files

2014-05-28 Thread Teg
-Original Message- HR> From: sqlite-users-boun...@sqlite.org HR> [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Roger Binns HR> Sent: Wednesday, May 28, 2014 12:06 PM HR> To: General Discussion of SQLite Database HR> Subject: Re: [sqlite] Reading compressed database files

Re: [sqlite] Reading compressed database files

2014-05-28 Thread Richard Hipp
On Wed, May 28, 2014 at 5:26 AM, Hadashi, Rinat wrote: > Hi Roger > > Where can I learn how to characterize my database? > How much does ZIP or gzip compress your database? The amount of compression obtained by CEROD is usually very close to the compression obtained simply by running the databas

Re: [sqlite] Reading compressed database files

2014-05-28 Thread Hadashi, Rinat
: [sqlite] Reading compressed database files -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 28/05/14 00:25, Hadashi, Rinat wrote: > My databases are very big (almost 100 GB). I am looking for a > compression solution. > > Did anyone have an experience with reading a compressed databas

Re: [sqlite] Reading compressed database files

2014-05-28 Thread Roger Binns
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 28/05/14 00:25, Hadashi, Rinat wrote: > My databases are very big (almost 100 GB). I am looking for a > compression solution. > > Did anyone have an experience with reading a compressed database? It would be helpful if you characterise your data a

Re: [sqlite] Reading compressed database files

2014-05-28 Thread RSmith
On 2014/05/28 09:25, Hadashi, Rinat wrote: Hi My databases are very big (almost 100 GB). I am looking for a compression solution. Did anyone have an experience with reading a compressed database? What was the degradation in performance of queries? Severe. Well, this depends - if the table c

[sqlite] Reading compressed database files

2014-05-28 Thread Hadashi, Rinat
Hi My databases are very big (almost 100 GB). I am looking for a compression solution. Did anyone have an experience with reading a compressed database? What was the degradation in performance of queries? Thanks Rinat Hadashi