Re: [sqlite] How to set memory usage as high as possible -- but not too high?

2008-04-24 Thread Ralf Junker
Jay A. Kreibich wrote: >> >Are you using a 32 bit or 64 bit process. >> >> 32, but it does not matter to the problem. > > When you give examples like "PRAGMA cache_size = 1000;", or 10M > pages which would take something on the order of 15 GB of memory to > service with the default 1K page

Re: [sqlite] How to set memory usage as high as possible -- but not too high?

2008-04-14 Thread Jay A. Kreibich
On Mon, Apr 14, 2008 at 09:51:40AM +0200, Ralf Junker scratched on the wall: > >> * OPTION 1: PRAGMA cache_size = 1000; > >> > >> Advantage: SQLite will use ample memory, but no more than that. > >> > >> Disadvantage: Difficulty to establish exact memory requirements in > >> advance. The hel

Re: [sqlite] How to set memory usage as high as possible -- but not too high?

2008-04-14 Thread Ralf Junker
Dan, many thanks for the quick response and detailed answers. However, a question or two still puzzle me. >> * OPTION 1: PRAGMA cache_size = 1000; >> >> Advantage: SQLite will use ample memory, but no more than that. >> >> Disadvantage: Difficulty to establish exact memory requirements in

Re: [sqlite] How to set memory usage as high as possible -- but not too high?

2008-04-14 Thread Ralf Junker
Roger Binns wrote: >Are you using a 32 bit or 64 bit process. 32, but it does not matter to the problem. >Also is there a requirement to create the database in the filesystem? Yes. >If not you could ensure your swap is sufficiently large (I use a mininmum of >16GB on my machines :-) and creat

Re: [sqlite] How to set memory usage as high as possible -- but not too high?

2008-04-13 Thread Dan
On Apr 14, 2008, at 5:53 AM, Ralf Junker wrote: > I need to create a huge database (about 6 GB, more than 6 mio > records, blobs, and FTS text) in as little time as possible. Since > memory is the key to speed, I try to use as much memory as is > available. However, there is the danger of r

Re: [sqlite] How to set memory usage as high as possible -- but not too high?

2008-04-13 Thread Roger Binns
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Ralf Junker wrote: > I need to create a huge database (about 6 GB, more than 6 mio records, blobs, > and FTS text) in as little time as possible. Since memory is the key to > speed, I try to use as much memory as is available. However, there is the

[sqlite] How to set memory usage as high as possible -- but not too high?

2008-04-13 Thread Ralf Junker
I need to create a huge database (about 6 GB, more than 6 mio records, blobs, and FTS text) in as little time as possible. Since memory is the key to speed, I try to use as much memory as is available. However, there is the danger of running out of memory. This is where memory usage control come