Re: [sqlite] Recovery After Crash

2007-06-18 Thread Asif Lodhi

Hi Christian,

On 6/19/07, Christian Smith <[EMAIL PROTECTED]> wrote:

SQLite is not optimised for large datasets. 
..
Consider using larger pages than the default 1024 bytes to limit the
number of pages SQLite must track. ..


Thank you for replying. I think performance can be tested only by
actual testing on live data. I'll code my application accordingly so
that I can replace Sqlite specfic code with something else in case I
run  into major problems.

--
Thanks again,

Asif

-
To unsubscribe, send email to [EMAIL PROTECTED]
-



Re: [sqlite] Recovery After Crash

2007-06-18 Thread Christian Smith

Asif Lodhi uttered:


Hi Kees,

Thanks for replying.

On 6/17/07, Kees Nuyt <[EMAIL PROTECTED]> wrote:

>... thankful if you experts would give me an "accurate" and fair
>picture of the crash-recovery aspects of SQLite - without any hype.

I'm not sure if you would qualify this as hype, but sqlite is
used in many end-user products, ranging from operating systems ..


Basically, I intend to use sqlite's data capacity as well - I mean
2^41 bytes - for reasonably sized databases. Well, not as much as 2^41
but somewhere around 2^32 to 2^36 bytes. I would like to know if the
"crash-recovery" feature will still work and the high-performance
mentioned will be valid even if I have this kind of a data volume. And
yes, I am talking about highly normalized database schemas with number
of tables exceeding 80. Please reply assuming I tend to come up
optimized db & query designs - keeping in view general rules for
database/query optimizations.



SQLite is not optimised for large datasets. Data recovery will work, as 
advertised, in the general case including large datasets, but the memory 
footprint of the library increases as the size of the database grows.


Consider using larger pages than the default 1024 bytes to limit the 
number of pages SQLite must track.


Other than that, the performance should degrade predictably with 
increasing datasets, given that SQLite uses the same BTree(+) based 
algorithms used by most database engines.





--
Thanks again and best regards,

Asif

-
To unsubscribe, send email to [EMAIL PROTECTED]
-



--
/"\
\ /ASCII RIBBON CAMPAIGN - AGAINST HTML MAIL
 X   - AGAINST MS ATTACHMENTS
/ \

-
To unsubscribe, send email to [EMAIL PROTECTED]
-



Re: [sqlite] Recovery After Crash

2007-06-17 Thread Asif Lodhi

Hi Kees,

Thanks for replying.

On 6/17/07, Kees Nuyt <[EMAIL PROTECTED]> wrote:

>... thankful if you experts would give me an "accurate" and fair
>picture of the crash-recovery aspects of SQLite - without any hype.

I'm not sure if you would qualify this as hype, but sqlite is
used in many end-user products, ranging from operating systems ..


Basically, I intend to use sqlite's data capacity as well - I mean
2^41 bytes - for reasonably sized databases. Well, not as much as 2^41
but somewhere around 2^32 to 2^36 bytes. I would like to know if the
"crash-recovery" feature will still work and the high-performance
mentioned will be valid even if I have this kind of a data volume. And
yes, I am talking about highly normalized database schemas with number
of tables exceeding 80. Please reply assuming I tend to come up
optimized db & query designs - keeping in view general rules for
database/query optimizations.

--
Thanks again and best regards,

Asif

-
To unsubscribe, send email to [EMAIL PROTECTED]
-



Re: [sqlite] Recovery After Crash

2007-06-17 Thread Kees Nuyt

Hi Asif,

On Sun, 17 Jun 2007 12:59:21 +0500, you wrote:

>Hi Everybody,
>
>I have just joined this mailing list as Sqlite looks like a good
>software solution to my needs. What I need right now is RE-assurance
>of "crash-recovery" that is mentioned on your front page. So, I would
>be thankful if you experts would give me an "accurate" and fair
>picture of the crash-recovery aspects of SQLite - without any hype.

I'm not sure if you would qualify this as hype, but sqlite is
used in many end-user products, ranging from operating systems
(OS X), webbrowsers (Firefox), embedded systems like PDA's, mp3
players etcetera. These are all enviroments where the users 1)
aren't especially careful 2) aren't willing or able to
handrecover a database. They even don't know it's there.
-- 
  (  Kees Nuyt
  )
c[_]

-
To unsubscribe, send email to [EMAIL PROTECTED]
-



[sqlite] Recovery After Crash

2007-06-17 Thread Asif Lodhi

Hi Everybody,

I have just joined this mailing list as Sqlite looks like a good
software solution to my needs. What I need right now is RE-assurance
of "crash-recovery" that is mentioned on your front page. So, I would
be thankful if you experts would give me an "accurate" and fair
picture of the crash-recovery aspects of SQLite - without any hype.

--
Best regards,

Asif

-
To unsubscribe, send email to [EMAIL PROTECTED]
-