Re: [sqlite] Corrupted database

2009-10-14 Thread McClellen, Chris
Subject: Re: [sqlite] Corrupted database On Oct 14, 2009, at 12:42 AM, McClellen, Chris wrote: But it does happen and we can reproduce it. Hard killing a thread is essentially equivalent to turning off the power. We have always assumed that it is different. When you write data to a file, the write

Re: [sqlite] Corrupted database

2009-10-14 Thread McClellen, Chris
:36 AM MC To: General Discussion of SQLite Database MC Subject: Re: [sqlite] Corrupted database MC On Oct 14, 2009, at 12:42 AM, McClellen, Chris wrote: But it does happen and we can reproduce it. Hard killing a thread is essentially equivalent to turning off the power. MC We have always

Re: [sqlite] Corrupted database

2009-10-14 Thread McClellen, Chris
I think the issue is : Thread 1 does exitprocess/terminateprocess (or process.kill, or anything like that) Thread 2 does write() -- the write I believe can be interrupted when partially complete in these cases (only part of the blocks have been written to disk, the others are not even

Re: [sqlite] Corrupted database

2009-10-13 Thread McClellen, Chris
To: General Discussion of SQLite Database Subject: Re: [sqlite] Corrupted database On Oct 13, 2009, at 1:56 AM, McClellen, Chris wrote: What is your synchronous set to? Full? FYI If you are using .NET data providers, it is set to Normal by default. If it is not set to full, I have seen

Re: [sqlite] Corrupted database

2009-10-12 Thread McClellen, Chris
What is your synchronous set to? Full? FYI If you are using .NET data providers, it is set to Normal by default. If it is not set to full, I have seen corruption when an application crashes, or exits when a thread is in the middle of updating the db (Synchronous = OFF makes corruption even

Re: [sqlite] Insert speed greatly decreasing over time

2009-10-08 Thread McClellen, Chris
I think I may now understand the problem we're seeing. I left out a very important piece of information: On the dbs we're seeing the increase in insert time, the average row size is large - really large. Basically we can see averages as high as 45k. This was causing overflow chains to be as

[sqlite] Insert speed greatly decreasing over time

2009-10-07 Thread McClellen, Chris
We have an application that uses a single table database, that is quite simple. Here is the schema: CREATE TABLE t (k varchar(50) primary key not null, d text not null, e datetime) We receive data over the course of an hour that is in a different form and we need to put into the db. The order

Re: [sqlite] Insert speed greatly decreasing over time

2009-10-07 Thread McClellen, Chris
I have not done that yet; I'll get it into that state then attach to sqlite3's command line tool and see if I can learn something. I will let you know what I find. -Original Message- From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Pavel Ivanov