Re: [sqlite] Corrupted database

2009-10-14 Thread McClellen, Chris
I think the issue is : Thread 1 does exitprocess/terminateprocess (or process.kill, or anything like that) Thread 2 does write() -- the write I believe can be interrupted when partially complete in these cases (only part of the blocks have been written to disk, the others are not even

Re: [sqlite] Corrupted database

2009-10-14 Thread McClellen, Chris
is never called.. and we get no MC> corruption. MC> Just a thought. MC> -Original Message- MC> From: sqlite-users-boun...@sqlite.org MC> [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Dan Kennedy MC> Sent: Wednesday, October 14, 2009 12:36 AM MC> To: Gener

Re: [sqlite] Corrupted database

2009-10-14 Thread McClellen, Chris
Subject: Re: [sqlite] Corrupted database On Oct 14, 2009, at 12:42 AM, McClellen, Chris wrote: > But it does happen and we can reproduce it. Hard killing a thread is > essentially equivalent to turning off the power. We have always assumed that it is different. When you write data to

Re: [sqlite] Corrupted database

2009-10-13 Thread McClellen, Chris
To: General Discussion of SQLite Database Subject: Re: [sqlite] Corrupted database On Oct 13, 2009, at 1:56 AM, McClellen, Chris wrote: > What is your synchronous set to? Full? FYI If you are using .NET > data > providers, it is set to "Normal" by default. > > If it is not

Re: [sqlite] Corrupted database

2009-10-12 Thread McClellen, Chris
What is your synchronous set to? Full? FYI If you are using .NET data providers, it is set to "Normal" by default. If it is not set to full, I have seen corruption when an application crashes, or exits when a thread is in the middle of updating the db (Synchronous = OFF makes corruption even

Re: [sqlite] Insert speed greatly decreasing over time

2009-10-08 Thread McClellen, Chris
I think I may now understand the problem we're seeing. I left out a very important piece of information: On the dbs we're seeing the increase in insert time, the average row size is large - really large. Basically we can see averages as high as 45k. This was causing overflow chains to be as

Re: [sqlite] Insert speed greatly decreasing over time

2009-10-07 Thread McClellen, Chris
I have not done that yet; I'll get it into that state then attach to sqlite3's command line tool and see if I can learn something. I will let you know what I find. -Original Message- From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Pavel Ivanov

[sqlite] Insert speed greatly decreasing over time

2009-10-07 Thread McClellen, Chris
We have an application that uses a single table database, that is quite simple. Here is the schema: CREATE TABLE t (k varchar(50) primary key not null, d text not null, e datetime) We receive data over the course of an hour that is in a different form and we need to put into the db. The order