[sqlite] ADO.NET driver upgrade puzzle

2017-09-25 Thread Roberts, Barry (FINTL)
Hi, We have a C# application which logs data in real-time to sqlite files. The application is multi-threaded, and typically logs 200-500 data streams simultaneously. The logging rate per stream is 1Hz to 1000Hz, depending on the type of data coming in. Each data stream is logged to its own db3

Re: [sqlite] ADO.NET driver upgrade puzzle

2017-09-25 Thread Roberts, Barry (FINTL)
Hi Clemens, As per my original post, all C# access code is making extensive use of "using" statements. However we do obviously rely on the connection pool being thread safe, because many threads are writing to different databases (connections) concurrently. There is no direct relationship betw

Re: [sqlite] ADO.NET driver upgrade puzzle

2017-09-27 Thread Roberts, Barry (FINTL)
Hi, I am aware of the sqlite FAQ, and especially the comments regarding file systems. We only ever use NTFS file system, and never have any FAT or FAT32 file systems. Given that the old 1.0.80.0 driver is totally stable, and the newer one is not, on the same exact hardware, I do not think the i

Re: [sqlite] When is db size an issue?

2017-10-02 Thread Roberts, Barry (FINTL)
We have logged live data into databases that are over 200GB without any issues. I don't think SQLite will be the issue itself, as it is merely limited by the file system. The more likely issue is when you need to transfer or backup the file, it can get unwieldy if it is too large. Kind Regards,

[sqlite] pragma integrity_check throwing exception

2017-10-03 Thread Roberts, Barry (FINTL)
Hi, Assume I have a database which is "malformed" due to rowid xxx missing from a table index. In the System.Data.SQLite.dll 1.0.80.0 C# driver the following code would return the reason, I would get a list of the rowid problems allowing me to log them. private static IEnumerable Integ

[sqlite] C# pragma integrity_check call throwing exception

2017-10-24 Thread Roberts, Barry (FINTL)
Hi, I asked the following question a few weeks ago, but did not get any responses, hoping someone may have an idea. We are currently running System.Data.SQLite.dll 1.0.80.0 and would like to upgrade to a newer version. However there are a variety of issues we have run into, most of which I hav

Re: [sqlite] C# pragma integrity_check call throwing exception

2017-10-26 Thread Roberts, Barry (FINTL)
Simon, > Your text makes it look like you think that that kind of corruption affects > only existing rows. This is not the case. If you continue to write to a > database which shows this problem, you can lose more of the existing rows > and/or the new data you're trying to write. The proper