Re: [sqlite] SQLite for datalogging - best practices

2018-10-30 Thread Keith Medcalf
Based on the block erase rate required to maintain I/O churn using the following database schema and assumptions: - SSD size is 32 GB - erase size is 2 MB - 3000 erase cycles per block (49,152,000 erase operations total) -- data returned from the wal_checkpoint operations create table Tracer (

Re: [sqlite] SQLite for datalogging - best practices

2018-10-30 Thread Richard Hipp
On 10/30/18, Gerlando Falauto wrote: > > I understand SQLite is perfectly capable of handling huge database files > without any issues. > Yet I'm convinced there may be some corner cases where there might be > legitimate reasons for wanting partitioning (like this flight recorder mode > of mine).

Re: [sqlite] SQLite for datalogging - best practices

2018-10-30 Thread Gerlando Falauto
Please forgive my insistence -- are both those ideas really, really, stupid? I understand SQLite is perfectly capable of handling huge database files without any issues. Yet I'm convinced there may be some corner cases where there might be legitimate reasons for wanting partitioning (like this

Re: [sqlite] Database identified as zip

2018-10-30 Thread Stephen Chrzanowski
That said, I still didn't know the shell/CLI could do that. But 14.5 and 14.6 are pretty far down https://sqlite.org/cli.html so, I probably gave up after 6.1 or 6.2 {smirk} Good nugget to keep rattling in my head. On Tue, Oct 30, 2018 at 10:44 AM Richard Hipp wrote: > > The core SQLite

Re: [sqlite] Database identified as zip

2018-10-30 Thread Richard Hipp
On 10/30/18, Stephen Chrzanowski wrote: > > Second, shouldn't SQLite only consider reading a file if the file size is > zero or if the appropriate SQLite header is found, and completely ignore > the file extension? The core SQLite library understands SQLite database files only. Reading and

Re: [sqlite] Database identified as zip

2018-10-30 Thread Richard Hipp
On 10/30/18, Dingyuan Wang wrote: > > Is this considered a bug? Should be fixed on trunk, now. -- D. Richard Hipp d...@sqlite.org ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org

Re: [sqlite] Database identified as zip

2018-10-30 Thread Stephen Chrzanowski
First off, I didn't know that SQLite could read from zip files directly. I don't like it, but, I'm sure there's a use case somewhere. Second, shouldn't SQLite only consider reading a file if the file size is zero or if the appropriate SQLite header is found, and completely ignore the file

Re: [sqlite] Database identified as zip

2018-10-30 Thread Richard Hipp
On 10/30/18, Dingyuan Wang wrote: > I look at the database file, there is a half zip file in the end. So > maybe the PK header confused the SQLite command line. That is the likely explanation. The code that deduces the database type (whether it is an ordinary SQLite database file, or a ZIP

[sqlite] Database identified as zip

2018-10-30 Thread Dingyuan Wang
Dear list, When my database opened with sqlite3 command line program, it shows this: SQLite version 3.26.0 2018-10-29 21:01:28 Enter ".help" for usage hints. sqlite> .schema CREATE VIRTUAL TABLE zip USING zipfile('funddata.db') /* zip(name,mode,mtime,sz,rawdata,data,method) */; sqlite> select *

Re: [sqlite] race condition?

2018-10-30 Thread Lei Chen
Thanks Dan. I just found another report regarding the hot journal, "Hot-Journal with VFS", https://www.mail-archive.com/sqlite-users@mailinglists.sqlite.org/msg112377.html. It seems the same issue as I hit. Thanks, Lei Chen Lei Chen 于2018年10月29日周一 下午4:45写道: > Hi experts, > > I'm debugging a

Re: [sqlite] curious discovery about geopoly module

2018-10-30 Thread Keith Medcalf
select sqlite_source_id(); both where it works and where it doesn't. Are they the same or different? --- The fact that there's a Highway to Hell but only a Stairway to Heaven says a lot about anticipated traffic volume. >-Original Message- >From: sqlite-users [mailto:sqlite-users-

Re: [sqlite] SQLite for datalogging - best practices

2018-10-30 Thread Richard Hipp
On 10/30/18, Mark Wagner wrote: > Going back to the comments from Dr. Hipp regarding WAL vs DELETE mode on > F2FS devices, I just wanted to confirm my understanding. > > Given a device with F2FS and with sqlite compiled with > SQLITE_ENABLE_BATCH_ATOMIC_WRITE, writes with DELETE mode will be >

Re: [sqlite] How to use SQLite Encryption Extension in Oracle MAF app

2018-10-30 Thread Richard Hipp
On 10/29/18, smartsanja wrote: > My hybrid mobile app built using Oracle MAF framework. I have a requirement > to encrypt the sqlite db using SQLite Encryption Extension. I could not find > any documentation on how to integrate SEE in Oracle MAF apps. I want to know > whether is this can be done

Re: [sqlite] curious discovery about geopoly module

2018-10-30 Thread Vladimir Vissoultchev
You can try some other sqlite wrapper for VBA, for instance vbRichClient ships with 3.24 -- http://www.vbrichclient.com/#/en/Downloads.htm Unfortunately as it's primary target is VB6 the stdcall port of sqlite is compiled to x86 binary only. cheers, -Original Message- From:

Re: [sqlite] curious discovery about geopoly module

2018-10-30 Thread Richard Hipp
On 10/30/18, Graham Hardman wrote: > To clarify: I built my own versions of the library and shell using the > latest amalgamation (3.25.2) specifically to test the geopoly Are you certain that the third-party tool is picking up your custom DLL? Verify by looking at the results of "SELECT

Re: [sqlite] curious discovery about geopoly module

2018-10-30 Thread Graham Hardman
To clarify: I built my own versions of the library and shell using the latest amalgamation (3.25.2) specifically to test the geopoly capability. The build process completed successfully with no error code, and as I said allow me to create tables and use the geopoly functionality in the command

Re: [sqlite] curious discovery about geopoly module

2018-10-30 Thread Clemens Ladisch
Graham Hardman wrote: > SQLiteForExcel [1] https://github.com/govert/SQLiteForExcel "sqlite3.dll is a copy of SQLite version 3.11.1" > "no such module: geopoly" > > I guess that makes sense in one way, but it begs the question of why the > shell and my version of SQLiteExpert find a way to

[sqlite] curious discovery about geopoly module

2018-10-30 Thread Graham Hardman
Hi everybody, regarding the geopoly module in version 3.25.2 a couple of weeks ago I wrote about the fact that the 'pragma compile_options' command failed to display when I was trying to check that my special build of the sqlite dll library and the command line shell was working corrrectly.

Re: [sqlite] SQLite for datalogging - best practices

2018-10-30 Thread Gerlando Falauto
On Tue, Oct 30, 2018 at 4:58 AM Keith Medcalf wrote: > > If you don't mind me asking, what sort of data are you collecting? > Are you the master (ie, scanning) or a slave (getting async data pushed to > you). > Are you "compressing" the returned data (storing only changes exceeding > the

Re: [sqlite] Parallel reading can be slow on APFS

2018-10-30 Thread Darren Duncan
I find it strange that there's a big global lock problem with APFS considering one of the biggest design and selling points was that APFS did NOT use global locks like the old HFS+ did. -- Darren Duncan On 2018-10-29 7:13 PM, Simon Slavin wrote: This post is about a problem with Apple's new