Re: [sqlite] unreached code in sqlite3.c?

2015-02-12 Thread Dan Kennedy
On 02/12/2015 09:02 PM, Jens Miltner wrote: Hi, I'm getting the following two warnings when compiling sqlite3.c with the latest clang tools: sqlite3.c:116769:39: warning: code will never be executed [-Wunreachable-code] if( pTerm-wtFlags TERM_VNULL ) continue;

Re: [sqlite] Porting SQLite to another operating system (not supported out of the box)

2015-02-10 Thread Dan Kennedy
On 02/11/2015 12:31 AM, Simon Slavin wrote: On 10 Feb 2015, at 5:01pm, Clemens Ladisch clem...@ladisch.de wrote: Janke, Julian wrote: In my opinion, this means, we must only write a VFS implementation for our target platform. What file API is there? It looks like a standard POXIS

Re: [sqlite] Multi-thread mode question

2015-02-09 Thread Dan Kennedy
of the statement being used... it will lead to bizarre crashes in the database; similar to double-releasing memory or delayed reference of memory that has been released. On Sun, Feb 8, 2015 at 3:00 AM, Dan Kennedy danielk1...@gmail.com wrote: On 02/08/2015 04:30 PM, Neo Anderson wrote: The doc says

Re: [sqlite] Multi-thread mode question

2015-02-08 Thread Dan Kennedy
On 02/08/2015 04:30 PM, Neo Anderson wrote: The doc says: Multi-thread. In this mode, SQLite can be safely used by multiple threads provided that no single database connection is used simultaneously in two or more threads. I have a scenario that every sqlite3_calls around a single database

Re: [sqlite] ROWID-based queries slow in FTS db

2015-01-30 Thread Dan Kennedy
On 01/29/2015 02:29 AM, farkas andras wrote: Hi all, I#39;m using FTS through DBD::SQLite (perl) to query large text databases (~10GB, ~10 million records). The regular FTS MATCH searches work fine (they usually run under a second), but searches based on ROWID are atrociously slow and hog

Re: [sqlite] ROWID-based queries slow in FTS db

2015-01-30 Thread Dan Kennedy
On 01/30/2015 10:49 PM, Dominique Devienne wrote: On Fri, Jan 30, 2015 at 4:38 PM, Dan Kennedy danielk1...@gmail.com wrote: On 01/29/2015 02:29 AM, farkas andras wrote: [...] but searches based on ROWID are atrociously slow and hog massive amounts of memory [...] Looks like range

Re: [sqlite] small sqlite fts snippet function or Fts Bug!

2015-01-27 Thread Dan Kennedy
On 01/27/2015 06:48 PM, boscowitch wrote: and the in an sqlite shell (SQLite version 3.8.8.1 2015-01-20 16:51:25) I get following for a select with snippet: EXAMPLE OUTPUT: sqlite select docid,*,snippet(test) from test where german match a; 1|[1] a b c|1] ba/b b c 2|[{[_.,:;[1] a b c|1] ba/b

Re: [sqlite] database locked in PHP

2015-01-25 Thread Dan Kennedy
On 01/25/2015 07:35 AM, Lev wrote: On Sat, 24 Jan 2015 20:59:22 + Simon Slavin slavins-drl2ohjjk6tg9huczpv...@public.gmane.org wrote: and set it to 6 (60 seconds) or so. Okay, I try that, but I still don't understand how can a single threaded application get a locked error. Was the

Re: [sqlite] regarding sqlite3_prepare_v2() func

2015-01-21 Thread Dan Kennedy
On 01/22/2015 11:53 AM, Sairam Gaddam wrote: I have one doubt regarding sqlite code. I have 2 programs-one with sqlite3_exec() included in the code and in other it is not included.I included those files which are zmain.c and zmain1.c respectively. First i created a database and added a table em

Re: [sqlite] Huge WAL log

2015-01-16 Thread Dan Kennedy
On 01/17/2015 12:04 AM, Jan Slodicka wrote: Simon Slavin-3 wrote Thanks to your post I discovered multiple-row inserts so that I now understand what you asked. Just a note that multiple-row inserts were added to SQLite relatively recently (2012-03-20 (3.7.11)) and, because SQLite does only

Re: [sqlite] Huge WAL log

2015-01-15 Thread Dan Kennedy
On 01/15/2015 12:28 AM, Jan Slodicka wrote: Richard Hipp-3 wrote No other active readers or writers. Are you sure? Writers for sure. As far readers are concerned, the things are too complex to make an absolute statement. (I shall check once more.) Some APIs that might be helpful: *

Re: [sqlite] SQLite Android Bindings: how difficult to add LOCALIZED back?

2015-01-08 Thread Dan Kennedy
On 01/08/2015 07:48 AM, Philip Warner wrote: I just saw the SQLite Android Bindings page at http://www.sqlite.org/android/doc/trunk/www/index.wiki but was a little disappointed to read in the details that UNICODE and LOCALIZED are not supported. I'd really like the latest SQLite, and

Re: [sqlite] VACUUM requires 6.7 times space ?

2015-01-05 Thread Dan Kennedy
On 01/05/2015 06:22 PM, Simon Slavin wrote: I have a database file which is 120GB in size. It consists of two huge tables and an index. Its journal_mode is DELETE. It is on a partition with 803GB of free space. By my calculations I have 6.7 times the amount of free space as the database is

Re: [sqlite] How often is xDisconnect called? (Was: Suggestion for syntax enhancement for virtual tables)

2015-01-05 Thread Dan Kennedy
Table Module to note that it is being created in the temp database, and do any required cleanup in xDisconnect instead of xDestroy for that instance. But if xDisconnect can be called at other times, cleanup could be premature. Best, Peter On Friday, January 2, 2015 12:56 AM, Dan Kennedy

Re: [sqlite] New column in select will not mask column of the same name in having clause and sqlite won't warn

2015-01-04 Thread Dan Kennedy
On 01/05/2015 01:39 PM, Hick Gunter wrote: This is completely legal and well defined. HAVING is applied to the RESULT set of a SELECT. The select asks to count the distinct kontrola in each group of kvadrat and datum, the HAVING clause specifies returning only those records with pocet 1. If

Re: [sqlite] New column in select will not mask column of the same name in having clause and sqlite won't warn

2015-01-04 Thread Dan Kennedy
On 01/05/2015 02:52 PM, Dan Kennedy wrote: On 01/05/2015 01:39 PM, Hick Gunter wrote: This is completely legal and well defined. HAVING is applied to the RESULT set of a SELECT. The select asks to count the distinct kontrola in each group of kvadrat and datum, the HAVING clause specifies

Re: [sqlite] Getting SQLITE_IOERR_WRITE when running sqlite

2015-01-02 Thread Dan Kennedy
On 01/02/2015 04:44 PM, Waiba, Aswin wrote: Hi, I am currently using sqlite version 3.7.14 in our application. We are using it via a single thread, however we are getting SQLITE_IOERR (10) when running the application. After enabling the extended result code, we found out that we were

Re: [sqlite] Suggestion for syntax enhancement for virtual tables

2015-01-01 Thread Dan Kennedy
On 01/02/2015 01:58 PM, Hick Gunter wrote: Temporary virtual tables sounds like an interesting concept. Does the xDestroy() function get called on such a beast (as opposed to xDisconnect() when the connection is closed)? Just xDisconnect(). Dan. Should that function delete the backing

Re: [sqlite] journal file is not removed when ATOMIC WRITE is enabled

2014-12-29 Thread Dan Kennedy
On 12/29/2014 07:57 AM, Yongil Jang wrote: For more information, In pager_end_transaction() function, int bDelete = (!pPager-tempFile sqlite3JournalExists(pPager-jfd)); -- sqlite3JournalExists() returns 0 I think both of pager_end_transaction() and sqlite3JournalExists() functions work

Re: [sqlite] FTS4 Problem

2014-12-24 Thread Dan Kennedy
On 12/25/2014 08:04 AM, Peter Truskier wrote: As I mentioned, I seem to have solved the problem by doing a rebuild command on the FTS4 table. But, as I thought about it further, I'm still confused as to why dropping, and then re-creating the virtual table didn't solve the problem as well.

Re: [sqlite] Abnormal memory usage when removing rows within nested transaction from a table, referenced by another table via FK,

2014-12-18 Thread Dan Kennedy
On 12/18/2014 02:41 PM, Paul wrote: I want to confirm that issue is fixed for me. Thanks again, Dan! Please ignore this update, patch fixes this problem as well. I want to add even more input for this issue. I understand why there is implicit savepoint, when I remove row from 'parent'

Re: [sqlite] Abnormal memory usage when removing rows within nested transaction from a table, referenced by another table via FK,

2014-12-18 Thread Dan Kennedy
On 12/18/2014 04:16 PM, Paul wrote: Hi, Dan. On 12/18/2014 02:41 PM, Paul wrote: I want to confirm that issue is fixed for me. Thanks again, Dan! Please ignore this update, patch fixes this problem as well. I want to add even more input for this issue. I understand why there is implicit

Re: [sqlite] SQLITE wal file size keeps growing

2014-12-18 Thread Dan Kennedy
On 12/19/2014 11:22 AM, Kushagradhi Bhowmik wrote: I am writing continuously into a db file which has PRAGMA journal_mode=WAL, PRAGMA journal_size_limit=0. My C++ program has two threads, one reader(queries at 15 sec intervals) and one writer(inserts at 5 sec intervals). Every 3 min I am

Re: [sqlite] SQLITE_FTS3_MAX_EXPR_DEPTH and upgrading sqlite

2014-12-17 Thread Dan Kennedy
On 12/16/2014 10:57 PM, Ed Willis wrote: Hello all, Apologies in advance if this question has been asked and answered elsewhere – a (brief, admittedly) search did not turn up anything and so I’m posting this. We’re in the process of upgrading sqlite in our service. We were on a version

Re: [sqlite] Abnormal memory usage when removing rows within nested transaction from a table, referenced by another table via FK,

2014-12-17 Thread Dan Kennedy
On 12/16/2014 03:08 PM, Paul wrote: The memory is being used by the statement journal, which you have in memory. If the app did not set journal_mode=memory and temp_store=memory, SQLite would create a really large temp file instead of using memory. Which would still be sub-optimal, but might not

Re: [sqlite] Query Planner for Virtual Tables: link table evaluation transitive property of constraints not used

2014-12-15 Thread Dan Kennedy
On 12/12/2014 09:22 PM, Josef Kučera wrote: Hello, I am trying to use SQLite's marvellous Virtual Table mechanism as a SQL layer for querying an in memory storage. This works good, but I have a problem with more complex queries. When querying a real SQLite database it correctly moves the

Re: [sqlite] Abnormal memory usage when removing rows within nested transaction from a table, referenced by another table via FK,

2014-12-15 Thread Dan Kennedy
On 12/15/2014 11:11 PM, Paul wrote: Hello, dear developers Recently I've stumbled upon a very rare and strange bug. The result of this is abnormal memory usage, that does not allow us to remove fair number of rows from a table due to the limit of memory, available for 32bit process. This is

Re: [sqlite] Abnormal memory usage when removing rows within nested transaction from a table, referenced by another table via FK,

2014-12-15 Thread Dan Kennedy
On 12/15/2014 11:59 PM, Dan Kennedy wrote: On 12/15/2014 11:11 PM, Paul wrote: Hello, dear developers Recently I've stumbled upon a very rare and strange bug. The result of this is abnormal memory usage, that does not allow us to remove fair number of rows from a table due to the limit

Re: [sqlite] Online/Hot backup of WAL journalling mode database

2014-12-12 Thread Dan Kennedy
On 12/12/2014 03:31 AM, Nick wrote: On 11 Dec 2014, at 10:08, Dan Kennedy wrote: On 12/11/2014 05:49 AM, Nick wrote: On 10 Dec 2014, at 07:35, Dan Kennedy wrote: Strictly speaking the database file may not be well-formed even if there is no ongoing checkpoint. If: a) process A opens

Re: [sqlite] Online/Hot backup of WAL journalling mode database

2014-12-11 Thread Dan Kennedy
On 12/11/2014 05:49 AM, Nick wrote: On 10 Dec 2014, at 07:35, Dan Kennedy wrote: Strictly speaking the database file may not be well-formed even if there is no ongoing checkpoint. If: a) process A opens a read transaction, b) process B opens and commits a write transaction

Re: [sqlite] Online/Hot backup of WAL journalling mode database

2014-12-09 Thread Dan Kennedy
On 12/10/2014 05:06 AM, Simon Slavin wrote: On 9 Dec 2014, at 8:57pm, Nick maill...@css-uk.net wrote: Environment is Linux with multiple (c. 4-6) processes accessing a single sqlite database named test.db. Backup: - New process started using cronjob to initiate application checkpoint until

Re: [sqlite] sqlite bugreport : unique index causes valid updates to fail

2014-12-08 Thread Dan Kennedy
On 12/08/2014 09:55 PM, Nico Williams wrote: Ideally there would be something like DEFERRED foreign key checking for uniqueness constraints... You could hack SQLite to do enforce unique constraints the same way as FKs. When adding an entry to a UNIQUE index b-tree, you check for a duplicate.

Re: [sqlite] Corrupting pointers to the lookaside smallacator

2014-11-27 Thread Dan Kennedy
On 11/27/2014 03:20 PM, Paul wrote: Here is how it looks with debug symbols are on: #0 0x28c4113e in memcpy () from /lib/libc.so.7 #1 0x08854c20 in sqlite3StrAccumAppend (p=0xfffe8548, z=0x2c3fffda vtb_enyqkyxs USING vtable_module_343, N=41) at sqlite3.c:21563 #2 0x087edf30 in

Re: [sqlite] Read overflow in CREATE VIRTUAL TABLE query (formerly Corrupting pointers to the lookaside smallacator)

2014-11-27 Thread Dan Kennedy
On 11/27/2014 05:56 PM, Paul wrote: Currently we use various versions of SQLite: SQLite version 3.8.0.1 2013-08-29 17:35:01 SQLite version 3.8.2 2013-12-06 14:53:30 SQLite version 3.8.6 2014-08-15 11:46:33 SQLite version 3.8.7 2014-10-17 11:24:17 All of them are affected so I never considered

Re: [sqlite] Infinite loop in sqlite3VdbeSorterWrite when sorting big data

2014-11-25 Thread Dan Kennedy
On 11/25/2014 02:53 AM, Marcin Sobieszczanski wrote: Hi I work with sqlite files that have a few gigabytes of simple data. Almost all of the data sits in one table that has 9 non-null integer columns (including row_id, and one int64 column) plus 3 additional string or int columns (additional

Re: [sqlite] Infinite loop in sqlite3VdbeSorterWrite when sorting big data

2014-11-25 Thread Dan Kennedy
On 11/26/2014 12:41 AM, Marcin Sobieszczanski wrote: Do you have a large cache-size configured? Yes: PRAGMA cache_size = 10 PRAGMA page_size = 16384 Thanks for reporting this. I think it should be fixed here: http://www.sqlite.org/src/info/623827192532f08b Dan.

Re: [sqlite] Corrupting pointers to the lookaside smallacator

2014-11-25 Thread Dan Kennedy
On 11/26/2014 06:47 AM, Ward Willats wrote: We are compiling the 3.8.7.1 using clang arm64 for iOS. Following set: #define SQLITE_ENABLE_COLUMN_METADATA 1 #define HAVE_INTTYPES_H 1 #define HAVE_STDINT_H 1 #define HAVE_USLEEP 1 #define SQLITE_DEBUG 1 #define SQLITE_MEMDEBUG 1 WAL mode. In

Re: [sqlite] sliteonline or sqlite in js

2014-11-14 Thread Dan Kennedy
On 11/14/2014 03:37 PM, Noel Frankinet wrote: Impressive ! It is that. Perhaps not as functional as a native app (so far), but looking really good! And you can't beat the deployment. Dan. On 12 November 2014 12:08, Kirill kir...@aidagw.com wrote: Good day, Full line manager to work

Re: [sqlite] Null rowid when using CTEs

2014-11-14 Thread Dan Kennedy
On 11/14/2014 08:33 AM, RP McMurphy wrote: When using CTEs the rowid is null. The following returns --NULL-- .null --NULL-- with c(x) as (select 1) select rowid from c; I guess that's expected. The same behaviour as for reading the rowid of a view or sub-select. It

Re: [sqlite] Using sqlite3_backup* while the destination connection has busy read-only statements.

2014-11-13 Thread Dan Kennedy
On 11/13/2014 05:26 AM, Shaun Seckman (Firaxis) wrote: Greetings all, I'm running into a situation in where our application is crashing during a call to sqlite_backup_finish inside of btreeParseCellPtr because some of the structure is corrupted. Both the source and destination database are

Re: [sqlite] [RFE bug] Improve error reporting for foreign keys

2014-10-27 Thread Dan Kennedy
On 10/27/2014 01:49 PM, Tristan Van Berkom wrote: This is just a request-for-enhancement bug report, I've went to the trouble or reproducing this problem in a simple test case and while I probably wont be able to immediately benefit from an upstream fix for this, I hope that this bug report will

Re: [sqlite] Installing 3.8.7 gives 3.8.6

2014-10-25 Thread Dan Kennedy
On 10/25/2014 09:36 PM, Arnaud Meuret wrote: Hi everyone, On a fresh CentOS 5, compiling SQLite using the [current tarball][1] for 3.8.7, the version being installed ends up in `/usr/local/lib` as **3.8.6**: bash-3.2# make install make[1]: Entering directory

Re: [sqlite] Bug 993556 - SQLite crash in walIndexTryHdr due to Windows EXCEPTION_IN_PAGE_ERROR exception

2014-10-20 Thread Dan Kennedy
On 10/18/2014 05:45 AM, Deon Brewis wrote: I'm trying to follow Richard's advise to work around this issue, which is: Is that database ever used by more than a single process. (Use by multiple threads using separate connections does not count - I mean really used by multiple processes with

Re: [sqlite] INSERT OR REPLACE in a virtual table implementation....

2014-10-17 Thread Dan Kennedy
On 10/18/2014 01:07 AM, dave wrote: I have a virtual table implementation, and I would like to use the INSERT OR REPLACE syntax to simplify actions for the user. In my xUpdate method, for the case where insertion is occuring, else if ( argc 1 SQLITE_NULL == sqlite3_value_type ( argv[0] ) ) {

Re: [sqlite] Unable to prepare a statement

2014-10-15 Thread Dan Kennedy
On 10/15/2014 07:19 AM, Sam Carleton wrote: When I use the SQLite Manager, I am able to run this query just fine: UPDATE EventNode SET IsActive = 1 WHERE EventNodeId IN (SELECT w.EventNodeId FROM EventNode as w, EventNode as m on m.objectId =

Re: [sqlite] Lets try this again. Sqlite Python libraries throwing exception on unique constraint.

2014-10-13 Thread Dan Kennedy
On 10/13/2014 11:44 PM, Jeffrey Parker wrote: Hello, I am working with sqlite3 in python 2.7.8 and I am running into a strange error where I get the below exception when running an insert into statement on an empty table. I know this is probably more to do with the python libraries but I

Re: [sqlite] 50% faster than 3.7.17

2014-10-09 Thread Dan Kennedy
On 10/09/2014 04:38 PM, David Woodhouse wrote: On Thu, 2014-09-25 at 11:13 +0100, David Woodhouse wrote: I suggested a couple of specific optimisations which the query planner might be able to make, which should hopefully have benefits wider than just my own use case. Are those not viable? I'm

Re: [sqlite] Full text search: Regression on 3.8.7 (or using incorrectly?)

2014-10-09 Thread Dan Kennedy
On 10/09/2014 07:23 PM, Sohail Somani wrote: On 2014-10-09, 7:32 AM, Dan Kennedy wrote: Got it, thanks for the explanation. Just to make sure that I understand you correctly, is the clause MATCH '*l0l* *h4x*' getting translated to MATCH 'l0l* h4x*'? Yes, that's right. Dan. In that case

Re: [sqlite] Full text search: Regression on 3.8.7 (or using incorrectly?)

2014-10-07 Thread Dan Kennedy
On 10/08/2014 01:52 AM, Sohail Somani wrote: Figured it out: match terms should be l0l* h4x* NOT *l0l* *h4x*, though it did work as expected with the older version. I'd suggest keeping the old behaviour unless there is a performance-based reason not to. On 2014-10-07, 2:49 PM, Sohail Somani

Re: [sqlite] Inefficient query plan with ORDER BY and UNION ALL subquery

2014-09-20 Thread Dan Kennedy
On 09/20/2014 10:59 AM, Yuanzhong Xu wrote: I think this is related to a check for restriction (18) in subquery flattening. (18) If the sub-query is a compound select, then all terms of the ORDER by clause of the parent must be simple references to columns of the sub-query. Quite correct.

Re: [sqlite] Atomic database structure initialization

2014-09-19 Thread Dan Kennedy
On 09/19/2014 02:53 PM, Paul wrote: Paul wrote: My goal is to make structure initialization of an *abstract* database atomic. [...] if database file is missing it must be created and initialized. http://www.sqlite.org/transactional.html Just do the check for the database structure and the

Re: [sqlite] write internal blob vs external file

2014-09-15 Thread Dan Kennedy
On 09/15/2014 03:18 PM, Dominique Devienne wrote: On Fri, Sep 12, 2014 at 11:48 PM, Eric Rubin-Smith eas@gmail.com wrote: Looking at the sqlite web site and mailing lists shows that the SQLite team has taken a stab at answering the question, is it faster to read a blob out of sqlite or out

Re: [sqlite] write internal blob vs external file

2014-09-15 Thread Dan Kennedy
On 09/15/2014 06:19 PM, Dominique Devienne wrote: On Mon, Sep 15, 2014 at 12:29 PM, Dan Kennedy danielk1...@gmail.com wrote: On 09/15/2014 03:18 PM, Dominique Devienne wrote: On Fri, Sep 12, 2014 at 11:48 PM, Eric Rubin-Smith eas@gmail.com wrote: Looking at the sqlite web site

Re: [sqlite] fts5

2014-09-11 Thread Dan Kennedy
On 09/11/2014 02:51 AM, Kyle Shannon wrote: I was browsing the source on the fossil repository, and I noticed that there were files for fts5 in the trunk. I've been playing with fts3/4 and I'm curious about what new features/changes are incorporated into fts5. Can anyone clarify that for me?

Re: [sqlite] unixGetPageSize needed but undefined

2014-07-28 Thread Dan Kennedy
On 07/27/2014 09:30 PM, Alan Hourihane wrote: Hi all, I logged this bug via Gentoo, but it should be done here... https://bugs.gentoo.org/show_bug.cgi?id=517110 Is this still present on the trunk? It may have been fixed here: http://www.sqlite.org/src/info/612b6d1b1f Dan. This

Re: [sqlite] [bug] sqlite memory corruption (use by digikam)

2014-07-15 Thread Dan Kennedy
On 07/15/2014 09:06 PM, Mathieu Clabaut wrote: Hello, Digikam bug https://bugs.kde.org/show_bug.cgi?id=323888#c89 seems to be caused by a sqlite memory leak It looks very much like the program is not calling sqlite3_close(). If you have a small program that shows SQLite leaking memory

Re: [sqlite] [bug] sqlite memory corruption (use by digikam)

2014-07-15 Thread Dan Kennedy
On 07/16/2014 03:22 AM, Dan Kennedy wrote: On 07/15/2014 09:06 PM, Mathieu Clabaut wrote: Hello, Digikam bug https://bugs.kde.org/show_bug.cgi?id=323888#c89 seems to be caused by a sqlite memory leak It looks very much like the program is not calling sqlite3_close(). If you have a small

Re: [sqlite] WITH syntax error

2014-07-12 Thread Dan Kennedy
On 07/13/2014 12:29 AM, Staffan Tylen wrote: The following statement is flagged as invalid, so what's the correct way of coding it? WITH A AS (SELECT 'A'), B AS (SELECT 'B') SELECT * FROM A UNION SELECT * FROM B ; This statement should work in SQLite 3.8.3 or

Re: [sqlite] WITH syntax error

2014-07-12 Thread Dan Kennedy
/67bfd59d9087a987 http://www.sqlite.org/src/info/31a19d11b97088296a The fix appeared in 3.8.4. If you upgrade, the statement will work. You'll note that I said the statement should work in 3.8.3. Not that it does. :) Dan. On Sat, Jul 12, 2014 at 8:06 PM, Dan Kennedy danielk1...@gmail.com

Re: [sqlite] I want to use CREATE TABLE ... AS SELECT ... - but what if the SELECT returns no rows?

2014-07-10 Thread Dan Kennedy
On 07/10/2014 04:45 PM, Tim Streater wrote: I have just noticed this syntax which will simplify some table creation for me. However in some instances where I want to use it, I have a handy SELECT available, but I don't want to actually insert a row at that time. Testing with the shell, the

Re: [sqlite] pragma and prepare statement

2014-07-10 Thread Dan Kennedy
On 07/10/2014 08:44 PM, Baptiste Daroussin wrote: Hi, We are using sqlite intensively in out developement and we discovered that apparently we cannot create a statement with a pragma Is there a reason why it is not possible? is it a bug or a per design The docs feature the following two

Re: [sqlite] documentation bugs

2014-07-09 Thread Dan Kennedy
On 07/09/2014 01:45 PM, Laurent Dami wrote: * In http://www.sqlite.org/src/wiki?name=Bug+Reports , the href to the bug list is http://www.sqlite.org/src/report; should be http://www.sqlite.org/src/reportlist * In vtab.hml: the description of sqlite3_index_info is not up to date (missing

Re: [sqlite] Planner chooses incorrect index

2014-07-08 Thread Dan Kennedy
On 06/25/2014 04:44 PM, João Ramos wrote: The sample column has some sensitive data that I can't share, so I'll have to change it and then try to reproduce the problem (I removed it before because I assumed that it wouldn't be important). On Mon, Jun 23, 2014 at 3:26 PM, Dan Kennedy danielk1

Re: [sqlite] sqlite-3.8.5: is auto index created multiple times for a single statement?

2014-07-07 Thread Dan Kennedy
On 07/07/2014 03:12 AM, Nissl Reinhard wrote: Hi, while preparing this statement create table gpBestellvorschlagInfo as select GanttPlanID , BestellterminRaw , case when not ( select max(HinweisCodiert) from Bestellvorschläge where ArtikelOID = o.ArtikelOID and

Re: [sqlite] Multiple reads and writes to a single DB connection from multiple threads

2014-07-06 Thread Dan Kennedy
On 06/02/2014 08:36 PM, Hick Gunter wrote: If you compile with SQLITE_THREADSAFE=1 then multiple calls from different threads will be serialized by SQLite. Serialized means that only one thread at a time will be allowed to run within SQLite; API calls from other threads will block until the

Re: [sqlite] Fwd: signal 6 during sqlite_step in WAL mode

2014-07-01 Thread Dan Kennedy
On 07/01/2014 12:07 PM, Mattan Shalev wrote: Hey guys, I'm getting signal 6 during sqlite_step in WAL mode. Working on Ubuntu 12.04, sqlite3 3.7.9. One process is the writing continuously, while other process reads from the DB in a multi threaded access. I made sure that sqlite is configured to

Re: [sqlite] hoe to create index to a big table?

2014-06-30 Thread Dan Kennedy
On 06/30/2014 03:30 PM, Hadashi, Rinat wrote: I work with a very big table, on Linux. I fail to create index getting the following error: SQL error near line 1: database or disk is full A CREATE INDEX on a large table uses temporary files to sort the data before creating the actual index

Re: [sqlite] Planner chooses incorrect index

2014-06-23 Thread Dan Kennedy
On 06/23/2014 05:48 AM, João Ramos wrote: Here you go: sqlite_stat1 (before - good planning) HistoryEntry idx_HistoryEntry_uri_historyOrder 14992 44 5 HistoryEntry idx_HistoryEntry_historyOrder_historyTimestamp 14992 6 2 HistoryEntry idx_HistoryEntry_sourceType_sourceId 14992 2999 2

Re: [sqlite] R-Tree Storage Optimization for Points

2014-06-19 Thread Dan Kennedy
On 06/19/2014 11:57 PM, Mohit Sindhwani wrote: Hi Wolfgang, On 19/6/2014 11:54 PM, Wolfgang Enzinger wrote: Not sure why you think you have to store those point coordinates twice. This works: sqlite CREATE VIRTUAL TABLE abc USING rtree(id,x,y); sqlite INSERT INTO abc VALUES(1,20,30); sqlite

Re: [sqlite] R-Tree Storage Optimization for Points

2014-06-19 Thread Dan Kennedy
The other columns are pairs, one pair per dimension, containing the minimum and maximum values for that dimension, respectively. Alysson Gonçalves de Azevedo Anarcho-syndicalism is a way of preserving freedom. - Monty Python 2014-06-19 14:06 GMT-03:00 Dan Kennedy danielk1...@gmail.com

Re: [sqlite] Proximity ranking with FTS

2014-06-17 Thread Dan Kennedy
On 06/17/2014 10:48 AM, Josh Wilson wrote: Yeah I had thought about using the byte distance between words but you get these instances: [Example A] |word1|10charword|word2| [Example B] |word1|3charword|4charword|3charword|word2| By using byte distances, both of these score the same, where

Re: [sqlite] shell core dumps on incomplete init file

2014-06-04 Thread Dan Kennedy
On 06/04/2014 05:06 PM, Rob Golsteijn wrote: Hi List, I noticed that the sqlite shell core dumps when it is started with an init file that ends with an incomplete statement. Example: Init file called my_init.sql with the following contents: -- note that the line below is NOT a

Re: [sqlite] Comments loss in sqlite_master table

2014-05-29 Thread Dan Kennedy
On 05/29/2014 03:42 PM, big stone wrote: Hello, I miss the functionnality of some other sql motors that keep the comments inside an object definition, like a table. Example : (with sqlite.exe 3.8.3) create table /* This table has an educative purpose */ toto(x); create table /* This table has

Re: [sqlite] vtable vs. OR condition

2014-05-26 Thread Dan Kennedy
On 05/26/2014 01:45 AM, András Kardos wrote: Hello, As an expoeriment I'd like to create various virtual tables (vtable) for SQLite. Like filysystem, process list, mailbox - all local or remote. The idea is to use SQLite as an unified API and query processor to access or join data from various

Re: [sqlite] Pre-preparing querys

2014-05-20 Thread Dan Kennedy
On 05/20/2014 07:30 AM, James K. Lowden wrote: On Mon, 19 May 2014 22:26:29 +0100 Simon Slavin slav...@bigfraud.org wrote: On 19 May 2014, at 10:21pm, Roger Binns rog...@rogerbinns.com wrote: It seems like most language wrappers for SQLite include some sort of statement cache because it is

Re: [sqlite] More LSM leak

2014-05-08 Thread Dan Kennedy
On 05/08/2014 06:59 AM, Charles Samuels wrote: This leak cursor leak can be consistently reproduced by my test program, but it doesn't occur every time you create and delete the cursor. The files you'll need are: http://www.derkarl.org/~charles/lsm/smaller.trace.bz2

Re: [sqlite] LSM Leaks memory

2014-05-07 Thread Dan Kennedy
On 05/07/2014 04:51 AM, sql...@charles.derkarl.org wrote: I In a more complex program, lsm seems to leak memory to no bounds, causing my application. Are bug reports against LSM even helpful? I think they are. Thanks for the report. Now fixed here:

Re: [sqlite] FTS3/4 merge function behaviour when deleting rows

2014-05-02 Thread Dan Kennedy
On 05/01/2014 03:30 PM, andrewmo wrote: We are using the FTS3 extension to sqlite to store large numbers of short (~300 byte) documents. This is working very well and providing us with very fast text search, but the behaviour around deletion of documents has me confused. Our system must control

Re: [sqlite] FTS3/4 merge function behaviour when deleting rows

2014-05-02 Thread Dan Kennedy
On 05/02/2014 04:13 PM, Andrew Moss wrote: On 2 May 2014 07:57, Dan Kennedy danielk1...@gmail.com wrote: On 05/01/2014 03:30 PM, andrewmo wrote: We are using the FTS3 extension to sqlite to store large numbers of short (~300 byte) documents. This is working very well and providing us

Re: [sqlite] FTS3/4 merge function behaviour when deleting rows

2014-05-02 Thread Dan Kennedy
for the same reasons. Ben Am 02.05.14 11:22 schrieb Dan Kennedy: So I'm thinking a solution might be: * Fix FTS so that it picks this case - when a merge includes so many delete markers that the output is small enough to be deemed a level-N b-tree, not a level-N+1 b-tree

Re: [sqlite] LSM bug

2014-04-29 Thread Dan Kennedy
On 04/29/2014 03:53 AM, sql...@charles.derkarl.org wrote: I didn't know this list strips attachments, so the source file is here: http://derkarl.org/~charles/runlsm.cpp Thanks for this. It is a problem. LSM accumulates data in a tree structure in shared-memory until there is enough (~1-2

Re: [sqlite] problem with INSERT after ALTER TABLE ... ADD COLUMN ... DEFAULT ... performed on source table

2014-04-26 Thread Dan Kennedy
On 04/26/2014 05:23 AM, Hinrichsen, John wrote: Default non-NULL values copied from a column that was added using ALTER TABLE ... ADD COLUMN ... DEFAULT ... are inserted into another table as NULLs when copied using INSERT INTO ... SELECT * FROM ... However, the same values are propagated

Re: [sqlite] Trigger cascade/nesting

2014-04-23 Thread Dan Kennedy
On 04/23/2014 05:05 PM, Peter Hardman wrote: Hi, Is there a way of preventing triggers cascading? I have a table where I need to set a timestamp field when a new record is INSERTED. The table uses an auto-increment key field so a BEFORE INSERT trigger is ruled out. An AFTER INSERT trigger

Re: [sqlite] Sqlite Instead of Trigger on Views does not always fire..

2014-04-02 Thread Dan Kennedy
On 04/02/2014 06:08 PM, Engin Guelen wrote: Hello, i noticed that Instead of Update Triggers on Views do not fire as soon as the Views get a bit more involved. The Following View and Trigger Code compiles w/o Errors. But when changing the SYNC column nothing happens to REF_TAB, that

Re: [sqlite] Using a customized collate function to mimic integer array type.

2014-03-21 Thread Dan Kennedy
On 03/21/2014 10:33 PM, Ben Peng wrote: Hi, Tristan, Your solution definitely works (we have defined a few custom functions) but our application hides databases from users but allows users to use simple conditions to retrieve results. To use this function, we would have to 1. teach users use

Re: [sqlite] Opening and closing an SQLITE3 db in PHP

2014-03-19 Thread Dan Kennedy
On 03/19/2014 06:49 AM, Tim Streater wrote: Part of my app will, at user request, read some data from an SQLite db and also some files from disk, and send it all out on the network. This may in some cases take several minutes, at the end of which the db gets updated here and there. While this

Re: [sqlite] Using ICU case folding support

2014-03-19 Thread Dan Kennedy
On 03/19/2014 07:55 PM, Aleksey Tulinov wrote: On 03/18/2014 10:02 PM, Alex Loukissas wrote: Alex, I suppose I can declare the column as BINARY and use LOWER( ) in my select statements. Browsing through the code though, I do see uses of u_foldCase in certain places, which leads me to

Re: [sqlite] Using ICU case folding support

2014-03-19 Thread Dan Kennedy
On 03/19/2014 09:44 PM, Aleksey Tulinov wrote: I've created test database: sqlite CREATE TABLE test (x COLLATE NOCASE); sqlite INSERT INTO test VALUES ('s'); sqlite INSERT INTO test VALUES ('S'); sqlite INSERT INTO test VALUES ('ё'); -- Russian e with diacritic sqlite INSERT INTO test VALUES

Re: [sqlite] Using ICU case folding support

2014-03-18 Thread Dan Kennedy
On 03/19/2014 01:22 AM, Alex Loukissas wrote: Hello, I'm trying to use the ICU extension and it looks like what I want to do is not very clear from the documentation. I would like to switch from my current usage, where my column declaration is as follows: CREATE TABLE demo(name text not null

Re: [sqlite] Error Database or disk if full shown when indexing for 2 billion records.

2014-03-17 Thread Dan Kennedy
On 03/17/2014 08:32 PM, Yi Wang wrote: I inserted 2 billion records with only 1 column with name of str_md5, the value is the MD5 encrypted value of mm+rowid(such like MD5(mm121212...). I didn't not create primary key for the only column b/c i am not sure it would slow the speed of insert

Re: [sqlite] Fwd: Exception when querying a range index

2014-03-11 Thread Dan Kennedy
On 03/11/2014 04:17 AM, St. B. wrote: Hi, On Mon, Mar 10, 2014 at 6:37 PM, Dan Kennedy danielk1...@gmail.com wrote: On 03/10/2014 06:49 PM, St. B. wrote: Hi, I posted this question last year, but did not get any feed back. Is this something that can be handled on the ML, or should I ask

Re: [sqlite] very slow fdsync() calls

2014-03-11 Thread Dan Kennedy
On 03/11/2014 07:01 AM, Jono Poff wrote: Hi, I have an application that uses sqlite3. Investigating a problem with the app stalling occasionally I found that (every hour or two) an fdsync() system call from sqlite3_step() was taking over 3 seconds to return. On closer investigation, the

Re: [sqlite] Fwd: Exception when querying a range index

2014-03-10 Thread Dan Kennedy
On 03/10/2014 06:49 PM, St. B. wrote: Hi, I posted this question last year, but did not get any feed back. Is this something that can be handled on the ML, or should I ask in another place? Regards, -- Forwarded message -- From: St. B. sbart...@gmail.com Date: Sun, Jan 6, 2013

Re: [sqlite] SQL quine using with

2014-03-08 Thread Dan Kennedy
On 03/08/2014 08:53 PM, Kees Nuyt wrote: Someone called zzo38 posted a quine (self-replicating program) on Internet Relay Chat in network: Freenode, channel: #sqlite [2014-03-08 11:01:59] zzo38 I made a quine program in SQL. [2014-03-08 11:02:10] zzo38 with q(q) as (select 'with q(q) as

Re: [sqlite] Out of memory error for SELECT char();

2014-03-08 Thread Dan Kennedy
On 03/09/2014 01:25 AM, Zsbán Ambrus wrote: In the sqlite3 console, the following very simple statement gives Error: out of memory: SELECT char(); I think this is a bug. It is. Thanks for the report. Now fixed here: http://www.sqlite.org/src/info/ba39df9d4f Dan. This query should

Re: [sqlite] Weird out of memory problem a prepare

2014-03-05 Thread Dan Kennedy
On 03/05/2014 03:05 AM, Eduardo Morras wrote: On Tue, 4 Mar 2014 15:19:24 + Simon Slavin slav...@bigfraud.org wrote: On 4 Mar 2014, at 3:15pm, Simon Slavin slav...@bigfraud.org wrote: On 4 Mar 2014, at 3:09pm, Eduardo Morras emorr...@yahoo.es wrote: zSql= SELECT r.name, s.content FROM

Re: [sqlite] Unnecessary implicit conversion (may lead to a bug)

2014-02-24 Thread Dan Kennedy
On 02/24/2014 05:54 AM, skywind mailing lists wrote: In afpUnlock(sqlite3_file *, int) the sharedLockByte is defined as an int (int sharedLockByte = SHARED_FIRST+pInode-sharedByte;) although all other related variables and the following function parameters are defined as unsigned long longs.

Re: [sqlite] How to Troubleshoot Disk I/O Error

2014-02-20 Thread Dan Kennedy
On 02/20/2014 09:29 PM, Akintoye Olorode (BLOOMBERG/ 731 LEXIN) wrote: Our client got the following print-out. First hint of failure is the line TRUNCATE 48 32768 failed. Any insights into what the root cause might be ? The operation that is failing is (probaby) an attempt to use

Re: [sqlite] help needed for major SQLite problem

2014-02-07 Thread Dan Kennedy
On 02/08/2014 03:00 AM, C M wrote: This is a follow-up to a question I asked on this list on Sep 1st, 2013, about an error that I was randomly getting with disk-based SQLite database in a Python desktop application. I now have more info to provide about the error...such as what was asked for at

Re: [sqlite] Understanding transactions

2014-02-05 Thread Dan Kennedy
On 02/04/2014 10:12 PM, Igor Tandetnik wrote: On 2/4/2014 5:23 AM, Yuriy Kaminskiy wrote: How sqlite is supposed to behave when *) there are read-only transaction; *) there are update transaction on other connection; *) cache space is exhausted by update transaction; *) sqlite was not able to

  1   2   3   4   5   6   7   8   9   10   >