Re: [sqlite] Consistent reads

2013-10-11 Thread Dan Kennedy
On 10/11/2013 02:29 PM, Paul Harris wrote: Hi again, I am wondering if there is any performance benefit in *not* wrapping multiple SELECT calls in a BEGIN/END transaction? As I understand it, with wrapping: BEGIN -- does nothing (yet) SELECT1 -- creates a SHARE-ONLY lock on the DB SELECT2 --

Re: [sqlite] COMMIT in SQLite

2013-10-08 Thread Dan Kennedy
On 10/08/2013 07:39 PM, Clemens Ladisch wrote: Paul Harris wrote: Many years ago, Igor mentioned that you should always reset/finalize any prepared statements before calling COMMIT. I am wondering, is this still true? Yes. Do I have to reset before I commit? And where is the requirement

Re: [sqlite] Write-ahead logging issue on Android

2013-10-04 Thread Dan Kennedy
On 10/05/2013 01:55 AM, Sascha Sertel wrote: Hello everybody, I'm hoping someone might have some insights on a particular issue I've been running into. Here some details: I'm working on a multi-platform app that uses a cross-platform library with SQLite 3.7.16.1 built into it (i.e. not using

Re: [sqlite] Using an sqlite db as a mutex?

2013-09-26 Thread Dan Kennedy
On 09/26/2013 10:00 PM, Simon Slavin wrote: On 26 Sep 2013, at 3:45pm, Dan Kennedy <danielk1...@gmail.com> wrote: Sounds right. BEGIN EXCLUSIVE obtains an exclusive lock on the db. If this succeeds, no other connection to the same database will be able to successfully execute BEGIN EXC

Re: [sqlite] Using an sqlite db as a mutex?

2013-09-26 Thread Dan Kennedy
On 09/26/2013 06:35 PM, Stephan Beal wrote: Hi, all, some months ago i was tasked with writing a WWW/PHP/MySQL-based application which takes a group of meeting tables and randomly assigns them to participants (yes, this was/is a real application). One of the problems i faced is an inherent race

Re: [sqlite] SQLite3 3.7.17 => using column names with character '@'.

2013-09-24 Thread Dan Kennedy
On 09/24/2013 04:52 PM, Alexander Syvak wrote: Hello, using input select all "project@na" from project where 1 yields 4 lines of "project@na". In fact the column named project@na does not exist, but the project@name does in the tested data base. What is the gist of such a result? A double

Re: [sqlite] Bug in sqlite3.exe?

2013-09-24 Thread Dan Kennedy
On 09/24/2013 11:53 PM, Staffan Tylen wrote: Well, it's not my database I'm looking at. What puzzles me is that Country Languages works but Country Official Languages doesn't, so could there be a parsing problem? It's because the AS keyword is optional. These two are equivalent: SELECT

Re: [sqlite] question on WAL files

2013-09-23 Thread Dan Kennedy
On 09/20/2013 11:30 PM, Carey, John wrote: Hello, I am trying to write a simple perl program (perl version 5.16.3). I am accessing a SQLite db which is using WAL(write ahead logging). It took me a while but I learned that my connection is only looking at the DB file and not the WAL file. As

Re: [sqlite] UPDATE question

2013-09-06 Thread Dan Kennedy
On 09/06/2013 10:19 PM, Marc L. Allen wrote: MySQL also uses this implementation. They acknowledge that it is not SQL compliant and that (I never thought of this), you cannot delete a record that has a foreign key link to itself. Postgres apparently has the ability to have deferred checking

Re: [sqlite] VACUUM silently fails, database size not changed

2013-08-31 Thread Dan Kennedy
On 08/31/2013 08:29 PM, Mario M. Westphal wrote: I run the VACUUM command at the end of a diagnosis and cleanup operation on my database. I use the SQLite 3 API on Windows 7. Latest version of SQLite. My database uses the WAL mode. The database size is 120 MB when I run the

Re: [sqlite] segmentation fault with 3.8.0

2013-08-29 Thread Dan Kennedy
On 08/29/2013 10:47 PM, Marc L. Allen wrote: Silly question.. I looked at the fix. Why ignore indexes with greater than 4 fields? Isn't that a bit risky? Wouldn't it be better to ignore the fields after the 4th one for planning? SQLite 3.8.0 really contains two query planners. The first

Re: [sqlite] 3.8.0 breaks pkgconfig file

2013-08-27 Thread Dan Kennedy
On 08/27/2013 09:30 PM, Andreas Radke wrote: A common build in Arch Linux doesn't properly replace Version: @RELEASE@ in file sqlite3.pc. Thanks for reporting this. A new package that should fix this problem is up now. Dan. ___ sqlite-users

Re: [sqlite] 3.8.0 Update

2013-08-27 Thread Dan Kennedy
On 08/27/2013 09:33 PM, James Pearson wrote: On 27 Aug 2013, at 8:19, Richard Hipp wrote: On Tue, Aug 27, 2013 at 10:15 AM, James Pearson wrote: I've just updated to SQLite 3.8.0 and seem to have lost the ability to use the up arrow key to cycle through my command line

Re: [sqlite] Collation advice

2013-08-26 Thread Dan Kennedy
On 08/26/2013 11:10 PM, Jan Slodicka wrote: Thanks, Simon. As a risk, I see overriding an existing collation name as risky. If any application makes changes to the database without the extension loaded, you're going to get corrupt indexes. Can you instead make up a new collation name ? I

Re: [sqlite] Database locking Error

2013-08-26 Thread Dan Kennedy
On 08/26/2013 01:37 PM, techi eth wrote: Hi, I come across database file locking error while trying below case with Update. Case: One process is updating a Colum periodically & other process is selecting same Colum or other colum in table periodically for read. What is the best way to handle

Re: [sqlite] BETWEEN and explicit collation assignment

2013-08-21 Thread Dan Kennedy
On 08/21/2013 11:02 PM, Igor Tandetnik wrote: On 8/21/2013 11:17 AM, Simon Slavin wrote: Given that this level of implementation is correct I feel that any error in SQLite's handling of COLLATE is closer to the expression parsing level than the low level implementation. The low level

Re: [sqlite] sqlite3DbMallocRaw is crashing

2013-08-20 Thread Dan Kennedy
On 08/20/2013 09:08 PM, Ashok Pitambar wrote: Hi Richard, If list of available buffers (*db->lookaside.pFree*) is NULL and it is assigned to pBuf and if you access pBuf->pNext it will crash. read my comments in below code snippet. There is good chance that sqlite may

Re: [sqlite] SQLite4 question

2013-08-19 Thread Dan Kennedy
On 08/19/2013 03:44 PM, Saito, Takuya wrote: Hi, I have a problem with sqlite4. When I tried to create a table, the locking protocol error occurred. $sqlite4 ex1 SQLite version 4.0.0 2013-07-31 17:43:18 Enter ".help" for instructions Enter SQL statements terminated with a ";"

Re: [sqlite] Sqlite support for UCLINUX

2013-08-15 Thread Dan Kennedy
On 08/15/2013 11:42 AM, Ajazur Rahaman wrote: Dear sir, Do we have sqlite support for UCLINUX Kernel Version 2.6.38 ? If it is ,from which version it is supported. We are trying to compile " sqlite-3.6.12 autoconf " code to get executables so as to run it on our Board which has no

Re: [sqlite] How to detect full table scan?

2013-08-13 Thread Dan Kennedy
On 08/13/2013 02:28 PM, Sqlite Dog wrote: We are using SQLite 3.7.17 Maybe you can use this stuff: http://www.sqlite.org/c3ref/stmt_status.html http://www.sqlite.org/c3ref/c_stmtstatus_counter.html In particular SQLITE_STMTSTATUS_FULLSCAN_STEP. Dan. 2013/8/13 Sqlite Dog

Re: [sqlite] Can a foreign key reference a named rowid?

2013-08-12 Thread Dan Kennedy
On 08/12/2013 01:20 PM, Baruch Burstein wrote: From the documentation for CREATE TABLE: The parent key of a foreign key constraint is not allowed to use the rowid. The parent key must used named columns only. Does this mean it can or can't use a named column that is an alias for the

Re: [sqlite] Default Constraint Behaviour!!!

2013-08-09 Thread Dan Kennedy
On 08/09/2013 04:39 PM, techi eth wrote: Is it possible to read default value of any Colum? Ex : Create table by adding default constraint to Colum & then read back the default constraint value before doing INSERT,UPDATE. "PRAGMA table_info" provides access to this information:

Re: [sqlite] Query on database back-up:

2013-07-31 Thread Dan Kennedy
On 07/31/2013 07:33 PM, Simon Slavin wrote: On 31 Jul 2013, at 12:56pm, techi eth wrote: I have followed below link for details. It say “If another thread or process writes to the source database while this function is sleeping, then SQLite detects this and usually

Re: [sqlite] New bug: PRAGMA cache_size requires write lock on DB

2013-07-23 Thread Dan Kennedy
On 07/23/2013 01:38 AM, Philip Goetz wrote: I have a Perl program that we have run successfully every day for almost the past 2 years, but which crashes today with the error message: FATAL ERR: Can't do PRAGMA cache_size = 100: attempt to write a readonly database The SQLite database in

Re: [sqlite] Is REAL the best universal data type?

2013-07-23 Thread Dan Kennedy
On 07/23/2013 04:53 PM, Max Vlasov wrote: On Tue, Jul 23, 2013 at 1:38 PM, Dan Kennedy <danielk1...@gmail.com> wrote: On 07/23/2013 02:52 PM, Max Vlasov wrote: So par adoxically probably the best type for universal field container is REAL (or NUMERIC) since it will accept data

Re: [sqlite] Is REAL the best universal data type?

2013-07-23 Thread Dan Kennedy
On 07/23/2013 02:52 PM, Max Vlasov wrote: I've created a kind of triple storage base with Sqlite db as the container. Basically it's several tables implementing Object-Propery-Value metaphor. There's only one field for data so thinking about generality I assumed that the type for the data field

Re: [sqlite] Passing collation to xBestIndex

2013-07-17 Thread Dan Kennedy
On 07/17/2013 03:46 PM, Dušan Paulovič wrote: Hello, in virtual table mechanism is missing a way to correctly handle following queries: SELECT * FROM vtab WHERE field = 'abc' COLLATE NOCASE; SELECT * FROM vtab WHERE field = 'abc' COLLATE USER_COLLATE; To xBestIndex function is passed only

Re: [sqlite] Memory usage of sqlite3

2013-07-16 Thread Dan Kennedy
On 07/16/2013 01:49 AM, Paolo Bolzoni wrote: From 35-40MB to 940MB; I would put massif result but I think the list deletes attachments. A very large blob or string result? Code allocates (or leaks) tremendous numbers of sqlite3_stmt* handles? SQLite has various APIs for querying memory

Re: [sqlite] Unexpected result from SQLite; WebSQL(SQLite) gets it right in sqlfiddle

2013-07-11 Thread Dan Kennedy
On 07/11/2013 08:21 PM, Igor Tandetnik wrote: On 7/11/2013 9:19 AM, Igor Tandetnik wrote: On 7/10/2013 1:30 PM, compscilaw . wrote: The correct result is one row; SQLite returns all rows. I'm getting three rows (with program_id of 4, 5 and 6), which looks correct to me. Why do you expect

Re: [sqlite] Unlock Notify problems

2013-07-09 Thread Dan Kennedy
ither in the sqlite3_reset() or sqlite3_finalize() call, or sometimes from within sqlite3_step() if it returns SQLITE_DONE or an error). Is B calling sqlite3_reset() or sqlite3_finalize() on its statement handles when it is finished with them? Dan. Owen On 9 July 2013 12:51, Dan Kennedy <danielk1

Re: [sqlite] Unlock Notify problems

2013-07-09 Thread Dan Kennedy
lockConnection = A; B->pBlockingConnection = A; C->pUnlockConnection = B; C->pBlockingConnection = B; Are both B and C in the linked list that starts at global variable sqlite3BlockedList (and connected by pNextBlocked)? Dan. Owen On 9 July 2013 11:20, Dan Kennedy <danielk1...@gmail.c

Re: [sqlite] Unlock Notify problems

2013-07-09 Thread Dan Kennedy
On 07/09/2013 04:08 PM, Dan Kennedy wrote: On 06/20/2013 03:20 PM, Owen Haynes wrote: Hello, I am currently having some problems with the unlock notify and getting in a state of deadlock. I am using code based on http://www.sqlite.org/unlock_notify.html, with the latest sqlite. The setup

Re: [sqlite] Unlock Notify problems

2013-07-09 Thread Dan Kennedy
On 06/20/2013 03:20 PM, Owen Haynes wrote: Hello, I am currently having some problems with the unlock notify and getting in a state of deadlock. I am using code based on http://www.sqlite.org/unlock_notify.html, with the latest sqlite. The setup is as follows: - WAL is on - Multi Threaded

Re: [sqlite] DLL Size differences and other info requested

2013-07-04 Thread Dan Kennedy
On 07/04/2013 05:49 AM, Philip Bennefall wrote: Hi Stephen, I don't know what compiler is used to build the official SqLite dll, but provided it is some version of Vc++ my experience is that MinGw often produces larger and sometimes significantly slower binaries on Windows than VC++ does. In

Re: [sqlite] R*Tree constraint error when inserting valid data

2013-06-27 Thread Dan Kennedy
On 06/27/2013 09:19 PM, Tobias Kolb wrote: Hi, I'm currently experimenting with the R*Tree support in SQLite. I have to collect some log data over a timespan and save it linked to the area (not the exact path, just a minimum bounding rect around) it was collected (min/max latitude and min/max

Re: [sqlite] Questions about exclusive transation

2013-06-26 Thread Dan Kennedy
On 06/26/2013 02:08 PM, Woody Wu wrote: On Tue, Jun 25, 2013 at 10:21:51PM -0400, Igor Tandetnik wrote: On 6/25/2013 10:13 PM, Woody Wu wrote: 1. When a exclusive transation started and not yet commit, I found if I open another connection to the same database and try to access it (using

Re: [sqlite] How to get the longest common sequence using C

2013-06-18 Thread Dan Kennedy
On 06/19/2013 02:17 AM, Stadin, Benjamin wrote: Hi, From the documentation on fts3 it is not clear to me how to access the longest common distance structure. Could you please provide an example how to calculate the offset to the stuct inside the match info? According to the docs I thought it

Re: [sqlite] Pager bugs(?)

2013-06-14 Thread Dan Kennedy
On 06/14/2013 10:55 PM, Jan Slodicka wrote: (Applies to SQLITE 3.7.15.2 (but v3.7.17.0 uses the same code)) Pager bug(?): Following code excerpt from sqlite3.c should crash if pPage==NULL && createFlag==0: static sqlite3_pcache_page *pcache1Fetch( sqlite3_pcache *p, unsigned int iKey,

Re: [sqlite] FTS4 + unicode61 tokenizer performance issue

2013-06-11 Thread Dan Kennedy
On 06/11/2013 08:20 PM, Valentine Silvansky wrote: Hi all! I have a custom-built sqlite with FTS4 and unicode61 tokenizer for it. I've got the only one table "messages": CREATE VIRTUAL TABLE messages USING FTS4(body TEXT, tokenize=unicode61); So, I populate this table with ~100k entries,

Re: [sqlite] Android large file support patch

2013-06-01 Thread Dan Kennedy
On 05/31/2013 09:28 PM, Pepijn Van Eeckhoudt wrote: Sorry for the non-threaded reply. My subscription was set to digest mode... Patch is available at https://dl.dropboxusercontent.com/u/105584447/android_largefile.patch Thanks for the patch. When I compile on Android with it, I get linker

Re: [sqlite] Android large file support patch

2013-05-31 Thread Dan Kennedy
On 05/31/2013 03:01 PM, Pepijn Van Eeckhoudt wrote: Hi all, I've ran into some issues running sqlite on Android when handling files larger than 4Gb. Support for this counts on glibc style large file support where off_t and off64_t are identical. In bionic (Android C runtime) this is not the

Re: [sqlite] Matchinfo FTS4 token position

2013-05-14 Thread Dan Kennedy
On 05/13/2013 11:25 PM, Stadin, Benjamin wrote: Hi all, I need to implement a ranking that considers the search result's token distance (so either the actual character offset, or token offset from the beginning of the text). Is it possible to get/query this distance from the FTS4 index

Re: [sqlite] Slowness with FTS Queries and non-FTS tables

2013-05-07 Thread Dan Kennedy
On 05/08/2013 01:54 AM, Scott Robison wrote: On Tue, 30 Apr 2013 23:56:35 -0700 (PDT) Paul Vercellotti wrote: We've got some trouble with FTS4 queries taking too long in which we're looking for a subset of matching records in the FTS table, as narrowed by a non-FTS table.

Re: [sqlite] Security concern with new fts3tokenize virtual table

2013-05-07 Thread Dan Kennedy
On 05/07/2013 05:17 PM, Ralf Junker wrote: The new fts3tokenize virtual table calls the fts3_tokenizer() ... However, this call is rejected if, for security reasons, So the problem is that with the authorizer block in place, the fts3tokneize virtual table does not work. One would have to

Re: [sqlite] Interrupting SQLite execution (mainly FTS)

2013-05-02 Thread Dan Kennedy
On Thu, 2 May 2013 16:58:01 +0200 "Jan Slodicka" wrote: > Hi Dan > > > What are your settings for pragmas "cache_size", "journal_mode" and > > "synchronous"? > > cache_size/synchronous - default values > > Don't remember, which journal_mode was used for testing. Should be >

Re: [sqlite] Interrupting SQLite execution (mainly FTS)

2013-05-02 Thread Dan Kennedy
On Thu, 2 May 2013 11:16:06 +0200 "Jan Slodicka" wrote: > I was testing various ways how to interrupt rebuilding of an FTS > index. Ability to abort is vital as the app is running on a > smartphone and has to meet responsivity requirements. > > Here is what SQLite offers

Re: [sqlite] Slowness with FTS Queries and non-FTS tables

2013-05-01 Thread Dan Kennedy
On Tue, 30 Apr 2013 23:56:35 -0700 (PDT) Paul Vercellotti wrote: > > > > Hi All, > > We've got some trouble with FTS4 queries taking too long in which > we're looking for a subset of matching records in the FTS table, as > narrowed by a non-FTS table. > > CREATE TABLE

Re: [sqlite] possible ordering issue since 3.7.15

2013-04-13 Thread Dan Kennedy
On 04/13/2013 11:22 PM, kenichi ishigaki wrote: Hi. I received a report that the result of the following SQL has changed since 3.7.15. I haven't looked into the sqlite source yet, but can we call this a bug? No. No "ORDER BY" clause means that the results are delivered in an undefined order.

Re: [sqlite] SQLite 3.7.17 preview - 2x faster?

2013-04-08 Thread Dan Kennedy
On 04/08/2013 04:40 PM, Max Vlasov wrote: On Mon, Apr 8, 2013 at 1:23 PM, Dan Kennedy <danielk1...@gmail.com> wrote: Right. But a VFS is not obliged to support the new xFetch() and xUnfetch() methods (used to read data from a memory mapped file). And if it doesn't, SQLite will use

Re: [sqlite] SQLite 3.7.17 preview - 2x faster?

2013-04-08 Thread Dan Kennedy
On 04/08/2013 03:22 PM, Max Vlasov wrote: On Sun, Apr 7, 2013 at 2:12 PM, Max Vlasov wrote: On Thu, Apr 4, 2013 at 4:02 PM, Richard Hipp wrote: We would like to encourage people to try out the new code and report both success and failure. Not

Re: [sqlite] SQL Logic error or missing database

2013-04-05 Thread Dan Kennedy
On 04/05/2013 09:08 PM, Rob Collie wrote: Yeap, I'm on Visual Studio 2012. I've created a console app: sqlite3 *oDatabase; int returnValue; returnValue = sqlite3_open_v2("file://C:/Newfolder/testing.db", , SQLITE_OPEN_CREATE, NULL); if (returnValue != SQLITE_OK ) {

Re: [sqlite] SQLite 3.7.17 preview - 2x faster?

2013-04-04 Thread Dan Kennedy
On 04/04/2013 08:44 PM, Howard Chu wrote: Richard Hipp wrote: The memory-mapped I/O is only enabled for windows, linux, mac OS-X, and solaris. We have found that it does not work on OpenBSD, for reasons we have not yet been able to uncove; but as a precaution, memory mapped I/O is disabled by

Re: [sqlite] TCL Test failures on ARM

2013-04-01 Thread Dan Kennedy
On 04/01/2013 01:15 PM, Bk wrote: I have updated make file with "TCC = armv7l-timesys-linux-gnueabi-gcc -g -DSQLITE_OS_UNIX=1 -DSQLITE_DISABLE_LFS=1 -I. -I${TOP}/src -I${TOP}/ext/rtree" The test still fails with DSQLITE_DISABLE_LFS=1 with same error sysfault-2.setup... Ok ftruncate: : File

Re: [sqlite] TCL Test failures on ARM

2013-03-29 Thread Dan Kennedy
On 03/29/2013 04:35 PM, Bk wrote: The perror("ftruncate") is printing ftruncate: : File too large . i have a 2GB card in the embedded device with 50% mem free. Seems like EFBIG. What value is actually being passed as the second argument to the system ftruncate() call? Does the test pass if

Re: [sqlite] sqlite3 and sqlite4 disk I/O

2013-03-28 Thread Dan Kennedy
at 2:02 PM, Dan Kennedy <danielk1...@gmail.com> wrote: On 03/19/2013 01:18 AM, Rob Turpin wrote: It's a simple table, primary key is an integer, with another column which is integer. Although I do begin a transaction, do 1000 updates and then commit. On Mon, Mar 18, 2013 at 11:36 A

Re: [sqlite] sqlite3 and sqlite4 disk I/O

2013-03-28 Thread Dan Kennedy
On 03/19/2013 01:18 AM, Rob Turpin wrote: It's a simple table, primary key is an integer, with another column which is integer. Although I do begin a transaction, do 1000 updates and then commit. On Mon, Mar 18, 2013 at 11:36 AM, Dan Kennedy <danielk1...@gmail.com> wrote: On 03/19/2013

Re: [sqlite] TCL Test failures on ARM

2013-03-28 Thread Dan Kennedy
On 03/28/2013 02:18 PM, Bk wrote: Hi, The osFtruncate is not returning zero value. And what is it setting errno to? At line 23440, when rc is non-zero, what does perror("ftruncate") print? Dan. i have put breakpoint at ts_ftruncate abd robust_ftruncate (gdb) break robust_ftruncate

Re: [sqlite] sqlite3 and sqlite4 disk I/O

2013-03-26 Thread Dan Kennedy
On 03/26/2013 06:34 AM, Rob Turpin wrote: Dan, I haven't heard anything more about this. I was wondering if you also think the CPU performance for sqlite4 should be better? Maybe you could help me with where I could focus my attention in looking into this. I know that's probably a big

Re: [sqlite] demovfs question

2013-03-20 Thread Dan Kennedy
On 03/20/2013 05:17 PM, Neo Anderson wrote: Sorry, what do you mean on question 2? Can I use the buffered fopen family functions or not? You probably can. I don't think you should though. Date: Wed, 20 Mar 2013 17:13:26 +0700 From:

Re: [sqlite] demovfs question

2013-03-20 Thread Dan Kennedy
On 03/20/2013 05:00 PM, Neo Anderson wrote: I'm studying the demovfs listed on http://www.sqlite.org/vfs.html. I've got a few questions: 1. By reading the comments, it seems that file read/write operations must be buffered if it is a journal file. Is this required by sqlite design? No. Not

Re: [sqlite] sqlite3 and sqlite4 disk I/O

2013-03-18 Thread Dan Kennedy
On 03/19/2013 12:28 AM, Rob Turpin wrote: I was running some performance tests for both sqlite3 and sqlite4 and have a question about a difference in my numbers. I'm running these on a Linux machine, so I enabled fdatasync for the sqlite3 build. I'm measuring the number of updates I can

Re: [sqlite] TCL Test failures on ARM

2013-03-14 Thread Dan Kennedy
On 03/13/2013 01:03 PM, bkk wrote: Hi, Below is the code sequence after making a breakpoint at robust_ftruncate() i could see that "robust_ftruncate" and "ts_ftruncate" is called couple of times before the error is given to the user Breakpoint 2, ts_ftruncate (fd=5, n=297136) at

Re: [sqlite] Order of ON DELETE CASCADE specified in SQLite?

2013-03-13 Thread Dan Kennedy
On 03/14/2013 12:09 AM, Dominique Devienne wrote: I stumbled upon http://stackoverflow.com/questions/60168/in-what-order-are-on-delete-cascade-constraints-processedand tried a simplified version in SQLite3, which appears to work fine (see below). Is this just happenstance in this case or will

Re: [sqlite] TCL Test failures on ARM

2013-03-12 Thread Dan Kennedy
On 03/13/2013 11:52 AM, bkk wrote: i tried putting break point at robust_ftruncate() but it was not successful (gdb) break robust_ftruncate Function "robust_ftruncate" not defined. the symbol table of testfixture was not having this i believe. does it have anything to do with crosscompiling ?

Re: [sqlite] TCL Test failures on ARM

2013-03-12 Thread Dan Kennedy
On 03/12/2013 06:45 PM, bkk wrote: Below is the backtrace from the gdb when the failure happened. Seems odd to me. Assuming this is happening within the sysfault-2.1 test case, then the first stack should be setting errno to EINTR. Causing the robust_ftruncate() function to retry

Re: [sqlite] TCL Test failures on ARM

2013-03-11 Thread Dan Kennedy
On 03/12/2013 10:48 AM, bkk wrote: Has anyone came across same problem ? Appreciate if someone can point out what’s going wrong with these tests Is there something odd about trying to write to errno on this platform? These tests depend on function tsIsFailErrno() in file test_syscall.c being

Re: [sqlite] TCL Test failures on ARM

2013-03-10 Thread Dan Kennedy
On 03/11/2013 10:52 AM, bkk wrote: Hi, When i executed the TCL: tests on my ARM board (nitrogen 6X) the below tests are failing with the message Expected: [0 ok] Got: [1 {nfail=1 rc=1 result=disk I/O error}] sysfault-2.1-vfsfault-transient

Re: [sqlite] A question about the ancient history of SQLite triggers

2013-03-05 Thread Dan Kennedy
On 03/05/2013 09:59 PM, Jay A. Kreibich wrote: On Tue, Mar 05, 2013 at 11:20:27PM +1100, Philip Warner scratched on the wall: On 5/03/2013 9:53 PM, Richard Hipp wrote: Recursive triggers (triggers that invoke themselves either directly or indirectly) were added in version 3.6.18, 2009-09-11.

Re: [sqlite] mem1.zMalloc assertion fails

2013-03-05 Thread Dan Kennedy
the compiler complained about undeclared variables. The assertion that fails is not among those. I am using SQLite 3.6.22 . Thanks for taking the time to help me out. 2013/3/5 Dan Kennedy <danielk1...@gmail.com> On 03/05/2013 07:19 PM, Μάριος Φραγκούλης wrote: Hi All, I have compiled SQLite a

Re: [sqlite] mem1.zMalloc assertion fails

2013-03-05 Thread Dan Kennedy
On 03/05/2013 07:19 PM, Μάριος Φραγκούλης wrote: Hi All, I have compiled SQLite as part of a Linux kernel module (Linux version 3.2.0.35-generic) having set SQLITE_OMIT_FLOATING_POINT, SQLITE_THREADSAFE=0, SQLITE_OMIT_LOAD_EXTENSION, SQLITE_OMIT_BUILTIN_TEST and NDEBUG. I have configured SQLite

Re: [sqlite] Is there a way to create a foreign key in existing table?

2013-03-01 Thread Dan Kennedy
On 03/01/2013 03:24 PM, Igor Korot wrote: Hi, Will foreign key creation give me the speed increase? Or I need more an index? Foreign keys only ever slow things down (more stuff to check each time a row is inserted/updated/deleted). Indexes sometimes speed up queries. Dan. Thank you. On

Re: [sqlite] locked database returning SQLITE_IOERR, not SQLITE_BUSY

2013-02-26 Thread Dan Kennedy
On 02/27/2013 12:49 AM, Greg Janée wrote: I've instrumented the SQLite source and have found that the error is occurring at the fcntl call near the end of function unixLock (in SQLite version 3.7.0.1, this is line 23592 of sqlite3.c). The relevant code snippet is below. fnctl is returning -1,

Re: [sqlite] locked database returning SQLITE_IOERR, not SQLITE_BUSY

2013-02-26 Thread Dan Kennedy
On 02/27/2013 12:00 AM, Greg Janée wrote: errno=2 (ENOENT) What could not be existing? Strange. Could the value of errno have been clobbered before you read it? What can you see if you run the app under "truss -tfcntl"? Dan. On Feb 26, 2013, at 4:01 AM, Dan Kennedy wrote: On

Re: [sqlite] locked database returning SQLITE_IOERR, not SQLITE_BUSY

2013-02-26 Thread Dan Kennedy
On 02/26/2013 05:22 AM, Greg Janée wrote: I'm accessing an SQLite database from two processes simultaneously. If there's contention, one process will receive an SQLITE_BUSY; that's fine. However, occasionally a process will receive an SQLITE_IOERR with the extended result code

Re: [sqlite] sqlite4 lsm storage engine

2013-02-20 Thread Dan Kennedy
directly? Thanks, Dan. Thanks, Rob On Wed, Feb 20, 2013 at 9:43 AM, Dan Kennedy <danielk1...@gmail.com> wrote: On 02/20/2013 11:37 PM, Rob Turpin wrote: Yes. Is it succeeding? Returning LSM_OK? Dan. On Wed, Feb 20, 2013 at 3:14 AM, Dan Kennedy <danielk1...@gmail.com> wro

Re: [sqlite] sqlite4 lsm storage engine

2013-02-20 Thread Dan Kennedy
On 02/20/2013 11:37 PM, Rob Turpin wrote: Yes. Is it succeeding? Returning LSM_OK? Dan. On Wed, Feb 20, 2013 at 3:14 AM, Dan Kennedy <danielk1...@gmail.com> wrote: On 02/20/2013 05:07 PM, Rob Turpin wrote: I'm running some performance tests on the lsm storage engine, and an iss

Re: [sqlite] sqlite4 lsm storage engine

2013-02-20 Thread Dan Kennedy
On 02/20/2013 05:07 PM, Rob Turpin wrote: I'm running some performance tests on the lsm storage engine, and an issue has cropped up for me. I retrieved the sqlite4 code from the repository about a week ago. I'm doing a simple single threaded test to see what kind of performance I can get on

Re: [sqlite] SQLite 4

2013-02-19 Thread Dan Kennedy
On 02/19/2013 03:50 PM, Gabriel Corneanu wrote: I am also on final steps of a new project, and I would love to compare sqlite4 before release (the data files will be public, therefore a later switch would be problematic). Is there any chance to get it for windows? I usually need the dll. Last

Re: [sqlite] Question: User defined function and auxiliary data for multiple instances on one query

2013-02-07 Thread Dan Kennedy
On 02/08/2013 12:08 PM, Yongil Jang wrote: Dear, I'm trying to make a mystrstr function to use it as a sub-function of "like". mystrstr function is designed to use boyer-moore algorithm to improve string search performance. (Only for simple substing search, but not a complex search pattern)

Re: [sqlite] Strange eviction from Linux page cache

2013-02-07 Thread Dan Kennedy
On 02/08/2013 12:21 AM, James Vanns wrote: If you don't even have to close the SQLite shell for that to happen, I'm guessing it's an interaction with POSIX/fcntl file locking, which theoretically works over NFS but as I recall has some oddities. What happens if you do this? pragma locking_mode

Re: [sqlite] Strange eviction from Linux page cache

2013-02-07 Thread Dan Kennedy
On 02/07/2013 10:30 PM, James Vanns wrote: I fear I must correct myself. SQLite appears to 2nd guess/avoid the Linux kernel page cache both when the file is local and when it is remote. I'd wager that it's own internal cache (an LRU of somesort?) only ever ensures that there are n pages in

Re: [sqlite] FTS problem with 'NOT term' queries

2013-02-03 Thread Dan Kennedy
On 02/04/2013 12:18 AM, Alexey Pechnikov wrote: Hello! And as result it's impossible to search docs in some situations: SELECT * FROM docs WHERE docs MATCH 'NOT sqlite'; Error: malformed MATCH expression: [NOT sqlite] As far as I can tell, in MATCH syntax NOT is a binary operator,

Re: [sqlite] Possible optimization in FTS SQLite? (abort early when unpacking docids of inverted index list)

2013-02-01 Thread Dan Kennedy
On 02/01/2013 08:31 PM, Dominique Pellé wrote: Hi I was trying to optimize this FTS query which can be a bottleneck in my application: SELECT docId,matchinfo(ftsStreets,'pcx') FROM ftsStreets WHERE ftsStreets MATCH '...' AND docId BETWEEN docid1 AND docid2; Can't SQLite optimize the query

Re: [sqlite] sqlite-analyzer & largish db?

2013-01-26 Thread Dan Kennedy
On 01/26/2013 05:06 AM, Petite Abeille wrote: Hello, [3.7.15.2 2013-01-09 11:53:05 c0e09560d26f0a6456be9dd3447f5311eb4f238f] [sqlite-analyzer-osx-x86-3071502] sqlite3_analyzer seems to, hmmm, overflow or something given a largish db. Looks like the osx build on sqlite.org was dynamically

Re: [sqlite] performance regression when using "insert or replace"

2013-01-24 Thread Dan Kennedy
On 01/24/2013 03:25 AM, Teg wrote: I use "insert or replace" heavily. In debug mode, I set it to use temp file on disk so, I can watch the disk IO, in release mode I set it to temp file in memory. The danger is that if you ever do anything that requires a bunch of temp file, you can easily

Re: [sqlite] performance regression when using "insert or replace"

2013-01-24 Thread Dan Kennedy
On 01/24/2013 02:48 AM, Heiles, Katrina wrote: Thank you so much!! This is great news. One question: according to the tempfiles.html doc... Section 3.0 states that "The rollback journal, master journal, and statement journal files are always written to disk. But the other kinds of temporary

Re: [sqlite] performance regression when using "insert or replace"

2013-01-23 Thread Dan Kennedy
On 01/23/2013 11:04 PM, Heiles, Katrina wrote: Hi Dan, Yes, this resolves the problem. performance comes back up to 31K/sec. What are the risks of using this as a workaround? Data integrity is very important to us so I'm curious what effect this pragma would have. No effect on data

Re: [sqlite] performance regression when using "insert or replace"

2013-01-23 Thread Dan Kennedy
On 01/23/2013 04:20 AM, Heiles, Katrina wrote: I am in the process of updating from 3.6.4 to the latest and greatest version (finally :-) ). While running performance unit tests, i found a major regression (10K/sec vs 30k/sec) on a common use case for us. The regression occurs when using

Re: [sqlite] Multi-column index is not used with IN operator

2013-01-17 Thread Dan Kennedy
-Selen ____ From: Dan Kennedy<danielk1...@gmail.com> To: General Discussion of SQLite Database<sqlite-users@sqlite.org> Sent: Thursday, January 17, 2013 2:38 PM Subject: Re: [sqlite] Multi-column index is not used with IN operator On 01/1

Re: [sqlite] Multi-column index is not used with IN operator

2013-01-17 Thread Dan Kennedy
ussion of SQLite Database <sqlite-users@sqlite.org>; Dan Kennedy <danielk1...@gmail.com> *Sent:* Wednesday, January 16, 2013 3:46 PM *Subject:* Re: [sqlite] Multi-column index is not used with IN operator Sorry, wrong query wrong result. But still when I add the order by,

Re: [sqlite] Multi-column index is not used with IN operator

2013-01-16 Thread Dan Kennedy
On 01/16/2013 09:22 PM, Selen Schabenberger wrote: PRAGMA foreign_keys=OFF; BEGIN TRANSACTION; CREATE TABLE 'Message' ('Id' INTEGER PRIMARY KEY NOT NULL, 'Tag' INTEGER NOT NULL, 'Flag' INTEGER NOT NULL ); ANALYZE sqlite_master; INSERT INTO "sqlite_stat1" VALUES('Message','IDX_TAG','460132

Re: [sqlite] Multi-column index is not used with IN operator

2013-01-16 Thread Dan Kennedy
and query again? Dan. - Selen From: Dan Kennedy<danielk1...@gmail.com> To: General Discussion of SQLite Database<sqlite-users@sqlite.org> Sent: Wednesday, January 16, 2013 2:56 PM Subject: Re: [sqlite] Multi-column index is not used with IN ope

Re: [sqlite] Multi-column index is not used with IN operator

2013-01-16 Thread Dan Kennedy
was not a covering index. But seems like it is a discount for 3.7.15.2? - Selen *From:* Dan Kennedy <danielk1...@gmail.com> *To:* sqlite-users@sqlite.org *Sent:* Wednesday, January 16, 2013 1:12 PM *Subject:* Re: [sqlite] Multi-

Re: [sqlite] Multi-column index is not used with IN operator

2013-01-16 Thread Dan Kennedy
WHERE tag IN () AND flag=1; return? Is it close to the 38250 that SQLite is using as an estimate when planning the query? Thanks, Dan. Thanks! Selen ____ From: Dan Kennedy<danielk1...@gmail.com> To: sqlite-users@sqlite.org Sent: Wednesday, January 16, 2013

Re: [sqlite] Facing "SQLite ERROR : unable to open database file" error

2013-01-16 Thread Dan Kennedy
a BEGIN/COMMIT block. http://www.sqlite.org/tempfiles.html#stmtjrnl Regards, Ashok On Wed, Jan 16, 2013 at 1:46 PM, Dan Kennedy<danielk1...@gmail.com> wrote: On 01/16/2013 02:21 PM, Ashok Pitambar wrote: Hi All, I have used sqlite for Database in my client , to sp

Re: [sqlite] Facing "SQLite ERROR : unable to open database file" error

2013-01-16 Thread Dan Kennedy
On 01/16/2013 02:21 PM, Ashok Pitambar wrote: Hi All, I have used sqlite for Database in my client , to speed up the performance I used *"begin"(BEGIN;) *and *"end"(END;)* query transactions to include multiple transactions in single transaction. This helped in performance by

Re: [sqlite] showwal.c to find WAL file differences? (trying to analyze some lost commits)

2013-01-10 Thread Dan Kennedy
On 01/10/2013 10:13 PM, Michael Schlenker wrote: Am 10.01.2013 15:31, schrieb Dan Kennedy: On 01/10/2013 07:11 PM, Michael Schlenker wrote: Hi everyone, [snip] I'm pretty sure there was no DELETE for the missing object, but want to verify what happend by comparing the WAL files. Now i

Re: [sqlite] showwal.c to find WAL file differences? (trying to analyze some lost commits)

2013-01-10 Thread Dan Kennedy
On 01/10/2013 08:44 PM, Michael Schlenker wrote: Am 10.01.2013 14:23, schrieb Clemens Ladisch: Michael Schlenker wrote: I'm trying to track down some lost commits [...] The sqlite db file and WAL/SHM files are on some automounted linux SAN filesystem (probably NFS beneath it)

Re: [sqlite] showwal.c to find WAL file differences? (trying to analyze some lost commits)

2013-01-10 Thread Dan Kennedy
On 01/10/2013 07:11 PM, Michael Schlenker wrote: Hi everyone, I'm trying to track down some lost commits for SQLite 3.7.7.1 via the APSW Python wrapper. Pagesize etc. are all left at defaults for the APSW wrapper. The following probablematic scenario: The sqlite db file and WAL/SHM files are

Re: [sqlite] An undefined function in a check constraint will cause selecting from sqlite_master to fail.

2013-01-07 Thread Dan Kennedy
On 01/05/2013 05:00 AM, Peter Aronson wrote: I've thought about this a bit more, and concluded this is probably a bug. If you define your own function, and reference it in a check constraint, and then try to select from sqlite_master when that function is not currently defined, the select fails

<    2   3   4   5   6   7   8   9   10   11   >