Re: [sqlite] Iterating a result from a query

results already iterated through must be kept(at least a reference to it, something like rowId). If setToLast is used, I must use the sqlite3_step in order to find the last entry and then cache the other results. Is there an easier way?? Cheers Kim B.

[sqlite] Malformed schema error on sqlite3odbc.dll with version 0.79

Hi guys, We are using sqlite as our database and noticed some weird odbc driver problem. "malformed database schema (deleteUserGroupsByUsers) - no such table: main.Users (11)" If I open the database with other tool such as sqlite studio, or firefox plug in, there is no problem - the schema che

[sqlite] concurrent write

Hi, We have database table, and it is being written, sometimes 30 times a second. Some of the data succeeded, but some aren't. How should we handle this sort of lock issue ? thanks Richard K ___ sqlite-users mailing list sqlite-users@sqlite.org

Re: [sqlite] concurrent write

: General Discussion of SQLite Database Subject: Re: [sqlite] concurrent write Hello! В сообщении от Saturday 29 November 2008 01:16:17 Richard Kim написал(а): > We have database table, and it is being written, sometimes 30 times a > second. > Some of the data succeeded, but some aren

[sqlite] primary key is indexed by default ?

Hi Just wondering that if you set primary key in table, the column is indexed by default in sqlite ? thanks a lot Richard K ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

[sqlite] Newb-ish performance questions

Hello, I'm trying out Sqlite3 with an eye to improving the performance of queries on an existing MySQL database. I've imported the data into sqlite which is approx. 30 million rows of part numbers each with a price. So far, it's approx. four times slower than the MySQL version, and the size o

Re: [sqlite] Newb-ish performance questions

' AND c5 IN ('C','E','F') AND c6 = 'S' AND c7 IS NULL) UNION ALL SELECT * FROM mytable WHERE (c1 = 'W' AND c2 IN ('3','C','E','F') AND c3 IN ('2','5') ) UNION ALL SELECT * FROM myta

Re: [sqlite] Newb-ish performance questions

Hello, Thanks The grep regex on the text file found around 10,000 lines over 5 minutes (out of a total possible 200,000 rows), at which time I stopped it, interesting experiment anyway :-) Using OR instead of UNION in Mysql is definitely slower, although maybe, as someone has mentioned above

Re: [sqlite] Newb-ish performance questions

You have a good point there, I've been using that wrongly. I'll try that. Thanks Kees Nuyt wrote: > On Sun, 22 Feb 2009 08:48:00 +, Kim Boulton > wrote in k...@jesk.co.uk, General Discussion > of SQLite Database : > > >> *Then queried the Sqlite3 ta

Re: [sqlite] Newb-ish performance questions

individual indexes > on c5, c6, and c7. > >Performance tuning rule #1 - problems are almost always in your use > of the database, not the database itself. :) > >-Tom > > On Sun, Feb 22, 2009 at 3:48 AM, Kim Boulton wrote: > >> Thanks for the hints

Re: [sqlite] Newb-ish performance questions

#x27;3','C','E','F') AND c3 IN ('2','5') ) OR (c1 = 'W' AND c2 = '3' AND c3 = 'S' AND c6 IS NULL ) OR (c2 = '1' AND c3 = '1' AND c4 IN ('C','E','F') AND c5 = '

Re: [sqlite] Newb-ish performance questions

#x27;3','C','E','F') AND c3 IN ('2','5') ) OR (c1 = 'W' AND c2 = '3' AND c3 = 'S' AND c6 IS NULL ) OR (c2 = '1' AND c3 = '1' AND c4 IN ('C','E','F') AND c5 = '

Re: [sqlite] Newb-ish performance questions

. k John Machin wrote: > On 23/02/2009 5:14 PM, Kim Boulton wrote: > >> Hello, >> >> Thanks >> >> The grep regex on the text file found around 10,000 lines over 5 minutes >> (out of a total possible 200,000 rows), at which time I stopped it, >> i

Re: [sqlite] Newb-ish performance questions

he results once I've finished trying all the options, it's looking good so far though :-) k D. Richard Hipp wrote: > > On Feb 23, 2009, at 2:42 AM, Kim Boulton wrote: >> >> But OR is a lot slower than using UNION ALL on both Sqlite and Mysql > > > The optimizer

[sqlite] .timer with windows cli

Hello, Is there a compiled v3.6.11 sqlite3.exe with the .timer facility enabled. I don't have a C compiler on this machine. Anywhere I can download one would be nice. Thanks kim ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlit

Re: [sqlite] .timer with windows cli

sqlite bods to release windows binaries which have the optional functions available. The timer would be a popular feature :-) Cheers. kim Roger Binns wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > Kim Boulton wrote: > >> Anywhere I can download one would be ni

[sqlite] Strange SQLITE_CORRUPT error

Hi, I'm seeing a very strange, consistently reproducible case, in which SQLITE_CORRUPT is being returned in response to a simple insert statement. There is only one connection to the db so it is unlikely a concurrency issue. The insert is immediately after the table is created. The table creati

Re: [sqlite] Strange SQLITE_CORRUPT error

:48 PM To: General Discussion of SQLite Database Subject: Re: [sqlite] Strange SQLITE_CORRUPT error On Mar 19, 2009, at 8:33 PM, Kim, Albert wrote: > > /* The maximum page number is 2^31. Return SQLITE_CORRUPT if a page > ** number greater than this, or zero, is requested. > *

[sqlite] SQLITE_OMIT_WSD (3.6.23.1)

Hi, We are compiling sqlite 3.6.23.1 with the SQLITE_OMIT_WSD compile time flag turned on. We are using the amalgamation. We found that this didn't completely eliminate the writable static data in our binary, and some investigation led me to this static variable: SQLITE_PRIVATE VdbeOp *sqli

Re: [sqlite] SQLITE_OMIT_WSD (3.6.23.1)

Dan Kennedy-4 wrote: > > > On May 28, 2010, at 1:11 AM, Kim, Albert wrote: > >> Hi, >> >> We are compiling sqlite 3.6.23.1 with the SQLITE_OMIT_WSD compile >> time flag turned on. We are using the amalgamation. We found that >> this didn't

[sqlite] Iterating a result from a query

heers Kim B.

Re: [sqlite] Iterating a result from a query

ies. For the relatively simple tables that we have at the moment, I don't think its an issue to make one lookup per item when scrolling. But tests will show that. > >Cheers > >Kim B.

Re: [sqlite] Iterating a result from a query

do relatively easily. Prefetching sounds like a wonderfull idea, it is definitely in a phase +2 from current phase, but if the concept is working it might make the flow a lot smoother. Cheers Kim B.

Re: [sqlite] New Mailing List: List-Id Header

* D. Richard Hipp ([EMAIL PROTECTED]) [031019 14:08]: > William Trenker wrote: > > > >Any chance of adding the standard List-Id header to the new mailing list? > > If I made the change correctly, this reply should have the List-Id header > line. I'm getting the backspace character in that heade

[sqlite] Multiple sessions, page sizes and cache

t up for 4K pages and requests for 512-byte pages are served from there directly. Many thanks, - Kim ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Multiple sessions, page sizes and cache

Hi Clemens, Thanks for your help! On Sat, Jan 14, 2017 at 9:54 AM, Clemens Ladisch wrote: > Kim Gräsman wrote: >> I would expect SQLite to allocate a page cache per session. > > There is typically one page cache instance per connection. > (A connection is what you get from

Re: [sqlite] Multiple sessions, page sizes and cache

sage. SQLITE_CONFIG_PCACHE2 is definitely furthest down on my list, for precisely the reasons you quote. - Kim ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Multiple sessions, page sizes and cache

Hi Richard, On Sat, Jan 14, 2017 at 2:17 PM, Richard Hipp wrote: > On 1/13/17, Kim Gräsman wrote: >> >> In an effort to reduce memory usage/fragmentation, we're trying to >> configure SQLite to allocate as much memory as necessary up-front >> (based on the e

Re: [sqlite] BUG: Illegal initialization in icu.c : sqlite3IcuInit

r union > type shall be constant expressions.” But this object doesn't have static storage duration, does it? `scalars` is just a local variable in a function: https://sourcecodebrowser.com/sqlite3/3.6.21/icu_8c_source.html#l00449 unless I'm looking at the wrong version. Again, it w

Re: [sqlite] BUG: Illegal initialization in icu.c : sqlite3IcuInit

David, On Fri, Jan 27, 2017 at 12:51 PM, David Empson wrote: > >> On 27/01/2017, at 9:09 PM, Kim Gräsman wrote: >> >> On Thu, Jan 26, 2017 at 10:08 PM, David Empson > <mailto:demp...@emptech.co.nz>> wrote: >>> >>>

Re: [sqlite] Multiple sessions, page sizes and cache

Hi Richard, I got side-tracked with other work, but am coming back to this now. On Sun, Jan 15, 2017 at 5:50 PM, Richard Hipp wrote: > On 1/15/17, Kim Gräsman wrote: >> >> 1) If I configure a global SQLite heap with SQLITE_CONFIG_HEAP, won't >> I just trade malloc hea

Re: [sqlite] Multiple connections, page sizes and cache

c() for memory, increasing overall memory usage. Would something like "PRAGMA cache_allocator=malloc" be a crazy idea? Thanks, - Kim On Sat, Feb 4, 2017 at 3:21 PM, Kim Gräsman wrote: > Hi Richard, > > I got side-tracked with other work, but am coming back to this now. > > O

[sqlite] Smallest reasonable cache size

? 100? Some of these connections are only opened to do `PRAGMA quick_check;`, I'm guessing that operation is not very cache-intensive, assuming it reads pages sequentially and checks them? Thanks for any advice on this, - Kim ___ sqlite-users ma

Re: [sqlite] Smallest reasonable cache size

arena. It seems to me the behavior you're describing would require coordination between caches, so maybe my assumptions are wrong here? Thank you, - Kim ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Smallest reasonable cache size

Den 17 feb. 2017 5:33 em skrev "Richard Hipp" : On 2/17/17, Kim Gräsman wrote: > > If we let it use malloc directly and control it > with the soft heap limit, we'll have a steadily rising memory curve > until all caches are fully loaded (could take weeks.) > Caches

Re: [sqlite] Smallest reasonable cache size

On Fri, Feb 17, 2017 at 8:37 PM, Richard Hipp wrote: > On 2/17/17, Kim Gräsman wrote: >> >> Thanks, shrink_memory could come in handy. But this is not the problem >> we're trying to solve -- rather we want to claim as much memory as possible >> up-front to make

[sqlite] Minor doc patches

not able to free up enough auxiliary memory to stay below the > limit, _it goes ahead and allocations_ the extra memory Should read "it goes ahead and _allocates_ the extra memory" For what it's worth, - Kim ___ sqlite-users mailing list s

Re: [sqlite] Minor doc patches

On Mon, Mar 6, 2017 at 12:36 PM, Richard Hipp wrote: > On 3/6/17, Kim Gräsman wrote: >> Hi all, >> >> I'm reading the documentation on memory >> (https://www.sqlite.org/malloc.html) again and stumbled on some typos: > > Thanks. Fixed now. Thanks! Alr

[sqlite] Query default lookaside pool size

Hi all, Is there a way to query SQLite build parameters at runtime, more specifically SQLITE_DEFAULT_LOOKASIDE? Thanks, - Kim ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo

Re: [sqlite] Query default lookaside pool size

On Wed, Mar 8, 2017 at 2:41 PM, Simon Slavin wrote: > > On 8 Mar 2017, at 11:09am, Kim Gräsman wrote: > >> Is there a way to query SQLite build parameters at runtime, more >> specifically SQLITE_DEFAULT_LOOKASIDE? > > <https://www.sqlite.org/pragma.html#pragma

[sqlite] SQLITE_OMIT_* vs amalgamation

T_SHARED_CACHE hoping for some speedups. Thanks, - Kim ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] SQLITE_OMIT_* vs amalgamation

I'm building for both Windows and Linux and it's a reproducible build, so I'd rather not depend on anything extra. Thanks, - Kim On Wed, Apr 19, 2017 at 2:10 AM, David Burgess wrote: > If you are running Linux, the build from source (i.e. making your own > amalgamatio

Re: [sqlite] Multiple sessions, page sizes and cache

Hi all, On Sun, Jan 15, 2017 at 5:50 PM, Richard Hipp wrote: > On 1/15/17, Kim Gräsman wrote: >> >> 1) If I configure a global SQLite heap with SQLITE_CONFIG_HEAP, won't >> I just trade malloc heap fragmentation for SQLite private heap >> fragmentation? Or does S

Re: [sqlite] Multiple sessions, page sizes and cache

On Fri, Apr 21, 2017 at 6:05 PM, Simon Slavin wrote: > > On 21 Apr 2017, at 4:18pm, Kim Gräsman wrote: > >> Unfortunately, we're getting occasional out-of-memory errors on >> statement execution. > > Is there a chance that your statements are making up tem

Re: [sqlite] Multiple sessions, page sizes and cache

On Fri, Apr 21, 2017 at 6:21 PM, Simon Slavin wrote: > > On 21 Apr 2017, at 5:16pm, Kim Gräsman wrote: > >> Could be. Would that show up in EXPLAIN somehow? > > You would find it easier to spot using EXPLAIN QUERY PLAN. 'scan' means it’s > just looking throug

Re: [sqlite] SQLITE_OMIT_* vs amalgamation

On Wed, Apr 19, 2017 at 1:18 PM, Richard Hipp wrote: > On 4/19/17, Kim Gräsman wrote: >> I'm building for both Windows and Linux and it's a reproducible build, >> so I'd rather not depend on anything extra. > > The only thing extra you need is tclsh instal

Re: [sqlite] Multiple sessions, page sizes and cache

On Fri, Apr 21, 2017 at 5:18 PM, Kim Gräsman wrote: > > I have a nagging suspicion that the tempdb is allocated from the > private heap (we've set pragma temp_store=memory) -- what are the > characteristics of that database? Can I forecast how large it will be? The behavior

[sqlite] -shm grows with large transaction

#x27;s a page correlation -- is it growing so much because we're touching so many pages? SQLite v.3.14.1. Thanks, - Kim [1] https://www.sqlite.org/fileformat2.html#walindexformat ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org

Re: [sqlite] -shm grows with large transaction

fied, but I can see that now. Thanks, - Kim ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] -shm grows with large transaction

On Wed, Apr 26, 2017 at 5:58 PM, Dominique Devienne wrote: > On Wed, Apr 26, 2017 at 5:34 PM, Kim Gräsman wrote: > >> Great, that means the numbers add up. This is a monster transaction >> updating 5M rows, and page size is 512 bytes, so I think we have roughly 1 >> ro

[sqlite] SQLite memory calculator (was Multiple sessions, page sizes and cache)

On Fri, Apr 21, 2017 at 5:18 PM, Kim Gräsman wrote: > Hi all, > > On Sun, Jan 15, 2017 at 5:50 PM, Richard Hipp wrote: >> On 1/15/17, Kim Gräsman wrote: >>> >>> 1) If I configure a global SQLite heap with SQLITE_CONFIG_HEAP, won't >>> I just tra

Re: [sqlite] SQLite memory calculator (was Multiple sessions, page sizes and cache)

Hi Simon, On Wed, Apr 26, 2017 at 11:46 PM, Simon Slavin wrote: > > On 26 Apr 2017, at 10:00pm, Kim Gräsman wrote: > >> Specifically, I wonder if 4MiB for the general-purpose heap is maybe >> entirely unreasonable? Is there a way to forecast how much memory will >> be

Re: [sqlite] SQLite memory calculator (was Multiple sessions, page sizes and cache)

On Wed, Apr 26, 2017 at 11:00 PM, Kim Gräsman wrote: > > I've used a spreadsheet internally to forecast how much memory SQLite > will need in a given configuration. > > I've cleaned/generalised it a little and posted here: > https://do

[sqlite] Duplicate documentation

on how you got there. Is there a way to fix this somehow? Thanks, - Kim ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] PRAGMA cache_size=0 increases memory usage

first hand when I issued 'PRAGMA cache_size=128' with a fixed heap on a large schema and immediately ran out of memory. - Kim ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] PRAGMA cache_size=0 increases memory usage

On Thu, May 18, 2017 at 8:27 PM, Bob Friesenhahn wrote: > On Thu, 18 May 2017, Kim Gräsman wrote: > >> On Thu, May 18, 2017 at 6:10 PM, Bob Friesenhahn >> wrote: >>> >>> Does anyone know why using 'PRAGMA cache_size=0' (or some other small >>&

Re: [sqlite] PRAGMA cache_size=0 increases memory usage

Hi Bob, Den 18 maj 2017 9:15 em skrev "Bob Friesenhahn" < bfrie...@simple.dallas.tx.us>: On Thu, 18 May 2017, Kim Gräsman wrote: > >> The request is issued early on when the connection is first opened so no >> actual queries have been issued at that time. >

[sqlite] Relationship class in sqlite?

o relationship class explicitly. Assuming that I completed defining the relationship between the shapefiles using REFERENCES keyword in sqlite, is there any visualization tool that enables me the navigation between the related table attribute values? I would appreciate your answer. Thanks

[sqlite] Hello.. I want to translate SQlite.org into Korean language version.

Hello. My name is Seungjin Kim. I'm from Korea and my job is teaching english for elementary students. My hobby is php programming because I was before php programmer. These day I programming on android and iOS. So I'm using SQLite now. I appreciate SQLite database. It can hleped my pr

[sqlite] sqlite3_step hold about 0.5sec in iphone.

Hi, I'm Hyoseok Kim from Korea. I develop a app on iphone. I use SQLite for about 120,000 data. In my code, sqlite3_step hold 0.5~1.0 sec. Please give me a hint to escape sqlite3_step method rapidly. Please help me. Thank you so much. My code is below... if (sqlite3_prepare_

[sqlite] sqllite remote server system.

Hi. who check source code in my friend project for sqliteDBMS add on? http://sourceforge.net/projects/sqlitedbms/ i want to patch sqlite remote management system feature like that project in the future as soon as you possible. thank you for your works. ---

[sqlite] SQLite logo usage

the attached image. I wonder if it is ok to publish it. Thanks for your attention, Bruno Kim Medeiros Cesar Eng. de Computação 2008 - EESC - USP brunokim...@gmail.com Skype: bkim.cesar ___ sqlite-users mailing list sqlite-users@sqlite.org http

Re: [sqlite] SQLite logo usage

Thanks for your answer. Is it explicit somewhere in the site, or should it be? I guessed to be the case, but there's no notice as we see on NASA images, for example. Bruno Kim Medeiros Cesar Eng. de Computação 2008 - EESC - USP brunokim...@gmail.com Skype: bkim.cesar 2012/12/10 Richard