[sqlite] Is it possible to see timeline for given branch (or even tag)?

2014-03-27 Thread Tony Papadimitriou
When I give the command FOSSIL TIM it lists all changes in all branches (and tags). But what if I want to see changes in only, say, the TRUNK branch? Is there a way? Or maybe items having a given tag? TIA ___ sqlite-users mailing list

[sqlite] Is it possible to MATCH across JOINed FTS4 tables?

2013-08-24 Thread David Waters
I can't quite figure out the right method to perform a MATCH query across joined FTS tables. Does anyone know of a method where this is possible? As an example, I have two FTS4 tables: CREATE VIRTUAL TABLE person USING fts4(personid,firstname,lastname,addressid) CREATE VIRTUAL TABLE address

Re: [sqlite] Slow sqlite3_open() - possible culprits?

2013-03-24 Thread Mohit Sindhwani
Hi! On 15/3/2013 11:40 PM, Mohit Sindhwani wrote: Hi Richard, On 14/3/2013 8:17 PM, Richard Hipp wrote: On Thu, Mar 14, 2013 at 12:34 AM, Mohit Sindhwani wrote: Hi, we are using SQLite3 + CEROD for a number of databases in an embedded systems application running on Windows

Re: [sqlite] Slow sqlite3_open() - possible culprits?

2013-03-15 Thread Mohit Sindhwani
Hi Richard, On 14/3/2013 8:17 PM, Richard Hipp wrote: On Thu, Mar 14, 2013 at 12:34 AM, Mohit Sindhwani wrote: Hi, we are using SQLite3 + CEROD for a number of databases in an embedded systems application running on Windows CE. We're finding unexpectedly long time to open

Re: [sqlite] Slow sqlite3_open() - possible culprits?

2013-03-14 Thread Richard Hipp
On Thu, Mar 14, 2013 at 12:34 AM, Mohit Sindhwani wrote: > Hi, we are using SQLite3 + CEROD for a number of databases in an embedded > systems application running on Windows CE. We're finding unexpectedly long > time to open the database (0.5s ~ 2.8sec). Maybe, these times are

Re: [sqlite] Slow sqlite3_open() - possible culprits?

2013-03-14 Thread Mohit Sindhwani
Hi Stephen, Thanks for the reply! On 14/3/2013 2:20 PM, Stephen Chrzanowski wrote: If you're attempting to open a read only SQLite database, it seems as though it will take that time to validate write permissions. By "read only", I meant that the database is for reading only. It doesn't

Re: [sqlite] Slow sqlite3_open() - possible culprits?

2013-03-14 Thread Stephen Chrzanowski
If you're attempting to open a read only SQLite database, it seems as though it will take that time to validate write permissions. I don't know what CEROD is. In that thread, to which I was a part of, you'll notice that when I changed just the basic file attribute to read only, even the CLI

[sqlite] Slow sqlite3_open() - possible culprits?

2013-03-13 Thread Mohit Sindhwani
Hi, we are using SQLite3 + CEROD for a number of databases in an embedded systems application running on Windows CE. We're finding unexpectedly long time to open the database (0.5s ~ 2.8sec). Maybe, these times are reasonable, but they seem long to us. We are using:

Re: [sqlite] Is it possible to use SQLITE to calculate the streakedness of numeric data?

2013-02-19 Thread Frank Chang
joe.fis...@tanguaylab.com, Michael Black, Marc L. Allen, and Simon Slavin, Our software architect defined data streakedness based upon Chauvenet's criterion. Thank you for all of your help. In statistical theory, *Chauvenet's criterion* (named for William

Re: [sqlite] Is it possible to use SQLITE to calculate the streakedness of numeric data?

2013-02-19 Thread Frank Chang
joe.fis...@tanguaylab.com, Michael Black, Marc. L Allen and Simon Slavin, Thank you for your help in helping me to convince our company's software architect that it is possible to calculate the streakedness of numeric data. ___ sqlite-users mailing

Re: [sqlite] Is it possible to use SQLITE to calculate the streakedness of numeric data?

2013-02-18 Thread Michael Black
ect: [sqlite] Is it possible to use SQLITE to calculate the streakedness of numeric data? Would anyone know how to use SQLITE to calculate the streakedness of data? The definition of streakedness is how many deviations away from the mean(i.e running average a numerical data streak is Thank you for y

Re: [sqlite] Is it possible to use SQLITE to calculate the, streakedness of numeric data?

2013-02-18 Thread joe.fis...@tanguaylab.com
Frank, Don't really understand your question. Should be no problem to calculate anything once. Just write your algorithm. The problem comes in when you try to calculate it for a set of data. SQLite like MySQL doesn't have SQL 2003/2008 Window Functions. Oracle recently stated they will not be

[sqlite] Is it possible to use SQLITE to calculate the streakedness of numeric data?

2013-02-18 Thread Frank Chang
Would anyone know how to use SQLITE to calculate the streakedness of data? The definition of streakedness is how many deviations away from the mean(i.e running average a numerical data streak is Thank you for your help. A variable R can be used to indicate how many deviations away from the mean a

Re: [sqlite] 5. Re: Sqlite, Is it possible to calculate the length of the longest increasing subsequence using an UDF

2012-10-16 Thread Black, Michael (IS)
: sqlite-users-boun...@sqlite.org [sqlite-users-boun...@sqlite.org] on behalf of Igor Tandetnik [itandet...@mvps.org] Sent: Tuesday, October 16, 2012 8:54 AM To: sqlite-users@sqlite.org Subject: EXT :Re: [sqlite] 5. Re: Sqlite, Is it possible to calculate the length of the longest increasing

Re: [sqlite] 5. Re: Sqlite, Is it possible to calculate the length of the longest increasing subsequence using an UDF

2012-10-16 Thread Igor Tandetnik
Black, Michael (IS) wrote: > Pseudo-code: > > lastchar=''; > For (char c in array) > if (lastchar = '' || c = lastchar+1) >curseq.push(c); > else >curseq.clear(); >curseq..push(c); > end The longest increasing subsequence doesn't need to be contiguous. Nor

Re: [sqlite] 5. Re: Sqlite, Is it possible to calculate the length of the longest increasing subsequence using an UDF

2012-10-16 Thread Black, Michael (IS)
man Information Systems From: sqlite-users-boun...@sqlite.org [sqlite-users-boun...@sqlite.org] on behalf of Igor Tandetnik [itandet...@mvps.org] Sent: Monday, October 15, 2012 6:05 PM To: sqlite-users@sqlite.org Subject: EXT :Re: [sqlite] 5. Re: Sql

Re: [sqlite] 5. Re: Sqlite, Is it possible to calculate the length of the longest increasing subsequence using an UDF

2012-10-15 Thread Igor Tandetnik
On 10/15/2012 4:29 PM, Frank Chang wrote: Igor Tandetnik, So what is the purpose of this whole exercise Following the project gurus's example sequence of -- 1,2,3,4,3,5,6,7,8,10 -- the numeric sorted ascending subsequence is found to be 1,2,3,4,5,6,7,8,10 using an automatic variable

[sqlite] 18. Re: Sqlite, Is it possible to calculate the length of the longest increasing subsequence using an UDF

2012-10-15 Thread Frank Chang
Elefterios Stamatogiannakis, Following the project gurus's example sequence of -- 1,2,3,4,3,5,6,7,8,10 -- the numeric sorted ascending subsequence is found to be 1,2,3,4,5,6,7,8,10 using an automatic variable containing the most recent monotically increasing sequence member value and traversing

[sqlite] 5. Re: Sqlite, Is it possible to calculate the length of the longest increasing subsequence using an UDF

2012-10-15 Thread Frank Chang
Igor Tandetnik, >>> So what is the purpose of this whole exercise Following the project gurus's example sequence of -- 1,2,3,4,3,5,6,7,8,10 -- the numeric sorted ascending subsequence is found to be 1,2,3,4,5,6,7,8,10 using an automatic variable containing the most recent monotically increasing

Re: [sqlite] Sqlite, Is it possible to calculate the length of the longest increasing subsequence using an UDF?

2012-10-13 Thread Elefterios Stamatogiannakis
Sorry for hijacking the thread, but i have an answer for that. IMHO having the computation application and the data management on different domains incurs a very high data transfer cost. The traditional thinking of shipping the data from the DB to somewhere else (application code) to do the

Re: [sqlite] Sqlite, Is it possible to calculate the length of the longest increasing subsequence using an UDF?

2012-10-12 Thread Igor Tandetnik
On 10/12/2012 11:23 AM, Frank Chang wrote: With the latest version of Sqlite, Is it possible to calculate the length of the longest increasing subsequence, also referred to as sortation percent, using a sqlite UDF, user defined function? Thank you. An algorithm described at http

[sqlite] Sqlite, Is it possible to calculate the length of the longest increasing subsequence using an UDF?

2012-10-12 Thread Frank Chang
With the latest version of Sqlite, Is it possible to calculate the length of the longest increasing subsequence, also referred to as sortation percent, using a sqlite UDF, user defined function? Thank you. ___ sqlite-users mailing list sqlite-users

Re: [sqlite] Is it possible to get the amalgation as individual files

2012-09-22 Thread Black, Michael (IS)
:Re: [sqlite] Is it possible to get the amalgation as individual files On Fri, Sep 21, 2012 at 4:01 PM, Nico Williams <n...@cryptonector.com>wrote: > >Install Cygwin, use that to make the amalgamation (after you've made > >whatever changes to the canonical sources), then bu

Re: [sqlite] Is it possible to get the amalgation as individual files

2012-09-21 Thread Richard Hipp
On Fri, Sep 21, 2012 at 4:52 PM, Jeff Archer < jsarc...@nanotronicsimaging.com> wrote: > On Fri, Sep 21, 2012 at 4:01 PM, Nico Williams >wrote: > > > >Install Cygwin, use that to make the amalgamation (after you've made > > >whatever changes to the canonical sources),

Re: [sqlite] Is it possible to get the amalgation as individual files

2012-09-21 Thread Igor Tandetnik
On 9/21/2012 4:52 PM, Jeff Archer wrote: Not sure what I need to do next. http://www.sqlite.org/howtocompile.html -- Igor Tandetnik ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Is it possible to get the amalgation as individual files

2012-09-21 Thread Jeff Archer
On Fri, Sep 21, 2012 at 4:01 PM, Nico Williams wrote: > >Install Cygwin, use that to make the amalgamation (after you've made > >whatever changes to the canonical sources), then build the amalgation > >in native Windows. Please excuse my ignorance. OK. I have Cygwin.

Re: [sqlite] Is it possible to get the amalgation as individual files

2012-09-21 Thread Nico Williams
On Fri, Sep 21, 2012 at 2:55 PM, Jeff Archer wrote: > Igor Tandetnik Fri Sep 21 15:26:16 EDT 2012 >> ..."Canonical Source Code" section > > I knew about this but unfortunately I am Windows only. So the "Note that a > unix-like development environment, including a

Re: [sqlite] Is it possible to get the amalgation as individual files

2012-09-21 Thread Jeff Archer
Igor Tandetnik Fri Sep 21 15:26:16 EDT 2012 > ..."Canonical Source Code" section I knew about this but unfortunately I am Windows only. So the "Note that a unix-like development environment, including a recent version of Tcl, is required in order to build from the canonical

Re: [sqlite] Is it possible to get the amalgation as individual files

2012-09-21 Thread Igor Tandetnik
On 9/21/2012 3:20 PM, Jeff Archer wrote: I assume that the amalgation exists as single files before it is combined into one file. http://sqlite.org/download.html , "Canonical Source Code" section at the bottom. -- Igor Tandetnik ___ sqlite-users

[sqlite] Is it possible to get the amalgation as individual files

2012-09-21 Thread Jeff Archer
I assume that the amalgation exists as single files before it is combined into one file. Is is possible to get these individual files so that I can build a debug version because Visual Studio debugger does not handle well the 138244 line amalgation file? Jeff Archer Nanotronics Imaging

Re: [sqlite] Different backend possible?

2012-06-23 Thread Pavel Ivanov
On Sat, Jun 23, 2012 at 2:28 PM, Simon Slavin wrote: > On 23 Jun 2012, at 7:14pm, "Peter M. Friedrich" > wrote: > >> do you think it's possible to create a different backend? I want to >> develop a relational database system

Re: [sqlite] Different backend possible?

2012-06-23 Thread Simon Slavin
On 23 Jun 2012, at 7:14pm, "Peter M. Friedrich" wrote: > do you think it's possible to create a different backend? I want to > develop a relational database system which uses tables in FITS-files > (for details about this format see >

Re: [sqlite] Different backend possible?

2012-06-23 Thread Roger Binns
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 23/06/12 11:14, Peter M. Friedrich wrote: > do you think it's possible to create a different backend? You can use the SQL frontend of SQLite with you providing the underlying data by any appropriate means: http://www.sqlite.org/vtab.html It

[sqlite] Different backend possible?

2012-06-23 Thread Peter M. Friedrich
Hi all, do you think it's possible to create a different backend? I want to develop a relational database system which uses tables in FITS-files (for details about this format see http://fits.gsfc.nasa.gov/fits_standard.html). I guess it would be a good idea to use an approved database like

Re: [sqlite] Is it possible to insert UTF-8 strings in SQLITE3.EXE?

2012-05-14 Thread Yuriy Kaminskiy
Kit wrote: > 2012/5/13, Frank Chang : >> Here is another way I found out how insert UTF-8 strings in SQLITE3.EXE. >> >> F:\sqlite3_6_16>sqlite3.exe mdName.dat >> SQLite version 3.6.16 >> Enter ".help" for instructions >> Enter SQL statements terminated with a ";" >>

Re: [sqlite] Is it possible to accurately retrieve UTF-8 String stored in SQLite 3.7.11 databases using sqlite3_column_text?

2012-05-14 Thread Richard Hipp
On Mon, May 14, 2012 at 9:48 AM, Frank Chang wrote: > > Good morning, Is it possible to accurately retrieve UTF-8 String stored > in SQLite 3.7.11 databases using sqlite3_column_text? > Yes. That is the default behavior. In fact, I do not know of a way to get it to

[sqlite] Is it possible to accurately retrieve UTF-8 String stored in SQLite 3.7.11 databases using sqlite3_column_text?

2012-05-14 Thread Frank Chang
Good morning, Is it possible to accurately retrieve UTF-8 String stored in SQLite 3.7.11 databases using sqlite3_column_text? If not, what sqlite3 C/C++ api should we use? Thank you. ___ sqlite-users

Re: [sqlite] Is it possible to insert UTF-8 strings in SQLITE3.EXE?

2012-05-14 Thread Kit
2012/5/13, Frank Chang : > Here is another way I found out how insert UTF-8 strings in SQLITE3.EXE. > > F:\sqlite3_6_16>sqlite3.exe mdName.dat > SQLite version 3.6.16 > Enter ".help" for instructions > Enter SQL statements terminated with a ";" > sqlite> INSERT INTO

Re: [sqlite] Is it possible to determine the length of UNICODE(UTF-8 or UTF-16) strings stored in SQLite 3.7.11 database?

2012-05-13 Thread Simon Slavin
On 13 May 2012, at 6:26pm, Richard Hipp wrote: > sqlite> select length('Gödel'), length(CAST('Gödel' AS blob)); > 5|6 > > SQLite does not know how to convert unicode to upper or lower case because > case conversion is locale dependent. But the number of characters in a >

Re: [sqlite] Is it possible to determine the length of UNICODE(UTF-8 or UTF-16) strings stored in SQLite 3.7.11 database?

2012-05-13 Thread Richard Hipp
On Sun, May 13, 2012 at 1:18 PM, Simon Slavin wrote: > > On 13 May 2012, at 4:49pm, Roger Binns wrote: > > > You should be accessing things via SQL and the C API. In that case the > > encoding in the database is not relevant as the strings have

Re: [sqlite] Is it possible to determine the length of UNICODE(UTF-8 or UTF-16) strings stored in SQLite 3.7.11 database?

2012-05-13 Thread Simon Slavin
On 13 May 2012, at 4:49pm, Roger Binns wrote: > You should be accessing things via SQL and the C API. In that case the > encoding in the database is not relevant as the strings have their > encoding converted as appropriate. > > sqlite3_column_bytes and

Re: [sqlite] Is it possible to determine the length of UNICODE(UTF-8 or UTF-16) strings stored in SQLite 3.7.11 database?

2012-05-13 Thread Roger Binns
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 13/05/12 08:07, Frank Chang wrote: > Good Morning, Is it possible to determine the length of UNICODE(UTF-8 > or UTF-16) strings stored in SQLite 3.7.11 database? http://www.sqlite.org/fileformat.html You should be accessing things via SQL and the

Re: [sqlite] Is it possible to determine the length of UNICODE(UTF-8 or UTF-16) strings stored in SQLite 3.7.11 database?

2012-05-13 Thread Keith Medcalf
> Good Morning, Is it possible to determine the length of UNICODE(UTF-8 or UTF- > 16) strings stored in SQLite 3.7.11 database? >I just tried using the IBM open-source ICU function int32_t u_strlen(const > UCHAR* str) but it gives me erroneous? Evidently the u_strlen function for a > UTF-8

[sqlite] Is it possible to determine the length of UNICODE(UTF-8 or UTF-16) strings stored in SQLite 3.7.11 database?

2012-05-13 Thread Frank Chang
Good Morning, Is it possible to determine the length of UNICODE(UTF-8 or UTF-16) strings stored in SQLite 3.7.11 database? I just tried using the IBM open-source ICU function int32_t u_strlen(const UCHAR* str) but it gives me erroneous? Evidently the u_strlen function for a UTF-8 NULL

Re: [sqlite] Is it possible to insert UTF-8 strings in SQLITE3.EXE?

2012-05-13 Thread Frank Chang
Richard Hipp, Simon Slavin, Luuk, and Keith Metcalf Thank you for your replies to our question. Here is another way I found out how insert UTF-8 strings in SQLITE3.EXE. F:\sqlite3_6_16>sqlite3.exe mdName.dat SQLite version 3.6.16 Enter ".help" for instructions Enter SQL statements

Re: [sqlite] Is it possible to inserted European accented strings(UTF-8/UTF-16) into SQLITE using SQLITE3.EXE?

2012-05-11 Thread Luuk
On 11-05-2012 19:47, Richard Hipp wrote: > On Fri, May 11, 2012 at 1:25 PM, Luuk wrote: > >> On 11-05-2012 19:11, Richard Hipp wrote: >>> On Fri, May 11, 2012 at 12:20 PM, Frank Chang >> wrote: >>> Good Afternoon, Is it possible to

Re: [sqlite] Is it possible to inserted European accented strings(UTF-8/UTF-16) into SQLITE using SQLITE3.EXE?

2012-05-11 Thread Keith Medcalf
Sent: Friday, 11 May, 2012 11:25 > To: sqlite-users@sqlite.org > Subject: Re: [sqlite] Is it possible to inserted European accented > strings(UTF-8/UTF-16) into SQLITE using SQLITE3.EXE? > > On 11-05-2012 19:11, Richard Hipp wrote: > > On Fri, May 11, 2012 at 12:20 PM, Frank C

Re: [sqlite] Is it possible to inserted European accented strings(UTF-8/UTF-16) into SQLITE using SQLITE3.EXE?

2012-05-11 Thread Simon Slavin
On 11 May 2012, at 6:47pm, Richard Hipp wrote: > Your work-around is to use some flavor of Unix or to set your windows box > to use the unicode 65001 codepage. I no longer use Windows a lot, but I delighted in setting everything to use the Unicode codepage as soon as it was

Re: [sqlite] Is it possible to inserted European accented strings(UTF-8/UTF-16) into SQLITE using SQLITE3.EXE?

2012-05-11 Thread Richard Hipp
On Fri, May 11, 2012 at 1:25 PM, Luuk wrote: > On 11-05-2012 19:11, Richard Hipp wrote: > > On Fri, May 11, 2012 at 12:20 PM, Frank Chang >wrote: > > > >> > >> Good Afternoon, Is it possible to inserted European accented > >> strings(UTF-8/UTF-16)

Re: [sqlite] Is it possible to inserted European accented strings(UTF-8/UTF-16) into SQLITE using SQLITE3.EXE?

2012-05-11 Thread Luuk
On 11-05-2012 19:11, Richard Hipp wrote: > On Fri, May 11, 2012 at 12:20 PM, Frank Chang > wrote: > >> >> Good Afternoon, Is it possible to inserted European accented >> strings(UTF-8/UTF-16) into SQLITE using SQLITE3.EXE? If so, could you >> please show us a brief

Re: [sqlite] Is it possible to inserted European accented strings(UTF-8/UTF-16) into SQLITE using SQLITE3.EXE?

2012-05-11 Thread Richard Hipp
On Fri, May 11, 2012 at 12:20 PM, Frank Chang wrote: > > Good Afternoon, Is it possible to inserted European accented > strings(UTF-8/UTF-16) into SQLITE using SQLITE3.EXE? If so, could you > please show us a brief example. Best Regards Frank. > INSERT INTO user(name)

[sqlite] Is it possible to inserted European accented strings(UTF-8/UTF-16) into SQLITE using SQLITE3.EXE?

2012-05-11 Thread Frank Chang
Good Afternoon, Is it possible to inserted European accented strings(UTF-8/UTF-16) into SQLITE using SQLITE3.EXE? If so, could you please show us a brief example. Best Regards Frank. ___ sqlite-users

[sqlite] [solution] - Re: Possible bug when rebuilding amalgamation without triggers or altertable

2012-04-27 Thread nn6eumtr
I looked into the problem more tonight and found all of the references to the omitted functions were from the auto-generated parser. I looked at the parser source and it was checking for omits in all the right places so the functions should have have been referenced. I checked the Makefile and

[sqlite] Is it possible to preclude the latest sqlite 3.7.11 Windows warning message?

2012-04-23 Thread Frank Chang
Simon Davies, We tried your suggestion, /Ze on Visual Studio 2008, buy we are still encountering Microsoft Visual 2008 warning, Thank you for your help. e:\users\frank\dqt_memorymap\sqlite\sqlite3.c(32329) : warning C4232: nonstandard extension used : 'pCurrent' : address of dllimport

Re: [sqlite] Is it possible to preclude the latest sqlite 3.7.11 Windows warning message?

2012-04-23 Thread Simon Davies
On 23 April 2012 13:04, Frank Chang wrote: > > >       Good morning, We are trying to compile  the latest SQLITE 3.7.11 > release but we keep getting the Windows Visual Studio 8 warning message: > warning C4232: nonstandard extension used : 'pCurrent' : address

[sqlite] Is it possible to preclude the latest sqlite 3.7.11 Windows warning message?

2012-04-23 Thread Frank Chang
Good morning, We are trying to compile the latest SQLITE 3.7.11 release but we keep getting the Windows Visual Studio 8 warning message: warning C4232: nonstandard extension used : 'pCurrent' : address of dllimport 'AreFileApisANSI' is not static, identity not guaranteed showm

Re: [sqlite] Is it possible to use substrings of Windows DOS batch fiile parameters in sqlite3.exe -line db ?

2012-04-11 Thread Frank Chang
Message: 19 >Date: Wed, 11 Apr 2012 08:31:49 -0400 >From: Gabor Grothendieck <ggrothendi...@gmail.com> >To: General Discussion of SQLite Database <sqlite-users@sqlite.org> >Subject: Re: [sqlite] Is it possible to use substrings of Windows DOS >batch fiile paramet

Re: [sqlite] Is it possible to use substrings of Windows DOS batch fiile parameters in sqlite3.exe -line db ?

2012-04-11 Thread Frank Chang
inq1ltd, Thank you for your reply. Here is an excerpt of the most recent Windows CMD file: set var=%1 @echo %var:~0,-4% set abc= %var:~0,-4% cameron.cmd %abc% > From: inq1...@inqvista.com > To: sqlite-users@sqlite.org > CC: frank_chan...@hotmail.com > Subject:

Re: [sqlite] Is it possible to use substrings of Windows DOS batch fiile parameters in sqlite3.exe -line db ?

2012-04-11 Thread inq1ltd
On Tuesday, April 10, 2012 07:14:59 PM Frank Chang wrote: > Good evening, We are trying to generate automated SQLITE SQL scripts based > on the names of SQLite tables derived by substring manipulation of Windows > DOS batch file and/or Windows environment variables. For example: > > /*

Re: [sqlite] Is it possible to use substrings of Windows DOS batch fiile parameters in sqlite3.exe -line db ?

2012-04-11 Thread Gabor Grothendieck
On Tue, Apr 10, 2012 at 7:14 PM, Frank Chang wrote: > > Good evening, We are trying to generate automated SQLITE  SQL scripts based > on the names of SQLite tables derived by substring manipulation of Windows > DOS batch file and/or Windows environment variables. For

Re: [sqlite] Is it possible to use substrings of Windows DOS batch fiile parameters in sqlite3.exe -line db ?

2012-04-11 Thread Kees Nuyt
On Tue, 10 Apr 2012 19:14:59 -0400, Frank Chang wrote: > > Good evening, We are trying to generate automated > SQLITE SQL scripts based on the names of SQLite > tables derived by substring manipulation of Windows > DOS batch file and/or Windows environment variables.

[sqlite] Is it possible to use substrings of Windows DOS batch fiile parameters in sqlite3.exe -line db ?

2012-04-10 Thread Frank Chang
Good evening, We are trying to generate automated SQLITE SQL scripts based on the names of SQLite tables derived by substring manipulation of Windows DOS batch file and/or Windows environment variables. For example: /* mary.bat */ FOR /f %%a IN ('dir /b *.zip') DO CALL sub %%a /*

Re: [sqlite] Is it possible to reduce the number of times sqlite3BTreeMoveToUnpacked is called with an SQLITE C++ application?

2012-02-28 Thread Dan Kennedy
On 02/28/2012 04:29 PM, Frank Chang wrote: Good morning, We have a SQLITE C++ application which tries to find the intersection between the blobs in separate sqlite database tables(which we call subgraphs) ,containing record numbers. When we profile the code below we find that the top

[sqlite] Is it possible to reduce the number of times sqlite3BTreeMoveToUnpacked is called with an SQLITE C++ application?

2012-02-28 Thread Frank Chang
Good morning, We have a SQLITE C++ application which tries to find the intersection between the blobs in separate sqlite database tables(which we call subgraphs) ,containing record numbers. When we profile the code below we find that the top profiler user is sqlite3BTreeMoveToUnpacked. I have

[sqlite] Problem and possible Optimiziation with LOOKASIDE buffer

2012-02-09 Thread Scholz Maik (CM-AI/PJ-CF42)
Hi, I am working on an embedded application using SQLite. My lookaside configuration: sqlite3_db_config(mydbhandle, SQLITE_DBCONFIG_LOOKASIDE, 0, 64, 128); After doing some profiling, I saw that sqlite3DbMallocRaw does not allocate

Re: [sqlite] opinion on possible bad effects from detachingdatabase whilst statements prepared on it.

2011-10-17 Thread O'Neill, Owen
, October 17, 2011 1:32 PM To: General Discussion of SQLite Database Subject: Re: [sqlite] opinion on possible bad effects from detachingdatabase whilst statements prepared on it. On 17 Oct 2011, at 1:22pm, O'Neill, Owen wrote: > the application is distributed, so while it is running it &

Re: [sqlite] opinion on possible bad effects from detaching database whilst statements prepared on it.

2011-10-17 Thread Simon Slavin
On 17 Oct 2011, at 1:22pm, O'Neill, Owen wrote: > the application is distributed, so while it is running it > re-syncronises it's state with the server by recieving a copy of the > server's database. At this point it detaches it's current mounted > database and mounts the new file. It has a

[sqlite] opinion on possible bad effects from detaching database whilst statements prepared on it.

2011-10-17 Thread O'Neill, Owen
Hi Everyone, I'm trying to hunt down an awkard bug in a multi-threaded application so I was interested in people's opinions on whether the following is a likely problem scenario. - the application is distributed, so while it is running it re-syncronises it's state with the server by

Re: [sqlite] Is it possible to optimize this query on a very large database table

2011-10-13 Thread Frank Chang
Igor Tandetnik, >> How come you only show one function? A user-defined aggregate function is >> actually represented by two C[++] functions - one that is called for every >> row >> and performs actual aggregation, and another that's called at the end of >> each >> group, reports the result

Re: [sqlite] Is it possible to optimize this query on a very largedatabase

2011-10-12 Thread Igor Tandetnik
Frank Chang wrote: > void cIntersectingGroupCache::AGGREGATEBLOBFunc(sqlite3_context *context, int > argc, sqlite3_value **argv){ How come you only show one function? A user-defined aggregate function is actually represented by two C[++] functions - one that is

Re: [sqlite] Is it possible to optimize this query on a very large database

2011-10-12 Thread Frank Chang
Igor Tandetnik, I tried your suggestion insert or replace into BlobLastNameTest(rowid, FieldName, Vertices) select min(rowid), FieldName, AGGREGATEBLOB(Vertices,rowid,%d,\'%s\') from BlobLastNameTest group by FieldName", (The AGGREGATEBLOB C++ User Defined Function is shown at bottom of

Re: [sqlite] Is it possible to optimize this query on a very large database table

2011-10-11 Thread Igor Tandetnik
Frank Chang wrote: >The explain query plan for select FieldName, min(rowid) from > BlobLastNameTest group by FieldName shows a full index scan. Of course. How else do you expect to be able to look at every FieldName? You seem to be expecting some kind of a

Re: [sqlite] Is it possible to optimize this query on a very large database table

2011-10-11 Thread Frank Chang
Igor Tandetnik, The explain query plan for select FieldName, min(rowid) from BlobLastNameTest group by FieldName shows a full index scan, even after I run ANALYZE TABLE AND INDEX ON FIELDNAME, which could be problematic when the number of rows in BlobLastNameTest increases by a

Re: [sqlite] Is it possible to optimize this query on a very large database table Oct. 10, 2011 13:53:01 GMT

2011-10-10 Thread Frank Chang
Igor Tandetnik, >>> Explain the problem you are trying to solve, *not* your proposed solution. >>> <<< What we are trying to achieve is to to find the minimum row id for each unique Field Name in BLobLastNameTest where many rows can have the same FIELDNAME but distinct

Re: [sqlite] Is it possible to optimize this query on a very large database table.

2011-10-10 Thread Igor Tandetnik
Frank Chang wrote: > Igor Tandetnik, > The fieldname groups in our BlobLastNameTable consist of > multiple rows where each pair of columns [FieldName, > BLOB[Vertices]] is unique. How so? You have FieldName declared as PRIMARY KEY. From

Re: [sqlite] Is it possible to optimize this query on a very large database table.

2011-10-10 Thread Frank Chang
Igor Tandetnik, The fieldname groups in our BlobLastNameTable consist of multiple rows where each pair of columns [FieldName, BLOB[Vertices]] is unique. Therefore, every fieldname group does not just have a single row but instead 1000's or 1's rows. So that is why we use

Re: [sqlite] Is it possible to optimize a query on a very large database table?

2011-10-10 Thread Igor Tandetnik
Frank Chang wrote: > Florian Weimar and Igor Tadetnik, > > When I replace the GROUP BY t1.FIELDNAME with ORDER BY 1, > > select t1.FieldName,t1.rowid from BlobLastNameTest t1 where t1.r > owid = (SELECT MIN(rowid) FROM BlobLastNameTest where FieldName = >

Re: [sqlite] Is it possible to optimize this query on a very large datatabase table

2011-10-10 Thread Igor Tandetnik
Frank Chang wrote: > So, why is my query just working accidently? I take it back - the behavior of your query is well-defined, for the simple reason that FieldName is unique, so every group only has a single row in it (as someone else has kindly pointed out - I

Re: [sqlite] Is it possible to optimize a query on a very large database table?

2011-10-10 Thread Frank Chang
Florian Weimar and Igor Tadetnik, When I replace the GROUP BY t1.FIELDNAME with ORDER BY 1, select t1.FieldName,t1.rowid from BlobLastNameTest t1 where t1.r owid = (SELECT MIN(rowid) FROM BlobLastNameTest where FieldName = t1.FIELDNAME) order by 1; the explain output seems to have 40%

Re: [sqlite] Is it possible to optimize a very large database query by avoiding total index scans

2011-10-10 Thread Frank Chang
Florence Weimar, Igor Tadetnik, Simon Slavin, I ran ANALYZE BLOBLASTNAMETEST in order to get better index statistics. Then I modified my query to: select t1.FieldName,t1.rowid from BlobLastNameTest t1 where t1.rowid = (SELECT MIN(rowid) FROM BlobLastNameTest where FieldName =

Re: [sqlite] Is it possible this optimize query on a very large database table

2011-10-09 Thread Frank Chang
Florian Weimer, >>A better query needs support for DISTINCT ON, which SQLite lacks >>AFAIK. But speed will obviously be limited because you cannot avoid >>traversing the index for the whole table. I read your email and found it to be very interesting. PostgresSQL supports DISTINCT ON.

Re: [sqlite] Is it possible to optimize this query on a very large datatabase table

2011-10-09 Thread Frank Chang
Igor Tandetnik, Here is a comparison of my query plan with your query plan on the latest version of sqlite. sqlite> explain query plan select FieldName, min(rowid) from BlobLastNameTest group by FieldName; 0|0|0|SCAN TABLE BlobLastNameTest USING COVERING INDEX claramary (~100 rows)

Re: [sqlite] Is is possible to optimize this query on a very large datatbase table?‏

2011-10-09 Thread Simon Slavin
On 10 Oct 2011, at 12:37am, Frank Chang wrote: > Simon Slavin, Here is the schema which I used. CREATE TABLE > [BlobLastNameTest] ([FieldName] CHAR (25), [Vertices] BLOB ) Okay. That's not what you posted originally. Okay so we have CREATE TABLE BlobLastNameTest (FieldName TEXT PRIMARY KEY,

Re: [sqlite] Is is possible to optimize this query on a very large datatbase table?‏

2011-10-09 Thread Frank Chang
Simon Slavin, Here is the schema which I used. CREATE TABLE [BlobLastNameTest] ([FieldName] CHAR (25), [Vertices] BLOB ) With this schema it is possible to have multiple rows with the same FieldName. This is intentional since I am writing a Windows and Linux C++ multithreaded application

Re: [sqlite] Is is possible to optimize this query on a very large datatbase table?

2011-10-09 Thread Simon Slavin
On 9 Oct 2011, at 4:13pm, Frank Chang wrote: > CREATE TABLE [BlobLastNameTest] ([FieldName] CHAR (25) PRIMARY KEY, > [Vertices] BLOB ) This form CREATE TABLE BlobLastNameTest (FieldName TEXT PRIMARY KEY, Vertices BLOB) does exactly the same in SQLite. >

Re: [sqlite] Is is possible to optimize this query on a very large datatbase table?

2011-10-09 Thread Florian Weimer
* Frank Chang: > This table could potentially hold 10 to 40 million rows. We are > using the following query to obtain the minumum rowid for each > unique LastName: > > sqlite> explain query plan select t1.FieldName,t1.rowid from BlobLastNameTest > t1 > GROUP BY t1.FIELDNAME HAVING t1.rowid =

Re: [sqlite] Is is possible to optimize this query on a very large datatbase table?

2011-10-09 Thread Igor Tandetnik
Frank Chang wrote: > Hi, We are using the following schema : > CREATE TABLE [BlobLastNameTest] ([FieldName] CHAR (25) PRIMARY KEY, > [Vertices] BLOB ) > > index|sqlite_autoindex_BlobLastNameTest_1|BlobLastNameTest|3| > > > This table could potentially hold 10 to 40

[sqlite] Is is possible to optimize this query on a very large datatbase table?

2011-10-09 Thread Frank Chang
Hi, We are using the following schema : CREATE TABLE [BlobLastNameTest] ([FieldName] CHAR (25) PRIMARY KEY, [Vertices] BLOB ) index|sqlite_autoindex_BlobLastNameTest_1|BlobLastNameTest|3| This table could potentially hold 10 to 40 million rows. We are using the following query to obtain

Re: [sqlite] Is it possible to multithread the conversion of MySQLite database table to the SQLite database

2011-09-03 Thread Frank Chang
Kees Nuyt, Thank you for very impressive and excellent reply to our question. I will show it to my boss and ask him for the data necessary to answer your question. I will also ask my boss , who is a director of product development, whether he will allow us to try to implement your producer

Re: [sqlite] Is it possible to multithread the conversion of MySQLite database table to the SQLite database?

2011-09-03 Thread Kees Nuyt
Hi Frank, On Sat, 3 Sep 2011 02:55:17 -0400, Frank Chang wrote: > Good morning, > > Is it possible to multithread the conversion of MySQLite > database table to the SQLite database? Dr. Richard Hipp > said in a post recently that at that time it was not to >

[sqlite] Is it possible to multithread the conversion of MySQLite database table to the SQLite database?

2011-09-03 Thread Frank Chang
Good morning, Is it possible to multithread the conversion of MySQLite database table to the SQLite database? Dr. Richard Hipp said in a post recently that at that time it was not to multithread SQLite database connections to the same database. Dr. Hipp suggested that we use MYSQL to do

Re: [sqlite] Is it possible to check a data type in a query?

2011-07-15 Thread Amit Chaudhuri
Perfect - thank you both.. On Thu, Jul 14, 2011 at 12:15 PM, Simon Slavin wrote: > > On 13 Jul 2011, at 1:13pm, Amit Chaudhuri wrote: > > > I have situation where a column may contain prices (REAL) or a string > > meaning "no price for this, sorry." I can handle this in

Re: [sqlite] Is it possible to check a data type in a query?

2011-07-14 Thread Simon Slavin
On 13 Jul 2011, at 1:13pm, Amit Chaudhuri wrote: > I have situation where a column may contain prices (REAL) or a string > meaning "no price for this, sorry." I can handle this in application code > but was wondering if I am overlooking a Sqlite feature which might do the > same out of the box:

Re: [sqlite] Is it possible to check a data type in a query?

2011-07-14 Thread Richard Hipp
On Wed, Jul 13, 2011 at 8:13 AM, Amit Chaudhuri wrote: > Hi all, > > I have situation where a column may contain prices (REAL) or a string > meaning "no price for this, sorry." I can handle this in application code > but was wondering if I am overlooking a Sqlite

[sqlite] Is it possible to check a data type in a query?

2011-07-14 Thread Amit Chaudhuri
Hi all, I have situation where a column may contain prices (REAL) or a string meaning "no price for this, sorry." I can handle this in application code but was wondering if I am overlooking a Sqlite feature which might do the same out of the box: perhaps a TYPE( ) or an IsText( ) function..? A

Re: [sqlite] Slow rollback - possible causes?

2011-06-08 Thread Richard Hipp
On Tue, Jun 7, 2011 at 10:03 PM, Eric Sigler wrote: > We haven't watched the WAL continuously, but we have noticed that the > WAL file grows slowly in size over time between application restarts > (around every 2 weeks). Currently, the WAL file for one of our DBs is >

Re: [sqlite] Slow rollback - possible causes?

2011-06-08 Thread Richard Hipp
On Tue, Jun 7, 2011 at 9:02 PM, Eric Sigler wrote: > Hello! > > Does anyone know of a reason why we might be seeing SQLite transaction > rollbacks that take between 60 and 240 seconds? (One particularly odd > occurrence was almost 20 minutes long!) This doesn't seem to

Re: [sqlite] Slow rollback - possible causes?

2011-06-07 Thread Pavel Ivanov
> We're issuing "PRAGMA > wal_checkpoint" to the open DB handle. If you want guaranteed finish of the checkpoint (and thus not growing WAL-file) you need to issue "PRAGMA wal_checkpoint(RESTART)". Pavel On Tue, Jun 7, 2011 at 10:36 PM, Eric Sigler wrote: > So, should

Re: [sqlite] Slow rollback - possible causes?

2011-06-07 Thread Eric Sigler
So, should the WAL file shrink back to 0 then? We're issuing "PRAGMA wal_checkpoint" to the open DB handle. -Eric On Tue, Jun 7, 2011 at 7:06 PM, Pavel Ivanov wrote: >> (Actually, that was another general question we had, should that WAL >> file ever shrink during use?  Why

Re: [sqlite] Slow rollback - possible causes?

2011-06-07 Thread Pavel Ivanov
> (Actually, that was another general question we had, should that WAL > file ever shrink during use?  Why would it grow to that size at all?) It shrinks, when the full checkpoint is completed successfully. Until then it grows. Pavel On Tue, Jun 7, 2011 at 10:03 PM, Eric Sigler

<    1   2   3   4   5   >