Re: [sqlite] Mod_sqlite install on Apache 2.2.15 using yum question

2012-07-12 Thread Rose, John B
27;t need anything extra. Or point me to something to read specific to that topic? Thanks for replying John ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

[sqlite] Mod_sqlite install on Apache 2.2.15 using yum question

2012-07-12 Thread Rose, John B
On a Red Hat server I am a bit new to yum but have successfully installed a few things. Including mod_perl, mod_python I have tried to unsuccessfully install mod_sqlite yum install mod_sqlite Loaded plugins: product-id, rhnplugin, subscription-manager Updating certificate-based repositori

Re: [sqlite] Problem with including sqlite3.c into c++ project

2012-06-25 Thread John Drescher
ith Visual Studio from time to time (not with sqlite but I use that with Qt): Delete Debug\Contegos_UI.pch and try again. John ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] SQLite and C++

2012-06-13 Thread John Drescher
u want Qt comes with a bundled sqlite that it uses with its C++ database classes. John ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] system.data.sqlite 1.0.81.0 - .edmx creation issue

2012-06-09 Thread John Gillespie
This works as expected for me. What version are you using? Did you set the pragma each time? What do you mean by ".edmx" John G % sqlite3 test.db SQLite version 3.7.7 2011-06-25 16:35:41 pragma foreign_keys=1; CREATE TABLE Lesson ( id INTEGER PRIMARY KEY AUTOINCREMENT, titl

Re: [sqlite] Disk file size

2012-06-06 Thread John Drescher
ile size and it is same as 57kb. > So my question is, why does the file size is not decreased after deleting > the rows? > Is it like the SQLite will reuse the disk space later or something? > Please let me know about this Issue the VACUUM statement to compact the

Re: [sqlite] don't understand what "query" returns...

2012-05-12 Thread John Gillespie
You need something like : query = "select Item1,Item2,Item3, count(*) from %s where Item55 in (%s) *group by Item1,Item2,Item3*" JG On 12 May 2012 10:24, philherna wrote: > > Hi, > > > I am using sqlite commands in my python script to output data from a sqlite > database. My problem is however

Re: [sqlite] SQLite Tcl Extension

2012-05-09 Thread John Gillespie
No: here is info from my mac - Mac OSX (run in terminal) : ~ 596 % sqlite3 test.db SQLite version 3.7.7 2011-06-25 16:35:41 Enter ".help" for instructions Enter SQL statements terminated with a ";" sqlite> .e ~ 597 % wish % set tcl_version 8.5 % package require sqlite3 3.7.5 % exit As you can s

[sqlite] Bug: Increment unique integer field

2012-05-07 Thread John Yani
In an SQL statement that inserts, deletes, or updates many rows, SQLite as well as MySQL InnoDB checks UNIQUE and FOREIGN KEY constraints row-by-row. According to the SQL standard, the default behavior should be deferred checking. http://stackoverflow.com/questions/7703196/sqlite-increment-unique-i

Re: [sqlite] SQLITE3 64-bit version

2012-04-23 Thread John Drescher
> Would you know if SQLITE3 can be compiled (and if it will work) as a 64-bit > DLL? > I use SQLITE as a 64 bit dll on windows. However for me it is included with the Qt library. John ___ sqlite-users mailing list sqlite-users@sqlite

Re: [sqlite] "DEFAULT BOOLEAN NOT NULL" not working with entityframework

2012-04-19 Thread John
d start looking at the ADO code. -j -- Regards John McMahon li...@jspect.fastmail.fm ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] SQLite Exception 14

2012-04-12 Thread FLOWERDAY John
: [sqlite] SQLite Exception 14 On Thu, Apr 12, 2012 at 4:22 PM, FLOWERDAY John wrote: > right after the first table, I get an SQLiteException 14. I have > searched the web and have found zero answers to this. I also cannot > find an answer on the SQLite site. Any suggestions? > [stepha

[sqlite] SQLite Exception 14

2012-04-12 Thread FLOWERDAY John
SQLiteException 14. I have searched the web and have found zero answers to this. I also cannot find an answer on the SQLite site. Any suggestions? John ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo

Re: [sqlite] Importing date string 'YYYYMMDD'

2012-04-06 Thread John
On 02/04/2012 5:20 AM, Simon Slavin wrote: On 1 Apr 2012, at 6:59am, John McMahon wrote: Thanks Igor (and Simon) That is pretty much the path I was thinking of taking (or possibly externally as I import the data), was just wondering if I had missed something in the date functions

Re: [sqlite] Importing date string 'YYYYMMDD'

2012-04-01 Thread John McMahon
On 01/04/2012 12:34 PM, Igor Tandetnik wrote: John wrote: Can the date time functions in SQLite correctly interpret a date string like '20120331'? No. Recognized formats are documented here: http://sqlite.org/lang_datefunc.html Is there a format or modifier that will help th

[sqlite] Importing date string 'YYYYMMDD'

2012-03-31 Thread John
rking out other solutions. John -- Regards John McMahon li...@jspect.fastmail.fm ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Primary Key uniqueness

2012-03-29 Thread John Gillespie
Try omitting 'rowid' - you are not grouping by it and if you did it is unique so no dups. select Column_1,Column_27,Column_47 , count(*) from old_table group by Column_1,Column_27,Column_47 having count(*) > 1 JG On 29 March 2012 17:27, Joe Bennett wrote: > Hi, > > I have

Re: [sqlite] What's the best way to organize this database?

2012-03-11 Thread John Salerno
Thanks so much for all the advice and information! I think I can get started now! :) On Sat, Mar 10, 2012 at 6:36 PM, Simon Slavin wrote: > > On 9 Mar 2012, at 4:00pm, John Salerno wrote: > >> On Fri, Mar 9, 2012 at 7:29 AM, Simon Slavin wrote: >> >>> Sooner or

Re: [sqlite] What's the best way to organize this database?

2012-03-10 Thread John Salerno
On Fri, Mar 9, 2012 at 7:29 AM, Simon Slavin wrote: > Sooner or later you're going to want to make a list which is sorted in artist > order.  And you're going to want to list 'The Beatles' (if you have any taste > at all).  But if you list artists in name order they'd come in the Ts, not > the

Re: [sqlite] What's the best way to organize this database?

2012-03-09 Thread John Salerno
On Mar 8, 7:46 am, Simon Slavin wrote: > Yes, this would be the 'normalised' form.  Something like > > artists: id, name, sortOrder > songs: id, artistID, title > plays: id, songID, playDate, playTime Ok, between you and Larry's last post, it's starting to make a lot more sense (except I don't i

Re: [sqlite] What's the best way to organize this database?

2012-03-08 Thread John Salerno
On Mar 7, 7:33 am, Simon Slavin wrote: > I don't understand the purpose of the table you originally described.  If you > are listing the same tracks again and again, listing different times it was > played, then it would be useful to have three tables (artists, tracks, > plays). If each trac

[sqlite] GUI for SQLite

2012-03-07 Thread Rose, John B
We are new to SQLite and have experimented with a few GUIs, Firefox plugin, SQLite DB Browser, and Navicat. Is there a single GUI that is considered the best, with the most features? Thanks ___ sqlite-users mailing list sqlite-users@sqlite.org http://s

Re: [sqlite] What's the best way to organize this database?

2012-03-07 Thread John Salerno
Thanks to both of you. The question of normalization was one thing I was considering, I just wasn't sure how it should be done. A separate table with Artist ID and Artist Name fields could be useful. Would it be good to make an equivalent table for the songs, or should the songs simply be liste

Re: [sqlite] What do people think of SQLite Root?

2012-03-06 Thread John Drescher
) Python Version: 2.7.2 (default, Jun 12 2011, 15:08:59) [MSC v.1500 32 bit (Intel)] wxPython Version: 2.8.12.1 (msw-unicode) wxPython Info: (__WXMSW__, wxMSW, unicode, wx-assertions-on, SWIG-1.3.29) Python Encoding: Default=ascii File=mbcs wxPython Encoding: cp1252 System Architecture: 32bi

[sqlite] What's the best way to organize this database?

2012-03-06 Thread John Salerno
Hi all. I'm very new to all of this, so I'm not necessarily looking for over-the-top advice, although anything you tell me will be appreciated. I just want to create a simple script (in Python, using sqlite3) that reads a "|" delineated text file and extracts the following bits of information f

Re: [sqlite] Manual

2012-03-03 Thread John Drescher
nd some special features. > It also has a number of really weird diagrammes. > > How do I read diagrammes like http://sqlite.org/images/syntax/sql-stmt.gif ? > Are you a programmer? That diagram is very basic and should be easy to understand if you took university level comp

Re: [sqlite] Interchangeably using SQLite .db file between desktop and android mobile device

2012-03-02 Thread Rose, John B
vice, gather samples somewhere in field and occasionally change/add/delete data. Come back to the lab and download the latest version of the database. Then the lab staff uses the new updated version until you go out again and repeat that sequence. John On 3/2/12 2:17 PM, "Simon Slavin" w

Re: [sqlite] Interchangeably using SQLite .db file between desktop and android mobile device

2012-03-02 Thread Rose, John B
ce the original on their desktop. Thanks On 3/2/12 12:52 PM, "Roger Binns" wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > [I reordered your message in my response] > > On 02/03/12 08:59, Rose, John B wrote: >> I had assumed we just moved the .

Re: [sqlite] Interchangeably using SQLite .db file between desktop and android mobile device

2012-03-02 Thread Rose, John B
tting it back on the desktop with the new data while it was on Android would be good to see. Thanks John On 3/2/12 11:38 AM, "Pavel Ivanov" wrote: >> Is there an example(s?) of a step-by-step for moving/using an SQLite .db file >> interchangeably between a desktop and an Androi

[sqlite] Interchangeably using SQLite .db file between desktop and android mobile device

2012-03-02 Thread Rose, John B
? Thanks John ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

[sqlite] Yum install of PHP not including sqlite3

2012-03-01 Thread Rose, John B
Hello We are running Red Hat 6.2 with PHP 5.3.3 installed via yum Among other things in the ./configure section I see '--without-sqlite3' However, via phpinfo() we see a section ... sqlite3 SQLite3 supportenabled SQLite3 module version0.7-dev SQLite Library3.6.20 DirectiveLoc

Re: [sqlite] Column names including spaces

2012-02-22 Thread John Drescher
in > the error message". > Are you escaping the quotes for whatever language / tool you are using so they are passed to SQLITE? John ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Is there any API for counting number of rows in a particular table.

2012-01-31 Thread John Elrick
bug fixes. > Meanwhile you could give me some feedback such as opening a file with any > extension by entering *.* in the filename of the FileDialog. > Common extensions I've seen used for SQLite: .sqlite .db .db3 Cheers, John ___ sqlite-users

Re: [sqlite] Found it

2012-01-26 Thread John Elrick
rarely follow > threads which don't directly affect me, but John Elrick's determination and > stamina have been a treat to watch. IMO he should be made an honorary > member of the dev team (or at least get a coffee mug). > > Thank you. You made my day. __

Re: [sqlite] Found it

2012-01-26 Thread John Elrick
On Thu, Jan 26, 2012 at 3:29 AM, Jean-Denis MUYS wrote: > > On 25 janv. 2012, at 22:30, John Elrick wrote: > > > > > I have to say this has been a fascinating learning experience. It has > been > > enlightening reading the SQLite code and beginning to under

Re: [sqlite] Found it

2012-01-25 Thread John Elrick
workings. I feel significantly more confident in the solidity of our code base and am very grateful that we chose SQLite as our database years ago. I doubt I would have had this much cooperation from the Chief Scientist with any other product. John ___

Re: [sqlite] Found it

2012-01-25 Thread John Elrick
On Wed, Jan 25, 2012 at 4:07 PM, Richard Hipp wrote: > On Wed, Jan 25, 2012 at 4:01 PM, John Elrick >wrote: > > > Much better. I wasn't sure which version to incorporate the changes into > > (the link is to the source), so I put them into 3.7.9. > > > >

Re: [sqlite] Found it

2012-01-25 Thread John Elrick
Thanks. On Wed, Jan 25, 2012 at 4:11 PM, Petite Abeille wrote: > > On Jan 25, 2012, at 10:09 PM, John Elrick wrote: > > > DML? > > http://en.wikipedia.org/wiki/Data_Manipulation_Language > > > ___ > sqlite-users maili

Re: [sqlite] Found it

2012-01-25 Thread John Elrick
On Wed, Jan 25, 2012 at 4:07 PM, Richard Hipp wrote: > On Wed, Jan 25, 2012 at 4:01 PM, John Elrick >wrote: > > > Much better. I wasn't sure which version to incorporate the changes into > > (the link is to the source), so I put them into 3.7.9. > > > >

Re: [sqlite] Found it

2012-01-25 Thread John Elrick
__ > sqlite-users mailing list > sqlite-users@sqlite.org > http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users > -- John Elrick Fenestra Technologies 540-868-1377 ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Found it

2012-01-25 Thread John Elrick
Richard, I've found a problem that I don't understand. Looking at the case OP_VerifyCookie, I attempted to output pOp->opcode, which I expected to equal OP_VerifyCookie. However, it doesn't: Schema has changed current state = 'db=0025, pOp->opCode=66785672, db->aDb[pOp->p1].pSchema=02110AB

Re: [sqlite] Found it

2012-01-25 Thread John Elrick
Richard, Is it reasonable to say that, assuming: 1. The schema has not changed 2. There is only one connection to the database that the value of iGeneration should always equal pOp->p3 in OP_VerifyCookie? ___ sqlite-users mailing list sqlite-users@sq

Re: [sqlite] Found it

2012-01-25 Thread John Elrick
On Wed, Jan 25, 2012 at 1:13 PM, Richard Hipp wrote: > On Wed, Jan 25, 2012 at 10:18 AM, John Elrick >wrote: > > > > > I do have some more information for you. I tracking everything which > could > > call reset and discovered that all of these are stemming f

Re: [sqlite] Found it

2012-01-25 Thread John Elrick
Addendum On Wed, Jan 25, 2012 at 1:12 PM, John Elrick wrote: > On Wed, Jan 25, 2012 at 9:50 AM, Richard Hipp wrote: > >> On Wed, Jan 25, 2012 at 9:02 AM, John Elrick > >wrote: >> >> > >> > current state = 'db=03FB1188, db->aDb[pOp-&g

Re: [sqlite] Found it

2012-01-25 Thread John Elrick
On Wed, Jan 25, 2012 at 9:50 AM, Richard Hipp wrote: > On Wed, Jan 25, 2012 at 9:02 AM, John Elrick >wrote: > > > > > current state = 'db=03FB1188, db->aDb[pOp->p1].pSchema=02110AB0, > > db->aDb[pOp->p1].pSchema->schema_cookie=27, > > db

Re: [sqlite] Found it

2012-01-25 Thread John Elrick
Ok. Possible scenario. I can't prove it, but somebody tell me if this is what could be going on: prepare query1 prepare query2 create something -> schema change query1.step - schema invalid so recreate - recreation of schema changes the generation query2.step - schema invalid so recreate

Re: [sqlite] Found it

2012-01-25 Thread John Elrick
On Wed, Jan 25, 2012 at 10:32 AM, Simon Slavin wrote: > > On 25 Jan 2012, at 3:18pm, John Elrick wrote: > > > So, it appears that something is making SQLite think the schema has > changed. > > Can you read the following: > > <http://www.sqlite.org/pragma.html#

Re: [sqlite] Found it

2012-01-25 Thread John Elrick
On Wed, Jan 25, 2012 at 9:50 AM, Richard Hipp wrote: > On Wed, Jan 25, 2012 at 9:02 AM, John Elrick >wrote: > > > > > current state = 'db=03FB1188, db->aDb[pOp->p1].pSchema=02110AB0, > > db->aDb[pOp->p1].pSchema->schema_cookie=27, > > db

Re: [sqlite] Found it

2012-01-25 Thread John Elrick
invoked. Whatever is resetting the internal schema isn't coming from here. On Wed, Jan 25, 2012 at 9:02 AM, John Elrick wrote: > > On Tue, Jan 24, 2012 at 7:46 PM, Richard Hipp wrote: > >> On Tue, Jan 24, 2012 at 7:37 PM, John Elrick > >wrote: >> >> > >> &

Re: [sqlite] Found it

2012-01-25 Thread John Elrick
On Tue, Jan 24, 2012 at 7:46 PM, Richard Hipp wrote: > On Tue, Jan 24, 2012 at 7:37 PM, John Elrick >wrote: > > > > > It appears that the value is set here: > > > > u.av.pBt = db->aDb[pOp->p1].pBt; > > if( u.av.pBt ){ > >sqlit

Re: [sqlite] Found it

2012-01-25 Thread John Elrick
On Wed, Jan 25, 2012 at 8:02 AM, Richard Hipp wrote: > On Wed, Jan 25, 2012 at 7:53 AM, John Elrick >wrote: > > > I started with the place where iGeneration was being changed and found > > nothing out of the ordinary. I started an examination and noticed the > > foll

Re: [sqlite] Found it

2012-01-25 Thread John Elrick
...especially given that the results of sqlite3SchemaClear are being passed as a parameter and from the declaration, sqlite3SchemaClear doesn't return anything. On Wed, Jan 25, 2012 at 7:53 AM, John Elrick wrote: > I started with the place where iGeneration was being changed and found &

Re: [sqlite] Found it

2012-01-25 Thread John Elrick
Init(&p->tblHash); sqlite3HashInit(&p->idxHash); sqlite3HashInit(&p->trigHash); sqlite3HashInit(&p->fkeyHash); p->enc = SQLITE_UTF8; } return p; } On Tue, Jan 24, 2012 at 7:46 PM, Richard Hipp wrote: > On Tue, Jan 24, 2012 at 7:37 PM, John Elri

Re: [sqlite] Found it

2012-01-24 Thread John Elrick
On Tue, Jan 24, 2012 at 7:26 PM, Richard Hipp wrote: > On Tue, Jan 24, 2012 at 7:18 PM, John Elrick >wrote: > SNIP > So the problem was introduced by > > http://www.sqlite.org/src/info/36c04dd1695f08 > > Which is the fix for this bug: > > http://www.sqli

Re: [sqlite] Found it

2012-01-24 Thread John Elrick
I really found it this time. While I was looking over the code changes, I noticed a section of code dealing with case OP_VerifyCookie: Inside that section is the following in 3.7.6 if( u.av.iMeta!=pOp->p2 || u.av.iGen!=pOp->p3 ){ sqlite3DbFree(db, p->zErrMsg); p->zErrMsg = sqlite3DbStr

Re: [sqlite] Found it

2012-01-24 Thread John Elrick
Let me rephrase that... I ran this test with a small case. See results below. On Tue, Jan 24, 2012 at 5:55 PM, John Elrick wrote: SNIP > > http://www.sqlite.org/fenstra/sqlite-201102040051.zip >> > > Low malloc count > 8,191 calls to malloc (consistent with 3

Re: [sqlite] Found it

2012-01-24 Thread John Elrick
On Tue, Jan 24, 2012 at 5:36 PM, Richard Hipp wrote: > On Tue, Jan 24, 2012 at 5:21 PM, John Elrick >wrote: > > > On Tue, Jan 24, 2012 at 3:05 PM, Richard Hipp wrote: > > > > > > > > OK. Please try these: > > > > > > http://www.sqlit

Re: [sqlite] Found it

2012-01-24 Thread John Elrick
On Tue, Jan 24, 2012 at 3:05 PM, Richard Hipp wrote: > On Tue, Jan 24, 2012 at 1:28 PM, John Elrick >wrote: > > > > > > > > http://www.sqlite.org/fenstra/sqlite-201103081639.zip > > > > > > This one gives the high number of mallocs just as doe

Re: [sqlite] Found it

2012-01-24 Thread John Elrick
Nope and nope. They are happening apparently out of the blue. On Jan 24, 2012 2:40 PM, "Nico Williams" wrote: > Maybe a view is getting materialized, or a some other temp table's > creation under the hood is triggering this? > ___ > sqlite-users mailin

Re: [sqlite] Found it

2012-01-24 Thread John Elrick
On Tue, Jan 24, 2012 at 12:53 PM, Richard Hipp wrote: > On Tue, Jan 24, 2012 at 12:15 PM, John Elrick >wrote: > > > > > > > Can you put a breakpoint on sqlite3ResetInternalSchema() and figure out > > > from whence it is being called so often? > > > &

Re: [sqlite] Found it

2012-01-24 Thread John Elrick
On Tue, Jan 24, 2012 at 1:28 PM, John Elrick wrote: SNIP http://www.sqlite.org/fenstra/sqlite-201103241737.zip > > > This one is failing to compile. It needs _msize. That sounds like the > 3.7.10 issue reported recently. > > I opened the sqlite3.c file and it

Re: [sqlite] Found it

2012-01-24 Thread John Elrick
suggestion. We do not have, nor have any intention of using, Visual Studio. It's also not a DLL, the resulting output is a Borland OBJ, which cannot be generated correctly from any other compiler. John ___ sqlite-users mailing list sqlite-u

Re: [sqlite] Found it

2012-01-24 Thread John Elrick
On Tue, Jan 24, 2012 at 12:53 PM, Richard Hipp wrote: > On Tue, Jan 24, 2012 at 12:15 PM, John Elrick >wrote: > > SNIP > http://www.sqlite.org/fenstra/sqlite-201103081639.zip This one gives the high number of mallocs just as does 3.7.6. > > http://www.sqli

Re: [sqlite] Found it

2012-01-24 Thread John Elrick
On Tue, Jan 24, 2012 at 1:18 PM, Dan Kennedy wrote: > On 01/25/2012 12:15 AM, John Elrick wrote: > >> On Tue, Jan 24, 2012 at 12:06 PM, Richard Hipp wrote: >> >> On Tue, Jan 24, 2012 at 11:59 AM, John >> Elrick >>> >>>> wrote: >>>&g

Re: [sqlite] Found it

2012-01-24 Thread John Elrick
On Tue, Jan 24, 2012 at 12:06 PM, Richard Hipp wrote: > On Tue, Jan 24, 2012 at 11:59 AM, John Elrick >wrote: > > > While reviewing our other thread, I noticed a piece of information > > concerning sqlite3ResetInternalSchema. Based on the number of times > that I

Re: [sqlite] Found it

2012-01-24 Thread John Elrick
While reviewing our other thread, I noticed a piece of information concerning sqlite3ResetInternalSchema. Based on the number of times that I reported it had been called, I believe that something was changed between 3.7.5 and 3.7.6 which causes sqlite3ResetInternalSchema to be called when it wasn'

Re: [sqlite] Found it

2012-01-24 Thread John Elrick
Addendum. After looking further it appears that the reparsing is happening independently of triggering. In this case, the reparsing occurs 30,502 times for every view and trigger I have examined. Only one trigger appears in the 3.7.5 listing and it is parsed exactly 1 time. 3.7.5 CREATE TRIGGE

[sqlite] Found it

2012-01-24 Thread John Elrick
Richard, Your last request for some detailed information about what queries were being processed did the trick. Here is a description of the problem (and yes, it appears to be in SQLite). In 3.7.5, the number one malloc consumer is INSERT INTO SEQUENCE_ELEMENTS ( SEQUENCE_ELEMENT_OID, SEQUENCE_

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-23 Thread John Elrick
On Mon, Jan 23, 2012 at 4:27 PM, Nico Williams wrote: > On Mon, Jan 23, 2012 at 3:02 PM, John Elrick > wrote: > > I think I can inject something to do some measurements. I seem to > recall, > > however, that there was no substantive difference in the number of > > tim

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-23 Thread John Elrick
On Mon, Jan 23, 2012 at 3:48 PM, Richard Hipp wrote: > On Mon, Jan 23, 2012 at 3:12 PM, John Elrick >wrote: > > > Brain hurts... > > > > Richard, more information for you. I rebuilt the call stack checking > > system into pure Delphi and confirmed that yy_re

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-23 Thread John Elrick
Brain hurts... Richard, more information for you. I rebuilt the call stack checking system into pure Delphi and confirmed that yy_reduce appears to be the malloc culprit. I further created a pair of procedures which I can use to track the yyruleno from yy_reduce as though it were a call. Below

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-22 Thread John Elrick
to SQLite and any > pure examination of SQLite's behaviour isn't going to spot anything, right > ? So a better place to query this would be a Delphi list ? > > Simon. > ___ > sqlite-users mailing list > sqlite-users@sqlite.org

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-21 Thread John Elrick
ifestation. As frustrating as it has been to narrow down the cause, I have nothing but respect and gratitude for everyone who has attempted to help. Thank you all. On Jan 20, 2012 3:47 PM, "Richard Hipp" wrote: > On Fri, Jan 20, 2012 at 3:40 PM, John Elrick >wrote: > > > I

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-20 Thread John Elrick
n Fri, Jan 20, 2012 at 2:55 PM, John Elrick wrote: > The problem is not in the queries. The problem is in a two order of > magnitude increase in _mallocs between the versions. The _mallocs are > coming from sqlite3Parser. > > > On Fri, Jan 20, 2012 at 2:37 PM, Max Vlasov wrote:

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-20 Thread John Elrick
The problem is not in the queries. The problem is in a two order of magnitude increase in _mallocs between the versions. The _mallocs are coming from sqlite3Parser. On Fri, Jan 20, 2012 at 2:37 PM, Max Vlasov wrote: > On Fri, Jan 20, 2012 at 10:05 PM, John Elrick >wrote: > >

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-20 Thread John Elrick
The change which results in a slow down occurred between 3.7.5.0 and 3.7.6.0. On Fri, Jan 20, 2012 at 8:34 AM, John Elrick wrote: > Thank you sir. I'll start looking. > > > On Fri, Jan 20, 2012 at 8:27 AM, Richard Hipp wrote: > >> On Fri, Jan 20, 2012 at 8:1

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-20 Thread John Elrick
Thank you sir. I'll start looking. On Fri, Jan 20, 2012 at 8:27 AM, Richard Hipp wrote: > On Fri, Jan 20, 2012 at 8:14 AM, John Elrick >wrote: > > > I asked in an earlier posting if the amalgamations were available > > somewhere. > > > > > > http:/

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-20 Thread John Elrick
the point where everything changed. On Thu, Jan 19, 2012 at 11:37 PM, Max Vlasov wrote: > John, another suggestion > > Can you test previous sqlite versions one by one towards older ones with > one of your problem queries until the results are "good" again and send > bot

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-19 Thread John Elrick
One more useful comparison. The following query is prepared and step is called with these results: step: UPDATE RESPONSES SET RESPONSE_NAME = :RESPONSE_NAME WHERE RESPONSE_OID = :RESPONSE_OID Cumulative Allocated Memory: 10,992 Count of _malloc Calls:18 Cumulati

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-19 Thread John Elrick
On Thu, Jan 19, 2012 at 11:49 AM, John Elrick wrote: > I've added more tracking to our libraries. Most queries result in minimal > (<200 calls) _malloc activity, But I have found several anomalies. I am > listing some representatives below. In the examples below, "st

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-19 Thread John Elrick
I've added more tracking to our libraries. Most queries result in minimal (<200 calls) _malloc activity, But I have found several anomalies. I am listing some representatives below. In the examples below, "step" is the operation. Note also that all queries should have been prepared with sqlite3

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-19 Thread John Elrick
On Thu, Jan 19, 2012 at 8:25 AM, John Elrick wrote: > > > On Thu, Jan 19, 2012 at 8:15 AM, Richard Hipp wrote: > >> On Thu, Jan 19, 2012 at 8:10 AM, John Elrick > >wrote: >> >> > >> > I've been reading through the code. Do I understand correc

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-19 Thread John Elrick
On Thu, Jan 19, 2012 at 8:15 AM, Richard Hipp wrote: > On Thu, Jan 19, 2012 at 8:10 AM, John Elrick >wrote: > > > > > I've been reading through the code. Do I understand correctly that if > one > > prepared statement binding is changed in such a way as may in

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-19 Thread John Elrick
On Thu, Jan 19, 2012 at 8:03 AM, Richard Hipp wrote: > On Thu, Jan 19, 2012 at 7:51 AM, John Elrick >wrote: > > > Interesting: > > > > 1. There are no database schema changes occurring after the system is > fully > > initialized > > 2. There are no A

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-19 Thread John Elrick
triggering the re-parse which did not do so in the earlier version. On Thu, Jan 19, 2012 at 7:45 AM, Richard Hipp wrote: > On Thu, Jan 19, 2012 at 7:41 AM, John Elrick >wrote: > > > Question: > > > > If a query has already been prepared with sqlite3_prepare_v2, why wou

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-19 Thread John Elrick
Question: If a query has already been prepared with sqlite3_prepare_v2, why would sqlite3_step need to call sqlite3Prepare, which in turn calls sqlite3RunParser? ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-18 Thread John Elrick
On Wed, Jan 18, 2012 at 4:32 PM, Richard Hipp wrote: > On Wed, Jan 18, 2012 at 4:30 PM, John Elrick >wrote: > > > I made one more stab and narrowed down the mallocs to this call: > > > > Count:119,133 = 'sqlite3Parser_lt_YYNSTATEpYYNRULE(12) > > sql

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-18 Thread John Elrick
NRULE); I started looking at yy_reduce, but it looks machine generated. If you give me some direction I'll see if I can narrow it down further. On Wed, Jan 18, 2012 at 4:02 PM, John Elrick wrote: > Whatever is happening, it appears I can only reproduce it under these > circumstances.

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-18 Thread John Elrick
Whatever is happening, it appears I can only reproduce it under these circumstances. I'll continue digging into the procedure tomorrow to see if I can narrow down where this is coming from. On Wed, Jan 18, 2012 at 3:54 PM, John Elrick wrote: > FYI, I traced the number of

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-18 Thread John Elrick
FYI, I traced the number of calls to sqlite3ResetInternalSchema() on a smaller set of data. It appears that it isn't the culprit. Total mallocs: 148,156 Total calls to sqlite3ResetInternalSchema(): 63 On Wed, Jan 18, 2012 at 3:41 PM, John Elrick wrote: > What else could trigger a

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-18 Thread John Elrick
What else could trigger a call to sqlite3ResetInternalSchema()? I'm getting a clear breakpoint tracing back to such innocuous calls as _sqlite3_step. On Wed, Jan 18, 2012 at 3:31 PM, Richard Hipp wrote: > On Wed, Jan 18, 2012 at 3:12 PM, John Elrick >wrote: > > > >

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-18 Thread John Elrick
I could not use any of the proffered tools for several reasons. After an inspiration yesterday, I dusted off my C programming skills and started hacking a pseudo-call stack system into SQLite3.c. I've put the statistics below for the top couple of call stacks. Total times _malloc called in test:

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-17 Thread John Elrick
On Mon, Jan 16, 2012 at 8:05 PM, John Elrick wrote: > > > On Mon, Jan 16, 2012 at 5:31 PM, Richard Hipp wrote: > >> On Mon, Jan 16, 2012 at 5:13 PM, John Elrick > >wrote: >> >> > I did this trace through the Delphi IDE and hand copied the call stack. >

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-17 Thread John Elrick
On Mon, Jan 16, 2012 at 5:36 PM, Richard Hipp wrote: > On Mon, Jan 16, 2012 at 5:31 PM, John Elrick >wrote: > > SNIP > This is very curious and perhaps a useful clue. SQLite does call > SNIP It is a clue that I need a break. While updating the counters to allow for nil p

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-17 Thread John Elrick
On Mon, Jan 16, 2012 at 11:47 PM, Max Vlasov wrote: > On Tue, Jan 17, 2012 at 5:05 AM, John Elrick >wrote: > > > > > > I can try that approach with BCC. I was concerned that the IDE would be > > getting inaccurate information from the .OBJ. Crossing into a >

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-16 Thread John Elrick
On Mon, Jan 16, 2012 at 5:31 PM, Richard Hipp wrote: > On Mon, Jan 16, 2012 at 5:13 PM, John Elrick >wrote: > > > I did this trace through the Delphi IDE and hand copied the call stack. > > Unfortunately, I can't give you line numbers, although I could go back >

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-16 Thread John Elrick
I will adjust the realloc tests tomorrow and let you know. The two routines are unique in the Delphi library unit. Thanks again for your time and efforts. On Mon, Jan 16, 2012 at 5:36 PM, Richard Hipp wrote: > On Mon, Jan 16, 2012 at 5:31 PM, John Elrick >wrote: > > > > >

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-16 Thread John Elrick
Richard, I don't know if the calls to _realloc will help also, but I've added tracing for those also. My updated output: Application: Surveyor.exe Sqlite version: 3.7.9 Date/Time:01/16/2012 17:20:58 Memory Used:

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-16 Thread John Elrick
On Mon, Jan 16, 2012 at 5:14 PM, Simon Slavin wrote: > > On 16 Jan 2012, at 9:37pm, John Elrick wrote: > > > Lacking the status interfaces for 3.6.17 I was forced to mark them as > > "interface not supported". Simon suggested I track the calls to _malloc, >

Re: [sqlite] Some pieces of the puzzle are coming together

2012-01-16 Thread John Elrick
I did this trace through the Delphi IDE and hand copied the call stack. Unfortunately, I can't give you line numbers, although I could go back and give you hex offsets from the start of the procedures. These are literally the first seven call stacks from _malloc after I initiate the trace. I'm n

<    1   2   3   4   5   6   7   8   9   10   >