[sqlite] SQL query causes various hangs/crashes/exits

[Larry Knibb]

Hi,

I hope I'm in the right place - this is my first post to sqlite-users.
I'm looking for help on a query I am composing which seems to be
blowing-up the query engine/API. Or maybe I'm just missing something
very obvious...

I have a query which works fine on a small database (15KB) which I
manipulated to have just one matching result, but on my full-size
database (40MB) this query causes my Windows Phone app to completely
die with no exception and similarly on my desktop PC while trying to
understand the issue SQLite Database Browser 2.0 b1.exe ends up "Not
Responding" (never comes back to life). Unfortunately I can't execute
this query via sqlite3.exe because it contains Unicode characters in
the query string.

I'm happy to provide any more background info as required but just on
first sight, is there anything immediately wrong with this query?

SELECT DISTINCT d.rowid AS id, d.*, i.relevance
FROM dictionary d
JOIN hp_index i ON i.dictionary_id = d.rowid
JOIN hanzi h ON h.rowid = i.hanzi_id
WHERE h.traditional = '我' OR h.simplified = '我'
ORDER BY i.relevance desc

I can get it to work by dropping the OR h.simplified part of the WHERE clause.

However, if I use a single where clause but use the h.simplified
column instead then it breaks again. Maybe it's the index?

CREATE INDEX i3 ON hanzi(traditional, simplified);

Any help much appreciated for my first post.

Cheers,
Larry

P.S. here's the query plan fr the first broken (on large dataset)
query showing the indexes working as intended:
0|0|2|SEARCH TABLE hanzi AS h USING COVERING INDEX i3 (traditional=?) (~10 rows)
0|0|2|SEARCH TABLE hanzi AS h USING AUTOMATIC COVERING INDEX
(simplified=?) (~7 rows)
0|1|1|SEARCH TABLE hp_index AS i USING INDEX i5 (hanzi_id=?) (~10 rows)
0|2|0|SEARCH TABLE dictionary AS d USING INTEGER PRIMARY KEY (rowid=?) (~1 rows)
0|0|0|USE TEMP B-TREE FOR DISTINCT
0|0|0|USE TEMP B-TREE FOR ORDER BY
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Found it

[Richard Hipp]

On Tue, Jan 24, 2012 at 7:37 PM, John Elrick wrote:

>
> It appears that the value is set here:
>
>  u.av.pBt = db->aDb[pOp->p1].pBt;
>  if( u.av.pBt ){
>sqlite3BtreeGetMeta(u.av.pBt, BTREE_SCHEMA_VERSION, (u32 *)&u.av.iMeta);
>u.av.iGen = db->aDb[pOp->p1].pSchema->iGeneration;
>  }else{
>u.av.iGen = u.av.iMeta = 0;
>  }
>
>
> I added a log trace to the else condition and it never fired off, so
> something is causing db->aDb[pOp->p1].pSchema->iGeneration to change
> relative to pOp->p3.  Give me some guidance as to where to dig and I'll be
> glad to do so
>

iGeneration changes in only one place in the code:
http://www.sqlite.org/src/artifact/5069f2248?ln=431

May I recommend that you put a printf() before this line

   http://www.sqlite.org/src/artifact/fc1b97fa6816?ln=3022

And have that printf display the following values:

   db  (rendered using %p)
   pOp->p1  (using %d)
   db->aDb[pOp->p1].pSchema  (using %p)
   db->aDb[pOp->p1].pSchema->schema_cookie  (using %d)
   db->aDb[pOp->p1].pSchema->iGeneration (using %d)
   iMeta  (using %d)
   pOp->p2  (using %d)
   pOp->p3  (using %d)
   p->zSql  (using %s)

And then also add a printf on the line above where iGeneration changes and
display its new value every time it changes.




-- 
D. Richard Hipp
d...@sqlite.org
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Found it

[John Elrick]

On Tue, Jan 24, 2012 at 7:26 PM, Richard Hipp  wrote:

> On Tue, Jan 24, 2012 at 7:18 PM, John Elrick  >wrote:
>

SNIP


> So the problem was introduced by
>
> http://www.sqlite.org/src/info/36c04dd1695f08
>
> Which is the fix for this bug:
>
> http://www.sqlite.org/src/info/f7b4edece25c99
>
> That helps.  But we still cannot recreate the problem.  Are you using
> shared cache mode and do you have multiple database connections open on the
> same database file?


Nope and nope.

It appears that the value is set here:

  u.av.pBt = db->aDb[pOp->p1].pBt;
  if( u.av.pBt ){
sqlite3BtreeGetMeta(u.av.pBt, BTREE_SCHEMA_VERSION, (u32 *)&u.av.iMeta);
u.av.iGen = db->aDb[pOp->p1].pSchema->iGeneration;
  }else{
u.av.iGen = u.av.iMeta = 0;
  }


I added a log trace to the else condition and it never fired off, so
something is causing db->aDb[pOp->p1].pSchema->iGeneration to change
relative to pOp->p3.  Give me some guidance as to where to dig and I'll be
glad to do so (tomorrow, my 9 year old daughter just asked for ice cream).
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Found it

[Richard Hipp]

On Tue, Jan 24, 2012 at 7:18 PM, John Elrick wrote:

> I really found it this time.
>
> While I was looking over the code changes, I noticed a section of code
> dealing with case OP_VerifyCookie:
>
> On a hunch, I replaced this line:
>
>  if( u.av.iMeta!=pOp->p2 || u.av.iGen!=pOp->p3 ){
>
> with the if statement from 3.7.5
>
>  if( u.av.iMeta!=pOp->p2 ){
>
> When I do, the number of mallocs drops back to 14,000 - still a little
> higher than in 3.7.5, but nowhere near 140,000.
>

So the problem was introduced by

 http://www.sqlite.org/src/info/36c04dd1695f08

Which is the fix for this bug:

 http://www.sqlite.org/src/info/f7b4edece25c99

That helps.  But we still cannot recreate the problem.  Are you using
shared cache mode and do you have multiple database connections open on the
same database file?


-- 
D. Richard Hipp
d...@sqlite.org
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Found it

[John Elrick]

I really found it this time.

While I was looking over the code changes, I noticed a section of code
dealing with case OP_VerifyCookie:

Inside that section is the following in 3.7.6

  if( u.av.iMeta!=pOp->p2 || u.av.iGen!=pOp->p3 ){
sqlite3DbFree(db, p->zErrMsg);
p->zErrMsg = sqlite3DbStrDup(db, "database schema has changed");
/* If the schema-cookie from the database file matches the cookie
** stored with the in-memory representation of the schema, do
** not reload the schema from the database file.
**
** If virtual-tables are in use, this is not just an optimization.
** Often, v-tables store their data in other SQLite tables, which
** are queried from within xNext() and other v-table methods using
** prepared queries. If such a query is out-of-date, we do not want to
** discard the database schema, as the user code implementing the
** v-table would have to be ready for the sqlite3_vtab structure itself
** to be invalidated whenever sqlite3_step() is called from within
** a v-table method.
*/
if( db->aDb[pOp->p1].pSchema->schema_cookie!=u.av.iMeta ){
  sqlite3ResetInternalSchema(db, pOp->p1);
}

On a hunch, I replaced this line:

  if( u.av.iMeta!=pOp->p2 || u.av.iGen!=pOp->p3 ){

with the if statement from 3.7.5

  if( u.av.iMeta!=pOp->p2 ){

When I do, the number of mallocs drops back to 14,000 - still a little
higher than in 3.7.5, but nowhere near 140,000.

Does that help?
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Found it

[Richard Hipp]

On Tue, Jan 24, 2012 at 5:58 PM, John Elrick wrote:

> Let me rephrase that...
>
> > > http://www.sqlite.org/fenstra/sqlite-201102040051.zip
>
> 8,191 calls to malloc (consistent with 3.7.5 for this dataset)
> >> > > http://www.sqlite.org/fenstra/sqlite-201102112254.zip
> >
> 14,726 calls to malloc
>
>
> 3.7.6
>
> 148,606 calls to malloc
>

I still believe that the problem is along this graph:


http://www.sqlite.org/src/timeline?from=36d79e6f54&to=f7e2ea33d5&nomerge

Do you disagree?  Do you think the problem occurs before or after the set
of changes shown above.  Only you are able to recreate the problem (so
far), so you have to be judge as to when it works and when it does not.
Let me know where we ought to be looking.


>
> --
> John Elrick
> Fenestra Technologies
> 540-868-1377
> ___
> sqlite-users mailing list
> sqlite-users@sqlite.org
> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
>



-- 
D. Richard Hipp
d...@sqlite.org
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Found it

[John Elrick]

Let me rephrase that...

I ran this test with a small case.  See results below.

On Tue, Jan 24, 2012 at 5:55 PM, John Elrick wrote:

SNIP

> > http://www.sqlite.org/fenstra/sqlite-201102040051.zip
>>
>
> Low malloc count
>

8,191 calls to malloc (consistent with 3.7.5 for this dataset)


>
>
>>
>> > > http://www.sqlite.org/fenstra/sqlite-201102112254.zip
>>
>
> High malloc count
>
>
14,726 calls to malloc


3.7.6

148,606 calls to malloc

So there was a jump, but not to the full level.


> The problem is between the two.
>



-- 
John Elrick
Fenestra Technologies
540-868-1377
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Found it

[John Elrick]

On Tue, Jan 24, 2012 at 5:36 PM, Richard Hipp  wrote:

> On Tue, Jan 24, 2012 at 5:21 PM, John Elrick  >wrote:
>
> > On Tue, Jan 24, 2012 at 3:05 PM, Richard Hipp  wrote:
> > > >
> > > > OK.  Please try these:
> > >
> > > http://www.sqlite.org/fenstra/sqlite-201102040051.zip
>

Low malloc count


>
> > > http://www.sqlite.org/fenstra/sqlite-201102112254.zip
>

High malloc count

The problem is between the two.
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Found it

[Richard Hipp]

On Tue, Jan 24, 2012 at 5:21 PM, John Elrick wrote:

> On Tue, Jan 24, 2012 at 3:05 PM, Richard Hipp  wrote:
> > >
> > > OK.  Please try these:
> >
> > http://www.sqlite.org/fenstra/sqlite-201102040051.zip
> > http://www.sqlite.org/fenstra/sqlite-201102112254.zip
> >
> >
> Both of these are low malloc count.
>

Progress!  Consider the timeline at

http://www.sqlite.org/src/timeline?p=36d79e6f54cdc412&n=37&nd

You have reported that the top-most check-in exhibits the problem but the
bottom-most check-in does not.  So the problem must be somewhere in between
these two.  Here are two other check-ins in the middle for you to try so
that we can narrow it down further:

http://www.sqlite.org/fenstra/sqlite-201102211146.zip
http://www.sqlite.org/fenstra/sqlite-201103040056.zip


-- 
D. Richard Hipp
d...@sqlite.org
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Found it

[John Elrick]

On Tue, Jan 24, 2012 at 3:05 PM, Richard Hipp  wrote:

> On Tue, Jan 24, 2012 at 1:28 PM, John Elrick  >wrote:
>
> >
> >
> > > http://www.sqlite.org/fenstra/sqlite-201103081639.zip
> >
> >
> > This one gives the high number of mallocs just as does 3.7.6.
> >
> > OK.  Please try these:
>
> http://www.sqlite.org/fenstra/sqlite-201102040051.zip
> http://www.sqlite.org/fenstra/sqlite-201102112254.zip
>
>
> --
> D. Richard Hipp
> d...@sqlite.org
> ___
> sqlite-users mailing list
> sqlite-users@sqlite.org
> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
>


Both of these are low malloc count.

I happened to think on my long drive from Frederick, are their canonical
procedures used to flag the system, to tell it that the schema needs
rebuilt?  Maybe I should attempt a call stack trace on those (if they
exist).
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Incompatible versions of SQLite on same system

[epankoke]

1. Could we please stay on topic 
2. Could we please not go down this road again? 

If you guys really want to argue about proper posting etiquette and / or using 
something besides an email list, they've both been done to death. Just search 
the archives or start a new thread that's appropriately titled. Just leave it 
out of this one. 

Eric 

On 2012-01-24 16:09, Tim Streater wrote: 
> On 24 Jan 2012 at 20:02, Joe Winograd wrote: 
> 
>> Thanks for the idea, but it will not install. The way this group operates 
>> with excessive trimming/snipping ... 
> No it doesn't. It doesn't do *enough* trimming and snipping, and as a result 
> our inboxes grow exponentially. If I want to read a thread I can sort by 
> subject and then read it through. But this is made harder by the excessive 
> repetition due to inadequate trimming (particularly of .sigs). 
> 
> -- 
> Cheers -- Tim 
> 
> 
> 

Did you guys ever consider Google Groups or something of the like? Email 
lists are soo clumsy. 

Normand 
___ 
sqlite-users mailing list 
sqlite-users@sqlite.org 
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users 
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Incompatible versions of SQLite on same system

[Normand Mongeau]

On 2012-01-24 16:09, Tim Streater wrote:

On 24 Jan 2012 at 20:02, Joe Winograd  wrote:


Thanks for the idea, but it will not install. The way this group operates
with excessive trimming/snipping ...

No it doesn't. It doesn't do *enough* trimming and snipping, and as a result 
our inboxes grow exponentially. If I want to read a thread I can sort by 
subject and then read it through. But this is made harder by the excessive 
repetition due to inadequate trimming (particularly of .sigs).

--
Cheers  --  Tim





Did you guys ever consider Google Groups or something of the like? Email 
lists are soo clumsy.


Normand
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Incompatible versions of SQLite on same system

[Tim Streater]

On 24 Jan 2012 at 20:02, Joe Winograd  wrote: 

> Thanks for the idea, but it will not install. The way this group operates 
> with excessive trimming/snipping ...

No it doesn't. It doesn't do *enough* trimming and snipping, and as a result 
our inboxes grow exponentially. If I want to read a thread I can sort by 
subject and then read it through. But this is made harder by the excessive 
repetition due to inadequate trimming (particularly of .sigs).

--
Cheers  --  Tim
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Found it

[John Elrick]

Nope and nope.  They are happening apparently out of the blue.
On Jan 24, 2012 2:40 PM, "Nico Williams"  wrote:

> Maybe a view is getting materialized, or a some other temp table's
> creation under the hood is triggering this?
> ___
> sqlite-users mailing list
> sqlite-users@sqlite.org
> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
>
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] ftruncate implementation

[Roger Binns]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 24/01/12 11:53, Simon Slavin wrote:
> Yes, but SQLite allocates pages in order, one by one.

Not quite true.  See also SQLITE_FCNTL_CHUNK_SIZE.

> It doesn't take advantage of the ability to allocate files sparsely.

Ever tried zeroblob?

Roger
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (GNU/Linux)

iEYEARECAAYFAk8fGkAACgkQmOOfHg372QTGkACfbwQfSKwHq19HfDXWYNhD3LEa
818AnjD1c4av9YQyxxAoV5jYIUVVk3zz
=4lCD
-END PGP SIGNATURE-
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Found it

[Richard Hipp]

On Tue, Jan 24, 2012 at 1:28 PM, John Elrick wrote:

>
>
> > http://www.sqlite.org/fenstra/sqlite-201103081639.zip
>
>
> This one gives the high number of mallocs just as does 3.7.6.
>
> OK.  Please try these:

http://www.sqlite.org/fenstra/sqlite-201102040051.zip
http://www.sqlite.org/fenstra/sqlite-201102112254.zip


-- 
D. Richard Hipp
d...@sqlite.org
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Incompatible versions of SQLite on same system

[Joe Winograd]

> you can go ahead and reinstall HP's Connection Manager

Kevin,
Thanks for the idea, but it will not install. The way this group operates 
with excessive trimming/snipping, that has long since been removed from this 
thread (this M.O. makes it very difficult for a member to join a discussion 
in the middle), but here's what I wrote at the get-go:


I received the following dialog box with the title :

Cannot load assembly:
System.Data.SQLite, Version=1.0.61.0, Culture=neutral,
PublicKeyToken=db937bc2d44ff139
The application will now exit.

The supposed "answer" from HP is that you may use use either TurboTax or 
Connection Manager, but not both! I was hoping the experts in this forum 
would have a solution to this problem, or at least a better work-around than 
uninstalling one and reinstalling the other each time I need one of the 
programs.


One of the really interesting things that came out in this thread (also long 
since trimmed) is that there is no SQLite DLL of any kind in the TurboTax 
directory structure and there doesn't seem to be one in any common/shared 
area that TT would be using (there *is* one in <\Common Files\Apple>, but TT 
is surely not using that).


Also trimmed from earlier in the thread:

I downloaded the latest  from the link that Richard provided 
and replaced the copy in Connection Manager>. Running CM fails in the same way as previously reported 
and running  (which is in the same directory as the CM 
executable and the new ) also fails in the same way as 
previously reported.


Regards, Joe

 Original Message 
Subject: Re: [sqlite] Incompatible versions of SQLite on same system
From: Kevin Benson 
To: General Discussion of SQLite Database 
Date: Tue Jan 24 2012 13:38:24 GMT-0600 (Central Standard Time)

On Tue, Jan 24, 2012 at 11:32 AM, Joe Winograd  wrote:


Joe,

Good to know! I had been looking just for. I don't have
access to the machine right now, but I do have a clone of its system drive,
and a search for  turned up:

System.Data.SQLite.Linq.DLL (more than one copy)
System.Data.SQLite.DLL (more than one copy)
System.Data.SQLite64.DLL (probably because it's 64-bit W7)

At the time the clone was made, HP Connection Manager wasn't on it, but HP
Power Assistant was, and the latter's directory in Program Files contains
both  and, so there's a
good chance that HP Connection Manager will have those, too (I am not
willing to uninstall Intuit's TurboTax at this time, so there's no way to
get HP Connection Manager installed to determine for sure what
SQLite-related DLLs it installs). Regards, Joe



It's a bit of a kludge, but ...you can go ahead and reinstall HP's
Connection Manager. When you want to run TurboTax ...just *temporarily*
rename the conflicting parent directory (C:\Program Files\HP Connection
Manager to C:\Program Files\HP Connection Manager_ ) and reboot your
system. It will be unable to find the directory to load the conflicting
files (or run HP Connection Manager). Then, run TurboTax to your heart's
content and when finished ...rename the parent directory *back* (remove the
underscore at the end of the directory name) and reboot to return HP
Connection Manager to a "working" state. Cheers

--
--
   --
  --ô¿ô--
 K e V i N



 Original Message 
Subject: Re: [sqlite] Incompatible versions of SQLite on same system
From: Joe Mistachkin
To: 'General Discussion of SQLite Database'
Date: Thu Jan 19 2012 10:06:09 GMT-0600 (Central Standard Time)


Another thing to keep in mind is that the System.Data.SQLite project
compiles
the native code for SQLite into files named "SQLite.Interop.dll" and
"System.Data.SQLite.dll" (mixed-mode assembly), depending on the build
configuration.





___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] ftruncate implementation

[Simon Slavin]

On 24 Jan 2012, at 7:09pm, David Garfield wrote:

> no, it is more handwaving.  The dirty marking you describe will be
> done for a partial page at the old end of the file.  Any additional
> pages will normally be left unallocated, and the operating system will
> provide zeros at read time when you try to read them.

Yes, but SQLite allocates pages in order, one by one.  It doesn't take 
advantage of the ability to allocate files sparsely.

Simon.
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] ftruncate implementation

[Roger Binns]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 24/01/12 11:00, Simon Slavin wrote:
> That's a bit of handwaving.  What happens is that the file system
> doesn't itself write zeros to the disk surface.

Not handwaving and Unix has operated this way since the early days.  They
are called sparse files:

  http://en.wikipedia.org/wiki/Sparse_file

Roger
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (GNU/Linux)

iEYEARECAAYFAk8fCUoACgkQmOOfHg372QTznQCg5lezhupQx8fVtExLjZthottc
KtcAnjjgzG2MfdhLf6RGf7vgRi9wjaXL
=Atgu
-END PGP SIGNATURE-
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Found it

[Nico Williams]

Maybe a view is getting materialized, or a some other temp table's
creation under the hood is triggering this?
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Incompatible versions of SQLite on same system

[Kevin Benson]

On Tue, Jan 24, 2012 at 11:32 AM, Joe Winograd  wrote:

> Joe,
>
> Good to know! I had been looking just for . I don't have
> access to the machine right now, but I do have a clone of its system drive,
> and a search for  turned up:
>
> System.Data.SQLite.Linq.DLL (more than one copy)
> System.Data.SQLite.DLL (more than one copy)
> System.Data.SQLite64.DLL (probably because it's 64-bit W7)
>
> At the time the clone was made, HP Connection Manager wasn't on it, but HP
> Power Assistant was, and the latter's directory in Program Files contains
> both  and , so there's a
> good chance that HP Connection Manager will have those, too (I am not
> willing to uninstall Intuit's TurboTax at this time, so there's no way to
> get HP Connection Manager installed to determine for sure what
> SQLite-related DLLs it installs). Regards, Joe
>
>
It's a bit of a kludge, but ...you can go ahead and reinstall HP's
Connection Manager. When you want to run TurboTax ...just *temporarily*
rename the conflicting parent directory (C:\Program Files\HP Connection
Manager to C:\Program Files\HP Connection Manager_ ) and reboot your
system. It will be unable to find the directory to load the conflicting
files (or run HP Connection Manager). Then, run TurboTax to your heart's
content and when finished ...rename the parent directory *back* (remove the
underscore at the end of the directory name) and reboot to return HP
Connection Manager to a "working" state. Cheers

--
   --
  --
 --ô¿ô--
K e V i N


>  Original Message 
> Subject: Re: [sqlite] Incompatible versions of SQLite on same system
> From: Joe Mistachkin 
> To: 'General Discussion of SQLite Database' 
> Date: Thu Jan 19 2012 10:06:09 GMT-0600 (Central Standard Time)
>
>> Another thing to keep in mind is that the System.Data.SQLite project
>> compiles
>> the native code for SQLite into files named "SQLite.Interop.dll" and
>> "System.Data.SQLite.dll" (mixed-mode assembly), depending on the build
>> configuration.
>>
>
> __**_
> sqlite-users mailing list
> sqlite-users@sqlite.org
> http://sqlite.org:8080/cgi-**bin/mailman/listinfo/sqlite-**users
>
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] ftruncate implementation

[David Garfield]

no, it is more handwaving.  The dirty marking you describe will be
done for a partial page at the old end of the file.  Any additional
pages will normally be left unallocated, and the operating system will
provide zeros at read time when you try to read them.  This makes them
appear zero-filled, without actually zero filling anything.

Having said that, I would expect certain operating systems (like DOS)
to actually do the zero-filling and complete it before returning from
the call.

--David Garfield

On Tue, Jan 24, 2012 at 14:00, Simon Slavin  wrote:
>
> On 24 Jan 2012, at 6:51pm, David Garfield wrote:
>
>> From the ftruncate page: "If the file size is increased, the extended
>> area shall appear as if it were zero-filled".
>> It doesn't have to write zeros, just act like it did.
>
> That's a bit of handwaving.  What happens is that the file system doesn't 
> itself write zeros to the disk surface.  It puts zeros into the cache of the 
> sector in memory and marks that sector as dirty (i.e. needing to eventually 
> be written back to disk).  So if the program doesn't write to that sector and 
> just releases it, those zeros do eventually get written to disk.  But if the 
> program does write to that sector the disk surface only gets touched once, 
> not twice, which is faster.
>
> So it doesn't write zeros to disk, but it does write zeros to the bit of 
> memory that represents that bit of disk, and arrange that (unless the program 
> overwrites them) they'll be written to disk eventually.
>
> Simon.
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Found it

[John Elrick]

On Tue, Jan 24, 2012 at 12:53 PM, Richard Hipp  wrote:

> On Tue, Jan 24, 2012 at 12:15 PM, John Elrick  >wrote:
>
> > >
> > > Can you put a breakpoint on sqlite3ResetInternalSchema() and figure out
> > > from whence it is being called so often?
> > >
> > >
> >
> > Just did.  Most of the calls are bubbling up from _sqlite3_step which I
> > mentioned before.
>

Richard,

I added some tracking which keeps a log of every query and writes the last
50 things done when the call to sqlite3ResetInternalSchema() takes place.
 Here is a fairly representative entry.  The last SQL is the one which
triggered the call to sqlite3ResetInternalSchema().  Nothing here which
touches the schema of the database that I can see.

last 50 sqls = 'step: select distinct RESPONSES.RESPONSE_OID from
RESPONSES, DATA_ELEMENTS, SEQUENCE_ELEMENTS where
SEQUENCE_ELEMENTS.SEQUENCE_ELEMENT_OID=:SEQUENCE_ELEMENTS_SEQUENCE_ELEMENT_OID
and DATA_ELEMENTS.DATA_ELEMENT_NAME=:DATA_ELEMENTS_DATA_ELEMENT_NAME and
RESPONSES.instance_parent=SEQUENCE_ELEMENTS.SEQUENCE_ELEMENT_OID and
RESPONSES.definition_parent=DATA_ELEMENTS.DATA_ELEMENT_OID order by
RESPONSES.rowid
step: SELECT * FROM RESPONSES a where a.soft_deleted_char = 'F' and
a.RESPONSE_OID = :oid
step: UPDATE RESPONSES SET
RESPONSE_NAME = :RESPONSE_NAME,
prelisted_value = :prelisted_value
WHERE RESPONSE_OID = :RESPONSE_OID
step: select distinct DATA_ELEMENTS.DATA_ELEMENT_OID from RESPONSES,
DATA_ELEMENTS, SEQUENCE_ELEMENTS where
SEQUENCE_ELEMENTS.SEQUENCE_ELEMENT_OID=:SEQUENCE_ELEMENTS_SEQUENCE_ELEMENT_OID
and DATA_ELEMENTS.DATA_ELEMENT_NAME=:DATA_ELEMENTS_DATA_ELEMENT_NAME and
RESPONSES.instance_parent=SEQUENCE_ELEMENTS.SEQUENCE_ELEMENT_OID and
RESPONSES.definition_parent=DATA_ELEMENTS.DATA_ELEMENT_OID order by
DATA_ELEMENTS.rowid
step: select distinct DATA_ELEMENTS.DATA_ELEMENT_OID from RESPONSES,
DATA_ELEMENTS, SEQUENCE_ELEMENTS where
SEQUENCE_ELEMENTS.SEQUENCE_ELEMENT_OID=:SEQUENCE_ELEMENTS_SEQUENCE_ELEMENT_OID
and DATA_ELEMENTS.DATA_ELEMENT_NAME=:DATA_ELEMENTS_DATA_ELEMENT_NAME and
RESPONSES.instance_parent=SEQUENCE_ELEMENTS.SEQUENCE_ELEMENT_OID and
RESPONSES.definition_parent=DATA_ELEMENTS.DATA_ELEMENT_OID order by
DATA_ELEMENTS.rowid
step: select distinct RESPONSES.RESPONSE_OID from RESPONSES, DATA_ELEMENTS,
SEQUENCE_ELEMENTS where
SEQUENCE_ELEMENTS.SEQUENCE_ELEMENT_OID=:SEQUENCE_ELEMENTS_SEQUENCE_ELEMENT_OID
and DATA_ELEMENTS.DATA_ELEMENT_NAME=:DATA_ELEMENTS_DATA_ELEMENT_NAME and
RESPONSES.instance_parent=SEQUENCE_ELEMENTS.SEQUENCE_ELEMENT_OID and
RESPONSES.definition_parent=DATA_ELEMENTS.DATA_ELEMENT_OID order by
RESPONSES.rowid
step: select distinct RESPONSES.RESPONSE_OID from RESPONSES, DATA_ELEMENTS,
SEQUENCE_ELEMENTS where
SEQUENCE_ELEMENTS.SEQUENCE_ELEMENT_OID=:SEQUENCE_ELEMENTS_SEQUENCE_ELEMENT_OID
and DATA_ELEMENTS.DATA_ELEMENT_NAME=:DATA_ELEMENTS_DATA_ELEMENT_NAME and
RESPONSES.instance_parent=SEQUENCE_ELEMENTS.SEQUENCE_ELEMENT_OID and
RESPONSES.definition_parent=DATA_ELEMENTS.DATA_ELEMENT_OID order by
RESPONSES.rowid
step: SELECT * FROM RESPONSES a where a.soft_deleted_char = 'F' and
a.RESPONSE_OID = :oid
step: UPDATE RESPONSES SET
RESPONSE_NAME = :RESPONSE_NAME,
prelisted_value = :prelisted_value
WHERE RESPONSE_OID = :RESPONSE_OID
step: select distinct DATA_ELEMENTS.DATA_ELEMENT_OID from RESPONSES,
DATA_ELEMENTS, SEQUENCE_ELEMENTS where
SEQUENCE_ELEMENTS.SEQUENCE_ELEMENT_OID=:SEQUENCE_ELEMENTS_SEQUENCE_ELEMENT_OID
and DATA_ELEMENTS.DATA_ELEMENT_NAME=:DATA_ELEMENTS_DATA_ELEMENT_NAME and
RESPONSES.instance_parent=SEQUENCE_ELEMENTS.SEQUENCE_ELEMENT_OID and
RESPONSES.definition_parent=DATA_ELEMENTS.DATA_ELEMENT_OID order by
DATA_ELEMENTS.rowid
step: select distinct DATA_ELEMENTS.DATA_ELEMENT_OID from RESPONSES,
DATA_ELEMENTS, SEQUENCE_ELEMENTS where
SEQUENCE_ELEMENTS.SEQUENCE_ELEMENT_OID=:SEQUENCE_ELEMENTS_SEQUENCE_ELEMENT_OID
and DATA_ELEMENTS.DATA_ELEMENT_NAME=:DATA_ELEMENTS_DATA_ELEMENT_NAME and
RESPONSES.instance_parent=SEQUENCE_ELEMENTS.SEQUENCE_ELEMENT_OID and
RESPONSES.definition_parent=DATA_ELEMENTS.DATA_ELEMENT_OID order by
DATA_ELEMENTS.rowid
step: select distinct RESPONSES.RESPONSE_OID from RESPONSES, DATA_ELEMENTS,
SEQUENCE_ELEMENTS where
SEQUENCE_ELEMENTS.SEQUENCE_ELEMENT_OID=:SEQUENCE_ELEMENTS_SEQUENCE_ELEMENT_OID
and DATA_ELEMENTS.DATA_ELEMENT_NAME=:DATA_ELEMENTS_DATA_ELEMENT_NAME and
RESPONSES.instance_parent=SEQUENCE_ELEMENTS.SEQUENCE_ELEMENT_OID and
RESPONSES.definition_parent=DATA_ELEMENTS.DATA_ELEMENT_OID order by
RESPONSES.rowid
step: select distinct RESPONSES.RESPONSE_OID from RESPONSES, DATA_ELEMENTS,
SEQUENCE_ELEMENTS where
SEQUENCE_ELEMENTS.SEQUENCE_ELEMENT_OID=:SEQUENCE_ELEMENTS_SEQUENCE_ELEMENT_OID
and DATA_ELEMENTS.DATA_ELEMENT_NAME=:DATA_ELEMENTS_DATA_ELEMENT_NAME and
RESPONSES.instance_parent=SEQUENCE_ELEMENTS.SEQUENCE_ELEMENT_OID and
RESPONSES.definition_parent=DATA_ELEMENTS.DATA_ELEMENT_OID order by
RESPONSES.rowid
step: SELECT * FROM RESPONSES a where a.soft_deleted_char = 'F' and
a.RESPONSE_OID = :oid
step: UPDATE RESPONSES SET
RESPONSE_NAME = :R

Re: [sqlite] ftruncate implementation

[Simon Slavin]

On 24 Jan 2012, at 6:51pm, David Garfield wrote:

> From the ftruncate page: "If the file size is increased, the extended
> area shall appear as if it were zero-filled".
> It doesn't have to write zeros, just act like it did.

That's a bit of handwaving.  What happens is that the file system doesn't 
itself write zeros to the disk surface.  It puts zeros into the cache of the 
sector in memory and marks that sector as dirty (i.e. needing to eventually be 
written back to disk).  So if the program doesn't write to that sector and just 
releases it, those zeros do eventually get written to disk.  But if the program 
does write to that sector the disk surface only gets touched once, not twice, 
which is faster.

So it doesn't write zeros to disk, but it does write zeros to the bit of memory 
that represents that bit of disk, and arrange that (unless the program 
overwrites them) they'll be written to disk eventually.

Simon.
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] makefile for c

[Jan Hudec]

On Sun, Jan 15, 2012 at 15:17:37 -0600, Bill McCormick wrote:
> Tim Streater wrote, On 1/15/2012 3:00 PM:
> >On 15 Jan 2012 at 20:44, Bill McCormick  wrote:
> >
> >>What is the problem with the shared lib stuff?
> >>
> >>Black, Michael (IS) wrote, On 1/15/2012 2:27 PM:
> >>>A simple one -- and please compile sqlite3.c into your program and make
> >>>everybody happy.
> >>>
> >>>Forget the shared library stuff as we have just been talking about.
> >The problem is that the computer vendor installs a shared lib with
> >a version of the library. Some 3rd party app installer then replaced that
> >shared lib with another version, and existing apps don't like it.
> >
> >SQLite is small enough that it can be compiled and linked in in its entirety.

I am quite certain Debian requires packages to be linked dynamically to
libraries that are packaged, the strongest reason being security support.

Of course since Debian package declares dependency and versions, 3rd party
installer won't just replace the shared library with incompatible version.

> OK. I don't see this as a problem for my use case. It would be
> better for me to stick with the shared libs.
> 
> What is the difference between the two libs: libsqlite.so.0 and
> libsqlite3.so.0? I assume that I'll be linking to libsqlite3.

When you are compiling, you link against the .so file, which is symlink to
the actual .so.0 file. That file is provided by 'libsqlite3-dev' package and
is called '/usr/lib/libsqlite3.so'. The corresponding linker option is
'-lsqlite3'. Since the header is installed as '/usr/include/sqlite3.h', you
don't need any special options for compilation step. To see where the files
are, use 'dpkg -L libsqlite3-dev'.

-- 
 Jan 'Bulb' Hudec 
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Found it

[Krystian Bigaj]

On 24 January 2012 19:32, John Elrick  wrote:

> On Tue, Jan 24, 2012 at 1:29 PM, Krystian Bigaj  >wrote:
> > You can compile sqlite3.dll with debug information, and then you can in
> VS
> > attach to your running .exe - you should be able to see sqlite
> > stacks/breakpoints/step-in/out/etc. should also work.
> >
> Thanks very much for the suggestion.  We do not have, nor have any
> intention of using, Visual Studio.  It's also not a DLL, the resulting
> output is a Borland OBJ, which cannot be generated correctly from any other
> compiler.


 So maybe you could try build OBJ with debug/remote options/symbols
(tdebug?). And then try to attach to running process from C++ Builder IDE
(if it's not plain Borland C++ compiler).
I've never used it, but it might work.

PS. I forgot also that VS doesn't support debugging code if there is more
than 64K lines in source file.

Best regards,
Krystian Bigaj
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] ftruncate implementation

[David Garfield]

>From the ftruncate page: "If the file size is increased, the extended
area shall appear as if it were zero-filled".
It doesn't have to write zeros, just act like it did.

--David Garfield

On Tue, Jan 24, 2012 at 08:19, Simon Slavin  wrote:
>
> On 24 Jan 2012, at 6:43am, David Henry wrote:
>
>> I am working without an operating system so there are no other agents trying
>> to steal data.
>
> You're writing an operating system ?  That can be lots of fun.  Good luck.
>
>> Bearing that in mind, is it still necessary to actually write
>> zero data to the sectors allocated? Is SQLite expecting it?
>
> I haven't looked though the code with that in mind, but as far as I know, 
> SQLite does not make any assumption about what will be in newly-assigned 
> sectors.  If it wants zeros there it'll write them itself.
>
> It is ftruncate itself which chooses to write zeros to any newly-assigned 
> pages of disk space.  This is part of the specification of ftruncate, and 
> documented here:
>
> 
>
> If your version of ftruncate doesn't write the zeros, you haven't implemented 
> ftruncate properly.  But if you're not trying to reproduce UNIX, I guess it 
> doesn't matter.
>
> Simon.
> ___
> sqlite-users mailing list
> sqlite-users@sqlite.org
> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Found it

[John Elrick]

On Tue, Jan 24, 2012 at 1:28 PM, John Elrick wrote:

SNIP

http://www.sqlite.org/fenstra/sqlite-201103241737.zip
>
>
> This one is failing to compile.  It needs _msize.  That sounds like the
> 3.7.10 issue reported recently.
>
>
I opened the sqlite3.c file and it is version 3.7.10.
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Found it

[John Elrick]

On Tue, Jan 24, 2012 at 1:29 PM, Krystian Bigaj wrote:

> You can compile sqlite3.dll with debug information, and then you can in VS
> attach to your running .exe - you should be able to see sqlite
> stacks/breakpoints/step-in/out/etc. should also work.
>
>
Thanks very much for the suggestion.  We do not have, nor have any
intention of using, Visual Studio.  It's also not a DLL, the resulting
output is a Borland OBJ, which cannot be generated correctly from any other
compiler.


John
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Found it

[Krystian Bigaj]

You can compile sqlite3.dll with debug information, and then you can in VS
attach to your running .exe - you should be able to see sqlite
stacks/breakpoints/step-in/out/etc. should also work.

Best regards,
Krystian Bigaj


On 24 January 2012 19:25, John Elrick  wrote:

> On Tue, Jan 24, 2012 at 1:18 PM, Dan Kennedy 
> wrote:
>
> > On 01/25/2012 12:15 AM, John Elrick wrote:
> > Unfortunately, no I cannot.  Delphi 2007 doesn't give me accurate
> information from a linked OBJ.  It's roughly equivalent to trying to get
> accurate call stacks from inside a DLL.  I've had to hand add pseudo call
> stack information.
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Found it

[John Elrick]

On Tue, Jan 24, 2012 at 12:53 PM, Richard Hipp  wrote:

> On Tue, Jan 24, 2012 at 12:15 PM, John Elrick  >wrote:
>
>
SNIP


> http://www.sqlite.org/fenstra/sqlite-201103081639.zip


This one gives the high number of mallocs just as does 3.7.6.


>
> http://www.sqlite.org/fenstra/sqlite-201103241737.zip


This one is failing to compile.  It needs _msize.  That sounds like the
3.7.10 issue reported recently.


John
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Found it

[John Elrick]

On Tue, Jan 24, 2012 at 1:18 PM, Dan Kennedy  wrote:

> On 01/25/2012 12:15 AM, John Elrick wrote:
>
>> On Tue, Jan 24, 2012 at 12:06 PM, Richard Hipp  wrote:
>>
>>  On Tue, Jan 24, 2012 at 11:59 AM, John 
>> Elrick
>>>
 wrote:

>>>
>>>  While reviewing our other thread, I noticed a piece of information
 concerning sqlite3ResetInternalSchema.  Based on the number of times

>>> that I
>>>
 reported it had been called, I believe that something was changed
 between
 3.7.5 and 3.7.6 which causes sqlite3ResetInternalSchema to be called
 when
 it wasn't in the earlier version.   Is there some kind of enumeration of
 what events would cause sqlite3ResetInternalSchema to be called in

>>> version
>>>
 3.7.5 vs 3.7.6?


>>> I agree that the fact that the triggers are being reparsed is a big hint.
>>> But we still don't know why they are being reparsed.  And we still cannot
>>> reproduce the problem in a command-line shell - in only seems to occur
>>> within your Delphi app.
>>>
>>> Can you put a breakpoint on sqlite3ResetInternalSchema() and figure out
>>> from whence it is being called so often?
>>>
>>>
>>>
>> Just did.  Most of the calls are bubbling up from _sqlite3_step which I
>> mentioned before.
>>
>
> Can you see the whole call stack? There are a couple of different
> ways sqlite3ResetInternalSchema() may be called from within
> sqlite3_step(). Knowing which will be a clue as to why it is being
> called.
>
> Unfortunately, no I cannot.  Delphi 2007 doesn't give me accurate
information from a linked OBJ.  It's roughly equivalent to trying to get
accurate call stacks from inside a DLL.  I've had to hand add pseudo call
stack information.
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Found it

[Dan Kennedy]

On 01/25/2012 12:15 AM, John Elrick wrote:

On Tue, Jan 24, 2012 at 12:06 PM, Richard Hipp  wrote:


On Tue, Jan 24, 2012 at 11:59 AM, John Elrick
wrote:



While reviewing our other thread, I noticed a piece of information
concerning sqlite3ResetInternalSchema.  Based on the number of times

that I

reported it had been called, I believe that something was changed between
3.7.5 and 3.7.6 which causes sqlite3ResetInternalSchema to be called when
it wasn't in the earlier version.   Is there some kind of enumeration of
what events would cause sqlite3ResetInternalSchema to be called in

version

3.7.5 vs 3.7.6?



I agree that the fact that the triggers are being reparsed is a big hint.
But we still don't know why they are being reparsed.  And we still cannot
reproduce the problem in a command-line shell - in only seems to occur
within your Delphi app.

Can you put a breakpoint on sqlite3ResetInternalSchema() and figure out
from whence it is being called so often?




Just did.  Most of the calls are bubbling up from _sqlite3_step which I
mentioned before.


Can you see the whole call stack? There are a couple of different
ways sqlite3ResetInternalSchema() may be called from within
sqlite3_step(). Knowing which will be a clue as to why it is being
called.

Dan.
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Found it

[Richard Hipp]

On Tue, Jan 24, 2012 at 12:15 PM, John Elrick wrote:

> >
> > Can you put a breakpoint on sqlite3ResetInternalSchema() and figure out
> > from whence it is being called so often?
> >
> >
>
> Just did.  Most of the calls are bubbling up from _sqlite3_step which I
> mentioned before.  There are no new changes to the schema immediately prior
> to these calls.  Here is one example where step triggers a call to
> sqlite3ResetInternalSchema() (apologies for using Delphi and our wrappers,
> but I hope it's clear):
>


That information isn't really useful.  I still have no idea what is wrong,
nor idea how to recreate the observed behavior.

Let's bisect to find the specific check-in that is causing your problem.
Here are two amalgamations that are in between 3.7.5 and 3.7.6.  Please let
me know how these work, and based on that will continue to narrow down the
changes.

http://www.sqlite.org/fenstra/sqlite-201103081639.zip
http://www.sqlite.org/fenstra/sqlite-201103241737.zip


-- 
D. Richard Hipp
d...@sqlite.org
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] C# amalgamation hand holding requested

[Roosevelt Anderson]

.NET code is compiled to byte code that runs on the Common Language
Runtime (CLR) which is a virtual machine. Each .NET application
creates an instance of the CLR. This is getting outside of the scope
of this list. If you need more information I would research the
architecture of NET.

On Tue, Jan 24, 2012 at 11:41 AM, Black, Michael (IS)
 wrote:
> And what's your reference for that?
> It can't load your DLL if an already-same-named DLL is loaded by some other
> app.  Or is there another reference page from Microsoft which contradicts
> the one I sent which explains that?  If the sqlite guys would put the
> version# in the DLL name that would help a LOT.
>
>
>
>
> Michael D. Black
>
> Senior Scientist
>
> Advanced Analytics Directorate
>
> Advanced GEOINT Solutions Operating Unit
>
> Northrop Grumman Information Systems
>
> 
> From: sqlite-users-boun...@sqlite.org [sqlite-users-boun...@sqlite.org] on 
> behalf of Roosevelt Anderson [roosevelt.ander...@gmail.com]
> Sent: Tuesday, January 24, 2012 10:22 AM
> To: General Discussion of SQLite Database
> Subject: EXT :Re: [sqlite] C# amalgamation hand holding requested
>
> This is .NET development not regular Windows development. The .NET
> application most of the time will use the version of
> System.Data.SQLite.dll that is in the same directory as the executing
> application. The only time it will not use this version is if you load
> System.Data.SQLite.dll into the Global Assembly Cache which I do not
> recommend.
>
> On Tue, Jan 24, 2012 at 10:49 AM, Black, Michael (IS)
>  wrote:
>> Yes --  you do need to worry.
>>
>> Plusyou apparently should rename the DLL so it doesn't collide with any 
>> others from what I can discern from this:
>>
>> http://msdn.microsoft.com/en-us/library/windows/desktop/ms682586(v=vs.85).aspx
>>
>>
>>
>> Michael D. Black
>>
>> Senior Scientist
>>
>> Advanced Analytics Directorate
>>
>> Advanced GEOINT Solutions Operating Unit
>>
>> Northrop Grumman Information Systems
>>
>> 
>> From: sqlite-users-boun...@sqlite.org [sqlite-users-boun...@sqlite.org] on 
>> behalf of Don V Nielsen [donvniel...@gmail.com]
>> Sent: Tuesday, January 24, 2012 9:39 AM
>> To: General Discussion of SQLite Database
>> Subject: EXT :Re: [sqlite] C# amalgamation hand holding requested
>>
>> Ok.  So I am doing things correctly.  I am already doing things correctly.
>>  I am using the provided .NET dll.  I copy it to my local project.  And
>> when that project moves to production, it will be in the project's .bin
>> folder.  I should not have to worry about the dll hell associated with HP
>> and Quicken and what not.
>>
>> Thanks.  I was getting confused.
>>
>> dvn
>>
>>
>> On Mon, Jan 23, 2012 at 2:03 PM, Simon Slavin  wrote:
>>
>>>
>>> On 23 Jan 2012, at 7:39pm, Roosevelt Anderson wrote:
>>>
>>> > The C# compiler does not compile C. C# and VB.NET get compiled down to
>>> bytecode.
>>> >
>>> > On Mon, Jan 23, 2012 at 12:56 PM, Simon Slavin 
>>> wrote:
>>> >>
>>> >> On 23 Jan 2012, at 4:39pm, Roosevelt Anderson wrote:
>>> >>
>>> >>> You can't use the amalgamation directly in C# as the SQLite
>>> >>> amalgamation is in C.
>>> >>
>>> >> Can you not simply tell your compiler that '.c' files are C and not C#
>>> ?  That's what you do with Objective-C.  Or do C# compilers not compile C ?
>>>
>>> Ah.  So C# is not a superset of C.  That explains things.  Thanks.
>>>
>>> Simon.
>>> ___
>>> sqlite-users mailing list
>>> sqlite-users@sqlite.org
>>> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
>>>
>> ___
>> sqlite-users mailing list
>> sqlite-users@sqlite.org
>> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
>> ___
>> sqlite-users mailing list
>> sqlite-users@sqlite.org
>> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
> ___
> sqlite-users mailing list
> sqlite-users@sqlite.org
> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
> ___
> sqlite-users mailing list
> sqlite-users@sqlite.org
> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Found it

[John Elrick]

On Tue, Jan 24, 2012 at 12:06 PM, Richard Hipp  wrote:

> On Tue, Jan 24, 2012 at 11:59 AM, John Elrick  >wrote:
>
> > While reviewing our other thread, I noticed a piece of information
> > concerning sqlite3ResetInternalSchema.  Based on the number of times
> that I
> > reported it had been called, I believe that something was changed between
> > 3.7.5 and 3.7.6 which causes sqlite3ResetInternalSchema to be called when
> > it wasn't in the earlier version.   Is there some kind of enumeration of
> > what events would cause sqlite3ResetInternalSchema to be called in
> version
> > 3.7.5 vs 3.7.6?
> >
>
> I agree that the fact that the triggers are being reparsed is a big hint.
> But we still don't know why they are being reparsed.  And we still cannot
> reproduce the problem in a command-line shell - in only seems to occur
> within your Delphi app.
>
> Can you put a breakpoint on sqlite3ResetInternalSchema() and figure out
> from whence it is being called so often?
>
>

Just did.  Most of the calls are bubbling up from _sqlite3_step which I
mentioned before.  There are no new changes to the schema immediately prior
to these calls.  Here is one example where step triggers a call to
sqlite3ResetInternalSchema() (apologies for using Delphi and our wrappers,
but I hope it's clear):

  itsSaveTabsheet :=
itsDatabase.prepareExec('INSERT INTO TABSHEETS VALUES (null,
:workbookType, '
  + ':manifestOid, :surveyOid, :formDefinitionId, :prefKey, '
  + ':name, :originalName, :sequence, :columnList)');
...

function TDataServices.saveTabsheet(const tabsheetId, aWorkbookType,
manifestOid, surveyOid,
  formDefinitionOid, aPrefKey, aName, aSeq, aColumnList: string): string;
begin
  itsSaveTabsheet := itsSaveTabsheet;
  itsSaveTabsheet.bind(':workbookType', aWorkbookType);
  itsSaveTabsheet.bind(':manifestOid', manifestOid);
  itsSaveTabsheet.bind(':surveyOid', surveyOid);
  itsSaveTabsheet.bind(':formDefinitionId', StrToIntDef(formDefinitionOid,
0));
  itsSaveTabsheet.bind(':prefKey', aPrefKey);
  itsSaveTabsheet.bind(':name', aName);
  itsSaveTabsheet.bind(':originalName', aName);
  itsSaveTabsheet.bind(':sequence', aSeq);
  itsSaveTabsheet.bind(':columnList', aColumnList);
  itsSaveTabsheet.execute;
  result := IntToStr(itsDatabase.lastInsertRowId);
end;
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Found it

[Richard Hipp]

On Tue, Jan 24, 2012 at 11:59 AM, John Elrick wrote:

> While reviewing our other thread, I noticed a piece of information
> concerning sqlite3ResetInternalSchema.  Based on the number of times that I
> reported it had been called, I believe that something was changed between
> 3.7.5 and 3.7.6 which causes sqlite3ResetInternalSchema to be called when
> it wasn't in the earlier version.   Is there some kind of enumeration of
> what events would cause sqlite3ResetInternalSchema to be called in version
> 3.7.5 vs 3.7.6?
>

I agree that the fact that the triggers are being reparsed is a big hint.
But we still don't know why they are being reparsed.  And we still cannot
reproduce the problem in a command-line shell - in only seems to occur
within your Delphi app.

Can you put a breakpoint on sqlite3ResetInternalSchema() and figure out
from whence it is being called so often?


> ___
> sqlite-users mailing list
> sqlite-users@sqlite.org
> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
>



-- 
D. Richard Hipp
d...@sqlite.org
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Found it

[John Elrick]

While reviewing our other thread, I noticed a piece of information
concerning sqlite3ResetInternalSchema.  Based on the number of times that I
reported it had been called, I believe that something was changed between
3.7.5 and 3.7.6 which causes sqlite3ResetInternalSchema to be called when
it wasn't in the earlier version.   Is there some kind of enumeration of
what events would cause sqlite3ResetInternalSchema to be called in version
3.7.5 vs 3.7.6?
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] C# amalgamation hand holding requested

[Black, Michael (IS)]

And what's your reference for that?
It can't load your DLL if an already-same-named DLL is loaded by some other
app.  Or is there another reference page from Microsoft which contradicts
the one I sent which explains that?  If the sqlite guys would put the
version# in the DLL name that would help a LOT.




Michael D. Black

Senior Scientist

Advanced Analytics Directorate

Advanced GEOINT Solutions Operating Unit

Northrop Grumman Information Systems


From: sqlite-users-boun...@sqlite.org [sqlite-users-boun...@sqlite.org] on 
behalf of Roosevelt Anderson [roosevelt.ander...@gmail.com]
Sent: Tuesday, January 24, 2012 10:22 AM
To: General Discussion of SQLite Database
Subject: EXT :Re: [sqlite] C# amalgamation hand holding requested

This is .NET development not regular Windows development. The .NET
application most of the time will use the version of
System.Data.SQLite.dll that is in the same directory as the executing
application. The only time it will not use this version is if you load
System.Data.SQLite.dll into the Global Assembly Cache which I do not
recommend.

On Tue, Jan 24, 2012 at 10:49 AM, Black, Michael (IS)
 wrote:
> Yes --  you do need to worry.
>
> Plusyou apparently should rename the DLL so it doesn't collide with any 
> others from what I can discern from this:
>
> http://msdn.microsoft.com/en-us/library/windows/desktop/ms682586(v=vs.85).aspx
>
>
>
> Michael D. Black
>
> Senior Scientist
>
> Advanced Analytics Directorate
>
> Advanced GEOINT Solutions Operating Unit
>
> Northrop Grumman Information Systems
>
> 
> From: sqlite-users-boun...@sqlite.org [sqlite-users-boun...@sqlite.org] on 
> behalf of Don V Nielsen [donvniel...@gmail.com]
> Sent: Tuesday, January 24, 2012 9:39 AM
> To: General Discussion of SQLite Database
> Subject: EXT :Re: [sqlite] C# amalgamation hand holding requested
>
> Ok.  So I am doing things correctly.  I am already doing things correctly.
>  I am using the provided .NET dll.  I copy it to my local project.  And
> when that project moves to production, it will be in the project's .bin
> folder.  I should not have to worry about the dll hell associated with HP
> and Quicken and what not.
>
> Thanks.  I was getting confused.
>
> dvn
>
>
> On Mon, Jan 23, 2012 at 2:03 PM, Simon Slavin  wrote:
>
>>
>> On 23 Jan 2012, at 7:39pm, Roosevelt Anderson wrote:
>>
>> > The C# compiler does not compile C. C# and VB.NET get compiled down to
>> bytecode.
>> >
>> > On Mon, Jan 23, 2012 at 12:56 PM, Simon Slavin 
>> wrote:
>> >>
>> >> On 23 Jan 2012, at 4:39pm, Roosevelt Anderson wrote:
>> >>
>> >>> You can't use the amalgamation directly in C# as the SQLite
>> >>> amalgamation is in C.
>> >>
>> >> Can you not simply tell your compiler that '.c' files are C and not C#
>> ?  That's what you do with Objective-C.  Or do C# compilers not compile C ?
>>
>> Ah.  So C# is not a superset of C.  That explains things.  Thanks.
>>
>> Simon.
>> ___
>> sqlite-users mailing list
>> sqlite-users@sqlite.org
>> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
>>
> ___
> sqlite-users mailing list
> sqlite-users@sqlite.org
> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
> ___
> sqlite-users mailing list
> sqlite-users@sqlite.org
> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Found it

[John Elrick]

Addendum.  After looking further it appears that the reparsing is happening
independently of triggering.  In this case, the reparsing occurs 30,502
times for every view and trigger I have examined.  Only one trigger appears
in the 3.7.5 listing and it is parsed exactly 1 time.

3.7.5

CREATE TRIGGER error_warning_after_delete after delete on
local_errors_warnings begin   insert into local_error_warning_deletions
values( old.error_warning_oid);   update alerter_links
 set is_dirty = 1where sequence_instance_oid =
old.sequence_instance_oid  and response_definition_oid in(
select response_definition_oidfrom behavior_independents
where behavior_oid = old.behavior_oid); end
Times called:  1
Cumulative Allocated Memory:   5,960
Count of _malloc Calls:56
Cumulative Reallocated Memory: 0
Count of _realloc Calls:   0
Cumulative Reallocated Memory where nil:   0
Count of _realloc Calls where nil: 0
Count of _free Calls:  32
Cumulative _mallocs by size
<= 1kb:3,304 bytes (54 count; 61 avg)
1kb to 4kb:2,656 bytes (2 count; 1,328 avg)
4bk to 8kb:0 bytes (0 count; NAN avg)
8bk to 16kb:   0 bytes (0 count; NAN avg)
16bk to 32kb:  0 bytes (0 count; NAN avg)
32bk to 64kb:  0 bytes (0 count; NAN avg)
64bk to 128kb: 0 bytes (0 count; NAN avg)
128kb to 256kb:0 bytes (0 count; NAN avg)
256kb to 512kb:0 bytes (0 count; NAN avg)
512kb to 1024kb:   0 bytes (0 count; NAN avg)
> 1mb: 0 bytes (0 count; NAN avg)
No reallocs
No reallocs of nil pointers
---

3.7.6

CREATE TRIGGER error_warning_after_delete after delete on
local_errors_warnings begin   insert into local_error_warning_deletions
values( old.error_warning_oid);   update alerter_links
 set is_dirty = 1where sequence_instance_oid =
old.sequence_instance_oid  and response_definition_oid in(
select response_definition_oidfrom behavior_independents
where behavior_oid = old.behavior_oid); end
Times called:  30502
Cumulative Allocated Memory:   180,327,824
Count of _malloc Calls:1,708,112
Cumulative Reallocated Memory: 0
Count of _realloc Calls:   0
Cumulative Reallocated Memory where nil:   0
Count of _realloc Calls where nil: 0
Count of _free Calls:  976,064
Cumulative _mallocs by size
<= 1kb:99,314,512 bytes (1,647,108
count; 60 avg)
1kb to 4kb:81,013,312 bytes (61,004 count;
1,328 avg)
4bk to 8kb:0 bytes (0 count; NAN avg)
8bk to 16kb:   0 bytes (0 count; NAN avg)
16bk to 32kb:  0 bytes (0 count; NAN avg)
32bk to 64kb:  0 bytes (0 count; NAN avg)
64bk to 128kb: 0 bytes (0 count; NAN avg)
128kb to 256kb:0 bytes (0 count; NAN avg)
256kb to 512kb:0 bytes (0 count; NAN avg)
512kb to 1024kb:   0 bytes (0 count; NAN avg)
> 1mb: 0 bytes (0 count; NAN avg)
No reallocs
No reallocs of nil pointers
---
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Incompatible versions of SQLite on same system

[Joe Winograd]

Joe,

Good to know! I had been looking just for . I don't have access 
to the machine right now, but I do have a clone of its system drive, and a 
search for  turned up:


System.Data.SQLite.Linq.DLL (more than one copy)
System.Data.SQLite.DLL (more than one copy)
System.Data.SQLite64.DLL (probably because it's 64-bit W7)

At the time the clone was made, HP Connection Manager wasn't on it, but HP 
Power Assistant was, and the latter's directory in Program Files contains 
both  and , so there's a 
good chance that HP Connection Manager will have those, too (I am not 
willing to uninstall Intuit's TurboTax at this time, so there's no way to 
get HP Connection Manager installed to determine for sure what 
SQLite-related DLLs it installs). Regards, Joe


 Original Message 
Subject: Re: [sqlite] Incompatible versions of SQLite on same system
From: Joe Mistachkin 
To: 'General Discussion of SQLite Database' 
Date: Thu Jan 19 2012 10:06:09 GMT-0600 (Central Standard Time)

Another thing to keep in mind is that the System.Data.SQLite project
compiles
the native code for SQLite into files named "SQLite.Interop.dll" and
"System.Data.SQLite.dll" (mixed-mode assembly), depending on the build
configuration.


___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

[sqlite] Found it

[John Elrick]

Richard,

Your last request for some detailed information about what queries were
being processed did the trick.  Here is a description of the problem (and
yes, it appears to be in SQLite).

In 3.7.5, the number one malloc consumer is

INSERT INTO SEQUENCE_ELEMENTS
(
SEQUENCE_ELEMENT_OID,
SEQUENCE_ELEMENT_NAME,
definition_parent,
instance_parent
)
values
(
:SEQUENCE_ELEMENT_OID,
:SEQUENCE_ELEMENT_NAME,
:definition_parent,
:instance_parent
)

Times called:  1
Cumulative Allocated Memory:   12,856
Count of _malloc Calls:169
Cumulative Reallocated Memory: 13,544
Count of _realloc Calls:   24
Cumulative Reallocated Memory where nil:   0
Count of _realloc Calls where nil: 0
Count of _free Calls:  111
Cumulative _mallocs by size
<= 1kb:9,168 bytes (166 count; 55 avg)
1kb to 4kb:3,688 bytes (3 count; 1,229 avg)
4bk to 8kb:0 bytes (0 count; NAN avg)
8bk to 16kb:   0 bytes (0 count; NAN avg)
16bk to 32kb:  0 bytes (0 count; NAN avg)
32bk to 64kb:  0 bytes (0 count; NAN avg)
64bk to 128kb: 0 bytes (0 count; NAN avg)
128kb to 256kb:0 bytes (0 count; NAN avg)
256kb to 512kb:0 bytes (0 count; NAN avg)
512kb to 1024kb:   0 bytes (0 count; NAN avg)
> 1mb: 0 bytes (0 count; NAN avg)
Cumulative _reallocs by size
<= 1kb:1,272 bytes (20 count; 64 avg)
1kb to 4kb:12,272 bytes (4 count; 3,068 avg)
4bk to 8kb:0 bytes (0 count; NAN avg)
8bk to 16kb:   0 bytes (0 count; NAN avg)
16bk to 32kb:  0 bytes (0 count; NAN avg)
32bk to 64kb:  0 bytes (0 count; NAN avg)
64bk to 128kb: 0 bytes (0 count; NAN avg)
128kb to 256kb:0 bytes (0 count; NAN avg)
256kb to 512kb:0 bytes (0 count; NAN avg)
512kb to 1024kb:   0 bytes (0 count; NAN avg)
> 1mb: 0 bytes (0 count; NAN avg)
No reallocs of nil pointers
---

However, in 3.7.6, the following is the number one consumer of mallocs:

CREATE TRIGGER sequence_elements_after_insert after insert on
sequence_elements
begin
update sequence_elements set sort_key = sequence_element_oid where
sequence_element_oid  = new.sequence_element_oid and sort_key is null;
insert into responses (definition_parent, instance_parent, response_name,
prelisted_value) select de.data_element_oid, new.sequence_element_oid,
ag.initial_value, '' from data_elements de, attribute_groups ag where
de.definition_parent = new.definition_parent and de.attribute_group =
ag.attribute_group_name;
insert or ignore into altered_sequences values(new.definition_parent);
end
Times called:  30502
Cumulative Allocated Memory:   255,240,736
Count of _malloc Calls:3,080,702
Cumulative Reallocated Memory: 3,904,256
Count of _realloc Calls:   30,502
Cumulative Reallocated Memory where nil:   0
Count of _realloc Calls where nil: 0
Count of _free Calls:  1,799,618
Cumulative _mallocs by size
<= 1kb:174,227,424 bytes (3,019,698
count; 58 avg)
1kb to 4kb:81,013,312 bytes (61,004 count;
1,328 avg)
4bk to 8kb:0 bytes (0 count; NAN avg)
8bk to 16kb:   0 bytes (0 count; NAN avg)
16bk to 32kb:  0 bytes (0 count; NAN avg)
32bk to 64kb:  0 bytes (0 count; NAN avg)
64bk to 128kb: 0 bytes (0 count; NAN avg)
128kb to 256kb:0 bytes (0 count; NAN avg)
256kb to 512kb:0 bytes (0 count; NAN avg)
512kb to 1024kb:   0 bytes (0 count; NAN avg)
> 1mb: 0 bytes (0 count; NAN avg)
Cumulative _reallocs by size
<= 1kb:3,904,256 bytes (30,502 count;
128 avg)
1kb to 4kb:0 bytes (0 count; NAN avg)
4bk to 8kb:0 bytes (0 count; NAN avg)
8bk to 16kb:   0 bytes (0 count; NAN avg)
16bk to 32kb:  0 bytes (0 count; NAN avg)
32bk to 64kb:  0 bytes (0 count; NAN avg)
64bk to 128kb: 0 bytes (0 count; NAN avg)
128kb to 256kb:0 bytes (0 count; NAN avg)
256kb to

Re: [sqlite] C# amalgamation hand holding requested

[Roosevelt Anderson]

This is .NET development not regular Windows development. The .NET
application most of the time will use the version of
System.Data.SQLite.dll that is in the same directory as the executing
application. The only time it will not use this version is if you load
System.Data.SQLite.dll into the Global Assembly Cache which I do not
recommend.

On Tue, Jan 24, 2012 at 10:49 AM, Black, Michael (IS)
 wrote:
> Yes --  you do need to worry.
>
> Plusyou apparently should rename the DLL so it doesn't collide with any 
> others from what I can discern from this:
>
> http://msdn.microsoft.com/en-us/library/windows/desktop/ms682586(v=vs.85).aspx
>
>
>
> Michael D. Black
>
> Senior Scientist
>
> Advanced Analytics Directorate
>
> Advanced GEOINT Solutions Operating Unit
>
> Northrop Grumman Information Systems
>
> 
> From: sqlite-users-boun...@sqlite.org [sqlite-users-boun...@sqlite.org] on 
> behalf of Don V Nielsen [donvniel...@gmail.com]
> Sent: Tuesday, January 24, 2012 9:39 AM
> To: General Discussion of SQLite Database
> Subject: EXT :Re: [sqlite] C# amalgamation hand holding requested
>
> Ok.  So I am doing things correctly.  I am already doing things correctly.
>  I am using the provided .NET dll.  I copy it to my local project.  And
> when that project moves to production, it will be in the project's .bin
> folder.  I should not have to worry about the dll hell associated with HP
> and Quicken and what not.
>
> Thanks.  I was getting confused.
>
> dvn
>
>
> On Mon, Jan 23, 2012 at 2:03 PM, Simon Slavin  wrote:
>
>>
>> On 23 Jan 2012, at 7:39pm, Roosevelt Anderson wrote:
>>
>> > The C# compiler does not compile C. C# and VB.NET get compiled down to
>> bytecode.
>> >
>> > On Mon, Jan 23, 2012 at 12:56 PM, Simon Slavin 
>> wrote:
>> >>
>> >> On 23 Jan 2012, at 4:39pm, Roosevelt Anderson wrote:
>> >>
>> >>> You can't use the amalgamation directly in C# as the SQLite
>> >>> amalgamation is in C.
>> >>
>> >> Can you not simply tell your compiler that '.c' files are C and not C#
>> ?  That's what you do with Objective-C.  Or do C# compilers not compile C ?
>>
>> Ah.  So C# is not a superset of C.  That explains things.  Thanks.
>>
>> Simon.
>> ___
>> sqlite-users mailing list
>> sqlite-users@sqlite.org
>> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
>>
> ___
> sqlite-users mailing list
> sqlite-users@sqlite.org
> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
> ___
> sqlite-users mailing list
> sqlite-users@sqlite.org
> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] C# amalgamation hand holding requested

[Black, Michael (IS)]

Yes --  you do need to worry.

Plusyou apparently should rename the DLL so it doesn't collide with any 
others from what I can discern from this:

http://msdn.microsoft.com/en-us/library/windows/desktop/ms682586(v=vs.85).aspx



Michael D. Black

Senior Scientist

Advanced Analytics Directorate

Advanced GEOINT Solutions Operating Unit

Northrop Grumman Information Systems


From: sqlite-users-boun...@sqlite.org [sqlite-users-boun...@sqlite.org] on 
behalf of Don V Nielsen [donvniel...@gmail.com]
Sent: Tuesday, January 24, 2012 9:39 AM
To: General Discussion of SQLite Database
Subject: EXT :Re: [sqlite] C# amalgamation hand holding requested

Ok.  So I am doing things correctly.  I am already doing things correctly.
 I am using the provided .NET dll.  I copy it to my local project.  And
when that project moves to production, it will be in the project's .bin
folder.  I should not have to worry about the dll hell associated with HP
and Quicken and what not.

Thanks.  I was getting confused.

dvn


On Mon, Jan 23, 2012 at 2:03 PM, Simon Slavin  wrote:

>
> On 23 Jan 2012, at 7:39pm, Roosevelt Anderson wrote:
>
> > The C# compiler does not compile C. C# and VB.NET get compiled down to
> bytecode.
> >
> > On Mon, Jan 23, 2012 at 12:56 PM, Simon Slavin 
> wrote:
> >>
> >> On 23 Jan 2012, at 4:39pm, Roosevelt Anderson wrote:
> >>
> >>> You can't use the amalgamation directly in C# as the SQLite
> >>> amalgamation is in C.
> >>
> >> Can you not simply tell your compiler that '.c' files are C and not C#
> ?  That's what you do with Objective-C.  Or do C# compilers not compile C ?
>
> Ah.  So C# is not a superset of C.  That explains things.  Thanks.
>
> Simon.
> ___
> sqlite-users mailing list
> sqlite-users@sqlite.org
> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
>
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] replying to thread

[David Henry]

Testing with Microsoft Outlook

___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] C# amalgamation hand holding requested

[Don V Nielsen]

Ok.  So I am doing things correctly.  I am already doing things correctly.
 I am using the provided .NET dll.  I copy it to my local project.  And
when that project moves to production, it will be in the project's .bin
folder.  I should not have to worry about the dll hell associated with HP
and Quicken and what not.

Thanks.  I was getting confused.

dvn


On Mon, Jan 23, 2012 at 2:03 PM, Simon Slavin  wrote:

>
> On 23 Jan 2012, at 7:39pm, Roosevelt Anderson wrote:
>
> > The C# compiler does not compile C. C# and VB.NET get compiled down to
> bytecode.
> >
> > On Mon, Jan 23, 2012 at 12:56 PM, Simon Slavin 
> wrote:
> >>
> >> On 23 Jan 2012, at 4:39pm, Roosevelt Anderson wrote:
> >>
> >>> You can't use the amalgamation directly in C# as the SQLite
> >>> amalgamation is in C.
> >>
> >> Can you not simply tell your compiler that '.c' files are C and not C#
> ?  That's what you do with Objective-C.  Or do C# compilers not compile C ?
>
> Ah.  So C# is not a superset of C.  That explains things.  Thanks.
>
> Simon.
> ___
> sqlite-users mailing list
> sqlite-users@sqlite.org
> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
>
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] ftruncate implementation

[Simon Slavin]

On 24 Jan 2012, at 6:43am, David Henry wrote:

> I am working without an operating system so there are no other agents trying
> to steal data.

You're writing an operating system ?  That can be lots of fun.  Good luck.

> Bearing that in mind, is it still necessary to actually write
> zero data to the sectors allocated? Is SQLite expecting it?

I haven't looked though the code with that in mind, but as far as I know, 
SQLite does not make any assumption about what will be in newly-assigned 
sectors.  If it wants zeros there it'll write them itself.

It is ftruncate itself which chooses to write zeros to any newly-assigned pages 
of disk space.  This is part of the specification of ftruncate, and documented 
here:



If your version of ftruncate doesn't write the zeros, you haven't implemented 
ftruncate properly.  But if you're not trying to reproduce UNIX, I guess it 
doesn't matter.

Simon.
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] storing and comparing dates in sqlite

[Nick Shaw]

It's your choice, really.  You could store it as TEXT, in some standardised 
format (e.g. XML dateTime format: -mm-ddThh:mm:ss. plus a timezone 
offset if you wanted) or your own format, and query it back as text, or you 
could store it in UNIX integer time (seconds since unix epoch (01/01/1970)) - 
so in an INTEGER field, etc.  Depends how you're going to use it.  Either way 
I've suggested has pros/cons. 

Nick.

-Original Message-
From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] 
On Behalf Of dotolee
Sent: 23 January 2012 18:01
To: sqlite-users@sqlite.org
Subject: Re: [sqlite] storing and comparing dates in sqlite


can you point me in the right direction? 
aka.  what data type am i using to store the date in my sqlite database? is 
TEXT correct? 
how do I do a select on it? 
thanks.


Stephan Beal-3 wrote:
> 
> On Mon, Jan 23, 2012 at 6:51 PM, dotolee  wrote:
> 
>>
>> i'm new to sqlite... and relatively new to php.  just wondering what 
>> the best way is to store and compare dates.
>>
> 
> For any given 10 developers you'll likely hear 11 opinions on this topic.
> IMO Unix timestamps are the most portable form out there. "Portable"
> meaning, in this context, the ability to work with them (more or less
> easily) in a wide variety of contexts.
> 
> 
> --
> - stephan beal
> http://wanderinghorse.net/home/stephan/
> http://gplus.to/sgbeal
> ___
> sqlite-users mailing list
> sqlite-users@sqlite.org
> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
> 
> 

--
View this message in context: 
http://old.nabble.com/storing-and-comparing-dates-in-sqlite-tp33189769p33189862.html
Sent from the SQLite mailing list archive at Nabble.com.

___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] replying to thread

[Larry Brasfield]

If you have an email client that can handle "mailto:"-prefixed link in 
the web page, the one just to the right of the respondee's name under 
the page title, it will get the right reference to link your response to 
the preceding post/email.  Mozilla's Thunderbird is one such client, but 
many other can do this.


Cheers,
--
Larry Brasfield
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] ftruncate implementation

[Roger Binns]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 23/01/12 22:43, David Henry wrote:
> I am working without an operating system so there are no other agents
> trying to steal data. Bearing that in mind, is it still necessary to
> actually write zero data to the sectors allocated? Is SQLite expecting
> it?

You should ensure that your operating system still reports free space
correctly to all other file system users (ie the space is actually
allocated).  For example on traditional Unix file systems you can open a
file, seek to 1TB and write one byte.  The file system will not report 1TB
less free space.  If you read in the space you'll get zeroes back.  As you
write it will come out of free space.  But if the disk only had 10MB free
you'll suddenly find writes failing even though you "allocated" the space.
 Trying to recover will get hairy depending on what writes will succeed or
fail as the mess is cleaned up.  You could (in theory, maybe not in
practise) get the database into a state where SQLite can't put it back
into a clean state by applying journals.

Roger
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (GNU/Linux)

iEYEARECAAYFAk8eZhEACgkQmOOfHg372QQBoQCfS7bsoSk+M8Irqv6ZTAElm3BC
u0wAnjL8w6OblWe/dTI67PhIfsgxqD1n
=DoRG
-END PGP SIGNATURE-
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users