[sqlite] [ANN] rq-2.3.3

2006-06-08 Thread Ara.T.Howard
NAME rq v2.3.3 SYNOPSIS rq (queue | export RQ_Q=q) mode [mode_args]* [options]* URIS http://codeforpeople.com/lib/ruby/rq/ http://raa.ruby-lang.org/project/rq/ http://www.linuxjournal.com/article/7922 DESCRIPTION ruby queue (rq) is a zero-admin zero-configuration tool used to cre

[sqlite] [ANN] rq-2.3.2

2006-04-28 Thread Ara.T.Howard
NAME rq v2.3.2 SYNOPSIS rq (queue | export RQ_Q=q) mode [mode_args]* [options]* URIS http://raa.ruby-lang.org/project/rq/ http://codeforpeople.com/lib/ruby/rq/rq-2.3.2/README http://www.linuxjournal.com/article/7922 DESCRIPTION ruby queue (rq) is a zero-admin zero-configuration to

Re: [sqlite] Database locked after crash

2005-05-17 Thread Ara.T.Howard
On Tue, 17 May 2005, Jaap Krabbendam wrote: I have been simulating a crash during a transaction. After BEGIN, at some point I do exit(-1) instead of COMMIT or ROLLBACK in order to simulate a crash. After that, I can see that a -journal file is present. If I restart my executable, it seems that the

Re: [sqlite] Multiuser SQLITE_LOCKED error syncronization idea

2005-05-09 Thread Ara.T.Howard
On Mon, 9 May 2005, Helmut Tschemernjak wrote: Hello, sqlite3 3.2.1 gives SQLITE_LOCKED errors if one process updates the database and another accesses it. Most retries will fail if the other processes is working e.g. many inserts. Here is my idea: Keep a list of up to 32 pid_t of waiting processes

Re: [sqlite] Newbie problem with locks and DB repair

2005-05-04 Thread Ara.T.Howard
On Tue, 3 May 2005, Tom Shaw wrote: At 6:09 PM -0400 5/3/05, D. Richard Hipp wrote: On Tue, 2005-05-03 at 17:45 -0400, Tom Shaw wrote: Hi. I was using SQLite with PHP 5 (MacOSX) and due to some issues the php page timedout before completing the DB update. Now I can't read the DB via php nor via

Re: [sqlite] backup open database

2005-05-02 Thread Ara.T.Howard
On Sun, 1 May 2005, D. Richard Hipp wrote: On Sun, 2005-05-01 at 00:28 +0800, Damian Slee wrote: i want to make a copy of a sqlite3 database file while it is open. is there anyway that i can tell programatically that any caches/journals are flushed out? or is there any way to get and exclusive loc

Re: [sqlite] determining all tables and fieldnames in a db

2005-04-28 Thread Ara.T.Howard
On Thu, 28 Apr 2005 [EMAIL PROTECTED] wrote: Try "select * from sqlite-master"; Regards, look good... that combined with 'pragma table_info'... this is o.k. for 2.8.x AND 3.x.x ?? cheers. -a -- === | email :: ara [dot]

[sqlite] determining all tables and fieldnames in a db

2005-04-28 Thread Ara.T.Howard
is there a query that can be run against 2.8.x and 3.x dbs that will return something like tablename | fieldname | fieldname | fieldname for example given create table foo ( a, b ); create table bar ( x, y, z ); this should return foo|a|b|NULL bar|x|y|z another alt

Re: [sqlite] atomic db replacement

2005-03-21 Thread Ara.T.Howard
On Fri, 18 Mar 2005, Eli Burke wrote: How about using a second in-memory database for your modifications, then using ATTACH to merge the changes. I'm fairly sure I remember Dr. Hipp stating that moving complete rows between attached database tables is very speedy. Depending on the particulars of yo

Re: [sqlite] atomic db replacement

2005-03-21 Thread Ara.T.Howard
On Fri, 18 Mar 2005, Andrew Piskorski wrote: If besides that one slow update you had ONLY READS (and those reads do not care which version of the data they get, old or new), I'd say sure, fine, an atomic "swap in a totally new db" operation might be worth trying. But for a database with active read

Re: [sqlite] atomic db replacement

2005-03-21 Thread Ara.T.Howard
On Fri, 18 Mar 2005, Lothar [unknown-8bit] Märkle wrote: sqlite3_exec(db, "BEGIN EXCLUSIVE TRANSACTION", NULL, NULL, error); copyFiles(); sqlite3_exec(db, "COMMIT", NULL, NULL, error); i think you have to use sqlite3_close to be shure all data is written. then copy. Also are you sure it is complete

Re: [sqlite] atomic db replacement

2005-03-17 Thread Ara.T.Howard
On Sat, 12 Mar 2005, Andrew Piskorski wrote: On Sat, Mar 12, 2005 at 10:03:25AM -0700, Ara.T.Howard wrote: does anyone have a strategy for doing massive updates to a db and atomicly replacing it in a multi-process situation? Why would you want to do that? SQLite properly supports transactions, so

[sqlite] atomic db replacement

2005-03-12 Thread Ara.T.Howard
does anyone have a strategy for doing massive updates to a db and atomicly replacing it in a multi-process situation? cheers. -a -- === | EMAIL :: Ara [dot] T [dot] Howard [at] noaa [dot] gov | PHONE :: 303.497.6469 |

Re: [sqlite] Mac OS X and SQLite Locking

2005-01-04 Thread Ara.T.Howard
On Tue, 4 Jan 2005, Steve Milner wrote: Hello List, I am having a problem with SQLite erroring out on Mac OS X. I am using 3.0.8. The problem happens when it tries to access a SAMBA/CIFS shared database. In my testing Windows to Linux and Linux to Windows worked fine, but Mac to Windows fails wi

Re: [sqlite] Row count in database

2004-12-15 Thread Ara.T.Howard
On Wed, 15 Dec 2004, Christopher Petrilli wrote: One thing I've noticed is that if I turn of synchronous, the filesystem slowly slows down, which is fun, but it doesn't do so enough that it's a major issue. I'm using the APSW wrapper for Python, which is basically a very thin wrapper over the basic

Re: [sqlite] Row count in database

2004-12-14 Thread Ara.T.Howard
On Tue, 14 Dec 2004, Christopher Petrilli wrote: On Tue, 14 Dec 2004 12:03:01 -0700 (MST), Ara.T.Howard <[EMAIL PROTECTED]> wrote: On Tue, 14 Dec 2004, Christopher Petrilli wrote: Has anyone had any experience in storing a million or more rows in a SQLite3 database? I've got a databas

Re: [sqlite] Row count in database

2004-12-14 Thread Ara.T.Howard
On Tue, 14 Dec 2004, Christopher Petrilli wrote: Has anyone had any experience in storing a million or more rows in a SQLite3 database? I've got a database that I've been building, which gets 250 inserts/second, roughly, and which has about 3M rows in it. At that point, the CPU load is huge. Note

Re: [sqlite] NULL values with NOT NULL constraint

2004-12-08 Thread Ara.T.Howard
On Wed, 8 Dec 2004, D. Richard Hipp wrote: Ara.T.Howard wrote: Has anyone seen anything like this and can suggest possible causes? does your code fork? Ooo. That sounds like the voice of experience speaking. :-) I should add forking to the documented list of ways to corrupt your database file. i

Re: [sqlite] NULL values with NOT NULL constraint

2004-12-08 Thread Ara.T.Howard
On Wed, 8 Dec 2004, Michael Robinette wrote: I have table somewhat like this created by sqlite 2.8.14: create table t1( created timestamp not null, n int not null, url text not null, primary key(n) ); somehow i've ended up with a database where .dump t1 produces a bunch of insert into t1 values(NUL

Re: [sqlite] SQL "IS" operator. Was: field=null vs. field isnull

2004-12-01 Thread Ara.T.Howard
On Wed, 1 Dec 2004, D. Richard Hipp wrote: I have lately noticed a need for an "IS" operator in SQLite. IS would work just like "=" for most things. The difference is that "IS" would compares NULLs as equals. There would, of course, need to be a corresponding "IS NOT" operator. You can already us

[sqlite] pragma allbytes; pragma locks_block;

2004-12-01 Thread Ara.T.Howard
every month or so someone seems to write in with 'database locked' questions. is there any good reason a pragma could not be added to lock the file in a blocking fashion (pragma locks_block) lock the whole file vs. byte range locking (pragma allbytes) ?? i realize this yields lower performance

Re: [sqlite] field=null vs. field isnull

2004-12-01 Thread Ara.T.Howard
On Wed, 1 Dec 2004, Brass Tilde wrote: i've read the 'null handling' section and still not found the answer to this question: why should 'select * from tbl where field=null' be any different from 'select * from tbl where field isnull' The short answer is "because it's different". A

Re: [sqlite] Locking database

2004-12-01 Thread Ara.T.Howard
On Wed, 1 Dec 2004, Alexander Jordanov wrote: this is getting a bit of off thread so if anyone is annoyed please speak up. I can't really make that because in PHP i can't set a global variable that will be available for anyone that uses the script. If i set a variable and change it in the script th

[sqlite] field=null vs. field isnull

2004-12-01 Thread Ara.T.Howard
i've read the 'null handling' section and still not found the answer to this question: why should 'select * from tbl where field=null' be any different from 'select * from tbl where field isnull' using 2.8.15 it seems to be: jib:~ > sqlite db 'create table tbl(field); insert into tbl

Re: [sqlite] Locking database

2004-12-01 Thread Ara.T.Howard
On Tue, 30 Nov 2004, Alexander Jordanov wrote: I am 100% sure that my all my queries go trought that class. Unfortunatelly it is too late to make such changes ('forces the user to specify whether the transaction is write or read') - i have too many scripts to change. make every single sql executio

Re: [sqlite] Locking database

2004-12-01 Thread Ara.T.Howard
On Wed, 24 Nov 2004, Alexander Jordanov wrote: @Ara.T.Howard: Thanks for the suggestion i will try it and hope the database will not lock again... Here is what i did: clearstatcache (); if ($sql[0]=='S'){ $fp=fopen('ko

Re: [sqlite] Locking database

2004-11-23 Thread Ara.T.Howard
On Tue, 23 Nov 2004, Alexander Jordanov wrote: Hi i have an SQLite database file that gets locked from time to time and some parts of the site that uses the sqlite cannot be accesed. For what i know the SQLite database uses the OS locking mechanism. So my question is: Is there any way to unlock it

Re: [sqlite] SQLite For Personal Use

2004-11-05 Thread Ara.T.Howard
On Fri, 5 Nov 2004, Jeff Flowers wrote: Is anyone using SQLite to manange personal data; not as part of another program but by itself, as distributed with the sqlite frontend? I searched Google but no one seems to be talking about SQLite as a program by itself. i do. anytime i have to manage data

Re: [sqlite] Locking enhancments

2004-10-04 Thread Ara.T.Howard
On Mon, 4 Oct 2004, D. Richard Hipp wrote: but still, there are no blocking locks correct? and, by extension, beginning a transaction could still result in busy being returned correct? regards. -a -- === | EMAIL :: Ara

Re: [sqlite] Error compiling example

2004-09-29 Thread Ara.T.Howard
On Wed, 29 Sep 2004, Max wrote: You need to link against the SQLite library: $ gcc pippo.c -o pippo -lsqlite Nothing the result is the same .. you need to link against the sqlite version 3 library (you've probably succesfully linked against a version 2 library on your system). try something like

Re: [sqlite] Ruby - SQLite 3.0.7

2004-09-29 Thread Ara.T.Howard
On Wed, 29 Sep 2004, Federico Granata wrote: Hi I'm looking for a sqlite 3.0.7 wrapper for ruby (nothin found with wiki). sqlite 2.x series is at http://sqlite-ruby.rubyforge.org/ i think 3.x is in the work by jamis buck, if not i'll proably attack in a month or so. -a -- ==

Re: [sqlite] Lock files....

2004-09-24 Thread Ara.T.Howard
On Fri, 24 Sep 2004, Eddy Macnaghten wrote: An attraction of SQLite is that it is all client based - making almost practically zero cost administration. Although this is not an issue on implementations that have an IT department, it makes a BIG difference in supporting the penny-ally implementatio

Re: [sqlite] Lock files....

2004-09-24 Thread Ara.T.Howard
On Fri, 24 Sep 2004, Matt Sergeant wrote: On 24 Sep 2004, at 17:43, Ara.T.Howard wrote: On Fri, 24 Sep 2004, Matt Sergeant wrote: On 24 Sep 2004, at 14:51, Ara.T.Howard wrote: What are people's views on this? i think it's sufficiently common to merit discussion on best practices at l

Re: [sqlite] Lock files....

2004-09-24 Thread Ara.T.Howard
On Fri, 24 Sep 2004, David Fletcher wrote: Hi all, http://opendlm.sourceforge.net might be an interesting place to start. great link. thanks! -a -- === | EMAIL :: Ara [dot] T [dot] Howard [at] noaa [dot] gov | PHONE ::

Re: [sqlite] Lock files....

2004-09-24 Thread Ara.T.Howard
On Fri, 24 Sep 2004, Matt Sergeant wrote: On 24 Sep 2004, at 14:51, Ara.T.Howard wrote: What are people's views on this? i think it's sufficiently common to merit discussion on best practices at least. More than that, I'm thinking there might be a call for an os_nfs.c that uses

Re: [sqlite] Lock files....

2004-09-24 Thread Ara.T.Howard
On Fri, 24 Sep 2004, Eddy Macnaghten wrote: There is no way I can guarantee the "nfs" to be good. Also, a mixture of Linux and Windows clients need to be allowed for, I do not know how SAMBA supports the fcntl functionality, or how well it interfaces with the Windows Server or Client locking mecha

Re: [sqlite] Lock files....

2004-09-24 Thread Ara.T.Howard
On Fri, 24 Sep 2004, Eddy Macnaghten wrote: However, reading the documentation it seems that SQLite is not hot on concurrent access through networks, or across platforms, due to the funnies of fcntl, or incompatibilities between Windows and Linux and so on. it works o.k. if your nfs impl is good (n

Re: [sqlite] is it o.k. to close database handle in both child and parent

2004-09-22 Thread Ara.T.Howard
On Wed, 22 Sep 2004, D. Richard Hipp wrote: Ara.T.Howard wrote: On Sat, 18 Sep 2004, Ara.T.Howard wrote: say you have the following logic: begin transaction in parent if pid = fork commit transaction close database else close database ... end I do not know what will happen

Re: [sqlite] is it o.k. to close database handle in both child and parent

2004-09-22 Thread Ara.T.Howard
On Sat, 18 Sep 2004, Ara.T.Howard wrote: say you have the following logic: begin transaction in parent if pid = fork commit transaction close database else close database ... end should this be o.k.? i notice the unlink of the db-journal will happen twice - which should be

[sqlite] is it o.k. to close database handle in both child and parent

2004-09-18 Thread Ara.T.Howard
say you have the following logic: begin transaction in parent if pid = fork commit transaction close database else close database ... end should this be o.k.? i notice the unlink of the db-journal will happen twice - which should be o.k. but will flush/sync operat

Re: [sqlite] [SOLVED] Re: [sqlite] nfs 'sillynames'

2004-09-16 Thread Ara.T.Howard
On Thu, 16 Sep 2004 [EMAIL PROTECTED] wrote: If this were implemented, it would remove the capability to go into the background. A common thing for a daemon process to do upon start-up is to get everything initialized (e.g. open databases and do other things that could fail and would need to be re

[sqlite] [SOLVED] Re: [sqlite] nfs 'sillynames'

2004-09-16 Thread Ara.T.Howard
On Fri, 3 Sep 2004, John LeSueur wrote: a followup on this post: i was running some straces on sqlite while it using transactions and think i may have found the source of the problem, we see this in in the strace output: ... ... close(5)= 0 unlink("/dmsp/m

Re: [sqlite] nfs 'sillynames'

2004-09-04 Thread Ara.T.Howard
On Sat, 4 Sep 2004, Ara.T.Howard wrote: On Fri, 3 Sep 2004, John LeSueur wrote: I think this file is created everytime you start a transaction. Maybe even if you only perform read only commands. The journal is what is used to keep track of the changes to the database. Anyone else have any

Re: [sqlite] nfs 'sillynames'

2004-09-04 Thread Ara.T.Howard
On Fri, 3 Sep 2004, John LeSueur wrote: I think this file is created everytime you start a transaction. Maybe even if you only perform read only commands. The journal is what is used to keep track of the changes to the database. Anyone else have any thoughts? yes - it is. the thing is, unless a

Re: [sqlite] nfs 'sillynames'

2004-09-03 Thread Ara.T.Howard
On Fri, 3 Sep 2004, Ara.T.Howard wrote: if you are unfamiliar with nfs sillynames, they occur when a file that is open on one client is removed or renamed on another. i am seeing alot of these appear in an NFS directory i'm using to store a sqlite database acessed by many clients. the a

[sqlite] nfs 'sillynames'

2004-09-03 Thread Ara.T.Howard
if you are unfamiliar with nfs sillynames, they occur when a file that is open on one client is removed or renamed on another. i am seeing alot of these appear in an NFS directory i'm using to store a sqlite database acessed by many clients. the access protocol is a meta-transaction wrapped around

RE: [sqlite] One more question on the C API performance

2004-09-03 Thread Ara.T.Howard
On Fri, 3 Sep 2004, Zahraie Ramin-p96152 wrote: -Original Message- From: John LeSueur [mailto:[EMAIL PROTECTED] Sent: Friday, September 03, 2004 11:09 AM To: [EMAIL PROTECTED] Subject: Re: [sqlite] One more question on the C API performance A 1000 rows of data return instantaneously. How

Re: [sqlite] Locking in 3.0.5

2004-09-01 Thread Ara.T.Howard
On Wed, 1 Sep 2004, Christian Smith wrote: A transaction gives you a snapshot in time of the database. You may need to do more than one query, and require a consistent snapshot for the duration of the multiple queries. this is definitely a real world need - in my latest code i have a 'snapshot' met

Re: [sqlite] Script perl e python, I can't open database from sqlite

2004-08-25 Thread Ara.T.Howard
On Wed, 25 Aug 2004, D. Richard Hipp wrote: Ara.T.Howard wrote: On Tue, 24 Aug 2004, D. Richard Hipp wrote: The more people use SQLite version 3, the faster it will leave beta status in particular, which features would you say need tested? i have many uses for sqlite, perhaps i may be able

Re: [sqlite] Script perl e python, I can't open database from sqlite

2004-08-24 Thread Ara.T.Howard
On Tue, 24 Aug 2004, D. Richard Hipp wrote: Mauricio Piacentini wrote: I will update SQLiteBrowser to use version 3 when it leaves beta status The more people use SQLite version 3, the faster it will leave beta status in particular, which features would you say need tested? i have many u

Re: [sqlite] Re: [Pysqlite-devel] Re: [sqlite] Python bindings for sqlite 3

2004-08-24 Thread Ara.T.Howard
On Tue, 24 Aug 2004, D. Richard Hipp wrote: Matt Wilson wrote: Normally python programmers would like to see named arguments in dictionary substation format: d = { 'blob': 'a\0b', 'id': 2 } cursor.execute("UPDATE t1 SET value=%(bigblob)s WHERE rowid=%(id)d", d) I'd be willing to extend the lexer/pa

Re: [sqlite] locking via windows nfs client

2004-08-20 Thread Ara.T.Howard
On Fri, 20 Aug 2004, Elmar Haneke wrote: ssh only. period. nothing gets in or out except on 22. You can forward the database-access through an SSH-tunnel. can you do this using passphrases in a manner that works across reboots w/o embedding passphrases? i can't figure out how to - at some point

[sqlite] [OT] Re: [sqlite] locking via windows nfs client

2004-08-20 Thread Ara.T.Howard
On Fri, 20 Aug 2004, Matt Sergeant wrote: Right, but regardless of what locking you ADD to the system, sqlite is still going to do the lockd NFS locking itself. At least until you provide patches to make NFS locking safe :-) my current scheme, which may not be entirly fool proof, i first obtain a r

Re: [sqlite] locking via windows nfs client

2004-08-20 Thread Ara.T.Howard
On Fri, 20 Aug 2004, Andrew Piskorski wrote: On Fri, Aug 20, 2004 at 08:45:06AM -0600, Ara.T.Howard wrote: On Fri, 20 Aug 2004, Matt Sergeant wrote: As far as linux -> nfs access goes it all depends on the quality of the NFS implementation, and the kernel drivers you're using. It'

Re: [sqlite] locking via windows nfs client

2004-08-20 Thread Ara.T.Howard
On Fri, 20 Aug 2004, Matt Sergeant wrote: As far as linux -> nfs access goes it all depends on the quality of the NFS implementation, and the kernel drivers you're using. It's not easy to create a stable NFS locking system. We've had lots of problems with it. If you can, go with local disk. i canno

[sqlite] locking via windows nfs client

2004-08-18 Thread Ara.T.Howard
has anyone out there used sqlite from a windows machine when the db resided on an nfs filesystem mounted using the windows nfs client? if so, does it work? have you attempted concurrent access from other windows machines? other *nix machines? i'm considering an application where process from both

Re: [sqlite] Shared Memory Database not working....

2004-08-04 Thread Ara.T.Howard
On Wed, 4 Aug 2004, Rajesh Nagarajan wrote: Hi I am trying to move to memory database from file based sqlite db, I want my memory database to be shared across various threads in my process. How do I do it? From the Wiki documentation, I found the following * (defvar db2 (sql:connect '(":memory:")

Re: [sqlite] force unlocking?

2004-08-03 Thread Ara.T.Howard
On Mon, 2 Aug 2004, Tito Ciuro wrote: Hello Ara, On 2 ago 2004, at 9:59, Ara.T.Howard wrote: the simplest way to do this is to create a file for each db, say db.lock, and to apply a blocking read/write to this file depending on the intent of your operation. the contents of this file are not

Re: [sqlite] force unlocking?

2004-08-02 Thread Ara.T.Howard
On Mon, 2 Aug 2004, Oliver Harvey wrote: hello all, we have many thousands of sqlite databases reporting 'database is locked'. then your access is occuring at a moment when another process is also using the database in a way that prevents aquiring the correct type of lock. sqlite uses non-blockin

[sqlite] db recovery

2004-07-23 Thread Ara.T.Howard
somehow i've managed to corrupt my db - the error was ./src/pager.c:1179: syncJournal: Assertion `pPager->nRec*pgSz+hdrSz==jSz' failed. running PRAGMA integrity_check yields something like carp:~/eg/ruby/rq/rq-0.1.2 > sqlite q 'PRAGMA integrity_check' | head *** in database main *** On page

Re: [sqlite] Improved Interpreter in latest SQLite version?

2004-07-20 Thread Ara.T.Howard
On Mon, 19 Jul 2004, gohaku wrote: Hello everyone, I am currently using SQLite v2.8.11. I have not had much experience with SQLite other than executing simple Queries and Updates. I don't have any problems with SQLite v2.8.11 and as such, have not upgraded to v3.0.2 I would like to know if v3.0.2 h