Hi there,
I am a huge fan of SQLIte and have recently done some code that I am
debugging with TotalView and MemoryScape (http://www.roguewave.com) -
VERY VERY nice debugger, I have used GDB as well alot but Totalview is
simply awesome
NOTE: C coding is NOT my day job ;-)
I am using Me
Hi there,
I am a huge fan of SQLIte and have recently done some code that I am
debugging with TotalView and MemoryScape (http://www.roguewave.com) -
VERY VERY nice debugger, I have used GDB as well alot but Totalview is
simply awesome
NOTE: C coding is NOT my day job ;-)
I am using Mem
Hi there,
I am a huge fan of SQLIte and have recently done some code that I am
debugging with TotalView and MemoryScape (http://www.roguewave.com) -
VERY VERY nice debugger, I have used GDB as well alot but Totalview is
simply awesome
NOTE: C coding is NOT my day job ;-)
I am using Mem
Hi Jay,
Wow, thanks for your detailed message below.much appreciated ;-)
I will try the PRAGMA and also the "msg_seq".great.
Lynton
On 10/05/2011 19:00, Jay A. Kreibich wrote:
> On Tue, May 10, 2011 at 12:42:14PM +0200, Lynton Grice scratched on the wa
ert you get the code to get the current TIME,
then if the time is >= "log_check_interval" then it is time to DELETE
all records older than the "history_retain_time".
I think that would be better.
Chat later
Lynton
On 10/05/2011 16:38, Stephan Beal wrote:
>
Hey NIco,
Now this is great.in fact I was playing with an "update hook" the
other dayand was going to put the deletion logic under the
SQLITE_INSERT below
But your code looks better ;-) Thanks !
void update_callback( void* udp, int type, const char* db_name, const
char* tbl_name
Hi Enrico,
I like the ON INSERT trigger.good idea. So perhaps you have a
"setLogMaxSize" type function in C that allows the client program to say
"hey, I only want the log to hold a max of 10 000 records".and then
I do a select count(*) inside the ON INSERT type trigger and delete
en
Hi Simon,
Thanks for the feedback below, I will write some "delete logic" to run
from time to time...;-)
Lynton
On 10/05/2011 13:34, Simon Slavin wrote:
> On 10 May 2011, at 11:42am, Lynton Grice wrote:
>
>> BTW: if I am using SQLIte as a logger, what PRAGMA stateme
Hi all,
Thanks for your comments...much appreciated..
BTW: if I am using SQLIte as a logger, what PRAGMA statement can I use
to say FIX the sqlite database size to say "5 MB"?
Also, lets say I have a AUTOINCREMENT INTEGER PRIMARY KEY, what will
happen when it reaches 5 MB? Will it just ke
Hi Stephan,
Thanks for this, much appreciated. My application is written in pure C,
so I guess I will not be able to use your C++ code?
Chat later
Lynton
On 10/05/2011 12:06, Stephan Beal wrote:
> On Tue, May 10, 2011 at 11:52 AM, Enrico Thierbach wrote:
>
>> I don't think sqlite (or any SQ
ecause there is a certain amount of write overhead.
> Why do you think you would want to do this?
>
> /eno
>
> On 10.05.2011, at 10:09, Lynton Grice wrote:
>
>> Hi there,
>>
>> SQLite is a perfect fit for a logger, the only question I have is once
>> i
Hi there,
SQLite is a perfect fit for a logger, the only question I have is once
it is in production my database will grow rapidly, how can I implement /
mimic a type of "rotating log"?
So in my mind I am thinking that perhaps I can LIMIT the size of the
SQLIte DB to say 5 MB? And once the D
Great, thanksI have made the change as you suggested;-)
memcpy(msg->raw_stream_in, sqlite3_column_blob(stmt, 2), len);
Lynton
On 03/04/2011 15:25, Paul van Helden wrote:
> On Sun, Apr 3, 2011 at 3:15 PM, Lynton
> Gricewrote:
>
>> Thanks, issue solved with the following:
>>
>> len =
Thanks, issue solved with the following:
len = sqlite3_column_bytes(stmt,2);
memcpy(msg->raw_stream_in, sqlite3_column_text(stmt, 2), len);
Thanks to everyone for your help ;-)
Lynton
On 03/04/2011 14:52, Paul van Helden wrote:
> On Sun, Apr 3, 2011 at 2:46 PM, Lynton
> Gricewrote:
>
>> cha
actuallly binary and NOT text use this:
>
>
> select hex(raw_stream_in) from queue;
> 4142004445464748494A
>
> You also forgot to do
> select length(raw_stream_in) from queue;
> Which would have showed you 10 so you should know you were doing something
> wrong.
>
> Hopefully
>A B nul D E F G H I J
> 012
> more test.dat
> AB
>
> Note the "more" stop at the first NUL character like it should.
>
> Then...use this file to test your stream, show us the resulting file with "od
> -xa" and show us yo
NSIENT );
idx = sqlite3_bind_parameter_index( stmt, ":num_bytes_in" );
sqlite3_bind_int( stmt, idx, msg.num_bytes_in);
rc = sqlite3_step(stmt);
rc = sqlite3_exec(handle,"COMMIT TRANSACTION;",0,0,0);
rc = sqlite3_finalize(stmt);
return 0;
}
On 03/04
t some point after the
> bind? If so, that
>
>
>
> Michael D. Black
> Senior Scientist
> NG Information Systems
> Advanced Analytics Directorate
>
>
>
>
> From: sqlite-users-boun...@sqlite.org [sqlite-users-boun...@sqlite.org] on
> behal
Hi Richard,
My apologies on the subject line, I did not mean it to say the function
is incorrect, but merely to understand why it is chopping it off
I am responding to the other now
Lynton
On 03/04/2011 13:16, Richard Hipp wrote:
> Others have responded with requests for information
Hi Paul,
Yes, I am using fsize as the msg.num_bytes_in..
When I run "SELECT Length(raw_stream_in) FROM test " I get the FULL
13035138 bytes
But it I read the "raw_stream_in" and sent it to a file (using ".output
result.txt") I only see chars up until the FIRST NUL.
Any ideas?
T
Hi there,
I have a 15MB file I need to read and store in an SQLite database.
I have attached a file to show you that there are NULL characters in the
first couple header fields and the rest is pure BINARY data. But just
incase the image gets stipped off while posting you can imagine the file
Hi there,
I have a 15MB file I need to read and store in an SQLite database.
There are NULL characters in the first couple header fields and the
rest is pure BINARY data. You can imagine the file looking like:
ppphNULNUL3STR.and then all the BINARY data..
I am no C expert but I hav
that needs to be
cleaned up correctly...
But anyway, the PRAGMA cache_size did help a lot
Chat later
Lynton
-Original Message-
From: sqlite-users-boun...@sqlite.org
[mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Lynton Grice
Sent: 08 December 2010 03:03 PM
To: 'General
Hi there,
I am playing with the PRAGMA cache_size and it seems to help lots. I will
keep you posted ;-)
Lynton
-Original Message-
From: sqlite-users-boun...@sqlite.org
[mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Lynton Grice
Sent: 07 December 2010 10:31 PM
To: sqlite-users
ound right?
From: Lynton Grice [mailto:lynton.gr...@logosworld.com]
Sent: 07 December 2010 10:26 PM
To: 'sqlite-users@sqlite.org'
Subject: RE: Runtime memory growth concerns
Hi there,
Regarding the message I sent earlier...Just a quick update from my side, it
seems when
out that sqlite3_step(stmt); line then all is "normal".
Any ideas? Do I need to set some PRAGMA stuff to get the memory better?
Thanks
Lynton
From: Lynton Grice [mailto:lynton.gr...@logosworld.com]
Sent: 07 December 2010 08:27 PM
To: 'sqlite-users@sqlite.org&#x
Hi there,
I am a huge SQLite fan and am very curious as to why the following would
happen.
Essentially I have a "queue implementation" using SQLIte in WAL mode and it
is working really well.
However, at runtime if I watch the Task Manager in windows as thousands of
messages are sent to
AM
To: General Discussion of SQLite Database
Subject: Re: [sqlite] Concern over runtime memory growth?
On Wed, Dec 8, 2010 at 8:58 AM, Lynton Grice
wrote:
> Hi there,
>
>
> I have implemented a queue using SQLIte in WAL mode and it seems to be
> working well..
>
>
> Now that I
Hi there,
I have implemented a queue using SQLIte in WAL mode and it seems to be
working well..
Now that I am testing and send thousands of messages to the queue I am
watching the memory growth of the application grow and grow.
I have make a "queue shared lib / dll" and have seen t
November 2010 11:05 AM
To: sqlite-users@sqlite.org
Subject: Re: [sqlite] Compile 64bit version of SQLIte on Solaris?
On 11/22/2010 03:25 PM, Lynton Grice wrote:
> Hi there,
>
> That does not work, I tried that already.
>
> # /usr/local/bin/gcc -m64 -D_FILE_OFFSET_BITS=64 -c -fPI
cally linked, not stripped, no debugging information available
>
> How can I get the ELF class to reflect "ELF 64-bit"?
>
> Any ideas?
>
> Lynton
>
> -Original Message-
> From: sqlite-users-boun...@sqlite.org
> [mailto:sqlite-users-boun...@sqlite.org] On B
stripped, no debugging information available
How can I get the ELF class to reflect "ELF 64-bit"?
Any ideas?
Lynton
-Original Message-
From: sqlite-users-boun...@sqlite.org
[mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Lynton Grice
Sent: 22 November 2010 09:33 AM
To
shared lib in ELF
class 64..
This possible?
Thanks
Lynton
-Original Message-
From: sqlite-users-boun...@sqlite.org
[mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Lynton Grice
Sent: 22 November 2010 09:28 AM
To: sqlite-users@sqlite.org
Subject: [sqlite] Compile 64bit version of SQLIte
Hi there,
I am getting the following error when trying to compile SQLite on a Solaris
64 bit machine:
/usr/local/bin/gcc -m64 -R/usr/sfw/lib/64 -c -fPIC -DHAVE_USLEEP sqlite3.c
sqlite3.c:1: sorry, unimplemented: 64-bit mode not compiled in
Can someone please let me know how I can do t
13:08:31 +0200, "Lynton Grice"
wrote:
>Hi Simon,
>
>Yup, on Solaris I ran this and it was 1000 milliseconds for the following:
>
>int theReturn = sqlite3_sleep(1);
>
>Any way you know I can make it sleep on Solaris for 1 millisecond? Any
other
>C tricks you know o
...@sqlite.org
[mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Simon Slavin
Sent: 21 November 2010 12:23 PM
To: General Discussion of SQLite Database
Subject: Re: [sqlite] SQLite really SLOW on Solaris?
On 21 Nov 2010, at 10:10am, Lynton Grice wrote:
> in my "queue implementation&quo
SQLite really SLOW on Solaris?
Lynton Grice wrote:
> Many thanks for your feedback, much appreciated ;-)
>
> But why would that happen on Solaris and not Debian?
Did you try it on real OSs & not VMs? Are you sure the host OS is
giving the same compute & disk slices to the VMs? An
Message-
From: sqlite-users-boun...@sqlite.org
[mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Eric Smith
Sent: 20 November 2010 09:13 PM
To: General Discussion of SQLite Database
Subject: Re: [sqlite] SQLite really SLOW on Solaris?
Lynton Grice wrote:
> Many thanks for your feedback, m
-users-boun...@sqlite.org] On Behalf Of Roger Binns
Sent: 20 November 2010 07:31 PM
To: General Discussion of SQLite Database
Subject: Re: [sqlite] SQLite really SLOW on Solaris?
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1
On 11/20/2010 07:12 AM, Lynton Grice wrote:
> On Debian it processes a cou
Hi there,
I compiled SQLite on Debain (VM) first using the following:
/usr/local/bin/gcc -c -fPIC sqlite3.c
/usr/local/bin/gcc -shared -o libsqlite3.so sqlite3.o
And then I created my own shared lib using SQLite and when I use the lib on
Debian it is SUPER FAST.
Then I installed SQ
Hi there,
Well I'm sure I was, all I did was add a "busy handler" and it seems to work
100% now ;-)
Lynton
-Original Message-
From: sqlite-users-boun...@sqlite.org
[mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Sylvain Pointeau
Sent: 16 November 2010 06:09 PM
To: General Discussio
te-users-boun...@sqlite.org] On Behalf Of Richard Hipp
Sent: 15 November 2010 02:05 PM
To: General Discussion of SQLite Database
Subject: Re: [sqlite] WAL and multiple writers?
On Mon, Nov 15, 2010 at 5:40 AM, Simon Slavin wrote:
>
> On 15 Nov 2010, at 10:13am, Lynton Grice wrote:
>
> >
Any ideas?
Thanks
Lynton
-Original Message-
From: sqlite-users-boun...@sqlite.org
[mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Lynton Grice
Sent: 14 November 2010 05:12 PM
To: 'General Discussion of SQLite Database'
Subject: [sqlite] WAL and multiple writers?
Impor
Hi there,
I have a "queue" implemented in C using SQLIte in WAL mode.
When I send messages to the queueit is fine, and I can receive messages
from the queue no problem.
BUT when I try run BOTH applications at the same time the sender works 100%
and the receiver seems to be able to r
Behalf Of David Kirkby
Sent: 08 November 2010 09:35 PM
To: General Discussion of SQLite Database
Subject: Re: [sqlite] Compiling SQLite on Solaris 64bit and SPARC?
On 8 November 2010 16:09, Lynton Grice wrote:
> Hi all,
>
> Anybody out there got the latest version of SQLite compiled on S
Behalf Of Lynton Grice
Sent: 07 November 2010 07:01 PM
To: 'General Discussion of SQLite Database'
Subject: [sqlite] Compiling SQLite on Solaris 64bit and SPARC?
Importance: High
Hi there,
I have just downloaded the latest version of SQLite
(sqlite-amalgamation-3.7.3.tar.gz) and am
Hi there,
I have just downloaded the latest version of SQLite
(sqlite-amalgamation-3.7.3.tar.gz) and am trying to compile it on my Solaris
10 64bit machine, but get an error for some reason (see below).
I ran a "./configure" (with no parameters) and it seemed to be fine, but
then the moment
ipes with it at all. I
ended up using just one table in one DB as indexing makes things simple
and fast and I support arbitrary queues with multiple readers. WAL i've
been trying these last few days and seems trouble-free.
On 30/09/2010 6:11 PM, Lynton Grice wrote:
> Hi there,
>
>
&
Database
Subject: Re: [sqlite] SQLite is perfect for FILE based MESSAGE QUEUE?
Quoth Lynton Grice , on 2010-09-30 12:05:18
+0200:
> BTW: What is WAL
WAL mode uses a write-ahead log instead of a rollback journal, which
can help reduce write activity but requires the use of shared memory
to k
-Original Message-
From: sqlite-users-boun...@sqlite.org
[mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Drake Wilson
Sent: 30 September 2010 11:51 AM
To: General Discussion of SQLite Database
Subject: Re: [sqlite] SQLite is perfect for FILE based MESSAGE QUEUE?
Quoth Lynton Grice , on
Hi there,
I am a HUGE SQLite fan and have an interesting question I have been
scratching my head about for a couple days now.
First off my daily job is very much around "messaging" and I am very
familiar with message queue products like Websphere MQ and Fiorano MQ.
When you install Webs
51 matches
Mail list logo
