Re: [sqlite] Sqlite uses a lot of memory during a delete operation

2009-09-16 Thread shankar m
Maybe LIMIT clause can be used. Please check the below link. http://www.sqlite.org/lang_delete.html Regards Shankar On Wed, Sep 9, 2009 at 5:16 PM, P Kishor wrote: > On Tue, Sep 8, 2009 at 10:48 PM, Benjamin Rutt wrote: > > On Mon, Sep 7, 2009 at 12:28

Re: [sqlite] Sqlite uses a lot of memory during a delete operation

2009-09-09 Thread P Kishor
On Tue, Sep 8, 2009 at 10:48 PM, Benjamin Rutt wrote: > On Mon, Sep 7, 2009 at 12:28 PM, P Kishor wrote: > >> Find out if the DELETEion is chewing up the memory or the SELECTion. Try >> >> SELECT * FROM old_conns WHERE "end" >= strftime('%s', 'now', '-7

Re: [sqlite] Sqlite uses a lot of memory during a delete operation

2009-09-08 Thread Benjamin Rutt
On Mon, Sep 7, 2009 at 12:28 PM, P Kishor wrote: > Find out if the DELETEion is chewing up the memory or the SELECTion. Try > > SELECT * FROM old_conns WHERE "end" >= strftime('%s', 'now', '-7 days'); > > If the above is quick, you can simply create a new table with that, >

Re: [sqlite] Sqlite uses a lot of memory during a delete operation

2009-09-08 Thread Benjamin Rutt
Tried that, it didn't help. On Mon, Sep 7, 2009 at 11:40 AM, Simon Slavin wrote: > > On 7 Sep 2009, at 4:01pm, Benjamin Rutt wrote: > > > Good idea. Tried that, though, and it didn't help - the process > > still grew > > and grew in memory. > > Just in case, change

Re: [sqlite] Sqlite uses a lot of memory during a delete operation

2009-09-07 Thread P Kishor
On Sun, Sep 6, 2009 at 5:23 PM, Benjamin Rutt wrote: > I noticed sqlite is using a lot of memory (up to 300MB before it hits a data > segment size ulimit and fails) during a delete operation.  This is > reproducable using the 'sqlite3' executable distributed with sqlite.  My >

Re: [sqlite] Sqlite uses a lot of memory during a delete operation

2009-09-07 Thread Simon Slavin
On 7 Sep 2009, at 4:01pm, Benjamin Rutt wrote: > Good idea. Tried that, though, and it didn't help - the process > still grew > and grew in memory. Just in case, change the name of your column 'end' to something that isn't a keyword. Simon. ___

Re: [sqlite] Sqlite uses a lot of memory during a delete operation

2009-09-07 Thread Benjamin Rutt
> > You're doing this on 68 million rows. While it probably shouldn't > give an error in this way, I can imagine various things that might > cause it. > > To help with debugging, and also as a suggested fix until the problem > can be investigated, could you pre-calculate your 'strftime' value, >

Re: [sqlite] Sqlite uses a lot of memory during a delete operation

2009-09-06 Thread Simon Slavin
On 6 Sep 2009, at 11:23pm, Benjamin Rutt wrote: > I noticed sqlite is using a lot of memory (up to 300MB before it > hits a data > segment size ulimit and fails) during a delete operation. This is > reproducable using the 'sqlite3' executable distributed with > sqlite. My > platform is

[sqlite] Sqlite uses a lot of memory during a delete operation

2009-09-06 Thread Benjamin Rutt
I noticed sqlite is using a lot of memory (up to 300MB before it hits a data segment size ulimit and fails) during a delete operation. This is reproducable using the 'sqlite3' executable distributed with sqlite. My platform is sqlite 3.6.13 with the OS being solaris 10 on sparc architecture, but