Re: [sqlite] Problem with incremental_vacuum and WAL

2011-04-07 Thread Jonathan Allin
After some more diagnosis I discovered that the free list is not corrupted afterall. It's just that the showdb tool fails to work properly with databases larger than 4Gb and since the free list trunk pages are located beyond the 4Gb barrier it caused problems. What is showdb? I could only

Re: [sqlite] Problem with incremental_vacuum and WAL

2011-04-07 Thread Filip Navara
On Thu, Apr 7, 2011 at 9:48 AM, Jonathan Allin jonat...@jonathanallin.com wrote: After some more diagnosis I discovered that the free list is not corrupted afterall. It's just that the showdb tool fails to work properly with databases larger than 4Gb and since the free list trunk pages are

Re: [sqlite] Problem with incremental_vacuum and WAL

2011-04-07 Thread Filip Navara
After throughout analysis of my original problem I have probably found the culprit. The problem happens when incremental_vacuum (incrVacuumStep) tries to remove the last page and the last page is free list leaf. In that case the following code path is taken: /* Remove the page from the

Re: [sqlite] Problem with incremental_vacuum and WAL

2011-04-06 Thread Filip Navara
On Wed, Apr 6, 2011 at 6:36 AM, Dan Kennedy danielk1...@gmail.com wrote: On 04/05/2011 04:49 PM, Filip Navara wrote: Hello, we are having problem with database that originated on computer of one of our customers. The database is used in WAL mode with auto_vacuum=1 and page_size=1024. When

Re: [sqlite] Problem with incremental_vacuum and WAL

2011-04-06 Thread Filip Navara
On Wed, Apr 6, 2011 at 9:27 AM, Filip Navara filip.nav...@gmail.com wrote: On Wed, Apr 6, 2011 at 6:36 AM, Dan Kennedy danielk1...@gmail.com wrote: On 04/05/2011 04:49 PM, Filip Navara wrote: Hello, we are having problem with database that originated on computer of one of our customers.

[sqlite] Problem with incremental_vacuum and WAL

2011-04-05 Thread Filip Navara
Hello, we are having problem with database that originated on computer of one of our customers. The database is used in WAL mode with auto_vacuum=1 and page_size=1024. When running the pragma incremental_vacuum(1); command the WAL file grows to 14Mb, while we would expect it to grow only to

Re: [sqlite] Problem with incremental_vacuum and WAL

2011-04-05 Thread Filip Navara
On Tue, Apr 5, 2011 at 11:49 AM, Filip Navara filip.nav...@gmail.com wrote: Hello, we are having problem with database that originated on computer of one of our customers. The database is used in WAL mode with auto_vacuum=1 and page_size=1024. When running the pragma incremental_vacuum(1);

Re: [sqlite] Problem with incremental_vacuum and WAL

2011-04-05 Thread Dan Kennedy
On 04/05/2011 04:49 PM, Filip Navara wrote: Hello, we are having problem with database that originated on computer of one of our customers. The database is used in WAL mode with auto_vacuum=1 and page_size=1024. When running the pragma incremental_vacuum(1); command the WAL file grows to