[sqlite] journal files not always removed

2015-09-10 Thread J Decker
Okay let's restart... maybe I misunderstood that Richard was able to reproduce this. I have figured out a simple script that with 3.8.11.1 windows (using binary download sqlite3.exe) causes the problem. running just 'sqlite3.exe' --- script --- .open test.db pragma journal_mode=wal; .open test.d

[sqlite] journal files not always removed

2015-09-01 Thread J Decker
On Sat, Aug 15, 2015 at 1:59 PM, Richard Hipp wrote: > On 8/15/15, Ashwin Hirschi wrote: >> >>> But I also see that behavior dates back to 3.7.6 and maybe earlier. It >>> isn't something new. >>> (Testing on Ubuntu). >> >> Also, are you sure you testing things right? I thought URI support was >>

[sqlite] journal files not always removed

2015-08-15 Thread Ashwin Hirschi
> With this new test case, I see that the -shm and -wal files are > retained upon exit in read-only mode. Great. Good to see other people are able to reproduce (some? of) the issue. > But I also see that behavior dates back to 3.7.6 and maybe earlier. It > isn't something new. > (Testing on Ub

[sqlite] journal files not always removed

2015-08-15 Thread Ashwin Hirschi
> Also, make sure that folder is not a shared resource or inside a shared > resource that is visible from any other network node or machine. > > This piece, describing the same symptom for Internet Explorer temporary > files, may help: > https://support.microsoft.com/en-us/kb/814782 The folde

[sqlite] journal files not always removed

2015-08-15 Thread Ashwin Hirschi
>> I've recently found SQLite doesn't always remove its journal files >> anymore. >> >> The issue seems to occur when opening WAL databases in read-only mode >> (i.e. using SQLITE_OPEN_READONLY). >> >> A scenario to reproduce this (using version 3.8.11.1) looks like: >> >> 1. open a WAL database

[sqlite] journal files not always removed

2015-08-15 Thread R.Smith
Also, make sure that folder is not a shared resource or inside a shared resource that is visible from any other network node or machine. This piece, describing the same symptom for Internet Explorer temporary files, may help: https://support.microsoft.com/en-us/kb/814782 What happens when you m

[sqlite] journal files not always removed

2015-08-15 Thread R.Smith
Checked this on WIndows 7 & 8, works as expected. This means either Windows 10 has some glitch or the access level to the folder is not correct, files may not be deleted by that process or some antivirus is checking the file while SQLite is trying to delete it, or you are not closing the DB con

[sqlite] journal files not always removed

2015-08-15 Thread Ashwin Hirschi
Hello, I've recently found SQLite doesn't always remove its journal files anymore. The issue seems to occur when opening WAL databases in read-only mode (i.e. using SQLITE_OPEN_READONLY). A scenario to reproduce this (using version 3.8.11.1) looks like: 1. open a WAL database in read-only mo

[sqlite] journal files not always removed

2015-08-15 Thread Richard Hipp
On 8/15/15, Ashwin Hirschi wrote: > >> But I also see that behavior dates back to 3.7.6 and maybe earlier. It >> isn't something new. >> (Testing on Ubuntu). > > Also, are you sure you testing things right? I thought URI support was > only added in 3.7.7... If that's true, your little script shoul

[sqlite] journal files not always removed

2015-08-15 Thread Richard Hipp
On 8/15/15, Keith Medcalf wrote: > > Quite Fascinating! Here is the transcript (it is running the Windows > SQLITE.EXE which I have in a different location in the path, so slightly > modified the script): > Ugh. There is a bug in my script. The final "ls -l" should have a "*" at the end Re

[sqlite] journal files not always removed

2015-08-15 Thread Richard Hipp
On 8/15/15, Keith Medcalf wrote: > > This is something changed in SQLITE itself. These tests are on Windows 10 > using the current MinGW compiler with the same configuration and windows > headers. > Do you also have MSYS installed? If so can you run the following shell script and see if it demo

[sqlite] journal files not always removed

2015-08-15 Thread Richard Hipp
On 8/15/15, Ashwin Hirschi wrote: > > Hello, > > I've recently found SQLite doesn't always remove its journal files anymore. > > The issue seems to occur when opening WAL databases in read-only mode > (i.e. using SQLITE_OPEN_READONLY). > > A scenario to reproduce this (using version 3.8.11.1) look

[sqlite] journal files not always removed

2015-08-15 Thread Keith Medcalf
3 Dir(s) 157,980,798,976 bytes free > -Original Message- > From: sqlite-users-bounces at mailinglists.sqlite.org [mailto:sqlite-users- > bounces at mailinglists.sqlite.org] On Behalf Of Richard Hipp > Sent: Saturday, 15 August, 2015 12:41 > To: General Discussion of

[sqlite] journal files not always removed

2015-08-15 Thread Keith Medcalf
Sent: Saturday, 15 August, 2015 11:59 > To: sqlite-users at mailinglists.sqlite.org > Subject: Re: [sqlite] journal files not always removed > > Also, make sure that folder is not a shared resource or inside a shared > resource that is visible from any other network

Re: [sqlite] journal files

2010-02-02 Thread Shane Harrelson
Actually, I believe the entire 28 byte header is zeroed, not just the first 4 bytes. See the zeroJournalHdr() function in pager.c for details. -Shane On Tue, Feb 2, 2010 at 7:09 AM, Pavel Ivanov wrote: > What do you want to see in journal files? You can execute 'PRAGMA > journal_mode = persi

Re: [sqlite] journal files

2010-02-02 Thread Pavel Ivanov
What do you want to see in journal files? You can execute 'PRAGMA journal_mode = persist' and all information in journal file except first 4 bytes will be left on disk for you. Is it enough? Pavel On Tue, Feb 2, 2010 at 7:00 AM, rishabh wrote: > > hey, > > I am coding for an application wherein

[sqlite] journal files

2010-02-02 Thread rishabh
hey, I am coding for an application wherein i need to check the journal files as in i dont want it to get deleted after the commit. how to go about it? where in the Sqlite3.c code can i edit it. also, is it possible to customize the sqlite code for the journal file a bit as per my needs? thanx

Re: [sqlite] Journal files

2008-12-02 Thread Stephen Abbamonte
Okay I updated to version 3.6.6.2 and now I am only seeing "PRAGMA main.journal_mode = OFF;" not work with my custom defined OS ( when I switch to windows it works ) I should note that I changed sqlite3.c to sqlite3.cpp and got the amalgamation to compile in C++ I also defined SQLITE_OS_OTHER and

Re: [sqlite] Journal files

2008-12-01 Thread Brown, Daniel
Cheers adding the extra pragma has stopped the temporary file activity :) -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of D. Richard Hipp Sent: Monday, December 01, 2008 6:14 PM To: General Discussion of SQLite Database Subject: Re: [sqlite] Journal files

Re: [sqlite] Journal files

2008-12-01 Thread D. Richard Hipp
On Dec 1, 2008, at 6:49 PM, Stephen Abbamonte wrote: > I just tried this line also and the journal files are still being > created > here is the code I am running: > > >int32_t ret = sqlite3_open(filename, m_DatabaseRef); > if( ret == SQLITE_OK ) >{ > sqlit

Re: [sqlite] Journal files

2008-12-01 Thread D. Richard Hipp
01, 2008 3:50 PM > To: 'General Discussion of SQLite Database' > Subject: Re: [sqlite] Journal files > > I just tried this line also and the journal files are still being > created > here is the code I am running: > > >int32_t ret = sqlite3_open(

Re: [sqlite] Journal files

2008-12-01 Thread Brown, Daniel
[EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Stephen Abbamonte Sent: Monday, December 01, 2008 3:50 PM To: 'General Discussion of SQLite Database' Subject: Re: [sqlite] Journal files I just tried this line also and the journal files are still being created here is the code

Re: [sqlite] Journal files

2008-12-01 Thread Stephen Abbamonte
I just tried this line also and the journal files are still being created here is the code I am running: int32_t ret = sqlite3_open(filename, m_DatabaseRef); if( ret == SQLITE_OK ) { sqlite3_stmt* sqlStmt = NULL; ret = sqlite3_prepare_v

Re: [sqlite] Journal files

2008-12-01 Thread Stefan Evert
> I tried that on sqlite3 version 3.6.6 and the return value was "OFF" > but the > journals are still being created. Any reason why this wouldn't work? Did you set PRAGMA journal_mode = OFF; ? The way I read the documentation (on a second or third close reading, I think), this only

Re: [sqlite] Journal files

2008-12-01 Thread Stephen Abbamonte
2008 9:56 AM To: General Discussion of SQLite Database Subject: Re: [sqlite] Journal files On Dec 1, 2008, at 10:50 AM, Eric Minbiole wrote: >>I am looking for a way to completely turn off the >> creation >> of journal files. Any help is much appreciated. >

Re: [sqlite] Journal files

2008-12-01 Thread Brown, Daniel
Does that control the creation of all temporary files created at runtime? -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of D. Richard Hipp Sent: Monday, December 01, 2008 7:56 AM To: General Discussion of SQLite Database Subject: Re: [sqlite] Journal

Re: [sqlite] Journal files

2008-12-01 Thread D. Richard Hipp
On Dec 1, 2008, at 10:50 AM, Eric Minbiole wrote: >>I am looking for a way to completely turn off the >> creation >> of journal files. Any help is much appreciated. > > http://www.sqlite.org/pragma.html And in particular http://www.sqlite.org/pragma.html#pragma_journal_mode >

Re: [sqlite] Journal files

2008-12-01 Thread Eric Minbiole
> I am looking for a way to completely turn off the creation > of journal files. Any help is much appreciated. http://www.sqlite.org/pragma.html ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/

[sqlite] Journal files

2008-12-01 Thread Stephen Abbamonte
Hello all, I am looking for a way to completely turn off the creation of journal files. Any help is much appreciated. Thanks. ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlit

Re: [sqlite] journal files

2008-10-01 Thread Igor Tandetnik
Dave Dyer <[EMAIL PROTECTED]> wrote: > How does sqlite distinguish between a journal file left over > from a crash, and a journal file that some other process is > still using? It checks for existence of locks on the main database file. For more details, see http://sqlite.org/atomiccommit.html

[sqlite] journal files

2008-10-01 Thread Dave Dyer
How does sqlite distinguish between a journal file left over from a crash, and a journal file that some other process is still using? .. and if the answer is "try to open it yourself", then what about the race condition where process A has finished, and is about to delete the journal, but hasn't

Re: [sqlite] Journal Files

2008-01-23 Thread drh
"Mark Riehl" <[EMAIL PROTECTED]> wrote: > I'm working with version 3.5.2 under Linux. I've got a database that > is being shared between two processes and I'm running into issues with > the journal file that doesn't go away. When that happens, one process > appears to have the lock on the databas

[sqlite] Journal Files

2008-01-23 Thread Mark Riehl
I'm working with version 3.5.2 under Linux. I've got a database that is being shared between two processes and I'm running into issues with the journal file that doesn't go away. When that happens, one process appears to have the lock on the database and the other process is essentially locked ou

Re: [sqlite] Journal files not deleted.

2007-04-12 Thread P Kishor
D] Sent: Tuesday, April 10, 2007 10:26 PM To: [EMAIL PROTECTED] Cc: [EMAIL PROTECTED] Subject: RE: [sqlite] Journal files not deleted. NO, This is one of the largest IT (SW development) companies. Does this matter in anyways? Regards, Ravi K -Original Message- From: Martin Jenkins

Re: [sqlite] Journal files not deleted.

2007-04-12 Thread drh
The original question was something about journal files not being deleted Nobody else has reported seeing this behavior. If you want help, you will have to give us additional information. -- D. Richard Hipp <[EMAIL PROTECTED]> --

RE: [sqlite] Journal files not deleted.

2007-04-12 Thread Noah Hart
Sent: Tuesday, April 10, 2007 10:26 PM To: [EMAIL PROTECTED] Cc: [EMAIL PROTECTED] Subject: RE: [sqlite] Journal files not deleted. NO, This is one of the largest IT (SW development) companies. Does this matter in anyways? Regards, Ravi K -Original Message- From: Martin Jenkins [mailto:[E

RE: [sqlite] Journal files not deleted.

2007-04-10 Thread ravi.karatagi
NO, This is one of the largest IT (SW development) companies. Does this matter in anyways? Regards, Ravi K -Original Message- From: Martin Jenkins [mailto:[EMAIL PROTECTED] Sent: Tuesday, April 10, 2007 8:41 PM To: sqlite-users@sqlite.org Subject: Re: [sqlite] Journal files not deleted

Re: [sqlite] Journal files not deleted.

2007-04-10 Thread Martin Jenkins
[EMAIL PROTECTED] wrote: www.wipro.com Would this be Wipro, the outsourcing company? Martin - To unsubscribe, send email to [EMAIL PROTECTED] --

[sqlite] Journal files not deleted.

2007-04-10 Thread ravi.karatagi
Hi All, The journal files created during the transactions are not getting deleted. These files are created per transaction or only one file per connection? I am seeing hundreds of journal files with a '-' suffix causing an error "Database disk full" (DB file is stored in flash card).

Re: [sqlite] journal files and database corruption

2006-01-20 Thread Will Leshner
On Jan 20, 2006, at 8:25 AM, Will Leshner wrote: Thanks for this information. It sounds like a reasonable precaution might be not to make "too many" changes to a database in one transaction. But I guess knowing how many changes is too many would be a pretty hard thing to figure out. Sor

Re: [sqlite] journal files and database corruption

2006-01-20 Thread Will Leshner
On Jan 20, 2006, at 8:07 AM, [EMAIL PROTECTED] wrote: Deleting a hot journal after a power loss or OS crash is more likely to result in severe database corruption, but database corruption is possible from deleting a hot journal after an ordinary program crash. Thanks for this information. It

Re: [sqlite] journal files and database corruption

2006-01-20 Thread drh
Will Leshner <[EMAIL PROTECTED]> wrote: > On Jan 20, 2006, at 7:41 AM, [EMAIL PROTECTED] wrote: > > > The database might be completely unusable. It depends on > > which writes completed and which had not at the time of the > > crash. > > Am I right in thinking that that would be more likely to h

Re: [sqlite] journal files and database corruption

2006-01-20 Thread Will Leshner
On Jan 20, 2006, at 7:41 AM, [EMAIL PROTECTED] wrote: The database might be completely unusable. It depends on which writes completed and which had not at the time of the crash. Am I right in thinking that that would be more likely to happen in, say, a hardware failure, and less likely to

Re: [sqlite] journal files and database corruption

2006-01-20 Thread drh
Will Leshner <[EMAIL PROTECTED]> wrote: > In the article about locking and concurrency on the SQLite website, > where it talks about how to corrupt a SQLite database, it says that a > SQLite database can be corrupted if a hot journal file is missing > when SQLite reconnects to the database. W

[sqlite] journal files and database corruption

2006-01-20 Thread Will Leshner
In the article about locking and concurrency on the SQLite website, where it talks about how to corrupt a SQLite database, it says that a SQLite database can be corrupted if a hot journal file is missing when SQLite reconnects to the database. What kind of corruption are we talking about, e