Re: [sqlite] Concurrent inserts - DB corruption in travisci vm with sqlite 3.7.9

2013-08-17 Thread ibrahim
On 16.08.2013 18:03, Gary Weaver wrote: Thanks to you and Richard for the links and info. Concurrency is not outlandish to expect, especially when it works in OS X and just not in the Ubuntu vm in Travis, but I now understand that these are expected problems.

Re: [sqlite] Concurrent inserts - DB corruption in travisci vm with sqlite 3.7.9

2013-08-17 Thread Gary Weaver
Yuriy, Thanks for following up. Henrik of TravisCI had said that We do not use network filesystems by default. We do use ramfs for some databases, but I don't think SQLite would use ramfs by default unless you put the database in an odd location. I'm also fairly sure we don't disable locks in any

Re: [sqlite] Concurrent inserts - DB corruption in travisci vm with sqlite 3.7.9

2013-08-17 Thread Keith Medcalf
On 16.08.2013 18:03, Gary Weaver wrote: Thanks to you and Richard for the links and info. Concurrency is not outlandish to expect, especially when it works in OS X and just not in the Ubuntu vm in Travis, but I now understand that these are expected problems.

Re: [sqlite] Concurrent inserts - DB corruption in travisci vm with sqlite 3.7.9

2013-08-17 Thread Gary Weaver
On Sat, Aug 17, 2013 at 11:47 AM, Keith Medcalf kmedc...@dessus.com wrote: On 16.08.2013 18:03, Gary Weaver wrote: You're right concurrency is not outlandish but from the viewpoint of sqlite it was therefore this answer and the link. Hold on here. What do you mean it works in OS X and

Re: [sqlite] Concurrent inserts - DB corruption in travisci vm with sqlite 3.7.9

2013-08-16 Thread Gary Weaver
On Thu, Aug 15, 2013 at 4:20 PM, Richard Hipp d...@sqlite.org wrote: On Thu, Aug 15, 2013 at 3:39 PM, Gary Weaver garyswea...@gmail.com wrote: Is there anything that stands out as something that would keep 30 processes from being able to concurrently insert into the same tables? Yes.

Re: [sqlite] Concurrent inserts - DB corruption in travisci vm with sqlite 3.7.9

2013-08-16 Thread Richard Hipp
On Fri, Aug 16, 2013 at 6:58 AM, Gary Weaver garyswea...@gmail.com wrote: I'm going to stop on this for now, because it sounds like SQLite was never intended to support concurrent writes to a file DB from what you said, so there is no use trying to debug an use case that isn't supported. I am

Re: [sqlite] Concurrent inserts - DB corruption in travisci vm with sqlite 3.7.9

2013-08-16 Thread ibrahim
On 15.08.2013 21:39, Gary Weaver wrote: SQLite varies between file is encrypted/not a DB errors and database disk image is malformed. It would seem consistent with SQLite not handling concurrent processing in this particular environment or with the version of SQLite since 3.7.7 is fine in OS

Re: [sqlite] Concurrent inserts - DB corruption in travisci vm with sqlite 3.7.9

2013-08-16 Thread Gary Weaver
On Aug 15, 2013, at 3:47 PM, ibrahim ibrahim.a...@googlemail.com wrote: On 15.08.2013 21:39, Gary Weaver wrote: SQLite varies between file is encrypted/not a DB errors and database disk image is malformed. It would seem consistent with SQLite not handling concurrent processing in this

Re: [sqlite] Concurrent inserts - DB corruption in travisci vm with sqlite 3.7.9

2013-08-16 Thread Simon Slavin
On 16 Aug 2013, at 5:03pm, Gary Weaver garyswea...@gmail.com wrote: Thanks to you and Richard for the links and info. Concurrency is not outlandish to expect, especially when it works in OS X and just not in the Ubuntu vm in Travis, but I now understand that these are expected problems.

Re: [sqlite] Concurrent inserts - DB corruption in travisci vm with sqlite 3.7.9

2013-08-16 Thread Yuriy Kaminskiy
Gary Weaver wrote: On Aug 15, 2013, at 3:47 PM, ibrahim ibrahim.a...@googlemail.com wrote: On 15.08.2013 21:39, Gary Weaver wrote: SQLite varies between file is encrypted/not a DB errors and database disk image is malformed. It would seem consistent with SQLite not handling concurrent

[sqlite] Concurrent inserts - DB corruption in travisci vm with sqlite 3.7.9

2013-08-15 Thread Gary Weaver
SQLite DB (file) corruption in travisci vm with 3.7.9 (latest they had available). Link to logs showing errors, code to reproduce here: https://github.com/travis-ci/travis-ci/issues/1334 Is there something in config, etc. that would help? ___

Re: [sqlite] Concurrent inserts - DB corruption in travisci vm with sqlite 3.7.9

2013-08-15 Thread Richard Hipp
On Thu, Aug 15, 2013 at 3:10 PM, Gary Weaver garyswea...@gmail.com wrote: SQLite DB (file) corruption in travisci vm with 3.7.9 (latest they had available). Link to logs showing errors, code to reproduce here: https://github.com/travis-ci/travis-ci/issues/1334 Is there something in config,

Re: [sqlite] Concurrent inserts - DB corruption in travisci vm with sqlite 3.7.9

2013-08-15 Thread Gary Weaver
On Aug 15, 2013, at 3:20 PM, Richard Hipp d...@sqlite.org wrote: On Thu, Aug 15, 2013 at 3:10 PM, Gary Weaver garyswea...@gmail.com wrote: SQLite DB (file) corruption in travisci vm with 3.7.9 (latest they had available). Link to logs showing errors, code to reproduce here:

Re: [sqlite] Concurrent inserts - DB corruption in travisci vm with sqlite 3.7.9

2013-08-15 Thread Richard Hipp
On Thu, Aug 15, 2013 at 3:39 PM, Gary Weaver garyswea...@gmail.com wrote: Is there anything that stands out as something that would keep 30 processes from being able to concurrently insert into the same tables? Yes. SQLite does not (and has never) supported that. Multiple processes can