Hi, I was interested in using sqlite over GPFS. I've seen a few useful threads on this:
- Network file system that support sqlite3 well https://www.mail-archive.com/sqlite-users@mailinglists.sqlite.org/msg117085.html - disable file locking mechanism over the network https://www.mail-archive.com/sqlite-users@mailinglists.sqlite.org/msg116846.html From these, I can see that there are some performance issues, even if I willing (which I am not) to make all access (read+write) sequential. [I don't expect to need many, if any, concurrent writers, but I will typically have concurrent readers.] To get a better sense of things, I downloaded 3.31.0 and ran the test suite on GPFS. Overall, it looks pretty good, but there were some WAL failures. Could someone comment on the precise implication of those test failures? I'm interested to know what usage patterns are likely to cause problems, and which are likely safe. Also, which other tests can I run ( https://www.sqlite.org/testing.html)? Perhaps more tests around concurrent read/writes? !Failures on these tests: e_walauto-1.1.2 e_walauto-1.1.3 e_walauto-1.1.5 e_walauto-1.1.7 e_walauto-1.1.12.3 e_walauto-1.1.12.5 e_walauto-1.2.2 e_walauto-1.2.3 e_walauto-1.2.5 e_walauto-1.2.7 e_walauto-1.2.12.3 e_walauto-1.2.12.5 zipfile-2.4a.2.1 zipfile-2.4a.2.2 Thanks in advance. The `make test` output log snippet is below. --- e_walauto-1.1.0... Ok e_walauto-1.1.1... Ok e_walauto-1.1.2... ! e_walauto-1.1.2 expected: [1] ! e_walauto-1.1.2 got: [0] e_walauto-1.1.3... ! e_walauto-1.1.3 expected: [1] ! e_walauto-1.1.3 got: [0] e_walauto-1.1.4... Ok e_walauto-1.1.5... ! e_walauto-1.1.5 expected: [1] ! e_walauto-1.1.5 got: [0] e_walauto-1.1.6... Ok e_walauto-1.1.7... ! e_walauto-1.1.7 expected: [1] ! e_walauto-1.1.7 got: [0] e_walauto-1.1.7... Ok e_walauto-1.1.8... Ok e_walauto-1.1.9... Ok e_walauto-1.1.10.1... Ok e_walauto-1.1.10.2... Ok e_walauto-1.1.11.1... Ok e_walauto-1.1.11.2... Ok e_walauto-1.1.11.3... Ok e_walauto-1.1.12.1... Ok e_walauto-1.1.12.2... Ok e_walauto-1.1.12.3... ! e_walauto-1.1.12.3 expected: [2] ! e_walauto-1.1.12.3 got: [0] e_walauto-1.1.12.4... Ok e_walauto-1.1.12.5... ! e_walauto-1.1.12.5 expected: [1559] ! e_walauto-1.1.12.5 got: [0] e_walauto-1.2.0... Ok e_walauto-1.2.1... Ok e_walauto-1.2.2... ! e_walauto-1.2.2 expected: [1] ! e_walauto-1.2.2 got: [0] e_walauto-1.2.3... ! e_walauto-1.2.3 expected: [1] ! e_walauto-1.2.3 got: [0] e_walauto-1.2.4... Ok e_walauto-1.2.5... ! e_walauto-1.2.5 expected: [1] ! e_walauto-1.2.5 got: [0] e_walauto-1.2.6... Ok e_walauto-1.2.7... ! e_walauto-1.2.7 expected: [1] ! e_walauto-1.2.7 got: [0] e_walauto-1.2.7... Ok e_walauto-1.2.8... Ok e_walauto-1.2.9... Ok e_walauto-1.2.10.1... Ok e_walauto-1.2.10.2... Ok e_walauto-1.2.11.1... Ok e_walauto-1.2.11.2... Ok e_walauto-1.2.11.3... Ok e_walauto-1.2.12.1... Ok e_walauto-1.2.12.2... Ok e_walauto-1.2.12.3... ! e_walauto-1.2.12.3 expected: [2] ! e_walauto-1.2.12.3 got: [0] e_walauto-1.2.12.4... Ok e_walauto-1.2.12.5... ! e_walauto-1.2.12.5 expected: [1559] ! e_walauto-1.2.12.5 got: [0] e_walauto.test-closeallfiles... Ok e_walauto.test-sharedcachesetting... Ok Time: e_walauto.test 92703 ms ... zipfile2.test-closeallfiles... Ok zipfile2.test-sharedcachesetting... Ok Time: zipfile2.test 14 ms Memory used: now 24 max 9283664 max-size 16908288 Allocation count: now 1 max 1311131 Page-cache used: now 0 max 13 max-size 65800 Page-cache overflow: now 0 max 20640016 SQLite 2020-01-10 01:05:49 0a500da6aa659a8e73206e6d22ddbf2da5e4f1d1d551eeb66433163a3e13109d 14 errors out of 249964 tests on localhost Linux 64-bit little-endian !Failures on these tests: e_walauto-1.1.2 e_walauto-1.1.3 e_walauto-1.1.5 e_walauto-1.1.7 e_walauto-1.1.12.3 e_walauto-1.1.12.5 e_walauto-1.2.2 e_walauto-1.2.3 e_walauto-1.2.5 e_walauto-1.2.7 e_walauto-1.2.12.3 e_walauto-1.2.12.5 zipfile-2.4a.2.1 zipfile-2.4a.2.2 All memory allocations freed - no leaks Memory used: now 0 max 9283664 max-size 16908288 Allocation count: now 0 max 1311131 Page-cache used: now 0 max 13 max-size 65800 Page-cache overflow: now 0 max 20640016 Maximum memory usage: 9283664 bytes Current memory usage: 0 bytes Number of malloc() : -1 calls _______________________________________________ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
