Re: [sqlite] Using sqlite's WAL with a hash table store

2010-11-04 Thread Russell Leighton
Check out: http://jaksprats.wordpress.com/2010/09/28/introducing-redisql-the-lightning-fast-polyglot/ On Nov 3, 2010, at 10:51 AM, Jay A. Kreibich wrote: > On Wed, Nov 03, 2010 at 05:10:22PM +0300, Alexey Pechnikov scratched > on the wall: >> 2010/11/3 Jay A. Kreibich >>> >>> Why not j

Re: [sqlite] Using sqlite's WAL with a hash table store

2010-11-03 Thread Jay A. Kreibich
On Wed, Nov 03, 2010 at 05:10:22PM +0300, Alexey Pechnikov scratched on the wall: > 2010/11/3 Jay A. Kreibich > > > > Why not just use an off-the-self hash cache, like memcached, or an > > off-the-self hash database, like Redis? Redis even supports an > > Append-Only write mode (e.g. WAL-ish

Re: [sqlite] Using sqlite's WAL with a hash table store

2010-11-03 Thread Alexey Pechnikov
2010/11/3 Jay A. Kreibich > > Why not just use an off-the-self hash cache, like memcached, or an > off-the-self hash database, like Redis? Redis even supports an > Append-Only write mode (e.g. WAL-ish journal mode). > How about power fail or OS crash? As I know, Redis does not garantees the d

Re: [sqlite] Using sqlite's WAL with a hash table store

2010-11-03 Thread Ben Harper
Interesting.. thanks. -Original Message- From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Jay A. Kreibich Sent: 03 November 2010 03:44 PM To: General Discussion of SQLite Database Subject: Re: [sqlite] Using sqlite's WAL with a hash table

Re: [sqlite] Using sqlite's WAL with a hash table store

2010-11-03 Thread Jay A. Kreibich
On Wed, Nov 03, 2010 at 12:31:35PM +0200, Ben Harper scratched on the wall: > I guess I could actually dump the hash table into a blob. > I'm also doing something like a bloom filter, and I guess that can just > as well go into a blob too.. Basically the system is a big cache, > and it must quick

Re: [sqlite] Using sqlite's WAL with a hash table store

2010-11-03 Thread Ben Harper
e: [sqlite] Using sqlite's WAL with a hash table store FTS3 extension is very fast and scalable hash engine. I did test FTS3 up to 400+ millions of record and it's nice. 2010/11/3 Ben Harper > Hi, > I know the answer to this question is really "Just try it and see", but I

Re: [sqlite] Using sqlite's WAL with a hash table store

2010-11-03 Thread Ben Harper
lf Of Simon Slavin Sent: 03 November 2010 11:17 AM To: General Discussion of SQLite Database Subject: Re: [sqlite] Using sqlite's WAL with a hash table store On 3 Nov 2010, at 8:30am, Ben Harper wrote: > I know the answer to this question is really "Just try it and see", but I

Re: [sqlite] Using sqlite's WAL with a hash table store

2010-11-03 Thread Alexey Pechnikov
FTS3 extension is very fast and scalable hash engine. I did test FTS3 up to 400+ millions of record and it's nice. 2010/11/3 Ben Harper > Hi, > I know the answer to this question is really "Just try it and see", but I > want to gauge whether the idea is sane or not before I spend/waste time on >

Re: [sqlite] Using sqlite's WAL with a hash table store

2010-11-03 Thread Simon Slavin
On 3 Nov 2010, at 8:30am, Ben Harper wrote: > I know the answer to this question is really "Just try it and see", but I > want to gauge whether the idea is sane or not before I spend/waste time on > the effort: > > I want to build a custom hash table DB, and to solve the > concurrency+durabil

[sqlite] Using sqlite's WAL with a hash table store

2010-11-03 Thread Ben Harper
Hi, I know the answer to this question is really "Just try it and see", but I want to gauge whether the idea is sane or not before I spend/waste time on the effort: I want to build a custom hash table DB, and to solve the concurrency+durability I need something akin to a WAL, and SQLite's WAL s