Re: HSQLDB woes...

2010-11-09 Thread Andrzej Bialecki
On 2010-11-08 23:35, Doğacan Güney wrote: >>> Does anyone know if there is a licensing problem with it? >> >> Yes. It's either GPL or commercial. >> > > Hmm... Is it ok if we do not include libraries in our code base but > pull it via ivy? I think it's ok, Lucene BDB directory uses this approach

Re: HSQLDB woes...

2010-11-08 Thread Doğacan Güney
On Mon, Nov 8, 2010 at 13:49, Andrzej Bialecki wrote: > On 2010-11-08 21:29, Doğacan Güney wrote: >> On Mon, Nov 8, 2010 at 10:26, Enis Söztutar wrote: >>> From my experience the SQL backend is a mJOR headache. Writing a SQL backend >>> is actually much much harder than >>> the HBase or Cassandra

Re: HSQLDB woes...

2010-11-08 Thread Andrzej Bialecki
On 2010-11-08 21:29, Doğacan Güney wrote: > On Mon, Nov 8, 2010 at 10:26, Enis Söztutar wrote: >> From my experience the SQL backend is a mJOR headache. Writing a SQL backend >> is actually much much harder than >> the HBase or Cassandra backend since we need very custom code for each SQL >> serve

Re: HSQLDB woes...

2010-11-08 Thread Andrzej Bialecki
On 2010-11-08 19:26, Enis Söztutar wrote: >>From my experience the SQL backend is a mJOR headache. Writing a SQL backend > is actually much much harder than > the HBase or Cassandra backend since we need very custom code for each SQL > server. Plus, there is some code for > dealing with HSQL embedd

Re: HSQLDB woes...

2010-11-08 Thread Doğacan Güney
On Mon, Nov 8, 2010 at 10:26, Enis Söztutar wrote: > From my experience the SQL backend is a mJOR headache. Writing a SQL backend > is actually much much harder than > the HBase or Cassandra backend since we need very custom code for each SQL > server. Plus, there is some code for > dealing with H

Re: HSQLDB woes...

2010-11-08 Thread Mattmann, Chris A (388J)
Guys, We recently used Berkeley XMLDB and it was actually pretty performant. I'm not sure about its license though; we used it internally at JPL. Cheers, Chris On 11/8/10 11:26 AM, "Enis Söztutar" wrote: >From my experience the SQL backend is a mJOR headache. Writing a SQL backend is actuall

Re: HSQLDB woes...

2010-11-08 Thread Enis Söztutar
>From my experience the SQL backend is a mJOR headache. Writing a SQL backend is actually much much harder than the HBase or Cassandra backend since we need very custom code for each SQL server. Plus, there is some code for dealing with HSQL embedded mode. I completely agree to switch to another z

HSQLDB woes...

2010-11-05 Thread Andrzej Bialecki
Hi, The HSQL-based SqlStore exhibits awful performance when used with Nutch. I believe this is related to the way LOBs are handled in HSQL - even for a tiny crawl of 50 pages the size of the .lob file is in the order of 100MB. Actually, after reaching this point the performance of any updates drop