Re: How to use Apache Cassandra with Apache Solr

2012-09-09 Thread Voth, Brad (GE Corporate)
Be wary off solandra, after talking with jake (its developer) I have learned it was a poc for the integration in datastax and it is now abandoned. Interestingly I just did a bakeoff between datastax, solandra, solr and elasticsearch for our environment and datastax performed decently but the

RE: Injest pauses

2012-08-29 Thread Voth, Brad (GE Corporate)
Very interesting links, after much more digging yesterday this appears to be exactly what I'm seeing. I am using 4.0 beta currently for my testing. FWIW I've also pulled trunk from svn as of yesterday and experienced the same issue. From: Alexey Serba

RE: Injest pauses

2012-08-29 Thread Voth, Brad (GE Corporate)
. -Original Message- From: Voth, Brad (GE Corporate) Sent: Wednesday, August 29, 2012 10:17 AM To: solr-user@lucene.apache.org Subject: RE: Injest pauses Very interesting links, after much more digging yesterday this appears to be exactly what I'm seeing. I am using 4.0 beta currently for my

RE: Injest pauses

2012-08-29 Thread Voth, Brad (GE Corporate)
at 11:58 AM, Voth, Brad (GE Corporate) brad.v...@ge.com wrote: Anyone know the actual status of SOLR-2565, it looks to be marked as resolved in 4.* but I am still seeing long pauses during commits using 4.* SOLR-2565 is definitely committed - adds are no longer blocked by commits (at least

RE: Injest pauses

2012-08-29 Thread Voth, Brad (GE Corporate)
Interestingly it is not pausing during every commit so at least a portion of the time the async commit code is working. Trying to track down the case where a wait would still be issued. -Original Message- From: Voth, Brad (GE Corporate) Sent: Wednesday, August 29, 2012 12:32 PM

RE: Injest pauses

2012-08-28 Thread Voth, Brad (GE Corporate)
I've noticed the following messages in the infostream log around the times the pauses begin... DW 0 [Tue Aug 28 13:25:29 UTC 2012; qtp435584308-969]: WARNING DocumentsWriter has stalled threads; waiting From: Voth, Brad (GE Corporate) Sent: Monday

RE: Injest pauses

2012-08-28 Thread Voth, Brad (GE Corporate)
if the flushing is able to keep up at some point. From: Shawn Heisey [s...@elyograg.org] Sent: Tuesday, August 28, 2012 1:37 PM To: solr-user@lucene.apache.org Subject: Re: Injest pauses On 8/27/2012 2:54 PM, Voth, Brad (GE Corporate) wrote: Hello all, I'm working

Injest pauses

2012-08-27 Thread Voth, Brad (GE Corporate)
Hello all, I'm working on implementing a solution in a very high index rate, lower query rate project. We have a very small record size, 2 small strings, 6 longs, 7 ints, and 2 dates, indexing on 8 of those fields. We need to be able to maintain an injest rate of 50k records/sec average.