Re: Tips for faster indexing

2015-07-19 Thread Erick Erickson
First thing is it looks like you're only sending one document at a time, perhaps with child objects. This is not optimal at all. I usually batch my docs up in groups of 1,000, and there is anecdotal evidence that there may (depending on the docs) be some gains above that number. Gotta balance the b

Re: Usage of CloudSolrStream while new data is indexed

2015-07-19 Thread Erick Erickson
The basic assumption is that any search has a "snapshot" of the index via the currently open searcher. I expect the streaming code is no different, indexing while reading from a stream should _not_ show documents that weren't in the index (and visible) when they query was submitted, regardless of h

Tips for faster indexing

2015-07-19 Thread Vineeth Dasaraju
Hi, I am trying to index JSON objects (which contain nested JSON objects and Arrays in them) into solr. My JSON Object looks like the following (This is fake data that I am using for this example): { "RawEventMessage": "Lorem ipsum dolor sit amet, consectetur adipiscing elit. Aliquam dolor o

Usage of CloudSolrStream while new data is indexed

2015-07-19 Thread mihaela olteanu
Hello, I am iterating through a whole collection in SolrCloud using CloudSolrStream. While I am doing this operation new data gets indexed into the collection. Does CloudSolrStream pick up the newly added values? Is it negatively impacted by this operation or what is the impact of the collection

Re: Basic auth

2015-07-19 Thread Erick Erickson
You're mixing up a couple of things. The Drupal is specific to, well, Drupal. You'd probably be best off asking about that on the Drupal lists. SOLR-4470 has not been committed yet, so you can't really use it. This may have been superceded by SOLR-7274 and there's a link to the Wiki that points to

Re: Basic auth

2015-07-19 Thread solr . user . 1507
I followed this guide: http://learnsubjects.drupalgardens.com/content/how-place-http-authentication-solr But there is some something wrong, can anyone help or refer to a guide on how to setup http basic auth? Regards > On 19 Jul 2015, at 01:10, solr.user.1...@gmail.com wrote: > > SOLR-4470 is

Re: solr blocking and client timeout issue

2015-07-19 Thread Shawn Heisey
On 7/19/2015 12:46 AM, Jeremy Ashcraft wrote: > That did the trick. The GC tuning options also seems to be working, but > I guess we'll see when traffic ramps back up on monday. Thanks for all > your help! > > On 7/18/2015 8:16 AM, Shawn Heisey wrote: >> The first thing I'd try is removing the U