Re: distributed search is significantly slower than direct search

Hi, I isolated the case Installed on a new machine (2 x Xeon E5410 2.33GHz) I have an environment with 12Gb of memory. I assigned 6gb of memory to Solr and I’m not running any other memory consuming process so no memory issues should arise. Removed all indexes apart from two: emptyCore –

Re: distributed search is significantly slower than direct search

Hi Yuval, quick question. You say that your code has 750k docs and around 400mb? Is this some kind of test dataset and you expect it to grow significantly? For an index of this size, I wouldn't use distributed search, single shard should be fine. Tomás On Sun, Nov 17, 2013 at 6:50 AM, Yuval

Re: distributed search is significantly slower than direct search

Hi Tomás This is just a test environment meant only to reproduce the issue I am currently investigating. The number of documents should grow substantially (billions of docs). On Sun, Nov 17, 2013 at 7:12 PM, Tomás Fernández Löbbe tomasflo...@gmail.com wrote: Hi Yuval, quick question. You say

Re: distributed search is significantly slower than direct search

You are asking for 5000 docs right? And that’s forcing us to look up 5000 external to internal ids. I think this always had a cost, but it’s obviously worse if you ask for a ton of results. I don’t think single node has to do this? And if we had like Searcher leases or something (we will

Install SOLr Cloud

New to SOLR cloud and am looking for some guidance on Install and configure. I was also looking at the Bitnami SOLR cloud ami. Any article or a link where there is some help on install. My idea is to have 3 VM’s on AWS, now I am not sure after building the VM’s how do I make a cluster from

Re: Install SOLr Cloud

You should start reading from here: http://wiki.apache.org/solr/SolrCloud 2013/11/17 dinar dalvi dinar.da...@kaybus.com New to SOLR cloud and am looking for some guidance on Install and configure. I was also looking at the Bitnami SOLR cloud ami. Any article or a link where there is some

Editing config files in the Solr Admin UI

Stefan Matheis and I have conspired to make the various Solr config files editable from the admin UI. Here's the Wiki writeup: https://wiki.apache.org/solr/Editing%20configuration%20files%20in%20the%20admin%20UI It's not quite complete yet, see the sub-issues attached to

Datadir Could not Set via System Properties?

I have removed the line of *dataDir* from my schema.xml and I have not a property defined as *dataDir *at my old style solr.xml. I have that line of codes: System.setProperty(solr.data.dir, /home/somewhere/data); CoreContainer coreContainer = CoreContainer.createAndLoad(solrHomePath,

Nutch 1.7 solrdedup error

When trying to delete duplicates after crawl I get the following, http://pastebin.com/aQbqmPLm When running this command on terminal: $ bin/nutch solrdedup http://localhost:8983/solr/rockies Here is my setup: - Nutch 1.7 - Solr 4.5.0 - java version 1.6.0_51 On Stackoverflow as well,

Re: distributed search is significantly slower than direct search

In order to accelerate the BinaryResponseWriter.write we extended this writer class to implement the docid to id tranformation by docValues (on memory) with no need to access stored field for id reading nor lazy loading of fields that also has a cost. That should improve read rate as docValues are

Re: exceeded limit of maxWarmingSearchers ERROR

Hi Erickson, Thanks for your reply. Iam getting the following error with liferay tomcat. 2013/11/18 07:29:42 ERROR com.liferay.portal.search.solr.SolrIndexWriterImpl.deleteDocument(SolrIndexWriterImpl.java:90) [] [liferay/search_writer] org.apache.solr.common.SolrException: Not Found Not

Solr cloud view shows core as down after using reload action

Hi, I have a solr set up using external zookeeper . Whenever there are any schema changes to be made I make those changes and upload the new config via cloud-scripts. I then reload the core using the action http://localhost:8190/solr/admin/cores?action=RELOADcore=coreName Everything works fine