solrcloud no server hosting shard
Hi guys, before starting note that I am new with solr and in particular with solrcloud. I have to index many many documents (>10mln), last week I have complete my import handler and configuration so I have started import activity on solr using solrcloud with 10 shard (and without replicas :S ) on VM with 30giga of RAM and good performance (I don't know if 10 are too much). Today I see that during specific update (delete of wrong document) of a specific document following exception was thrown: org.apache.solr.common.SolrException: no servers hosting shard: at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:148) at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:118) at java.util.concurrent.FutureTask.run(Unknown Source) at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.util.concurrent.FutureTask.run(Unknown Source) at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) After restarting solrcloud the exception is thrown during update of another document. Nevertheless, search queries work fine but slow. I thank you so much in advance if you can help me with this exception or if you have any suggestion for my configuration. Is it a must to have some replicas of shards? can I add now a replica after some million of document indexed? To configure solrcloud I have essentially used default configuration and I have read general solrcloud wiki, are there any suggestions to use solr with this size of document in a more comfortable way? Thanks again, Giuseppe p.s. sorry for my english :) -- View this message in context: http://lucene.472066.n3.nabble.com/solrcloud-no-server-hosting-shard-tp4107268.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: SolrCloud and MoreLikeThis: SOLR-788
great, thanks very much for your kind support, with this query I can perform a sort of workaround to SOLR-4414 issue, what do you think about? I am wrong? Anyway, I am new with solr and solrcloud too, but I am having a full immersion with it from few days to index very large mole of documents. So, any hint is appreciate, for instance I don't know if the choice to use 10 shards on the same server (30giga RAM) is good and how much number of shards is impact on indexing time. Tx a lot, -giuseppe Date: Thu, 12 Dec 2013 06:38:09 -0800 From: ml-node+s472066n4106382...@n3.nabble.com To: giuseppe_fe...@hotmail.com Subject: Re: SolrCloud and MoreLikeThis: SOLR-788 Hi; Yes, I am talking about SOLR-788. There writes 4.1 so it means that it has fixed at 4.1. On the other hand some patches are applied both for ongoing versions and trunk. 5.0 is the trunk version of Solr. For your other question: what do you mean with: "where is document with this id?". If you want to learn the shard that document belongs to you can do that: http://localhost:8983/solr/collection1/select?q=*%3A*&fl=url%2C+%5Bshard%5D&wt=json&indent=true Thanks; Furkan KAMACI 2013/12/12 gf80 <[hidden email]> > Hi, > thanks for the answer, I think that you mean the issue SOLR-788, isn't it? > if yes, I think that it's solved as you say, but I see Fix Version/s: > > > 4.1, > 5.0, so is it possible > that it's not already delivered in Solr4.6? > However I think that solving related issue my problem is not solved :(. > > I am just trying to find a warkaround, for example is there any way to ask > solrcloud about "where is document with this id?", if yes I can try to > customize morelikethis to do this question before to ask for MLT on a owner > shard. Obviously, I am assuming that after selecting the right shard the > MLT answer include documents in other shards. > > Let me know if you have any suggestion, thanks in advance, > -giuseppe > > > Date: Thu, 12 Dec 2013 03:51:04 -0800 > From: [hidden email] > To: [hidden email] > Subject: Re: SolrCloud and MoreLikeThis: SOLR-788 > > > > Hi; > > > SOLR-4414 has no patch. It's related issue has patches bu it seems fixed > > since Solr 4.1 > > > Thanks; > > Furkan KAMACI > > > > > > 2013/12/12 gf80 <[hidden email]> > > > > Hi guys, > > > > > > could you kindly help me to apply patch for MoreLikeThis on solrcloud. > > > I'm using Solr 4.6 and I'm using solrcloud with 10 shards. > > > The problem is described here > > > https://issues.apache.org/jira/browse/SOLR-4414 > > but I think that it was solved but not already delivered in Solr4.6. > > > > > > Thanks a lot in advance, > > > Giuseppe > > > > > > P.S. Rakudten: Did you figure out the problem applying patch? Tx > > > > > > > > > > > > -- > > > View this message in context: > > > > http://lucene.472066.n3.nabble.com/SolrCloud-and-MoreLikeThis-SOLR-788-tp4022581p4106258.html > > Sent from the Solr - User mailing list archive at Nabble.com. > > > > > > > > > > > > > > > > If you reply to this email, your message will be added to > the discussion below: > > http://lucene.472066.n3.nabble.com/SolrCloud-and-MoreLikeThis-SOLR-788-tp4022581p4106355.html > > > > To unsubscribe from SolrCloud and MoreLikeThis: SOLR-788, > click here. > > NAML > > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/SolrCloud-and-MoreLikeThis-SOLR-788-tp4022581p4106364.html > Sent from the Solr - User mailing list archive at Nabble.com. > If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/SolrCloud-and-MoreLikeThis-SOLR-788-tp4022581p4106382.html To unsubscribe from SolrCloud and MoreLikeThis: SOLR-788, click here. NAML -- View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-and-MoreLikeThis-SOLR-788-tp4022581p4106385.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: SolrCloud and MoreLikeThis: SOLR-788
Hi, thanks for the answer, I think that you mean the issue SOLR-788, isn't it? if yes, I think that it's solved as you say, but I see Fix Version/s: 4.1, 5.0, so is it possible that it's not already delivered in Solr4.6? However I think that solving related issue my problem is not solved :(. I am just trying to find a warkaround, for example is there any way to ask solrcloud about "where is document with this id?", if yes I can try to customize morelikethis to do this question before to ask for MLT on a owner shard. Obviously, I am assuming that after selecting the right shard the MLT answer include documents in other shards. Let me know if you have any suggestion, thanks in advance, -giuseppe Date: Thu, 12 Dec 2013 03:51:04 -0800 From: ml-node+s472066n4106355...@n3.nabble.com To: giuseppe_fe...@hotmail.com Subject: Re: SolrCloud and MoreLikeThis: SOLR-788 Hi; SOLR-4414 has no patch. It's related issue has patches bu it seems fixed since Solr 4.1 Thanks; Furkan KAMACI 2013/12/12 gf80 <[hidden email]> > Hi guys, > > could you kindly help me to apply patch for MoreLikeThis on solrcloud. > I'm using Solr 4.6 and I'm using solrcloud with 10 shards. > The problem is described here > https://issues.apache.org/jira/browse/SOLR-4414 > but I think that it was solved but not already delivered in Solr4.6. > > Thanks a lot in advance, > Giuseppe > > P.S. Rakudten: Did you figure out the problem applying patch? Tx > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/SolrCloud-and-MoreLikeThis-SOLR-788-tp4022581p4106258.html > Sent from the Solr - User mailing list archive at Nabble.com. > If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/SolrCloud-and-MoreLikeThis-SOLR-788-tp4022581p4106355.html To unsubscribe from SolrCloud and MoreLikeThis: SOLR-788, click here. NAML -- View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-and-MoreLikeThis-SOLR-788-tp4022581p4106364.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: SolrCloud with large synonym files
Tx a lot Jack tomorrow I split synonyms file. Anyway, do you know how can I set jute.maxbuffer? --giuseppe Inviato da iPhone Il giorno 11/dic/2013, alle ore 22:40, "Jack Krupansky-2 [via Lucene]" ha scritto: > Note that the synonym filter accepts a comma-separated list of synonym > files, so you can split your huge synonym file into two or more smaller > files. > > --Jack Krupansky > > -Original Message- > From: gf80 > Sent: Wednesday, December 11, 2013 5:21 PM > To: [hidden email] > Subject: RE: SolrCloud with large synonym files > > Hi all, > > I have the same exception > > org.apache.zookeeper.KeeperException$ConnectionLossException: > KeeperErrorCode = > ConnectionLoss for /configs/myconf/synonyms.txt > > synonyms.txt is greater than 1,5Mb > > I have tried to set jute.maxbuffer specifying -Djute.maxbuffer=1024M at the > solrcloud startup but I'm not able to figure out the problem. > Please let me know your suggestions/solutions. > Thanks a lot in advance, > Giuseppe > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/SolrCloud-with-large-synonym-files-tp3473568p4106239.html > Sent from the Solr - User mailing list archive at Nabble.com. > > > > If you reply to this email, your message will be added to the discussion > below: > http://lucene.472066.n3.nabble.com/SolrCloud-with-large-synonym-files-tp3473568p4106246.html > To unsubscribe from SolrCloud with large synonym files, click here. > NAML -- View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-with-large-synonym-files-tp3473568p4106268.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: SolrCloud and MoreLikeThis: SOLR-788
Hi guys, could you kindly help me to apply patch for MoreLikeThis on solrcloud. I'm using Solr 4.6 and I'm using solrcloud with 10 shards. The problem is described here https://issues.apache.org/jira/browse/SOLR-4414 but I think that it was solved but not already delivered in Solr4.6. Thanks a lot in advance, Giuseppe P.S. Rakudten: Did you figure out the problem applying patch? Tx -- View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-and-MoreLikeThis-SOLR-788-tp4022581p4106258.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: SolrCloud with large synonym files
Hi all, I have the same exception org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /configs/myconf/synonyms.txt synonyms.txt is greater than 1,5Mb I have tried to set jute.maxbuffer specifying -Djute.maxbuffer=1024M at the solrcloud startup but I'm not able to figure out the problem. Please let me know your suggestions/solutions. Thanks a lot in advance, Giuseppe -- View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-with-large-synonym-files-tp3473568p4106239.html Sent from the Solr - User mailing list archive at Nabble.com.
