Re: SPLITSHARD not working in SOLR-4.4.0
Sorry I misunderstood. That NPE can only happen if the uniqueKey is not defined. The code already checks for a reader.fields() returning null. On Wed, Oct 16, 2013 at 11:22 AM, Shalin Shekhar Mangar shalinman...@gmail.com wrote: Just to be clear, you had a required uniqueKey defined in the schema before you indexed any document, is that correct? It is possible to have a NPE in that line if there is an empty segment or if there are documents but no fields! I'm curious to understand how you ended up with an index like that. On Wed, Oct 16, 2013 at 11:01 AM, RadhaJayalakshmi rlakshminaraya...@inautix.co.in wrote: Thanks for the response!! Yes i have defined unique key in the schema... Still it is throwing the same error.. Is this SPLITSHARD a new feature that is under development in solr 4.4? Has anyone able to split the shards using SPLITSHARD successfully? -- View this message in context: http://lucene.472066.n3.nabble.com/SPLITSHARD-not-working-in-SOLR-4-4-0-tp4095623p4095789.html Sent from the Solr - User mailing list archive at Nabble.com. -- Regards, Shalin Shekhar Mangar. -- Regards, Shalin Shekhar Mangar.
Re: SPLITSHARD not working in SOLR-4.4.0
Shalin, It is working for me. As you pointed rightly, i had defined UNIQUE_KEY field in schema, but forgot to mention this field in the uniqueKey decalaration. After i added this, it started working. One another question i have with regard to SPLITSHARD is, we are not able to control, which nodes of tomcat, the splitted shards should be create. While creating a collection, we can mention createNodeSet to set our preference of tomcat nodes on which the collections slices should be created. But i dont find that feature in SPLITSHARD API. Would you know that it is a limitation in solr 4.4 or is there any other means by which we can achieve this -- View this message in context: http://lucene.472066.n3.nabble.com/SPLITSHARD-not-working-in-SOLR-4-4-0-tp4095623p4095809.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: SPLITSHARD not working in SOLR-4.4.0
Thanks for clearing that. The way it is implemented, shard splitting must create the leaders of sub-shards on the same node as the leader of the parent shard. The location of the other replicas of the sub-shards are chosen at random. Split shard doesn't support a createNodeSet parameter yet but it'd make for a nice improvement. Can you please open a jira issue? On Wed, Oct 16, 2013 at 1:00 PM, RadhaJayalakshmi rlakshminaraya...@inautix.co.in wrote: Shalin, It is working for me. As you pointed rightly, i had defined UNIQUE_KEY field in schema, but forgot to mention this field in the uniqueKey decalaration. After i added this, it started working. One another question i have with regard to SPLITSHARD is, we are not able to control, which nodes of tomcat, the splitted shards should be create. While creating a collection, we can mention createNodeSet to set our preference of tomcat nodes on which the collections slices should be created. But i dont find that feature in SPLITSHARD API. Would you know that it is a limitation in solr 4.4 or is there any other means by which we can achieve this -- View this message in context: http://lucene.472066.n3.nabble.com/SPLITSHARD-not-working-in-SOLR-4-4-0-tp4095623p4095809.html Sent from the Solr - User mailing list archive at Nabble.com. -- Regards, Shalin Shekhar Mangar.
Re: SPLITSHARD not working in SOLR-4.4.0
Which is the size of the index?
If the index is too big, the SPLISHARD operation will give you a timeout and
don't will finish
--
Yago Riveiro
Sent with Sparrow (http://www.sparrowmailapp.com/?sig)
On Tuesday, October 15, 2013 at 10:36 AM, RadhaJayalakshmi wrote:
Hi All,
For POC purpose, I just brought up a Tomcat-Solr Cluster, with Zookeeper of
3 zodes.
In one of my collection, i haave only one shard, with two replicas. I just
want to split this shard, so that, it will be splitted by two and each
splitted shard will have two replicas(including the master copy). but when i
execute the SPLITSHARD command, i am getting, the below
NullpointerException:
Exception Trace:
---
ain{StandardDirectoryReader(segments_3:2183:nrt _ua(4.4):C977031)}
79569726 [http-bio-7031-exec-56] INFO
org.apache.solr.update.SolrIndexSplitter – SolrIndexSplitter: partitions=2
segments=1
79569726 [http-bio-7031-exec-56] ERROR
org.apache.solr.handler.admin.CoreAdminHandler – ERROR executing split:
java.lang.NullPointerException
at
org.apache.solr.update.SolrIndexSplitter.split(SolrIndexSplitter.java:154)
at
org.apache.solr.update.SolrIndexSplitter.split(SolrIndexSplitter.java:89)
at
org.apache.solr.update.DirectUpdateHandler2.split(DirectUpdateHandler2.java:766)
at
org.apache.solr.handler.admin.CoreAdminHandler.handleSplitAction(CoreAdminHandler.java:284)
at
org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:186)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
at
org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:611)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:222)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99)
at
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:947)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)
at
org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1009)
at
org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:589)
at
org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:312)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
79569727 [http-bio-7031-exec-56] ERROR org.apache.solr.core.SolrCore –
java.lang.RuntimeException: java.lang.NullPointerException
at
org.apache.solr.handler.admin.CoreAdminHandler.handleSplitAction(CoreAdminHandler.java:290)
at
org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:186)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
at
org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:611)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:222)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99)
at
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:947)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)
at
org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1009)
at
org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:589)
at
org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:312)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
Re: SPLITSHARD not working in SOLR-4.4.0
That is strange. Do you have a uniqueKey defined in the schema? Is it
marked as required?
On Tue, Oct 15, 2013 at 3:06 PM, RadhaJayalakshmi
rlakshminaraya...@inautix.co.in wrote:
Hi All,
For POC purpose, I just brought up a Tomcat-Solr Cluster, with Zookeeper of
3 zodes.
In one of my collection, i haave only one shard, with two replicas. I just
want to split this shard, so that, it will be splitted by two and each
splitted shard will have two replicas(including the master copy). but when
i
execute the SPLITSHARD command, i am getting, the below
NullpointerException:
Exception Trace:
---
ain{StandardDirectoryReader(segments_3:2183:nrt _ua(4.4):C977031)}
79569726 [http-bio-7031-exec-56] INFO
org.apache.solr.update.SolrIndexSplitter – SolrIndexSplitter: partitions=2
segments=1
79569726 [http-bio-7031-exec-56] ERROR
org.apache.solr.handler.admin.CoreAdminHandler – ERROR executing split:
java.lang.NullPointerException
at
org.apache.solr.update.SolrIndexSplitter.split(SolrIndexSplitter.java:154)
at
org.apache.solr.update.SolrIndexSplitter.split(SolrIndexSplitter.java:89)
at
org.apache.solr.update.DirectUpdateHandler2.split(DirectUpdateHandler2.java:766)
at
org.apache.solr.handler.admin.CoreAdminHandler.handleSplitAction(CoreAdminHandler.java:284)
at
org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:186)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
at
org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:611)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:222)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99)
at
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:947)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)
at
org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1009)
at
org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:589)
at
org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:312)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
79569727 [http-bio-7031-exec-56] ERROR org.apache.solr.core.SolrCore –
java.lang.RuntimeException: java.lang.NullPointerException
at
org.apache.solr.handler.admin.CoreAdminHandler.handleSplitAction(CoreAdminHandler.java:290)
at
org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:186)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
at
org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:611)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:222)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99)
at
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:947)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)
at
org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1009)
at
Re: SPLITSHARD not working in SOLR-4.4.0
Thanks for the response!! Yes i have defined unique key in the schema... Still it is throwing the same error.. Is this SPLITSHARD a new feature that is under development in solr 4.4? Has anyone able to split the shards using SPLITSHARD successfully? -- View this message in context: http://lucene.472066.n3.nabble.com/SPLITSHARD-not-working-in-SOLR-4-4-0-tp4095623p4095789.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: SPLITSHARD not working in SOLR-4.4.0
Just to be clear, you had a required uniqueKey defined in the schema before you indexed any document, is that correct? It is possible to have a NPE in that line if there is an empty segment or if there are documents but no fields! I'm curious to understand how you ended up with an index like that. On Wed, Oct 16, 2013 at 11:01 AM, RadhaJayalakshmi rlakshminaraya...@inautix.co.in wrote: Thanks for the response!! Yes i have defined unique key in the schema... Still it is throwing the same error.. Is this SPLITSHARD a new feature that is under development in solr 4.4? Has anyone able to split the shards using SPLITSHARD successfully? -- View this message in context: http://lucene.472066.n3.nabble.com/SPLITSHARD-not-working-in-SOLR-4-4-0-tp4095623p4095789.html Sent from the Solr - User mailing list archive at Nabble.com. -- Regards, Shalin Shekhar Mangar.
