Re: Problem with SolrCloud + Zookeeper + DataImportHandler
The mail programs usually strip out attachments, so your attachments didn't go through. Maybe put it on Pastebin or similar? But since you say it works on a single node, I wonder if one or more of your nodes has an old jar on it that's getting used. One could test it by trying to run your import on each node independently. Best Erick On Thu, Aug 8, 2013 at 11:19 PM, 兴涛孙 wrote: > hello,guys: > > > > I've encounted a problem about configuring many cluested nodes with solr,so > i want to ask for your help,thanks in advance! > > The problems lists as follows: > > 1.Installation platform: > > solr4.3.1,zookeeper 3.4.5 and tomcat 7 with jdk1.7 > > 2.when i configured single node with DIH to build index,it can work > properly,but when i configured one more(three nodes present) shard nodes > with solr,then import data with DIH,some errors occured,i cannot find the > reason,error information lists as follows: > > 2013-08-09 08:19:24,349 : ERROR [http-bio-8983-exec-72] > null:java.lang.ClassCastException: > org.apache.lucene.codecs.BlockTreeTermsWriter$PendingTerm cannot be cast to > org.apache.lucene.codecs.BlockTreeTermsWriter$PendingBlock > > 3.Details information and error messages enclosed with this message,for > more information,please refer to it. > > > > Looking forward to hearing from > you,thanks a lot. > > > > Yours, > > > > ★★★ > § sunxingtao > § MOBILE:18643108123 > § EMail:sunxing...@gmail.com > ★★★ >
RE: Problem with SolrCloud + Zookeeper + DataImportHandler
Hi, As you've asked. https://issues.apache.org/jira/browse/SOLR-3165 If you have any questions or need more details I can debug this problem more. Agnieszka > -Original Message- > From: Mark Miller [mailto:markrmil...@gmail.com] > Sent: Friday, February 24, 2012 10:11 PM > To: solr-user@lucene.apache.org > Subject: Re: Problem with SolrCloud + Zookeeper + DataImportHandler > > The key piece is "ZkSolrResourceLoader does not support getConfigDir() > " > > Apparently DIH is doing something that requires getting the local > config dir path - but this is on ZK in SolrCloud mode, not the local > filesystem. > > Could you make a JIRA issue for this? I could look into a work around > depending on why DIH needs to do this. > > - Mark > > On Feb 20, 2012, at 7:28 AM, Agnieszka Kukałowicz wrote: > > > Hi All, > > > > I've recently downloaded latest solr trunk to configure solrcloud > with > > zookeeper > > using standard configuration from wiki: > > http://wiki.apache.org/solr/SolrCloud. > > > > The problem occurred when I tried to configure DataImportHandler in > > solrconfig.xml: > > > > > class="org.apache.solr.handler.dataimport.DataImportHandler"> > > > > db-data-config.xml > > > > > > > > > > After starting solr with zookeeper I've got errors: > > > > Feb 20, 2012 11:30:12 AM org.apache.solr.common.SolrException log > > SEVERE: null:org.apache.solr.common.SolrException > >at org.apache.solr.core.SolrCore.(SolrCore.java:606) > >at org.apache.solr.core.SolrCore.(SolrCore.java:490) > >at > > org.apache.solr.core.CoreContainer.create(CoreContainer.java:705) > >at > org.apache.solr.core.CoreContainer.load(CoreContainer.java:442) > >at > org.apache.solr.core.CoreContainer.load(CoreContainer.java:313) > >at > > > org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer > .ja > > va:262) > >at > > > org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java > :98 > > ) > >at > > org.mortbay.jetty.servlet.FilterHolder.doStart(FilterHolder.java:97) > >at > > > org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50 > ) > >at > > > org.mortbay.jetty.servlet.ServletHandler.initialize(ServletHandler.java > :71 > > 3) > >at > > org.mortbay.jetty.servlet.Context.startContext(Context.java:140) > >at > > > org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java: > 128 > > 2) > >at > > > org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:51 > 8) > >at > > > org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499) > >at > > > org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50 > ) > >at > > > org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.j > ava > > :152) > >at > > > org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandl > erC > > ollection.java:156) > >at > > > org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50 > ) > >at > > > org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.j > ava > > :152) > >at > > > org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50 > ) > >at > > > org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:13 > 0) > >at org.mortbay.jetty.Server.doStart(Server.java:224) > >at > > > org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50 > ) > >at > > org.mortbay.xml.XmlConfiguration.main(XmlConfiguration.java:985) > >at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > >at > > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.ja > va: > > 39) > >at > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccesso > rIm > > pl.java:25) > >at java.lang.reflect.Method.invoke(Method.java:597) > >at org.mortbay.start.Main.invokeMain(Main.java:194) > >at org.mortbay.start.Main.start(Main.java:534) > >at org.mortbay.start.Main.start(Main.java:441) > >at org.mortbay.start.Main.main(Main.java:119) > > Caused by: org.apache.solr.common.SolrException:
Re: Problem with SolrCloud + Zookeeper + DataImportHandler
The key piece is "ZkSolrResourceLoader does not support getConfigDir() " Apparently DIH is doing something that requires getting the local config dir path - but this is on ZK in SolrCloud mode, not the local filesystem. Could you make a JIRA issue for this? I could look into a work around depending on why DIH needs to do this. - Mark On Feb 20, 2012, at 7:28 AM, Agnieszka Kukałowicz wrote: > Hi All, > > I've recently downloaded latest solr trunk to configure solrcloud with > zookeeper > using standard configuration from wiki: > http://wiki.apache.org/solr/SolrCloud. > > The problem occurred when I tried to configure DataImportHandler in > solrconfig.xml: > > class="org.apache.solr.handler.dataimport.DataImportHandler"> > > db-data-config.xml > > > > > After starting solr with zookeeper I've got errors: > > Feb 20, 2012 11:30:12 AM org.apache.solr.common.SolrException log > SEVERE: null:org.apache.solr.common.SolrException >at org.apache.solr.core.SolrCore.(SolrCore.java:606) >at org.apache.solr.core.SolrCore.(SolrCore.java:490) >at > org.apache.solr.core.CoreContainer.create(CoreContainer.java:705) >at org.apache.solr.core.CoreContainer.load(CoreContainer.java:442) >at org.apache.solr.core.CoreContainer.load(CoreContainer.java:313) >at > org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.ja > va:262) >at > org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:98 > ) >at > org.mortbay.jetty.servlet.FilterHolder.doStart(FilterHolder.java:97) >at > org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) >at > org.mortbay.jetty.servlet.ServletHandler.initialize(ServletHandler.java:71 > 3) >at > org.mortbay.jetty.servlet.Context.startContext(Context.java:140) >at > org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:128 > 2) >at > org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:518) >at > org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499) >at > org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) >at > org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java > :152) >at > org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandlerC > ollection.java:156) >at > org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) >at > org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java > :152) >at > org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) >at > org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130) >at org.mortbay.jetty.Server.doStart(Server.java:224) >at > org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) >at > org.mortbay.xml.XmlConfiguration.main(XmlConfiguration.java:985) >at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java: > 39) >at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorIm > pl.java:25) >at java.lang.reflect.Method.invoke(Method.java:597) >at org.mortbay.start.Main.invokeMain(Main.java:194) >at org.mortbay.start.Main.start(Main.java:534) >at org.mortbay.start.Main.start(Main.java:441) >at org.mortbay.start.Main.main(Main.java:119) > Caused by: org.apache.solr.common.SolrException: FATAL: Could not create > importer. DataImporter config invalid >at > org.apache.solr.handler.dataimport.DataImportHandler.inform(DataImportHand > ler.java:120) >at > org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:542 > ) >at org.apache.solr.core.SolrCore.(SolrCore.java:601) >... 31 more > Caused by: org.apache.solr.common.cloud.ZooKeeperException: > ZkSolrResourceLoader does not support getConfigDir() - likely, w >at > org.apache.solr.cloud.ZkSolrResourceLoader.getConfigDir(ZkSolrResourceLoad > er.java:99) >at > org.apache.solr.handler.dataimport.SimplePropertiesWriter.init(SimplePrope > rtiesWriter.java:47) >at > org.apache.solr.handler.dataimport.DataImporter.(DataImporter.java:1 > 12) >at > org.apache.solr.handler.dataimport.DataImportHandler.inform(DataImportHand > ler.java:114) >... 33 more > > I've checked if file db-data-config.xml is available in Zookeeper: > > [zk: localhost:2181(CONNECTED) 0] ls /configs/conf1 > [admin-extra.menu-top.html, dict, solrconfig.xml, dataimport.properties, > admin-extra.html, solrconfig.xml.old, solrconfig.xml.new, solrconfig.xml~, > xslt, db-data-config.xml, velocity, elevate.xml, > admin-extra.menu-bottom.html, solrconfig.xml.dataimport, schema.xml] > [zk: localhost:2181(CONNECTED) 1] > > Is it possible to configure DIH wi
