Re: Problem with SolrCloud + Zookeeper + DataImportHandler
The mail programs usually strip out attachments, so your attachments didn't go through. Maybe put it on Pastebin or similar? But since you say it works on a single node, I wonder if one or more of your nodes has an old jar on it that's getting used. One could test it by trying to run your import on each node independently. Best Erick On Thu, Aug 8, 2013 at 11:19 PM, 兴涛孙 sunxing...@gmail.com wrote: hello,guys: I've encounted a problem about configuring many cluested nodes with solr,so i want to ask for your help,thanks in advance! The problems lists as follows: 1.Installation platform: solr4.3.1,zookeeper 3.4.5 and tomcat 7 with jdk1.7 2.when i configured single node with DIH to build index,it can work properly,but when i configured one more(three nodes present) shard nodes with solr,then import data with DIH,some errors occured,i cannot find the reason,error information lists as follows: 2013-08-09 08:19:24,349 : ERROR [http-bio-8983-exec-72] null:java.lang.ClassCastException: org.apache.lucene.codecs.BlockTreeTermsWriter$PendingTerm cannot be cast to org.apache.lucene.codecs.BlockTreeTermsWriter$PendingBlock 3.Details information and error messages enclosed with this message,for more information,please refer to it. Looking forward to hearing from you,thanks a lot. Yours, ★★★ § sunxingtao § MOBILE:18643108123 § EMail:sunxing...@gmail.com ★★★
Problem with SolrCloud + Zookeeper + DataImportHandler
hello,guys: I've encounted a problem about configuring many cluested nodes with solr,so i want to ask for your help,thanks in advance! The problems lists as follows: 1.Installation platform: solr4.3.1,zookeeper 3.4.5 and tomcat 7 with jdk1.7 2.when i configured single node with DIH to build index,it can work properly,but when i configured one more(three nodes present) shard nodes with solr,then import data with DIH,some errors occured,i cannot find the reason,error information lists as follows: 2013-08-09 08:19:24,349 : ERROR [http-bio-8983-exec-72] null:java.lang.ClassCastException: org.apache.lucene.codecs.BlockTreeTermsWriter$PendingTerm cannot be cast to org.apache.lucene.codecs.BlockTreeTermsWriter$PendingBlock 3.Details information and error messages enclosed with this message,for more information,please refer to it. Looking forward to hearing from you,thanks a lot. Yours, ★★★ § sunxingtao § MOBILE:18643108123 § EMail:sunxing...@gmail.com ★★★
RE: Problem with SolrCloud + Zookeeper + DataImportHandler
Hi, As you've asked. https://issues.apache.org/jira/browse/SOLR-3165 If you have any questions or need more details I can debug this problem more. Agnieszka -Original Message- From: Mark Miller [mailto:markrmil...@gmail.com] Sent: Friday, February 24, 2012 10:11 PM To: solr-user@lucene.apache.org Subject: Re: Problem with SolrCloud + Zookeeper + DataImportHandler The key piece is ZkSolrResourceLoader does not support getConfigDir() Apparently DIH is doing something that requires getting the local config dir path - but this is on ZK in SolrCloud mode, not the local filesystem. Could you make a JIRA issue for this? I could look into a work around depending on why DIH needs to do this. - Mark On Feb 20, 2012, at 7:28 AM, Agnieszka Kukałowicz wrote: Hi All, I've recently downloaded latest solr trunk to configure solrcloud with zookeeper using standard configuration from wiki: http://wiki.apache.org/solr/SolrCloud. The problem occurred when I tried to configure DataImportHandler in solrconfig.xml: requestHandler name=/dataimport class=org.apache.solr.handler.dataimport.DataImportHandler lst name=defaults str name=configdb-data-config.xml/str /lst /requestHandler After starting solr with zookeeper I've got errors: Feb 20, 2012 11:30:12 AM org.apache.solr.common.SolrException log SEVERE: null:org.apache.solr.common.SolrException at org.apache.solr.core.SolrCore.init(SolrCore.java:606) at org.apache.solr.core.SolrCore.init(SolrCore.java:490) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:705) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:442) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:313) at org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer .ja va:262) at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java :98 ) at org.mortbay.jetty.servlet.FilterHolder.doStart(FilterHolder.java:97) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50 ) at org.mortbay.jetty.servlet.ServletHandler.initialize(ServletHandler.java :71 3) at org.mortbay.jetty.servlet.Context.startContext(Context.java:140) at org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java: 128 2) at org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:51 8) at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50 ) at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.j ava :152) at org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandl erC ollection.java:156) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50 ) at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.j ava :152) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50 ) at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:13 0) at org.mortbay.jetty.Server.doStart(Server.java:224) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50 ) at org.mortbay.xml.XmlConfiguration.main(XmlConfiguration.java:985) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.ja va: 39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccesso rIm pl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.mortbay.start.Main.invokeMain(Main.java:194) at org.mortbay.start.Main.start(Main.java:534) at org.mortbay.start.Main.start(Main.java:441) at org.mortbay.start.Main.main(Main.java:119) Caused by: org.apache.solr.common.SolrException: FATAL: Could not create importer. DataImporter config invalid at org.apache.solr.handler.dataimport.DataImportHandler.inform(DataImportH and ler.java:120) at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java: 542 ) at org.apache.solr.core.SolrCore.init(SolrCore.java:601) ... 31 more Caused by: org.apache.solr.common.cloud.ZooKeeperException: ZkSolrResourceLoader does not support getConfigDir() - likely, w at org.apache.solr.cloud.ZkSolrResourceLoader.getConfigDir(ZkSolrResourceL oad er.java:99) at org.apache.solr.handler.dataimport.SimplePropertiesWriter.init(SimplePr ope rtiesWriter.java:47) at org.apache.solr.handler.dataimport.DataImporter.init(DataImporter.jav a:1 12
Re: Problem with SolrCloud + Zookeeper + DataImportHandler
The key piece is ZkSolrResourceLoader does not support getConfigDir() Apparently DIH is doing something that requires getting the local config dir path - but this is on ZK in SolrCloud mode, not the local filesystem. Could you make a JIRA issue for this? I could look into a work around depending on why DIH needs to do this. - Mark On Feb 20, 2012, at 7:28 AM, Agnieszka Kukałowicz wrote: Hi All, I've recently downloaded latest solr trunk to configure solrcloud with zookeeper using standard configuration from wiki: http://wiki.apache.org/solr/SolrCloud. The problem occurred when I tried to configure DataImportHandler in solrconfig.xml: requestHandler name=/dataimport class=org.apache.solr.handler.dataimport.DataImportHandler lst name=defaults str name=configdb-data-config.xml/str /lst /requestHandler After starting solr with zookeeper I've got errors: Feb 20, 2012 11:30:12 AM org.apache.solr.common.SolrException log SEVERE: null:org.apache.solr.common.SolrException at org.apache.solr.core.SolrCore.init(SolrCore.java:606) at org.apache.solr.core.SolrCore.init(SolrCore.java:490) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:705) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:442) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:313) at org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.ja va:262) at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:98 ) at org.mortbay.jetty.servlet.FilterHolder.doStart(FilterHolder.java:97) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.mortbay.jetty.servlet.ServletHandler.initialize(ServletHandler.java:71 3) at org.mortbay.jetty.servlet.Context.startContext(Context.java:140) at org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:128 2) at org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:518) at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java :152) at org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandlerC ollection.java:156) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java :152) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130) at org.mortbay.jetty.Server.doStart(Server.java:224) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.mortbay.xml.XmlConfiguration.main(XmlConfiguration.java:985) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java: 39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorIm pl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.mortbay.start.Main.invokeMain(Main.java:194) at org.mortbay.start.Main.start(Main.java:534) at org.mortbay.start.Main.start(Main.java:441) at org.mortbay.start.Main.main(Main.java:119) Caused by: org.apache.solr.common.SolrException: FATAL: Could not create importer. DataImporter config invalid at org.apache.solr.handler.dataimport.DataImportHandler.inform(DataImportHand ler.java:120) at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:542 ) at org.apache.solr.core.SolrCore.init(SolrCore.java:601) ... 31 more Caused by: org.apache.solr.common.cloud.ZooKeeperException: ZkSolrResourceLoader does not support getConfigDir() - likely, w at org.apache.solr.cloud.ZkSolrResourceLoader.getConfigDir(ZkSolrResourceLoad er.java:99) at org.apache.solr.handler.dataimport.SimplePropertiesWriter.init(SimplePrope rtiesWriter.java:47) at org.apache.solr.handler.dataimport.DataImporter.init(DataImporter.java:1 12) at org.apache.solr.handler.dataimport.DataImportHandler.inform(DataImportHand ler.java:114) ... 33 more I've checked if file db-data-config.xml is available in Zookeeper: [zk: localhost:2181(CONNECTED) 0] ls /configs/conf1 [admin-extra.menu-top.html, dict, solrconfig.xml, dataimport.properties, admin-extra.html, solrconfig.xml.old, solrconfig.xml.new, solrconfig.xml~, xslt, db-data-config.xml, velocity, elevate.xml, admin-extra.menu-bottom.html, solrconfig.xml.dataimport, schema.xml] [zk: localhost:2181(CONNECTED) 1] Is it possible to configure DIH with Zookeper? And how
Problem with SolrCloud + Zookeeper + DataImportHandler
Hi All, I've recently downloaded latest solr trunk to configure solrcloud with zookeeper using standard configuration from wiki: http://wiki.apache.org/solr/SolrCloud. The problem occurred when I tried to configure DataImportHandler in solrconfig.xml: requestHandler name=/dataimport class=org.apache.solr.handler.dataimport.DataImportHandler lst name=defaults str name=configdb-data-config.xml/str /lst /requestHandler After starting solr with zookeeper I've got errors: Feb 20, 2012 11:30:12 AM org.apache.solr.common.SolrException log SEVERE: null:org.apache.solr.common.SolrException at org.apache.solr.core.SolrCore.init(SolrCore.java:606) at org.apache.solr.core.SolrCore.init(SolrCore.java:490) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:705) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:442) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:313) at org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.ja va:262) at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:98 ) at org.mortbay.jetty.servlet.FilterHolder.doStart(FilterHolder.java:97) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.mortbay.jetty.servlet.ServletHandler.initialize(ServletHandler.java:71 3) at org.mortbay.jetty.servlet.Context.startContext(Context.java:140) at org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:128 2) at org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:518) at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java :152) at org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandlerC ollection.java:156) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java :152) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130) at org.mortbay.jetty.Server.doStart(Server.java:224) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.mortbay.xml.XmlConfiguration.main(XmlConfiguration.java:985) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java: 39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorIm pl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.mortbay.start.Main.invokeMain(Main.java:194) at org.mortbay.start.Main.start(Main.java:534) at org.mortbay.start.Main.start(Main.java:441) at org.mortbay.start.Main.main(Main.java:119) Caused by: org.apache.solr.common.SolrException: FATAL: Could not create importer. DataImporter config invalid at org.apache.solr.handler.dataimport.DataImportHandler.inform(DataImportHand ler.java:120) at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:542 ) at org.apache.solr.core.SolrCore.init(SolrCore.java:601) ... 31 more Caused by: org.apache.solr.common.cloud.ZooKeeperException: ZkSolrResourceLoader does not support getConfigDir() - likely, w at org.apache.solr.cloud.ZkSolrResourceLoader.getConfigDir(ZkSolrResourceLoad er.java:99) at org.apache.solr.handler.dataimport.SimplePropertiesWriter.init(SimplePrope rtiesWriter.java:47) at org.apache.solr.handler.dataimport.DataImporter.init(DataImporter.java:1 12) at org.apache.solr.handler.dataimport.DataImportHandler.inform(DataImportHand ler.java:114) ... 33 more I've checked if file db-data-config.xml is available in Zookeeper: [zk: localhost:2181(CONNECTED) 0] ls /configs/conf1 [admin-extra.menu-top.html, dict, solrconfig.xml, dataimport.properties, admin-extra.html, solrconfig.xml.old, solrconfig.xml.new, solrconfig.xml~, xslt, db-data-config.xml, velocity, elevate.xml, admin-extra.menu-bottom.html, solrconfig.xml.dataimport, schema.xml] [zk: localhost:2181(CONNECTED) 1] Is it possible to configure DIH with Zookeper? And how to do it? I'm little confused with that. Regards Agnieszka Kukalowicz
