Hello all,
I have 2 BAM instances in 192.168.3.15 and 192.168.3.25 servers. I am
trying to use 3.25 BAM as a cassandra server and 3.15 as an analyzer.
I executed cassandra server BAM and changed master-datasource.xml[1] and
cassandra-components.xml[2] as in the links.
Then I ran my analyzer on other server and tried following script.
REATE EXTERNAL TABLE IF NOT EXISTS callLog
(id STRING, callingPartyNumber STRING, originIp STRING, CalledPartyNumberp
STRING, destIp STRING, duration STRING, timesta STRING)
STORED BY 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler'
WITH SERDEPROPERTIES (
"wso2.carbon.datasource.name" = "WSO2BAM_CASSANDRA_DATASOURCE" ,
"cassandra.cf.name" = "log_analyzer_call_records_logs" ,
"cassandra.columns.mapping" = ":key, payload_callingPartyNumber,
payload_originIp, payload_CalledPartyNumber, payload_destIp,
payload_duration, payload_timestamp" );
When I ran this I get following error saying about problem in connection.
*[2014-02-11 22:07:16,613] ERROR
{org.apache.hadoop.hive.cassandra.CassandraProxyClient} - Error while
trying to connect to cassandra host:192.168.3.25*
*org.apache.hadoop.hive.cassandra.CassandraException: unable to connect to
server*
* at
org.apache.hadoop.hive.cassandra.CassandraClientHolder.initClient(CassandraClientHolder.java:57)*
* at
org.apache.hadoop.hive.cassandra.CassandraClientHolder.<init>(CassandraClientHolder.java:37)*
* at
org.apache.hadoop.hive.cassandra.CassandraProxyClient.createConnection(CassandraProxyClient.java:181)*
* at
org.apache.hadoop.hive.cassandra.CassandraProxyClient.initializeConnection(CassandraProxyClient.java:207)*
* at
org.apache.hadoop.hive.cassandra.CassandraProxyClient.<init>(CassandraProxyClient.java:144)*
* at
org.apache.hadoop.hive.cassandra.CassandraManager.openConnection(CassandraManager.java:188)*
* at
org.apache.hadoop.hive.cassandra.CassandraStorageHandler.preCreateTable(CassandraStorageHandler.java:260)*
* at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:396)*
* at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:540)*
* at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:3479)*
* at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:225)*
* at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:129)*
* at
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:62)*
* at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1351)*
* at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1126)*
* at org.apache.hadoop.hive.ql.Driver.run(Driver.java:934)*
* at
org.apache.hadoop.hive.service.HiveServer$HiveServerHandler.execute(HiveServer.java:201)*
* at
org.apache.hadoop.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:187)*
* at
org.wso2.carbon.analytics.hive.impl.HiveExecutorServiceImpl$ScriptCallable.executeHiveQuery(HiveExecutorServiceImpl.java:569)*
* at
org.wso2.carbon.analytics.hive.impl.HiveExecutorServiceImpl$ScriptCallable.call(HiveExecutorServiceImpl.java:282)*
* at
org.wso2.carbon.analytics.hive.impl.HiveExecutorServiceImpl$ScriptCallable.call(HiveExecutorServiceImpl.java:189)*
* at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)*
* at java.util.concurrent.FutureTask.run(FutureTask.java:166)*
* at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)*
* at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)*
* at java.lang.Thread.run(Thread.java:679)*
*Caused by: org.apache.thrift.transport.TTransportException:
java.net.ConnectException: Connection refused*
* at org.apache.thrift.transport.TSocket.open(TSocket.java:183)*
* at
org.apache.thrift.transport.TFramedTransport.open(TFramedTransport.java:81)*
* at
org.apache.hadoop.hive.cassandra.CassandraClientHolder.initClient(CassandraClientHolder.java:54)*
* ... 25 more*
*Caused by: java.net.ConnectException: Connection refused*
* at java.net.PlainSocketImpl.socketConnect(Native Method)*
* at
java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:327)*
* at
java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:193)*
* at
java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:180)*
* at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:385)*
* at java.net.Socket.connect(Socket.java:546)*
* at org.apache.thrift.transport.TSocket.open(TSocket.java:178)*
* ... 27 more*
*FAILED: Error in metadata: java.lang.NullPointerException*
*[2014-02-11 22:07:16,618] ERROR {org.apache.hadoop.hive.ql.exec.Task} -
FAILED: Error in metadata: java.lang.NullPointerException*
*org.apache.hadoop.hive.ql.metadata.HiveException:
java.lang.NullPointerException*
* at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:546)*
* at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:3479)*
* at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:225)*
* at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:129)*
* at
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:62)*
* at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1351)*
* at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1126)*
* at org.apache.hadoop.hive.ql.Driver.run(Driver.java:934)*
* at
org.apache.hadoop.hive.service.HiveServer$HiveServerHandler.execute(HiveServer.java:201)*
* at
org.apache.hadoop.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:187)*
* at
org.wso2.carbon.analytics.hive.impl.HiveExecutorServiceImpl$ScriptCallable.executeHiveQuery(HiveExecutorServiceImpl.java:569)*
* at
org.wso2.carbon.analytics.hive.impl.HiveExecutorServiceImpl$ScriptCallable.call(HiveExecutorServiceImpl.java:282)*
* at
org.wso2.carbon.analytics.hive.impl.HiveExecutorServiceImpl$ScriptCallable.call(HiveExecutorServiceImpl.java:189)*
* at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)*
* at java.util.concurrent.FutureTask.run(FutureTask.java:166)*
* at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)*
* at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)*
* at java.lang.Thread.run(Thread.java:679)*
*Caused by: java.lang.NullPointerException*
* at
org.apache.hadoop.hive.cassandra.CassandraProxyClient.initializeConnection(CassandraProxyClient.java:223)*
* at
org.apache.hadoop.hive.cassandra.CassandraProxyClient.<init>(CassandraProxyClient.java:144)*
* at
org.apache.hadoop.hive.cassandra.CassandraManager.openConnection(CassandraManager.java:188)*
* at
org.apache.hadoop.hive.cassandra.CassandraStorageHandler.preCreateTable(CassandraStorageHandler.java:260)*
* at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:396)*
* at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:540)*
* ... 17 more*
*FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.DDLTask*
*[2014-02-11 22:07:16,619] ERROR {org.apache.hadoop.hive.ql.Driver} -
FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.DDLTask*
*[2014-02-11 22:07:16,632] ERROR
{org.wso2.carbon.analytics.hive.impl.HiveExecutorServiceImpl} - Error
while executing Hive script.*
*Query returned non-zero code: 9, cause: FAILED: Execution Error, return
code 1 from org.apache.hadoop.hive.ql.exec.DDLTask*
*java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED:
Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask*
* at
org.apache.hadoop.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:189)*
* at
org.wso2.carbon.analytics.hive.impl.HiveExecutorServiceImpl$ScriptCallable.executeHiveQuery(HiveExecutorServiceImpl.java:569)*
* at
org.wso2.carbon.analytics.hive.impl.HiveExecutorServiceImpl$ScriptCallable.call(HiveExecutorServiceImpl.java:282)*
* at
org.wso2.carbon.analytics.hive.impl.HiveExecutorServiceImpl$ScriptCallable.call(HiveExecutorServiceImpl.java:189)*
* at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)*
* at java.util.concurrent.FutureTask.run(FutureTask.java:166)*
* at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)*
* at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)*
* at java.lang.Thread.run(Thread.java:679)*
*[2014-02-11 22:07:16,663] ERROR
{org.wso2.carbon.analytics.hive.ui.client.HiveExecutionClient} - Error
while executing Hive script.Query returned non-zero code: 9, cause: FAILED:
Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask*
*org.wso2.carbon.analytics.hive.stub.HiveExecutionServiceHiveExecutionException:
HiveExecutionServiceHiveExecutionException*
* at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)*
* at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)*
* at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)*
* at java.lang.reflect.Constructor.newInstance(Constructor.java:532)*
* at java.lang.Class.newInstance0(Class.java:374)*
* at java.lang.Class.newInstance(Class.java:327)*
* at
org.wso2.carbon.analytics.hive.stub.HiveExecutionServiceStub.executeHiveScript(HiveExecutionServiceStub.java:216)*
* at
org.wso2.carbon.analytics.hive.ui.client.HiveExecutionClient.executeScript(HiveExecutionClient.java:66)*
* at
org.apache.jsp.hive_002dexplorer.queryresults_jsp._jspService(org.apache.jsp.hive_002dexplorer.queryresults_jsp:92)*
* at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:111)*
* at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)*
* at
org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:403)*
* at
org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:492)*
* at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:378)*
* at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)*
* at org.wso2.carbon.ui.JspServlet.service(JspServlet.java:155)*
* at org.wso2.carbon.ui.TilesJspServlet.service(TilesJspServlet.java:80)*
* at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)*
* at
org.eclipse.equinox.http.helper.ContextPathServletAdaptor.service(ContextPathServletAdaptor.java:37)*
* at
org.eclipse.equinox.http.servlet.internal.ServletRegistration.service(ServletRegistration.java:61)*
* at
org.eclipse.equinox.http.servlet.internal.ProxyServlet.processAlias(ProxyServlet.java:128)*
* at
org.eclipse.equinox.http.servlet.internal.ProxyServlet.service(ProxyServlet.java:68)*
* at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)*
* at
org.wso2.carbon.tomcat.ext.servlet.DelegationServlet.service(DelegationServlet.java:68)*
* at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)*
* at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)*
* at
org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:749)*
* at
org.apache.catalina.core.ApplicationDispatcher.doInclude(ApplicationDispatcher.java:605)*
* at
org.apache.catalina.core.ApplicationDispatcher.include(ApplicationDispatcher.java:544)*
* at
org.eclipse.equinox.http.servlet.internal.RequestDispatcherAdaptor.include(RequestDispatcherAdaptor.java:37)*
* at
org.eclipse.equinox.http.helper.ContextPathServletAdaptor$RequestDispatcherAdaptor.include(ContextPathServletAdaptor.java:369)*
* at
org.apache.jasper.runtime.JspRuntimeLibrary.include(JspRuntimeLibrary.java:1015)*
* at
org.apache.jasper.runtime.PageContextImpl.include(PageContextImpl.java:700)*
* at sun.reflect.GeneratedMethodAccessor43.invoke(Unknown Source)*
* at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)*
* at java.lang.reflect.Method.invoke(Method.java:616)*
* at org.apache.tiles.jsp.context.JspUtil.doInclude(JspUtil.java:87)*
* at
org.apache.tiles.jsp.context.JspTilesRequestContext.include(JspTilesRequestContext.java:88)*
* at
org.apache.tiles.jsp.context.JspTilesRequestContext.dispatch(JspTilesRequestContext.java:82)*
* at
org.apache.tiles.impl.BasicTilesContainer.render(BasicTilesContainer.java:465)*
* at
org.apache.tiles.jsp.taglib.InsertAttributeTag.render(InsertAttributeTag.java:140)*
* at
org.apache.tiles.jsp.taglib.InsertAttributeTag.render(InsertAttributeTag.java:117)*
* at
org.apache.tiles.jsp.taglib.RenderTagSupport.execute(RenderTagSupport.java:171)*
* at
org.apache.tiles.jsp.taglib.RoleSecurityTagSupport.doEndTag(RoleSecurityTagSupport.java:75)*
* at
org.apache.tiles.jsp.taglib.ContainerTagSupport.doEndTag(ContainerTagSupport.java:80)*
* at
org.apache.jsp.admin.layout.template_jsp._jspx_meth_tiles_insertAttribute_7(org.apache.jsp.admin.layout.template_jsp:603)*
* at
org.apache.jsp.admin.layout.template_jsp._jspService(org.apache.jsp.admin.layout.template_jsp:335)*
* at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:111)*
* at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)*
* at
org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:403)*
* at
org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:492)*
* at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:378)*
* at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)*
* at org.wso2.carbon.ui.JspServlet.service(JspServlet.java:155)*
* at org.wso2.carbon.ui.TilesJspServlet.service(TilesJspServlet.java:80)*
* at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)*
* at
org.eclipse.equinox.http.helper.ContextPathServletAdaptor.service(ContextPathServletAdaptor.java:37)*
* at
org.eclipse.equinox.http.servlet.internal.ServletRegistration.service(ServletRegistration.java:61)*
* at
org.eclipse.equinox.http.servlet.internal.ProxyServlet.processAlias(ProxyServlet.java:128)*
* at
org.eclipse.equinox.http.servlet.internal.ProxyServlet.service(ProxyServlet.java:68)*
* at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)*
* at
org.wso2.carbon.tomcat.ext.servlet.DelegationServlet.service(DelegationServlet.java:68)*
* at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)*
* at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)*
* at
org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:749)*
* at
org.apache.catalina.core.ApplicationDispatcher.processRequest(ApplicationDispatcher.java:487)*
* at
org.apache.catalina.core.ApplicationDispatcher.doForward(ApplicationDispatcher.java:412)*
* at
org.apache.catalina.core.ApplicationDispatcher.forward(ApplicationDispatcher.java:339)*
* at
org.eclipse.equinox.http.servlet.internal.RequestDispatcherAdaptor.forward(RequestDispatcherAdaptor.java:30)*
* at
org.eclipse.equinox.http.helper.ContextPathServletAdaptor$RequestDispatcherAdaptor.forward(ContextPathServletAdaptor.java:362)*
* at
org.apache.tiles.servlet.context.ServletTilesRequestContext.forward(ServletTilesRequestContext.java:198)*
* at
org.apache.tiles.servlet.context.ServletTilesRequestContext.dispatch(ServletTilesRequestContext.java:185)*
* at
org.apache.tiles.impl.BasicTilesContainer.render(BasicTilesContainer.java:419)*
* at
org.apache.tiles.impl.BasicTilesContainer.render(BasicTilesContainer.java:370)*
* at org.wso2.carbon.ui.action.ActionHelper.render(ActionHelper.java:52)*
* at org.wso2.carbon.ui.TilesJspServlet.service(TilesJspServlet.java:101)*
* at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)*
* at
org.eclipse.equinox.http.helper.ContextPathServletAdaptor.service(ContextPathServletAdaptor.java:37)*
* at
org.eclipse.equinox.http.servlet.internal.ServletRegistration.service(ServletRegistration.java:61)*
* at
org.eclipse.equinox.http.servlet.internal.ProxyServlet.processAlias(ProxyServlet.java:128)*
* at
org.eclipse.equinox.http.servlet.internal.ProxyServlet.service(ProxyServlet.java:68)*
* at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)*
* at
org.wso2.carbon.tomcat.ext.servlet.DelegationServlet.service(DelegationServlet.java:68)*
* at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)*
* at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)*
* at
org.wso2.carbon.tomcat.ext.filter.CharacterSetFilter.doFilter(CharacterSetFilter.java:61)*
* at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)*
* at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)*
* at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:222)*
* at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123)*
* at
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:472)*
* at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171)*
* at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99)*
* at
org.wso2.carbon.tomcat.ext.valves.CompositeValve.continueInvocation(CompositeValve.java:178)*
* at
org.wso2.carbon.tomcat.ext.valves.CarbonTomcatValve$1.invoke(CarbonTomcatValve.java:47)*
* at
org.wso2.carbon.webapp.mgt.TenantLazyLoaderValve.invoke(TenantLazyLoaderValve.java:56)*
* at
org.wso2.carbon.tomcat.ext.valves.TomcatValveContainer.invokeValves(TomcatValveContainer.java:47)*
* at
org.wso2.carbon.tomcat.ext.valves.CompositeValve.invoke(CompositeValve.java:141)*
* at
org.wso2.carbon.tomcat.ext.valves.CarbonStuckThreadDetectionValve.invoke(CarbonStuckThreadDetectionValve.java:156)*
* at
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:936)*
* at
org.wso2.carbon.tomcat.ext.valves.CarbonContextCreatorValve.invoke(CarbonContextCreatorValve.java:52)*
* at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)*
* at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407)*
* at
org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1004)*
* at
org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:589)*
* at
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:1653)*
* at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)*
* at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)*
* at java.lang.Thread.run(Thread.java:679)*
What is the reason for this error. In same server when accessing mysql
database in localhost, I had to use localhost instead of 192.168.3.15 since
it gave connection error while using ip address. Is there any issue when
using ip address for data sources. How can I connect to data source using
my analyzer?
1. https://gist.github.com/cdwijayarathna/8938849
2. https://gist.github.com/cdwijayarathna/8938877
Thank You!
--
*Chamila Wijayarathna*
Engineering Intern,
WSO2 Inc.
_______________________________________________
Dev mailing list
[email protected]
http://wso2.org/cgi-bin/mailman/listinfo/dev
