Is it Zeppelin log or Spark interpreter log ? I guess we need also the spark interpreter log to understand what is breaking Spark under the hood. org.apache.thrift.transport.TTransportException is just technical exception on inter-jvm communication
On Thu, Sep 15, 2016 at 7:13 PM, Arpan Saha <arpan.s...@mindtree.com> wrote: > > Hi, > > Please find below full stack trace. > > ERROR [2016-09-15 16:49:15,117] ({pool-1-thread-2} > RemoteInterpreter.java[init]:182) - Failed to create interpreter: > org.apache.zeppelin.spark.SparkInterpreter > ERROR [2016-09-15 16:49:15,118] ({pool-1-thread-2} Job.java[run]:189) - > Job failed > org.apache.zeppelin.interpreter.InterpreterException: > org.apache.thrift.transport.TTransportException > at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.init( > RemoteInterpreter.java:183) > at org.apache.zeppelin.interpreter.remote. > RemoteInterpreter.getFormType(RemoteInterpreter.java:328) > at org.apache.zeppelin.interpreter.LazyOpenInterpreter. > getFormType(LazyOpenInterpreter.java:105) > at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph. > java:260) > at org.apache.zeppelin.scheduler.Job.run(Job.java:176) > at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run( > RemoteScheduler.java:328) > at java.util.concurrent.Executors$RunnableAdapter. > call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1142) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Caused by: org.apache.thrift.transport.TTransportException > at org.apache.thrift.transport.TIOStreamTransport.read( > TIOStreamTransport.java:132) > at org.apache.thrift.transport.TTransport.readAll(TTransport. > java:86) > at org.apache.thrift.protocol.TBinaryProtocol.readAll( > TBinaryProtocol.java:429) > at org.apache.thrift.protocol.TBinaryProtocol.readI32( > TBinaryProtocol.java:318) > at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin( > TBinaryProtocol.java:219) > at org.apache.thrift.TServiceClient.receiveBase( > TServiceClient.java:69) > at org.apache.zeppelin.interpreter.thrift. > RemoteInterpreterService$Client.recv_createInterpreter( > RemoteInterpreterService.java:184) > at org.apache.zeppelin.interpreter.thrift. > RemoteInterpreterService$Client.createInterpreter( > RemoteInterpreterService.java:168) > at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.init( > RemoteInterpreter.java:172) > ... 12 more > ERROR [2016-09-15 16:49:15,118] ({Thread-18} > RemoteInterpreterEventPoller.java[run]:88) > - Can't get RemoteInterpreterEvent > > Thanks, > Arpan. > > ________________________________________ > From: DuyHai Doan [doanduy...@gmail.com] > Sent: Thursday, September 15, 2016 4:29 AM > To: users@zeppelin.apache.org > Subject: Re: Issue with Zeppelin setup on Datastax-Spark > > Can you provide the complete stack trace ? > > Also, worth reading my blog post about integrating Spark/Zeppelin/C* or > DSE : http://www.doanduyhai.com/blog/?p=2325 > > On Thu, Sep 15, 2016 at 5:17 AM, Arpan Saha <arpan.s...@mindtree.com< > mailto:arpan.s...@mindtree.com>> wrote: > Hi Team, > > I am trying to integrate Zeppelin 0.6.0 with DataStax 4.8.8 (which has > Spark 1.4.2). After I configured following properties in zeppelin-env.sh > when I start zeppelin daemon it started and in the browser I can see > zeppelin is running but when I am trying to execute spark query in the > notebook it is throwing below Error. Could you please help me to solve this > issue. > > export JAVA_HOME=<JAVA Home Path> > export SPARK_HOME=/etc/dse/spark > export HADOOP_CONF_DIR=/etc/dse/hadoop > export MASTER=spark://<masterhost>:7077 > > Also, added/updated below properties in the Spark Interpreter screen of > Zeppelin UI. > > Master > spark.app.name<http://spark.app.name> > spark.cassandra.auth.password > spark.cassandra.auth.username > spark.cassandra.connection.host > spark.cores.max > spark.executor.memory > zeppelin.interpreter.host > zeppelin.interpreter.port > > Trying to execute below statement in the notebook: > %spark > sc.version > > Below Error is getting: > java.net.SocketException: Connection reset at java.net.SocketInputStream. > read(SocketInputStream.java:209) at java.net.SocketInputStream. > read(SocketInputStream.java:141) at java.io.BufferedInputStream. > fill(BufferedInputStream.java:246) at java.io.BufferedInputStream. > read1(BufferedInputStream.java:286) at java.io.BufferedInputStream. > read(BufferedInputStream.java:345) at org.apache.thrift.transport. > TIOStreamTransport.read(TIOStreamTransport.java:127) at > org.apache.thrift.transport.TTransport.readAll(TTransport.java:86) at > org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429) > at > org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318) > at > org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219) > at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69) > at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$ > Client.recv_createInterpreter(RemoteInterpreterService.java:184) at > org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$ > Client.createInterpreter(RemoteInterpreterService.java:168) at > org.apache.zeppelin.interpreter.remote.RemoteInterpreter.init(RemoteInterpreter.java:172) > at > org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getFormType(RemoteInterpreter.java:328) > at org.apache.zeppelin.interpreter.LazyOpenInterpreter.getFormType( > LazyOpenInterpreter.java:105) > > users-subscr...@zeppelin.apache.org<mailto:users- > subscr...@zeppelin.apache.org> > > Thanks, > Arpan. > > ________________________________ > Notice: This e-mail message has been sent by an employee or contractor of > American Express Global Business Travel (“GBT”), a joint venture that is > not wholly-owned by American Express Company or any of its subsidiaries > (“American Express”). E-mail from GBT employees and contractors may > continue to utilize an American Express domain for some period; however > American Express is not responsible for the content of this email, which is > controlled by GBT. “American Express Global Business Travel”, “American > Express” and the American Express Logo are trademarks of American Express > and are used by GBT under limited license. > ________________________________ > Important : Cet email a été envoyé par un employé ou un sous-traitant > d’American Express Global Business Travel (« GBT »), une joint-venture qui > n’est pas intégralement détenue par American Express Company ou l’une de > ses filiales (« American Express »). Les emails des employés et > sous-traitants de GBT peuvent continuer de comporter un nom de domaine > d’American Express pour une certaine période ; toutefois, American Express > n’est pas responsable du contenu de cet email, qui est contrôlé par GBT. « > American Express Global Business Travel », « American Express » et le logo > American Express sont des marques d’American Express et sont utilisées par > GBT aux termes d’une licence limitée. > > ________________________________ > > http://www.mindtree.com/email/disclaimer.html > >