Re: Cassandra Interpreter on emr-5.20.0 gives error
Now the Cassandra interpreter is working. There were some jar files missing
in the Cassandra Interpreter. After copying those missing jar files to
cassandra Interpreter folder, it worked.
Thanks
-Shyla
On Mon, Dec 24, 2018 at 9:37 AM shyla deshpande
wrote:
> Just to be clear, spark cassandra connection is working fine. It is just
> the cassandra interpreter that is giving me the error.
>
> On Sun, Dec 23, 2018 at 11:58 PM shyla deshpande
> wrote:
>
>> ERROR [2018-12-24 07:38:18,097] ({pool-2-thread-2} Job.java[run]:190) -
>> Job failed
>> java.lang.ExceptionInInitializerError
>> at
>> org.apache.zeppelin.cassandra.EnhancedSession.(EnhancedSession.scala:40)
>> at
>> org.apache.zeppelin.cassandra.InterpreterLogic.(InterpreterLogic.scala:98)
>> at
>> org.apache.zeppelin.cassandra.CassandraInterpreter.open(CassandraInterpreter.java:231)
>> at
>> org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69)
>> at
>> org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:617)
>> at org.apache.zeppelin.scheduler.Job.run(Job.java:188)
>> at
>> org.apache.zeppelin.scheduler.ParallelScheduler$JobRunner.run(ParallelScheduler.java:162)
>> at
>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> at
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
>> at
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> at java.lang.Thread.run(Thread.java:748)
>> Caused by: org.fusesource.scalate.TemplateException:
>> scala/reflect/internal/Reporter
>> at
>> org.fusesource.scalate.TemplateEngine.compileAndLoad(TemplateEngine.scala:732)
>> at
>> org.fusesource.scalate.TemplateEngine.compileAndLoadEntry(TemplateEngine.scala:699)
>> at
>> org.fusesource.scalate.TemplateEngine.liftedTree1$1(TemplateEngine.scala:419)
>> at
>> org.fusesource.scalate.TemplateEngine.load(TemplateEngine.scala:413)
>> at
>> org.fusesource.scalate.TemplateEngine.load(TemplateEngine.scala:471)
>> at
>> org.fusesource.scalate.TemplateEngine.layout(TemplateEngine.scala:573)
>> at
>> org.apache.zeppelin.cassandra.DisplaySystem$NoResultDisplay$.(DisplaySystem.scala:369)
>> at
>> org.apache.zeppelin.cassandra.DisplaySystem$NoResultDisplay$.(DisplaySystem.scala)
>> ... 14 more
>> Caused by: java.lang.NoClassDefFoundError: scala/reflect/internal/Reporter
>> at java.lang.ClassLoader.defineClass1(Native Method)
>> at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
>> at
>> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
>> at java.net.URLClassLoader.defineClass(URLClassLoader.java:468)
>> at java.net.URLClassLoader.access$100(URLClassLoader.java:74)
>> at java.net.URLClassLoader$1.run(URLClassLoader.java:369)
>> at java.net.URLClassLoader$1.run(URLClassLoader.java:363)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at java.net.URLClassLoader.findClass(URLClassLoader.java:362)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>> at
>> org.fusesource.scalate.support.ScalaCompiler$.create(ScalaCompiler.scala:42)
>> at
>> org.fusesource.scalate.TemplateEngine.createCompiler(TemplateEngine.scala:231)
>> at
>> org.fusesource.scalate.TemplateEngine.compiler$lzycompute(TemplateEngine.scala:221)
>> at
>> org.fusesource.scalate.TemplateEngine.compiler(TemplateEngine.scala:221)
>> at
>> org.fusesource.scalate.TemplateEngine.compileAndLoad(TemplateEngine.scala:757)
>> ... 21 more
>> Caused by: java.lang.ClassNotFoundException:
>> scala.reflect.internal.Reporter
>> at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:4
Re: Cassandra Interpreter on emr-5.20.0 gives error
Just to be clear, spark cassandra connection is working fine. It is just
the cassandra interpreter that is giving me the error.
On Sun, Dec 23, 2018 at 11:58 PM shyla deshpande
wrote:
> ERROR [2018-12-24 07:38:18,097] ({pool-2-thread-2} Job.java[run]:190) -
> Job failed
> java.lang.ExceptionInInitializerError
> at
> org.apache.zeppelin.cassandra.EnhancedSession.(EnhancedSession.scala:40)
> at
> org.apache.zeppelin.cassandra.InterpreterLogic.(InterpreterLogic.scala:98)
> at
> org.apache.zeppelin.cassandra.CassandraInterpreter.open(CassandraInterpreter.java:231)
> at
> org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69)
> at
> org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:617)
> at org.apache.zeppelin.scheduler.Job.run(Job.java:188)
> at
> org.apache.zeppelin.scheduler.ParallelScheduler$JobRunner.run(ParallelScheduler.java:162)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: org.fusesource.scalate.TemplateException:
> scala/reflect/internal/Reporter
> at
> org.fusesource.scalate.TemplateEngine.compileAndLoad(TemplateEngine.scala:732)
> at
> org.fusesource.scalate.TemplateEngine.compileAndLoadEntry(TemplateEngine.scala:699)
> at
> org.fusesource.scalate.TemplateEngine.liftedTree1$1(TemplateEngine.scala:419)
> at
> org.fusesource.scalate.TemplateEngine.load(TemplateEngine.scala:413)
> at
> org.fusesource.scalate.TemplateEngine.load(TemplateEngine.scala:471)
> at
> org.fusesource.scalate.TemplateEngine.layout(TemplateEngine.scala:573)
> at
> org.apache.zeppelin.cassandra.DisplaySystem$NoResultDisplay$.(DisplaySystem.scala:369)
> at
> org.apache.zeppelin.cassandra.DisplaySystem$NoResultDisplay$.(DisplaySystem.scala)
> ... 14 more
> Caused by: java.lang.NoClassDefFoundError: scala/reflect/internal/Reporter
> at java.lang.ClassLoader.defineClass1(Native Method)
> at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
> at
> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
> at java.net.URLClassLoader.defineClass(URLClassLoader.java:468)
> at java.net.URLClassLoader.access$100(URLClassLoader.java:74)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:369)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:363)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:362)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> at
> org.fusesource.scalate.support.ScalaCompiler$.create(ScalaCompiler.scala:42)
> at
> org.fusesource.scalate.TemplateEngine.createCompiler(TemplateEngine.scala:231)
> at
> org.fusesource.scalate.TemplateEngine.compiler$lzycompute(TemplateEngine.scala:221)
> at
> org.fusesource.scalate.TemplateEngine.compiler(TemplateEngine.scala:221)
> at
> org.fusesource.scalate.TemplateEngine.compileAndLoad(TemplateEngine.scala:757)
> ... 21 more
> Caused by: java.lang.ClassNotFoundException:
> scala.reflect.internal.Reporter
> at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 38 more
> ERROR [2018-12-24 07:45:26,593] ({pool-2-thread-2} Job.java[run]:190) -
> Job failed
> java.lang.NoClassDefFoundError: Could not initialize class
> org.apache.zeppelin.cassandra.DisplaySystem$NoResultDisplay$
> at
> org.apache.zeppelin.cassandra.EnhancedSession.(EnhancedSession.scala:40)
> at
> org.apache.zeppelin.cassandra.InterpreterLogic.(InterpreterLogic.scala:98)
> at
> org.apache.zeppeli
Re: Cassandra Interpreter on emr-5.20.0 gives error
) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) On Sun, Dec 23, 2018 at 11:33 PM Jeff Zhang wrote: > Could you check the cassandra interpreter log ? > > shyla deshpande 于2018年12月24日周一 下午2:50写道： > >> No, the application versions are tied to the emr version. >> So I tried now with emr-5.15.0, which comes with Spark 2.3.0 and Zeppelin >> 0.7.3. >> I am still getting the same error. >> [image: Screen Shot 2018-12-23 at 10.48.51 PM.png] >> >> >> On Sun, Dec 23, 2018 at 10:25 PM Jeff Zhang wrote: >> >>> Is it possible to just downgrade spark ? >>> >>> shyla deshpande 于2018年12月24日周一 下午2:23写道： >>> >>>> Hi Jeff, >>>> I am using emr-5.20.0 which comes with applications:Spark 2.4.0 and >>>> Zeppelin 0.8.0. >>>> Are you suggesting I downgrade the emr version? >>>> Thanks >>>> -Shyla >>>> >>>> >>>> On Sun, Dec 23, 2018 at 3:40 PM Jeff Zhang wrote: >>>> >>>>> >>>>> I see the scope of scala-reflect in pom.xml is runtime. Could you also >>>>> try the apache zeppelin version instead of AWS version ? I guess it may be >>>>> a bug of apache zeppelin >>>>> >>>>> https://github.com/apache/zeppelin/blob/master/cassandra/pom.xml#L109 >>>>> >>>>> shyla deshpande 于2018年12月24日周一 上午3:29写道： >>>>> >>>>>> Hi Jeff, >>>>>> Thank you for your response. My cluster is on AWS EMR. Since it is >>>>>> all preconfigured, I was assuming there won't be any version mismatch. >>>>>> Can you please give me more info as to where I should be looking at. >>>>>> >>>>>> Thanks >>>>>> -Shyla >>>>>> >>>>>> On Sat, Dec 22, 2018 at 10:49 PM Jeff Zhang wrote: >>>>>> >>>>>>> Do you binary version or building it from source ? It seems due to >>>>>>> scala version issue. >>>>>>> >>>>>>> shyla deshpande 于2018年12月23日周日 下午2:08写道： >>>>>>> >>>>>>>> Cassandra Interpreter on emr-5.20.0 gives error >>>>>>>> [image: CassandraInterpreterError.png] >>>>>>>> Thank >>>>>>>> -Shyla >>>>>>>> >>>>>>>> >>>>>>> >>>>>>> -- >>>>>>> Best Regards >>>>>>> >>>>>>> Jeff Zhang >>>>>>> >>>>>> >>>>> >>>>> -- >>>>> Best Regards >>>>> >>>>> Jeff Zhang >>>>> >>>> >>> >>> -- >>> Best Regards >>> >>> Jeff Zhang >>> >> > > -- > Best Regards > > Jeff Zhang >
Re: Cassandra Interpreter on emr-5.20.0 gives error
Hi Jeff, I am using emr-5.20.0 which comes with applications:Spark 2.4.0 and Zeppelin 0.8.0. Are you suggesting I downgrade the emr version? Thanks -Shyla On Sun, Dec 23, 2018 at 3:40 PM Jeff Zhang wrote: > > I see the scope of scala-reflect in pom.xml is runtime. Could you also try > the apache zeppelin version instead of AWS version ? I guess it may be a > bug of apache zeppelin > > https://github.com/apache/zeppelin/blob/master/cassandra/pom.xml#L109 > > shyla deshpande 于2018年12月24日周一 上午3:29写道： > >> Hi Jeff, >> Thank you for your response. My cluster is on AWS EMR. Since it is all >> preconfigured, I was assuming there won't be any version mismatch. >> Can you please give me more info as to where I should be looking at. >> >> Thanks >> -Shyla >> >> On Sat, Dec 22, 2018 at 10:49 PM Jeff Zhang wrote: >> >>> Do you binary version or building it from source ? It seems due to scala >>> version issue. >>> >>> shyla deshpande 于2018年12月23日周日 下午2:08写道： >>> >>>> Cassandra Interpreter on emr-5.20.0 gives error >>>> [image: CassandraInterpreterError.png] >>>> Thank >>>> -Shyla >>>> >>>> >>> >>> -- >>> Best Regards >>> >>> Jeff Zhang >>> >> > > -- > Best Regards > > Jeff Zhang >
Re: Cassandra Interpreter on emr-5.20.0 gives error
Hi Jeff, Thank you for your response. My cluster is on AWS EMR. Since it is all preconfigured, I was assuming there won't be any version mismatch. Can you please give me more info as to where I should be looking at. Thanks -Shyla On Sat, Dec 22, 2018 at 10:49 PM Jeff Zhang wrote: > Do you binary version or building it from source ? It seems due to scala > version issue. > > shyla deshpande 于2018年12月23日周日 下午2:08写道： > >> Cassandra Interpreter on emr-5.20.0 gives error >> [image: CassandraInterpreterError.png] >> Thank >> -Shyla >> >> > > -- > Best Regards > > Jeff Zhang >
Cassandra Interpreter on emr-5.20.0 gives error
Cassandra Interpreter on emr-5.20.0 gives error [image: CassandraInterpreterError.png] Thank -Shyla
How to add Cassandra Interpreter to Zeppelin on EMR?
Directory /usr/lib/zeppelin/interpreter/cassandra already exists. But when Create new interpreter in 'Interpreter' menu on Zeppelin GUI, What are the properties name and value I should specify. Any dependencies I should add? Appreciate your help Thanks -shyla
How do I clear the output of a specific paragraph using code in Zeppelin?
I need to clear the output of some specific paragraphs on the click of a button in Zeppelin. Clearing the output of all paragraphs won't work for me because the calendar that I am using for date input is part of the output. How do I clear the output of a specific paragraph using code in Zeppelin? Thanks
I need data download button in the Reports mode
Hello all, I want the users to be able to download the data in report mode. Is there a way, some kind of tricks? please help Thanks
Re: How do I give ReadOnly access to anonymous user?
Hi Michael , Thanks for the response. I am using Shiro for users within our organization. I was seeing if there is a way to share the link with the customers who are not a part of our organization. -Shyla On Thu, Oct 26, 2017 at 8:53 AM, Michael Segel <msegel_had...@hotmail.com> wrote: > Do you really want the user to be anonymous? > What about using Shiro to set up a role? > > > > On Oct 26, 2017, at 10:48 AM, shyla deshpande <deshpandesh...@gmail.com> > wrote: > > > > I am running Zeppelin on EMR cluster. > > I want to share a Dashboard just for viewing with the customers . > > What is the best way to do that? > > > > Thanks > > -shyla > >
How do I give ReadOnly access to anonymous user?
I am running Zeppelin on EMR cluster. I want to share a Dashboard just for viewing with the customers . What is the best way to do that? Thanks -shyla
download Failed - Network error
When I try to download data as csv file, I get download Failed - Network error. I am using Zeppelin 0.7.1 I appreciate your input
Re: java.lang.NullPointerException..was working good consistently for many months...
Cassandra Interpreter returns the following error org.apache.zeppelin.interpreter.InterpreterException: OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was removed in 8.0 OpenJDK 64-Bit Server VM warning: INFO: os::commit_memory(0xc000, 716177408, 0) failed; error='Cannot allocate memory' (errno=12) # # There is insufficient memory for the Java Runtime Environment to continue. # Native memory allocation (mmap) failed to map 716177408 bytes for committing reserved memory. # An error report file with more information is saved as: # /mnt/var/lib/zeppelin/hs_err_pid2858.log at org.apache.zeppelin.interpreter.remote.RemoteInterpreterManagedProcess.start(RemoteInterpreterManagedProcess.java:143) at org.apache.zeppelin.interpreter.remote.RemoteInterpreterProcess.reference(RemoteInterpreterProcess.java:73) at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.open(RemoteInterpreter.java:258) at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getFormType(RemoteInterpreter.java:423) at org.apache.zeppelin.interpreter.LazyOpenInterpreter.getFormType(LazyOpenInterpreter.java:106) at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:387) at org.apache.zeppelin.scheduler.Job.run(Job.java:175) at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:329) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) On Thu, Aug 24, 2017 at 11:07 PM, shyla deshpande <deshpandesh...@gmail.com> wrote: > I am using Zeppelin Version 0.7.1 on EMR. > I have been using Zeppelin for many months and was working fine. My > queries started to slow down. > So I restarted Zeppelin, I am now getting the following error. I also > tried restarting the Spark Interpreter and it did not help. Please help! > > java.lang.NullPointerException > at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:38) > at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:33) > at org.apache.zeppelin.spark.SparkInterpreter.createSparkContext_2( > SparkInterpreter.java:391) > at org.apache.zeppelin.spark.SparkInterpreter.createSparkContext( > SparkInterpreter.java:380) > at org.apache.zeppelin.spark.SparkInterpreter.getSparkContext( > SparkInterpreter.java:146) > at org.apache.zeppelin.spark.SparkInterpreter.open( > SparkInterpreter.java:828) > at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open( > LazyOpenInterpreter.java:70) > at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$ > InterpretJob.jobRun(RemoteInterpreterServer.java:483) > at org.apache.zeppelin.scheduler.Job.run(Job.java:175) > at org.apache.zeppelin.scheduler.FIFOScheduler$1.run( > FIFOScheduler.java:139) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1142) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) >
java.lang.NullPointerException..was working good consistently for many months...
I am using Zeppelin Version 0.7.1 on EMR. I have been using Zeppelin for many months and was working fine. My queries started to slow down. So I restarted Zeppelin, I am now getting the following error. I also tried restarting the Spark Interpreter and it did not help. Please help! java.lang.NullPointerException at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:38) at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:33) at org.apache.zeppelin.spark.SparkInterpreter.createSparkContext_2(SparkInterpreter.java:391) at org.apache.zeppelin.spark.SparkInterpreter.createSparkContext(SparkInterpreter.java:380) at org.apache.zeppelin.spark.SparkInterpreter.getSparkContext(SparkInterpreter.java:146) at org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:828) at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:70) at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:483) at org.apache.zeppelin.scheduler.Job.run(Job.java:175) at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745)
Re: unable to restart zeppelin on AWS EMR
I found from the spark History server , that my old Zeppelin application
was still alive and using up the resources. After I killed that
application, it is working fine. Thanks everyone for all your help.
On Sun, Jun 4, 2017 at 8:48 PM, shyla deshpande <deshpandesh...@gmail.com>
wrote:
> Thanks everyone for the reply. Still having issues.
>
> Moon, I had tried
> sudo -u zeppelin /usr/lib/zeppelin/bin/zeppelin-daemon.sh restart
> and it did not work.
>
> I am using the Zeppelin Version 0.7.1. I checked the logs and in the
> logs, I saw the error message that the port 8890 already in use. Since
> sudo stop zeppelin did not work , I killed the process that wasusing 8890.
>
> Now I am able to start and stop zeppelin using sudo start zeppelin and
> sudo stop zeppelin.
>
> But now I have a new problem, The cassandra interpreter works fine, but
> the spark interpreter hangs, and I have to cancel the job. Even a simple
> job as the following hangs
> val df1 = sc.parallelize(1 to 10).toDF()
> df1.show()
>
> I see the following in the log
>
> WARN [2017-06-05 03:33:33,283] ({Timer-0} Logging.scala[logWarning]:66) -
> Initial job has not accepted any resources; check your cluster UI to ensure
> that workers are registered and have sufficient resources
>
> Please help, I just made some config changes and wanted to restart
> Zeppelin and now I messed up my presentation.
>
> On Sun, Jun 4, 2017 at 11:19 AM, moon soo Lee <m...@apache.org> wrote:
>
>> Have you tried restart with 'sudo -u zeppelin'?
>>
>> sudo -u zeppelin /usr/lib/zeppelin/bin/zeppelin-daemon.sh restart
>>
>> worked for me.
>>
>>
>> Thanks,
>> moon
>>
>> On Sat, Jun 3, 2017 at 11:51 PM Jonathan Kelly <jonathaka...@gmail.com>
>> wrote:
>>
>>> Shyla,
>>>
>>> What release of EMR are you using? There was a problem with earlier
>>> releases of EMR where upstart was not properly tracking the Zeppelin PID,
>>> so "sudo stop zeppelin" wouldn't work. This has been fixed for a while, but
>>> I don't remember what version contained the fix. If you are not using the
>>> latest release, you might want to try that. Otherwise, if you're already
>>> using the latest version, there might be something else going on.
>>>
>>> ~ Jonathan
>>> On Sat, Jun 3, 2017 at 8:28 PM shyla deshpande <deshpandesh...@gmail.com>
>>> wrote:
>>>
>>>> I changed some configuration and want to restart zeppelin on AWS EMR,
>>>> but unable to do. My local Zeppelin works fine.
>>>>
>>>> I have tried
>>>> 1. zeppelin-daemon.sh restart outputs[ OK ] but
>>>> has no effect.
>>>> 2. sudo stop zeppelin outputsstop: Unknown
>>>> instance:
>>>> 3. sudo start zeppelin outputs . start: Job
>>>> failed to start
>>>>
>>>> Zeppelin is running and able to login as anonymous user, unable to
>>>> restart . Appreciate your input.
>>>>
>>>> Thanks
>>>>
>>>
>
Re: unable to restart zeppelin on AWS EMR
Thanks everyone for the reply. Still having issues.
Moon, I had tried
sudo -u zeppelin /usr/lib/zeppelin/bin/zeppelin-daemon.sh restart
and it did not work.
I am using the Zeppelin Version 0.7.1. I checked the logs and in the
logs, I saw the error message that the port 8890 already in use. Since
sudo stop zeppelin did not work , I killed the process that wasusing 8890.
Now I am able to start and stop zeppelin using sudo start zeppelin and sudo
stop zeppelin.
But now I have a new problem, The cassandra interpreter works fine, but the
spark interpreter hangs, and I have to cancel the job. Even a simple job as
the following hangs
val df1 = sc.parallelize(1 to 10).toDF()
df1.show()
I see the following in the log
WARN [2017-06-05 03:33:33,283] ({Timer-0} Logging.scala[logWarning]:66) -
Initial job has not accepted any resources; check your cluster UI to ensure
that workers are registered and have sufficient resources
Please help, I just made some config changes and wanted to restart Zeppelin
and now I messed up my presentation.
On Sun, Jun 4, 2017 at 11:19 AM, moon soo Lee <m...@apache.org> wrote:
> Have you tried restart with 'sudo -u zeppelin'?
>
> sudo -u zeppelin /usr/lib/zeppelin/bin/zeppelin-daemon.sh restart
>
> worked for me.
>
>
> Thanks,
> moon
>
> On Sat, Jun 3, 2017 at 11:51 PM Jonathan Kelly <jonathaka...@gmail.com>
> wrote:
>
>> Shyla,
>>
>> What release of EMR are you using? There was a problem with earlier
>> releases of EMR where upstart was not properly tracking the Zeppelin PID,
>> so "sudo stop zeppelin" wouldn't work. This has been fixed for a while, but
>> I don't remember what version contained the fix. If you are not using the
>> latest release, you might want to try that. Otherwise, if you're already
>> using the latest version, there might be something else going on.
>>
>> ~ Jonathan
>> On Sat, Jun 3, 2017 at 8:28 PM shyla deshpande <deshpandesh...@gmail.com>
>> wrote:
>>
>>> I changed some configuration and want to restart zeppelin on AWS EMR,
>>> but unable to do. My local Zeppelin works fine.
>>>
>>> I have tried
>>> 1. zeppelin-daemon.sh restart outputs[ OK ] but
>>> has no effect.
>>> 2. sudo stop zeppelin outputsstop: Unknown
>>> instance:
>>> 3. sudo start zeppelin outputs . start: Job failed
>>> to start
>>>
>>> Zeppelin is running and able to login as anonymous user, unable to
>>> restart . Appreciate your input.
>>>
>>> Thanks
>>>
>>
unable to restart zeppelin on AWS EMR
I changed some configuration and want to restart zeppelin on AWS EMR, but unable to do. My local Zeppelin works fine. I have tried 1. zeppelin-daemon.sh restart outputs[ OK ] but has no effect. 2. sudo stop zeppelin outputsstop: Unknown instance: 3. sudo start zeppelin outputs . start: Job failed to start Zeppelin is running and able to login as anonymous user, unable to restart . Appreciate your input. Thanks
Task not serializable error when I try to cache the spark sql table
Hello all,
I am getting org.apache.spark.SparkException: Task not serializable error
when I try to cache the spark sql table. I am using a UDF on a column of
table and want to cache the resultant table . I can execute the paragraph
successfully when there is no caching.
Please help! Thanks
UDF :
def fn1(res: String): Int = {
100
}
spark.udf.register("fn1", fn1(_: String): Int)
spark
.read
.format("org.apache.spark.sql.cassandra")
.options(Map("keyspace" -> "k", "table" -> "t"))
.load
.createOrReplaceTempView("t1")
val df1 = spark.sql("SELECT col1, col2, fn1(col3) from t1" )
df1.createOrReplaceTempView("t2")
spark.catalog.cacheTable("t2")
Re: Create cassandra interpreter for Zeppelin on AWS EMR spark cluster
I now have the cassandra interpreter setup. But I am getting the following error java.lang.NoClassDefFoundError: Could not initialize class org.apache.zeppelin.cassandra.DisplaySystem$NoResultDisplay$ at org.apache.zeppelin.cassandra.EnhancedSession.(EnhancedSession.scala:40) Please help. On Fri, May 19, 2017 at 3:45 PM, DuyHai Doan <doanduy...@gmail.com> wrote: > Just download a binary of Zeppelin with all interpreters on your AWS EMR > cluster and install it there > > On Sat, May 20, 2017 at 12:21 AM, shyla deshpande < > deshpandesh...@gmail.com> wrote: > >> I don't see the cassandra interpreter, so I need to create the >> interpreter. >> >> Locally, I installed the Binary package with all interpreters and works >> fine. >> >> On AWS EMR, all the binaries may not be there, and thats where I need >> help. >> >> Thanks >> >> On Fri, May 19, 2017 at 3:04 PM, DuyHai Doan <doanduy...@gmail.com> >> wrote: >> >>> So just use the Cassandra interpreter, I don't see where is the problem, >>> there is even documentation here: >>> >>> http://zeppelin.apache.org/docs/0.7.1/interpreter/cassandra.html >>> >>> On Fri, May 19, 2017 at 11:51 PM, shyla deshpande < >>> deshpandesh...@gmail.com> wrote: >>> >>>> Yes, we do have cassandra cluster on AWS-EC2. >>>> >>>> On Fri, May 19, 2017 at 2:39 PM, DuyHai Doan <doanduy...@gmail.com> >>>> wrote: >>>> >>>>> If you're running on AWS EMR Spark Cluster, why do you need a >>>>> Cassandra interpreter Is Cassandra installed on your AWS cluster ? >>>>> >>>>> On Fri, May 19, 2017 at 11:23 PM, shyla deshpande < >>>>> deshpandesh...@gmail.com> wrote: >>>>> >>>>>> Hello all, >>>>>> >>>>>> I need help in creating cassandra interpreter for Zeppelin on AWS EMR >>>>>> spark cluster. Please give me the info on what to install and configure. >>>>>> >>>>>> Thanks >>>>>> >>>>>> >>>>> >>>> >>> >> >
Re: Create cassandra interpreter for Zeppelin on AWS EMR spark cluster
I don't see the cassandra interpreter, so I need to create the interpreter. Locally, I installed the Binary package with all interpreters and works fine. On AWS EMR, all the binaries may not be there, and thats where I need help. Thanks On Fri, May 19, 2017 at 3:04 PM, DuyHai Doan <doanduy...@gmail.com> wrote: > So just use the Cassandra interpreter, I don't see where is the problem, > there is even documentation here: > > http://zeppelin.apache.org/docs/0.7.1/interpreter/cassandra.html > > On Fri, May 19, 2017 at 11:51 PM, shyla deshpande < > deshpandesh...@gmail.com> wrote: > >> Yes, we do have cassandra cluster on AWS-EC2. >> >> On Fri, May 19, 2017 at 2:39 PM, DuyHai Doan <doanduy...@gmail.com> >> wrote: >> >>> If you're running on AWS EMR Spark Cluster, why do you need a Cassandra >>> interpreter ???? Is Cassandra installed on your AWS cluster ? >>> >>> On Fri, May 19, 2017 at 11:23 PM, shyla deshpande < >>> deshpandesh...@gmail.com> wrote: >>> >>>> Hello all, >>>> >>>> I need help in creating cassandra interpreter for Zeppelin on AWS EMR >>>> spark cluster. Please give me the info on what to install and configure. >>>> >>>> Thanks >>>> >>>> >>> >> >
Create cassandra interpreter for Zeppelin on AWS EMR spark cluster
Hello all, I need help in creating cassandra interpreter for Zeppelin on AWS EMR spark cluster. Please give me the info on what to install and configure. Thanks
Re: Setting Note permission
I want to know if this is possible. Works great for a single user but in a multi-user environment, we need more granular control on who can do what. The readers permission is not useful, because the user cannot execute or even change the display type Please share your experience how you are using in multi user environment. Thanks On Sun, May 14, 2017 at 9:53 PM, shyla deshpande <deshpandesh...@gmail.com> wrote: > How do I set permissions to a Note to do only the following : > 1. execute the paragraphs > 2. choose a different value from dynamic dropdown > 3. change display type from bar chart to tabular > 4. download the result data as a csv or tsv file > > I do no want the users to change the code or access Interpreter menu or > change configuration. >
Setting Note permission
How do I set permissions to a Note to do only the following : 1. execute the paragraphs 2. choose a different value from dynamic dropdown 3. change display type from bar chart to tabular 4. download the result data as a csv or tsv file I do no want the users to change the code or access Interpreter menu or change configuration.
Re: java.lang.NullPointerException on adding local jar as dependency to the spark interpreter
Also, my local jar file that I want to add as dependency is a fat jar with dependencies. Nothing works after I add my local fat jar, I get *java.lang.NullPointerException for everything. Please help* On Thu, May 4, 2017 at 10:18 PM, shyla deshpande <deshpandesh...@gmail.com> wrote: > Adding the dependency by filling groupId:artifactId:version works good. > But when I add add a local jar file as the artifact , get > *ERROR java.lang.NullPointerException*. I see the local jar file being > added to local-repo, but I get the ERROR. > > Please help. > >
