date:20160802

Re: How to use R interpreter ?

2016-08-02 Thread Rerngvit Yanggratoke

Hello Jeff,
 Have you installed R into your environment as explained in this document 
(https://zeppelin.apache.org/docs/0.6.0/interpreter/r.html 
)? It is a 
prerequisite. Also, please try the installation validation command (R -e 
"print(1+1)").

Cheers,
Rerngvit

> On 01 Aug 2016, at 09:05, Jeff Zhang  wrote:
> 
> 
> I try to use R interpreter using spark.r, r and knitr, but all fails. I have 
> already compiled zeppelin with profile sparkr enabled. But I don't see R 
> interpreter in interpreter page, I also didn't see spark.r in spark 
> interpreter group. Do I miss anything here ? BTW I am using master
> 
> 
> no spark.r
> 
> 
> 3 ways to call r interpreter, but no one succeeded.
> 
> <2016-08-01_1458.png>
> 
> 
> 
> The second and third error seems related with ZEPPELIN-1247
> 
> https://issues.apache.org/jira/browse/ZEPPELIN-1247 
> 
> 
> 
> 
> 
> 
> -- 
> Best Regards
> 
> Jeff Zhang

UNSUBSCRIBE

2016-08-02 Thread Higino Filho com

-UNSUBSCRIBE

Error when starting zeppelin server

2016-08-02 Thread Vikash Kumar

Hi All,
We are getting the error when starting zeppelin daemon. We are 
running with 4 month old code where we made some changes into code. Same code 
is running on HDP 2.3 on VM but when running  on HDP 2.4 on another system we 
are getting this error :

Exception in thread "main" java.lang.SecurityException: class 
"javax.servlet.ServletRegistration$Dynamic"'s signer information does not match 
signer information of other classes in the same package
at java.lang.ClassLoader.checkCerts(ClassLoader.java:898)
at java.lang.ClassLoader.preDefineClass(ClassLoader.java:668)
at java.lang.ClassLoader.defineClass(ClassLoader.java:761)
at 
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at 
org.apache.zeppelin.server.ZeppelinServer.setupRestApiContextHandler(ZeppelinServer.java:228)
at 
org.apache.zeppelin.server.ZeppelinServer.main(ZeppelinServer.java:105)

System Configs :
CentOS 7.2
HDP 2.4
JAVA 1.8
Spark 1.6.1



Thanks and regards,
Vikash Kumar

Re: Error when starting zeppelin server

2016-08-02 Thread Jeff Zhang

What version of zeppelin do you use ?

On Tue, Aug 2, 2016 at 8:42 PM, Vikash Kumar 
wrote:

> Hi All,
>
> We are getting the error when starting zeppelin daemon. We
> are running with 4 month old code where we made some changes into code.
> Same code is running on HDP 2.3 on VM but when running  on HDP 2.4 on
> another system we are getting this error :
>
>
>
> Exception in thread "main" java.lang.SecurityException: class
> "javax.servlet.ServletRegistration$Dynamic"'s signer information does not
> match signer information of other classes in the same package
>
> at java.lang.ClassLoader.checkCerts(ClassLoader.java:898)
>
> at
> java.lang.ClassLoader.preDefineClass(ClassLoader.java:668)
>
> at java.lang.ClassLoader.defineClass(ClassLoader.java:761)
>
> at
> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
>
> at
> java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
>
> at
> java.net.URLClassLoader.access$100(URLClassLoader.java:73)
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
>
> at java.security.AccessController.doPrivileged(Native
> Method)
>
> at
> java.net.URLClassLoader.findClass(URLClassLoader.java:361)
>
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>
> at
> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
>
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>
> at
> org.apache.zeppelin.server.ZeppelinServer.setupRestApiContextHandler(ZeppelinServer.java:228)
>
> at
> org.apache.zeppelin.server.ZeppelinServer.main(ZeppelinServer.java:105)
>
>
>
> System Configs :
>
> *CentOS 7.2*
>
> *HDP 2.4*
>
> *JAVA 1.8*
>
> *Spark 1.6.1*
>
>
>
>
>
>
>
> Thanks and regards,
>
> Vikash Kumar
>



-- 
Best Regards

Jeff Zhang

RE: Error when starting zeppelin server

2016-08-02 Thread Vikash Kumar

Hi Jeff,
It is before 0.6.0. I took this code on a random day 4 month 
back.

From: Jeff Zhang [mailto:zjf...@gmail.com]
Sent: Tuesday, August 2, 2016 7:02 PM
To: users@zeppelin.apache.org
Subject: Re: Error when starting zeppelin server

What version of zeppelin do you use ?

On Tue, Aug 2, 2016 at 8:42 PM, Vikash Kumar 
mailto:vikash.ku...@resilinc.com>> wrote:
Hi All,
We are getting the error when starting zeppelin daemon. We are 
running with 4 month old code where we made some changes into code. Same code 
is running on HDP 2.3 on VM but when running  on HDP 2.4 on another system we 
are getting this error :

Exception in thread "main" java.lang.SecurityException: class 
"javax.servlet.ServletRegistration$Dynamic"'s signer information does not match 
signer information of other classes in the same package
at java.lang.ClassLoader.checkCerts(ClassLoader.java:898)
at java.lang.ClassLoader.preDefineClass(ClassLoader.java:668)
at java.lang.ClassLoader.defineClass(ClassLoader.java:761)
at 
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at 
org.apache.zeppelin.server.ZeppelinServer.setupRestApiContextHandler(ZeppelinServer.java:228)
at 
org.apache.zeppelin.server.ZeppelinServer.main(ZeppelinServer.java:105)

System Configs :
CentOS 7.2
HDP 2.4
JAVA 1.8
Spark 1.6.1



Thanks and regards,
Vikash Kumar



--
Best Regards

Jeff Zhang

spark.jars option for Zeppelin over Livy

2016-08-02 Thread Chen Song

When using Zeppelin over Livy, how would I set the *spark.jars* option?

I try to set it in my spark-defaults.conf and Livy doesn't respect it at
all. Other properties in spark-default.conf seem to be picked up propertly.

Chen

Re: Output of lm summary

2016-08-02 Thread Eric Charles


Has the JIRA(s) been filled?

On 31/07/16 11:53, moon soo Lee wrote:

Thanks. File a jira issue for limiting response size would be
appreciated as well.

Best,
moon

On Sun, Jul 31, 2016 at 6:35 PM Abul Basar mailto:aba...@einext.com>> wrote:

Sure, i will log a jira ticket for this issue. Thank you for
investigating the problem.

Btw, is there a way to set default R response size something around
100 recs. Currently there is no limit, so for large dataframe, UI
freezes. If there is no existing function, i will log a jira for this.

- AB


On Sunday, 31 July 2016, moon soo Lee mailto:m...@apache.org>> wrote:

Hi,

Thanks for reporting the problem.

I have tried and get first 2 lines of output as well.
Do you mind file an jira issue for this problem?
That would help track this issue.

Best,
moon

On Thu, Jul 28, 2016 at 6:37 PM Abul Basar 
wrote:

Hello All,

I am trying to run the following R commands using spark R.

*%r #Using SparkR interpreter*
*require(ggplot2)
*
*fit = lm(price ~ carat, data = diamonds)
*
*summary(fit)
*


Expected Output (as displayed by R Studio);

Call:
lm(formula = price ~ carat, data = diamonds)

Residuals:
  Min   1Q   Median   3Q  Max
-18585.3   -804.8-18.9537.4  12731.7

Coefficients:
 Estimate Std. Error t value Pr(>|t|)
(Intercept) -2256.36  13.06  -172.8   <2e-16 ***
carat7756.43  14.07   551.4   <2e-16 ***
---
Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1

Residual standard error: 1549 on 53938 degrees of freedom
Multiple R-squared:  0.8493,Adjusted R-squared:  0.8493
F-statistic: 3.041e+05 on 1 and 53938 DF,  p-value: < 2.2e-16


But, below is what I am getting - only first 2 lines of the
above output is shown.

Call:

lm(formula = price ~ carat, data = diamonds)


Currently, as a stop gap solution, I write the following to,
but the output is not good.

output.capture(summary(fit))


Does anyone figured a fix for this?


Thanks!

- AB

Re: spark.jars option for Zeppelin over Livy

2016-08-02 Thread Vinay Shukla

In recent Zeppelin builds with Livy interpreter you can set spark-packages
(e.g Databricks csv)

as value of property "livy.spark.jars.packages" on Livy interpreter
properties.

Please see the attached screenshot

On Tue, Aug 2, 2016 at 1:43 PM, Felix Cheung 
wrote:

> Have you tried setting it in the Interpreter menu under Livy?
>
>
>
>
>
> On Tue, Aug 2, 2016 at 11:04 AM -0700, "Chen Song"  > wrote:
>
> When using Zeppelin over Livy, how would I set the *spark.jars* option?
>
> I try to set it in my spark-defaults.conf and Livy doesn't respect it at
> all. Other properties in spark-default.conf seem to be picked up propertly.
>
> Chen
>

Re: spark.jars option for Zeppelin over Livy

2016-08-02 Thread Felix Cheung

Have you tried setting it in the Interpreter menu under Livy?





On Tue, Aug 2, 2016 at 11:04 AM -0700, "Chen Song" 
mailto:chen.song...@gmail.com>> wrote:

When using Zeppelin over Livy, how would I set the spark.jars option?

I try to set it in my spark-defaults.conf and Livy doesn't respect it at all. 
Other properties in spark-default.conf seem to be picked up propertly.

Chen

Re: spark.jars option for Zeppelin over Livy

2016-08-02 Thread Felix Cheung

Probably livy.spark.jars then as Spark Packages is a different list?

http://spark.apache.org/docs/latest/submitting-applications.html#advanced-dependency-management

_
From: Vinay Shukla mailto:vinayshu...@gmail.com>>
Sent: Tuesday, August 2, 2016 1:51 PM
Subject: Re: spark.jars option for Zeppelin over Livy
To: mailto:users@zeppelin.apache.org>>

In recent Zeppelin builds with Livy interpreter you can set spark-packages (e.g 
Databricks csv)

as value of property "livy.spark.jars.packages" on Livy interpreter properties.

Please see the attached screenshot

On Tue, Aug 2, 2016 at 1:43 PM, Felix Cheung 
mailto:felixcheun...@hotmail.com>> wrote:
Have you tried setting it in the Interpreter menu under Livy?

On Tue, Aug 2, 2016 at 11:04 AM -0700, "Chen Song" 
mailto:chen.song...@gmail.com>> wrote:

When using Zeppelin over Livy, how would I set the spark.jars option?

I try to set it in my spark-defaults.conf and Livy doesn't respect it at all. 
Other properties in spark-default.conf seem to be picked up propertly.

Chen

Re: Error when starting zeppelin server

2016-08-02 Thread Jeff Zhang

Do you use the built in version of HDP 2.4 or you build zeppelin by
yourself ? And you can check the zeppelin by click "About Zeppelin"
[image: Inline image 1]

On Tue, Aug 2, 2016 at 9:46 PM, Vikash Kumar 
wrote:

> Hi Jeff,
>
> It is before 0.6.0. I took this code on a random day 4
> month back.
>
>
>
> *From:* Jeff Zhang [mailto:zjf...@gmail.com]
> *Sent:* Tuesday, August 2, 2016 7:02 PM
> *To:* users@zeppelin.apache.org
> *Subject:* Re: Error when starting zeppelin server
>
>
>
> What version of zeppelin do you use ?
>
>
>
> On Tue, Aug 2, 2016 at 8:42 PM, Vikash Kumar 
> wrote:
>
> Hi All,
>
> We are getting the error when starting zeppelin daemon. We
> are running with 4 month old code where we made some changes into code.
> Same code is running on HDP 2.3 on VM but when running  on HDP 2.4 on
> another system we are getting this error :
>
>
>
> Exception in thread "main" java.lang.SecurityException: class
> "javax.servlet.ServletRegistration$Dynamic"'s signer information does not
> match signer information of other classes in the same package
>
> at java.lang.ClassLoader.checkCerts(ClassLoader.java:898)
>
> at
> java.lang.ClassLoader.preDefineClass(ClassLoader.java:668)
>
> at java.lang.ClassLoader.defineClass(ClassLoader.java:761)
>
> at
> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
>
> at
> java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
>
> at
> java.net.URLClassLoader.access$100(URLClassLoader.java:73)
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
>
> at java.security.AccessController.doPrivileged(Native
> Method)
>
> at
> java.net.URLClassLoader.findClass(URLClassLoader.java:361)
>
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>
> at
> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
>
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>
> at
> org.apache.zeppelin.server.ZeppelinServer.setupRestApiContextHandler(ZeppelinServer.java:228)
>
> at
> org.apache.zeppelin.server.ZeppelinServer.main(ZeppelinServer.java:105)
>
>
>
> System Configs :
>
> *CentOS 7.2*
>
> *HDP 2.4*
>
> *JAVA 1.8*
>
> *Spark 1.6.1*
>
>
>
>
>
>
>
> Thanks and regards,
>
> Vikash Kumar
>
>
>
>
>
> --
>
> Best Regards
>
> Jeff Zhang
>



-- 
Best Regards

Jeff Zhang

Re: How to use R interpreter ?

2016-08-02 Thread Jeff Zhang

Not sure what kind of change I make, but anyway it works now.

On Tue, Aug 2, 2016 at 8:33 PM, Rerngvit Yanggratoke <
rerngvit.yanggrat...@gmail.com> wrote:

> Hello Jeff,
>  Have you installed R into your environment as explained in this
> document (https://zeppelin.apache.org/docs/0.6.0/interpreter/r.html)? It
> is a prerequisite. Also, please try the installation validation command (R
> -e "print(1+1)").
>
> Cheers,
> Rerngvit
>
> On 01 Aug 2016, at 09:05, Jeff Zhang  wrote:
>
>
> I try to use R interpreter using spark.r, r and knitr, but all fails. I
> have already compiled zeppelin with profile sparkr enabled. But I don't see
> R interpreter in interpreter page, I also didn't see spark.r in spark
> interpreter group. Do I miss anything here ? BTW I am using master
>
>
> no spark.r
> 
>
> 3 ways to call r interpreter, but no one succeeded.
>
> <2016-08-01_1458.png>
>
>
>
> The second and third error seems related with ZEPPELIN-1247
>
> https://issues.apache.org/jira/browse/ZEPPELIN-1247
>
>
>
>
>
> --
> Best Regards
>
> Jeff Zhang
>
>
>


-- 
Best Regards

Jeff Zhang

Re: How to use R interpreter ?

UNSUBSCRIBE

Error when starting zeppelin server

Re: Error when starting zeppelin server

RE: Error when starting zeppelin server

spark.jars option for Zeppelin over Livy

Re: Output of lm summary

Re: spark.jars option for Zeppelin over Livy

Re: spark.jars option for Zeppelin over Livy

Re: spark.jars option for Zeppelin over Livy

Re: Error when starting zeppelin server

Re: How to use R interpreter ?

12 matches

Site Navigation

Mail list logo

Footer information