[GitHub] [zeppelin] Reamer commented on pull request #4031: [ZEPPELIN-5215]. Use user defined exception instead of TException to propagate exception to zeppelin server

[GitBox]

Reamer commented on pull request #4031:
URL: https://github.com/apache/zeppelin/pull/4031#issuecomment-776575275


   LGTM
   I am not sure if it makes sense to distinguish between an exception thrown 
by the remote interpreter and an exception thrown by the Zeppelin server for 
the remote interpreter.
   What do you think?



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [zeppelin] asfgit closed pull request #4051: [ZEPPELIN-5244] Docker build in dockerhub fails

[GitBox]

asfgit closed pull request #4051:
URL: https://github.com/apache/zeppelin/pull/4051


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [zeppelin] asfgit closed pull request #4049: [ZEPPELIN-5242] Change **/interpreter/** to interpreter/**

[GitBox]

asfgit closed pull request #4049:
URL: https://github.com/apache/zeppelin/pull/4049


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [zeppelin] zjffdu commented on pull request #4031: [ZEPPELIN-5215]. Use user defined exception instead of TException to propagate exception to zeppelin server

[GitBox]

zjffdu commented on pull request #4031:
URL: https://github.com/apache/zeppelin/pull/4031#issuecomment-776616554


   > LGTM
   > I am not sure if it makes sense to distinguish between an exception thrown 
by the remote interpreter and an exception thrown by the Zeppelin server for 
the remote interpreter.
   > What do you think?
   
   Do you mean the 2 exceptions here ?  
https://github.com/apache/zeppelin/pull/4031/files#diff-3a436f559ddff9ba7280b2617547f5cc9d759e7f4bc6f04304c7e7fe7e01c061R98
   
   We would treat them differently, if it is due to Interpreter exception, then 
no retry, otherwise it would retry (because it may due to network issue)



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [zeppelin] zjffdu commented on pull request #4048: [ZEPPELIN-5241] Typos in spark tutorial

[GitBox]

zjffdu commented on pull request #4048:
URL: https://github.com/apache/zeppelin/pull/4048#issuecomment-776620343


   Thanks for the contribution @omrisk 
   PR LGTM



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [zeppelin] zjffdu commented on pull request #4026: [ZEPPELIN-5074] Improve on how to install doc

[GitBox]

zjffdu commented on pull request #4026:
URL: https://github.com/apache/zeppelin/pull/4026#issuecomment-776631623


   Will merge if no more comment



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [zeppelin] zjffdu commented on pull request #4048: [ZEPPELIN-5241] Typos in spark tutorial

[GitBox]

zjffdu commented on pull request #4048:
URL: https://github.com/apache/zeppelin/pull/4048#issuecomment-776632182


   Will merge if no more comment



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [zeppelin] omrisk commented on pull request #4048: [ZEPPELIN-5241] Typos in spark tutorial

[GitBox]

omrisk commented on pull request #4048:
URL: https://github.com/apache/zeppelin/pull/4048#issuecomment-776632673


   Thanks @zjffdu! Happy to help.
   I see that there are still failing build tests.
   Couldn't find an open ticket or PR to fix this, is there a way I could help 
with that ?
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [zeppelin] Reamer commented on pull request #4031: [ZEPPELIN-5215]. Use user defined exception instead of TException to propagate exception to zeppelin server

[GitBox]

Reamer commented on pull request #4031:
URL: https://github.com/apache/zeppelin/pull/4031#issuecomment-776668466


   > Do you mean the 2 exceptions here ? 
https://github.com/apache/zeppelin/pull/4031/files#diff-3a436f559ddff9ba7280b2617547f5cc9d759e7f4bc6f04304c7e7fe7e01c061R98
   
   Yes I thing, that's the right location. My thoughts went in the direction of 
3 Exception:
- a TException for network problems -> retry
- an "InterpreterRPCException" to indicate exceptions thrown by the 
interpreter
- a "ServerRPCException" to indicate exceptions thrown by the server.

At the moment the handling is the same, but it might be helpful in the 
future to make a difference here.



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [zeppelin] zjffdu commented on pull request #4048: [ZEPPELIN-5241] Typos in spark tutorial

[GitBox]

zjffdu commented on pull request #4048:
URL: https://github.com/apache/zeppelin/pull/4048#issuecomment-776769807


   @omrisk Failure of `Neo4jCypherInterpreterTest` is fixed by a recent PR 
#4050 (You can could rebase this PR to fix it)
   but there still some flaky tests in selenium test (frontend test) that needs 
to fix, but I think it would not be easy, so we could do it separately. BTW, if 
you are interested in making contribution to zeppelin, you can pick up any 
tickets in jira, and we will help you in making contribution.



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Slack channel for Zeppelin community

[Jeff Zhang]

Hi Folks,

We have an apache slack channel for Zeppelin, but we didn't make lots of
discussion there,  but I think it is suitable for many kinds of discussion,
specially we recently talked about regular community sync up meeting. So if
you are interested, please leave your slack account in this thread, I will
invite you to join it.



-- 
Best Regards

Jeff Zhang

[jira] [Created] (ZEPPELIN-5246) Zeppelin in cluster mode doesn't create spark submit

[Ruslan Fialkovsky (Jira)]

Ruslan Fialkovsky created ZEPPELIN-5246:
---

 Summary: Zeppelin in cluster mode doesn't create spark submit 
 Key: ZEPPELIN-5246
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5246
 Project: Zeppelin
  Issue Type: Bug
  Components: interpreter-setting, Interpreters, spark
Affects Versions: 0.9.0
Reporter: Ruslan Fialkovsky
 Attachments: Screenshot 2021-02-10 at 18.30.38.png

Hello. I'm trying  to configure zeppelin cluster mode and running spark on yarn.

This is my interpreter conf on the picture and it works in zeppelin single node 
case.

So, seems zeppelin starts SparkContext instead of  spark-submit in zeppelin 
cluster mode:
{code:java}
// INFO [2021-02-10 18:34:16,838] ({Thread-1034} 
ClusterInterpreterCheckThread.java[run]:51) - ClusterInterpreterCheckThread 
run() >>>  │
 INFO [2021-02-10 18:34:16,848] ({SchedulerFactory2} 
ProcessLauncher.java[transition]:109) - Process state is transitioned to 
LAUNCHED│
 INFO [2021-02-10 18:34:16,848] ({SchedulerFactory2} 
ProcessLauncher.java[launch]:96) - Process is launched: 
[/usr/lib/zeppelin/bin/interpreter.sh, -d, /usr/lib/zeppelin/interpreter/spark, 
-c, 10.15.145│
.26, -p, 17317, -r, :, -i, spark-fialkovskiy, -u, fialkovskiy, -l, 
/usr/lib/zeppelin/local-repo/spark, -g, spark]  
   │
 INFO [2021-02-10 18:34:16,955] ({Exec Stream Pumper} 
ProcessLauncher.java[processLine]:188) - Interpreter launch command:  
/usr/lib/spark/3.0.1/bin/spark-submit --class org.apache.zeppelin.interpreter.│
remote.RemoteInterpreterServer --driver-class-path 
":/usr/lib/zeppelin/interpreter/spark/*::/usr/lib/zeppelin/interpreter/zeppelin-interpreter-shaded-0.9.0-preview2.jar:/usr/lib/zeppelin/interpreter/spa│
rk/spark-interpreter-0.9.0-preview2.jar:/etc/hadoop/" --driver-java-options " 
-Dfile.encoding=UTF-8 
-Dlog4j.configuration='file:///etc/zeppelin/log4j.properties' 
-Dlog4j.configurationFile='file:///etc/z│
eppelin/log4j2.properties' 
-Dzeppelin.log.file='/usr/lib/zeppelin/logs/zeppelin-interpreter-spark-fialkovskiy-fialkovskiy--hadoop836713.log'"
 /usr/lib/zeppelin/interpreter/spark/spark-interpreter-0.9.0-│
preview2.jar 10.15.145.26 17317 "spark-fialkovskiy" :+ pid=8070 

  │
 INFO [2021-02-10 18:34:16,955] ({Exec Stream Pumper} 
ProcessLauncher.java[processLine]:188) - Interpreter launch command:  
/usr/lib/spark/3.0.1/bin/spark-submit --class org.apache.zeppelin.interpreter.│
remote.RemoteInterpreterServer --driver-class-path 
":/usr/lib/zeppelin/interpreter/spark/*::/usr/lib/zeppelin/interpreter/zeppelin-interpreter-shaded-0.9.0-preview2.jar:/usr/lib/zeppelin/interpreter/spa│
rk/spark-interpreter-0.9.0-preview2.jar:/etc/hadoop/" --driver-java-options " 
-Dfile.encoding=UTF-8 
-Dlog4j.configuration='file:///etc/zeppelin/log4j.properties' 
-Dlog4j.configurationFile='file:///etc/z│
eppelin/log4j2.properties' 
-Dzeppelin.log.file='/usr/lib/zeppelin/logs/zeppelin-interpreter-spark-fialkovskiy-fialkovskiy--hadoop836713.log'"
 /usr/lib/zeppelin/interpreter/spark/spark-interpreter-0.9.0-│
preview2.jar 10.15.145.26 17317 "spark-fialkovskiy" :+ pid=8070 

  │
 INFO [2021-02-10 18:34:24,844] ({Thread-1034} 
ClusterManager.java[getIntpProcessStatus]:455) - interpreter thrift 
10.15.145.26:17305 service is online!   
   │
 INFO [2021-02-10 18:34:24,845] ({Thread-1034} 
ClusterManager.java[getIntpProcessStatus]:461) - interpreter thrift 
10.15.145.26:17305 accessible!  
   │
 INFO [2021-02-10 18:34:24,845] ({Thread-1034} 
ClusterInterpreterCheckThread.java[online]:62) - Found cluster interpreter 
10.15.145.26:17305  
│
 INFO [2021-02-10 18:34:24,851] ({Thread-1034} 
ProcessLauncher.java[transition]:109) - Process state is transitioned to 
RUNNING 
  │
 INFO [2021-02-10 18:34:24,852] ({Thread-1034} 
ClusterInterpreterCheckThread.java[run]:81) - ClusterInterpreterCheckThread 
run() <<<  │
 INFO [2021-02-10 18:34:24,854] ({SchedulerFactory2} 
ClusterManager.java[getIntpProcessStatus]:455) - interpreter thrift 
10.15.145.26:17305 service is online!   
 │
 INFO [2021-02-10 18:34:24,854] ({SchedulerFactory2} 
ClusterManager.java[get

Re: Slack channel for Zeppelin community

[Eric Pugh]

Thanks, my slack email s ep...@apache.org 


> On Feb 10, 2021, at 10:17 AM, Jeff Zhang  wrote:
> 
> Hi Folks,
> 
> We have an apache slack channel for Zeppelin, but we didn't make lots of 
> discussion there,  but I think it is suitable for many kinds of discussion, 
> specially we recently talked about regular community sync up meeting. So if 
> you are interested, please leave your slack account in this thread, I will 
> invite you to join it.
> 
> 
> 
> -- 
> Best Regards
> 
> Jeff Zhang

___
Eric Pugh | Founder & CEO | OpenSource Connections, LLC | 434.466.1467 | 
http://www.opensourceconnections.com  | 
My Free/Busy   
Co-Author: Apache Solr Enterprise Search Server, 3rd Ed 


This e-mail and all contents, including attachments, is considered to be 
Company Confidential unless explicitly stated otherwise, regardless of whether 
attachments are marked as such.

Re: Slack channel for Zeppelin community

[Bryan Katis]

Hi Jeff,

My Slack user is bryan.ka...@zepl.com

Thanks,
Bryan

On Wed, Feb 10, 2021 at 7:18 AM Jeff Zhang  wrote:

> Hi Folks,
>
> We have an apache slack channel for Zeppelin, but we didn't make lots of
> discussion there,  but I think it is suitable for many kinds of discussion,
> specially we recently talked about regular community sync up meeting. So if
> you are interested, please leave your slack account in this thread, I will
> invite you to join it.
>
>
>
> --
> Best Regards
>
> Jeff Zhang
>
-- 



Thanks,

Bryan


*Bryan Katis* | *Zepl *| Chief Product Officer | M +1 678.468.7391 |
br...@zepl.com | zepl.com  | Twitter
 |  LinkedIn

[GitHub] [zeppelin] omrisk commented on pull request #4048: [ZEPPELIN-5241] Typos in spark tutorial

[GitBox]

omrisk commented on pull request #4048:
URL: https://github.com/apache/zeppelin/pull/4048#issuecomment-777212206


   @zjffdu , thanks, could you please merge this?
   I'll try to find a beginner friendly jira issue :) 



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [zeppelin] zjffdu commented on pull request #4048: [ZEPPELIN-5241] Typos in spark tutorial

[GitBox]

zjffdu commented on pull request #4048:
URL: https://github.com/apache/zeppelin/pull/4048#issuecomment-777221707


   Will merge it soon, and here's a list of jiras for new contributors
   
https://issues.apache.org/jira/issues/?jql=labels%20%3D%20newbie%20and%20project%20%3D%20ZEPPELIN



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [zeppelin] omrisk opened a new pull request #4052: [ZEPPELIN-5229] - bump flink 1.10 minor version

[GitBox]

omrisk opened a new pull request #4052:
URL: https://github.com/apache/zeppelin/pull/4052


   ### What is this PR for?
   Bumping flink minor version
   
   ### What type of PR is it?
   Improvement 
   
   ### Todos
   * [ ] - Task
   
   ### What is the Jira issue?
   https://issues.apache.org/jira/browse/ZEPPELIN-5229
   
   ### How should this be tested?
   Automation and builds 
   
   ### Screenshots (if appropriate)
   
   ### Questions:
   * Does the licenses files need update? - no 
   * Is there breaking changes for older versions? - no
   * Does this needs documentation? - no
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [zeppelin] zjffdu commented on pull request #4052: [ZEPPELIN-5229] - bump flink 1.10 minor version

[GitBox]

zjffdu commented on pull request #4052:
URL: https://github.com/apache/zeppelin/pull/4052#issuecomment-777248721


   Thanks @omrisk, there's another place needs to update flink version.
   
https://github.com/apache/zeppelin/blob/master/zeppelin-interpreter-integration/src/test/java/org/apache/zeppelin/integration/FlinkIntegrationTest110.java#L32
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [zeppelin] omrisk commented on pull request #4052: [ZEPPELIN-5229] - bump flink 1.10 minor version

[GitBox]

omrisk commented on pull request #4052:
URL: https://github.com/apache/zeppelin/pull/4052#issuecomment-777259136


   @zjffdu, thanks, missed that, fixed.
   Newbie question, should parameters like that be extracted to a `.properties` 
file (in a seperate issue/PR)?
   So that versions can be fully managed for builds in tests with a single 
source for the values?



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [zeppelin] zjffdu commented on pull request #4052: [ZEPPELIN-5229] - bump flink 1.10 minor version

[GitBox]

zjffdu commented on pull request #4052:
URL: https://github.com/apache/zeppelin/pull/4052#issuecomment-777261274


   That's would be better, @omrisk maybe put them in project root pom.xml. 
   If that is possible, we should do the same thing for spark as well. 



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org