from:"xiufeng liu"

Re: Compile error

2019-08-29 Thread xiufeng liu

Hi again,
I have tried not to use docker, but it is same. here is the log

 INFO [2019-08-29 15:45:18,840] ({ParallelScheduler-Worker-2}
AbstractScheduler.java[runJob]:142) - Job
paragraph_1567093498023_-273931001 finished by scheduler
org.apache.zeppelin.shell.ShellInterpreter752743685
 INFO [2019-08-29 15:45:27,167] ({ParallelScheduler-Worker-1}
AbstractScheduler.java[runJob]:116) - Job
paragraph_1567093498023_-273931001 started by scheduler
org.apache.zeppelin.shell.TerminalInterpreter1624562114
 INFO [2019-08-29 15:45:27,183] ({ParallelScheduler-Worker-1}
Log.java[initialized]:193) - Logging initialized @13965ms to
org.eclipse.jetty.util.log.Slf4jLog
 INFO [2019-08-29 15:45:27,190] ({ParallelScheduler-Worker-1}
TerminalInterpreter.java[internalInterpret]:114) - loop = 0
 WARN [2019-08-29 15:45:27,236] ({Thread-7}
ContextHandler.java[setContextPath]:1593) -
o.e.j.s.ServletContextHandler@71fa1926{/,null,UNAVAILABLE} contextPath ends
with /
 INFO [2019-08-29 15:45:27,244] ({Thread-7} TerminalThread.java[run]:65) -
WebRoot is
jar:file:/home/xiuli/zeppelin/interpreter/sh/zeppelin-shell-0.9.0-SNAPSHOT.jar!/html
 INFO [2019-08-29 15:45:27,263] ({pool-1-thread-2}
RemoteInterpreterServer.java[getStatus]:866) - job:null
 INFO [2019-08-29 15:45:27,263] ({pool-1-thread-2}
RemoteInterpreterServer.java[getStatus]:866) -
job:org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob@fc56d7a8
 INFO [2019-08-29 15:45:27,263] ({pool-1-thread-2}
RemoteInterpreterServer.java[getStatus]:868) - getStatus: RUNNING
 INFO [2019-08-29 15:45:27,307] ({Thread-7} Server.java[doStart]:370) -
jetty-9.4.z-SNAPSHOT; built: 2019-04-29T20:42:08.989Z; git:
e1bc35120a6617ee3df052294e433f3a25ce7097; jvm 1.8.0_201-b09
 INFO [2019-08-29 15:45:27,339] ({Thread-7}
DefaultSessionIdManager.java[doStart]:365) - DefaultSessionIdManager
workerName=node0
 INFO [2019-08-29 15:45:27,339] ({Thread-7}
DefaultSessionIdManager.java[doStart]:370) - No SessionScavenger set, using
defaults
 INFO [2019-08-29 15:45:27,341] ({Thread-7}
HouseKeeper.java[startScavenging]:149) - node0 Scavenging every 66ms
 INFO [2019-08-29 15:45:27,373] ({Thread-7}
ContextHandler.java[doStart]:855) - Started
o.e.j.s.ServletContextHandler@71fa1926{/terminal,null,AVAILABLE}
 INFO [2019-08-29 15:45:27,384] ({Thread-7}
AbstractConnector.java[doStart]:292) - Started ServerConnector@950392e
{HTTP/1.1,[http/1.1]}{0.0.0.0:35599}
 INFO [2019-08-29 15:45:27,385] ({Thread-7} Server.java[doStart]:410) -
Started @14167ms
 INFO [2019-08-29 15:45:27,797] ({ParallelScheduler-Worker-1}
TerminalInterpreter.java[createTerminalDashboard]:154) -

  
Terminal - man-sc02 (192.168.0.2)
STATUS: 
CONNECTED
DISCONNECTED
ERROR




  





  http://192.168.0.2:35599?noteId=2EN14VVZ5¶graphId=paragraph_1567093498023_-273931001&t=1567093527757";
height="400" width="100%" frameborder="0" scrolling="0">


 INFO [2019-08-29 15:45:27,800] ({ParallelScheduler-Worker-1}
AbstractScheduler.java[runJob]:142) - Job
paragraph_1567093498023_-273931001 finished by scheduler
org.apache.zeppelin.shell.TerminalInterpreter1624562114

On Thu, Aug 29, 2019 at 5:01 PM xiufeng liu  wrote:

>
> Hi Xun,
> I probably know the reason. I compile the source from Dockfile. The
> following ip address is the container address, and port, which won't work
> if access outside of the container. Do you think it is a bug for running
> Zeppelin in Docker?
>
> http://172.17.0.3:42877?noteId=2ENZ85UFU¶graphId=paragraph_1567090139520_204251118&t=1567090151527
>
> /Xiufeng
>
> On Thu, Aug 29, 2019 at 3:56 PM Xun Liu  wrote:
>
>> hi, xiufeng liu:
>>
>> Please send me your zeppelin-interpreter-shll.log file.
>>
>>
>> On Aug 29, 2019, at 9:50 PM, Jeff Zhang  wrote:
>>
>> + Xun who implement the interactive shell.
>>
>>
>>
>> xiufeng liu  于2019年8月29日周四 下午9:44写道：
>>
>>> Dear Jeff,
>>>
>>> Thanks! It works.
>>> But, the interactive shell does not work (see the attached picture).
>>> Does it need some special configuration? Thanks
>>> /Xiufeng
>>>
>>> On Thu, Aug 29, 2019 at 3:05 PM Jeff Zhang  wrote:
>>>
>>>> Please also exclude r module as well.
>>>>
>>>> xiufeng liu  于2019年8月29日周四 下午7:53写道：
>>>>
>>>>> *Yes, i have used the root account. Now I used the non-root account to
>>>>> compile, but got another error:*
>>>>> *The command I used is mvn -e clean package -Pscala-2.11 -Pbuild-distr
>>>>> -Pspark-2.3 -Pr -Phadoop-2.7 -Dhadoop.version=2.7.3 -DskipTests -pl 
>>>>> !beam'*
>>>>>
>>>>> *-*
>>>>>
>>>>> ERROR]
>>>>> /zeppelin/r/src/m

Re: Compile error

2019-08-29 Thread xiufeng liu

Besides, the ip address 192.168.0.2
<http://192.168.0.2:35599/?noteId=2EN14VVZ5¶graphId=paragraph_1567093498023_-273931001&t=1567093527757>
is
my subnet ip address. The shell should obtain my public IP address, instead
of this subnet ip address.
http://192.168.0.2:35599?noteId=2EN14VVZ5¶graphId=paragraph_1567093498023_-273931001&t=1567093527757
<http://192.168.0.2:35599/?noteId=2EN14VVZ5¶graphId=paragraph_1567093498023_-273931001&t=1567093527757>

On Thu, Aug 29, 2019 at 6:07 PM xiufeng liu  wrote:

> Hi again,
>
> It might be due to the firewall as I run on a remote server. I copied to
> run on my local desktop, and it can work fine.
> I could see that it will open a random port for the shell, for example,
> 35599, in my previous test, which is not good as the port might not be
> open.  I think it would be good if one can specify the port for the
> interactive shell, e.g., in the configuration file?
>
> /Xiufeng
>
> On Thu, Aug 29, 2019 at 5:53 PM xiufeng liu  wrote:
>
>> Hi again,
>> I have tried not to use docker, but it is same. here is the log
>>
>>  INFO [2019-08-29 15:45:18,840] ({ParallelScheduler-Worker-2}
>> AbstractScheduler.java[runJob]:142) - Job
>> paragraph_1567093498023_-273931001 finished by scheduler
>> org.apache.zeppelin.shell.ShellInterpreter752743685
>>  INFO [2019-08-29 15:45:27,167] ({ParallelScheduler-Worker-1}
>> AbstractScheduler.java[runJob]:116) - Job
>> paragraph_1567093498023_-273931001 started by scheduler
>> org.apache.zeppelin.shell.TerminalInterpreter1624562114
>>  INFO [2019-08-29 15:45:27,183] ({ParallelScheduler-Worker-1}
>> Log.java[initialized]:193) - Logging initialized @13965ms to
>> org.eclipse.jetty.util.log.Slf4jLog
>>  INFO [2019-08-29 15:45:27,190] ({ParallelScheduler-Worker-1}
>> TerminalInterpreter.java[internalInterpret]:114) - loop = 0
>>  WARN [2019-08-29 15:45:27,236] ({Thread-7}
>> ContextHandler.java[setContextPath]:1593) -
>> o.e.j.s.ServletContextHandler@71fa1926{/,null,UNAVAILABLE} contextPath
>> ends with /
>>  INFO [2019-08-29 15:45:27,244] ({Thread-7} TerminalThread.java[run]:65)
>> - WebRoot is
>> jar:file:/home/xiuli/zeppelin/interpreter/sh/zeppelin-shell-0.9.0-SNAPSHOT.jar!/html
>>  INFO [2019-08-29 15:45:27,263] ({pool-1-thread-2}
>> RemoteInterpreterServer.java[getStatus]:866) - job:null
>>  INFO [2019-08-29 15:45:27,263] ({pool-1-thread-2}
>> RemoteInterpreterServer.java[getStatus]:866) -
>> job:org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob@fc56d7a8
>>  INFO [2019-08-29 15:45:27,263] ({pool-1-thread-2}
>> RemoteInterpreterServer.java[getStatus]:868) - getStatus: RUNNING
>>  INFO [2019-08-29 15:45:27,307] ({Thread-7} Server.java[doStart]:370) -
>> jetty-9.4.z-SNAPSHOT; built: 2019-04-29T20:42:08.989Z; git:
>> e1bc35120a6617ee3df052294e433f3a25ce7097; jvm 1.8.0_201-b09
>>  INFO [2019-08-29 15:45:27,339] ({Thread-7}
>> DefaultSessionIdManager.java[doStart]:365) - DefaultSessionIdManager
>> workerName=node0
>>  INFO [2019-08-29 15:45:27,339] ({Thread-7}
>> DefaultSessionIdManager.java[doStart]:370) - No SessionScavenger set, using
>> defaults
>>  INFO [2019-08-29 15:45:27,341] ({Thread-7}
>> HouseKeeper.java[startScavenging]:149) - node0 Scavenging every 66ms
>>  INFO [2019-08-29 15:45:27,373] ({Thread-7}
>> ContextHandler.java[doStart]:855) - Started
>> o.e.j.s.ServletContextHandler@71fa1926{/terminal,null,AVAILABLE}
>>  INFO [2019-08-29 15:45:27,384] ({Thread-7}
>> AbstractConnector.java[doStart]:292) - Started ServerConnector@950392e
>> {HTTP/1.1,[http/1.1]}{0.0.0.0:35599}
>>  INFO [2019-08-29 15:45:27,385] ({Thread-7} Server.java[doStart]:410) -
>> Started @14167ms
>>  INFO [2019-08-29 15:45:27,797] ({ParallelScheduler-Worker-1}
>> TerminalInterpreter.java[createTerminalDashboard]:154) -
>> 
>>   
>> Terminal - man-sc02 (192.168.0.2)
>> STATUS: 
>> > ng-style="{'color':'green'}">CONNECTED
>> > ng-style="{'color':'red'}">DISCONNECTED
>> ERROR
>> > class="fa fa-info-circle interpreter-binding-mode-info-link"
>> aria-hidden="true" tooltip-placement="bottom" uib-tooltip="Please run this
>> paragraph again">
>>
>> 
>>
>>   
>> 
>>
>> 
>>
>> 
>>   http://192.168.0.2:35599?noteId=2EN14VVZ5¶graphId=paragraph_1567093498023_-273931001&t=1567093527757";
>> height="400" width="100%" frameborder="0" scrolling="0">
>> 
>>
>

Re: Compile error

2019-08-29 Thread xiufeng liu

Hi again,

It might be due to the firewall as I run on a remote server. I copied to
run on my local desktop, and it can work fine.
I could see that it will open a random port for the shell, for example,
35599, in my previous test, which is not good as the port might not be
open.  I think it would be good if one can specify the port for the
interactive shell, e.g., in the configuration file?

/Xiufeng

On Thu, Aug 29, 2019 at 5:53 PM xiufeng liu  wrote:

> Hi again,
> I have tried not to use docker, but it is same. here is the log
>
>  INFO [2019-08-29 15:45:18,840] ({ParallelScheduler-Worker-2}
> AbstractScheduler.java[runJob]:142) - Job
> paragraph_1567093498023_-273931001 finished by scheduler
> org.apache.zeppelin.shell.ShellInterpreter752743685
>  INFO [2019-08-29 15:45:27,167] ({ParallelScheduler-Worker-1}
> AbstractScheduler.java[runJob]:116) - Job
> paragraph_1567093498023_-273931001 started by scheduler
> org.apache.zeppelin.shell.TerminalInterpreter1624562114
>  INFO [2019-08-29 15:45:27,183] ({ParallelScheduler-Worker-1}
> Log.java[initialized]:193) - Logging initialized @13965ms to
> org.eclipse.jetty.util.log.Slf4jLog
>  INFO [2019-08-29 15:45:27,190] ({ParallelScheduler-Worker-1}
> TerminalInterpreter.java[internalInterpret]:114) - loop = 0
>  WARN [2019-08-29 15:45:27,236] ({Thread-7}
> ContextHandler.java[setContextPath]:1593) -
> o.e.j.s.ServletContextHandler@71fa1926{/,null,UNAVAILABLE} contextPath
> ends with /
>  INFO [2019-08-29 15:45:27,244] ({Thread-7} TerminalThread.java[run]:65) -
> WebRoot is
> jar:file:/home/xiuli/zeppelin/interpreter/sh/zeppelin-shell-0.9.0-SNAPSHOT.jar!/html
>  INFO [2019-08-29 15:45:27,263] ({pool-1-thread-2}
> RemoteInterpreterServer.java[getStatus]:866) - job:null
>  INFO [2019-08-29 15:45:27,263] ({pool-1-thread-2}
> RemoteInterpreterServer.java[getStatus]:866) -
> job:org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob@fc56d7a8
>  INFO [2019-08-29 15:45:27,263] ({pool-1-thread-2}
> RemoteInterpreterServer.java[getStatus]:868) - getStatus: RUNNING
>  INFO [2019-08-29 15:45:27,307] ({Thread-7} Server.java[doStart]:370) -
> jetty-9.4.z-SNAPSHOT; built: 2019-04-29T20:42:08.989Z; git:
> e1bc35120a6617ee3df052294e433f3a25ce7097; jvm 1.8.0_201-b09
>  INFO [2019-08-29 15:45:27,339] ({Thread-7}
> DefaultSessionIdManager.java[doStart]:365) - DefaultSessionIdManager
> workerName=node0
>  INFO [2019-08-29 15:45:27,339] ({Thread-7}
> DefaultSessionIdManager.java[doStart]:370) - No SessionScavenger set, using
> defaults
>  INFO [2019-08-29 15:45:27,341] ({Thread-7}
> HouseKeeper.java[startScavenging]:149) - node0 Scavenging every 66ms
>  INFO [2019-08-29 15:45:27,373] ({Thread-7}
> ContextHandler.java[doStart]:855) - Started
> o.e.j.s.ServletContextHandler@71fa1926{/terminal,null,AVAILABLE}
>  INFO [2019-08-29 15:45:27,384] ({Thread-7}
> AbstractConnector.java[doStart]:292) - Started ServerConnector@950392e
> {HTTP/1.1,[http/1.1]}{0.0.0.0:35599}
>  INFO [2019-08-29 15:45:27,385] ({Thread-7} Server.java[doStart]:410) -
> Started @14167ms
>  INFO [2019-08-29 15:45:27,797] ({ParallelScheduler-Worker-1}
> TerminalInterpreter.java[createTerminalDashboard]:154) -
> 
>   
> Terminal - man-sc02 (192.168.0.2)
> STATUS: 
>  ng-style="{'color':'green'}">CONNECTED
>  ng-style="{'color':'red'}">DISCONNECTED
> ERROR
>  tooltip-placement="bottom" uib-tooltip="Please run this paragraph
> again">
>
> 
>
>   
> 
>
> 
>
> 
>   http://192.168.0.2:35599?noteId=2EN14VVZ5¶graphId=paragraph_1567093498023_-273931001&t=1567093527757";
> height="400" width="100%" frameborder="0" scrolling="0">
> 
>
>  INFO [2019-08-29 15:45:27,800] ({ParallelScheduler-Worker-1}
> AbstractScheduler.java[runJob]:142) - Job
> paragraph_1567093498023_-273931001 finished by scheduler
> org.apache.zeppelin.shell.TerminalInterpreter1624562114
>
> On Thu, Aug 29, 2019 at 5:01 PM xiufeng liu  wrote:
>
>>
>> Hi Xun,
>> I probably know the reason. I compile the source from Dockfile. The
>> following ip address is the container address, and port, which won't work
>> if access outside of the container. Do you think it is a bug for running
>> Zeppelin in Docker?
>>
>> http://172.17.0.3:42877?noteId=2ENZ85UFU¶graphId=paragraph_1567090139520_204251118&t=1567090151527
>>
>> /Xiufeng
>>
>> On Thu, Aug 29, 2019 at 3:56 PM Xun Liu  wrote:
>>
>>> hi, xiufeng liu:
>>>
>>> Please send me your zeppelin-interpreter-shll.log file.
>>>
>>>
>>> On Aug 29, 2019, at 9:50

Re: Compile error

2019-08-29 Thread xiufeng liu

Hi Xun,
I probably know the reason. I compile the source from Dockfile. The
following ip address is the container address, and port, which won't work
if access outside of the container. Do you think it is a bug for running
Zeppelin in Docker?
http://172.17.0.3:42877?noteId=2ENZ85UFU¶graphId=paragraph_1567090139520_204251118&t=1567090151527

/Xiufeng

On Thu, Aug 29, 2019 at 3:56 PM Xun Liu  wrote:

> hi, xiufeng liu:
>
> Please send me your zeppelin-interpreter-shll.log file.
>
>
> On Aug 29, 2019, at 9:50 PM, Jeff Zhang  wrote:
>
> + Xun who implement the interactive shell.
>
>
>
> xiufeng liu  于2019年8月29日周四 下午9:44写道：
>
>> Dear Jeff,
>>
>> Thanks! It works.
>> But, the interactive shell does not work (see the attached picture).
>> Does it need some special configuration? Thanks
>> /Xiufeng
>>
>> On Thu, Aug 29, 2019 at 3:05 PM Jeff Zhang  wrote:
>>
>>> Please also exclude r module as well.
>>>
>>> xiufeng liu  于2019年8月29日周四 下午7:53写道：
>>>
>>>> *Yes, i have used the root account. Now I used the non-root account to
>>>> compile, but got another error:*
>>>> *The command I used is mvn -e clean package -Pscala-2.11 -Pbuild-distr
>>>> -Pspark-2.3 -Pr -Phadoop-2.7 -Dhadoop.version=2.7.3 -DskipTests -pl !beam'*
>>>>
>>>> *-*
>>>>
>>>> ERROR]
>>>> /zeppelin/r/src/main/scala/org/apache/zeppelin/rinterpreter/RContext.scala:31:
>>>> error: object SparkZeppelinContext is not a member of package
>>>> org.apache.zeppelin.spark
>>>> [INFO] import org.apache.zeppelin.spark.{SparkInterpreter,
>>>> SparkZeppelinContext}
>>>> [INFO]^
>>>> [ERROR]
>>>> /zeppelin/r/src/main/scala/org/apache/zeppelin/rinterpreter/RContext.scala:48:
>>>> error: not found: type SparkZeppelinContext
>>>> [INFO]   private var z: Option[SparkZeppelinContext] = None
>>>> [INFO] ^
>>>> [ERROR]
>>>> /zeppelin/r/src/main/scala/org/apache/zeppelin/rinterpreter/RContext.scala:128:
>>>> error: not found: type SparkZeppelinContext
>>>> [INFO]   private def initializeSparkR(sc : SparkContext, sql :
>>>> SQLContext, z : SparkZeppelinContext) : Unit = synchronized {
>>>> [INFO]
>>>> ^
>>>> [ERROR]
>>>> /zeppelin/r/src/main/java/org/apache/zeppelin/rinterpreter/RStatics.java:28:
>>>> error: object SparkZeppelinContext is not a member of package
>>>> org.apache.zeppelin.spark
>>>> [INFO] import org.apache.zeppelin.spark.SparkZeppelinContext;
>>>> [INFO]^
>>>> [ERROR]
>>>> /zeppelin/r/src/main/java/org/apache/zeppelin/rinterpreter/RStatics.java:45:
>>>> error: not found: type SparkZeppelinContext
>>>> [INFO]   public static SparkZeppelinContext setZ(SparkZeppelinContext
>>>> newZ) {
>>>> [INFO] ^
>>>> [ERROR]
>>>> /zeppelin/r/src/main/java/org/apache/zeppelin/rinterpreter/RStatics.java:45:
>>>> error: not found: type SparkZeppelinContext
>>>> [INFO]   public static SparkZeppelinContext setZ(SparkZeppelinContext
>>>> newZ) {
>>>> [INFO]   ^
>>>> [ERROR] 6 errors found
>>>> [INFO]
>>>> 
>>>> [INFO] Reactor Summary:
>>>> [INFO]
>>>> [INFO] Zeppelin ... SUCCESS [
>>>> 16.712 s]
>>>> [INFO] Zeppelin: Interpreter .. SUCCESS [
>>>> 15.426 s]
>>>> [INFO] Zeppelin: Interpreter API .. SUCCESS [
>>>> 49.017 s]
>>>> [INFO] Zeppelin: Interpreter Parent ... SUCCESS [
>>>>  1.230 s]
>>>> [INFO] Zeppelin: Zengine .. SUCCESS [
>>>> 13.530 s]
>>>> [INFO] Zeppelin: Display system apis .. SUCCESS [
>>>> 13.154 s]
>>>> [INFO] Zeppelin: Groovy interpreter ... SUCCESS [
>>>>  3.510 s]
>>>> [INFO] Zeppelin: Spark Parent . SUCCESS [
>>>>  2.825 s]
>>>> [INFO] Zeppelin: Spark Shims .. SUCCESS [
>>>>  2.398 s]
>>>> [INFO] Zeppelin: Spark1 Shims . SUCCESS [
>>>> 10.266 s]
&

Re: Compile error

2019-08-29 Thread xiufeng liu

Dear Jeff,

Thanks! It works.
But, the interactive shell does not work (see the attached picture).  Does
it need some special configuration? Thanks
/Xiufeng

On Thu, Aug 29, 2019 at 3:05 PM Jeff Zhang  wrote:

> Please also exclude r module as well.
>
> xiufeng liu  于2019年8月29日周四 下午7:53写道：
>
>> *Yes, i have used the root account. Now I used the non-root account to
>> compile, but got another error:*
>> *The command I used is mvn -e clean package -Pscala-2.11 -Pbuild-distr
>> -Pspark-2.3 -Pr -Phadoop-2.7 -Dhadoop.version=2.7.3 -DskipTests -pl !beam'*
>>
>> *-*
>>
>> ERROR]
>> /zeppelin/r/src/main/scala/org/apache/zeppelin/rinterpreter/RContext.scala:31:
>> error: object SparkZeppelinContext is not a member of package
>> org.apache.zeppelin.spark
>> [INFO] import org.apache.zeppelin.spark.{SparkInterpreter,
>> SparkZeppelinContext}
>> [INFO]^
>> [ERROR]
>> /zeppelin/r/src/main/scala/org/apache/zeppelin/rinterpreter/RContext.scala:48:
>> error: not found: type SparkZeppelinContext
>> [INFO]   private var z: Option[SparkZeppelinContext] = None
>> [INFO] ^
>> [ERROR]
>> /zeppelin/r/src/main/scala/org/apache/zeppelin/rinterpreter/RContext.scala:128:
>> error: not found: type SparkZeppelinContext
>> [INFO]   private def initializeSparkR(sc : SparkContext, sql :
>> SQLContext, z : SparkZeppelinContext) : Unit = synchronized {
>> [INFO]
>>   ^
>> [ERROR]
>> /zeppelin/r/src/main/java/org/apache/zeppelin/rinterpreter/RStatics.java:28:
>> error: object SparkZeppelinContext is not a member of package
>> org.apache.zeppelin.spark
>> [INFO] import org.apache.zeppelin.spark.SparkZeppelinContext;
>> [INFO]^
>> [ERROR]
>> /zeppelin/r/src/main/java/org/apache/zeppelin/rinterpreter/RStatics.java:45:
>> error: not found: type SparkZeppelinContext
>> [INFO]   public static SparkZeppelinContext setZ(SparkZeppelinContext
>> newZ) {
>> [INFO] ^
>> [ERROR]
>> /zeppelin/r/src/main/java/org/apache/zeppelin/rinterpreter/RStatics.java:45:
>> error: not found: type SparkZeppelinContext
>> [INFO]   public static SparkZeppelinContext setZ(SparkZeppelinContext
>> newZ) {
>> [INFO]   ^
>> [ERROR] 6 errors found
>> [INFO]
>> 
>> [INFO] Reactor Summary:
>> [INFO]
>> [INFO] Zeppelin ... SUCCESS [
>> 16.712 s]
>> [INFO] Zeppelin: Interpreter .. SUCCESS [
>> 15.426 s]
>> [INFO] Zeppelin: Interpreter API .. SUCCESS [
>> 49.017 s]
>> [INFO] Zeppelin: Interpreter Parent ... SUCCESS [
>>  1.230 s]
>> [INFO] Zeppelin: Zengine .. SUCCESS [
>> 13.530 s]
>> [INFO] Zeppelin: Display system apis .. SUCCESS [
>> 13.154 s]
>> [INFO] Zeppelin: Groovy interpreter ... SUCCESS [
>>  3.510 s]
>> [INFO] Zeppelin: Spark Parent . SUCCESS [
>>  2.825 s]
>> [INFO] Zeppelin: Spark Shims .. SUCCESS [
>>  2.398 s]
>> [INFO] Zeppelin: Spark1 Shims . SUCCESS [
>> 10.266 s]
>> [INFO] Zeppelin: Spark2 Shims . SUCCESS [
>>  9.687 s]
>> [INFO] Zeppelin: Python interpreter ... SUCCESS [
>>  7.686 s]
>> [INFO] Zeppelin: Spark Interpreter  SUCCESS [
>> 27.392 s]
>> [INFO] Zeppelin: Spark Scala Parent ... SUCCESS [
>>  5.968 s]
>> [INFO] Zeppelin: Spark Interpreter Scala_2.10 . SUCCESS [
>> 10.189 s]
>> [INFO] Zeppelin: Spark Interpreter Scala_2.11 . SUCCESS [
>>  9.291 s]
>> [INFO] Zeppelin: Spark Interpreter Scala_2.12 . SUCCESS [
>> 10.062 s]
>> [INFO] Zeppelin: Spark dependencies ... SUCCESS
>> [02:51 min]
>> [INFO] Zeppelin: Shell interpreter  SUCCESS [
>>  7.017 s]
>> [INFO] Zeppelin: Submarine interpreter  SUCCESS [
>>  7.459 s]
>> [INFO] Zeppelin: Markdown interpreter . SUCCESS [
>>  1.551 s]
>> [INFO] Zeppelin: Angular interpreter .. SUCCESS [
>>  0.929 s]
>> [INFO] Zeppelin: Livy interpreter . SUCCESS [
>>  6.981 s]
>> [INFO] Zeppelin: HBase interpreter ...

Re: Compile error

2019-08-29 Thread xiufeng liu

cutor.java:149)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:136)
at
org_scala_tools_maven_executions.JavaMainCallerByFork.run(JavaMainCallerByFork.java:80)
at
org_scala_tools_maven.ScalaCompilerSupport.compile(ScalaCompilerSupport.java:124)
at
org_scala_tools_maven.ScalaCompilerSupport.doExecute(ScalaCompilerSupport.java:80)
at org_scala_tools_maven.ScalaMojoSupport.execute(ScalaMojoSupport.java:342)
... 22 more
[ERROR]
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the
command
[ERROR]   mvn  -rf :zeppelin-zrinterpreter_2.11
The command '/bin/sh -c mvn -e clean package -Pscala-2.11 -Pbuild-distr
-Pspark-2.3 -Pr -Phadoop-2.7 -Dhadoop.version=2.7.3 -DskipTests -pl !beam'
returned a non-zero code: 1
xiuli@man-sc02:~/docker-zeppelin$


On Thu, 29 Aug 2019, 09:12 Jeff Zhang,  wrote:

>  What is your build command ？ And do you use root to build it ?
>
> xiufeng liu  于2019年8月29日周四 下午2:55写道：
>
>> Dear Jeff,
>>
>> Thanks a lot!
>> I have excluded the beam module, but I got another compile error. Could
>> you help to take a look? Thanks
>>
>> /afancy
>>
>> -
>> [WARNING] The requested profile "hadoop-2.6" could not be activated
>> because it does not exist.
>> [ERROR] Failed to execute goal
>> com.github.eirslett:frontend-maven-plugin:1.6:npm (npm build) on project
>> zeppelin-web: Failed to run task: 'npm run build:dist' failed.
>> org.apache.commons.exec.ExecuteException: Process exited with an error: 3
>> (Exit value: 3) -> [Help 1]
>> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
>> goal com.github.eirslett:frontend-maven-plugin:1.6:npm (npm build) on
>> project zeppelin-web: Failed to run task
>> at
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:212)
>> at
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>> at
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>> at
>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
>> at
>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
>> at
>> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
>> at
>> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
>> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307)
>> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193)
>> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106)
>> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:863)
>> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288)
>> at org.apache.maven.cli.MavenCli.main(MavenCli.java:199)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:498)
>> at
>> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
>> at
>> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
>> at
>> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
>> at
>> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
>> Caused by: org.apache.maven.plugin.MojoFailureException: Failed to run
>> task
>> at
>> com.github.eirslett.maven.plugins.frontend.mojo.AbstractFrontendMojo.execute(AbstractFrontendMojo.java:100)
>> at
>> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134)
>> at
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:207)
>> ... 20 more
>> Caused by:
>> com.github.eirslett.maven.plugins.frontend.lib.TaskRunnerException: 'npm
>> run build:dist' failed.
>> at
>> com.github.eirslett.maven.plugins.frontend.lib.NodeTaskExecutor.execute(NodeTaskExecutor.java:63)
>> at
>> com.github.eirslett.maven.plugins.frontend.mojo.NpmMojo.execute(NpmMojo.java:62)
>> at
>> com.github.eirslett.maven.plugins.frontend

Re: Compile error

2019-08-28 Thread xiufeng liu

Dear Jeff,

Thanks a lot!
I have excluded the beam module, but I got another compile error. Could you
help to take a look? Thanks

/afancy

-
[WARNING] The requested profile "hadoop-2.6" could not be activated because
it does not exist.
[ERROR] Failed to execute goal
com.github.eirslett:frontend-maven-plugin:1.6:npm (npm build) on project
zeppelin-web: Failed to run task: 'npm run build:dist' failed.
org.apache.commons.exec.ExecuteException: Process exited with an error: 3
(Exit value: 3) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
goal com.github.eirslett:frontend-maven-plugin:1.6:npm (npm build) on
project zeppelin-web: Failed to run task
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:212)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at
org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:863)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:199)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoFailureException: Failed to run task
at
com.github.eirslett.maven.plugins.frontend.mojo.AbstractFrontendMojo.execute(AbstractFrontendMojo.java:100)
at
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:207)
... 20 more
Caused by:
com.github.eirslett.maven.plugins.frontend.lib.TaskRunnerException: 'npm
run build:dist' failed.
at
com.github.eirslett.maven.plugins.frontend.lib.NodeTaskExecutor.execute(NodeTaskExecutor.java:63)
at
com.github.eirslett.maven.plugins.frontend.mojo.NpmMojo.execute(NpmMojo.java:62)
at
com.github.eirslett.maven.plugins.frontend.mojo.AbstractFrontendMojo.execute(AbstractFrontendMojo.java:94)
... 22 more
Caused by:
com.github.eirslett.maven.plugins.frontend.lib.ProcessExecutionException:
org.apache.commons.exec.ExecuteException: Process exited with an error: 3
(Exit value: 3)
at
com.github.eirslett.maven.plugins.frontend.lib.ProcessExecutor.execute(ProcessExecutor.java:82)
at
com.github.eirslett.maven.plugins.frontend.lib.ProcessExecutor.executeAndRedirectOutput(ProcessExecutor.java:64)
at
com.github.eirslett.maven.plugins.frontend.lib.NodeExecutor.executeAndRedirectOutput(NodeExecutor.java:29)
at
com.github.eirslett.maven.plugins.frontend.lib.NodeTaskExecutor.execute(NodeTaskExecutor.java:58)
... 24 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an
error: 3 (Exit value: 3)
at
org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:404)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:166)
at
com.github.eirslett.maven.plugins.frontend.lib.ProcessExecutor.execute(ProcessExecutor.java:74)
... 27 more
[ERROR]
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException

On Thu, Aug 29, 2019 at 3:25 AM Jeff Zhang  wrote:

> The problem is that there's no beam-runners-flink 2.0.0 for scala 2.10
>
> https://mvnrepository.com/artifact/org.apache.beam/beam-runners-flink
>
> There's several approach for it .
>
> 1. exclude beam module when building.  Add -pl !beam
> 2. Use -Pscala-2.10 -Pspark-1.6
> 3. Upgrade beam version to 2.5.0 which support scala 2.11
>
>
> And please create a ticket for it.
>
>
> afancy  于2019年8月28日周三 下午11:31写道：
>
>> Dear all,
>>
>> I use the following command to compile the source code on Ubuntu 16.04,
>> b

Re: Editing files on filesystem from Zeppelin?

2019-06-14 Thread xiufeng liu

very nice feature.  look forward to it.  when will the next release be?

liu

On Fri, 14 Jun 2019, 09:56 Queimado, Fernando (Nokia - PT/Amadora), <
fernando.queim...@nokia.com> wrote:

> unsubscribe
>
>
>
> *From:* Eric Pugh 
> *Sent:* Thursday, June 13, 2019 3:07 PM
> *To:* users@zeppelin.apache.org
> *Subject:* Re: Editing files on filesystem from Zeppelin?
>
>
>
> Any thoughts?   Am I looking for something that actually isnt' needed in
> Zeppelin, but I don't quite realize it?
>
>
>
> On Sun, Jun 9, 2019 at 7:13 PM Eric Pugh 
> wrote:
>
> I’ve been poking around a bit more on the differences between Jupyter and
> Zeppelin, and it seems like one gap that Zeppelin has is that it’s not
> really possible to edit a file on the filesystem directly.   Everything has
> to be in a notebook…
>
>
>
> Am I missing something possibly?  If I want to look at some shared code in
> a python library for example, can I load that file inside of Zeppelin web
> UI?
>
>
>
> Will the new Terminal tool let me do a “vi ./lib/shared_code.py” for
> example?
>
>
>
> Thanks!
>
>
>
> Eric
>
>
>
>
>
>
>
> ___
>
> *Eric Pugh **| *Founder & CEO | OpenSource Connections, LLC |
> 434.466.1467 | http://www.opensourceconnections.com | My Free/Busy
> 
>
> Co-Author: Apache Solr Enterprise Search Server, 3rd Ed
> 
>
> This e-mail and all contents, including attachments, is considered to be
> Company Confidential unless explicitly stated otherwise, regardless
> of whether attachments are marked as such.
>
>
>
>

Re: Failed to start Zeppelin

2019-06-11 Thread xiufeng liu

Here is the result of echo ${ZEPPELIN_CLASSPATH}
:/opt/zeppelin/lib/interpreter/*:/opt/zeppelin/lib/*:/opt/zeppelin/*::/opt/zeppelin/conf

On Tue, Jun 11, 2019 at 4:14 PM Jeff Zhang  wrote:

> Could you show me the ZEPPELIN_CLASSPATH like the one in your last log ?
>
> xiufeng liu  于2019年6月11日周二 下午6:24写道：
>
>> Thanks. I removed the lib of Hive and Hadoop from the classpath, and
>> restart again. But, this time, I got the following error:
>> HTTP ERROR 503
>> Problem accessing /. Reason:
>> Service Unavailable
>>
>> see the log: https://pastebin.com/HTRmKkuq
>>
>> /Xiufeng
>>
>> On Tue, Jun 11, 2019 at 12:09 PM Jeff Zhang  wrote:
>>
>>> I notice you also put hadoop and hive lib under zeppelin's classpath, it
>>> might conflict with zeppelin's lib. Any reason why you need to put hadoop
>>> and hive under zeppelin's classpath ?
>>>
>>> ZEPPELIN_CLASSPATH:
>>> ::/opt/hadoop/lib/*:.:/opt/hive/lib/*:.:/opt/zeppelin_0.8.1/lib/interpreter/*:/opt/zeppelin_0.8.1/lib/*:/opt/zeppelin_0.8.1/*::/opt/zeppelin_0.8.1/conf
>>>
>>>
>>> xiufeng liu  于2019年6月11日周二 下午6:03写道：
>>>
>>>> Sorry, please skip my previous email. I have sent you the wrong one.
>>>> Please look at this log: https://pastebin.com/Ma7CDHtW
>>>>
>>>> /Xiufeng
>>>>
>>>> On Tue, Jun 11, 2019 at 11:57 AM xiufeng liu 
>>>> wrote:
>>>>
>>>>> Thanks! here is the log: https://pastebin.com/LWZvBiT5
>>>>>
>>>>> /Xiufeng
>>>>>
>>>>> On Tue, Jun 11, 2019 at 11:15 AM Jeff Zhang  wrote:
>>>>>
>>>>>> It looks like in the second try zeppelin can start properly, but hit
>>>>>> this exception later.
>>>>>> Could you paste the full stacktrace ?
>>>>>>
>>>>>> xiufeng liu  于2019年6月11日周二 下午2:56写道：
>>>>>>
>>>>>>> Sorry! Here is the link:
>>>>>>> https://drive.google.com/open?id=1iGpGXGPP6C2PehQs-glAUkNZNg_tWldl
>>>>>>> /Xiufeng
>>>>>>>
>>>>>>> On Tue, Jun 11, 2019 at 6:21 AM Jeff Zhang  wrote:
>>>>>>>
>>>>>>>> Wrong link ?
>>>>>>>>
>>>>>>>> xiufeng liu  于2019年6月11日周二 上午12:26写道：
>>>>>>>>
>>>>>>>>> Dear Jeff,
>>>>>>>>>
>>>>>>>>> Thanks for your suggestion.
>>>>>>>>> I have tried this, but it still doesn't work. I have recorded a
>>>>>>>>> video. You could see my problem:
>>>>>>>>> https://vimeo.com/user23880238/review/341376478/57ca43dfb8
>>>>>>>>>
>>>>>>>>> /Xiufeng
>>>>>>>>>
>>>>>>>>> On Mon, Jun 10, 2019 at 3:30 AM Jeff Zhang 
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> This is probably due to your old interpreter.json file under
>>>>>>>>>> ZEPPELIN_CONF_DIR.
>>>>>>>>>> You can first stop zeppelin, then delete interpreter.json and
>>>>>>>>>> restart zeppelin.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> xiufeng liu  于2019年6月10日周一 上午6:02写道：
>>>>>>>>>>
>>>>>>>>>>> Thanks!
>>>>>>>>>>> But, but the prebuilt binary packages of 0.8.0 and 0,8.1 were
>>>>>>>>>>> both using the hk2-locator-2.5.0-b32.jar. It doesn't work, but I 
>>>>>>>>>>> didn't try
>>>>>>>>>>> to build from the source codes.
>>>>>>>>>>>
>>>>>>>>>>> /xiuli
>>>>>>>>>>>
>>>>>>>>>>> On Sun, Jun 9, 2019 at 4:59 AM Xun Liu  wrote:
>>>>>>>>>>>
>>>>>>>>>>>> hi, xiufeng
>>>>>>>>>>>>
>>>>>>>>>>>> I checked it.
>>>>>>>>>>>> This problem is org.jvnet.hk2 using gson for List, The problem
>>>>>>>>>>>> triggered by the paradigm shift.
>>>>>&g

Re: Failed to start Zeppelin

2019-06-11 Thread xiufeng liu

Thanks. I removed the lib of Hive and Hadoop from the classpath, and
restart again. But, this time, I got the following error:
HTTP ERROR 503
Problem accessing /. Reason:
Service Unavailable

see the log: https://pastebin.com/HTRmKkuq

/Xiufeng

On Tue, Jun 11, 2019 at 12:09 PM Jeff Zhang  wrote:

> I notice you also put hadoop and hive lib under zeppelin's classpath, it
> might conflict with zeppelin's lib. Any reason why you need to put hadoop
> and hive under zeppelin's classpath ?
>
> ZEPPELIN_CLASSPATH:
> ::/opt/hadoop/lib/*:.:/opt/hive/lib/*:.:/opt/zeppelin_0.8.1/lib/interpreter/*:/opt/zeppelin_0.8.1/lib/*:/opt/zeppelin_0.8.1/*::/opt/zeppelin_0.8.1/conf
>
>
> xiufeng liu  于2019年6月11日周二 下午6:03写道：
>
>> Sorry, please skip my previous email. I have sent you the wrong one.
>> Please look at this log: https://pastebin.com/Ma7CDHtW
>>
>> /Xiufeng
>>
>> On Tue, Jun 11, 2019 at 11:57 AM xiufeng liu  wrote:
>>
>>> Thanks! here is the log: https://pastebin.com/LWZvBiT5
>>>
>>> /Xiufeng
>>>
>>> On Tue, Jun 11, 2019 at 11:15 AM Jeff Zhang  wrote:
>>>
>>>> It looks like in the second try zeppelin can start properly, but hit
>>>> this exception later.
>>>> Could you paste the full stacktrace ?
>>>>
>>>> xiufeng liu  于2019年6月11日周二 下午2:56写道：
>>>>
>>>>> Sorry! Here is the link:
>>>>> https://drive.google.com/open?id=1iGpGXGPP6C2PehQs-glAUkNZNg_tWldl
>>>>> /Xiufeng
>>>>>
>>>>> On Tue, Jun 11, 2019 at 6:21 AM Jeff Zhang  wrote:
>>>>>
>>>>>> Wrong link ?
>>>>>>
>>>>>> xiufeng liu  于2019年6月11日周二 上午12:26写道：
>>>>>>
>>>>>>> Dear Jeff,
>>>>>>>
>>>>>>> Thanks for your suggestion.
>>>>>>> I have tried this, but it still doesn't work. I have recorded a
>>>>>>> video. You could see my problem:
>>>>>>> https://vimeo.com/user23880238/review/341376478/57ca43dfb8
>>>>>>>
>>>>>>> /Xiufeng
>>>>>>>
>>>>>>> On Mon, Jun 10, 2019 at 3:30 AM Jeff Zhang  wrote:
>>>>>>>
>>>>>>>> This is probably due to your old interpreter.json file under
>>>>>>>> ZEPPELIN_CONF_DIR.
>>>>>>>> You can first stop zeppelin, then delete interpreter.json and
>>>>>>>> restart zeppelin.
>>>>>>>>
>>>>>>>>
>>>>>>>> xiufeng liu  于2019年6月10日周一 上午6:02写道：
>>>>>>>>
>>>>>>>>> Thanks!
>>>>>>>>> But, but the prebuilt binary packages of 0.8.0 and 0,8.1 were both
>>>>>>>>> using the hk2-locator-2.5.0-b32.jar. It doesn't work, but I didn't 
>>>>>>>>> try to
>>>>>>>>> build from the source codes.
>>>>>>>>>
>>>>>>>>> /xiuli
>>>>>>>>>
>>>>>>>>> On Sun, Jun 9, 2019 at 4:59 AM Xun Liu  wrote:
>>>>>>>>>
>>>>>>>>>> hi, xiufeng
>>>>>>>>>>
>>>>>>>>>> I checked it.
>>>>>>>>>> This problem is org.jvnet.hk2 using gson for List, The problem
>>>>>>>>>> triggered by the paradigm shift.
>>>>>>>>>>
>>>>>>>>>> org.glassfish.hk2.api.MultiException: A MultiException has 1
>>>>>>>>>> exceptions.  They are:
>>>>>>>>>> 1. java.lang.RuntimeException: Can not convert this type of
>>>>>>>>>> property: class com.google.gson.internal.LinkedTreeMap
>>>>>>>>>>
>>>>>>>>>> at
>>>>>>>>>> org.jvnet.hk2.internal.Utilities.justCreate(Utilities.java:1009) ~[
>>>>>>>>>> hk2-locator-2.5.0-b32.jar:?]
>>>>>>>>>> at
>>>>>>>>>> org.jvnet.hk2.internal.ServiceLocatorImpl.create(ServiceLocatorImpl.java:975)
>>>>>>>>>> ~[hk2-locator-2.5.0-b32.jar:?]
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> I am using zeppelin 0.8.0 without this problem.
>>>>>>&g

Re: Failed to start Zeppelin

2019-06-10 Thread xiufeng liu

Sorry! Here is the link:
https://drive.google.com/open?id=1iGpGXGPP6C2PehQs-glAUkNZNg_tWldl
/Xiufeng

On Tue, Jun 11, 2019 at 6:21 AM Jeff Zhang  wrote:

> Wrong link ?
>
> xiufeng liu  于2019年6月11日周二 上午12:26写道：
>
>> Dear Jeff,
>>
>> Thanks for your suggestion.
>> I have tried this, but it still doesn't work. I have recorded a video.
>> You could see my problem:
>> https://vimeo.com/user23880238/review/341376478/57ca43dfb8
>>
>> /Xiufeng
>>
>> On Mon, Jun 10, 2019 at 3:30 AM Jeff Zhang  wrote:
>>
>>> This is probably due to your old interpreter.json file under
>>> ZEPPELIN_CONF_DIR.
>>> You can first stop zeppelin, then delete interpreter.json and restart
>>> zeppelin.
>>>
>>>
>>> xiufeng liu  于2019年6月10日周一 上午6:02写道：
>>>
>>>> Thanks!
>>>> But, but the prebuilt binary packages of 0.8.0 and 0,8.1 were both
>>>> using the hk2-locator-2.5.0-b32.jar. It doesn't work, but I didn't try to
>>>> build from the source codes.
>>>>
>>>> /xiuli
>>>>
>>>> On Sun, Jun 9, 2019 at 4:59 AM Xun Liu  wrote:
>>>>
>>>>> hi, xiufeng
>>>>>
>>>>> I checked it.
>>>>> This problem is org.jvnet.hk2 using gson for List, The problem
>>>>> triggered by the paradigm shift.
>>>>>
>>>>> org.glassfish.hk2.api.MultiException: A MultiException has 1
>>>>> exceptions.  They are:
>>>>> 1. java.lang.RuntimeException: Can not convert this type of property:
>>>>> class com.google.gson.internal.LinkedTreeMap
>>>>>
>>>>> at org.jvnet.hk2.internal.Utilities.justCreate(Utilities.java:1009) ~[
>>>>> hk2-locator-2.5.0-b32.jar:?]
>>>>> at
>>>>> org.jvnet.hk2.internal.ServiceLocatorImpl.create(ServiceLocatorImpl.java:975)
>>>>> ~[hk2-locator-2.5.0-b32.jar:?]
>>>>>
>>>>>
>>>>> I am using zeppelin 0.8.0 without this problem.
>>>>>
>>>>> You can change to my hk version, try it.
>>>>>
>>>>> ~/zeppelin-current$ find . -name "hk2-*"
>>>>> ./interpreter/lens/hk2-utils-2.2.0-b14.jar
>>>>> ./interpreter/lens/hk2-api-2.2.0-b14.jar
>>>>> ./interpreter/lens/hk2-locator-2.2.0-b14.jar
>>>>> ./interpreter/file/hk2-api-2.4.0-b34.jar
>>>>> ./interpreter/file/hk2-utils-2.4.0-b34.jar
>>>>> ./interpreter/file/hk2-locator-2.4.0-b34.jar
>>>>> ./lib/hk2-api-2.4.0-b34.jar
>>>>> ./lib/hk2-utils-2.4.0-b34.jar
>>>>> ./lib/hk2-locator-2.4.0-b34.jar
>>>>>
>>>>>
>>>>>
>>>>> On Jun 9, 2019, at 4:54 AM, xiufeng liu  wrote:
>>>>>
>>>>> Dear all,
>>>>>
>>>>> I failed to start zeppelin server, and got the following message.
>>>>> On the web page:
>>>>> HTTP ERROR: 503
>>>>>
>>>>> Problem accessing /. Reason:
>>>>>
>>>>> Service Unavailable
>>>>>
>>>>>
>>>>> --
>>>>> Powered by Jetty:// 9.3.20.v20170531 <http://eclipse.org/jetty>
>>>>>
>>>>>
>>>>> In the log file:
>>>>>
>>>>> xiuli@man-sc01:/opt/zeppelin/logs$ cat zeppelin-xiuli-man-sc01.out
>>>>> ZEPPELIN_CLASSPATH:
>>>>> ::/opt/hadoop/lib/*:.:/opt/hive/lib/*:.:/opt/zeppelin/lib/interpreter/*:/opt/zeppelin/lib/*:/opt/zeppelin/*::/opt/zeppelin/conf
>>>>> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
>>>>> MaxPermSize=512m; support was removed in 8.0
>>>>> SLF4J: Class path contains multiple SLF4J bindings.
>>>>> SLF4J: Found binding in
>>>>> [jar:file:/opt/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>>>>> SLF4J: Found binding in
>>>>> [jar:file:/opt/zeppelin/lib/interpreter/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>>>>> SLF4J: Found binding in
>>>>> [jar:file:/opt/zeppelin/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>>>>> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
>>>>> explanation.
>>>>> SLF4J: Actual binding is of type
>>>>> [org.apache.logging.slf4j.Log4jLoggerFactory]

Re: Failed to start Zeppelin

2019-06-10 Thread xiufeng liu

Dear Jeff,

Thanks for your suggestion.
I have tried this, but it still doesn't work. I have recorded a video. You
could see my problem:
https://vimeo.com/user23880238/review/341376478/57ca43dfb8

/Xiufeng

On Mon, Jun 10, 2019 at 3:30 AM Jeff Zhang  wrote:

> This is probably due to your old interpreter.json file under
> ZEPPELIN_CONF_DIR.
> You can first stop zeppelin, then delete interpreter.json and restart
> zeppelin.
>
>
> xiufeng liu  于2019年6月10日周一 上午6:02写道：
>
>> Thanks!
>> But, but the prebuilt binary packages of 0.8.0 and 0,8.1 were both using
>> the hk2-locator-2.5.0-b32.jar. It doesn't work, but I didn't try to build
>> from the source codes.
>>
>> /xiuli
>>
>> On Sun, Jun 9, 2019 at 4:59 AM Xun Liu  wrote:
>>
>>> hi, xiufeng
>>>
>>> I checked it.
>>> This problem is org.jvnet.hk2 using gson for List, The problem triggered
>>> by the paradigm shift.
>>>
>>> org.glassfish.hk2.api.MultiException: A MultiException has 1
>>> exceptions.  They are:
>>> 1. java.lang.RuntimeException: Can not convert this type of property:
>>> class com.google.gson.internal.LinkedTreeMap
>>>
>>> at org.jvnet.hk2.internal.Utilities.justCreate(Utilities.java:1009) ~[
>>> hk2-locator-2.5.0-b32.jar:?]
>>> at
>>> org.jvnet.hk2.internal.ServiceLocatorImpl.create(ServiceLocatorImpl.java:975)
>>> ~[hk2-locator-2.5.0-b32.jar:?]
>>>
>>>
>>> I am using zeppelin 0.8.0 without this problem.
>>>
>>> You can change to my hk version, try it.
>>>
>>> ~/zeppelin-current$ find . -name "hk2-*"
>>> ./interpreter/lens/hk2-utils-2.2.0-b14.jar
>>> ./interpreter/lens/hk2-api-2.2.0-b14.jar
>>> ./interpreter/lens/hk2-locator-2.2.0-b14.jar
>>> ./interpreter/file/hk2-api-2.4.0-b34.jar
>>> ./interpreter/file/hk2-utils-2.4.0-b34.jar
>>> ./interpreter/file/hk2-locator-2.4.0-b34.jar
>>> ./lib/hk2-api-2.4.0-b34.jar
>>> ./lib/hk2-utils-2.4.0-b34.jar
>>> ./lib/hk2-locator-2.4.0-b34.jar
>>>
>>>
>>>
>>> On Jun 9, 2019, at 4:54 AM, xiufeng liu  wrote:
>>>
>>> Dear all,
>>>
>>> I failed to start zeppelin server, and got the following message.
>>> On the web page:
>>> HTTP ERROR: 503
>>>
>>> Problem accessing /. Reason:
>>>
>>> Service Unavailable
>>>
>>>
>>> --
>>> Powered by Jetty:// 9.3.20.v20170531 <http://eclipse.org/jetty>
>>>
>>>
>>> In the log file:
>>>
>>> xiuli@man-sc01:/opt/zeppelin/logs$ cat zeppelin-xiuli-man-sc01.out
>>> ZEPPELIN_CLASSPATH:
>>> ::/opt/hadoop/lib/*:.:/opt/hive/lib/*:.:/opt/zeppelin/lib/interpreter/*:/opt/zeppelin/lib/*:/opt/zeppelin/*::/opt/zeppelin/conf
>>> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
>>> MaxPermSize=512m; support was removed in 8.0
>>> SLF4J: Class path contains multiple SLF4J bindings.
>>> SLF4J: Found binding in
>>> [jar:file:/opt/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>>> SLF4J: Found binding in
>>> [jar:file:/opt/zeppelin/lib/interpreter/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>>> SLF4J: Found binding in
>>> [jar:file:/opt/zeppelin/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>>> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
>>> explanation.
>>> SLF4J: Actual binding is of type
>>> [org.apache.logging.slf4j.Log4jLoggerFactory]
>>> 2019-06-08T20:49:26,757 INFO [main]
>>> org.apache.zeppelin.conf.ZeppelinConfiguration - Load configuration from
>>> file:/opt/zeppelin/conf/zeppelin-site.xml
>>> 2019-06-08T20:49:26,797 INFO [main]
>>> org.apache.zeppelin.conf.ZeppelinConfiguration - Server Host: 0.0.0.0
>>> 2019-06-08T20:49:26,797 INFO [main]
>>> org.apache.zeppelin.conf.ZeppelinConfiguration - Server Port: 8080
>>> 2019-06-08T20:49:26,797 INFO [main]
>>> org.apache.zeppelin.conf.ZeppelinConfiguration - Context Path: /
>>> 2019-06-08T20:49:26,799 INFO [main]
>>> org.apache.zeppelin.conf.ZeppelinConfiguration - Zeppelin Version: 0.8.1
>>> 2019-06-08T20:49:26,814 INFO [main] org.eclipse.jetty.util.log - Logging
>>> initialized @876ms
>>> 2019-06-08T20:49:26,937 INFO [main]
>>> org.apache.zeppelin.server.ZeppelinServer - ZeppelinServer Webapp path:
>>> /opt/zeppelin/webapps
>>> 20

Re: Failed to start Zeppelin

2019-06-09 Thread xiufeng liu

Thanks!
But, but the prebuilt binary packages of 0.8.0 and 0,8.1 were both using
the hk2-locator-2.5.0-b32.jar. It doesn't work, but I didn't try to build
from the source codes.

/xiuli

On Sun, Jun 9, 2019 at 4:59 AM Xun Liu  wrote:

> hi, xiufeng
>
> I checked it.
> This problem is org.jvnet.hk2 using gson for List, The problem triggered
> by the paradigm shift.
>
> org.glassfish.hk2.api.MultiException: A MultiException has 1 exceptions.
> They are:
> 1. java.lang.RuntimeException: Can not convert this type of property:
> class com.google.gson.internal.LinkedTreeMap
>
> at org.jvnet.hk2.internal.Utilities.justCreate(Utilities.java:1009) ~[
> hk2-locator-2.5.0-b32.jar:?]
> at
> org.jvnet.hk2.internal.ServiceLocatorImpl.create(ServiceLocatorImpl.java:975)
> ~[hk2-locator-2.5.0-b32.jar:?]
>
>
> I am using zeppelin 0.8.0 without this problem.
>
> You can change to my hk version, try it.
>
> ~/zeppelin-current$ find . -name "hk2-*"
> ./interpreter/lens/hk2-utils-2.2.0-b14.jar
> ./interpreter/lens/hk2-api-2.2.0-b14.jar
> ./interpreter/lens/hk2-locator-2.2.0-b14.jar
> ./interpreter/file/hk2-api-2.4.0-b34.jar
> ./interpreter/file/hk2-utils-2.4.0-b34.jar
> ./interpreter/file/hk2-locator-2.4.0-b34.jar
> ./lib/hk2-api-2.4.0-b34.jar
> ./lib/hk2-utils-2.4.0-b34.jar
> ./lib/hk2-locator-2.4.0-b34.jar
>
>
>
> On Jun 9, 2019, at 4:54 AM, xiufeng liu  wrote:
>
> Dear all,
>
> I failed to start zeppelin server, and got the following message.
> On the web page:
> HTTP ERROR: 503
>
> Problem accessing /. Reason:
>
> Service Unavailable
>
>
> --
> Powered by Jetty:// 9.3.20.v20170531 <http://eclipse.org/jetty>
>
>
> In the log file:
>
> xiuli@man-sc01:/opt/zeppelin/logs$ cat zeppelin-xiuli-man-sc01.out
> ZEPPELIN_CLASSPATH:
> ::/opt/hadoop/lib/*:.:/opt/hive/lib/*:.:/opt/zeppelin/lib/interpreter/*:/opt/zeppelin/lib/*:/opt/zeppelin/*::/opt/zeppelin/conf
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=512m; support was removed in 8.0
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in
> [jar:file:/opt/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/opt/zeppelin/lib/interpreter/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/opt/zeppelin/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> explanation.
> SLF4J: Actual binding is of type
> [org.apache.logging.slf4j.Log4jLoggerFactory]
> 2019-06-08T20:49:26,757 INFO [main]
> org.apache.zeppelin.conf.ZeppelinConfiguration - Load configuration from
> file:/opt/zeppelin/conf/zeppelin-site.xml
> 2019-06-08T20:49:26,797 INFO [main]
> org.apache.zeppelin.conf.ZeppelinConfiguration - Server Host: 0.0.0.0
> 2019-06-08T20:49:26,797 INFO [main]
> org.apache.zeppelin.conf.ZeppelinConfiguration - Server Port: 8080
> 2019-06-08T20:49:26,797 INFO [main]
> org.apache.zeppelin.conf.ZeppelinConfiguration - Context Path: /
> 2019-06-08T20:49:26,799 INFO [main]
> org.apache.zeppelin.conf.ZeppelinConfiguration - Zeppelin Version: 0.8.1
> 2019-06-08T20:49:26,814 INFO [main] org.eclipse.jetty.util.log - Logging
> initialized @876ms
> 2019-06-08T20:49:26,937 INFO [main]
> org.apache.zeppelin.server.ZeppelinServer - ZeppelinServer Webapp path:
> /opt/zeppelin/webapps
> 2019-06-08T20:49:27,024 INFO [main]
> org.apache.zeppelin.server.ZeppelinServer - Starting zeppelin server
> 2019-06-08T20:49:27,025 INFO [main] org.eclipse.jetty.server.Server -
> jetty-9.3.20.v20170531
> 2019-06-08T20:49:28,822 INFO [main] / - Initializing Shiro environment
> 2019-06-08T20:49:28,822 INFO [main]
> org.apache.shiro.web.env.EnvironmentLoader - Starting Shiro environment
> initialization.
> 2019-06-08T20:49:29,206 INFO [main]
> org.apache.shiro.web.env.EnvironmentLoader - Shiro environment initialized
> in 384 ms.
> 2019-06-08T20:49:29,468 INFO [main]
> org.apache.zeppelin.scheduler.SchedulerFactory - Scheduler Thread Pool
> Size: 100
> 2019-06-08T20:49:29,480 WARN [main]
> org.apache.zeppelin.conf.ZeppelinConfiguration - zeppelin.config.fs.dir is
> not specified, fall back to local conf directory zeppelin.conf.dir
> 2019-06-08T20:49:29,480 WARN [main]
> org.apache.zeppelin.conf.ZeppelinConfiguration - zeppelin.config.fs.dir is
> not specified, fall back to local conf directory zeppelin.conf.dir
> 2019-06-08T20:49:29,584 INFO [main]
> org.apache.zeppelin.interpreter.InterpreterSettingManager - Using
> RecoveryStorage:
> org.apache.zeppelin.interpreter.recovery.NullRecoverySto

Failed to start Zeppelin

2019-06-08 Thread xiufeng liu

Dear all,

I failed to start zeppelin server, and got the following message.
On the web page:
HTTP ERROR: 503

Problem accessing /. Reason:

Service Unavailable

--
Powered by Jetty:// 9.3.20.v20170531 


In the log file:

xiuli@man-sc01:/opt/zeppelin/logs$ cat zeppelin-xiuli-man-sc01.out
ZEPPELIN_CLASSPATH:
::/opt/hadoop/lib/*:.:/opt/hive/lib/*:.:/opt/zeppelin/lib/interpreter/*:/opt/zeppelin/lib/*:/opt/zeppelin/*::/opt/zeppelin/conf
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
MaxPermSize=512m; support was removed in 8.0
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/opt/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/opt/zeppelin/lib/interpreter/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/opt/zeppelin/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
explanation.
SLF4J: Actual binding is of type
[org.apache.logging.slf4j.Log4jLoggerFactory]
2019-06-08T20:49:26,757 INFO [main]
org.apache.zeppelin.conf.ZeppelinConfiguration - Load configuration from
file:/opt/zeppelin/conf/zeppelin-site.xml
2019-06-08T20:49:26,797 INFO [main]
org.apache.zeppelin.conf.ZeppelinConfiguration - Server Host: 0.0.0.0
2019-06-08T20:49:26,797 INFO [main]
org.apache.zeppelin.conf.ZeppelinConfiguration - Server Port: 8080
2019-06-08T20:49:26,797 INFO [main]
org.apache.zeppelin.conf.ZeppelinConfiguration - Context Path: /
2019-06-08T20:49:26,799 INFO [main]
org.apache.zeppelin.conf.ZeppelinConfiguration - Zeppelin Version: 0.8.1
2019-06-08T20:49:26,814 INFO [main] org.eclipse.jetty.util.log - Logging
initialized @876ms
2019-06-08T20:49:26,937 INFO [main]
org.apache.zeppelin.server.ZeppelinServer - ZeppelinServer Webapp path:
/opt/zeppelin/webapps
2019-06-08T20:49:27,024 INFO [main]
org.apache.zeppelin.server.ZeppelinServer - Starting zeppelin server
2019-06-08T20:49:27,025 INFO [main] org.eclipse.jetty.server.Server -
jetty-9.3.20.v20170531
2019-06-08T20:49:28,822 INFO [main] / - Initializing Shiro environment
2019-06-08T20:49:28,822 INFO [main]
org.apache.shiro.web.env.EnvironmentLoader - Starting Shiro environment
initialization.
2019-06-08T20:49:29,206 INFO [main]
org.apache.shiro.web.env.EnvironmentLoader - Shiro environment initialized
in 384 ms.
2019-06-08T20:49:29,468 INFO [main]
org.apache.zeppelin.scheduler.SchedulerFactory - Scheduler Thread Pool
Size: 100
2019-06-08T20:49:29,480 WARN [main]
org.apache.zeppelin.conf.ZeppelinConfiguration - zeppelin.config.fs.dir is
not specified, fall back to local conf directory zeppelin.conf.dir
2019-06-08T20:49:29,480 WARN [main]
org.apache.zeppelin.conf.ZeppelinConfiguration - zeppelin.config.fs.dir is
not specified, fall back to local conf directory zeppelin.conf.dir
2019-06-08T20:49:29,584 INFO [main]
org.apache.zeppelin.interpreter.InterpreterSettingManager - Using
RecoveryStorage:
org.apache.zeppelin.interpreter.recovery.NullRecoveryStorage
2019-06-08T20:49:29,585 INFO [main]
org.apache.zeppelin.interpreter.InterpreterSettingManager - Using
LifecycleManager:
org.apache.zeppelin.interpreter.lifecycle.NullLifecycleManager
2019-06-08T20:49:29,617 INFO [main]
org.apache.zeppelin.interpreter.InterpreterSettingManager - Register
InterpreterSettingTemplate: flink
2019-06-08T20:49:29,623 INFO [main]
org.apache.zeppelin.interpreter.InterpreterSettingManager - Register
InterpreterSettingTemplate: ignite
2019-06-08T20:49:29,627 INFO [main]
org.apache.zeppelin.interpreter.InterpreterSettingManager - Register
InterpreterSettingTemplate: alluxio
2019-06-08T20:49:29,632 WARN [main]
org.apache.zeppelin.interpreter.InterpreterSettingManager - No
interpreter-setting.json found in /opt/zeppelin/interpreter/lib
2019-06-08T20:49:29,636 INFO [main]
org.apache.zeppelin.interpreter.InterpreterSettingManager - Register
InterpreterSettingTemplate: elasticsearch
2019-06-08T20:49:29,639 INFO [main]
org.apache.zeppelin.interpreter.InterpreterSettingManager - Register
InterpreterSettingTemplate: md
2019-06-08T20:49:29,642 INFO [main]
org.apache.zeppelin.interpreter.InterpreterSettingManager - Register
InterpreterSettingTemplate: sap
2019-06-08T20:49:29,644 INFO [main]
org.apache.zeppelin.interpreter.InterpreterSettingManager - Register
InterpreterSettingTemplate: groovy
2019-06-08T20:49:29,647 INFO [main]
org.apache.zeppelin.interpreter.InterpreterSettingManager - Register
InterpreterSettingTemplate: python
2019-06-08T20:49:29,650 INFO [main]
org.apache.zeppelin.interpreter.InterpreterSettingManager - Register
InterpreterSettingTemplate: cassandra
2019-06-08T20:49:29,654 INFO [main]
org.apache.zeppelin.interpreter.InterpreterSettingManager - Register
InterpreterSettingTemplate: neo4j
2019-06-08T20:49:29,657 INFO [main]
org.apache.zeppelin.interpreter.InterpreterSettingManager - Register
Interp

Re: Order of paragraphs vs. different interpreters (spark vs. pyspark)

2016-07-13 Thread xiufeng liu

It is easy to change the code. I did myself and use it as an ETL tool. It
is very powerful

Afancy

On Wednesday, July 13, 2016, Ahmed Sobhi  wrote:

> I think this pr addresses what I need. Case 2 seem to describe the issue
> I'm having if I'm reading it correctly.
>
> The proposed solution, however, is not that clear to me.
>
> Is it that you define workflows where a work flow is a sequence of
> (notebook, paragraph) pairs that are to be run in a specific order?
> If that's the case, then this definitely solves my problem, but it's
> really cumbersome from a usability point of view. I think a better solution
> for my use case is to just have an option to run all paragraphs in the
> order they appear in on the notebook, regardless of which interpreter they
> use.
>
> On Wed, Jul 13, 2016 at 12:31 PM, Hyung Sung Shim  > wrote:
>
>> hi.
>> Maybe https://github.com/apache/zeppelin/pull/1176 is related what you
>> want.
>> Please check this pr.
>>
>> 2016년 7월 13일 수요일, xiufeng liu> >님이 작성한 메시지:
>>
>> You have to change the source codes to add the dependencies of running
>>> paragraphs. I think it is a really interesting feature, for example, it can
>>> be use as an ETL tool. But, unfortunately, there is no configuration option
>>> right now.
>>>
>>> /afancy
>>>
>>> On Wed, Jul 13, 2016 at 12:27 PM, Ahmed Sobhi 
>>> wrote:
>>>
>>>> Hello,
>>>>
>>>> I have been working on a large Spark Scala notebook. I recently had the
>>>> requirement to produce graphs/plots out of these data. Python and PySpark
>>>> seemed like a natural fit but since I've already invested a lot of time and
>>>> effort into the Scala version, I want to restrict my usage of python to
>>>> just plotting.
>>>>
>>>> I found a good workflow for where in the scala paragraphs I can use 
>>>> *registerTempTable
>>>> *and in python I can just use *sqlContext.table *to retrieve that
>>>> table.
>>>>
>>>> The problem now is that if I try to run all paragraphs to get the
>>>> notebook updated, the python paragraphs fail because they are running
>>>> before the scala ones eventhough they are placed after them.
>>>>
>>>> It seems like the behavior in Zeppelin is that it attempts to run the
>>>> paragraphs concurrently if they were running on different interpreters
>>>> which might seem fine on the surface. But now that I want to introduce some
>>>> dependency between spark/pyspark paragraphs, is there any way to do that?
>>>>
>>>> --
>>>> Cheers,
>>>> Ahmed
>>>>
>>>
>>>
>
>
> --
> Cheers,
> Ahmed
> http://bit.ly/ahmed_abtme <http://about.me/humanzz>
>

Re: Order of paragraphs vs. different interpreters (spark vs. pyspark)

2016-07-13 Thread xiufeng liu

You have to change the source codes to add the dependencies of running
paragraphs. I think it is a really interesting feature, for example, it can
be use as an ETL tool. But, unfortunately, there is no configuration option
right now.

/afancy

On Wed, Jul 13, 2016 at 12:27 PM, Ahmed Sobhi  wrote:

> Hello,
>
> I have been working on a large Spark Scala notebook. I recently had the
> requirement to produce graphs/plots out of these data. Python and PySpark
> seemed like a natural fit but since I've already invested a lot of time and
> effort into the Scala version, I want to restrict my usage of python to
> just plotting.
>
> I found a good workflow for where in the scala paragraphs I can use 
> *registerTempTable
> *and in python I can just use *sqlContext.table *to retrieve that table.
>
> The problem now is that if I try to run all paragraphs to get the notebook
> updated, the python paragraphs fail because they are running before the
> scala ones eventhough they are placed after them.
>
> It seems like the behavior in Zeppelin is that it attempts to run the
> paragraphs concurrently if they were running on different interpreters
> which might seem fine on the surface. But now that I want to introduce some
> dependency between spark/pyspark paragraphs, is there any way to do that?
>
> --
> Cheers,
> Ahmed
>

Re: Compile error

Re: Compile error

Re: Compile error

Re: Compile error

Re: Compile error

Re: Compile error

Re: Compile error

Re: Editing files on filesystem from Zeppelin?

Re: Failed to start Zeppelin

Re: Failed to start Zeppelin

Re: Failed to start Zeppelin

Re: Failed to start Zeppelin

Re: Failed to start Zeppelin

Failed to start Zeppelin

Re: Order of paragraphs vs. different interpreters (spark vs. pyspark)

Re: Order of paragraphs vs. different interpreters (spark vs. pyspark)

16 matches

Site Navigation

Mail list logo

Footer information