Re: Unmodifiable interpreter properties

2018-03-04 Thread Karan Sewani 
Well


You can take away interpreter editing rights from user altogether.


This feature would be there in zeppelin 0.8.0, for 0.7.3 you can apply 
following patch and build it from source.


https://github.com/apache/zeppelin/pull/2526/files


Best

Karan


From: Jhon Anderson Cardenas Diaz 
Sent: Friday, March 2, 2018 9:51:54 PM
To: d...@zeppelin.apache.org; users@zeppelin.apache.org
Subject: Unmodifiable interpreter properties

Hi fellow Zeppelin users.

I would like to know if is there a way in zeppelin to set interpreter 
properties that can not be changed by the user from the graphic interface.

An example use case in which this can be useful is if we want that zeppelin 
users can not kill jobs from the spark ui; for this you must modify the 
property "spark.ui.killEnabled" with value FALSE. The problem is that the user 
can change this property from the interpreter screen and enable the feature 
again.

I am wondering if maybe is there some attribute in the properties registered in 
interpreter-setting.json that makes that property readonly (for end user) or 
something like that.

Thank you in advance!.

Re: Thrift server for call back will start. Port:

2018-03-04 Thread Jeff Zhang 
Could you check the interpreter log ? The issue of not be able to
connecting to thrift port could happen due to network issue, like firewall
or you use VPN, etc.



小野圭二 于2018年3月5日周一 下午12:32写道：

> Hi,
>
> I show the all log on this error.There are 2 type error. The 1 is at the
> first run. The 2 is at the second run. Seems like could not established to
> Thrift callback port 51348 that was set at the first run.
> First of all, does it need to establish the callback port of Thrift
> server?
> The notebook script was just
> %pyspark
> print 'aaa'
> Any advice appreciate.
>
> 1.
> INFO [2018-03-05 13:11:13,914] ({qtp1651855867-13}
> VFSNotebookRepo.java[save]:221) - Saving note:2D6S6TB3U INFO [2018-03-05
> 13:11:13,934] ({pool-2-thread-2} SchedulerFactory.java[jobStarted]:109) -
> Job 20180302-135047_99102973 started by scheduler
> org.apache.zeppelin.interpreter.remote.RemoteInterpreter-shared_session
> INFO [2018-03-05 13:11:13,936] ({pool-2-thread-2}
> Paragraph.java[jobRun]:397) - run paragraph 20180302-135047_99102973 using
> pyspark
> RemoteInterpreter_org.apache.zeppelin.spark.PySparkInterpreter_shared_session
> INFO [2018-03-05 13:11:13,936] ({pool-2-thread-2}
> ManagedInterpreterGroup.java[getOrCreateInterpreterProcess]:57) - Create
> InterperterProcess for InterpreterGroup: 2CV1983WX:shared_process WARN
> [2018-03-05 13:11:14,010] ({pool-2-thread-2}
> InterpreterSetting.java[setupPropertiesForSparkR]:796) - sparkr.zip is not
> found, SparkR may not work. INFO [2018-03-05 13:11:14,017]
> ({pool-2-thread-2} RemoteInterpreterManagedProcess.java[start]:123) -
> Choose port 51347 for RemoteInterpreterProcess INFO [2018-03-05
> 13:11:14,023] ({pool-2-thread-2}
> RemoteInterpreterManagedProcess.java[start]:130) - Thrift server for
> callback will start. Port: 51348 INFO [2018-03-05 13:11:14,049]
> ({pool-2-thread-2} RemoteInterpreterManagedProcess.java[start]:205) - Run
> interpreter process [/Users/onokeiji/zeppelin/zeppelin/bin/interpreter.sh,
> -d, /Users/onokeiji/zeppelin/zeppelin/interpreter/spark, -c, 172.16.20.10,
> -p, 51348, -l, /Users/onokeiji/zeppelin/zeppelin/local-repo/2CV1983WX, -g,
> spark] INFO [2018-03-05 13:11:14,238] ({Exec Default Executor}
> RemoteInterpreterManagedProcess.java[onProcessComplete]:258) - Interpreter
> process exited 0 ERROR [2018-03-05 13:12:14,058] ({pool-2-thread-2}
> Job.java[run]:184) - Job failed
> org.apache.zeppelin.interpreter.InterpreterException: Cannot run
> interpreter at
> org.apache.zeppelin.interpreter.remote.RemoteInterpreterManagedProcess.start(RemoteInterpreterManagedProcess.java:220)
> at
> org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getOrCreateInterpreterProcess(RemoteInterpreter.java:101)
> at
> org.apache.zeppelin.interpreter.remote.RemoteInterpreter.internal_create(RemoteInterpreter.java:153)
> at
> org.apache.zeppelin.interpreter.remote.RemoteInterpreter.open(RemoteInterpreter.java:126)
> at
> org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getFormType(RemoteInterpreter.java:265)
> at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:423) at
> org.apache.zeppelin.scheduler.Job.run(Job.java:182) at
> org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:307)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266) at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748) ERROR [2018-03-05 13:12:14,075]
> ({pool-2-thread-2} NotebookServer.java[afterStatusChange]:2219) - Error
> org.apache.zeppelin.interpreter.InterpreterException: Cannot run
> interpreter at
> org.apache.zeppelin.interpreter.remote.RemoteInterpreterManagedProcess.start(RemoteInterpreterManagedProcess.java:220)
> at
> org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getOrCreateInterpreterProcess(RemoteInterpreter.java:101)
> at
> org.apache.zeppelin.interpreter.remote.RemoteInterpreter.internal_create(RemoteInterpreter.java:153)
> at
> org.apache.zeppelin.interpreter.remote.RemoteInterpreter.open(RemoteInterpreter.java:126)
> at
> org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getFormType(RemoteInterpreter.java:265)
> at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:423) at
> org.apache.zeppelin.scheduler.Job.run(Job.java:182) at
> org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:307)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266) at
>

Re: Thrift server for call back will start. Port:

2018-03-04 Thread 小野圭二 
Hi,

I show the all log on this error.There are 2 type error. The 1 is at the
first run. The 2 is at the second run. Seems like could not established to
Thrift callback port 51348 that was set at the first run.
First of all, does it need to establish the callback port of Thrift
server?
The notebook script was just
%pyspark
print 'aaa'
Any advice appreciate.

1.
INFO [2018-03-05 13:11:13,914] ({qtp1651855867-13}
VFSNotebookRepo.java[save]:221) - Saving note:2D6S6TB3U INFO [2018-03-05
13:11:13,934] ({pool-2-thread-2} SchedulerFactory.java[jobStarted]:109) -
Job 20180302-135047_99102973 started by scheduler
org.apache.zeppelin.interpreter.remote.RemoteInterpreter-shared_session
INFO [2018-03-05 13:11:13,936] ({pool-2-thread-2}
Paragraph.java[jobRun]:397) - run paragraph 20180302-135047_99102973 using
pyspark
RemoteInterpreter_org.apache.zeppelin.spark.PySparkInterpreter_shared_session
INFO [2018-03-05 13:11:13,936] ({pool-2-thread-2}
ManagedInterpreterGroup.java[getOrCreateInterpreterProcess]:57) - Create
InterperterProcess for InterpreterGroup: 2CV1983WX:shared_process WARN
[2018-03-05 13:11:14,010] ({pool-2-thread-2}
InterpreterSetting.java[setupPropertiesForSparkR]:796) - sparkr.zip is not
found, SparkR may not work. INFO [2018-03-05 13:11:14,017]
({pool-2-thread-2} RemoteInterpreterManagedProcess.java[start]:123) -
Choose port 51347 for RemoteInterpreterProcess INFO [2018-03-05
13:11:14,023] ({pool-2-thread-2}
RemoteInterpreterManagedProcess.java[start]:130) - Thrift server for
callback will start. Port: 51348 INFO [2018-03-05 13:11:14,049]
({pool-2-thread-2} RemoteInterpreterManagedProcess.java[start]:205) - Run
interpreter process [/Users/onokeiji/zeppelin/zeppelin/bin/interpreter.sh,
-d, /Users/onokeiji/zeppelin/zeppelin/interpreter/spark, -c, 172.16.20.10,
-p, 51348, -l, /Users/onokeiji/zeppelin/zeppelin/local-repo/2CV1983WX, -g,
spark] INFO [2018-03-05 13:11:14,238] ({Exec Default Executor}
RemoteInterpreterManagedProcess.java[onProcessComplete]:258) - Interpreter
process exited 0 ERROR [2018-03-05 13:12:14,058] ({pool-2-thread-2}
Job.java[run]:184) - Job failed
org.apache.zeppelin.interpreter.InterpreterException: Cannot run
interpreter at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterManagedProcess.start(RemoteInterpreterManagedProcess.java:220)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getOrCreateInterpreterProcess(RemoteInterpreter.java:101)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreter.internal_create(RemoteInterpreter.java:153)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreter.open(RemoteInterpreter.java:126)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getFormType(RemoteInterpreter.java:265)
at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:423) at
org.apache.zeppelin.scheduler.Job.run(Job.java:182) at
org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:307)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266) at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748) ERROR [2018-03-05 13:12:14,075]
({pool-2-thread-2} NotebookServer.java[afterStatusChange]:2219) - Error
org.apache.zeppelin.interpreter.InterpreterException: Cannot run
interpreter at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterManagedProcess.start(RemoteInterpreterManagedProcess.java:220)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getOrCreateInterpreterProcess(RemoteInterpreter.java:101)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreter.internal_create(RemoteInterpreter.java:153)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreter.open(RemoteInterpreter.java:126)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getFormType(RemoteInterpreter.java:265)
at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:423) at
org.apache.zeppelin.scheduler.Job.run(Job.java:182) at
org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:307)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266) at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at