[GitHub] zeppelin issue #2688: [Zeppelin-2571] & [Zeppelin-465] Run paragraphs: from ...
Github user tinkoff-dwh commented on the issue: https://github.com/apache/zeppelin/pull/2688 @Leemoonsoo You're right. The description was not true. The description has been changed. ---
[jira] [Created] (ZEPPELIN-3087) zeppelin 0.6.0 interperter corn Unstable implementation
jjLi created ZEPPELIN-3087: -- Summary: zeppelin 0.6.0 interperter corn Unstable implementation Key: ZEPPELIN-3087 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3087 Project: Zeppelin Issue Type: Bug Components: zeppelin-zengine Affects Versions: 0.6.0 Reporter: jjLi Priority: Blocker notebook corn Unstable implementation，Sometimes can run several times in a row, non-concurrent implementation, shared mode, RemoteInterpreterServer often hung, not hanging instability -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (ZEPPELIN-3086) zeppelin 0.6.0 interperter can't dep jars
jjLi created ZEPPELIN-3086: -- Summary: zeppelin 0.6.0 interperter can't dep jars Key: ZEPPELIN-3086 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3086 Project: Zeppelin Issue Type: Bug Components: zeppelin-zengine Affects Versions: 0.6.0 Reporter: jjLi Priority: Blocker *spark interpreter conf: * %spark , %spark.pyspark , %spark.r , %spark.sql , %spark.dep edit restart remove Option spark.jars /root/extra-jars/tablestore-4.1.0-jar-with-dependencies.jar,/root/extra-jars/mysql-connector-java-5.1.39.jar,/root/extra-jars/emr-core-1.3.1.jar,/root/extra-jars/loghub-client-lib-0.6.5.jar,/root/extra-jars/hadoop-aliyun-2.7.2.jar,/root/extra-jars/emr-sdk_2.10-1.3.1.jar spark.jars.packages com.stratio.datasource:spark-mongodb_2.10:0.11.2 zeppelin.dep.localrepolocal-repo zeppelin.interpreter.localRepo /usr/lib/zeppelin-current/local-repo/2CE818RJ8 *shell:* ll /usr/lib/zeppelin-current/local-repo/2CE818RJ8/ total 0 *notebook run show:* no driver class ... -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[GitHub] zeppelin pull request #2692: ZEPPELIN-3085 Introduce generic ConfInterpreter...
GitHub user zjffdu opened a pull request: https://github.com/apache/zeppelin/pull/2692 ZEPPELIN-3085 Introduce generic ConfInterpreter for more fine-grained control of interpreter setting ### What is this PR for? A few sentences describing the overall goals of the pull request's commits. First time? Check out the contributing guide - https://zeppelin.apache.org/contribution/contributions.html ### What type of PR is it? [Bug Fix | Improvement | Feature | Documentation | Hot Fix | Refactoring] ### Todos * [ ] - Task ### What is the Jira issue? * Open an issue on Jira https://issues.apache.org/jira/browse/ZEPPELIN/ * Put link here, and add [ZEPPELIN-*Jira number*] in PR title, eg. [ZEPPELIN-533] ### How should this be tested? * First time? Setup Travis CI as described on https://zeppelin.apache.org/contribution/contributions.html#continuous-integration * Strongly recommended: add automated unit tests for any new or changed behavior * Outline any manual steps to test the PR here. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? * Is there breaking changes for older versions? * Does this needs documentation? You can merge this pull request into a Git repository by running: $ git pull https://github.com/zjffdu/zeppelin ZEPPELIN-3085 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/2692.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2692 commit aeec35eca0d84df8bc3757878196da0ac372b66d Author: Jeff Zhang Date: 2017-11-12T01:18:41Z ZEPPELIN-3040. Allow to specify portRange for interpreter process thrift service This PR is trying to add new configuration `zeppelin.interpreter.portRange` which control the portRange of interpreter process. This is required by some users for security reason. [Improvement | Feature ] * [ ] - Task * https://issues.apache.org/jira/browse/ZEPPELIN-3040 Manually test. Set zeppelin.interpreter.portRange and launch python interpreter, verify it is in the proper portRange. * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang Closes #2661 from zjffdu/ZEPPELIN-3040 and squashes the following commits: a87c425 [Jeff Zhang] address comments 7e885bd [Jeff Zhang] ZEPPELIN-3040. Allow to specify portRange for interpreter process thrift service commit 3dd6ec62c254f1a9ae9f74df3930f86fa5401b59 Author: Jeff Zhang Date: 2017-11-30T05:56:20Z ZEPPELIN-3085. Introduce generic ConfInterpreter for more fine-grained control of interpreter setting ---
[jira] [Created] (ZEPPELIN-3085) Introduce generic ConfInterpreter for more fine-grained control of interpreter setting
Jeff Zhang created ZEPPELIN-3085: Summary: Introduce generic ConfInterpreter for more fine-grained control of interpreter setting Key: ZEPPELIN-3085 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3085 Project: Zeppelin Issue Type: New Feature Reporter: Jeff Zhang -- This message was sent by Atlassian JIRA (v6.4.14#64029)
Re: [DISCUSS] Change some default settings for avoiding unintended usages
Shell interpreter is a black hole for security, usually we don't recommend or allow user to use shell. We may need to refactor the shell interpreter, running under zeppelin user is too dangerous. Jongyoul Lee 于2017年11月29日周三 下午11:44写道： > Hi, users and dev, > > Recently, I've got an issue about the abnormal usage of some interpreters. > Zeppelin's users can access shell by shell and python interpreters. It > means all users can run or execute what they want even if it harms the > system. Thus I agree that we need to change some default settings to > prevent this kind of abusing situation. Before we proceed to do it, I want > to listen to others' opinions. > > Feel free to reply this email > > Regards, > Jongyoul > > -- > 이종열, Jongyoul Lee, 李宗烈 > http://madeng.net >
[GitHub] zeppelin issue #2637: Add support to run Spark interpreter on a Kubernetes c...
Github user echarles commented on the issue: https://github.com/apache/zeppelin/pull/2637 @matyix I've given a try on you last commit and can not get the additional deps (in settings page) working. I don't see the `spark.jars` property in the generate command (by interpreter.sh): ``` /opt/spark/bin/spark-submit --class org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer --driver-class-path ":/opt/zeppelin/interpreter/spark/*:/opt/zeppelin/lib/interpreter/*::/opt/zeppelin/interpreter/spark/zeppelin-spark_2.11-0.8.0-SNAPSHOT.jar:/etc/hdfs-k8s/conf" --driver-java-options " -Dfile.encoding=UTF-8 -Dlog4j.configuration=file:///opt/zeppelin/conf/log4j.properties -Dzeppelin.log.file=/opt/zeppelin/logs/zeppelin-interpreter---zeppelin-k8s-hdfs-locality-zeppelin-7cd554b49d-dpq2k.log" --master k8s://https://kubernetes:443 --conf spark.cores.max='1' --conf spark.shuffle.service.enabled='false' --conf spark.yarn.dist.archives=/opt/spark/R/lib/sparkr.zip --conf spark.executor.instances='3' --conf spark.sql.catalogImplementation='in-memory' --conf spark.app.name='zeppelin-k8s-spark' --conf spark.executor.memory='1g' --conf spark.master='k8s://https://kubernetes:443' --conf spark.kubernetes.namespace='default' --conf spark.kubernetes.executor.docker.image='datalaye r/spark-k8s-executor:2.2.0-0.5.0' --conf spark.kubernetes.driver.docker.image='datalayer/spark-k8s-driver:2.2.0-0.5.0' --conf spark.kubernetes.initcontainer.docker.image='datalayer/spark-k8s-init:2.2.0-0.5.0' --conf spark.kubernetes.resourceStagingServer.uri='http://10.108.197.6:1' --conf ``` ---
[GitHub] zeppelin issue #2684: [Zeppelin-2572] multiple paragraphs actions
Github user tinkoff-dwh commented on the issue: https://github.com/apache/zeppelin/pull/2684 Ready to review ---
[GitHub] zeppelin issue #2615: [ZEPPELIN-1999][IMPROVEMENT] refactoring replacement c...
Github user tinkoff-dwh commented on the issue: https://github.com/apache/zeppelin/pull/2615 Ready to review ---
[GitHub] zeppelin issue #2556: [Zeppelin-2839] permissions for folders
Github user tinkoff-dwh commented on the issue: https://github.com/apache/zeppelin/pull/2556 Ready to review ---
[GitHub] zeppelin issue #2449: [Zeppelin-2676] recent notes list
Github user tinkoff-dwh commented on the issue: https://github.com/apache/zeppelin/pull/2449 Ready to review ---
[GitHub] zeppelin issue #2442: [ZEPPELIN-2679] JDBC. precode for session
Github user tinkoff-dwh commented on the issue: https://github.com/apache/zeppelin/pull/2442 Ready to review ---
[GitHub] zeppelin issue #2668: ZEPPELIN-3051. Support Interpreter Process Recovery
Github user felixcheung commented on the issue: https://github.com/apache/zeppelin/pull/2668 Yes! ---
[DISCUSS] Change some default settings for avoiding unintended usages
Hi, users and dev, Recently, I've got an issue about the abnormal usage of some interpreters. Zeppelin's users can access shell by shell and python interpreters. It means all users can run or execute what they want even if it harms the system. Thus I agree that we need to change some default settings to prevent this kind of abusing situation. Before we proceed to do it, I want to listen to others' opinions. Feel free to reply this email Regards, Jongyoul -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net
[GitHub] zeppelin pull request #2688: [Zeppelin-2571] & [Zeppelin-465] Run paragraphs...
Github user tinkoff-dwh closed the pull request at: https://github.com/apache/zeppelin/pull/2688 ---
[GitHub] zeppelin pull request #2688: [Zeppelin-2571] & [Zeppelin-465] Run paragraphs...
GitHub user tinkoff-dwh reopened a pull request: https://github.com/apache/zeppelin/pull/2688 [Zeppelin-2571] & [Zeppelin-465] Run paragraphs: from first/current to current/last ### What is this PR for? This pr add the ability to run all paragraphs from the first to the current and from the current to the last. This makes it easier to update the data if changes are made in one of the related paragraphs. ### What type of PR is it? Feature ### What is the Jira issue? [ZEPPELIN-2571](https://issues.apache.org/jira/browse/ZEPPELIN-2571) - (Add a "Run to here" option on paragraphs) [ZEPPELIN-465](https://issues.apache.org/jira/browse/ZEPPELIN-465) - (Capability to run all cells below the current cell) ### How should this be tested? 1. Click on the "Run: from first to this" or "Run: from this to last" in the dropdown menu. Paragraphs from the first/current to the current/last will be started in order. 2. Press the key combination: CTRL + SHIFT + ENTER. A window will appear with the choice of the desired action.  Choose one of two actions. The selected action will be performed. ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no You can merge this pull request into a Git repository by running: $ git pull https://github.com/tinkoff-dwh/zeppelin ZEPPELIN-2571&465 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/2688.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2688 commit bfc38919020643cb143a19aed70bcbe1cde7dc50 Author: tinkoff-dwh Date: 2017-11-27T10:33:01Z [ZEPPELIN-2517]&[ZEPPELIN-465] Run paragraphs from 1st to this. From this to last commit 9fbcdb6d24f9a72b000a06d5e8020ee121309060 Author: tinkoff-dwh Date: 2017-11-27T11:38:15Z [ZEPPELIN-2517]&[ZEPPELIN-465] add keyboard shortcut commit a7a415847158efad03bac57cc31d418a2c0115ee Author: tinkoff-dwh Date: 2017-11-28T10:29:34Z [ZEPPELIN-2517]&[ZEPPELIN-465] logic change commit 8ca1df207ad7cb5157bd4e314e34bf56568ca116 Author: tinkoff-dwh Date: 2017-11-28T12:19:00Z [Zeppelin-2517]&[Zeppelin-465] line reduction commit 70f130cea38d34e304302451bec4ab916fff481c Author: tinkoff-dwh Date: 2017-11-28T14:33:36Z [Zeppelin-2517]&[Zeppelin-465] some text change commit 3d57b3038a6791c7038ed72ddaa57d6da6dc9c98 Author: tinkoff-dwh Date: 2017-11-29T12:18:38Z [ZEPPELIN-2517]&[ZEPPELIN-465] save paragraph's focus ---
[GitHub] zeppelin issue #2688: [Zeppelin-2571] & [Zeppelin-465] Run paragraphs: from ...
Github user tinkoff-dwh commented on the issue: https://github.com/apache/zeppelin/pull/2688 @Leemoonsoo Now paragraph's focus and cursor position stay in the same position after launch. ---
[GitHub] zeppelin pull request #2544: [ZEPPELIN-2724] Another Attempt to solve the de...
Github user sadhen closed the pull request at: https://github.com/apache/zeppelin/pull/2544 ---
[GitHub] zeppelin pull request #2539: [ZEPPELIN-2863] change notebook-authorization.j...
Github user sadhen closed the pull request at: https://github.com/apache/zeppelin/pull/2539 ---
