GitHub user alourie opened a pull request:
https://github.com/apache/zeppelin/pull/2517
Zeppelin 2835 add ssl doco
### What is this PR for?
Complementing Zeppelin-1501 (support for Cassandra with SSL in interpreter)
with documentation updates.
### What type of PR is it?
Improvement
### What is the Jira issue?
* [Zeppelin-2835]
### How should this be tested?
Check that documentation for cassandra interpreter includes cassandra.ssl
options.
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/instaclustr/zeppelin Zeppelin-2835-addSSL-doco
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/zeppelin/pull/2517.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2517
----
commit d91b310cbb985eac1e12ab9528a3be9e8e1b834c
Author: Prabhjyot Singh <[email protected]>
Date: 2017-01-07T12:37:00Z
[ZEPPELIN-1906] Use multiple InterpreterResult for displaying multiple JDBC
queries
### What is this PR for?
Use multiple InterpreterResult for displaying multiple JDBC queries.
IMO since other sql editors allows to execute multiple sql separated with
";" and ours display mechanism being more powerful, hence, it should also allow
the same.
### What type of PR is it?
[Improvement]
### What is the Jira issue?
* [ZEPPELIN-1906](https://issues.apache.org/jira/browse/ZEPPELIN-1906)
### How should this be tested?
Try running following in a paragraph (with Postgres setting) and check for
output.
```
%jdbc
create table test_temp_table (id int);
select column_name, data_type, character_maximum_length from
INFORMATION_SCHEMA.COLUMNS where table_name = 'test_temp_table';
SELECT table_name FROM information_schema.tables WHERE table_schema =
'public';
drop table test_temp_table;
SELECT table_name FROM information_schema.tables WHERE table_schema =
'public';
```
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? N/A
* Is there breaking changes for older versions? N/A
* Does this needs documentation? N/A
Author: Prabhjyot Singh <[email protected]>
Closes #1845 from prabhjyotsingh/ZEPPELIN-1906 and squashes the following
commits:
b27352a [Prabhjyot Singh] on error show previous output.
f9fd5c6 [Prabhjyot Singh] allow last query to be without ";"
b3e742e [Prabhjyot Singh] fixing checkstyle-fail-build
ac4663d [Prabhjyot Singh] add block comment
f3da37f [Prabhjyot Singh] replace regex with slightly better logic.
e6727b5 [Prabhjyot Singh] add testcase for spliting sql.
c096e76 [Prabhjyot Singh] remove extra empty lines
e675190 [Prabhjyot Singh] user same connection instead of creating new
everytime
f5ab796 [Prabhjyot Singh] Use multiple InterpreterResult for displaying
multiple JDBC queries
(cherry picked from commit 8464971c7aab0734f96d0a5a11d842b8e595324a)
Signed-off-by: Prabhjyot Singh <[email protected]>
commit b8637f5e5fa4aab8859e6bc90fa7886ba9157b24
Author: Alexander Shoshin <[email protected]>
Date: 2017-01-11T08:45:31Z
[ZEPPELIN-1787] Add an example of Flink Notebook
### What is this PR for?
This PR will add an example of batch processing with Flink to Zeppelin
tutorial notebooks. There are no any Flink notebooks in the tutorial at the
moment.
### What type of PR is it?
Improvement
### What is the Jira issue?
[ZEPPELIN-1787](https://issues.apache.org/jira/browse/ZEPPELIN-1787)
### How should this be tested?
You should open `Using Flink for batch processing` notebook from the
`Zeppelin Tutorial` folder and run all paragraphs one by one
### Questions:
* Does the licenses files need update? - **no**
* Is there breaking changes for older versions? - **no**
* Does this needs documentation? - **no**
Author: Alexander Shoshin <[email protected]>
Closes #1758 from AlexanderShoshin/ZEPPELIN-1787 and squashes the following
commits:
83cbffb [Alexander Shoshin] remove localhost url
5255e17 [Alexander Shoshin] Merge branch 'master' into ZEPPELIN-1787
0b9df56 [Alexander Shoshin] add a link for this notebook to Zeppelin
documentation
593c47d [Alexander Shoshin] convert notebook to 0.7.0 format
9013620 [Alexander Shoshin] convert notebook to 0.6.2 format
fe2a39e [Alexander Shoshin] add download instruction, change "wget" to
"curl"
f64b60a [Alexander Shoshin] [ZEPPELIN-1787] Add an example of Flink Notebook
(cherry picked from commit 0da08d1d726129f6b684c99b1af8802907475d8a)
Signed-off-by: ahyoungryu <[email protected]>
commit 6a15e7bf30876005b79f7593e02d5a4dc9f691d2
Author: Jeff Zhang <[email protected]>
Date: 2017-01-11T07:22:19Z
ZEPPELIN-1867. Update document for pig interpreter and add one sample note
### What is this PR for?
* Minor update for pig interpreter
* Add one sample pig tutorial note which do the same thing as the spark
tutorial note.
### What type of PR is it?
[Improvement | Documentation ]
### Todos
* [ ] - Task
### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-1867
### How should this be tested?
Tested manually
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
Author: Jeff Zhang <[email protected]>
Closes #1830 from zjffdu/ZEPPELIN-1867 and squashes the following commits:
1c0d819 [Jeff Zhang] rename note name
50198a1 [Jeff Zhang] add more description of tutorial note
88385f2 [Jeff Zhang] Add pig tutorial note
25216f8 [Jeff Zhang] ZEPPELIN-1867. Update document for pig interpreter and
add one sample note
(cherry picked from commit 3d2d4b6f9804ecc5c157c1b4a3885ee01890884e)
Signed-off-by: ahyoungryu <[email protected]>
commit ffdc5e972e2d5dd36aab099c71a6e852ed0c9260
Author: soralee <[email protected]>
Date: 2017-01-11T06:26:23Z
[ZEPPELIN-1864] Improvement to show folder and note after searching note
### What is this PR for?
This PR is for improvement to show folder and note after using the filter.
And I found some bugs and fixed like this.
the following list is improvement and bug fixed.
1. After using the filter in Zeppelin Home, every note is shown by the form
[FolderName/NoteName] like below. It would be nice to show folder icon and note
icon as previous status.
2. When using the filter, some functions and icons next to note and folder
are disappeared.
3. When using the filter, the `Rename Note` function doesn't work. ( When I
was handling this PR, this bug was discovered.)
### What type of PR is it?
[ Bug Fix | Improvement ]
### Todos
* [x] - improve to show folder and note when finishing to use filter.
* [x] - some functions and icons next to note and folder are appeared when
using filter.
* [x] - fix `Rename Note` function when using the filter.
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1864
### How should this be tested?
- **[Test 1]** Before/After using the filter, check the list structure of
your notes. It must be same appearance.
- **[Test 2]** When using the filter, check the notes. Some icons and
functions next to note and folder must be appeared.
- **[Test 3]** When using the filter, click `Rename Note`. It must be
appeared the path of Note.
### Screenshots (if appropriate)
**Test 1**.
**Test 2**.
**Test 3**.
### Questions:
* Does the licenses files need update? N/A
* Is there breaking changes for older versions? N/A
* Does this needs documentation? N/A
Author: soralee <[email protected]>
Closes #1834 from soralee/ZEPPELIN-1864 and squashes the following commits:
6fb53aa [soralee] resolve conflict
fd2c243 [soralee] resolve conflict
3e4b8ae [soralee] fix for that filter of navbar and home don't work
61680e5 [soralee] Improvement to show folder and note after searching note
69d6d6d [soralee] Improvement to show folder and note after searching note
(cherry picked from commit d393a5b52d345adc4da807065a25757572202075)
Signed-off-by: ahyoungryu <[email protected]>
commit 0981d34f92de4ee3ec7f59f53c6d4f70b747c9ca
Author: Unknown <[email protected]>
Date: 2017-01-10T14:03:03Z
[MINOR] Small Selenium test fixes
### What is this PR for?
Remove unused imports;
Replace "Thread.sleep" (unstable solution);
Add "deleteTestNotebook()" method -> testWidth.
### What type of PR is it?
[Refactoring]
### Todos
* [ ] - Task
### What is the Jira issue?
* Open an issue on Jira https://issues.apache.org/jira/browse/ZEPPELIN/
* Put link here, and add [ZEPPELIN-*Jira number*] in PR title, eg.
[ZEPPELIN-533]
### How should this be tested?
Travis-CI
### Screenshots (if appropriate)
https://travis-ci.org/apache/zeppelin/builds/190644901 ->
https://travis-ci.org/apache/zeppelin/jobs/190644918
### Questions:
* Does the licenses files need update? (no)
* Is there breaking changes for older versions? (no)
* Does this needs documentation? (no)
Author: Unknown <[email protected]>
Closes #1882 from bitchelov/automationTestFix and squashes the following
commits:
f898c59 [Unknown] [MINOR] Small Selenium test fixes
(cherry picked from commit 434215668e9db51706230420f8ce2c1c268b2457)
Signed-off-by: Jongyoul Lee <[email protected]>
commit ab87537bb2c99857428f712979dd3feb8d971809
Author: Khalid Huseynov <[email protected]>
Date: 2017-01-11T04:48:26Z
[ZEPPELIN-1730, 1587] add spark impersonation through --proxy-user option
### What is this PR for?
This is to add spark impersonation using --proxy-user option. note that it
enables also to use spark impersonation without having logged user as system
user with configured ssh.
### What type of PR is it?
Improvement
### Todos
* [x] - add `--proxy-user`
* [x] - try on standalone spark 1.6.2
* [x] - try on yarn-client mode spark 2.0.1
### What is the Jira issue?
Directly solves
[ZEPPELIN-1730](https://issues.apache.org/jira/browse/ZEPPELIN-1730) and also
solves [ZEPPELIN-1587](https://issues.apache.org/jira/browse/ZEPPELIN-1587)
according to discussion in #1566 since using `--proxy-user` in `spark-submit`
is preferable method.
### How should this be tested?
1. switch your spark cluster to `per user` and `isolated` mode
2. set up `user impersonation` flag
3. run some job using that spark interpreter
4. spark context should be created with currently logged in user
credentials on behalf of system user
### Screenshots (if appropriate)
standalone
yarn-client
<img width="997" alt="screen shot 2017-01-04 at 10 00 13 am"
src="https://cloud.githubusercontent.com/assets/1642088/21653117/75410fde-d264-11e6-886f-11d8b5dbd29e.png";>
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? yes
Author: Khalid Huseynov <[email protected]>
Closes #1840 from khalidhuseynov/feat/spark-proxy-user and squashes the
following commits:
e4251de [Khalid Huseynov] update doc with env var
dc61cae [Khalid Huseynov] check for env spark_proxy in interpreter.sh
8b66740 [Khalid Huseynov] add spark_proxy_user to env.sh
892b7e4 [Khalid Huseynov] add note in docs
4c3dba9 [Khalid Huseynov] add --proxy-user option for spark
(cherry picked from commit 5e0aacf8a8f187702452d7cd2ee83b26c56dec90)
Signed-off-by: Jongyoul Lee <[email protected]>
commit 7aa52d828fcfcd23f4a9c1c08279e0db8911fad0
Author: AhyoungRyu <[email protected]>
Date: 2017-01-12T06:15:14Z
[MINOR] Rename Pig tutorial note to consider priority
### What is this PR for?
After #1830 merged, Pig tutorial note placed as a first under `Zeppelin
Tutorial` folder. I told to zjffdu, I thought the note name should be same with
Spark ("Basic Feature (Spark)") in [this
comment](https://github.com/apache/zeppelin/pull/1830#discussion_r95522394)
(because they have same contents).
<img
src="https://cloud.githubusercontent.com/assets/10060731/21879248/a6d9b88a-d8da-11e6-8f43-5ef192e5895c.png";
width="300px">
But considering the number of Spark and Pig users, the Spark tutorial note
needs to be placed as first I think.
<img
src="https://cloud.githubusercontent.com/assets/10060731/21879244/a488e3d0-d8da-11e6-9e0b-c91ca890c611.png";
width="300px">
### What type of PR is it?
Rename Pig tutorial note
### What is the Jira issue?
N/A
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: AhyoungRyu <[email protected]>
Closes #1889 from AhyoungRyu/rename/pigTutorialNote and squashes the
following commits:
f08fd69 [AhyoungRyu] Rename Pig tutorial note to consider priority
(cherry picked from commit b9c667ae1dfcbc6d80d4fc65f64572acee96ede6)
Signed-off-by: ahyoungryu <[email protected]>
commit 94bbd41422ab98d8ee787163598e0aaa49fc2bc6
Author: astroshim <[email protected]>
Date: 2017-01-11T06:02:00Z
[ZEPPELIN-1229] Clear browser cache with version hashtag.
### What is this PR for?
This PR avoids browser cache.
### What type of PR is it?
Bug Fix
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1229
### How should this be tested?
1. Run old version of zeppelin(I was using 0.6.1) and show main page up in
your browser.
2. Stop zeppelin.
3. Run this PR of Zeppelin and show page up on the same browser of 1.
4. check main page changed.
- before (Job menu doesn't show)
- after (Job menu show)
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: astroshim <[email protected]>
Closes #1858 from astroshim/ZEPPELIN-1229 and squashes the following
commits:
18defbe [astroshim] modify regx
85e0a05 [astroshim] remove arguments in code
ca09eac [astroshim] change path
13d8056 [astroshim] trying another way
6b554e0 [astroshim] Merge branch 'master' into ZEPPELIN-1229
655dc3d [astroshim] tag all html
c94de90 [astroshim] delete unnecessary codes
9d9f76f [astroshim] fix ZEPPELIN-1229
(cherry picked from commit 02323e283c6cce12bb06bf5327420c2d2da5cbe2)
Signed-off-by: Mina Lee <[email protected]>
commit b0883a80d04918ce3fa79053469ce5cd96e9f63f
Author: Khalid Huseynov <[email protected]>
Date: 2017-01-11T07:22:35Z
[ZEPPELIN-1936] Fix user impersonation setting propagation
### What is this PR for?
This is to fix bug of creating interpreter with impersonation enabled
### What type of PR is it?
Bug Fix
### Todos
* [x] - fix model
### What is the Jira issue?
[ZEPPELIN-1936](https://issues.apache.org/jira/browse/ZEPPELIN-1936)
### How should this be tested?
create new interpreter with "User Impersonation" enabled
### Screenshots (if appropriate)
before:
after:
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: Khalid Huseynov <[email protected]>
Closes #1884 from khalidhuseynov/fix/new-interp-impersonation-setting and
squashes the following commits:
d5f8393 [Khalid Huseynov] fix model on interpreter-create
(cherry picked from commit 7290200322174fa643625034af2a8c61737dad06)
Signed-off-by: Mina Lee <[email protected]>
commit 55addf1a3194f40ac48eb97dd98bf8b9c3d98b2e
Author: cloverhearts <[email protected]>
Date: 2017-01-13T02:53:10Z
[HOTFIX : ZEPPELIN-1932] paragraph blur error
### What is this PR for?
When one or more hidden editors are present, clicking on the editor will
cause a blur error.
This means that when a paragraph is hidden through ng-if,
Caused by calling the blur method in the absence of an editor object.
### What type of PR is it?
Hot Fix
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1932
### How should this be tested?
1. create paragraph and open debug console.
2. enable hide paragraph.
3. page refresh
4. click to anywhere paragraph.
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: cloverhearts <[email protected]>
Closes #1879 from cloverhearts/hotfix/paragraphOnfocusEvent and squashes
the following commits:
7071638 [cloverhearts] fix show title and paragraph context issue
8f4d0bf [cloverhearts] fixed readonly event error
5ecfabb [cloverhearts] check editor object is undeifned.
(cherry picked from commit 2b0e2a41cb7e0d7fc160d5c9193413ffe4d94f68)
Signed-off-by: Mina Lee <[email protected]>
commit 88e2ac2798780a589771bda22029bbd876910189
Author: 1ambda <[email protected]>
Date: 2017-01-10T22:56:35Z
[ZEPPELIN-1917] Improve python.conda interpreter
### What is this PR for?
Add missing commands to the `python.conda` interpreter
- `conda info`
- `conda list`
- `conda create`
- `conda install`
- `conda uninstall (alias of remove)`
- `conda env *`
#### Implementation Detail
The reason I modified `PythonProcess` is due to NPE
```java
//
https://github.com/apache/zeppelin/blob/master/python/src/main/java/org/apache/zeppelin/python/PythonProcess.java#L107-L118
public String sendAndGetResult(String cmd) throws IOException {
writer.println(cmd);
writer.println();
writer.println("\"" + STATEMENT_END + "\"");
StringBuilder output = new StringBuilder();
String line = null;
// NPE when line is null
while (!(line = reader.readLine()).contains(STATEMENT_END)) {
logger.debug("Read line from python shell : " + line);
output.append(line + "\n");
}
return output.toString();
}
```
```
java.lang.NullPointerException
at
org.apache.zeppelin.python.PythonProcess.sendAndGetResult(PythonProcess.java:113)
at
org.apache.zeppelin.python.PythonInterpreter.sendCommandToPython(PythonInterpreter.java:250)
at
org.apache.zeppelin.python.PythonInterpreter.bootStrapInterpreter(PythonInterpreter.java:272)
at
org.apache.zeppelin.python.PythonInterpreter.open(PythonInterpreter.java:100)
at
org.apache.zeppelin.python.PythonCondaInterpreter.restartPythonProcess(PythonCondaInterpreter.java:139)
at
org.apache.zeppelin.python.PythonCondaInterpreter.interpret(PythonCondaInterpreter.java:88)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:94)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:494)
at org.apache.zeppelin.scheduler.Job.run(Job.java:175)
at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
```
### What type of PR is it?
[Improvement | Refactoring]
### Todos
* [x] - info
* [x] - list
* [x] - create
* [x] - install
* [x] - uninstall (= remove)
* [x] - env *
### What is the Jira issue?
[ZEPPELIN-1917](https://issues.apache.org/jira/browse/ZEPPELIN-1917)
### How should this be tested?
1. Install [miniconda](http://conda.pydata.org/miniconda.html)
2. Make sure that your python interpreter can use `conda` (check the
Interpreter Binding page)
3. Remove `test` conda env since we will create in the following section
```sh
$ conda env remove --yes --name test
```
4. Run these commands with `%python.conda`
```
%python.conda info
%python.conda env list
%python.conda create --name test
# you should be able to see `test` in the list
%python.conda env list
%python.conda activate pymysql
%python.conda install pymysql
# you should be able to import
%python
import pymysql.cursors
%python.conda uninstall pymysql
%python.conda deactivate pymysql
# you should be able to see `No module named pymysql.cursor` since we
deactivated
%python
import pymysql.cursors
```
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? - NO
* Is there breaking changes for older versions? - NO
* Does this needs documentation? - NO
Author: 1ambda <[email protected]>
Closes #1868 from 1ambda/ZEPPELIN-1917/improve-conda-interpreter and
squashes the following commits:
3ba171a [1ambda] fix: Wrap output style
292ed6d [1ambda] refactor: Throw exception in runCommand
2d4aa7d [1ambda] test: Add some tests
49a4a11 [1ambda] feat: Supports other env commands
6eb7e92 [1ambda] fix: NPE in PythonProcess
9c5dd86 [1ambda] refactor: Activate, Deactivate
f955889 [1ambda] fix: minor
935cb89 [1ambda] refactor: Abstract commands
b1c4c9f [1ambda] feat: Add conda remove (uninstall)
e539c42 [1ambda] feat: Add conda install
4f58fa2 [1ambda] feat: Add conda create
7da132d [1ambda] docs: Add missing conda list description
929ca8a [1ambda] feat: Make conda output beautiful
0c6ebb4 [1ambda] feat: Add list conda command
017c76f [1ambda] refactor: Import InterpreterResult.{Code, Type} to short
codes
b8a5154 [1ambda] refactor: Simplify exception flow so private funcs don't
need care exceptions
64d4bef [1ambda] style: Rename some funcs
afc456d [1ambda] refactor: Add private to member vars
f36fc74 [1ambda] feat: Add info command
2eb9bf5 [1ambda] style: Remove useless newlines
bd2564e [1ambda] refactor: PythonCondaInterpreter.interpret
f0d69bc [1ambda] fix: Use specific command for env list in conda
(cherry picked from commit 034fdc6735e075c89f727bb6bc6fddbc89b639c4)
Signed-off-by: Lee moon soo <[email protected]>
commit 8aea6a52eecc7cd5c75e0ae90d8b907cba2d537f
Author: robbins <[email protected]>
Date: 2017-01-12T15:15:29Z
[ZEPPELIN-1560] avoid generating minus sign in package name
### What is this PR for?
using Object.hashCode() as part of the REPL wrapper class name can cause a
compilation error as hashCode can validly return a negative integer.
We would like this fix backported to 0.6 and later streams.
### What type of PR is it?
Bug Fix
### Todos
* [ ] - Task
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1560
### How should this be tested?
regression tests with openJdk + tests with IBM jvm
### Screenshots (if appropriate)
N/A
### Questions:
* Does the licenses files need update? NO
* Is there breaking changes for older versions? NO
* Does this needs documentation? NO
Author: robbins <[email protected]>
Closes #1894 from robbinspg/ZPPELIN-1560 and squashes the following commits:
eeef3ad [robbins] [ZEPPELIN-1560] avoid generating minus sign in package
name
(cherry picked from commit 068c8946211823ac98fc7dbf8061da6e9a2712c3)
Signed-off-by: Lee moon soo <[email protected]>
commit 893c23dd9d48497f3aaeab2fa28917850203369d
Author: cloverhearts <[email protected]>
Date: 2017-01-14T00:02:55Z
[HOTFIX] Does not working settings menu in zeppelin web graph ui
### What is this PR for?
Does not working settings menu in zeppelin web graph ui
### What type of PR is it?
Bug Fix
### How should this be tested?
1. toggle settings menu in zeppelin graph ui
### Screenshots (if appropriate)
#### Before
#### After
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: cloverhearts <[email protected]>
Closes #1899 from cloverhearts/ZEEPELIN-SETTING-PROBLEM-WEB-UI and squashes
the following commits:
e3453b7 [cloverhearts] invalid render life cycle for setting
(cherry picked from commit 59e15c03d6a405e07dec59fb6e7f0ad87150794f)
Signed-off-by: Lee moon soo <[email protected]>
commit 59d2d107b841f637b8da0b1fcb7f3a8c90c8db7a
Author: 1ambda <[email protected]>
Date: 2017-01-11T05:38:01Z
[ZEPPELIN-1883] Can't import spark submitted packages in PySpark
### What is this PR for?
Fixed importing packages in pyspack requested by `SPARK_SUBMIT_OPTION`
### What type of PR is it?
[Bug Fix]
### Todos
Nothing
### What is the Jira issue?
[ZEPPELIN-1883](https://issues.apache.org/jira/browse/ZEPPELIN-1883)
### How should this be tested?
0. Download Apache Spark 1.6.2 (since it's the most recent for
pyspark-cassandra)
1. Set `SPARK_HOME` and `SPARK_SUBMIT_OPTION` in `conf/zeppelin-env.sh` like
```sh
export SPARK_HOME="~/github/apache-spark/1.6.2-bin-hadoop2.6"
export SPARK_SUBMIT_OPTIONS="--packages
com.datastax.spark:spark-cassandra-connector_2.10:1.6.2,TargetHolding:pyspark-cassandra:0.3.5
--exclude-packages org.slf4j:slf4j-api"
```
2. Check before that you can run `spark-submit` or not
```
./bin/spark-submit --packages
com.datastax.spark:spark-cassandra-connector_2.10:1.6.2,TargetHolding:pyspark-cassandra:0.3.5
--exclude-packages org.slf4j:slf4j-api --class
org.apache.spark.examples.SparkPi lib/spark-examples-1.6.2-hadoop2.6.0.jar
```
3. Test whether submitted packages can be import or not
```
%pyspark
import pyspark_cassandra
```
### Screenshots (if appropriate)
```
import pyspark_cassandra
Traceback (most recent call last):
File
"/var/folders/lr/8g9y625n5j39rz6qhkg8s6640000gn/T/zeppelin_pyspark-5266742863961917074.py",
line 267, in <module>
raise Exception(traceback.format_exc())
Exception: Traceback (most recent call last):
File
"/var/folders/lr/8g9y625n5j39rz6qhkg8s6640000gn/T/zeppelin_pyspark-5266742863961917074.py",
line 265, in <module>
exec(code)
File "<stdin>", line 1, in <module>
ImportError: No module named pyspark_cassandra
```
### Questions:
* Does the licenses files need update? - NO
* Is there breaking changes for older versions? - NO
* Does this needs documentation? - NO
Author: 1ambda <[email protected]>
Closes #1831 from
1ambda/ZEPPELIN-1883/cant-import-submitted-packages-in-pyspark and squashes the
following commits:
585d48a [1ambda] Use spark.jars instead of classpath
f76d2c8 [1ambda] fix: Do not extend PYTHONPATH in yarn-client
c735bd5 [1ambda] fix: Import spark submit packages in pyspark
(cherry picked from commit cb8e4187029fdd7b892d84f23efd51acaed65f78)
Signed-off-by: Lee moon soo <[email protected]>
commit 0f98dca046d6c21756d9f30672c867073535df7d
Author: Unknown <[email protected]>
Date: 2016-12-12T14:14:12Z
[MINOR] Remove unused import. Naming convention.
### What is this PR for?
Change method name (Method names should comply with a naming convention).
Remove unused imports. Using append makes code simpler to read
`sb.append("\nAccessTime = ").append(accessTime);` instead
`sb.append("\nAccessTime = " + accessTime);`
### What type of PR is it?
[Refactoring]
### Todos
* [ ] - Task
### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-1839
### How should this be tested?
HDFSFileInterpreterTest.java (still working)
### Questions:
* Does the licenses files need update? (no)
* Is there breaking changes for older versions? (no)
* Does this needs documentation? (no)
Remove this unused import, naming convention
Author: Unknown <[email protected]>
Closes #1747 from bitchelov/hdfsFileInterpreterSmallChanges and squashes
the following commits:
6d27bb8 [Unknown] Minor changes
(cherry picked from commit 69bc353d3c047ad8ad29584ce9e3b6c84d7ace7e)
Signed-off-by: Jongyoul Lee <[email protected]>
commit 054e0846dc558a48653c71d71438fe952775a82b
Author: Jeff Zhang <[email protected]>
Date: 2017-01-13T03:30:13Z
ZEPPELIN-1293. Livy Interpreter: Automatically attach or create to a new
session
### What is this PR for?
By default, livy session will expire after one hour. This PR would create
session automatically for user if session is expired, and would also display
the session expire information in frontend. The expire message would only
display at the first time of session recreation, after that the message won't
be displayed.
### What type of PR is it?
[Improvement ]
### Todos
* [ ] - Task
### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-1293
### How should this be tested?
Tested manually.
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
Author: Jeff Zhang <[email protected]>
Closes #1861 from zjffdu/ZEPPELIN-1293 and squashes the following commits:
e174593 [Jeff Zhang] minor update on warning message
30c3569 [Jeff Zhang] address comments
88f0d9a [Jeff Zhang] ZEPPELIN-1293. Livy Interpreter: Automatically attach
or create to a new session
commit 8dc4721eaec0684ef3df6c25a8668badb4ed2ab5
Author: Lee moon soo <[email protected]>
Date: 2017-01-12T18:58:06Z
[ZEPPELIN-1619] Load js package as a plugin visualization
### What is this PR for?
Current helium plugin application api (experimental) requires create
library in java class, and need to create both backend / frontend code in the
package. Which is good if your plugin requires both frontend and backend code
running.
However, when user just want to make new visualization which completely
runs on front-end side in javascript, creating helium application in java
project and taking care of backend code can be bit of overhead and barrier for
javascript developers.
This PR adds capability to load pure javascript package as a visualization.
### how it works
1. create (copy, download) 'helium package json' file into
`ZEPPELIN_HOME/helium` directory.
The json file point visualization js package in npm repository or local
file system in `artifact` field.
`type` field in the json file need to be `VISUALIZATION`
Here's an example
(zeppelin-examples/zeppelin-example-horizontalbar/zeppelin-example-horizontalbar.json)
```
{
"type" : "VISUALIZATION",
"name" : "zeppelin_horizontalbar",
"description" : "Horizontal Bar chart (example)",
"artifact" : "./zeppelin-examples/zeppelin-example-horizontalbar",
"icon" : "<i class='fa fa-bar-chart rotate90flipX'></i>"
}
```
2. Go to helium GUI menu. (e.g. http://localhost:8080/#/helium).
The menu will list all available packages.
<img width="796" alt="writing_visualization_helium_menu"
src="https://cloud.githubusercontent.com/assets/1540981/21749660/0f401c10-d558-11e6-9961-b6d0a9c023d8.png";>
3. click 'enable' in any package want to use.
Once a visualization package is enabled, `HeliumVisualizationFactory` will
collect all enabled visualizations and create js bundle on the fly.
4. js bundle will be loaded on notebook and additional visualization
becomes available
### Programming API to create new plugin visualization.
Simply extends
[visualization.js](https://github.com/apache/zeppelin/blob/master/zeppelin-web/src/app/visualization/visualization.js)
and overrides some methods, such as
```
/**
* get transformation
*/
getTransformation() {
// override this
};
/**
* Method will be invoked when data or configuration changed
*/
render(tableData) {
// override this
};
/**
* Refresh visualization.
*/
refresh() {
// override this
};
/**
* method will be invoked when visualization need to be destroyed.
* Don't need to destroy this.targetEl.
*/
destroy() {
// override this
};
/**
* return {
* template : angular template string or url (url should end with
.html),
* scope : an object to bind to template scope
* }
*/
getSetting() {
// override this
};
```
This is exactly the same api that built-in visualization uses.
an example implementation included
`zeppelin-examples/zeppelin-example-horizontalbar/horizontalbar.js`.
Actually [all built-in
visualizations](https://github.com/apache/zeppelin/tree/master/zeppelin-web/src/app/visualization/builtins)
are example
### Packaging and publishing visualization
Each visualization will need `package.json` file (e.g.
`zeppelin-examples/zeppelin-example-horizontalbar/package.json`) to be packaged.
Package can be published in npm repository or package can be deployed to
the local filesystem.
`zeppelin-examples/zeppelin-example-horizontalbar/` is an example package
that is deployed in the local filesystem
### Development mode
First, locally install and enable your development package by setting
`artifact` field to the development directory.
Then run zeppelin-web in visualization development mode with following
command
```
cd zeppelin-web
npm run visdev
```
When you have change in your local development package, just reload your
notebook. Then Zeppelin will automatically rebuild / reload the package.
Any feedback would be appreciated!
### What type of PR is it?
Feature
### Todos
* [x] - Load plugin visualization js package on runtime
* [x] - Make the feature works in zeppelin Binary package
* [x] - Show loading indicator while 'enable' / 'disable' package
* [x] - Add document
* [x] - Add license of new dependency
* [x] - Development mode
* [x] - Propagate error to front-end
* [x] - Display multiple versions of a package.
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1619
### How should this be tested?
Build Zeppelin with `-Pexamples` flag. That'll install example
visualization package `horizontalbar`.
You'll able to select `horizontalbar` along with other built-in
visualizations
To test npm online package install capability, Place
[zeppelin-bubble.json](https://github.com/Leemoonsoo/zeppelin-bubble/blob/master/zeppelin-bubble.json)
in hour local registry (`ZEPPELIN_HOME/helium`) and enable it in Helium gui
menu.
And then zeppelin will download package from npm repository and load.
### Questions:
* Does the licenses files need update? yes
* Is there breaking changes for older versions? no
* Does this needs documentation? yes
Author: Lee moon soo <[email protected]>
Closes #1842 from Leemoonsoo/ZEPPELIN-1619-rebased and squashes the
following commits:
7c49bbb [Lee moon soo] Let Zeppelin continue to bootstrap on offline
816bdec [Lee moon soo] Display license of package when enabling
28fb37d [Lee moon soo] beautifulize helium menu
295768e [Lee moon soo] fix drag and drop visualization reorder
bb304db [Lee moon soo] Sort version in decreasing order
e7f18f1 [Lee moon soo] fix english in docs and labels
c7b187f [Lee moon soo] Merge branch 'master' into ZEPPELIN-1619-rebased
4c87983 [Lee moon soo] Merge remote-tracking branch 'apache-github/master'
into ZEPPELIN-1619-rebased
ecd925b [Lee moon soo] Merge remote-tracking branch 'apache-github/master'
into ZEPPELIN-1619-rebased
a92cadd [Lee moon soo] Use minifiable syntax
cec534c [Lee moon soo] Reduce log message
f373f1d [Lee moon soo] Ignore removed package
e18d9a4 [Lee moon soo] Ability to customize order of visualization package
display
cd74396 [Lee moon soo] Add rest api doc
9de5d6d [Lee moon soo] exclude .npmignore and package.json from
zeppelin-web rat check
08abded [Lee moon soo] exclude package.json from rat check
661c26b [Lee moon soo] update screenshot and keep experimental tag only in
docs
4515805 [Lee moon soo] Display multiple versions of a package
408c512 [Lee moon soo] Make unittest test bundling with proper vis package
on npm registry
fb7a147 [Lee moon soo] display svg icon
47de6d9 [Lee moon soo] Propagate bundle error to the front-end
0fe5e00 [Lee moon soo] visualization development mode
022e8f6 [Lee moon soo] exclude
zeppelin-examples/zeppelin-example-horizontalbar/package.json file from rat
check
2ef3b69 [Lee moon soo] Add new dependency license
f943d33 [Lee moon soo] Add doc
f494dbd [Lee moon soo] package npm dependency module in binary package
b655fa6 [Lee moon soo] use any version of dependency in example. so
zeppelin version bumpup doesn't need to take care of them
2aec52d [Lee moon soo] show loading indicator while enable/disable package
6c380f6 [Lee moon soo] refactor code to fix HeliumTest
e142336 [Lee moon soo] update unittest
7d5e0ae [Lee moon soo] Resolve dependency conflict
c50a524 [Lee moon soo] Add conf/helium.json in .gitignore
1c7b73a [Lee moon soo] add result.css
d2823ad [Lee moon soo] load visualization and tabledata module from source
instead npm if accessible
4e1b061 [Lee moon soo] Convert horizontalbar to VISUALIZATION example
a5a935b [Lee moon soo] connect visualization factory with restapi
4b21252 [Lee moon soo] initial implementation of helium menu
0c4da2e [Lee moon soo] pass bundled visualization to result.controller.js
f5ce99e [Lee moon soo] import helium service js
1663582 [Lee moon soo] initial implementation of helium menu
74d52d4 [Lee moon soo] bundle visualization package from npm repository on
the fly
(cherry picked from commit 300f7532342d1ea47b85d3b777a8797a3e2248d4)
Signed-off-by: Lee moon soo <[email protected]>
commit 8956d682f591062cd129b93be23b3a10e91dcc83
Author: AhyoungRyu <[email protected]>
Date: 2017-01-15T06:14:42Z
[HOTFIX][ZEPPELIN-1970] Use relative path for broken screenshot imgs
### What is this PR for?
Two screenshot imgs in [Writing a new
visualization](https://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/development/writingzeppelinvisualization.html)
page are broken after deployed. It can be fixed by using relative path like
other images. (e.g.
[shiroauthentication.md](https://github.com/apache/zeppelin/blob/master/docs/security/shiroauthentication.md#4-login))
### What type of PR is it?
Hot Fix
### What is the Jira issue?
[ZEPPELIN-1970](https://issues.apache.org/jira/browse/ZEPPELIN-1970)
### How should this be tested?
It can't be reproduced using docs dev mode. Needs to be tested with below
steps.
```
1) build gh-pages (website) branch
JEKYLL_ENV=production bundle exec jekyll build
cp -r _site/ /tmp/zeppelin_website/
mkdir -p /tmp/zeppelin_website/docs/0.7.0-SNAPSHOT
2) build this patch (docs) and copy it under docs/0.7.0-SNAPSHOT of website
cd docs
bundle exec jekyll build --safe
cp -r _site/ /tmp/zeppelin_website/0.7.0-SNAPSHOT/
3) start httpserver and browse http://localhost:8000/docs/0.7.0-SNAPSHOT/
cd /tmp/zeppelin_website
python -m SimpleHTTPServer
```
### Screenshots (if appropriate)
- before
<img width="809" alt="screen shot 2017-01-15 at 3 10 53 pm"
src="https://cloud.githubusercontent.com/assets/10060731/21960655/a73ee658-db35-11e6-8e4d-7702adb1ab19.png";>
- after
<img width="751" alt="screen shot 2017-01-15 at 3 10 13 pm"
src="https://cloud.githubusercontent.com/assets/10060731/21960650/a23348a2-db35-11e6-80a4-a6bc9b9b188c.png";>
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: AhyoungRyu <[email protected]>
Closes #1901 from AhyoungRyu/ZEPPELIN-1970 and squashes the following
commits:
d64e13f [AhyoungRyu] Use relative path for screenshot imgs
(cherry picked from commit f86bb858b8032408b542f15ccb8794df02224a33)
Signed-off-by: ahyoungryu <[email protected]>
commit 835e9e21f7a94066313af98c44de9b793b1ba54d
Author: Jeff Zhang <[email protected]>
Date: 2017-01-12T07:39:17Z
ZEPPELIN-1933. Set pig job name and allow to set pig property in pig
interpreter setting
### What is this PR for?
Two improvements for pig interpreter.
* Set job name via paragraph title if it exists, otherwise use the last
line of pig script
* Allow to set any pig property in interpreter setting
### What type of PR is it?
[ Improvement]
### Todos
* [ ] - Task
### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-1933
### How should this be tested?
Unit tested and manually tested.
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
Author: Jeff Zhang <[email protected]>
Closes #1885 from zjffdu/ZEPPELIN-1933 and squashes the following commits:
d2e1cd4 [Jeff Zhang] address comments
9cee380 [Jeff Zhang] ZEPPELIN-1933. Set pig job name and allow to set pig
property in pig interpreter setting
(cherry picked from commit 41f9fd921d77f5112107ba76c8794213cf3af929)
Signed-off-by: Felix Cheung <[email protected]>
commit a3d7316190f487ef5a5f041c2eede752b9b38df8
Author: Mina Lee <[email protected]>
Date: 2017-01-13T02:39:42Z
[BUILD] Update release script
### What is this PR for?
* Change hadoop profile from `hadoop-2.4` to `hadoop-2.6`
* Use `SCALA_VERSION` variable instead of hardcoding
* Specify projects to be built for netinst package instead of excluding
unnecessary projects.
### What type of PR is it?
Build
### What is the Jira issue?
### How should this be tested?
Outline the steps to test the PR here.
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: Mina Lee <[email protected]>
Closes #1890 from minahlee/update/release_script and squashes the following
commits:
a97b5fe [Mina Lee] Remove one r interpreter profile as only one will take
effect
1479d26 [Mina Lee] Use scala variable instead of hardcoding Specify project
to build for net-inst package instead of adding exluding projects everytime
zeppelin have new interpreter
da9080a [Mina Lee] Update hadoop profile from 2.4 to 2.6
(cherry picked from commit f8c11d15f4378523922c76a892a755a60e4a187b)
Signed-off-by: Mina Lee <[email protected]>
commit 20c3cbccfd0ac4e58637bd4324774b7e3ab536c9
Author: Khalid Huseynov <[email protected]>
Date: 2017-01-12T23:12:29Z
[ZEPPELIN-1961] Improve stability of sync when get fails
### What is this PR for?
This is to improve the stability of sync mechanism when `get` from some
backend storage fails (e.g. corrupt file, network issues).
### What type of PR is it?
Bug Fix | Hot Fix
### Todos
* [x] - handle exception
### What is the Jira issue?
[ZEPPELIN-1961](https://issues.apache.org/jira/browse/ZEPPELIN-1961)
### How should this be tested?
CI green
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: Khalid Huseynov <[email protected]>
Closes #1895 from khalidhuseynov/fix-stability/sync-fail and squashes the
following commits:
aa1e199 [Khalid Huseynov] catch failed get command
(cherry picked from commit e94d5c0fb66ee0954a74450002c5b81b8a7331a7)
Signed-off-by: Mina Lee <[email protected]>
commit 7b123fb8e5b593c6839613f4f851e692529543a8
Author: Jun Kim <[email protected]>
Date: 2017-01-15T13:22:42Z
[DOCS] Reflect changed default storage to doc
### What is this PR for?
Reflect effects caused by changing the default notebook storage
VFSNotebookRepo to GitNotebookRepo.
### What type of PR is it?
[Documentation]
### Questions:
* Does the licenses files need update? NO
* Is there breaking changes for older versions? NO
* Does this needs documentation? NO
Author: Jun Kim <[email protected]>
Closes #1903 from tae-jun/patch-3 and squashes the following commits:
60448da [Jun Kim] [DOCS] Reflect changed default storage to doc
(cherry picked from commit 982cc0d17e6482844068dbb29ad5a11325a43446)
Signed-off-by: ahyoungryu <[email protected]>
commit 57f03df9e5bd5fbe5e715a78c0f7d809ea31a180
Author: victor.sheng <[email protected]>
Date: 2017-01-12T06:54:26Z
[ZEPPELIN-1941] Fix cron job with release resource option dead lock
### What is this PR for?
There is a deadlock in concurrent cron job execution with release resource
option.
`Scenario`:
Two notebook run with cron job that release resource after job finished.
In `Notebook.CronJob.execute()` method:
`T1. note.runAll(); // locked paragraphs(lock) and wait to
interpreterSettings(lock)`
`T2. notebook.getInterpreterFactory().restart()
//locked(interpreterSettings) and wait for paragraphs(lock) during jobAbort.`
This will trigger a deadlock that cause zeppelin hang.
### What type of PR is it?
[Bug Fix ]
### Todos
* [x] - Fix this by avoid acquire lock in job abort method.
### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-1941
### How should this be tested?
Outline the steps to test the PR here.
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update?
* Is there breaking changes for older versions?
* Does this needs documentation?
Author: victor.sheng <[email protected]>
Closes #1891 from OopsOutOfMemory/fix_dead_lock_cronjob and squashes the
following commits:
517fdfa [victor.sheng] fix cron job with release resource option dead lock
(cherry picked from commit 215599cb39420a3564f8fcc7ac64a8da748aa526)
Signed-off-by: Jongyoul Lee <[email protected]>
commit 2a869c80edcaa8ebd2141fe97ddc0d036e66ccc8
Author: Jeff Zhang <[email protected]>
Date: 2017-01-10T06:07:33Z
ZEPPELIN-1770. Restart only the client user's interpreter when restarting
interpreter setting
### What is this PR for?
This PR would only restart the trigger user's interpreter rather than all
the interpreter. So that restarting won't affect other users.
### What type of PR is it?
[Improvement]
### Todos
* [ ] - Task
### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-1770
### How should this be tested?
Tested manually.
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
Author: Jeff Zhang <[email protected]>
Closes #1846 from zjffdu/ZEPPELIN-1770 and squashes the following commits:
5ee076d [Jeff Zhang] fix scoped mode and add unit test
8cb28a3 [Jeff Zhang] ZEPPELIN-1770. Restart only the client user's
interpreter when restarting interpreter setting
(cherry picked from commit ae1cb0527bc223b25761e1370618929e228183f8)
Signed-off-by: Jongyoul Lee <[email protected]>
commit 20ebb6cc1e8246f72e74af36fa286761a79c53f4
Author: Jeff Zhang <[email protected]>
Date: 2017-01-11T02:56:53Z
ZEPPELIN-1918. Fix build with Spark 2.1.0
### What is this PR for?
It's my misunderstanding of `SPARK_VER` in travis. It is only used for
downloading spark distribution. We need to specify spark profile explicitly for
building with specific version of spark. This PR add new profile for spark 2.1
and fix the build issue with spark 2.1.0 because `SecurityManager` changes its
constructor signature in spark 2.1
### What type of PR is it?
[Bug Fix ]
### Todos
* [ ] - Task
### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-1918
### How should this be tested?
Build with spark 2.1.0 and tested it manually as below screenshot.
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
Author: Jeff Zhang <[email protected]>
Closes #1880 from zjffdu/ZEPPELIN-1918 and squashes the following commits:
8f87459 [Jeff Zhang] update release script
34772e0 [Jeff Zhang] update build doc for spark 2.1
5efdb11 [Jeff Zhang] fix unit test and address comments
def502f [Jeff Zhang] ZEPPELIN-1918. Fix build with Spark 2.1.0
(cherry picked from commit 9bc4dce9884ec4011f677560f708286968549374)
Signed-off-by: Felix Cheung <[email protected]>
commit 98f55c099b4baa814ec4cf7d680b8cbd7e667f1f
Author: Lee moon soo <[email protected]>
Date: 2017-01-16T15:40:44Z
[ZEPPELIN-1969] Can not change visualization package version.
### What is this PR for?
Changing visualization package version from helium menu, sometimes fail.
This PR fixes the problem and providing a unittest.
### What type of PR is it?
Bug Fix
### Todos
* [x] - remove package from node_module and let npm download again before
bundle the package.
* [x] - add unittest.
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1969
### How should this be tested?
Unittest HeliumVisualizationFactoryTest.switchVersion() ensure the fix.
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: Lee moon soo <[email protected]>
Closes #1900 from Leemoonsoo/fix_helium_version_switch and squashes the
following commits:
540497f [Lee moon soo] fix style
e9f2811 [Lee moon soo] Make download package everytime bundle to workaround
inconsistent behavior of npm install
(cherry picked from commit d61cd99dbb5c63078b3e20e94183355e2c401d5f)
Signed-off-by: Lee moon soo <[email protected]>
commit a2d6a8cf05104443b7a30c84fd4d71838136caaf
Author: Renjith Kamath <[email protected]>
Date: 2017-01-11T17:13:32Z
ZEPPELIN-1935 Add jceks stored password support for jdbc interpreter
### What is this PR for?
Add support for jceks stored password instead of using password in clear
text. This security enhancement prevents any user from reading clear passwords
from interpreter json using shell/py/spark etc. #1315 is the parent PR which
fixed similar a issue in Active Directory (shiro.ini config).
### What type of PR is it?
Improvement
### Todos
### What is the Jira issue?
ZEPPELIN-1935
### How should this be tested?
Create a keystore file using the hadoop credential commandline, for this
the hadoop commons should be in the classpath.
`hadoop credential create jdbc.password -provider
jceks://file/user/zeppelin/conf/zeppelin.jceks`
Use the jceks file and the key to configure jdbc interpreter. Example
interpreter setting:
#### Following are the supported settings for backward compatibility
- Settings with username and jceks
```
default.driver org.postgresql.Driver
default.jceks.credentialKey jdbc.password
default.jceks.file jceks://file/tmp/zeppelin.jceks
default.url jdbc:postgresql://rkamath-local-1:5432/
default.user rk-user
```
- Settings with user name and clear text password
```
default.driver org.postgresql.Driver
default.url jdbc:postgresql://rkamath-local-1:5432/
default.user rk-user
default.password password1
```
### Screenshots (if appropriate)
<img width="1392" alt="screen shot 2017-01-10 at 7 02 12 pm"
src="https://cloud.githubusercontent.com/assets/2031306/21808016/5e602982-d767-11e6-88f9-3d15b9a7f0b8.png";>
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? yes
Author: Renjith Kamath <[email protected]>
Closes #1881 from r-kamath/ZEPPELIN-1935 and squashes the following commits:
5cc4db1 [Renjith Kamath] ZEPPELIN-1935 revert wildcard imports
dfabe3a [Renjith Kamath] Merge branch 'master' of
https://github.com/apache/zeppelin into ZEPPELIN-1935
e62088a [Renjith Kamath] ZEPPELIN-1935 fix log message
d41d56c [Renjith Kamath] ZEPPELIN-1935 Add jceks stored password support
for jdbc interpreter
(cherry picked from commit 04d34547a1453e16ea4cb306cfcfa0d79f22acfe)
Signed-off-by: Prabhjyot Singh <[email protected]>
commit f7edda1c4633329ed522dea088a12edb00013386
Author: Jeff Zhang <[email protected]>
Date: 2017-01-16T01:01:54Z
ZEPPELIN-1432. Support cancellation of paragraph execution
### What is this PR for?
Livy 0.3 support cancel operation, this PR is to support cancel in livy
interpreter. First we would check the livy version, then based on the livy
version, we would call the livy rest api to cancel the statement.
### What type of PR is it?
Improvement | Feature ]
### Todos
* [ ] - Task
### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-1432
### How should this be tested?
Tested manually, because cancel is only avaible in livy 0.3 which is not
released yet.
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
Author: Jeff Zhang <[email protected]>
Closes #1859 from zjffdu/ZEPPELIN-1432 and squashes the following commits:
83eaf83 [Jeff Zhang] minor update
200ca71 [Jeff Zhang] address comments
1cbeb26 [Jeff Zhang] add zeppelin.livy.pull_status.interval.millis
070fea0 [Jeff Zhang] ZEPPELIN-1432. Support cancellation of paragraph
execution
(cherry picked from commit 2fcfaa8c74cad5adf9adcdf76987e4ffbe5983c7)
Signed-off-by: Felix Cheung <[email protected]>
commit 2dc5c8806c76136af5de7cba032f629118e73208
Author: AhyoungRyu <[email protected]>
Date: 2017-01-16T13:30:21Z
[Hot Fix] Fix deadlink in writingzeppelinvisualization.md
### What is this PR for?
It should point
[HeliumVisualizationFactory.java](https://github.com/apache/zeppelin/blob/master/zeppelin-zengine/src/main/java/org/apache/zeppelin/helium/HeliumVisualizationFactory.java)
not
[HeliumVisualizationPackage.java](https://github.com/apache/zeppelin/blob/master/zeppelin-zengine/src/main/java/org/apache/zeppelin/helium/HeliumVisualizationPackage.java)
### What type of PR is it?
Documentation | HotFix
### What is the Jira issue?
N/A
### How should this be tested?
click `HeliumVisualizationFactory` link in [this
section](https://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/development/writingzeppelinvisualization.html#3-create-and-load-visualization-bundle-on-the-fly)
:)
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: AhyoungRyu <[email protected]>
Closes #1904 from AhyoungRyu/fix/deadlink and squashes the following
commits:
60ac6c9 [AhyoungRyu] Fix deadlink in writingzeppelinvisualization.md
(cherry picked from commit 425abe302374522278e7e76d4c78b71ce5dcdd9d)
Signed-off-by: ahyoungryu <[email protected]>
commit 350cf9c294114cd40ceef00c570d8f53caeea922
Author: Khalid Huseynov <[email protected]>
Date: 2017-01-13T05:32:02Z
[ZEPPELIN-1963] set cron job executor to current user by default
### What is this PR for?
currently when executing cron job, backend doesn't know who initiated cron
job (with subsequent save) unless user puts his name. This PR adds user name by
default by keeping compatibility with current workflow.
### What type of PR is it?
Improvement
### Todos
* [x] - add user on front
### What is the Jira issue?
[ZEPPELIN-1963](https://issues.apache.org/jira/browse/ZEPPELIN-1963)
### How should this be tested?
go and set cron job
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: Khalid Huseynov <[email protected]>
Closes #1898 from khalidhuseynov/cron-user and squashes the following
commits:
30dc440 [Khalid Huseynov] add logged cron executing user
(cherry picked from commit 8daf32563960b16db739e30c8dcd91d60f854917)
Signed-off-by: Mina Lee <[email protected]>
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
![https://cloud.githubusercontent.com/assets/1642088/21653117/75410fde-d264-11e6-886f-11d8b5dbd29e.png"](https://cloud.githubusercontent.com/assets/1642088/21653117/75410fde-d264-11e6-886f-11d8b5dbd29e.png"){kind=link}
![https://cloud.githubusercontent.com/assets/10060731/21879248/a6d9b88a-d8da-11e6-8f43-5ef192e5895c.png"](https://cloud.githubusercontent.com/assets/10060731/21879248/a6d9b88a-d8da-11e6-8f43-5ef192e5895c.png"){kind=link}
![https://cloud.githubusercontent.com/assets/10060731/21879244/a488e3d0-d8da-11e6-9e0b-c91ca890c611.png"](https://cloud.githubusercontent.com/assets/10060731/21879244/a488e3d0-d8da-11e6-9e0b-c91ca890c611.png"){kind=link}
![https://cloud.githubusercontent.com/assets/1540981/21749660/0f401c10-d558-11e6-9961-b6d0a9c023d8.png"](https://cloud.githubusercontent.com/assets/1540981/21749660/0f401c10-d558-11e6-9961-b6d0a9c023d8.png"){kind=link}
![https://cloud.githubusercontent.com/assets/10060731/21960655/a73ee658-db35-11e6-8e4d-7702adb1ab19.png"](https://cloud.githubusercontent.com/assets/10060731/21960655/a73ee658-db35-11e6-8e4d-7702adb1ab19.png"){kind=link}
![https://cloud.githubusercontent.com/assets/10060731/21960650/a23348a2-db35-11e6-80a4-a6bc9b9b188c.png"](https://cloud.githubusercontent.com/assets/10060731/21960650/a23348a2-db35-11e6-80a4-a6bc9b9b188c.png"){kind=link}
![https://cloud.githubusercontent.com/assets/2031306/21808016/5e602982-d767-11e6-88f9-3d15b9a7f0b8.png"](https://cloud.githubusercontent.com/assets/2031306/21808016/5e602982-d767-11e6-88f9-3d15b9a7f0b8.png"){kind=link}
