[jira] [Created] (ZEPPELIN-5317) Automate document and website deploy
Lee Moon Soo created ZEPPELIN-5317: -- Summary: Automate document and website deploy Key: ZEPPELIN-5317 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5317 Project: Zeppelin Issue Type: Improvement Reporter: Lee Moon Soo Currently, Apache Zeppelin website and documentation are deployed through apache SVN "manually", page by page. After a pullrequest is merged, committers may forget or make a mistake on performing the manual SVN deployment process. If we can make the entire website and documentation is generated as a single artifact (like docker image) and make deployment automated, then there will be fewer broken links and outdated documentation. Or we can learn from other ASF projects about the best practice of releasing website and document. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-5261) Sandbox HTML result rendering
Lee Moon Soo created ZEPPELIN-5261: -- Summary: Sandbox HTML result rendering Key: ZEPPELIN-5261 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5261 Project: Zeppelin Issue Type: Improvement Components: GUI Affects Versions: 0.9.0 Reporter: Lee Moon Soo Zeppelin display system allows users to render arbitrary HTML results inside a Note. This includes Javascript inlined in the HTML data to be rendered. It can be used for a potential xss attack, when a user open a shared notebook from another user, which includes an exploit code inside HTML result in the Note. There could a couple of different approaches to prevent this a. Don't render HTML results unless the user explicitly 'trust' the Note. In this way, when a Note includes HTML results, Zeppelin UI can ask the user if user want to trust and render HTML result or not. b. Sandbox HTML result rendering using iframe In this way, HTML result is rendered inside an iframe came from different domain. Because browser's xss protection, it prevents potential exploits rendered in iframe access to any data in the parent window (Zeppelin). This approach is implemented in Google Colab. IMO, (b) is more favorable while it makes security depends on 'trust' of a user. However, there's some expected complexity on implementation and configuration, such as * Passing result data to render from parent window to the iframe came from a different domain * Automatically resize iframe based on its content * client webbrowser should able to access Iframe domain. Or should able to configure an alternative domain to load iframe source. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-5167) Cannot enable helium package due to EACCES: permission denied, mkdir '/.cache'
Lee Moon Soo created ZEPPELIN-5167:
--
Summary: Cannot enable helium package due to EACCES: permission
denied, mkdir '/.cache'
Key: ZEPPELIN-5167
URL: https://issues.apache.org/jira/browse/ZEPPELIN-5167
Project: Zeppelin
Issue Type: Bug
Environment: I'm using the the zeppelin docker image
Reporter: Ori Nakar
Can not enable helium package due to
{code:java}
INFO [2020-12-17 14:20:54,342] ({qtp1179381257-29}
YarnTaskExecutor.java[execute]:54) - Running 'yarn config set cache-folder
/zeppelin/local-repo/helium-bundle/yarn-cache
--registry=https://registry.npmjs.org/' in /zeppelin/local-repo/helium-bundle
ERROR [2020-12-17 14:20:54,437] ({Thread-20} InputStreamHandler.java[log]:60) -
/zeppelin/local-repo/helium-bundle/node/yarn/dist/node_modules/mkdirp/index.js:90
ERROR [2020-12-17 14:20:54,438] ({Thread-20} InputStreamHandler.java[log]:60) -
throw err0;
ERROR [2020-12-17 14:20:54,438] ({Thread-20} InputStreamHandler.java[log]:60) -
^
ERROR [2020-12-17 14:20:54,438] ({Thread-20} InputStreamHandler.java[log]:60) -
ERROR [2020-12-17 14:20:54,438] ({Thread-20} InputStreamHandler.java[log]:60) -
Error: EACCES: permission denied, mkdir '/.cache'
ERROR [2020-12-17 14:20:54,438] ({Thread-20} InputStreamHandler.java[log]:60) -
at Error (native)
ERROR [2020-12-17 14:20:54,438] ({Thread-20} InputStreamHandler.java[log]:60) -
at Object.fs.mkdirSync (fs.js:922:18)
ERROR [2020-12-17 14:20:54,438] ({Thread-20} InputStreamHandler.java[log]:60) -
at sync
(/zeppelin/local-repo/helium-bundle/node/yarn/dist/node_modules/mkdirp/index.js:71:13)
ERROR [2020-12-17 14:20:54,439] ({Thread-20} InputStreamHandler.java[log]:60) -
at Function.sync
(/zeppelin/local-repo/helium-bundle/node/yarn/dist/node_modules/mkdirp/index.js:77:24)
ERROR [2020-12-17 14:20:54,439] ({Thread-20} InputStreamHandler.java[log]:60) -
at Object.
(/zeppelin/local-repo/helium-bundle/node/yarn/dist/bin/yarn.js:30:8)
ERROR [2020-12-17 14:20:54,440] ({Thread-20} InputStreamHandler.java[log]:60) -
at Module._compile (module.js:570:32)
ERROR [2020-12-17 14:20:54,440] ({Thread-20} InputStreamHandler.java[log]:60) -
at Object.Module._extensions..js (module.js:579:10)
ERROR [2020-12-17 14:20:54,440] ({Thread-20} InputStreamHandler.java[log]:60) -
at Module.load (module.js:487:32)
ERROR [2020-12-17 14:20:54,440] ({Thread-20} InputStreamHandler.java[log]:60) -
at tryModuleLoad (module.js:446:12)
ERROR [2020-12-17 14:20:54,440] ({Thread-20} InputStreamHandler.java[log]:60) -
at Function.Module._load (module.js:438:3)
ERROR [2020-12-17 14:20:54,445] ({qtp1179381257-29}
HeliumRestApi.java[enablePackage]:233) -
com.github.eirslett.maven.plugins.frontend.lib.TaskRunnerException: 'yarn
config set cache-folder /zeppelin/local-repo/helium-bundle/yarn-cache
--registry=https://registry.npmjs.org/' failed. (error code 1)
java.io.IOException:
com.github.eirslett.maven.plugins.frontend.lib.TaskRunnerException: 'yarn
config set cache-folder /zeppelin/local-repo/helium-bundle/yarn-cache
--registry=https://registry.npmjs.org/' failed. (error code 1)
at
org.apache.zeppelin.helium.HeliumBundleFactory.buildPackage(HeliumBundleFactory.java:440)
at org.apache.zeppelin.helium.Helium.enable(Helium.java:324)
at
org.apache.zeppelin.rest.HeliumRestApi.enablePackage(HeliumRestApi.java:227)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:76)
at
org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:148)
at
org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:191)
at
org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$ResponseOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:200)
at
org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:103)
at
org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:493)
at
org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:415)
at
org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:104)
at
[jira] [Created] (ZEPPELIN-5062) Highlight 0.9.0 new features and improvements on website
Lee Moon Soo created ZEPPELIN-5062: -- Summary: Highlight 0.9.0 new features and improvements on website Key: ZEPPELIN-5062 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5062 Project: Zeppelin Issue Type: Sub-task Reporter: Lee Moon Soo Highlights 0.9.0 new features and improvements on website -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4985) Instant visual feedback on high latency network environment
Lee Moon Soo created ZEPPELIN-4985: -- Summary: Instant visual feedback on high latency network environment Key: ZEPPELIN-4985 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4985 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.8.2 Reporter: Lee Moon Soo In high latency network environment (between web browser and zeppelin-server), some user actions on the browser (mouse click, keyboard input) such as 'run paragraph' and 'switch visualization', first send message to zeppelin server and wait for response message before making any update in the ui. This make user feel ui 'freeze' for a while. Especially on frequent actions, like * run paragraph * switch visualization can make instant visual feedback without waiting for server response, like * run paragraph -> change paragraph status to PENDING * switch visualization -> switch visualization immediately, without waiting for server response. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4760) Add description and homepage information on github repository
Lee Moon Soo created ZEPPELIN-4760: -- Summary: Add description and homepage information on github repository Key: ZEPPELIN-4760 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4760 Project: Zeppelin Issue Type: Improvement Reporter: Lee Moon Soo Attachments: image-2020-04-16-22-01-37-953.png Today, Zeppelin's Github repo description saying "Mirror of Apache Zeppelin". !image-2020-04-16-22-01-37-953.png! We can improve this using [.asf.yaml|https://cwiki.apache.org/confluence/display/INFRA/.asf.yaml+features+for+git+repositories] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4748) Let user dynamically format spark web ui url on Kubernetes environment through zeppelin.spark.uiWebUrl
Lee Moon Soo created ZEPPELIN-4748: -- Summary: Let user dynamically format spark web ui url on Kubernetes environment through zeppelin.spark.uiWebUrl Key: ZEPPELIN-4748 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4748 Project: Zeppelin Issue Type: Improvement Reporter: Lee Moon Soo Assignee: Lee Moon Soo Fix For: 0.9.0 When Zeppelin is running on Kubernetes, SparkUI URL should be dynamically generated, while Service name for Spark interpreter Pod is generated on runtime. And Ingress controller or reverse-proxy route traffic to SparkUI. Problem is, depends on those Ingress or reverse proxy configuration, SparkUI url should be generated in a different formats. Currently, generated url format is hardcoded to "//-.". And setting 'zeppelin.spark.uiWebUrl' static url doesn't make any sense while we can not know what url it will be before run. Therefore, 'zeppelin.spark.uiWebUrl' need more make sense to take url format in case of Kubernetes. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4699) Migrate helium registry infrastructure
Lee Moon Soo created ZEPPELIN-4699: -- Summary: Migrate helium registry infrastructure Key: ZEPPELIN-4699 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4699 Project: Zeppelin Issue Type: Task Reporter: Lee Moon Soo Helium registry is located in https://s3.amazonaws.com/helium-package/helium.(json|js) Source code for generating registry is located here, [https://github.com/ZEPL/helium-package-registry] However, the code and registry are not well maintained recently. I think we can consider migrate registry and generation code to somewhere community can more easily maintain. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4619) Run a note from commandline
Lee Moon Soo created ZEPPELIN-4619: -- Summary: Run a note from commandline Key: ZEPPELIN-4619 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4619 Project: Zeppelin Issue Type: New Feature Reporter: Lee Moon Soo Assignee: Lee Moon Soo Fix For: 0.9.0 Provide a command-line option to run a single note. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4618) Zeppelin on Kubernetes does not automatically configure Spark on Kubernetes
Lee Moon Soo created ZEPPELIN-4618: -- Summary: Zeppelin on Kubernetes does not automatically configure Spark on Kubernetes Key: ZEPPELIN-4618 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4618 Project: Zeppelin Issue Type: Bug Reporter: Lee Moon Soo Assignee: Lee Moon Soo Fix For: 0.9.0 Since ZEPPELIN-4440, Spark on Kubernetes is not correctly configured when Zeppelin is running on Kubernetes. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4387) travis_check.py
Lee Moon Soo created ZEPPELIN-4387: -- Summary: travis_check.py Key: ZEPPELIN-4387 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4387 Project: Zeppelin Issue Type: Sub-task Reporter: Lee Moon Soo Assignee: Lee Moon Soo Migrating all tests from Travis to Github Actions takes time. Meanwhile, we can make Github Actions run travis_check.py script and get rid of Jenkins. Which is relatively easy to do. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4385) Move CI to Github Action from Jenkins + Travis
Lee Moon Soo created ZEPPELIN-4385: -- Summary: Move CI to Github Action from Jenkins + Travis Key: ZEPPELIN-4385 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4385 Project: Zeppelin Issue Type: Task Reporter: Lee Moon Soo Currently, when a new pull request is created, 1. Individual contributor's travis integration build branch 2. Jenkins (managed by ASF infra) triggered and check individual contributor's travis build status 3. Pull request build status is displayed based on Jenkins's check result There was two reasons why Zeppelin project uses Jenkins + Individual contributor's travis integration. * Travis build slots in ASF organization is limited and couldn't get enough slot to build pullrequest and often PR waits more than 12h to be scheduled * Restarting individual flaky tests is not possible. while individual contributor doesn't have permission to access ASF's travis integration. Therefore, Flaky test fail require full test matrix restart and that was quite painful. While full test matrix run again produce other flaky test fails. However, Jenkins now only triggered by pullrequest from comitters. https://issues.apache.org/jira/browse/INFRA-19249 Lack of integration test on pull requests really make collative development difficult, in the community. Recently, Github added CI functionality through [Github Actions.|https://github.com/features/actions] I think we need to consider this. Reasons are - Can build all pull requests - Non shared build slots (Build slot is not shared with other ASF project, unlike Travis) - Individual contributor also able to run CI build their branch before making PR -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4363) Flaky test - ParagraphActionsIT.testSingleDynamicFormTextInput
Lee Moon Soo created ZEPPELIN-4363:
--
Summary: Flaky test -
ParagraphActionsIT.testSingleDynamicFormTextInput
Key: ZEPPELIN-4363
URL: https://issues.apache.org/jira/browse/ZEPPELIN-4363
Project: Zeppelin
Issue Type: Sub-task
Reporter: Lee Moon Soo
Attachments: image-2019-10-01-14-32-30-390.png
[https://api.travis-ci.org/v3/job/592216145/log.txt]
{code:java}
Results : Tests in error:
ParagraphActionsIT.testSingleDynamicFormTextInput:536->AbstractZeppelinIT.setTextOfParagraph:49
» NoSuchElement Tests run: 30, Failures: 0, Errors: 1, Skipped: 0{code}
screenshot taken here is
!image-2019-10-01-14-32-30-390.png!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4362) Tests around Flink interpreter are redundant in .travis.yml
Lee Moon Soo created ZEPPELIN-4362:
--
Summary: Tests around Flink interpreter are redundant in
.travis.yml
Key: ZEPPELIN-4362
URL: https://issues.apache.org/jira/browse/ZEPPELIN-4362
Project: Zeppelin
Issue Type: Improvement
Reporter: Lee Moon Soo
Assignee: Lee Moon Soo
Looks like .travis.yml runs Flink interpreter in multiple test matrix.
There's test matrix for 'flink'
{code:java}
# Test flink module- sudo: required jdk: "openjdk8" dist: xenial
env: PYTHON="3" SPARKR="true" PROFILE="-Pscala-2.11" BUILD_FLAG="clean
install -Pbuild-distr -DskipRat -am" TEST_FLAG="verify -Pusing-packaged-distr
-DskipRat" MODULES="-pl flink" TEST_PROJECTS="-DfailIfNoTests=false" {code}
However, test matrix for 'interpreter modules' also runs test in 'flink' modules
{code:java}
# Test interpreter modules- jdk: "openjdk8" dist: xenial env:
PYTHON="3" SPARKR="true" SCALA_VER="2.10" TENSORFLOW="1.0.0"
PROFILE="-Pscala-2.10" BUILD_FLAG="install -DskipTests -DskipRat -am"
TEST_FLAG="test -DskipRat" MODULES="-pl $(echo
.,zeppelin-interpreter,zeppelin-interpreter-api,${INTERPRETERS} | sed
's/!//g')" TEST_PROJECTS="" {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4361) PersonalizeActionsIT.testGraphAction test fail
Lee Moon Soo created ZEPPELIN-4361:
--
Summary: PersonalizeActionsIT.testGraphAction test fail
Key: ZEPPELIN-4361
URL: https://issues.apache.org/jira/browse/ZEPPELIN-4361
Project: Zeppelin
Issue Type: Bug
Reporter: Lee Moon Soo
[https://api.travis-ci.org/v3/job/591740764/log.txt]
{code:java}
Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 161.099 sec <<<
FAILURE! - in org.apache.zeppelin.integration.PersonalizeActionsIT
testGraphAction(org.apache.zeppelin.integration.PersonalizeActionsIT) Time
elapsed: 50.642 sec <<< FAILURE!
java.lang.AssertionError: The output of graph mode is not changed
Expected: "fa fa-bar-chart"
but: was "fa fa-table"
at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
at org.junit.Assert.assertThat(Assert.java:956)
at org.junit.rules.ErrorCollector$1.call(ErrorCollector.java:65)
at org.junit.rules.ErrorCollector.checkSucceeds(ErrorCollector.java:78)
at org.junit.rules.ErrorCollector.checkThat(ErrorCollector.java:63)
at
org.apache.zeppelin.integration.PersonalizeActionsIT.testGraphAction(PersonalizeActionsIT.java:252)
Results :
Failed tests:
PersonalizeActionsIT.testGraphAction:252 The output of graph mode is not
changed
Expected: "fa fa-bar-chart"
but: was "fa fa-table"
Tests run: 30, Failures: 1, Errors: 0, Skipped: 0 {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4357) LivyInterpreterIT fail
Lee Moon Soo created ZEPPELIN-4357:
--
Summary: LivyInterpreterIT fail
Key: ZEPPELIN-4357
URL: https://issues.apache.org/jira/browse/ZEPPELIN-4357
Project: Zeppelin
Issue Type: Bug
Reporter: Lee Moon Soo
{code:java}
Tests run: 6, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 271.271 sec <<<
FAILURE! - in org.apache.zeppelin.livy.LivyInterpreterIT
testSharedInterpreter(org.apache.zeppelin.livy.LivyInterpreterIT) Time
elapsed: 38.941 sec <<< FAILURE!
java.lang.AssertionError: expected: but was:
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:834)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:144)
at
org.apache.zeppelin.livy.LivyInterpreterIT.testSharedInterpreter(LivyInterpreterIT.java:768)
testSparkRInterpreter(org.apache.zeppelin.livy.LivyInterpreterIT) Time
elapsed: 23.92 sec <<< FAILURE!
java.lang.AssertionError: expected: but was:
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:834)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:144)
at
org.apache.zeppelin.livy.LivyInterpreterIT.testSparkRInterpreter(LivyInterpreterIT.java:602)
INFO [2019-09-27 16:48:56,063] ({Thread-0} Logging.scala[info]:39) - Shutting
down cluster pool.
Results :
Failed tests:
LivyInterpreterIT.testSharedInterpreter:768 expected: but was:
LivyInterpreterIT.testSparkRInterpreter:602 expected: but was:
Tests run: 6, Failures: 2, Errors: 0, Skipped: 0
{code}
[https://api.travis-ci.org/v3/job/590204255/log.txt]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4352) Test fail after ZEPPELIN-4331
Lee Moon Soo created ZEPPELIN-4352:
--
Summary: Test fail after ZEPPELIN-4331
Key: ZEPPELIN-4352
URL: https://issues.apache.org/jira/browse/ZEPPELIN-4352
Project: Zeppelin
Issue Type: Bug
Reporter: Lee Moon Soo
Unittest fail after
https://issues.apache.org/jira/browse/ZEPPELIN-4331
[https://api.travis-ci.org/v3/job/589061181/log.txt]
{code:java}
Results :
Failed tests:
CassandraInterpreterTest.should_describe_table:693 expected:<...ndex_interval
= 2048[];<...> but was:<...ndex_interval = 2048[AND
memtable_flush_period_in_ms = 0];<...>
CassandraInterpreterTest.should_describe_keyspace:609
expected:<...ndex_interval = 2048[;complex_table's
indicesNameTargetclustering2idxclustering2idx1indexed1idx2indexed2keys_map_idxkeys(key_indexed_map)pk2idxpk2As CQL
statementCREATE INDEX clustering2idx ON
live_data.complex_table (clustering2);CREATE INDEX idx1 ON
live_data.complex_table (indexed1);CREATE INDEX idx2 ON live_data.complex_table
(indexed2);CREATE INDEX keys_map_idx ON live_data.complex_table
(keys(key_indexed_map));CREATE INDEX pk2idx ON live_data.complex_table
(pk2);sensor_dataColumn TypeColumn NameData
Typesensor_iduuidmonthintcharacteristicsmaptext,
textmodel_numbertextprovidertextdatetimestampvaluedoubleAs CQL
statementCREATE TABLE live_data.sensor_data
(sensor_id uuid,month int,date timestamp,characteristics maptext, text
static,model_number text static,provider text static,value double,PRIMARY KEY
((sensor_id, month), date)) WITH CLUSTERING ORDER BY (date DESC)AND
read_repair_chance = 0.0AND dclocal_read_repair_chance = 0.1AND
gc_grace_seconds = 864000AND bloom_filter_fp_chance = 0.01AND caching = {
'keys' : 'ALL', 'rows_per_partition' : 'NONE' }AND comment = ''AND compaction =
{ 'class' : 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
}AND compression = { 'sstable_compression' :
'org.apache.cassandra.io.compress.LZ4Compressor' }AND default_time_to_live =
0AND speculative_retry = '99.0PERCENTILE'AND min_index_interval = 128AND
max_index_interval = 2048;stationsColumn TypeColumn NameData
Typestation_iduuidsensorsfrozenmapuuid,
frozenlive_data.geolocationAs
CQL statementCREATE TABLE live_data.stations (station_id
uuid,sensors frozenmapuuid,
frozenlive_data.geolocation,PRIMARY KEY (station_id)) WITH
read_repair_chance = 0.0AND dclocal_read_repair_chance = 0.1AND
gc_grace_seconds = 864000AND bloom_filter_fp_chance = 0.01AND caching = {
'keys' : 'ALL', 'rows_per_partition' : 'NONE' }AND comment = ''AND compaction =
{ 'class' : 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
}AND compression = { 'sstable_compression' :
'org.apache.cassandra.io.compress.LZ4Compressor' }AND default_time_to_live =
0AND speculative_retry = '99.0PERCENTILE'AND min_index_interval = 128AND
max_index_interval = 2048];<...> but was:<...ndex_interval =
2048[AND memtable_flush_period_in_ms = 0;complex_table's
indicesNameTargetclustering2idxclustering2idx1indexed1idx2indexed2keys_map_idxkeys(key_indexed_map)pk2idxpk2As CQL
statementCREATE INDEX clustering2idx ON
live_data.complex_table (clustering2);CREATE INDEX idx1 ON
live_data.complex_table (indexed1);CREATE INDEX idx2 ON live_data.complex_table
(indexed2);CREATE INDEX keys_map_idx ON live_data.complex_table
(keys(key_indexed_map));CREATE INDEX pk2idx ON live_data.complex_table
(pk2);sensor_dataColumn TypeColumn NameData
Typesensor_iduuidmonthintcharacteristicsmaptext,
textmodel_numbertextprovidertextdatetimestampvaluedoubleAs CQL
statementCREATE TABLE live_data.sensor_data
(sensor_id uuid,month int,date timestamp,characteristics maptext, text
static,model_number text static,provider text static,value double,PRIMARY KEY
((sensor_id, month), date)) WITH CLUSTERING ORDER BY (date DESC)AND
read_repair_chance = 0.0AND dclocal_read_repair_chance = 0.1AND
gc_grace_seconds = 864000AND bloom_filter_fp_chance = 0.01AND caching = {
'keys' : 'ALL', 'rows_per_partition' : 'NONE' }AND comment = ''AND compaction =
{ 'class' : 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
}AND compression = { 'sstable_compression' :
'org.apache.cassandra.io.compress.LZ4Compressor' }AND default_time_to_live =
0AND speculative_retry = '99.0PERCENTILE'AND min_index_interval = 128AND
max_index_interval = 2048AND memtable_flush_period_in_ms =
0;stationsColumn TypeColumn NameData
Typestation_iduuidsensorsfrozenmapuuid,
frozenlive_data.geolocationAs
CQL statementCREATE TABLE live_data.stations (station_id
uuid,sensors frozenmapuuid,
frozenlive_data.geolocation,PRIMARY KEY (station_id)) WITH
read_repair_chance = 0.0AND dclocal_read_repair_chance = 0.1AND
gc_grace_seconds = 864000AND bloom_filter_fp_chance = 0.01AND caching = {
'keys' : 'ALL', 'rows_per_partition' : 'NONE' }AND comment = ''AND compaction =
{ 'class' :
[jira] [Created] (ZEPPELIN-4351) Broken test after ZEPPELIN-4311
Lee moon soo created ZEPPELIN-4351:
--
Summary: Broken test after ZEPPELIN-4311
Key: ZEPPELIN-4351
URL: https://issues.apache.org/jira/browse/ZEPPELIN-4351
Project: Zeppelin
Issue Type: Bug
Reporter: Lee moon soo
Test broken after
https://issues.apache.org/jira/browse/ZEPPELIN-4311
{code:java}
Failed tests:
InterpreterRestApiTest.testRestartInterpreterPerNote:308 expected:<...y">
markdown
[
]> but was:<...y">
markdown
[]>
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4349) Flaky test - org.apache.zeppelin.python.IPythonInterpreterTest.testIPythonPlotting
Lee moon soo created ZEPPELIN-4349:
--
Summary: Flaky test -
org.apache.zeppelin.python.IPythonInterpreterTest.testIPythonPlotting
Key: ZEPPELIN-4349
URL: https://issues.apache.org/jira/browse/ZEPPELIN-4349
Project: Zeppelin
Issue Type: Sub-task
Reporter: Lee moon soo
[https://api.travis-ci.org/v3/job/589060103/log.txt]
{code:java}
Tests run: 11, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 71.611 sec <<<
FAILURE! - in org.apache.zeppelin.python.IPythonInterpreterTest
testIPythonPlotting(org.apache.zeppelin.python.IPythonInterpreterTest) Time
elapsed: 4.674 sec <<< FAILURE!
java.lang.AssertionError: expected:<2> but was:<3>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:834)
at org.junit.Assert.assertEquals(Assert.java:645)
at org.junit.Assert.assertEquals(Assert.java:631)
at
org.apache.zeppelin.python.IPythonInterpreterTest.testIPythonPlotting(IPythonInterpreterTest.java:234)
Running org.apache.zeppelin.python.PythonDockerInterpreterTest
WARN [2019-09-24 20:54:09,148] ({Exec Default Executor}
ProcessLauncher.java[onProcessFailed]:111) - Process is failed due to
org.apache.commons.exec.ExecuteException: Process exited with an error: 143
(Exit value: 143)
INFO [2019-09-24 20:54:09,148] ({Exec Default Executor}
ProcessLauncher.java[transition]:86) - Process state is transitioned to
TERMINATED
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in
org.apache.zeppelin.python.PythonDockerInterpreterTest
Results :
Failed tests:
IPythonInterpreterTest.testIPythonPlotting:234 expected:<2> but was:<3>
Tests run: 33, Failures: 1, Errors: 0, Skipped: 0 {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4348) Flaky test - ZeppelinSparkClusterTest.zRunTest
Lee moon soo created ZEPPELIN-4348:
--
Summary: Flaky test - ZeppelinSparkClusterTest.zRunTest
Key: ZEPPELIN-4348
URL: https://issues.apache.org/jira/browse/ZEPPELIN-4348
Project: Zeppelin
Issue Type: Sub-task
Reporter: Lee moon soo
{code:java}
20:33:30,993 ERROR org.apache.thrift.server.TThreadPoolServer:315 - Thrift
error occurred during processing of message.
org.apache.thrift.transport.TTransportException
at
org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at
org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:425)
at
org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:321)
at
org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:225)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:27)
at
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:310)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
20:33:30,993 WARN
org.apache.zeppelin.interpreter.remote.RemoteInterpreterManagedProcess:141 -
ignore the exception when shutting down
java.lang.RuntimeException: org.apache.thrift.transport.TTransportException
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterProcess.callRemoteFunction(RemoteInterpreterProcess.java:122)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterManagedProcess.stop(RemoteInterpreterManagedProcess.java:133)
at
org.apache.zeppelin.interpreter.ManagedInterpreterGroup.close(ManagedInterpreterGroup.java:106)
at
org.apache.zeppelin.interpreter.ManagedInterpreterGroup.close(ManagedInterpreterGroup.java:88)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.thrift.transport.TTransportException
at
org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at
org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:425)
at
org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:321)
at
org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:225)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at
org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.recv_shutdown(RemoteInterpreterService.java:347)
at
org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.shutdown(RemoteInterpreterService.java:335)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterManagedProcess$1.call(RemoteInterpreterManagedProcess.java:136)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterManagedProcess$1.call(RemoteInterpreterManagedProcess.java:133)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterProcess.callRemoteFunction(RemoteInterpreterProcess.java:118)
... 4 more
20:33:30,996 INFO
org.apache.zeppelin.interpreter.remote.RemoteInterpreterManagedProcess:147 -
Remote process terminated
20:33:30,997 INFO org.apache.zeppelin.rest.AbstractTestRestApi:303 -
Terminating test Zeppelin...
20:33:31,004 INFO org.eclipse.jetty.server.AbstractConnector:341 - Stopped
ServerConnector@49d8e094{HTTP/1.1,[http/1.1]}{0.0.0.0:8080}
20:33:31,004 WARN
org.apache.zeppelin.interpreter.remote.RemoteInterpreterManagedProcess:233 -
Process is exited with exit value 0
20:33:31,005 INFO org.apache.zeppelin.interpreter.util.ProcessLauncher:86 -
Process state is transitioned to COMPLETED
20:33:31,005 INFO org.eclipse.jetty.server.session:167 - node0 Stopped
scavenging
20:33:31,032 INFO org.eclipse.jetty.server.handler.ContextHandler:1045 -
Stopped
o.e.j.w.WebAppContext@6a7e1738{zeppelin-web,/,file:///home/travis/build/Leemoonsoo/zeppelin/zeppelin-web/dist/,UNAVAILABLE}
20:33:33,036 INFO org.apache.zeppelin.rest.AbstractTestRestApi:367 -
Connecting to http://localhost:8080/api/version
20:33:33,037 INFO org.apache.commons.httpclient.HttpMethodDirector:439 - I/O
exception (java.net.ConnectException) caught when processing request:
Connection refused (Connection refused)
20:33:33,038 INFO org.apache.commons.httpclient.HttpMethodDirector:445 -
Retrying request
20:33:33,038 INFO org.apache.commons.httpclient.HttpMethodDirector:439 - I/O
exception (java.net.ConnectException) caught when processing request:
Connection refused (Connection refused)
20:33:33,038 INFO org.apache.commons.httpclient.HttpMethodDirector:445 -
Retrying request
20:33:33,039 INFO
[jira] [Created] (ZEPPELIN-4339) Flaky tests org.apache.zeppelin.AbstractZeppelinIT#testAngularDisplay
Lee moon soo created ZEPPELIN-4339:
--
Summary: Flaky tests
org.apache.zeppelin.AbstractZeppelinIT#testAngularDisplay
Key: ZEPPELIN-4339
URL: https://issues.apache.org/jira/browse/ZEPPELIN-4339
Project: Zeppelin
Issue Type: Task
Reporter: Lee moon soo
Attachments: image-2019-09-19-15-15-38-804.png
Flaky test
19:41:34,777 ERROR org.apache.zeppelin.AbstractZeppelinIT:142 - Exception in
ZeppelinIT while testAngularDisplay org.openqa.selenium.TimeoutException:
Expected condition failed: waiting for
org.apache.zeppelin.AbstractZeppelinIT$1@5c530d1e (tried for 120 second(s) with
1 SECONDS interval) at
org.openqa.selenium.support.ui.FluentWait.timeoutException(FluentWait.java:263)
at org.openqa.selenium.support.ui.FluentWait.until(FluentWait.java:231) at
org.apache.zeppelin.AbstractZeppelinIT.pollingWait(AbstractZeppelinIT.java:99)
at
org.apache.zeppelin.AbstractZeppelinIT.waitForParagraph(AbstractZeppelinIT.java:73)
at
org.apache.zeppelin.integration.ZeppelinIT.testAngularDisplay(ZeppelinIT.java:108)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498) at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.Verifier$1.evaluate(Verifier.java:35) at
org.junit.rules.RunRules.evaluate(RunRules.java:20) at
org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at
org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at
org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at
org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at
org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at
org.junit.runners.ParentRunner.run(ParentRunner.java:363) at
org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264)
at
org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
at
org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124)
at
org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200)
at
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153)
at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
Caused by: org.openqa.selenium.NoSuchElementException: Unable to locate
element:
\{"method":"xpath","selector":"(//div[@ng-controller=\"ParagraphCtrl\"])[3]//div[contains(@class,
'control')]//span[2][contains(.,'FINISHED')]"} Command duration or timeout: 0
milliseconds at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method) at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at
org.openqa.selenium.remote.ErrorHandler.createThrowable(ErrorHandler.java:214)
at
org.openqa.selenium.remote.ErrorHandler.throwIfResponseFailed(ErrorHandler.java:166)
at
org.openqa.selenium.remote.http.JsonHttpResponseCodec.reconstructValue(JsonHttpResponseCodec.java:40)
at
org.openqa.selenium.remote.http.AbstractHttpResponseCodec.decode(AbstractHttpResponseCodec.java:80)
at
org.openqa.selenium.remote.http.AbstractHttpResponseCodec.decode(AbstractHttpResponseCodec.java:44)
at
org.openqa.selenium.remote.HttpCommandExecutor.execute(HttpCommandExecutor.java:164)
at
org.openqa.selenium.remote.service.DriverCommandExecutor.execute(DriverCommandExecutor.java:83)
at
org.openqa.selenium.remote.RemoteWebDriver.execute(RemoteWebDriver.java:601) at
org.openqa.selenium.remote.RemoteWebDriver.findElement(RemoteWebDriver.java:371)
at
org.openqa.selenium.remote.RemoteWebDriver.findElementByXPath(RemoteWebDriver.java:473)
at org.openqa.selenium.By$ByXPath.findElement(By.java:361) at
org.openqa.selenium.remote.RemoteWebDriver.findElement(RemoteWebDriver.java:363)
at
[jira] [Created] (ZEPPELIN-4338) Docker image build error
Lee moon soo created ZEPPELIN-4338:
--
Summary: Docker image build error
Key: ZEPPELIN-4338
URL: https://issues.apache.org/jira/browse/ZEPPELIN-4338
Project: Zeppelin
Issue Type: Task
Reporter: Lee moon soo
Assignee: Lee moon soo
Fix For: 0.9.0, 0.8.2
Docker image build error with /script/docker/zeppelin/bin/Dockerfile
{code:java}
After this operation, 103 MB of additional disk space will be used.
WARNING: The following packages cannot be authenticated!
r-base-core r-cran-boot r-cran-cluster r-cran-foreign r-cran-mass
r-cran-kernsmooth r-cran-lattice r-cran-nlme r-cran-matrix r-cran-mgcv
r-cran-rpart r-cran-survival r-cran-class r-cran-nnet r-cran-spatial
r-cran-codetools r-recommended r-base r-base-dev r-base-html r-doc-html
E: There were unauthenticated packages and -y was used without
--allow-unauthenticated
The command '/bin/sh -c echo "$LOG_TAG Install R related packages" && echo
"deb http://cran.rstudio.com/bin/linux/ubuntu xenial/" | tee -a
/etc/apt/sources.list && gpg --keyserver keyserver.ubuntu.com --recv-key
E084DAB9 && gpg -a --export E084DAB9 | apt-key add - && apt-get -y
update && apt-get -y install r-base r-base-dev && R -e
"install.packages('knitr', repos='http://cran.us.r-project.org')" && R -e
"install.packages('ggplot2', repos='http://cran.us.r-project.org')" && R -e
"install.packages('googleVis', repos='http://cran.us.r-project.org')" && R
-e "install.packages('data.table', repos='http://cran.us.r-project.org')" &&
apt-get -y install libcurl4-gnutls-dev libssl-dev && R -e
"install.packages('devtools', repos='http://cran.us.r-project.org')" && R
-e "install.packages('Rcpp', repos='http://cran.us.r-project.org')" &&
Rscript -e "library('devtools'); library('Rcpp');
install_github('ramnathv/rCharts')"' returned a non-zero code: 100{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4333) Escape popup dialog title and message
Lee moon soo created ZEPPELIN-4333: -- Summary: Escape popup dialog title and message Key: ZEPPELIN-4333 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4333 Project: Zeppelin Issue Type: Task Components: front-end Affects Versions: 0.8.1 Reporter: Lee moon soo Assignee: Lee moon soo Fix For: 0.8.2 There're couple of places we're not escaping contents of popup dialog (title, message) -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (ZEPPELIN-4100) Builtin visualization enhanced streaming support
Lee moon soo created ZEPPELIN-4100: -- Summary: Builtin visualization enhanced streaming support Key: ZEPPELIN-4100 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4100 Project: Zeppelin Issue Type: Task Affects Versions: 0.8.1 Reporter: Lee moon soo Fix For: 0.9.0 ZEPPELIN-3340 introduced support for streaming data visualization. However, has some limitations like # Initial chart selection and setup required # Switching visualization during progress is not possible # Multiple paragraphs in a note cannot be updated in real-time (while multiple paragraphs cannot run concurrently). This issue will address limitation 1, 2, 3. So a note can have multiple visualizations that updated in real-time, with capabilities to change chart type on the fly. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-4024) Dark theme
Lee moon soo created ZEPPELIN-4024: -- Summary: Dark theme Key: ZEPPELIN-4024 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4024 Project: Zeppelin Issue Type: Task Reporter: Lee moon soo Who don't want dark theme? :) -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-4023) Document note file conversion from 0.8 -> 0.9
Lee moon soo created ZEPPELIN-4023: -- Summary: Document note file conversion from 0.8 -> 0.9 Key: ZEPPELIN-4023 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4023 Project: Zeppelin Issue Type: Task Components: documentation Reporter: Lee moon soo Fix For: 0.9.0 Since 0.9.0 changes note file naming convention, how to convert existing note files need to be documented and well explained from install / upgrade section. * Include note file naming convention change on release note * Explain how to convert old files to newer version in docs/setup/operation/upgrading.md * Add docs for property zeppelin.notebook.new_format.convert and zeppelin.notebook.new_format.delete_old introduced [https://github.com/apache/zeppelin/pull/3189] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-4022) Release 0.9.0
Lee moon soo created ZEPPELIN-4022: -- Summary: Release 0.9.0 Key: ZEPPELIN-4022 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4022 Project: Zeppelin Issue Type: Task Reporter: Lee moon soo Fix For: 0.9.0 Umbrella issue that tracks release 0.9.0. Please link any blockers here. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-4004) RemoteResource.invokeMethod() has broken
Lee moon soo created ZEPPELIN-4004: -- Summary: RemoteResource.invokeMethod() has broken Key: ZEPPELIN-4004 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4004 Project: Zeppelin Issue Type: Bug Affects Versions: 0.8.1 Reporter: Lee moon soo Assignee: Lee moon soo RemoteResource is a representation of object in ResourcePool in Interpreter running on another process. RemoteResource provides a invokeMethod() to call method of an object remotely, which is not working now. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3994) Notebook serving
Lee moon soo created ZEPPELIN-3994:
--
Summary: Notebook serving
Key: ZEPPELIN-3994
URL: https://issues.apache.org/jira/browse/ZEPPELIN-3994
Project: Zeppelin
Issue Type: New Feature
Reporter: Lee moon soo
h2. Motivation
Notebook is useful for interactive analysis. But bringing a model in a Note to
production is another challenge. Often, we see two approaches
a. Call paragraph using Rest API to ZeppelinServer
b. Reimplement model outside the notebook and deploy it without using Zeppelin.
Approach a) brings some headache because of Zeppelin server is not fault
tolerant and can be restarted at any moment intentionally (for changing
configuration, etc). Also notebook to be run through REST API can be changed at
any time without notice.
Approach b) has a clear down side. "re-implementation".
So, It'll be great if a Note can be deployed independently from ZeppelinServer
with RestAPI endpoint, with high availability support. It makes following
usecase really easy and reliable for production use
# Create model in Zeppelin (or any function)
# Click deploy button in a Note
# Access model (any function) using REST api.
h2. Requirements
* Note can be deployed through GUI in a single click ('Deploy' button on every
Note)
* Once Note is deployed, it runs independently from ZeppelinServer. Deployed
Note should keep up and running even if ZeppelinServer is restarting/stopped.
* ZeppelinServer provide a GUI to manage deployments
* Deployed note should be highly available.
* Runs on Kubernetes
h2. Design
h3. Deploy button
Each note have a 'Deploy' button.
h3. On deploy button click
On 'Deploy' button click, following will happen.
* ZeppelinServer creates a new Pod
** The pod snapshot Notebook directory mount it.
** The pod runs another ZeppelinServer
** Current login session information is transferred to the new ZeppelinServer
* ZeppelinServer in a new Pod runs paragraphs in the Note
** Depends on Note, it'll run multiple interpreters.
** Interpreters are running in Kubernetes Deployment Resource instead of Pod
resource.
* Once all paragraphs are successfully run, delete a new ZeppelinServer Pod
and all other Interpreter Deployment resource except for default Interpreter
Deployment resource of the Note.
For example, when A note has Markdown and Python paragraph with python as
default interpreter of a Note, then ZeppelinServer, python and Markdown
interpreter will be created after 'deploy' button click, but ZeppelinServer and
Markdown interpreter will be terminated after successful note run. And Python
interpreter will be remained for serving.
h3. Register model (or any function) to be served
Each interpreter has a
[ResourcePool|https://github.com/apache/zeppelin/blob/master/zeppelin-interpreter/src/main/java/org/apache/zeppelin/resource/ResourcePool.java].
And ResourcePool is programmatically accessible by enduser. For example, user
can register arbitrary object into ResourcePool using API.
{code:java}
%spark
val myModel =
z.put("model_1", myModel){code}
h3. Access model (or any function) from Rest api Endpoint
Every object registered in the ResourcePool is wrapped by
[Resource|https://github.com/apache/zeppelin/blob/master/zeppelin-interpreter/src/main/java/org/apache/zeppelin/resource/Resource.java#L151].
Resource provide method invocation using
[Resource.invokeMethod()|https://github.com/apache/zeppelin/blob/master/zeppelin-interpreter/src/main/java/org/apache/zeppelin/resource/Resource.java#L151].
RemoteInterpreterServer provide a rest api endpoint to call method of Resource
in its ResourcePool. Such as
{code:java}
//{code}
and pass parameters of method using POST param or something.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3989) Configure IPython Interpreter in Docker image
Lee moon soo created ZEPPELIN-3989: -- Summary: Configure IPython Interpreter in Docker image Key: ZEPPELIN-3989 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3989 Project: Zeppelin Issue Type: Task Affects Versions: 0.8.0 Reporter: Lee moon soo Assignee: Lee moon soo Fix For: 0.8.1 It'll be nice if Zeppelin docker image installs necessary libraries to enable IPython Interpreter. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3988) Text output include '\r' char does not displayed correctly
Lee moon soo created ZEPPELIN-3988: -- Summary: Text output include '\r' char does not displayed correctly Key: ZEPPELIN-3988 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3988 Project: Zeppelin Issue Type: Task Affects Versions: 0.8.0 Reporter: Lee moon soo Assignee: Lee moon soo Fix For: 0.8.1 Text output '\r' is not displayed. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3982) Document how to setup development environment for Zeppelin on Kubernetes
Lee moon soo created ZEPPELIN-3982: -- Summary: Document how to setup development environment for Zeppelin on Kubernetes Key: ZEPPELIN-3982 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3982 Project: Zeppelin Issue Type: Task Reporter: Lee moon soo Assignee: Lee moon soo Explain how to setup development environment for Zeppelin on Kubernetes that enables local development without build package and docker image on every code change. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3954) Use "kubectl create -f" instead of "kubectl apply -f"
Lee moon soo created ZEPPELIN-3954: -- Summary: Use "kubectl create -f" instead of "kubectl apply -f" Key: ZEPPELIN-3954 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3954 Project: Zeppelin Issue Type: Improvement Components: Kubernetes Reporter: Lee moon soo Use "kubectl create -f" instead of "kubectl apply -f" on creating interpreter pod. Possible problem explained in [this comment|https://github.com/apache/zeppelin/pull/3240#discussion_r248567845]. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3868) Quick start menu link broken in the website
Lee moon soo created ZEPPELIN-3868: -- Summary: Quick start menu link broken in the website Key: ZEPPELIN-3868 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3868 Project: Zeppelin Issue Type: Bug Reporter: Lee moon soo Assignee: Lee moon soo Quickstart menu item link has broken. For example go to page https://zeppelin.apache.org/community.html and then click "QuickStart" on the menu. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3854) Flaky test - org.apache.zeppelin.scheduler.RemoteSchedulerTest.testAbortOnPending
Lee moon soo created ZEPPELIN-3854:
--
Summary: Flaky test -
org.apache.zeppelin.scheduler.RemoteSchedulerTest.testAbortOnPending
Key: ZEPPELIN-3854
URL: https://issues.apache.org/jira/browse/ZEPPELIN-3854
Project: Zeppelin
Issue Type: Sub-task
Reporter: Lee moon soo
https://api.travis-ci.org/v3/job/446566408/log.txt
{code}
Tests run: 2, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 12.265 sec <<<
FAILURE! - in org.apache.zeppelin.scheduler.RemoteSchedulerTest
testAbortOnPending(org.apache.zeppelin.scheduler.RemoteSchedulerTest) Time
elapsed: 7.019 sec <<< FAILURE!
java.lang.AssertionError: null
at org.junit.Assert.fail(Assert.java:86)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.junit.Assert.assertTrue(Assert.java:52)
at
org.apache.zeppelin.scheduler.RemoteSchedulerTest.testAbortOnPending(RemoteSchedulerTest.java:258)
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3853) Flaky test - IPySparkInterpreterTest
Lee moon soo created ZEPPELIN-3853:
--
Summary: Flaky test - IPySparkInterpreterTest
Key: ZEPPELIN-3853
URL: https://issues.apache.org/jira/browse/ZEPPELIN-3853
Project: Zeppelin
Issue Type: Sub-task
Reporter: Lee moon soo
IPySparkInterpreterTest
https://api.travis-ci.org/v3/job/446566416/log.txt
{code}
08:35:39,940 INFO org.apache.zeppelin.python.IPythonInterpreter:334 - Kill
IPython Process
08:35:39,946 ERROR io.grpc.internal.SerializingExecutor:126 - Exception while
executing runnable
io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed@64d7d2fe
java.lang.NullPointerException
at
io.grpc.stub.ClientCalls$StreamObserverToCallListenerAdapter.onClose(ClientCalls.java:434)
at
io.grpc.PartialForwardingClientCallListener.onClose(PartialForwardingClientCallListener.java:39)
at
io.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:23)
at
io.grpc.ForwardingClientCallListener$SimpleForwardingClientCallListener.onClose(ForwardingClientCallListener.java:40)
at
io.grpc.internal.CensusStatsModule$StatsClientInterceptor$1$1.onClose(CensusStatsModule.java:678)
at
io.grpc.PartialForwardingClientCallListener.onClose(PartialForwardingClientCallListener.java:39)
at
io.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:23)
at
io.grpc.ForwardingClientCallListener$SimpleForwardingClientCallListener.onClose(ForwardingClientCallListener.java:40)
at
io.grpc.internal.CensusTracingModule$TracingClientInterceptor$1$1.onClose(CensusTracingModule.java:403)
at
io.grpc.internal.ClientCallImpl.closeObserver(ClientCallImpl.java:459)
at io.grpc.internal.ClientCallImpl.access$300(ClientCallImpl.java:63)
at
io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.close(ClientCallImpl.java:546)
at
io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.access$600(ClientCallImpl.java:467)
at
io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInContext(ClientCallImpl.java:584)
at io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at
io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
08:35:39,949 INFO org.apache.zeppelin.spark.NewSparkInterpreter:138 - Close
SparkInterpreter
Tests run: 8, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 194.415 sec <<<
FAILURE! - in org.apache.zeppelin.spark.IPySparkInterpreterTest
testIPythonAdvancedFeatures(org.apache.zeppelin.spark.IPySparkInterpreterTest)
Time elapsed: 35.429 sec <<< ERROR!
java.lang.RuntimeException: Fail to open IPythonInterpreter
at
org.apache.zeppelin.python.IPythonInterpreter.launchIPythonKernel(IPythonInterpreter.java:309)
at
org.apache.zeppelin.python.IPythonInterpreter.open(IPythonInterpreter.java:148)
at
org.apache.zeppelin.spark.IPySparkInterpreter.open(IPySparkInterpreter.java:66)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69)
at
org.apache.zeppelin.spark.IPySparkInterpreterTest.startInterpreter(IPySparkInterpreterTest.java:93)
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3852) Flaky test - org.apache.zeppelin.helium.HeliumBundleFactoryTest
Lee moon soo created ZEPPELIN-3852:
--
Summary: Flaky test -
org.apache.zeppelin.helium.HeliumBundleFactoryTest
Key: ZEPPELIN-3852
URL: https://issues.apache.org/jira/browse/ZEPPELIN-3852
Project: Zeppelin
Issue Type: Sub-task
Reporter: Lee moon soo
org.apache.zeppelin.helium.HeliumBundleFactoryTest sometimes hangs
{code}
Running org.apache.zeppelin.helium.HeliumBundleFactoryTest
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/home/travis/build/apache/zeppelin/zeppelin-interpreter/target/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/home/travis/.m2/repository/org/slf4j/slf4j-log4j12/1.7.10/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
02:51:04,445 INFO
com.github.eirslett.maven.plugins.frontend.lib.NodeInstaller:83 - Installing
node version v6.9.1
02:51:04,448 INFO
com.github.eirslett.maven.plugins.frontend.lib.NodeInstaller:314 - Downloading
https://nodejs.org/dist/v6.9.1/node-v6.9.1-linux-x64.tar.gz to
/home/travis/build/apache/zeppelin/zeppelin-zengine/target/tmp/ZeppelinLTest_nodeCache/cache/node-v6.9.1-linux-x64.tar.gz
02:51:04,450 INFO
com.github.eirslett.maven.plugins.frontend.lib.ProxyConfig:27 - No proxies
configured
02:51:04,450 INFO
com.github.eirslett.maven.plugins.frontend.lib.FileDownloader:91 - No proxy was
configured, downloading directly
02:51:05,810 INFO
com.github.eirslett.maven.plugins.frontend.lib.NodeInstaller:301 - Unpacking
/home/travis/build/apache/zeppelin/zeppelin-zengine/target/tmp/ZeppelinLTest_nodeCache/cache/node-v6.9.1-linux-x64.tar.gz
into
/home/travis/build/apache/zeppelin/zeppelin-zengine/target/tmp/ZeppelinLTest_nodeCache/node/tmp
02:51:06,641 INFO
com.github.eirslett.maven.plugins.frontend.lib.NodeInstaller:153 - Copying node
binary from
/home/travis/build/apache/zeppelin/zeppelin-zengine/target/tmp/ZeppelinLTest_nodeCache/node/tmp/node-v6.9.1-linux-x64/bin/node
to
/home/travis/build/apache/zeppelin/zeppelin-zengine/target/tmp/ZeppelinLTest_nodeCache/node/node
02:51:06,796 INFO
com.github.eirslett.maven.plugins.frontend.lib.NodeInstaller:182 - Installed
node locally.
02:51:06,798 INFO
com.github.eirslett.maven.plugins.frontend.lib.NPMInstaller:117 - Installing
npm version 3.10.8
02:51:06,798 INFO
com.github.eirslett.maven.plugins.frontend.lib.NPMInstaller:198 - Downloading
http://registry.npmjs.org//npm/-/npm-3.10.8.tgz to
/home/travis/build/apache/zeppelin/zeppelin-zengine/target/tmp/ZeppelinLTest_nodeCache/cache/npm-3.10.8.tar.gz
02:51:06,799 INFO
com.github.eirslett.maven.plugins.frontend.lib.ProxyConfig:27 - No proxies
configured
02:51:06,799 INFO
com.github.eirslett.maven.plugins.frontend.lib.FileDownloader:91 - No proxy was
configured, downloading directly
02:51:06,912 INFO
com.github.eirslett.maven.plugins.frontend.lib.NPMInstaller:185 - Unpacking
/home/travis/build/apache/zeppelin/zeppelin-zengine/target/tmp/ZeppelinLTest_nodeCache/cache/npm-3.10.8.tar.gz
into
/home/travis/build/apache/zeppelin/zeppelin-zengine/target/tmp/ZeppelinLTest_nodeCache/node/node_modules
02:51:07,343 INFO
com.github.eirslett.maven.plugins.frontend.lib.NPMInstaller:165 - Installed npm
locally.
02:51:07,346 INFO
com.github.eirslett.maven.plugins.frontend.lib.YarnInstaller:97 - Installing
Yarn version v0.21.3
02:51:07,346 INFO
com.github.eirslett.maven.plugins.frontend.lib.YarnInstaller:154 - Downloading
https://github.com/yarnpkg/yarn/releases/download/v0.21.3/yarn-v0.21.3.tar.gz
to
/home/travis/build/apache/zeppelin/zeppelin-zengine/target/tmp/ZeppelinLTest_nodeCache/cache/yarn-v0.21.3./yarn-v0.21.3.tar.gz
02:51:07,346 INFO
com.github.eirslett.maven.plugins.frontend.lib.ProxyConfig:27 - No proxies
configured
02:51:07,348 INFO
com.github.eirslett.maven.plugins.frontend.lib.FileDownloader:91 - No proxy was
configured, downloading directly
02:51:07,532 WARN org.apache.http.client.protocol.ResponseProcessCookies:129 -
Invalid cookie header: "Set-Cookie: has_recent_activity=1; path=/; expires=Mon,
05 Nov 2018 03:51:07 -". Invalid 'expires' attribute: Mon, 05 Nov 2018
03:51:07 -
02:51:07,533 WARN org.apache.http.client.protocol.ResponseProcessCookies:129 -
Invalid cookie header: "Set-Cookie: logged_in=no; domain=.github.com; path=/;
expires=Fri, 05 Nov 2038 02:51:07 -; secure; HttpOnly". Invalid 'expires'
attribute: Fri, 05 Nov 2038 02:51:07 -
02:51:08,002 INFO
com.github.eirslett.maven.plugins.frontend.lib.YarnInstaller:141 - Unpacking
/home/travis/build/apache/zeppelin/zeppelin-zengine/target/tmp/ZeppelinLTest_nodeCache/cache/yarn-v0.21.3./yarn-v0.21.3.tar.gz
into
[jira] [Created] (ZEPPELIN-3851) Flaky test - LivyInterpreterIT
Lee moon soo created ZEPPELIN-3851:
--
Summary: Flaky test - LivyInterpreterIT
Key: ZEPPELIN-3851
URL: https://issues.apache.org/jira/browse/ZEPPELIN-3851
Project: Zeppelin
Issue Type: Sub-task
Reporter: Lee moon soo
Flaky test on
- LivyInterpreterIT.testPySparkInterpreter
-
LivyInterpreterIT.testSparkInterpreterWithDisplayAppInfo_StringWithoutTruncation
- LivyInterpreterIT.testSparkInterpreter
{code}
18/11/05 02:59:45 INFO Client: Application report for
application_1541386527524_0006 (state: ACCEPTED)
18/11/05 02:59:45 INFO Client:
client token: N/A
diagnostics: N/A
ApplicationMaster host: N/A
ApplicationMaster RPC port: -1
queue: default
start time: 1541386785198
final status: UNDEFINED
tracking URL:
http://travis-job-ebd07cc4-099c-4b69-be82-33e56b246eba:40966/proxy/application_1541386527524_0006/
user: travis
18/11/05 02:59:45 INFO ShutdownHookManager: Shutdown hook called
18/11/05 02:59:45 INFO ShutdownHookManager: Deleting directory
/tmp/spark-261368a3-9d39-4f78-92fa-88ff256924c9
YARN Diagnostics:
Application killed by user.
at
org.apache.zeppelin.livy.BaseLivyInterpreter.createSession(BaseLivyInterpreter.java:332)
at
org.apache.zeppelin.livy.BaseLivyInterpreter.initLivySession(BaseLivyInterpreter.java:186)
at
org.apache.zeppelin.livy.BaseLivyInterpreter.open(BaseLivyInterpreter.java:163)
at
org.apache.zeppelin.livy.LivyInterpreterIT.testSparkInterpreter(LivyInterpreterIT.java:108)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at
org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264)
at
org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
at
org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124)
at
org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200)
at
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153)
at
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
INFO [2018-11-05 03:01:10,292] ({main} LivyInterpreterIT.java[tearDown]:71) -
Shutting down livy at
http://travis-job-ebd07cc4-099c-4b69-be82-33e56b246eba:8998
Tests run: 6, Failures: 1, Errors: 2, Skipped: 0, Time elapsed: 366.203 sec <<<
FAILURE! - in org.apache.zeppelin.livy.LivyInterpreterIT
testPySparkInterpreter(org.apache.zeppelin.livy.LivyInterpreterIT) Time
elapsed: 25.45 sec <<< FAILURE!
java.lang.AssertionError: expected: but was:
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:834)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:144)
at
org.apache.zeppelin.livy.LivyInterpreterIT.testPySparkInterpreter(LivyInterpreterIT.java:397)
testSparkInterpreterWithDisplayAppInfo_StringWithoutTruncation(org.apache.zeppelin.livy.LivyInterpreterIT)
Time elapsed: 90.882 sec <<< ERROR!
org.apache.zeppelin.interpreter.InterpreterException: Fail to create session,
please check livy interpreter log and livy server log
at
org.apache.zeppelin.livy.BaseLivyInterpreter.createSession(BaseLivyInterpreter.java:332)
[jira] [Created] (ZEPPELIN-3850) "Run all paragraphs" button runs only the first paragraph on the note
Lee moon soo created ZEPPELIN-3850: -- Summary: "Run all paragraphs" button runs only the first paragraph on the note Key: ZEPPELIN-3850 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3850 Project: Zeppelin Issue Type: Bug Affects Versions: 0.9.0 Reporter: Lee moon soo Assignee: Lee moon soo Fix For: 0.9.0 On master branch, "Run all paragraphs" button runs only the first paragraph. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3849) Note id is displayed instead of name
Lee moon soo created ZEPPELIN-3849: -- Summary: Note id is displayed instead of name Key: ZEPPELIN-3849 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3849 Project: Zeppelin Issue Type: Bug Affects Versions: 0.9.0 Reporter: Lee moon soo Assignee: Lee moon soo Fix For: 0.9.0 Note name is not displayed correctly after ZEPPELIN-2619 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3848) zeppelin-web dev mode does not work
Lee moon soo created ZEPPELIN-3848:
--
Summary: zeppelin-web dev mode does not work
Key: ZEPPELIN-3848
URL: https://issues.apache.org/jira/browse/ZEPPELIN-3848
Project: Zeppelin
Issue Type: New Feature
Reporter: Lee moon soo
Assignee: Lee moon soo
Fix For: 0.9.0
zeppelin-web development mode `npm run dev` does not work with error.
{code:java}
module.js:471
throw err;
^
Error: Cannot find module 'webpack/bin/config-yargs'
at Function.Module._resolveFilename (module.js:469:15)
at Function.Module._load (module.js:417:25)
at Module.require (module.js:497:17)
at require (internal/module.js:20:19)
at Object.
(/Users/moon/Projects/zeppelin/zeppelin-web/node_modules/webpack-dev-server/bin/webpack-dev-server.js:54:1)
at Module._compile (module.js:570:32)
at Object.Module._extensions..js (module.js:579:10)
at Module.load (module.js:487:32)
at tryModuleLoad (module.js:446:12)
at Function.Module._load (module.js:438:3){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3840) Zeppelin on Kubernetes
Lee moon soo created ZEPPELIN-3840:
--
Summary: Zeppelin on Kubernetes
Key: ZEPPELIN-3840
URL: https://issues.apache.org/jira/browse/ZEPPELIN-3840
Project: Zeppelin
Issue Type: New Feature
Reporter: Lee moon soo
Assignee: Lee moon soo
Fix For: 0.9.0
h2.
h2. Goal
Make Zeppelin run on Kubernetes environment.
- Run Zeppelin daemon as a Deployment, with RBAC to create/delete Pods for
interpreters
- Run Standard interpreters as Pods
- Run Spark interpreter with Spark Cluster deployed in Kubernetes cluster.
h2. How it works
# Zeppelin-daemon is deployed in Kubernetes with necessary Role (RBAC).
e.g. kubectl apply -f ${ZEPPELIN_HOME}/k8s/zeppelin.yaml
# Zeppelin-daemon automatically configure itself to use
K8sStandardInterpreterLauncher, K8sSparkInterpreterLauncher instead of
[StandardInterpreterLauncher|https://github.com/apache/zeppelin/blob/master/zeppelin-plugins/launcher/standard/src/main/java/org/apache/zeppelin/interpreter/launcher/StandardInterpreterLauncher.java],
[SparkInterpreterLauncher|https://github.com/apache/zeppelin/blob/master/zeppelin-plugins/launcher/spark/src/main/java/org/apache/zeppelin/interpreter/launcher/SparkInterpreterLauncher.java].
## K8sStandardInterpreterLauncher run an interpreter as a Pod
## K8sSparkInterpreterLauncher run spark interpreter with Spark cluster in the
Kubernetes cluster.
So user can start to use Zeppelin on Kubernetes with zero configuration.
Customize the interpreter pod
User can easily modify, extend zeppelin.yaml as their needs. (like mount volume
to persist configuration and notebook, etc) To provide the same customization
capability to interpreter pod, Zeppelin stores interpreter pod spec (yaml)
files in the directory "${ZEPPELIN_HOME}/k8s/interpreter/", and all yaml files
in the directory. So user can modify pod spec file or add more.
h2. Spark interpreter in Kubernetes
Spark Interpreter not only runs itself in Kubernetes as a Pod, but also creates
Spark cluster. Spark-summit can deploy spark cluster as well in Kubernetes. see
[https://spark.apache.org/docs/2.3.0/running-on-kubernetes.html.] Also there's
a PR we can check [https://github.com/apache/zeppelin/pull/2637].
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3839) A Tutorial notebook filename is not compatible with MS Windows
Lee moon soo created ZEPPELIN-3839: -- Summary: A Tutorial notebook filename is not compatible with MS Windows Key: ZEPPELIN-3839 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3839 Project: Zeppelin Issue Type: Bug Reporter: Lee moon soo Assignee: Lee moon soo Fix For: 0.9.0 [https://github.com/apache/zeppelin/pull/3186] includes '|' (pipe) in one of Tutorial notebook filename. '|' is reserved char in windows filesystem. see [https://docs.microsoft.com/en-us/windows/desktop/fileio/naming-a-file]. This is also a reason why appveyor is failing. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3837) Make 'how to build' up to date.
Lee moon soo created ZEPPELIN-3837: -- Summary: Make 'how to build' up to date. Key: ZEPPELIN-3837 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3837 Project: Zeppelin Issue Type: Task Reporter: Lee moon soo Assignee: Lee moon soo Fix For: 0.9.0 docs/setup/basics/how_to_build.md is bit outdated. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3836) zeppelin.apache.org/docs/latest points 0.7.3, instead of 0.8.0
Lee moon soo created ZEPPELIN-3836: -- Summary: zeppelin.apache.org/docs/latest points 0.7.3, instead of 0.8.0 Key: ZEPPELIN-3836 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3836 Project: Zeppelin Issue Type: Task Reporter: Lee moon soo Assignee: Lee moon soo [https://zeppelin.apache.org/docs/latest] points 0.7.3 version doc, instead of 0.8.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3835) Update website "what's new" section for 0.8.0 release.
Lee moon soo created ZEPPELIN-3835: -- Summary: Update website "what's new" section for 0.8.0 release. Key: ZEPPELIN-3835 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3835 Project: Zeppelin Issue Type: Task Reporter: Lee moon soo Assignee: Lee moon soo Update website "what's new" section for 0.8.0 release. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3554) Flaky test - InterpreterContextTest.testThreadLocal
Lee moon soo created ZEPPELIN-3554:
--
Summary: Flaky test - InterpreterContextTest.testThreadLocal
Key: ZEPPELIN-3554
URL: https://issues.apache.org/jira/browse/ZEPPELIN-3554
Project: Zeppelin
Issue Type: Bug
Reporter: Lee moon soo
Assignee: Lee moon soo
Fix For: 0.9.0
Flaky test - InterpreterContextTest.testThreadLocal
{code:java}
testThreadLocal(org.apache.zeppelin.interpreter.InterpreterContextTest) Time
elapsed: 0.004 sec <<< FAILURE!
java.lang.AssertionError: expected null, but
was:
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotNull(Assert.java:755)
at org.junit.Assert.assertNull(Assert.java:737)
at org.junit.Assert.assertNull(Assert.java:747)
at
org.apache.zeppelin.interpreter.InterpreterContextTest.testThreadLocal(InterpreterContextTest.java:29){code}
Full logs
https://api.travis-ci.org/v3/job/394317200/log.txt
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3285) Unnecessary margin before the title of note
Lee moon soo created ZEPPELIN-3285: -- Summary: Unnecessary margin before the title of note Key: ZEPPELIN-3285 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3285 Project: Zeppelin Issue Type: Bug Affects Versions: 0.8.0 Reporter: Lee moon soo Attachments: image-2018-03-02-15-59-39-827.png There's unnecessary margin before the title. !image-2018-03-02-15-59-39-827.png! -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3284) z.getInterpreterContext().out().clear() broken in Python interpreter
Lee moon soo created ZEPPELIN-3284: -- Summary: z.getInterpreterContext().out().clear() broken in Python interpreter Key: ZEPPELIN-3284 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3284 Project: Zeppelin Issue Type: Bug Affects Versions: 0.8.0 Reporter: Lee moon soo Attachments: image-2018-03-02-15-54-38-942.png Zeppelin 0.7.x, %spark and %python interpreter able to clear output using z.getInterpreterContext().out().clear() !image-2018-03-02-15-54-38-942.png! However, master branch and branch-0.8, PythonInterpreter does not provide the same capability. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3283) InterpreterOutput.toInterpreterResultMessage() and InterpreterOutput.getInterpreterResultMessages() are redundant
Lee moon soo created ZEPPELIN-3283: -- Summary: InterpreterOutput.toInterpreterResultMessage() and InterpreterOutput.getInterpreterResultMessages() are redundant Key: ZEPPELIN-3283 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3283 Project: Zeppelin Issue Type: Improvement Reporter: Lee moon soo org.apache.zeppelin.interpreter.InterpreterOutput.toInterpreterResultMessage() and org.apache.zeppelin.interpreter.InterpreterOutput.getInterpreterResultMessages() are redundant -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-2994) Websocket/REST API to access ResourcePool
Lee moon soo created ZEPPELIN-2994: -- Summary: Websocket/REST API to access ResourcePool Key: ZEPPELIN-2994 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2994 Project: Zeppelin Issue Type: New Feature Reporter: Lee moon soo h2. Motivation [ResourcePool|https://github.com/apache/zeppelin/blob/master/zeppelin-interpreter/src/main/java/org/apache/zeppelin/resource/ResourcePool.java] is general purpose, distributed map across interpreter processes. ResourcePool currently provides * Put / Get any object * List objects * Invoke method of object in the ResourcePool Because of ResourcePool is (logically) distributed across Interpreters, interpreter can use it to communicate to other interpreters. Pass interpreter result to other interpreter, let other interpreter call directly call one of the method of SparkContext, etc. h2. Websocket/REST API to ResourcePool However, currently ResourcePool API is only accessible in Interpreter. If front-end can have Websocket/Rest API to the ResourcePool, we'll have usages like * Interpreter store [TableData|https://github.com/apache/zeppelin/blob/master/zeppelin-interpreter/src/main/java/org/apache/zeppelin/tabledata/TableData.java] into the ResourcePool. * Front-end read TableData directly from ResourcePool. (and visualize data) This will open possibilities of * Move pivot routine to the backend (because current pivot works in front-end with partial data) * Realtime visualization update on front-end as data changes -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (ZEPPELIN-2975) CI test is failing on e2e test profile
Lee moon soo created ZEPPELIN-2975:
--
Summary: CI test is failing on e2e test profile
Key: ZEPPELIN-2975
URL: https://issues.apache.org/jira/browse/ZEPPELIN-2975
Project: Zeppelin
Issue Type: Bug
Reporter: Lee moon soo
Assignee: Lee moon soo
Recently, CI is failing on e2e test profile
{code}
[INFO] **
[INFO] *Failures*
[INFO] **
[INFO]
[INFO] 1) Search block e2e Test correct count of selections
[INFO] [31m- [39m[31mFailed: No element found using locator: By(xpath,
//div[@class="new-paragraph" and @ng-click="insertNew('below');"])[39m
[INFO]
[INFO] 2) Search block e2e Test correct matches count number
[INFO] [31m- [39m[31mFailed: No element found using locator: By(xpath,
//div[@class="new-paragraph" and @ng-click="insertNew('below');"])[39m
[INFO]
[INFO] 3) Search block e2e Test counter increase and decrease correctly
[INFO] [31m- [39m[31mFailed: No element found using locator: By(xpath,
//div[@class="new-paragraph" and @ng-click="insertNew('below');"])[39m
[INFO]
[INFO] 4) Search block e2e Test matches count changes correctly after replace
[INFO] [31m- [39m[31mFailed: No element found using locator: By(xpath,
//div[@class="new-paragraph" and @ng-click="insertNew('below');"])[39m
[INFO]
[INFO] 5) Search block e2e Test replace all works correctly
[INFO] [31m- [39m[31mFailed: No element found using locator: By(xpath,
//div[@class="new-paragraph" and @ng-click="insertNew('below');"])[39m
[INFO]
[INFO] Executed 9 of 9 specs[31m (5 FAILED)[39m in 4 mins 23 secs.
[INFO] [17:16:01] I/launcher - 0 instance(s) of WebDriver still running
[INFO] [17:16:01] I/launcher - chrome #01 failed 5 test(s)
[INFO] [17:16:01] I/launcher - overall: 5 failed spec(s)
[INFO] [17:16:01] E/launcher - Process exited with error code 1
[ERROR] error Command failed with exit code 1.
[INFO] info Visit https://yarnpkg.com/en/docs/cli/run for documentation about
this command.
[INFO]
[INFO] BUILD FAILURE
[INFO]
[INFO] Total time: 05:36 min
[INFO] Finished at: 2017-10-05T17:16:01Z
[INFO] Final Memory: 59M/931M
[INFO]
{code}
https://s3.amazonaws.com/archive.travis-ci.org/jobs/283426450/log.txt?X-Amz-Expires=30=20171005T210506Z=AWS4-HMAC-SHA256=AKIAJRYRXRSVGNKPKO5A/20171005/us-east-1/s3/aws4_request=host=3157cb96dd388d60114545c8104c10473cc602bf45c8ab1698ab6b6837033428
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Created] (ZEPPELIN-2962) CI Test is failing on selenium test profile
Lee moon soo created ZEPPELIN-2962:
--
Summary: CI Test is failing on selenium test profile
Key: ZEPPELIN-2962
URL: https://issues.apache.org/jira/browse/ZEPPELIN-2962
Project: Zeppelin
Issue Type: Bug
Reporter: Lee moon soo
Assignee: Lee moon soo
CI TEST is failing with following error on SELENIUM test profile
{code}
Driver info: driver.version: FirefoxDriver
at
org.openqa.selenium.firefox.internal.NewProfileExtensionConnection.start(NewProfileExtensionConnection.java:139)
at
org.openqa.selenium.firefox.FirefoxDriver.startClient(FirefoxDriver.java:271)
at
org.openqa.selenium.remote.RemoteWebDriver.(RemoteWebDriver.java:117)
at
org.openqa.selenium.firefox.FirefoxDriver.(FirefoxDriver.java:216)
at
org.openqa.selenium.firefox.FirefoxDriver.(FirefoxDriver.java:211)
at
org.openqa.selenium.firefox.FirefoxDriver.(FirefoxDriver.java:207)
at
org.apache.zeppelin.WebDriverManager.getWebDriver(WebDriverManager.java:87)
at
org.apache.zeppelin.integration.AuthenticationIT.startUp(AuthenticationIT.java:98)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at
org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264)
at
org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
at
org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124)
at
org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200)
at
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153)
at
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
Caused by: org.openqa.selenium.WebDriverException:
java.io.FileNotFoundException: /tmp/unzip6094094994883474027stream/install.rdf
(No such file or directory)
Build info: version: '2.48.2', revision:
'41bccdd10cf2c0560f637404c2d96164b67d9d67', time: '2015-10-09 13:08:06'
System info: host:
'testing-gce-ba2c4ba2-6dd0-4101-b34b-090875edfa69.c.eco-emissary-99515.internal',
ip: '10.10.20.9', os.name: 'Linux', os.arch: 'amd64', os.version:
'3.13.0-115-generic', java.version: '1.7.0_80'
Driver info: driver.version: FirefoxDriver
at
org.openqa.selenium.firefox.internal.FileExtension.readIdFromInstallRdf(FileExtension.java:142)
at
org.openqa.selenium.firefox.internal.FileExtension.writeTo(FileExtension.java:61)
at
org.openqa.selenium.firefox.FirefoxProfile.installExtensions(FirefoxProfile.java:443)
at
org.openqa.selenium.firefox.FirefoxProfile.layoutOnDisk(FirefoxProfile.java:421)
at
org.openqa.selenium.firefox.internal.NewProfileExtensionConnection.start(NewProfileExtensionConnection.java:95)
... 23 more
Caused by: java.io.FileNotFoundException:
/tmp/unzip6094094994883474027stream/install.rdf (No such file or directory)
at java.io.FileInputStream.open(Native Method)
at java.io.FileInputStream.(FileInputStream.java:146)
at java.io.FileInputStream.(FileInputStream.java:101)
at
sun.net.www.protocol.file.FileURLConnection.connect(FileURLConnection.java:90)
at
sun.net.www.protocol.file.FileURLConnection.getInputStream(FileURLConnection.java:188)
at org.apache.xerces.impl.XMLEntityManager.setupCurrentEntity(Unknown
Source)
at
org.apache.xerces.impl.XMLVersionDetector.determineDocVersion(Unknown Source)
at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source)
at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source)
at org.apache.xerces.parsers.XMLParser.parse(Unknown Source)
at org.apache.xerces.parsers.DOMParser.parse(Unknown Source)
at org.apache.xerces.jaxp.DocumentBuilderImpl.parse(Unknown Source)
at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:205)
at
org.openqa.selenium.firefox.internal.FileExtension.readIdFromInstallRdf(FileExtension.java:98)
... 27 more
{code}
--
This message was sent
[jira] [Created] (ZEPPELIN-2961) Remove unnecessary 'interpreter-setting.json' file in the spark interpreter.
Lee moon soo created ZEPPELIN-2961:
--
Summary: Remove unnecessary 'interpreter-setting.json' file in the
spark interpreter.
Key: ZEPPELIN-2961
URL: https://issues.apache.org/jira/browse/ZEPPELIN-2961
Project: Zeppelin
Issue Type: Improvement
Reporter: Lee moon soo
Priority: Trivial
Spark interpreter currently have two {{interpreter-setting.json}} files.
- {{spark/src/main/resources/interpreter-setting.json}}
- {{spark/src/main/sparkr-resources/interpreter-setting.json}}
{{spark/src/main/resources/interpreter-setting.json}} is always ignored by
{{spark/pom.xml}} and
{{spark/src/main/sparkr-resources/interpreter-setting.json}} is effective one.
But i think we better keep
{{spark/src/main/resources/interpreter-setting.json}} effective and remove
unnecessary {{spark/src/main/sparkr-resources/interpreter-setting.json}}.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Created] (ZEPPELIN-2907) Do not store "editor" configuration inside of conf/interpreter.json
Lee moon soo created ZEPPELIN-2907:
--
Summary: Do not store "editor" configuration inside of
conf/interpreter.json
Key: ZEPPELIN-2907
URL: https://issues.apache.org/jira/browse/ZEPPELIN-2907
Project: Zeppelin
Issue Type: Improvement
Reporter: Lee moon soo
Each interpreter can provide some configuration for code editor from
interpreter-setting.json.
{code}
"editor": {
"language": "sql",
"editOnDblClick": false
}
{code}
This configuration is copied to conf/interpreter.json on interpreterSetting
creation and Zeppelin retrieves "editor" information from conf/interpreter.json.
This makes interpreter impossible to add / update "editor" configuration
without user recreate interpreterSetting.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Created] (ZEPPELIN-2874) ZeppelinSparkClusterTest.pySparkTest - NullPointerException
Lee moon soo created ZEPPELIN-2874:
--
Summary: ZeppelinSparkClusterTest.pySparkTest -
NullPointerException
Key: ZEPPELIN-2874
URL: https://issues.apache.org/jira/browse/ZEPPELIN-2874
Project: Zeppelin
Issue Type: Sub-task
Reporter: Lee moon soo
Flaky test
[Build job|https://travis-ci.org/agura/zeppelin/jobs/267165984]
{code}
Tests run: 10, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 161.765 sec
<<< FAILURE! - in org.apache.zeppelin.rest.ZeppelinSparkClusterTest
pySparkTest(org.apache.zeppelin.rest.ZeppelinSparkClusterTest) Time elapsed:
4.021 sec <<< ERROR!
java.lang.NullPointerException: null
at
org.apache.zeppelin.rest.ZeppelinSparkClusterTest.pySparkTest(ZeppelinSparkClusterTest.java:292)
13:22:20,422 INFO org.apache.zeppelin.server.ZeppelinServer:206 - Shutting
down Zeppelin Server ...
13:22:20,435 INFO org.apache.zeppelin.notebook.repo.NotebookRepoSync:430 -
Closing all notebook storages
13:22:23,436 INFO org.apache.zeppelin.server.ZeppelinServer:215 - Bye
Results :
Tests in error:
ZeppelinSparkClusterTest.pySparkTest:292 NullPointer
Tests run: 10, Failures: 0, Errors: 1, Skipped: 0
{code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Created] (ZEPPELIN-2864) Release 0.7.3
Lee moon soo created ZEPPELIN-2864: -- Summary: Release 0.7.3 Key: ZEPPELIN-2864 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2864 Project: Zeppelin Issue Type: Task Reporter: Lee moon soo Fix For: 0.7.3 This issue tracks release 0.7.3 -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (ZEPPELIN-2732) Flaky test - testSingleDynamicFormSelectForm
Lee moon soo created ZEPPELIN-2732:
--
Summary: Flaky test - testSingleDynamicFormSelectForm
Key: ZEPPELIN-2732
URL: https://issues.apache.org/jira/browse/ZEPPELIN-2732
Project: Zeppelin
Issue Type: Sub-task
Reporter: Lee moon soo
Flaky test
log - https://api.travis-ci.org/jobs/250622951/log.txt?deansi=true
{code}
Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 342.77 sec <<<
FAILURE! - in org.apache.zeppelin.integration.ParagraphActionsIT
testSingleDynamicFormSelectForm(org.apache.zeppelin.integration.ParagraphActionsIT)
Time elapsed: 16.79 sec <<< FAILURE!
java.lang.AssertionError: After 'Run on selection change' checkbox is
unchecked, the paragraph should not run if selecting a different option
Expected: "Howdy 1"
but: was "Howdy 2"
at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
at org.junit.Assert.assertThat(Assert.java:956)
at org.junit.rules.ErrorCollector$1.call(ErrorCollector.java:65)
at org.junit.rules.ErrorCollector.checkSucceeds(ErrorCollector.java:78)
at org.junit.rules.ErrorCollector.checkThat(ErrorCollector.java:63)
at
org.apache.zeppelin.integration.ParagraphActionsIT.testSingleDynamicFormSelectForm(ParagraphActionsIT.java:634)
{code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Created] (ZEPPELIN-2710) Let user manually update progress bar
Lee moon soo created ZEPPELIN-2710: -- Summary: Let user manually update progress bar Key: ZEPPELIN-2710 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2710 Project: Zeppelin Issue Type: Improvement Reporter: Lee moon soo Assignee: Lee moon soo Priority: Minor Fix For: 0.8.0 If underlying interpreter provide progress information, Zeppelin displays progress bar. For example, Spark interpreter provides Sparkjob progress information and Zeppelin displays it. But not all interpreter supports progress information. So, if user can just programmatically update progress bar, that would be useful. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (ZEPPELIN-2619) Save note in [Title].zpln instead of [NOTEID]/note.json
Lee moon soo created ZEPPELIN-2619:
--
Summary: Save note in [Title].zpln instead of [NOTEID]/note.json
Key: ZEPPELIN-2619
URL: https://issues.apache.org/jira/browse/ZEPPELIN-2619
Project: Zeppelin
Issue Type: Improvement
Reporter: Lee moon soo
Currently all notebook storage implementations (GitNotebookRepo,
VFSNotebookRepo, etc) stores notebook {{\[NoteID]/note.json}}.
This dir/file name convention is not human friendly. Also it's not filename
search friendly.
It would be nice if notebook is stored in the storage {{\[Note title].zpln}}
name convention.
This work will need to address
- Handle duplicate Note title.
- Map Zeppelin's logical folder structure with underlying storage system's
folder structure.
- Keep backward compatibility.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2546) NotebookSecurityRestApiTest fails on travis
Lee moon soo created ZEPPELIN-2546:
--
Summary: NotebookSecurityRestApiTest fails on travis
Key: ZEPPELIN-2546
URL: https://issues.apache.org/jira/browse/ZEPPELIN-2546
Project: Zeppelin
Issue Type: Bug
Reporter: Lee moon soo
{{NotebookSecurityRestApiTest}} fails.
log -
https://s3.amazonaws.com/archive.travis-ci.org/jobs/232172080/log.txt?X-Amz-Expires=30=20170514T212740Z=AWS4-HMAC-SHA256=AKIAJRYRXRSVGNKPKO5A/20170514/us-east-1/s3/aws4_request=host=ff4905e101d0e2e3fd5ef648e32accb53f36acd6aacd1c4e4618d932df5ea279
{code}
Failed tests:
NotebookSecurityRestApiTest.testThatOtherUserCannotAccessNoteIfPermissionSet:81->createNoteForUser:155
test note create method:
Expected: HTTP response <200> from /api/notebook/
but: got <302> Found
NotebookSecurityRestApiTest.testThatUserCanSearchNote:115->createNoteForUser:155
test note create method:
Expected: HTTP response <200> from /api/notebook/
but: got <302> Found
NotebookSecurityRestApiTest.testThatWriterCannotRemoveNote:98->createNoteForUser:155
test note create method:
Expected: HTTP response <200> from /api/notebook/
but: got <302> Found
NotebookSecurityRestApiTest.testThatOtherUserCanAccessNoteIfPermissionNotSet:72->createNoteForUser:155
test note create method:
Expected: HTTP response <200> from /api/notebook/
but: got <302> Found
NotebookSecurityRestApiTest.testThatUserCanCreateAndRemoveNote:63->createNoteForUser:155
test note create method:
Expected: HTTP response <200> from /api/notebook/
but: got <302> Found
{code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2545) SecurityRestApiTest test fails on travis
Lee moon soo created ZEPPELIN-2545:
--
Summary: SecurityRestApiTest test fails on travis
Key: ZEPPELIN-2545
URL: https://issues.apache.org/jira/browse/ZEPPELIN-2545
Project: Zeppelin
Issue Type: Bug
Reporter: Lee moon soo
{{org.apache.zeppelin.rest.SecurityRestApiTest}} test fails.
Log -
https://s3.amazonaws.com/archive.travis-ci.org/jobs/232172080/log.txt?X-Amz-Expires=30=20170514T212740Z=AWS4-HMAC-SHA256=AKIAJRYRXRSVGNKPKO5A/20170514/us-east-1/s3/aws4_request=host=ff4905e101d0e2e3fd5ef648e32accb53f36acd6aacd1c4e4618d932df5ea279
{code}
Tests run: 2, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 4.146 sec <<<
FAILURE! - in org.apache.zeppelin.rest.SecurityRestApiTest
testGetUserList(org.apache.zeppelin.rest.SecurityRestApiTest) Time elapsed:
0.063 sec <<< ERROR!
com.google.gson.JsonSyntaxException: java.lang.IllegalStateException: Expected
BEGIN_OBJECT but was STRING at line 1 column 7
at com.google.gson.stream.JsonReader.expect(JsonReader.java:339)
at com.google.gson.stream.JsonReader.beginObject(JsonReader.java:322)
at
com.google.gson.internal.bind.MapTypeAdapterFactory$Adapter.read(MapTypeAdapterFactory.java:184)
at
com.google.gson.internal.bind.MapTypeAdapterFactory$Adapter.read(MapTypeAdapterFactory.java:146)
at com.google.gson.Gson.fromJson(Gson.java:791)
at com.google.gson.Gson.fromJson(Gson.java:757)
at com.google.gson.Gson.fromJson(Gson.java:706)
at
org.apache.zeppelin.rest.SecurityRestApiTest.testGetUserList(SecurityRestApiTest.java:69)
testTicket(org.apache.zeppelin.rest.SecurityRestApiTest) Time elapsed: 0.039
sec <<< ERROR!
com.google.gson.JsonSyntaxException: java.lang.IllegalStateException: Expected
BEGIN_OBJECT but was STRING at line 1 column 7
at com.google.gson.stream.JsonReader.expect(JsonReader.java:339)
at com.google.gson.stream.JsonReader.beginObject(JsonReader.java:322)
at
com.google.gson.internal.bind.MapTypeAdapterFactory$Adapter.read(MapTypeAdapterFactory.java:184)
at
com.google.gson.internal.bind.MapTypeAdapterFactory$Adapter.read(MapTypeAdapterFactory.java:146)
at com.google.gson.Gson.fromJson(Gson.java:791)
at com.google.gson.Gson.fromJson(Gson.java:757)
at com.google.gson.Gson.fromJson(Gson.java:706)
at
org.apache.zeppelin.rest.SecurityRestApiTest.testTicket(SecurityRestApiTest.java:55)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2478) Configure appveyor.yml
Lee moon soo created ZEPPELIN-2478: -- Summary: Configure appveyor.yml Key: ZEPPELIN-2478 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2478 Project: Zeppelin Issue Type: New Feature Reporter: Lee moon soo Appveyor has been enabled by INFRA-14019. And skeleton build script (doing nothing) has been added by https://github.com/apache/zeppelin/pull/2303. We need to configure .appveyor.yml to actually build Zeppelin on windows. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2434) Credential feature does work in JDBC interpreter
Lee moon soo created ZEPPELIN-2434: -- Summary: Credential feature does work in JDBC interpreter Key: ZEPPELIN-2434 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2434 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.1 Reporter: Lee moon soo Fix For: 0.7.2 Credential feature does work in JDBC interpreter Problem reported https://lists.apache.org/thread.html/5138345b37492b7973e309d22fc1ecbd44dadd7b0e20b7f72fc03579@%3Cusers.zeppelin.apache.org%3E -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2405) Can't modify interpreter setting
Lee moon soo created ZEPPELIN-2405:
--
Summary: Can't modify interpreter setting
Key: ZEPPELIN-2405
URL: https://issues.apache.org/jira/browse/ZEPPELIN-2405
Project: Zeppelin
Issue Type: Bug
Affects Versions: 0.7.1
Reporter: Lee moon soo
Priority: Blocker
Fix For: 0.7.2
Error when saving interpreter setting (occurs interpreter setting created
automatically)
{code}
WARN [2017-04-15 18:17:15,722] ({qtp1423407397-75}
PhaseInterceptorChain.java[unwind]:444) - Exception in handleFault on
interceptor
org.apache.cxf.binding.xml.interceptor.XMLFaultOutInterceptor@460c2f21
org.apache.cxf.interceptor.Fault:
org.apache.zeppelin.interpreter.InterpreterGroup.keySet()Ljava/util/concurrent/ConcurrentHashMap$KeySetView;
at
org.apache.cxf.service.invoker.AbstractInvoker.createFault(AbstractInvoker.java:162)
at
org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:128)
at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:205)
at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:102)
at
org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:58)
at
org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:94)
at
org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:272)
at
org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121)
at
org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:239)
at
org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:248)
at
org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:222)
at
org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:153)
at
org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:167)
at
org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:286)
at
org.apache.cxf.transport.servlet.AbstractHTTPServlet.doPut(AbstractHTTPServlet.java:223)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:598)
at
org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:262)
at
org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:812)
at
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1669)
at org.apache.zeppelin.server.CorsFilter.doFilter(CorsFilter.java:72)
at
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
at
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
at
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:577)
at
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:223)
at
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
at
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
at
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
at
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215)
at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
at org.eclipse.jetty.server.Server.handle(Server.java:499)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:311)
at
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
at
org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NoSuchMethodError:
org.apache.zeppelin.interpreter.InterpreterGroup.keySet()Ljava/util/concurrent/ConcurrentHashMap$KeySetView;
at
org.apache.zeppelin.interpreter.InterpreterSetting.closeAndRemoveAllInterpreterGroups(InterpreterSetting.java:256)
at
org.apache.zeppelin.interpreter.InterpreterSettingManager.setPropertyAndRestart(InterpreterSettingManager.java:911)
at
org.apache.zeppelin.rest.InterpreterRestApi.updateSetting(InterpreterRestApi.java:144)
at
[jira] [Created] (ZEPPELIN-2361) Flaky test: ParagraphActionsIT.testRunOnSelectionChange
Lee moon soo created ZEPPELIN-2361:
--
Summary: Flaky test: ParagraphActionsIT.testRunOnSelectionChange
Key: ZEPPELIN-2361
URL: https://issues.apache.org/jira/browse/ZEPPELIN-2361
Project: Zeppelin
Issue Type: Bug
Reporter: Lee moon soo
Selenium test profile sometimes fails with
{code}
Results :
Failed tests:
ParagraphActionsIT.testRunOnSelectionChange:306 Even if
'RunOnSelectionChange' is set as false, still can run the paragraph by pressing
ENTER
Expected: "My selection is 1"
but: was "My selection is 2"
Tests run: 23, Failures: 1, Errors: 0, Skipped: 0
{code}
https://travis-ci.org/apache/zeppelin/jobs/218608853
or
{code}
Results :
Tests in error:
ParagraphActionsIT.testRunOnSelectionChange:306 » StaleElementReference
Elemen...
Tests run: 23, Failures: 0, Errors: 1, Skipped: 0
{code}
https://travis-ci.org/apache/zeppelin/jobs/218598988
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2360) [Umbrella] Improve Note editing experience
Lee moon soo created ZEPPELIN-2360: -- Summary: [Umbrella] Improve Note editing experience Key: ZEPPELIN-2360 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2360 Project: Zeppelin Issue Type: Improvement Reporter: Lee moon soo This is umbrella issue for improving Note editing experience. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2336) Note is refreshed on Note creation/deletion/rename
Lee moon soo created ZEPPELIN-2336: -- Summary: Note is refreshed on Note creation/deletion/rename Key: ZEPPELIN-2336 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2336 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.1 Reporter: Lee moon soo Priority: Critical Fix For: 0.7.2 Open two browser windows, A, B. One window A, open a notebook. The other window B, try create / remove / rename note. The note on browser window A is get refreshed, which is unnecessary. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2286) Some test matrix on Travis often exceeds time limits (50min)
Lee moon soo created ZEPPELIN-2286: -- Summary: Some test matrix on Travis often exceeds time limits (50min) Key: ZEPPELIN-2286 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2286 Project: Zeppelin Issue Type: Improvement Reporter: Lee moon soo Assignee: Lee moon soo Currently, we have 9 matrix on travis CI. 2nd,3rd one usually takes around 45min and often exceeds limit. (50min). And as we add more test, test time will increase and we'll more likely see test failing because of time limit. So it's better split test into other test matrix. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2284) Handle angularObjects in angularObjectRegistry on interpreter restart.
Lee moon soo created ZEPPELIN-2284: -- Summary: Handle angularObjects in angularObjectRegistry on interpreter restart. Key: ZEPPELIN-2284 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2284 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.1 Reporter: Lee moon soo On Interpreter restart, Related angularObjects in AngularObjectRegistry need to be removed. However, removal is not taken care properly. Related test case that should be reverted once this issue is fixed. https://github.com/apache/zeppelin/pull/2157/commits/2d9c1821ef3e7ee5a01cd4a0cf14de02675e2be9 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2282) NPE on NotebookServer.java[onMessage]:356
Lee moon soo created ZEPPELIN-2282:
--
Summary: NPE on NotebookServer.java[onMessage]:356
Key: ZEPPELIN-2282
URL: https://issues.apache.org/jira/browse/ZEPPELIN-2282
Project: Zeppelin
Issue Type: Bug
Affects Versions: 0.7.0
Reporter: Lee moon soo
Assignee: Lee moon soo
Fix For: 0.7.1
In some circumstance, client send ticket null in it's message.
ZeppelinServer does not check null value.
{code}
ERROR [2017-03-15 17:52:11,554] ({qtp399931359-56}
NotebookServer.java[onMessage]:356) - Can't handle message
java.lang.NullPointerException
at
java.util.concurrent.ConcurrentHashMap.get(ConcurrentHashMap.java:936)
at
org.apache.zeppelin.ticket.TicketContainer.getTicket(TicketContainer.java:68)
at
org.apache.zeppelin.socket.NotebookServer.onMessage(NotebookServer.java:175)
at
org.apache.zeppelin.socket.NotebookSocket.onWebSocketText(NotebookSocket.java:59)
at
org.eclipse.jetty.websocket.common.events.JettyListenerEventDriver.onTextMessage(JettyListenerEventDriver.java:128)
at
org.eclipse.jetty.websocket.common.message.SimpleTextMessage.messageComplete(SimpleTextMessage.java:69)
at
org.eclipse.jetty.websocket.common.events.AbstractEventDriver.appendMessage(AbstractEventDriver.java:65)
at
org.eclipse.jetty.websocket.common.events.JettyListenerEventDriver.onTextFrame(JettyListenerEventDriver.java:122)
at
org.eclipse.jetty.websocket.common.events.AbstractEventDriver.incomingFrame(AbstractEventDriver.java:161)
at
org.eclipse.jetty.websocket.common.WebSocketSession.incomingFrame(WebSocketSession.java:309)
at
org.eclipse.jetty.websocket.common.extensions.ExtensionStack.incomingFrame(ExtensionStack.java:214)
at
org.eclipse.jetty.websocket.common.Parser.notifyFrame(Parser.java:220)
at org.eclipse.jetty.websocket.common.Parser.parse(Parser.java:258)
at
org.eclipse.jetty.websocket.common.io.AbstractWebSocketConnection.readParse(AbstractWebSocketConnection.java:632)
at
org.eclipse.jetty.websocket.common.io.AbstractWebSocketConnection.onFillable(AbstractWebSocketConnection.java:480)
at
org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
at java.lang.Thread.run(Thread.java:745)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2260) Skip npm install / bundle when no helium package is selected
Lee moon soo created ZEPPELIN-2260: -- Summary: Skip npm install / bundle when no helium package is selected Key: ZEPPELIN-2260 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2260 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.7.0 Reporter: Lee moon soo Assignee: Lee moon soo Zeppelin 0.7.0 installs node and npm when it first starts for Helium package. To be installed, or to failed to be installed due to network timeout, it takes some times. We can just create empty file when no Helium package is enabled, instead of install npm and build bundle. See discussion https://github.com/apache/zeppelin/pull/2095#issuecomment-285447619 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2162) Make travis_check.py print instructions of setting up CI.
Lee moon soo created ZEPPELIN-2162:
--
Summary: Make travis_check.py print instructions of setting up CI.
Key: ZEPPELIN-2162
URL: https://issues.apache.org/jira/browse/ZEPPELIN-2162
Project: Zeppelin
Issue Type: Improvement
Reporter: Lee moon soo
Priority: Minor
When contributor didn't set travis-ci, {{travis_check.py}} fails. Although
contribution guide has some instruction setting up CI, it will be more helpful
{{travis_check.py}} script prints why it fails and where contributor should go
to setup the CI.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2135) Don't re-license jdbc/src/main/java/org/apache/zeppelin/jdbc/SqlCompleter.java
Lee moon soo created ZEPPELIN-2135: -- Summary: Don't re-license jdbc/src/main/java/org/apache/zeppelin/jdbc/SqlCompleter.java Key: ZEPPELIN-2135 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2135 Project: Zeppelin Issue Type: Bug Affects Versions: 0.6.0 Reporter: Lee moon soo Assignee: Lee moon soo Fix For: 0.8.0 Found that jdbc/src/main/java/org/apache/zeppelin/jdbc/SqlCompleter.java is taken from SQLLine 1.0.2 (BSD license), but we put Apache LICENSE Header on it. We can not change the license unless copyright holder allows it. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2134) Release 0.7.1
Lee moon soo created ZEPPELIN-2134: -- Summary: Release 0.7.1 Key: ZEPPELIN-2134 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2134 Project: Zeppelin Issue Type: Task Reporter: Lee moon soo Since 0.7.0 release, there're many problems are reported, including critical problems. We'll need 0.7.1 release with bug fixes and stability improvement, as soon as possible. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2129) Flaky test - PySparkInterpreterTest fails with TypeError: namedtuple() missing 3 required keyword-only arguments: 'verbose', 'rename', and 'module'
Lee moon soo created ZEPPELIN-2129:
--
Summary: Flaky test - PySparkInterpreterTest fails with TypeError:
namedtuple() missing 3 required keyword-only arguments: 'verbose', 'rename',
and 'module'
Key: ZEPPELIN-2129
URL: https://issues.apache.org/jira/browse/ZEPPELIN-2129
Project: Zeppelin
Issue Type: Sub-task
Reporter: Lee moon soo
Assignee: Lee moon soo
PysparkInterpreterTest fails with
https://travis-ci.org/Leemoonsoo/zeppelin/jobs/202563404
{code}
PySparkInterpreterTest.testBasicIntp:111 expected: but was:
PySparkInterpreterTest.testCompletion:120 null
PySparkInterpreterMatplotlibTest.dependenciesAreInstalled:144 [%text
Traceback (most recent call last):
File "/tmp/zeppelin_pyspark-218141602126326064.py", line 22, in
from pyspark.conf import SparkConf
File "", line 961, in _find_and_load
File "", line 950, in _find_and_load_unlocked
File "", line 646, in _load_unlocked
File "", line 616, in _load_backward_compatible
File
"/home/travis/build/Leemoonsoo/zeppelin/interpreter/spark/pyspark/pyspark.zip/pyspark/__init__.py",
line 44, in
File "", line 961, in _find_and_load
File "", line 950, in _find_and_load_unlocked
File "", line 646, in _load_unlocked
File "", line 616, in _load_backward_compatible
File
"/home/travis/build/Leemoonsoo/zeppelin/interpreter/spark/pyspark/pyspark.zip/pyspark/context.py",
line 37, in
File "", line 961, in _find_and_load
File "", line 950, in _find_and_load_unlocked
File "", line 646, in _load_unlocked
File "", line 616, in _load_backward_compatible
File
"/home/travis/build/Leemoonsoo/zeppelin/interpreter/spark/pyspark/pyspark.zip/pyspark/rdd.py",
line 47, in
File "", line 961, in _find_and_load
File "", line 950, in _find_and_load_unlocked
File "", line 646, in _load_unlocked
File "", line 616, in _load_backward_compatible
File
"/home/travis/build/Leemoonsoo/zeppelin/interpreter/spark/pyspark/pyspark.zip/pyspark/statcounter.py",
line 24, in
File "/home/travis/miniconda/lib/python3.6/site-packages/numpy/__init__.py",
line 146, in
from . import add_newdocs
File
"/home/travis/miniconda/lib/python3.6/site-packages/numpy/add_newdocs.py", line
13, in
from numpy.lib import add_newdoc
File
"/home/travis/miniconda/lib/python3.6/site-packages/numpy/lib/__init__.py",
line 8, in
from .type_check import *
File
"/home/travis/miniconda/lib/python3.6/site-packages/numpy/lib/type_check.py",
line 11, in
import numpy.core.numeric as _nx
File
"/home/travis/miniconda/lib/python3.6/site-packages/numpy/core/__init__.py",
line 72, in
from numpy.testing.nosetester import _numpy_tester
File
"/home/travis/miniconda/lib/python3.6/site-packages/numpy/testing/__init__.py",
line 10, in
from unittest import TestCase
File "/home/travis/miniconda/lib/python3.6/unittest/__init__.py", line 58, in
from .result import TestResult
File "/home/travis/miniconda/lib/python3.6/unittest/result.py", line 7, in
from . import util
File "/home/travis/miniconda/lib/python3.6/unittest/util.py", line 119, in
_Mismatch = namedtuple('Mismatch', 'actual expected value')
File
"/home/travis/build/Leemoonsoo/zeppelin/interpreter/spark/pyspark/pyspark.zip/pyspark/serializers.py",
line 381, in namedtuple
TypeError: namedtuple() missing 3 required keyword-only arguments: 'verbose',
'rename', and 'module'
, %text Traceback (most recent call last):
{code}
Which is because of pyspark does not work with python 3.6
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2123) Scale-out CI capacity by leveraging individual contributor's travis account
Lee moon soo created ZEPPELIN-2123: -- Summary: Scale-out CI capacity by leveraging individual contributor's travis account Key: ZEPPELIN-2123 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2123 Project: Zeppelin Issue Type: Improvement Reporter: Lee moon soo Assignee: Lee moon soo h3. Motivation Recently INFRA-13469 reduced simultaneous build capacity of Zeppelin project to 5 from 11. After that, although https://github.com/apache/zeppelin/pull/2003 reduced CI build time by 60%, it's not very difficult to see pullrequests are waiting more than 10 hours in the queue to be tested. It's mainly because of Apache Zeppelin uses ASF's travis account and the same account serves all project in ASF. It's easy to guess that there will be tons of build requests from various projects in ASF. By the way, individual contributor fork Apache Zeppelin repository on github to make a pullrequest. And it's not very difficult to setup travis for the fork. If Apache Zeppelin project can leverage all individual contributors travis account to build the pullrequest, that'll give many advantages. - Individual contributor will have 5 simultaneous build slot on travis. - No other project shares the travis slot. - Individual contributor can control build - cancel, restart h3. How it works 1. Individual contributor setup travis on Apache Zeppelin fork. (and turn on "Build pushes") 2. Contributor pushes the branch to forked repository -> Triggers Travis CI build 3. Contributor creates pullrequest to ApacheZeppelin repository -> Triggers Jenkins CI build 4. Jenkins CI build script checks individual contributors Travis CI build status. Jenkins CI build script will not actually build the project but will just check contributors Travis CI build status. And Jekins CI build script will run on ASF infra (builds.apache.org) h3. Things to do Following tasks need to be done. 1. Create build CI script for Jenkins that checks contributor's travis CI 2. Setup Jenkins configuration on builds.apache.org 3. Ask INFRA to turn off pullrequest build on Travis-CI and add Jekins for pullrequest build 4. Add travis setup after fork in how to contribute guide. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2120) Flaky Test: NotebookTest.testRunAll
Lee moon soo created ZEPPELIN-2120:
--
Summary: Flaky Test: NotebookTest.testRunAll
Key: ZEPPELIN-2120
URL: https://issues.apache.org/jira/browse/ZEPPELIN-2120
Project: Zeppelin
Issue Type: Sub-task
Reporter: Lee moon soo
Assignee: Lee moon soo
Priority: Minor
build - https://travis-ci.org/apache/zeppelin/jobs/201721697
log - https://api.travis-ci.org/jobs/201721697/log.txt?deansi=true
{code}
testRunAll(org.apache.zeppelin.notebook.NotebookTest) Time elapsed: 0.035 sec
<<< ERROR!
java.lang.NullPointerException: null
at
org.apache.zeppelin.notebook.NotebookTest.testRunAll(NotebookTest.java:325)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2103) Unnecessary request to Helium registry
Lee moon soo created ZEPPELIN-2103:
--
Summary: Unnecessary request to Helium registry
Key: ZEPPELIN-2103
URL: https://issues.apache.org/jira/browse/ZEPPELIN-2103
Project: Zeppelin
Issue Type: Bug
Affects Versions: 0.8.0
Reporter: Lee moon soo
Assignee: Lee moon soo
Fix For: 0.8.0
Every {{Helium.getAllPackageInfo()}} call read helium package information from
all registry configured (both local registry, online registry by default).
Problem is, {{Helium.getAllPackageInfo()}} is used inside of many other
methods. like {{Helium.suggestApp()}}, {{Helium.enable()}},
{{Helium.disable()}}, {{Helium.recreateBundle()}}, {{Helium.getPackageInfo()}}.
So local/remote registry is unnecessarily accessed more than it should do.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2074) Allow ResourcePool persist object
Lee moon soo created ZEPPELIN-2074:
--
Summary: Allow ResourcePool persist object
Key: ZEPPELIN-2074
URL: https://issues.apache.org/jira/browse/ZEPPELIN-2074
Project: Zeppelin
Issue Type: Sub-task
Reporter: Lee moon soo
Add an ability to persist object in ResourcePool into note.json, selectively.
Might need a method, such as
{code}
class Resource {
...
public void persist(boolean yesno)
...
}
{code}
can be used like
{code}
Resource myResource = pool.get(...);
myResource.persist(true);
...
{code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2073) Replace AngularObjectRegistry by ResourcePool
Lee moon soo created ZEPPELIN-2073: -- Summary: Replace AngularObjectRegistry by ResourcePool Key: ZEPPELIN-2073 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2073 Project: Zeppelin Issue Type: Improvement Reporter: Lee moon soo Priority: Minor Zeppelin provides AngularObjectRegistry and ResourcePool to Interpreter through InterpreterContext. And they can be compared like AngularObjectRegistry - Can get/put object - Can watch the object - Persisted in the note.json - Interpreter and Front-end can access AngularObjectRegistry ResourcePool - Can get/put/list objects - Can call method and get return value of the object - Interpreter can access ResourcePool ResourcePool can adds following features - Persist object in the note.json - Watch object change - Make front-end access resource pool. Then AngularObjectRegistry can be replaced by ResourcePool. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2067) SparkInterpreter (scala) prints unnecessary newline
Lee moon soo created ZEPPELIN-2067:
--
Summary: SparkInterpreter (scala) prints unnecessary newline
Key: ZEPPELIN-2067
URL: https://issues.apache.org/jira/browse/ZEPPELIN-2067
Project: Zeppelin
Issue Type: Bug
Reporter: Lee moon soo
Assignee: Lee moon soo
Fix For: 0.8.0
When SparkInterpreter call interpret() method, it prints output from scala repl
(IMain). However before each evaluation's output is printed, there's
unnecessary newline char from scala repl.
Made stacktrace where this unnecessary newline came from and got
{code}
at
org.apache.zeppelin.interpreter.InterpreterOutput.write(InterpreterOutput.java:177)
at
org.apache.zeppelin.interpreter.util.InterpreterOutputStream.write(InterpreterOutputStream.java:50)
at
org.apache.zeppelin.interpreter.util.LogOutputStream.write(LogOutputStream.java:97)
at
org.apache.zeppelin.interpreter.util.InterpreterOutputStream.write(InterpreterOutputStream.java:64)
at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:221)
at sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:291)
at sun.nio.cs.StreamEncoder.implFlush(StreamEncoder.java:295)
at sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:141)
at java.io.OutputStreamWriter.flush(OutputStreamWriter.java:229)
at java.io.BufferedWriter.flush(BufferedWriter.java:254)
at java.io.PrintWriter.flush(PrintWriter.java:320)
at java.io.PrintWriter.flush(PrintWriter.java:320)
at
scala.tools.nsc.reporters.ConsoleReporter.printMessage(ConsoleReporter.scala:45)
at
scala.tools.nsc.interpreter.ReplReporter.printMessage(ReplReporter.scala:61)
at
scala.tools.nsc.reporters.ConsoleReporter.printMessage(ConsoleReporter.scala:50)
at scala.tools.nsc.interpreter.ReplReporter.print(ReplReporter.scala:50)
at
scala.tools.nsc.reporters.ConsoleReporter.display(ConsoleReporter.scala:69)
at
scala.tools.nsc.reporters.AbstractReporter.info0(AbstractReporter.scala:48)
at
scala.tools.nsc.reporters.AbstractReporter.info0(AbstractReporter.scala:16)
at scala.reflect.internal.Reporter.error(Reporting.scala:82)
at
scala.tools.nsc.interpreter.ReplReporter.scala$tools$nsc$interpreter$ReplReporter$$super$error(ReplReporter.scala:33)
at
scala.tools.nsc.interpreter.ReplReporter$$anonfun$error$1.apply(ReplReporter.scala:33)
at
scala.tools.nsc.interpreter.ReplReporter$$anonfun$error$1.apply(ReplReporter.scala:33)
at
scala.tools.nsc.interpreter.ReplReporter.withoutTruncating(ReplReporter.scala:28)
at scala.tools.nsc.interpreter.ReplReporter.error(ReplReporter.scala:33)
at
scala.tools.nsc.typechecker.Contexts$ImmediateReporter.handleError(Contexts.scala:1377)
at
scala.tools.nsc.typechecker.Contexts$ContextReporter.issue(Contexts.scala:1254)
at
scala.tools.nsc.typechecker.Contexts$Context.issue(Contexts.scala:573)
at
scala.tools.nsc.typechecker.Typers$Typer$$anonfun$normalTypedApply$1$1.apply(Typers.scala:4549)
at
scala.tools.nsc.typechecker.Typers$Typer$$anonfun$normalTypedApply$1$1.apply(Typers.scala:4548)
at scala.tools.nsc.typechecker.Typers$Typer.onError$3(Typers.scala:4522)
at
scala.tools.nsc.typechecker.Typers$Typer.normalTypedApply$1(Typers.scala:4548)
at
scala.tools.nsc.typechecker.Typers$Typer.typedApply$1(Typers.scala:4580)
at
scala.tools.nsc.typechecker.Typers$Typer.typedInAnyMode$1(Typers.scala:5343)
...
...
...
at
scala.tools.nsc.typechecker.Typers$Typer$$anonfun$65.apply(Typers.scala:3151)
at scala.collection.immutable.List.loop$1(List.scala:173)
at scala.collection.immutable.List.mapConserve(List.scala:189)
at
scala.tools.nsc.typechecker.Typers$Typer.typedStats(Typers.scala:3151)
at
scala.tools.nsc.typechecker.Typers$Typer.typedTemplate(Typers.scala:1921)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
at
scala.tools.nsc.typechecker.Analyzer$typerFactory$$anon$3.run(Analyzer.scala:93)
at scala.tools.nsc.Global$Run.compileUnitsInternal(Global.scala:1501)
at scala.tools.nsc.Global$Run.compileUnits(Global.scala:1486)
at scala.tools.nsc.Global$Run.compileSources(Global.scala:1481)
at
scala.tools.nsc.interpreter.IMain.compileSourcesKeepingRun(IMain.scala:435)
at
scala.tools.nsc.interpreter.IMain$ReadEvalPrint.compileAndSaveRun(IMain.scala:855)
at
scala.tools.nsc.interpreter.IMain$ReadEvalPrint.compile(IMain.scala:813)
at
scala.tools.nsc.interpreter.IMain$Request.compile$lzycompute(IMain.scala:1002)
at scala.tools.nsc.interpreter.IMain$Request.compile(IMain.scala:997)
at scala.tools.nsc.interpreter.IMain.compile(IMain.scala:579)
at
[jira] [Created] (ZEPPELIN-2042) Document how to run selenium test
Lee moon soo created ZEPPELIN-2042: -- Summary: Document how to run selenium test Key: ZEPPELIN-2042 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2042 Project: Zeppelin Issue Type: Task Reporter: Lee moon soo Assignee: Lee moon soo Priority: Minor Document how to run selenium test in development environment. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2035) BI directional RPC framework between ZeppelinServer and InterpreterProcess on top of thrift
Lee moon soo created ZEPPELIN-2035:
--
Summary: BI directional RPC framework between ZeppelinServer and
InterpreterProcess on top of thrift
Key: ZEPPELIN-2035
URL: https://issues.apache.org/jira/browse/ZEPPELIN-2035
Project: Zeppelin
Issue Type: Improvement
Reporter: Lee moon soo
Priority: Minor
ZeppelinServer and InterpreterProcess communicates using thrift protocol.
InterpreterProcess run as a thrift server, ZeppelinServer run as a thrift
client.
Since thrift provides client->server RPC mechanism, ZeppelinServer can call
methods in InterpreterProcess and get result back.
{noformat}
[ZeppelinServer] ---ThriftMethodCall---> [InterpreterProcess]
{noformat}
However, thrift does not provides mechanism to call method from
InterpreterProcess to ZeppelinServer. Currently,
[RemoteInterpreterEventClient|https://github.com/apache/zeppelin/blob/master/zeppelin-interpreter/src/main/java/org/apache/zeppelin/interpreter/remote/RemoteInterpreterEventClient.java]
and
[RemoteInterpreterEventPoller|https://github.com/apache/zeppelin/blob/master/zeppelin-interpreter/src/main/java/org/apache/zeppelin/interpreter/remote/RemoteInterpreterEventPoller.java]
provides a mechanism to call method from InterpreterProcess to ZeppelinServer.
{noformat}
(method call)
[InterpreterProcess] ---EventPoller/EventClient---> [ZeppelinServer] ---+
| |
| (return result) |
+-ThriftMethodCall--+
{noformat}
Therefore
1. To add method call from ZeppelinServer to InterpreterProcess,
- add method in thrift IDL
- implement the thrift method
- call the method from ZeppelinServer
2. To add method call from InterpreterProcess to ZeppelinServer,
- add message type in thrift IDL
- implement send message function in EventClient
- implement receive message message functions in EventPoller
- add thriftIDL to receive result
- implement the thrift method
- implement method return wait mechanism in InterpreterProcess
- call the method from InterpreterProcess and get return from ZeppelinServer
It would be nice if Zeppelin provides some simplified layer for 2), which
currently quite painful to do for every single method call from
InterpreterProcess to ZeppelinServer.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2022) Make SparkInterpreter directly access TableData in ResourcePool
Lee moon soo created ZEPPELIN-2022: -- Summary: Make SparkInterpreter directly access TableData in ResourcePool Key: ZEPPELIN-2022 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2022 Project: Zeppelin Issue Type: Sub-task Reporter: Lee moon soo Fix For: 0.8.0 Implement [spark datasource|https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala] for TableData in ResourcePool. Then Spark will able to query any TableData available in the ResourcePool. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-2021) Flaky test - PySparkInterpreterTest.testCompletion
Lee moon soo created ZEPPELIN-2021:
--
Summary: Flaky test - PySparkInterpreterTest.testCompletion
Key: ZEPPELIN-2021
URL: https://issues.apache.org/jira/browse/ZEPPELIN-2021
Project: Zeppelin
Issue Type: Sub-task
Reporter: Lee moon soo
Example
[log|https://s3.amazonaws.com/archive.travis-ci.org/jobs/195639051/log.txt]
from [build|https://travis-ci.org/apache/zeppelin/jobs/195639051]
{code}
testCompletion(org.apache.zeppelin.spark.PySparkInterpreterTest) Time elapsed:
0.102 sec <<< FAILURE!
java.lang.AssertionError: null
at org.junit.Assert.fail(Assert.java:86)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.junit.Assert.assertTrue(Assert.java:52)
at
org.apache.zeppelin.spark.PySparkInterpreterTest.testCompletion(PySparkInterpreterTest.java:121)
17/01/26 19:23:23 INFO SparkContext: Invoking stop() from shutdown hook
17/01/26 19:23:23 INFO SparkUI: Stopped Spark web UI at http://172.17.0.6:4040
17/01/26 19:23:23 INFO MapOutputTrackerMasterEndpoint:
MapOutputTrackerMasterEndpoint stopped!
17/01/26 19:23:23 INFO MemoryStore: MemoryStore cleared
17/01/26 19:23:23 INFO BlockManager: BlockManager stopped
17/01/26 19:23:23 INFO BlockManagerMaster: BlockManagerMaster stopped
17/01/26 19:23:23 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint:
OutputCommitCoordinator stopped!
17/01/26 19:23:23 INFO RemoteActorRefProvider$RemotingTerminator: Shutting down
remote daemon.
17/01/26 19:23:23 INFO SparkContext: Successfully stopped SparkContext
17/01/26 19:23:23 INFO ShutdownHookManager: Shutdown hook called
17/01/26 19:23:23 INFO ShutdownHookManager: Deleting directory
/tmp/spark-416c693f-9290-428b-830a-d0bb5c0da703/pyspark-6c48736e-37c2-4747-8a38-5d0bf104b4fa
17/01/26 19:23:23 INFO ShutdownHookManager: Deleting directory
/tmp/spark-9ce929d5-8400-410d-9729-9a3caefd8b2c
17/01/26 19:23:23 INFO RemoteActorRefProvider$RemotingTerminator: Remote daemon
shut down; proceeding with flushing remote transports.
17/01/26 19:23:23 INFO ShutdownHookManager: Deleting directory
/tmp/spark-508bdc3a-9777-486b-901b-b72d0ba42250
17/01/26 19:23:23 INFO ShutdownHookManager: Deleting directory
/tmp/spark-416c693f-9290-428b-830a-d0bb5c0da703
Results :
Failed tests:
PySparkInterpreterTest.testCompletion:121 null
Tests run: 7, Failures: 1, Errors: 0, Skipped: 0
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ZEPPELIN-2020) Remote method invocation for Resource in ResourcePool
Lee moon soo created ZEPPELIN-2020: -- Summary: Remote method invocation for Resource in ResourcePool Key: ZEPPELIN-2020 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2020 Project: Zeppelin Issue Type: Sub-task Reporter: Lee moon soo Assignee: Lee moon soo Fix For: 0.8.0 Currently, ResourcePool provides a way to store Serializable and Non-Serializable object. In case of Non-Serializable object is stored in resource pool, other interpreter process can not read the object. This is limitation for storing object like jdbc connection, spark dataframe in the resourcepool. For non-serialiable object in the resource pool, we can think about * Call method remotely and get return * Call method remotely and save return into resource pool. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-2019) [Umbrella] Query dataset across different interpreter
Lee moon soo created ZEPPELIN-2019: -- Summary: [Umbrella] Query dataset across different interpreter Key: ZEPPELIN-2019 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2019 Project: Zeppelin Issue Type: New Feature Reporter: Lee moon soo Fix For: 0.8.0 h3. Motivation Zeppelin connects various backend data processing system through Interpreter. While Zeppelin is central place that those heterogeneous systems connected, it is really great Zeppelin gives possibility of query data across different backend system. So, such job "joining jdbc table and spark dataframe" would be possible. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1993) Install interpreter from Helium menu.
Lee moon soo created ZEPPELIN-1993:
--
Summary: Install interpreter from Helium menu.
Key: ZEPPELIN-1993
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1993
Project: Zeppelin
Issue Type: New Feature
Reporter: Lee moon soo
Currently, {{bin/install-interpreter.sh}} command installs interpreters.
And {{conf/interpreter-list}} file holds informations for available community
managed interpreters.
'Helium' menu can provide GUI for install/uninstall/upgrade interpreters, as
well as the other pluggable components like visualization.
* How it works
Implement InterpreterListHeliumRegistry that extends HeliumRegistry.java, and
providing informations for available community managed interpreters based on
information conf/interpreter-list.
3rd party interpreter will need to copy helium package json file into /helium
directory for now. In the future, we can automatically generate package info
from maven repository using similar approach described in ZEPPELIN-1973 for
npm. Then both 3rd party and community managed interpreter will be listed in
helium menu, automatically.
Once user click 'enable', libraries will be downloaded from maven repository
and copied to interpreter directory. After new interpreter will be loaded when
Zeppelin restart.
* Future work
Load / Unload interpreter without restarting Zeppelin.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1992) Flaky test - startUpWithAuthenticationEnable()
Lee moon soo created ZEPPELIN-1992:
--
Summary: Flaky test - startUpWithAuthenticationEnable()
Key: ZEPPELIN-1992
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1992
Project: Zeppelin
Issue Type: Sub-task
Reporter: Lee moon soo
CI build fails with
{code}
Caused by: com.google.gson.JsonSyntaxException: duplicate key: 2C6EDDAHM
at
com.google.gson.internal.bind.MapTypeAdapterFactory$Adapter.read(MapTypeAdapterFactory.java:191)
at
com.google.gson.internal.bind.MapTypeAdapterFactory$Adapter.read(MapTypeAdapterFactory.java:146)
at
com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.read(ReflectiveTypeAdapterFactory.java:93)
at
com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.read(ReflectiveTypeAdapterFactory.java:172)
at com.google.gson.Gson.fromJson(Gson.java:791)
at com.google.gson.Gson.fromJson(Gson.java:757)
at com.google.gson.Gson.fromJson(Gson.java:706)
at com.google.gson.Gson.fromJson(Gson.java:678)
at
org.apache.zeppelin.interpreter.InterpreterFactory.loadFromFile(InterpreterFactory.java:387)
at
org.apache.zeppelin.interpreter.InterpreterFactory.init(InterpreterFactory.java:248)
at
org.apache.zeppelin.interpreter.InterpreterFactory.(InterpreterFactory.java:165)
at
org.apache.zeppelin.interpreter.InterpreterFactory.(InterpreterFactory.java:138)
at
org.apache.zeppelin.server.ZeppelinServer.(ZeppelinServer.java:135)
... 35 more
...
...
Results :
Tests in error:
NotebookSecurityRestApiTest.init:49->AbstractTestRestApi.startUpWithAuthenticationEnable:229->AbstractTestRestApi.start:179
» Runtime
Tests run: 53, Failures: 0, Errors: 1, Skipped: 0
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on
project zeppelin-server: There are test failures.
[ERROR]
[ERROR] Please refer to
/home/travis/build/apache/zeppelin/zeppelin-server/target/surefire-reports for
the individual test results.
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn -rf :zeppelin-server
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1986) WelcomePageSuite test fail
Lee moon soo created ZEPPELIN-1986:
--
Summary: WelcomePageSuite test fail
Key: ZEPPELIN-1986
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1986
Project: Zeppelin
Issue Type: Bug
Reporter: Lee moon soo
Recently, most CI build fails with
{code}
[36mRun starting. Expected test count is: 1[0m
Pid dir doesn't exist, create /home/travis/build/apache/zeppelin/run
Zeppelin start [60G[[1;32m OK [0;39m]
< HTTP/1.1 200 OK
[32mWelcomePageSuite:[0m
[31m- Welcome sign is correct *** FAILED ***[0m
[31m The code passed to eventually never returned normally. Attempted 16
times over 20.62462999303 seconds. Last failure message:
WelcomePageSuite.this.find("welcome")(WelcomePageSuite.this.driver).isDefined
was false. (WelcomePageSuite.scala:31)[0m
Zeppelin stop [60G[[1;32m OK [0;39m]
[36mRun completed in 40 seconds, 857 milliseconds.[0m
[36mTotal number of tests run: 1[0m
[36mSuites: completed 3, aborted 0[0m
[36mTests: succeeded 0, failed 1, canceled 0, ignored 0, pending 0[0m
[31m*** 1 TEST FAILED ***[0m
[ERROR] Failed to execute goal org.scalatest:scalatest-maven-plugin:1.0:test
(test) on project zeppelin-server: There are test failures -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn -rf :zeppelin-server
{code}
error
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1975) Prevent broken link, image in docs, automatically.
Lee moon soo created ZEPPELIN-1975: -- Summary: Prevent broken link, image in docs, automatically. Key: ZEPPELIN-1975 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1975 Project: Zeppelin Issue Type: Improvement Reporter: Lee moon soo Priority: Minor Currently, there're many reasons /docs can have broken link or image. for example * by mistake * it works well in /docs local dev mode, but link broken when deployed (e.g. ZEPPELIN-1970) How about add a CI profile that build docs, run docs in production configuration and verify all the links and images are not broken? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1969) Can not switch visualization package version
Lee moon soo created ZEPPELIN-1969: -- Summary: Can not switch visualization package version Key: ZEPPELIN-1969 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1969 Project: Zeppelin Issue Type: Bug Reporter: Lee moon soo Assignee: Lee moon soo Fix For: 0.7.0 In case of there're multiple versions of a visualization package in npm repository, Zeppelin helium menu allows user select specific version. However, switching version sometimes result 'npm install' command failure (internally). And visualization bundle can not be rebuilt. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1915) [Umbrella] Improve built-in visualizations
Lee moon soo created ZEPPELIN-1915: -- Summary: [Umbrella] Improve built-in visualizations Key: ZEPPELIN-1915 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1915 Project: Zeppelin Issue Type: Task Reporter: Lee moon soo This is umbrella issues for - Bug fixes - Improvements on built-in visualizations -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1887) "Run all paragraphs" adds new paragraph
Lee moon soo created ZEPPELIN-1887: -- Summary: "Run all paragraphs" adds new paragraph Key: ZEPPELIN-1887 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1887 Project: Zeppelin Issue Type: Bug Reporter: Lee moon soo Click "Run all paragraphs" adds new paragraph, which is unexpected behavior. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1830) Test failure on RemoteAngularObjectTest.testAngularObjectRemovalOnZeppelinServerSide
Lee moon soo created ZEPPELIN-1830: -- Summary: Test failure on RemoteAngularObjectTest.testAngularObjectRemovalOnZeppelinServerSide Key: ZEPPELIN-1830 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1830 Project: Zeppelin Issue Type: Bug Reporter: Lee moon soo Flaky test failure on RemoteAngularObjectTest.testAngularObjectRemovalOnZeppelinServerSide Build https://travis-ci.org/apache/zeppelin/jobs/184525254 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1825) Use version controlled notebook repo by default.
Lee moon soo created ZEPPELIN-1825: -- Summary: Use version controlled notebook repo by default. Key: ZEPPELIN-1825 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1825 Project: Zeppelin Issue Type: Improvement Reporter: Lee moon soo After ZEPPELIN-1190, user can create and view checkpoints of note. However, default notebook repo (VFSNotebookRepo) does not implement checkpoint() and user will see "Couldn't checkpoint note revision: possibly storage doesn't support versioning. Please check the logs for more details." message. How about use notebook repo that support checkpoint() as a default? So user can use checkpoint feature with zero configuration. I think we can use GitNotebookRepo as a default one -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1811) Enable SSL by default
Lee moon soo created ZEPPELIN-1811: -- Summary: Enable SSL by default Key: ZEPPELIN-1811 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1811 Project: Zeppelin Issue Type: Improvement Reporter: Lee moon soo How about make Zeppelin use SSL by default? One possible approach is generate keystore, truststore on the first run if necessary command line tool (key-tools, openssl) is available on the system. Otherwise fallback to non-ssl with print warning message. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1809) Paragraph title is not correctly displayed in "link this paragraph" url.
Lee moon soo created ZEPPELIN-1809: -- Summary: Paragraph title is not correctly displayed in "link this paragraph" url. Key: ZEPPELIN-1809 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1809 Project: Zeppelin Issue Type: Bug Reporter: Lee moon soo paragraph title is not correctly displayed in "Link this paragraph" url. see attached screenshot. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1808) Keyboard shortcut should not work in "Link this paragraph" url
Lee moon soo created ZEPPELIN-1808: -- Summary: Keyboard shortcut should not work in "Link this paragraph" url Key: ZEPPELIN-1808 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1808 Project: Zeppelin Issue Type: Bug Affects Versions: 0.6.2 Reporter: Lee moon soo Keyboard shortcut should not work in "Link this paragraph" url. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
