[jira] [Created] (ZEPPELIN-1275) Comment code of PySparkInterpreter is not highlighted
Jeff Zhang created ZEPPELIN-1275: Summary: Comment code of PySparkInterpreter is not highlighted Key: ZEPPELIN-1275 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1275 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.6.0 Reporter: Jeff Zhang Priority: Minor -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] zeppelin issue #1231: [Zeppelin - 683][WIP] BittorrentNotebookRepo
Github user onkarshedge commented on the issue: https://github.com/apache/zeppelin/pull/1231 And also a note on directories.. 1] torrent notes/ 17fa195f6c85f72d197d63896b15f456e624/note.json 282f928f9429828e5ef0a422f13d3263e671a2d3/note.json resume/ torrents/ settings.dat The torrent directory is created which will contain the following directories. When the user wants to share a note via DHT he will give the noteId , the note.json file is copied to torrent/notes// and then seeded by adding to TorrentEngine. The reason to copy before seeding is if note is changed or updated after added to seeding, the pieces hash will change and hence corrupt. The torrent state will change from seeding --> downloading because it doesn't have that file. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1231: [Zeppelin - 683][WIP] BittorrentNotebookRepo
Github user onkarshedge commented on the issue: https://github.com/apache/zeppelin/pull/1231 @bzz here is the diagram.  [Link to drive] (https://drive.google.com/file/d/0Bwg4NhDtfdM9WFRQSGJVV09Ub1U/view?usp=sharing)  [Link to drive](https://drive.google.com/file/d/0Bwg4NhDtfdM9UFhkMDItQlVFaHM/view?usp=sharing) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #1272: Remove empty user when put permission
GitHub user zhangmq opened a pull request: https://github.com/apache/zeppelin/pull/1272 Remove empty user when put permission ### What is this PR for? check empty users and delete it. ### What type of PR is it? [Bug Fix] ### Todos ### What is the Jira issue? ### How should this be tested? clear note permissions then your note can't read. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update?no * Is there breaking changes for older versions?no * Does this needs documentation?no You can merge this pull request into a Git repository by running: $ git pull https://github.com/zhangmq/zeppelin master Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/1272.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1272 commit 61bd580d4285135855d6610b83b367f19c5426ff Author: zhangmengqi Date: 2016-08-03T06:24:48Z remve empty user when put permission --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1271: [ZEPPELIN-1274]Write "Spark SQL" in docs rather than "...
Github user AhyoungRyu commented on the issue: https://github.com/apache/zeppelin/pull/1271 @sarutak Looks good. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1271: [ZEPPELIN-1274]Write "Spark SQL" in docs rather than "...
Github user sarutak commented on the issue: https://github.com/apache/zeppelin/pull/1271 @AhyoungRyu Thanks for the notification. I'll fix them soon. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1271: [ZEPPELIN-1274]Write "Spark SQL" in docs rather than "...
Github user AhyoungRyu commented on the issue: https://github.com/apache/zeppelin/pull/1271 @sarutak Thanks for fixing this. I found more `SparkSQL` in the below 2 files. - [docs/manual/dynamicform.md#using-form-templates](https://github.com/apache/zeppelin/blob/master/docs/manual/dynamicform.md#using-form-templates) - [docs/interpreter/livy.md#configuration](https://github.com/apache/zeppelin/blob/master/docs/interpreter/livy.md#configuration) Could you change them as well? :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1258: [ ZEPPELIN-1266 ] Code editor Optimization
Github user corneadoug commented on the issue: https://github.com/apache/zeppelin/pull/1258 @cloverhearts Thanks for the changes and keeping this PR focused. I saw some great improvements with big Notebook with those changes. @Leemoonsoo Can you try it too and tell us if you also think its better? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1270: [ZEPPELIN-1273] Use Math.abs to determine if custom fo...
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/1270 Looks great to me, thank you @praagarw Merging to only to master, if there is no further discussion Or do you think we should also apply this to upcoming 0.6.1 as well? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1258: [ ZEPPELIN-1266 ] Code editor Optimization
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/1258 Looks great to me! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #1271: [Z
GitHub user sarutak opened a pull request: https://github.com/apache/zeppelin/pull/1271 [Z ### What is this PR for? Some of the doc files say "SparkSQL" but the collect spelling is "Spark SQL" (need a white space between "Spark" and "SQL"). Lets's replace it with the collect one. ### What type of PR is it? [Bug Fix | Improvement | Feature | Documentation | Hot Fix | Refactoring] ### Todos * [ ] - Task ### What is the Jira issue? * Open an issue on Jira https://issues.apache.org/jira/browse/ZEPPELIN/ * Put link here, and add [ZEPPELIN-*Jira number*] in PR title, eg. [ZEPPELIN-533] ### How should this be tested? Outline the steps to test the PR here. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? * Is there breaking changes for older versions? * Does this needs documentation? You can merge this pull request into a Git repository by running: $ git pull https://github.com/sarutak/zeppelin ZEPPELIN-1274 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/1271.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1271 commit 14aa2b760c256a3a862342bdca365bcecbea7072 Author: Kousuke Saruta Date: 2016-08-03T05:37:28Z Replaced 'SparkSQL' in docs into 'Spark SQL' --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (ZEPPELIN-1274) Write "Spark SQL" in docs rather than "SparkSQL"
Kousuke Saruta created ZEPPELIN-1274: Summary: Write "Spark SQL" in docs rather than "SparkSQL" Key: ZEPPELIN-1274 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1274 Project: Zeppelin Issue Type: Improvement Components: documentation Affects Versions: 0.7.0 Reporter: Kousuke Saruta Priority: Minor Some of the doc files say "SparkSQL" but the collect spelling is "Spark SQL" (need a white space between "Spark" and "SQL"). Lets's replace it with the collect one. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] zeppelin issue #1263: Small cleanup of zeppelin-server tests
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/1263 CI failure ``` Results : Failed tests: ZeppelinSparkClusterTest.sparkRTest:116 expected:<[[1] 3]> but was:<[Error in getSparkSession(): SparkSession not initialized Error in (function (classes, fdef, mtable) : unable to find an inherited method for function 'count' for signature '"function"' ]> Tests run: 65, Failures: 1, Errors: 0, Skipped: 0 Fixed in #1259 so rebasing again --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1258: [ ZEPPELIN-1266 ] Code editor Optimization
Github user cloverhearts commented on the issue: https://github.com/apache/zeppelin/pull/1258 @bzz I removed the parts which you say. Thank you. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1258: [ ZEPPELIN-1266 ] Code editor Optimization
Github user cloverhearts commented on the issue: https://github.com/apache/zeppelin/pull/1258 @corneadoug I did modification. Please review for this pr. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #1267: [ZEPPELIN-1261] Bug fix in z.show() for matplot...
Github user asfgit closed the pull request at: https://github.com/apache/zeppelin/pull/1267 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1248: [ZEPPELIN-1069]Ignore implicit interpreter when user e...
Github user mwkang commented on the issue: https://github.com/apache/zeppelin/pull/1248 I refactor method name. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1266: [ZEPPELIN-1219] Add searching feature to Zeppelin docs...
Github user AhyoungRyu commented on the issue: https://github.com/apache/zeppelin/pull/1266 @bzz Really appreciate for your all precise comments! Updated several docs as you suggested :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #1270: [ZEPPELIN-1273] Use Math.abs to determine if cu...
GitHub user prasadwagle opened a pull request: https://github.com/apache/zeppelin/pull/1270 [ZEPPELIN-1273] Use Math.abs to determine if custom formatter should be called for y axis values ### What is this PR for? Use Math.abs to determine if custom formatter should be called for y axis values. ### What type of PR is it? Bug Fix ### Todos * [ ] - Task ### What is the Jira issue? [ZEPPELIN-1273] https://issues.apache.org/jira/browse/ZEPPELIN-1273 ### How should this be tested? Create simple table with two columns - date in one and large negative numbers like -1000 in other. Display line chart and see that the y axis values are formatted like -10M. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No You can merge this pull request into a Git repository by running: $ git pull https://github.com/prasadwagle/incubator-zeppelin ZEPPELIN-1273 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/1270.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1270 commit 06e12f88e3d39f6b090ad8c9fc346491f9e79908 Author: Prasad Wagle Date: 2016-08-03T03:57:13Z Use Math.abs to determine if custom formatter should be called for y axis values --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (ZEPPELIN-1273) d3.format not called for large negative numbers
Prasad Wagle created ZEPPELIN-1273: -- Summary: d3.format not called for large negative numbers Key: ZEPPELIN-1273 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1273 Project: Zeppelin Issue Type: Bug Components: front-end Reporter: Prasad Wagle Assignee: Prasad Wagle Priority: Minor -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] zeppelin issue #1207: [DOC][ZEPPELIN-1209] Remove a useless sentence about d...
Github user AhyoungRyu commented on the issue: https://github.com/apache/zeppelin/pull/1207 CI build failure is irrelevant with this PR i think. Can this be merged then? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #1268: minor doc fix for r.md
Github user asfgit closed the pull request at: https://github.com/apache/zeppelin/pull/1268 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #1259: [ZEPPELIN-1260] R interpreter doesn't work with...
Github user asfgit closed the pull request at: https://github.com/apache/zeppelin/pull/1259 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1268: minor doc fix for r.md
Github user AhyoungRyu commented on the issue: https://github.com/apache/zeppelin/pull/1268 @zjffdu you have good eyes :) Looks good. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1267: [ZEPPELIN-1261] Bug fix in z.show() for matplotlib gra...
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/1267 Sounds great! Apparently CI failure has been addressed in #1259 as well --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #932: Replace CXF with Jersey2 [ZEPPELIN-903]
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/932 A quick search over JIRA suggests that the failure you reffer was taked care of in [ZEPPELIN-1264](https://issues.apache.org/jira/browse/ZEPPELIN-1264) and is resolved in latest master, please rebase. In PR body > Does the licenses files need update? N I think it does @echarles all transitive dependencies lie `woodstox` and `org.glassfish.jersey.bundles` and `javax.validation`, etc will be included in convenience binary for release so each of them must be as well included in `zeppelin-distribution/src/bin-license/LICENSE` according to their license. Could you please double check that? >Jersey2 can better manage the JSON bodies and mappings. Could you please elaborate on that part? People might not be very familiar with it very well, so if you could put the benefits of such change in PR description - that would help a lot. Thank you! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1267: [ZEPPELIN-1261] Bug fix in z.show() for matplotlib gra...
Github user bustios commented on the issue: https://github.com/apache/zeppelin/pull/1267 I see. Thanks for your help and information @bzz. I'll keep it in mind for subsequent PRs --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (ZEPPELIN-1272) Zeppelin spark innterpreters throws java.lang.StackOverflowError after running a while
lichenglin created ZEPPELIN-1272:
Summary: Zeppelin spark innterpreters throws
java.lang.StackOverflowError after running a while
Key: ZEPPELIN-1272
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1272
Project: Zeppelin
Issue Type: Bug
Components: Interpreters
Affects Versions: 0.6.0
Reporter: lichenglin
I'm using Zeppelin to run some spark job with crontab.
But In the last days,I found Zeppelin's spark interpreter shut down almost
every day once or more.
And here is the log
{code}
java.lang.StackOverflowError
at scala.reflect.internal.Types$TypeMap.mapOver(Types.scala:4183)
at scala.reflect.internal.Types$AsSeenFromMap.apply(Types.scala:4638)
at scala.reflect.internal.Types$TypeMap.mapOver(Types.scala:4197)
at scala.reflect.internal.Types$AsSeenFromMap.apply(Types.scala:4638)
at scala.reflect.internal.Types$Type.asSeenFrom(Types.scala:754)
at scala.reflect.internal.Types$Type.computeMemberType(Types.scala:788)
at
scala.reflect.internal.Symbols$MethodSymbol.typeAsMemberOf(Symbols.scala:2655)
at scala.reflect.internal.Types$Type.memberType(Types.scala:779)
at
scala.reflect.internal.Types$class.defineUnderlyingOfSingleType(Types.scala:1534)
at
scala.reflect.internal.SymbolTable.defineUnderlyingOfSingleType(SymbolTable.scala:13)
at scala.reflect.internal.Types$SingleType.underlying(Types.scala:1486)
at scala.reflect.internal.Types$SingletonType.widen(Types.scala:1340)
at
scala.reflect.internal.Types$AsSeenFromMap.toPrefix$1(Types.scala:4541)
at scala.reflect.internal.Types$AsSeenFromMap.apply(Types.scala:4556)
at scala.reflect.internal.Types$TypeMap.mapOver(Types.scala:4183)
at scala.reflect.internal.Types$AsSeenFromMap.apply(Types.scala:4638)
at scala.reflect.internal.Types$TypeMap.mapOver(Types.scala:4197)
at scala.reflect.internal.Types$AsSeenFromMap.apply(Types.scala:4638)
at scala.reflect.internal.Types$Type.asSeenFrom(Types.scala:754)
at scala.reflect.internal.Types$Type.computeMemberType(Types.scala:788)
at
scala.reflect.internal.Symbols$MethodSymbol.typeAsMemberOf(Symbols.scala:2655)
at scala.reflect.internal.Types$Type.memberType(Types.scala:779)
at
scala.reflect.internal.Types$class.defineUnderlyingOfSingleType(Types.scala:1534)
at
scala.reflect.internal.SymbolTable.defineUnderlyingOfSingleType(SymbolTable.scala:13)
at scala.reflect.internal.Types$SingleType.underlying(Types.scala:1486)
at scala.reflect.internal.Types$SingletonType.widen(Types.scala:1340)
at
scala.reflect.internal.Types$AsSeenFromMap.toPrefix$1(Types.scala:4541)
at scala.reflect.internal.Types$AsSeenFromMap.apply(Types.scala:4556)
at scala.reflect.internal.Types$TypeMap.mapOver(Types.scala:4183)
at scala.reflect.internal.Types$AsSeenFromMap.apply(Types.scala:4638)
at scala.reflect.internal.Types$TypeMap.mapOver(Types.scala:4197)
at scala.reflect.internal.Types$AsSeenFromMap.apply(Types.scala:4638)
at scala.reflect.internal.Types$Type.asSeenFrom(Types.scala:754)
at scala.reflect.internal.Types$Type.computeMemberType(Types.scala:788)
at
scala.reflect.internal.Symbols$MethodSymbol.typeAsMemberOf(Symbols.scala:2655)
at scala.reflect.internal.Types$Type.memberType(Types.scala:779)
at
scala.reflect.internal.Types$class.defineUnderlyingOfSingleType(Types.scala:1534)
at
scala.reflect.internal.SymbolTable.defineUnderlyingOfSingleType(SymbolTable.scala:13)
at scala.reflect.internal.Types$SingleType.underlying(Types.scala:1486)
at scala.reflect.internal.Types$SingletonType.widen(Types.scala:1340)
at
scala.reflect.internal.Types$AsSeenFromMap.toPrefix$1(Types.scala:4541)
at scala.reflect.internal.Types$AsSeenFromMap.apply(Types.scala:4556)
at scala.reflect.internal.Types$TypeMap.mapOver(Types.scala:4183)
{code}
It was a very very long log, seems to be a loop
I have adjust the env like this
{code}
export JAVA_HOME=/home/hadoop/jdk
export MASTER=spark://namenode:7077
export ZEPPELIN_PORT=10001
export SPARK_HOME=/home/hadoop/spark-1.6.2-bin-hadoop2.6
export SPARK_SUBMIT_OPTIONS="--driver-memory 2g --executor-memory 5g
--driver-class-path
/home/hadoop/spark-1.6.2-bin-hadoop2.6/extlib/oracle-driver.jar:/home/hadoop/spark-1.6.2-bin-hadoop2.6/extlib/phoenix-4.7.0-HBase-1.1-client-spark.jar:/home/hadoop/spark-1.6.2-bin-hadoop2.6/extlib/spark-csv_2.10-1.3.0.jar:/home/hadoop/zeppelin-0.6.0-bin-all/lib/*:/home/hadoop/zeppelin-0.6.0-bin-all/*::/home/hadoop/zeppelin-0.6.0-bin-all/conf:/home/hadoop/zeppelin-0.6.0-bin-all/interpreter/spark/*::/home/hadoop/zeppelin-0.6.0-bin-all/conf:/home/hadoop/zeppelin-0.6.0-bin-all/conf:/home/hadoop/zeppelin-0.6.0-bi
[GitHub] zeppelin issue #1266: [ZEPPELIN-1219] Add searching feature to Zeppelin docs...
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/1266 Great improvement @AhyoungRyu ! Posted few suggestions above. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (ZEPPELIN-1271) ZeppelinSparkClusterTest.sparkRTest test is flaky and fails often
Alexander Bezzubov created ZEPPELIN-1271:
Summary: ZeppelinSparkClusterTest.sparkRTest test is flaky and
fails often
Key: ZEPPELIN-1271
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1271
Project: Zeppelin
Issue Type: Bug
Affects Versions: 0.6.0, 0.7.0
Reporter: Alexander Bezzubov
ZeppelinSparkClusterTest.sparkRTest test is flaky
Same failures
- https://github.com/apache/zeppelin/pull/1249
- https://github.com/apache/zeppelin/pull/1160
- https://github.com/apache/zeppelin/pull/1051
- https://github.com/apache/zeppelin/pull/1043
- https://github.com/apache/zeppelin/pull/943
- https://github.com/apache/zeppelin/pull/835
{code}
[INFO] Zeppelin: Server ... FAILURE [03:05 min]
Results :
Failed tests:
ZeppelinSparkClusterTest.sparkRTest:116 expected:<[[1] 3]> but
was:<[Error in getSparkSession(): SparkSession not initialized
Error in (function (classes, fdef, mtable) : unable to find an
inherited method for function 'count' for signature '"function"'
]>
Tests run: 65, Failures: 1, Errors: 0, Skipped: 0
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[GitHub] zeppelin issue #1263: Small cleanup of zeppelin-server tests
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/1263 CI failed due to [ZEPPELIN-1264](https://issues.apache.org/jira/browse/ZEPPELIN-1264) Rebasing on latest master and merging, if there is no further discusison --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1267: [ZEPPELIN-1261] Bug fix in z.show() for matplotlib gra...
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/1267 Looks great to me, thank you @bustios ! Merging to master if there is no further discussion --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1269: ZEPPELIN-1270. Remove getting SQLContext from SparkSes...
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/1269 \cc @Leemoonsoo Please help review, thanks --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #1269: ZEPPELIN-1270. Remove getting SQLContext from S...
GitHub user zjffdu opened a pull request: https://github.com/apache/zeppelin/pull/1269 ZEPPELIN-1270. Remove getting SQLContext from SparkSession.wrapped() ### What is this PR for? SparkSession.wrapped is only for spark 2.0 preview, it is not supported in spark 2.0 release. So I think we can remove that piece of code. Otherwise we will get the following error in log which might be a little confusing. ``` 08:05:44,946 - Thread(pool-2-thread-3) - (Utils.java:40) - org.apache.spark.sql.SparkSession.wrapped() java.lang.NoSuchMethodException: org.apache.spark.sql.SparkSession.wrapped() at java.lang.Class.getMethod(Class.java:1786) at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:38) at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:33) ``` ### What type of PR is it? [Improvement] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-1270 ### How should this be tested? Check the log and the above error is gone. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No You can merge this pull request into a Git repository by running: $ git pull https://github.com/zjffdu/zeppelin ZEPPELIN-1270 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/1269.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1269 commit 4401561ca852654fecc0affa5617816517402641 Author: Jeff Zhang Date: 2016-08-03T00:20:03Z ZEPPELIN-1270. Remove getting SQLContext from SparkSession.wrapped() --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (ZEPPELIN-1270) Remove getting SQLContext from SparkSession.wrapped()
Jeff Zhang created ZEPPELIN-1270:
Summary: Remove getting SQLContext from SparkSession.wrapped()
Key: ZEPPELIN-1270
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1270
Project: Zeppelin
Issue Type: Improvement
Affects Versions: 0.7.0
Reporter: Jeff Zhang
Assignee: Jeff Zhang
Priority: Minor
SparkSession.wrapped is only for spark 2.0 preview, it is not supported in
spark 2.0 release. So I think we can remove that piece of code. Otherwise we
will get the following error in log which might be a little confusing.
{noformat}
08:05:44,946 - Thread(pool-2-thread-3) - (Utils.java:40) -
org.apache.spark.sql.SparkSession.wrapped()
java.lang.NoSuchMethodException: org.apache.spark.sql.SparkSession.wrapped()
at java.lang.Class.getMethod(Class.java:1786)
at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:38)
at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:33)
at
org.apache.zeppelin.spark.SparkInterpreter.getSQLContext_2(SparkInterpreter.java:241)
at
org.apache.zeppelin.spark.SparkInterpreter.getSQLContext(SparkInterpreter.java:229)
at
org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:744)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69)
at
org.apache.zeppelin.spark.SparkRInterpreter.getSparkInterpreter(SparkRInterpreter.java:188)
at
org.apache.zeppelin.spark.SparkRInterpreter.open(SparkRInterpreter.java:72)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:383)
at org.apache.zeppelin.scheduler.Job.run(Job.java:176)
at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[GitHub] zeppelin pull request #1268: minor doc fix for r.md
GitHub user zjffdu opened a pull request: https://github.com/apache/zeppelin/pull/1268 minor doc fix for r.md ### What is this PR for? straightforward doc fix ### What type of PR is it? [Documentation] ### Todos * [ ] - Task ### What is the Jira issue? * No jira created as it is very trival. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No You can merge this pull request into a Git repository by running: $ git pull https://github.com/zjffdu/zeppelin r_doc_fix Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/1268.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1268 commit 105fead32d131ed466bc169f084a443556968b9d Author: Jeff Zhang Date: 2016-08-02T23:51:07Z minor doc fix for r.md --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1268: minor doc fix for r.md
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/1268 @AhyoungRyu Please help review. Thanks --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1232: ZEPPELIN-1197. Should print output directly without in...
Github user Leemoonsoo commented on the issue: https://github.com/apache/zeppelin/pull/1232 Merge into master if there're no more discussions. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1260: ZEPPELIN-1267. PySparkInterpreter doesn't work in spar...
Github user Leemoonsoo commented on the issue: https://github.com/apache/zeppelin/pull/1260 Looks good to me. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #1267: [ZEPPELIN-1261] Bug fix in z.show() for matplot...
GitHub user bustios opened a pull request: https://github.com/apache/zeppelin/pull/1267 [ZEPPELIN-1261] Bug fix in z.show() for matplotlib graphs ### What is this PR for? Bug fix in z.show() for matplotlib graphs and code refactoring ### What type of PR is it? Bug Fix ### What is the Jira issue? [ZEPPELIN-1261](https://issues.apache.org/jira/browse/ZEPPELIN-1261) ### How should this be tested? ``` %python import matplotlib.pyplot as plt x = [1,2,3,4,5] y = [6,7,8,9,0] plt.plot(x, y, marker="o") z.show(plt, height="20em") plt.close() ``` ``` %python import matplotlib.pyplot as plt x = [1,2,3,4,5] y = [6,7,8,9,0] plt.plot(x, y, marker="o") z.show(plt, height="300px") plt.close() ``` ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No You can merge this pull request into a Git repository by running: $ git pull https://github.com/bustios/zeppelin ZEPPELIN-1261 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/1267.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1267 commit 3e0ef22121d3858206f9af1787bf79108f9f2ed6 Author: Paul Bustios Date: 2016-08-02T20:55:56Z Bug fix in show_matplotlib --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1259: [ZEPPELIN-1260] R interpreter doesn't work with Spark ...
Github user Leemoonsoo commented on the issue: https://github.com/apache/zeppelin/pull/1259 Merge it into master and branch-0.6 if there're no more discussion --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #1261: [ZEPPELIN-1264] [HOTFIX] Fix CI test failure wi...
Github user asfgit closed the pull request at: https://github.com/apache/zeppelin/pull/1261 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1261: [ZEPPELIN-1264] [HOTFIX] Fix CI test failure with Fail...
Github user Leemoonsoo commented on the issue: https://github.com/apache/zeppelin/pull/1261 Merge it into master and branch-0.6 as a hotfix --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #1266: [ZEPPELIN-1219] Add searching feature to Zeppel...
GitHub user AhyoungRyu opened a pull request: https://github.com/apache/zeppelin/pull/1266 [ZEPPELIN-1219] Add searching feature to Zeppelin docs site ### What is this PR for? As more and more document pages are added, it's really hard to find specific pages. So I added searching feature to Zeppelin documentation site([jekyll](https://jekyllrb.com/) based site) using [lunr.js](http://lunrjs.com/). - **How it works?** I created [`search_data.json`](https://github.com/AhyoungRyu/zeppelin/blob/6e02423f541cc406e4e41031629609a276a9f481/docs/search_data.json) which is used for docs info template. `lunr.js` combines all of the text from all of the docs in `docs/` into `_site/search_data.json`. It looks like below.  All the info are comes from [Jekyll YAML front matter](https://jekyllrb.com/docs/frontmatter/) variables. (i.e. title, group, description.. that's why I rewrote all docs' title and description.) Using this data, [search.js](https://github.com/AhyoungRyu/zeppelin/blob/6e02423f541cc406e4e41031629609a276a9f481/docs/assets/themes/zeppelin/js/search.js) will do this job! ### What type of PR is it? Improvement & Feature ### Todos * [x] - Keep consistency for all docs pages' `Title` * [x] - Add some overview sentences to all docs pages' `Description` section (this will be used as the result preview) * [x] - Add apache license header to all docs page (some pages are missing the license header currently) * [x] - Add LICENSE for `lunr.min.js` ### What is the Jira issue? [ZEPPELIN-1219](https://issues.apache.org/jira/browse/ZEPPELIN-1219) ### How should this be tested? 1. Build docs site -> please see [docs/README.md#build-documentation](https://github.com/apache/zeppelin/tree/master/docs#build-documentation) 2. Click `search` icon in navbar and go to `search.html` page 3. Type anything you want to search in the search bar (i.e. type `python`, `spark`, `dynamic` ... ) ### Screenshots (if appropriate) https://cloud.githubusercontent.com/assets/10060731/17343202/71185300-5937-11e6-9e57-687bf2839cfb.png";>  ### Questions: * Does the licenses files need update? Yes, for `lunr.min.js` * Is there breaking changes for older versions? no * Does this needs documentation? no You can merge this pull request into a Git repository by running: $ git pull https://github.com/AhyoungRyu/zeppelin ZEPPELIN-1219 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/1266.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1266 commit 881a6b036e70bfb05f12c8a633f10c873508de9d Author: AhyoungRyu Date: 2016-08-02T19:11:27Z Add js files: lunr.min.js & search.js commit d261a63a7581ed0cc7ca3d78c46ae4b074a17ba7 Author: AhyoungRyu Date: 2016-08-02T19:13:25Z Add template for storing docs info based on jekyll front matter commit 495d6c420d975653f48926e055cc299e043daaa8 Author: AhyoungRyu Date: 2016-08-02T19:16:27Z Keep consistency all docs' front matter for the right search result commit 09e023d86cfc48794f3df53529266f8fd6e65832 Author: AhyoungRyu Date: 2016-08-02T19:16:51Z Add search icon to navbar commit d55ce76f310634298c5605f8b5a9ff2e1f3dcd6c Author: AhyoungRyu Date: 2016-08-02T19:17:08Z Add searching page commit d24c536f67c597db77751cbb383d113916bf769e Author: AhyoungRyu Date: 2016-08-02T19:19:02Z Attach 'Apache Zeppelin ZEPPELIN_VERSION Documentation: ' to title commit 6e02423f541cc406e4e41031629609a276a9f481 Author: AhyoungRyu Date: 2016-08-02T19:20:03Z Apply css style for the search results commit 0f3457d8c4aaebe4419f68c48a6422494d54a2d2 Author: AhyoungRyu Date: 2016-08-02T20:12:11Z Add lunr.min.js license info commit e6ab4b7a424f6681001eb14dffad9bdae4b2e03d Author: AhyoungRyu Date: 2016-08-02T20:12:42Z Exclude lunr.min.js --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1259: [ZEPPELIN-1260] R interpreter doesn't work with Spark ...
Github user echarles commented on the issue: https://github.com/apache/zeppelin/pull/1259 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #932: Replace CXF with Jersey2 [ZEPPELIN-903]
Github user echarles commented on the issue: https://github.com/apache/zeppelin/pull/932 Failing with org.apache.zeppelin.interpreter.InterpreterException: org.apache.thrift.TApplicationException: Internal error processing createInterpreter at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.init(RemoteInterpreter.java:238) Is this a WKZCIF (Well Know Zeppelin CI Failure) ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1265: [ZEPPELIN-1210] Run interpreter per user
Github user echarles commented on the issue: https://github.com/apache/zeppelin/pull/1265 Quickly went through the changes, but not sure to get it. In which way is this related to the various intepreter modes we already have? In which way is this related to ZEPPELIN-1000 (Multiple simultaneous users on a single WEB server)? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1247: ZEPPELIN-1254 Make get and save Interpreter bindings c...
Github user prabhjyotsingh commented on the issue: https://github.com/apache/zeppelin/pull/1247 LGTM! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #928: [ZEPPELIN-116] Add Apache Mahout Interpreter
Github user rawkintrevo commented on the issue: https://github.com/apache/zeppelin/pull/928 [Build 6281](https://travis-ci.org/apache/zeppelin/builds/149199571) Profiles [1](https://s3.amazonaws.com/archive.travis-ci.org/jobs/149199572/log.txt), [2](https://s3.amazonaws.com/archive.travis-ci.org/jobs/149199574/log.txt), and [3](https://travis-ci.org/apache/zeppelin/jobs/149199575): All stalled a la [ZEPPELIN-862](https://issues.apache.org/jira/browse/ZEPPELIN-862?jql=project%20%3D%20ZEPPELIN%20AND%20status%20in%20(Open%2C%20%22In%20Progress%22%2C%20Reopened)%20AND%20labels%20%3D%20flaky-test) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #1265: [ZEPPELIN-1210] Run interpreter per user
GitHub user jongyoul opened a pull request: https://github.com/apache/zeppelin/pull/1265 [ZEPPELIN-1210] Run interpreter per user ### What is this PR for? Enabling each user to run same interpreter. ### What type of PR is it? [Improvement] ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1210 ### How should this be tested? 1. Enable shiro to use authentication mode 1. Check `per user` in your interpreter tab 1. Run different paragraphs with different users 1. Run `%spark sc.version`, you will see the two `res0: ...` in your paragraphs ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No You can merge this pull request into a Git repository by running: $ git pull https://github.com/jongyoul/zeppelin ZEPPELIN-1210 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/1265.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1265 commit 8c5874756c7f2cbddc3d2a93b3ea60dbaf30b469 Author: Jongyoul Lee Date: 2016-07-21T15:34:25Z Added new parameter in order to pass the user information into getInterpreter commit 9fdfd1747a49b900fe952a1704eab35a5b4487bd Author: Jongyoul Lee Date: 2016-07-22T10:29:07Z WIP commit 52e1cbac924964316368cf112284325706174f03 Author: Jongyoul Lee Date: 2016-07-28T13:21:23Z WIP commit 65a24415824055bee5691866654b9b16e9106c76 Author: Jongyoul Lee Date: 2016-08-02T15:10:18Z Added option in UI --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #928: [ZEPPELIN-116] Add Apache Mahout Interpreter
GitHub user rawkintrevo reopened a pull request: https://github.com/apache/zeppelin/pull/928 [ZEPPELIN-116] Add Apache Mahout Interpreter ### What is this PR for? This PR adds Mahout functionality for the Spark Interpreter. ### What type of PR is it? Improvement ### Todos - [x] Implement Mahout Interpreter in Spark - [x] Add Unit Tests - [x] Add Documentation - [x] Add Example Notebook ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-116 ### How should this be tested? Open a Spark Notebook with Mahout enabled and run a few simple commands using the R-Like DSL and Spark Distributed Context (Mahout Specific) ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? Yes You can merge this pull request into a Git repository by running: $ git pull https://github.com/rawkintrevo/incubator-zeppelin mahout-terp Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/928.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #928 commit af935152ce0b70578317ad0f629fd7cf7043f9e0 Author: Trevor Grant Date: 2016-06-08T17:05:25Z [ZEPPELIN-116] Add Mahout Interpreter --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #928: [ZEPPELIN-116] Add Apache Mahout Interpreter
Github user rawkintrevo closed the pull request at: https://github.com/apache/zeppelin/pull/928 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #928: [ZEPPELIN-116] Add Apache Mahout Interpreter
Github user rawkintrevo commented on the issue: https://github.com/apache/zeppelin/pull/928 ## CI Failures in This PR Profile [2](https://s3.amazonaws.com/archive.travis-ci.org/jobs/148308638/log.txt) Hangs a la [ZEPPELIN-862](https://issues.apache.org/jira/browse/ZEPPELIN-862?jql=project%20%3D%20ZEPPELIN%20AND%20status%20in%20(Open%2C%20%22In%20Progress%22%2C%20Reopened)%20AND%20labels%20%3D%20flaky-test) `No output has been received in the last 10 minutes, this potentially indicates a stalled build or something wrong with the build itself.` Profile [6](https://s3.amazonaws.com/archive.travis-ci.org/jobs/148308642/log.txt), [8](https://s3.amazonaws.com/archive.travis-ci.org/jobs/148308647/log.txt) Network issues, can't download dependencies `[ERROR] Failed to execute goal org.apache.maven.plugins:maven-remote-resources-plugin:1.4:process (default) on project zeppelin: Error downloading resources archive. Could not transfer artifact org.apache.apache.resources:apache-jar-resource-bundle:jar:1.5-SNAPSHOT from/to codehaus-snapshots (https://nexus.codehaus.org/snapshots/): nexus.codehaus.org: Name or service not known` `ERROR] Failed to execute goal org.apache.maven.plugins:maven-remote-resources-plugin:1.4:process (default) on project zeppelin: Error downloading resources archive. Could not transfer artifact org.apache.apache.resources:apache-jar-resource-bundle:jar:1.5-SNAPSHOT from/to apache-snapshots (https://repository.apache.org/snapshots/): Connect to repository.apache.org:443 [repository.apache.org/207.244.88.143] failed: Connection timed out` Profile [7 ](https://s3.amazonaws.com/archive.travis-ci.org/jobs/148308645/log.txt) This is a [known flaky test with no coresponding JIRA](https://github.com/apache/zeppelin/pull/1201) `31m- should provide onclick method *** FAILED ***[0m [31m The code passed to eventually never returned normally. Attempted 1 times over 206.957211 milliseconds. Last failure message: 0 was not equal to 1. (AbstractAngularElemTest.scala:72)[0m` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #1264: Updated path to point to latest Maven binaries
GitHub user jojurajan opened a pull request: https://github.com/apache/zeppelin/pull/1264 Updated path to point to latest Maven binaries ### What is this PR for? To update link of Maven binary provided in the installation steps. ### What type of PR is it? [Documentation] ### Todos NA ### What is the Jira issue? NA ### How should this be tested? By running the following commands ``` wget http://www.eu.apache.org/dist/maven/maven-3/3.3.9/binaries/apache-maven-3.3.9-bin.tar.gz sudo tar -zxf apache-maven-3.3.9-bin.tar.gz -C /usr/local/ sudo ln -s /usr/local/apache-maven-3.3.9/bin/mvn /usr/local/bin/mvn # Build using latest mvn mvn clean package -Pspark-1.6 -Phadoop-2.4 -Pyarn -Ppyspark -DskipTests ``` ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No You can merge this pull request into a Git repository by running: $ git pull https://github.com/jojurajan/zeppelin jojurajan-maven-link-patch Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/1264.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1264 commit 0a4853f1a56c1bf108ec5a9e19111708ae649194 Author: Joju Rajan Date: 2016-08-02T06:56:48Z Updated path to latest Maven binaries --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1261: [ZEPPELIN-1264] [HOTFIX] Fix CI test failure with Fail...
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/1261 Have created [ZEPPELIN-1269](https://issues.apache.org/jira/browse/ZEPPELIN-1269) LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (ZEPPELIN-1269) HeliumApplicationFactoryTest hangs on default build from master
Alexander Bezzubov created ZEPPELIN-1269:
Summary: HeliumApplicationFactoryTest hangs on default build from
master
Key: ZEPPELIN-1269
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1269
Project: Zeppelin
Issue Type: Bug
Reporter: Alexander Bezzubov
{code}
Running org.apache.zeppelin.helium.HeliumApplicationFactoryTest
20:53:26,641 ERROR org.apache.zeppelin.interpreter.Interpreter:341 - Static
initialization is deprecated. You should change it to use
interpreter-setting.json in your jar or
interpreter/{interpreter}/interpreter-setting.json
20:53:28,711 INFO
org.apache.zeppelin.interpreter.remote.RemoteInterpreterManagedProcess:116 -
Run interpreter process
[/Users/alex/floss/zeppelin-incubator/bin/interpreter.sh, -d,
/Users/alex/floss/zeppelin-incubator/interpreter/spark, -p, 60434, -l,
/Users/alex/floss/zeppelin-incubator/local-repo/2BUP7GVTH]
20:53:28,763 INFO
org.apache.zeppelin.interpreter.remote.RemoteInterpreterManagedProcess:154 -
Interpreter process exited 0
20:53:58,990 ERROR org.apache.zeppelin.scheduler.RemoteScheduler:256 - Can't
get status information
org.apache.zeppelin.interpreter.InterpreterException:
org.apache.thrift.transport.TTransportException: java.net.ConnectException:
Connection refused
at
org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:53)
at
org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:1)
at
org.apache.commons.pool2.BasePooledObjectFactory.makeObject(BasePooledObjectFactory.java:60)
at
org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:861)
at
org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:435)
at
org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:363)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterProcess.getClient(RemoteInterpreterProcess.java:96)
at
org.apache.zeppelin.scheduler.RemoteScheduler$JobStatusPoller.getStatus(RemoteScheduler.java:254)
at
org.apache.zeppelin.scheduler.RemoteScheduler$JobStatusPoller.run(RemoteScheduler.java:212)
Caused by: org.apache.thrift.transport.TTransportException:
java.net.ConnectException: Connection refused
at org.apache.thrift.transport.TSocket.open(TSocket.java:187)
..
20:56:59,101 INFO org.apache.zeppelin.notebook.Paragraph:282 - run paragraph
20160802-205659_1961452200 using null
org.apache.zeppelin.interpreter.LazyOpenInterpreter@747b96ad
20:56:59,105 ERROR org.apache.zeppelin.scheduler.Job:189 - Job failed
org.apache.zeppelin.interpreter.InterpreterException:
java.lang.NullPointerException
at
org.apache.zeppelin.interpreter.dev.DevInterpreter.interpret(DevInterpreter.java:88)
at
org.apache.zeppelin.interpreter.ClassloaderInterpreter.interpret(ClassloaderInterpreter.java:58)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:94)
at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:309)
at org.apache.zeppelin.scheduler.Job.run(Job.java:176)
at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
Caused by: java.lang.NullPointerException
at
org.apache.zeppelin.interpreter.dev.DevInterpreter.interpret(DevInterpreter.java:86)
... 12 more
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[GitHub] zeppelin issue #1231: [Zeppelin - 683][WIP] BittorrentNotebookRepo
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/1231 @onkarshedge >> Initial idea the we discussed was that `BittorrentNotebookRepo` encapsulates all the things that are required in order to get notebooks. > Could you please elaborate this point. Sure. The idea with P2P notebook storage implementation, be that Bittorrent or Dat or any other protocol is to have: - a self-contained implementation (that possibly can be extracted to maven submodule later) - of a single class, that `implements NotebookRepo` protocol - and is pluggable, instead or on the side with current `VFSNotebookRepo` (for now - pluggable though a simple configuration in `zeppelin-env.sh`, later I can imagine that would be also possible though GUI) In case only some parts of `VFSNotebookRepo` are required (not sure if that is the case or not) - we can extract them to the _skeletal implementation_ `AbstractFileSystemNotebookRepo` and make `BittorrentNotebookRepo extends AbstractFileSystemNotebookRepo`. For more details on this approach to design object oriented architecture please read infamous Joshua Bloch "Effective Java, 2nd edition" `Item18: Prefer interfaces to abstract classes` p.93 --- Waiting for the diagram of current architecture and code improvements according to styleguide - please ping me and I'll be happy to make another pass tomorrow. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #1263: Small cleanup of zeppelin-server tests
GitHub user bzz opened a pull request: https://github.com/apache/zeppelin/pull/1263 Small cleanup of zeppelin-server tests ### What is this PR for? Small cleanup of zeppelin-server tests ### What type of PR is it? Refactoring ### How should this be tested? ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No You can merge this pull request into a Git repository by running: $ git pull https://github.com/bzz/incubator-zeppelin cleanup/zeppelin-server-tests Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/1263.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1263 commit 95462d6dedb834b8d8d63865083cf215894f951c Author: Alexander Bezzubov Date: 2016-08-02T11:05:36Z Small cleanup of org.apache.zeppelin.* tests --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1259: [ZEPPELIN-1260] R interpreter doesn't work with Spark ...
Github user Leemoonsoo commented on the issue: https://github.com/apache/zeppelin/pull/1259 Thanks @echarles for the review. I have exposed sqlContext as well --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1262: [ZEPPELIN-1268]
Github user corneadoug commented on the issue: https://github.com/apache/zeppelin/pull/1262 @kavinkumarks Thanks for the contribution, the Paragraph ID is actually already shown in the UI https://github.com/apache/zeppelin/blob/master/zeppelin-web/src/app/notebook/paragraph/paragraph-control.html#L43 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1239: [HOTFIX][ZEPPELIN-1240] Removed interpreter properties...
Github user jongyoul commented on the issue: https://github.com/apache/zeppelin/pull/1239 @Leemoonsoo @minahlee Could you please test it? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #1262: [ZEPPELIN-1268]
GitHub user kavinkumarks opened a pull request: https://github.com/apache/zeppelin/pull/1262 [ZEPPELIN-1268] ### What is this PR for? This pull request is to add the below options so when someone develops a custom UI it would ease them. 1. Add a new option "Get paragraph id" in the notebook UI 2. Add a new REST API to get the status of a single paragraph ### What type of PR is it? Improvement ### Todos * Need to update the REST APIs documentation http://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/rest-api/rest-notebook.html#get-the-status-of-all-paragraphs ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-1268 ### How should this be tested? * Navigate to the notebook UI and a new option "Get paragraph id" will be shown for each paragraph and on clicking on it, the paragraph id would be alerted * The new REST API http://%5Bzeppelin-server%5D:%5Bzeppelin-port%5D/api/notebook/job/%5BnotebookId%5D/%5BparagraphId%5D could be accessed to get the status of a single paragraph. ### Screenshots (if appropriate) ### Questions: You can merge this pull request into a Git repository by running: $ git pull https://github.com/kavinkumarks/zeppelin zeppelin-1268-custom-UI Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/1262.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1262 commit a449992256d8badf72a412ccc0e3134873d5db31 Author: Kavin Date: 2016-08-02T11:07:35Z Changes to show new option to get paragraph id in notebook UI and new REST API to get status of a single paragraph --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1259: [ZEPPELIN-1260] R interpreter doesn't work with Spark ...
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/1259
@minahlee Just saw you comment on ZEPPELIN-1260, but @Leemoonsoo has been
fast...
I have tested the changes, and now sparkr dataframes are working well (with
the `spark` variable which referts to the new Spark2 session).
The R tutorial note refers to sqlContext which is no more present
```
Error in dispatchFunc("createDataFrame(data, schema = NULL, samplingRatio =
1.0)", : object 'sqlContext' not found
```
Patch could also expose sqlContext.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] zeppelin issue #1261: [ZEPPELIN-1264] [HOTFIX] Fix CI test failure with Fail...
Github user Leemoonsoo commented on the issue: https://github.com/apache/zeppelin/pull/1261 @bzz I see the same error on my local test. However somehow travis does not have the error. Anyway, do you mind file a new issue for the new error? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1258: [ ZEPPELIN-1266 ] Code editor Optimization
Github user corneadoug commented on the issue: https://github.com/apache/zeppelin/pull/1258 I would limit this PR to the first commit, for me the rest is out of scope. Also, in the first PR, there is no need to make a if before calling `setParagraphMode`, the conditions you added is already at the beginning of the function. `$scope.setParagraphMode` can also be changed to `var setParagraphMode` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1234: [ZEPPELIN-1234] Fix for bug ZEPPELIN-1234
Github user SachinJanani commented on the issue: https://github.com/apache/zeppelin/pull/1234 Travis checks are failing but are not related to this changes.@jongyoul Can you please have a look. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1261: [ZEPPELIN-1264] [HOTFIX] Fix CI test failure with Fail...
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/1261 Have updated the comment, you might need to reload the page --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1261: [ZEPPELIN-1264] [HOTFIX] Fix CI test failure with Fail...
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/1261 Local build results are - it hangs for last 4 minutes with the error below ``` 20:56:59,101 INFO org.apache.zeppelin.notebook.Paragraph:282 - run paragraph 20160802-205659_1961452200 using null org.apache.zeppelin.interpreter.LazyOpenInterpreter@747b96ad 20:56:59,105 ERROR org.apache.zeppelin.scheduler.Job:189 - Job failed org.apache.zeppelin.interpreter.InterpreterException: java.lang.NullPointerException at org.apache.zeppelin.interpreter.dev.DevInterpreter.interpret(DevInterpreter.java:88) at org.apache.zeppelin.interpreter.ClassloaderInterpreter.interpret(ClassloaderInterpreter.java:58) at org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:94) at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:309) at org.apache.zeppelin.scheduler.Job.run(Job.java:176) at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) Caused by: java.lang.NullPointerException at org.apache.zeppelin.interpreter.dev.DevInterpreter.interpret(DevInterpreter.java:86) ... 12 more ``` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1261: [ZEPPELIN-1264] [HOTFIX] Fix CI test failure with Fail...
Github user Leemoonsoo commented on the issue: https://github.com/apache/zeppelin/pull/1261 Not sure why CI is not triggered in this PR. Here's CI result with my travis account https://travis-ci.org/Leemoonsoo/zeppelin/builds/149153003 CI is not green yet, but at least ZEPPELIN-1264 is resolved. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #932: Replace CXF with Jersey2 [ZEPPELIN-903]
Github user echarles commented on the issue: https://github.com/apache/zeppelin/pull/932 @Leemoonsoo Just pushed the asked changes regarding licenses. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #1261: [ZEPPELIN-1264] [HOTFIX] Fix CI test failure wi...
Github user Leemoonsoo closed the pull request at: https://github.com/apache/zeppelin/pull/1261 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #1261: [ZEPPELIN-1264] [HOTFIX] Fix CI test failure wi...
GitHub user Leemoonsoo reopened a pull request: https://github.com/apache/zeppelin/pull/1261 [ZEPPELIN-1264] [HOTFIX] Fix CI test failure with Failed to create interpreter: org.apache.zeppelin.interpreter.remote.mock.MockInterpreterA ### What is this PR for? Fix CI test failure with error ``` 14:05:27,226 ERROR org.apache.zeppelin.interpreter.remote.RemoteInterpreter:237 - Failed to create interpreter: org.apache.zeppelin.interpreter.remote.mock.MockInterpreterA 14:05:27,227 ERROR org.apache.zeppelin.interpreter.remote.RemoteInterpreter:264 - Failed to initialize interpreter: org.apache.zeppelin.interpreter.remote.mock.MockInterpreterA. Remove it from interpreterGroup 14:05:27,240 INFO org.apache.zeppelin.scheduler.SchedulerFactory:131 - Job jobName1 started by scheduler test 14:05:27,240 INFO org.apache.zeppelin.interpreter.remote.RemoteInterpreter:223 - Create remote interpreter org.apache.zeppelin.interpreter.remote.mock.MockInterpreterA 14:05:27,242 ERROR org.apache.zeppelin.interpreter.remote.RemoteInterpreter:237 - Failed to create interpreter: org.apache.zeppelin.interpreter.remote.mock.MockInterpreterA 14:05:27,243 ERROR org.apache.zeppelin.scheduler.Job:189 - Job failed org.apache.zeppelin.interpreter.InterpreterException: org.apache.thrift.TApplicationException: Internal error processing createInterpreter at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.init(RemoteInterpreter.java:238) at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getFormType(RemoteInterpreter.java:383) at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.interpret(RemoteInterpreter.java:299) at org.apache.zeppelin.scheduler.RemoteSchedulerTest$2.jobRun(RemoteSchedulerTest.java:210) at org.apache.zeppelin.scheduler.Job.run(Job.java:176) at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:329) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.thrift.TApplicationException: Internal error processing createInterpreter at org.apache.thrift.TApplicationException.read(TApplicationException.java:111) at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:71) at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.recv_createInterpreter(RemoteInterpreterService.java:196) at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.createInterpreter(RemoteInterpreterService.java:180) at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.init(RemoteInterpreter.java:227) ... 12 more ``` Some unittest launches remote interpreter process for the test with some mock interpreter implementation. So mock interpreter class in the test should be available for interpreter's classpath for the test. ### What type of PR is it? Hot Fix ### Todos * [x] - Add necessary test-classes directory in interpreter process's classpath ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1264 ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no You can merge this pull request into a Git repository by running: $ git pull https://github.com/Leemoonsoo/zeppelin ZEPPELIN-1264 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/1261.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1261 commit 10ad928c79bc2ade26e6cdee58aa4e35ff4fda61 Author: Lee moon soo Date: 2016-08-02T11:38:45Z Add zeppelin-interpreter/target/test-classes, zeppelin-zengine/target/test-classes in classpath of interpreter --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1261: [ZEPPELIN-1264] [HOTFIX] Fix CI test failure with Fail...
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/1261 CI seems to not beeing triggered on this branch :\ Trying locally with `time mvn package -pl "\!zeppelin-distribution"` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1248: [ZEPPELIN-1069]Ignore implicit interpreter when user e...
Github user astroshim commented on the issue: https://github.com/apache/zeppelin/pull/1248 tested. LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #1261: [ZEPPELIN-1264] [HOTFIX] Fix CI test failure wi...
GitHub user Leemoonsoo opened a pull request: https://github.com/apache/zeppelin/pull/1261 [ZEPPELIN-1264] [HOTFIX] Fix CI test failure with Failed to create interpreter: org.apache.zeppelin.interpreter.remote.mock.MockInterpreterA ### What is this PR for? Fix CI test failure with error ``` 14:05:27,226 ERROR org.apache.zeppelin.interpreter.remote.RemoteInterpreter:237 - Failed to create interpreter: org.apache.zeppelin.interpreter.remote.mock.MockInterpreterA 14:05:27,227 ERROR org.apache.zeppelin.interpreter.remote.RemoteInterpreter:264 - Failed to initialize interpreter: org.apache.zeppelin.interpreter.remote.mock.MockInterpreterA. Remove it from interpreterGroup 14:05:27,240 INFO org.apache.zeppelin.scheduler.SchedulerFactory:131 - Job jobName1 started by scheduler test 14:05:27,240 INFO org.apache.zeppelin.interpreter.remote.RemoteInterpreter:223 - Create remote interpreter org.apache.zeppelin.interpreter.remote.mock.MockInterpreterA 14:05:27,242 ERROR org.apache.zeppelin.interpreter.remote.RemoteInterpreter:237 - Failed to create interpreter: org.apache.zeppelin.interpreter.remote.mock.MockInterpreterA 14:05:27,243 ERROR org.apache.zeppelin.scheduler.Job:189 - Job failed org.apache.zeppelin.interpreter.InterpreterException: org.apache.thrift.TApplicationException: Internal error processing createInterpreter at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.init(RemoteInterpreter.java:238) at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getFormType(RemoteInterpreter.java:383) at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.interpret(RemoteInterpreter.java:299) at org.apache.zeppelin.scheduler.RemoteSchedulerTest$2.jobRun(RemoteSchedulerTest.java:210) at org.apache.zeppelin.scheduler.Job.run(Job.java:176) at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:329) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.thrift.TApplicationException: Internal error processing createInterpreter at org.apache.thrift.TApplicationException.read(TApplicationException.java:111) at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:71) at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.recv_createInterpreter(RemoteInterpreterService.java:196) at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.createInterpreter(RemoteInterpreterService.java:180) at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.init(RemoteInterpreter.java:227) ... 12 more ``` Some unittest launches remote interpreter process for the test with some mock interpreter implementation. So mock interpreter class in the test should be available for interpreter's classpath for the test. ### What type of PR is it? Hot Fix ### Todos * [x] - Add necessary test-classes directory in interpreter process's classpath ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1264 ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no â¦/test-classes in classpath of interpreter You can merge this pull request into a Git repository by running: $ git pull https://github.com/Leemoonsoo/zeppelin ZEPPELIN-1264 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/1261.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1261 commit 10ad928c79bc2ade26e6cdee58aa4e35ff4fda61 Author: Lee moon soo Date: 2016-08-02T11:38:45Z Add zeppelin-interpreter/target/test-classes, zeppelin-zengine/target/test-classes in classpath of interpreter --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1259: [ZEPPELIN-1260] R interpreter doesn't work with Spark ...
Github user Leemoonsoo commented on the issue: https://github.com/apache/zeppelin/pull/1259 @bzz Thanks for quick review. Updated the indent. This should be merged to branch-0.6 as well --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1227: [ZEPPELIN-1198][Spark Standalone] Documents for runnin...
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/1227 Looks great to me! Merging if there is no further discussion. > Does this needs documentation? no I think it does ;) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1255: Adding extra libraries to livy
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/1255 You can use --conf spark.jars= and --conf spark.jars.packages= instead --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1255: Adding extra libraries to livy
Github user mfelgamal commented on the issue: https://github.com/apache/zeppelin/pull/1255 I think that the livy itself doesn't support add (--jars/--packages property in spark-submit) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1231: [Zeppelin - 683][WIP] BittorrentNotebookRepo
Github user onkarshedge commented on the issue: https://github.com/apache/zeppelin/pull/1231 @bzz . I will post a diagram of communication for clear view. `BittorrentNotebookRepo` does not implement/override any `NotebookRepo` methods. It uses all VFSNotebookRepo methods. ```java Note get(String noteId, AuthenticationInfo subject); List list(AuthenticationInfo subject); void save(Note note, AuthenticationInfo subject); ``` Only two key methods are ```java public String shareNote(String noteId); // take the note.json file and start seeding, return magnet link public void download(String magnetLink); // download the files in the torrent directory. ``` ``` Initial idea the we discussed was that BittorrentNotebookRepo encapsulates all the things that are required in order to get notebooks. ``` Could you please elaborate this point. Once the design and goal is clear, it will help me implement faster. Give me some time I will post a diagram.. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1254: [ZEPPELIN-1257] storage - fix get note revision api
Github user khalidhuseynov commented on the issue: https://github.com/apache/zeppelin/pull/1254 @bzz i believe we decided not to merge it for now. I'll revise it and let you know --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1231: [Zeppelin - 683][WIP] BittorrentNotebookRepo
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/1231 @onkarshedge on the architecture side - could you please elaborate on the design that you choose, especially regarding `TorrentServlet` - why do you need a new servlet? What are the parts that communicate to each other? A diagram (event ASCI one) would help here. On the code side - please read the project style guide for Java language carefully and make sure you follow the conventions described there. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1231: [Zeppelin - 683][WIP] BittorrentNotebookRepo
Github user onkarshedge commented on the issue:
https://github.com/apache/zeppelin/pull/1231
@khalidhuseynov thanks for helping.
To actually see `TorrentSocket` in action I have to create
a`WebSocketCreator` and a `Servlet`, then add this to jetty server , [at this
line](https://github.com/apache/zeppelin/blob/6f867ceb0c2b93ecca3be8a16c155547182eb0dc/zeppelin-server/src/main/java/org/apache/zeppelin/server/ZeppelinServer.java#L223)
```java
webApp.addServlet(new ServletHolder("ws-events",new
TorrentServlet()),"/download");
```
So then should it be like this ...
```java
public class BittorrentNotebookRepo extends VFSNotebookRepo implements
TorrentEngineListener,
WebSocketCreator {
@Override
public Object createWebSocket(ServletUpgradeRequest servletUpgradeRequest,
ServletUpgradeResponse servletUpgradeResponse) {
return new TorrentSocket(this);
}
}
```
And the `TorrentServlet` class
```java
public class TorrentServlet extends WebSocketServlet {
@Override
public void configure(WebSocketServletFactory webSocketServletFactory) {
webSocketServletFactory.setCreator(new BittorrentNotebookRepo());
}
}
```
Here is the problem as I cannot instantiate the BittorrentNotebookRepo here
, it requires `conf` parameter. Also the NotebookRepos' are instantiated in
`NotebookRepoSync`.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] zeppelin issue #1254: [ZEPPELIN-1257] storage - fix get note revision api
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/1254 @khalidhuseynov thank you! Do you suggest merging this guy now and taking care of Revision separation later? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (ZEPPELIN-1268) As an enduser, I would like to embed paragraph and refresh the content of it in my custom UI
Kavin Kumar created ZEPPELIN-1268: - Summary: As an enduser, I would like to embed paragraph and refresh the content of it in my custom UI Key: ZEPPELIN-1268 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1268 Project: Zeppelin Issue Type: Improvement Components: front-end, zeppelin-server, zeppelin-zengine Reporter: Kavin Kumar Being an end user of Apache Zeppelin, I would like to add the following enhancements to the codebase so that I can embed paragraph and also refresh the paragraph content from the custom UI.Note that the custom UI is different from the notebook UI and served by a simple js application.Embedding the paragraph content and refreshing the content of it in the custom UI are done using the Zeppelin REST APIs. When we analyzed the existing APIs and the notebook UI, we thought that the following would be helpful when someone wants to do the same as mentioned above: * Expose paragraph id as a new option for each paragraph in the notebook UI say "Get the paragraph id" so that the end user can easily find it out * Create a new REST API to find out the status of a single paragraph -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] zeppelin issue #1260: ZEPPELIN-1267. PySparkInterpreter doesn't work in spar...
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/1260 \cc @jongyoul for review --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1248: [ZEPPELIN-1069]Ignore implicit interpreter when user e...
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/1248 ð for having a test! Looks good to me, modulo the issue raised above. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1258: [ ZEPPELIN-1266 ] Code editor Optimization
Github user cloverhearts commented on the issue: https://github.com/apache/zeppelin/pull/1258 @bzz Thank you for your feedback. i will check to your opinion. Thank you --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #1260: ZEPPELIN-1267. PySparkInterpreter doesn't work ...
GitHub user zjffdu opened a pull request: https://github.com/apache/zeppelin/pull/1260 ZEPPELIN-1267. PySparkInterpreter doesn't work in spark 2.0 ### What is this PR for? PySparkInterpreter doesn't work in spark 2.0 because pyspark and py4j is not distributed to executors. This PR extract the setup staff for pyspark interpreter into method setupConfForPySpark and use it for both spark1 and spark2. But this is just a short term solution, as I think this should be handled by spark rather than zeppelin, here zeppelin duplicate part of spark's work. In the long term, I'd like to resolve it in `ZEPPELIN-1263`. ### What type of PR is it? [Bug Fix] ### Todos * https://issues.apache.org/jira/browse/ZEPPELIN-1263 ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-1267 ### How should this be tested? Verify it manually. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No You can merge this pull request into a Git repository by running: $ git pull https://github.com/zjffdu/zeppelin ZEPPELIN-1267 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/1260.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1260 commit 81d1d56c94934dd6c4b32144d810626356ce3c0e Author: Jeff Zhang Date: 2016-08-02T09:41:21Z ZEPPELIN-1267. PySparkInterpreter doesn't work in spark 2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1259: [ZEPPELIN-1260] R interpreter doesn't work with Spark ...
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/1259 Looks great to me, modulo question above. Thank you for prompt fix @Leemoonsoo ! Shall this be merged to master or branch-0.6 as well? Asking as JIRA fix version is not set for this one. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1258: [ ZEPPELIN-1266 ] Code editor Optimization
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/1258 Would it make sense to change `isParagraphSaveAlready` => `wasParagraphAlreadySaved` ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #1259: [ZEPPELIN-1260] R interpreter doesn't work with...
GitHub user Leemoonsoo opened a pull request:
https://github.com/apache/zeppelin/pull/1259
[ZEPPELIN-1260] R interpreter doesn't work with Spark 2.0
### What is this PR for?
This PR fixes R interpreter doesn't work with Spark 2.0
### What type of PR is it?
Bug Fix
### Todos
* [x] - Create and inject SparkSession into SparkRInterpreter
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1260
### How should this be tested?
Run Zeppelin with Spark 2.0 and run following codes and see if it returns
`[1] 3`
```
%r
localDF <- data.frame(name=c("a", "b", "c"), age=c(19, 23, 18))
df <- createDataFrame(spark, localDF)
count(df)
```
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/Leemoonsoo/zeppelin ZEPPELIN-1260
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/zeppelin/pull/1259.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1259
commit 6bd112811d81aa871b077c655fa0980802e3bc71
Author: Lee moon soo
Date: 2016-08-02T09:30:23Z
Create and inject spark session into sparkr interpreter
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] zeppelin issue #1258: [ ZEPPELIN-1266 ] Code editor Optimization
Github user cloverhearts commented on the issue: https://github.com/apache/zeppelin/pull/1258 please, remove to browser cache --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (ZEPPELIN-1267) PySparkInterpreter doesn't work in spark 2.0
Jeff Zhang created ZEPPELIN-1267:
Summary: PySparkInterpreter doesn't work in spark 2.0
Key: ZEPPELIN-1267
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1267
Project: Zeppelin
Issue Type: Bug
Components: Interpreters
Affects Versions: 0.7.0
Reporter: Jeff Zhang
Assignee: Jeff Zhang
py4j is not distributed to executors.
{noformat}
Error from python worker:
/usr/bin/python: No module named pyspark
PYTHONPATH was:
/Users/jzhang/Temp/hadoop_tmp/nm-local-dir/usercache/jzhang/filecache/27/__spark_libs__3944184934921201174.zip/spark-core_2.11-2.0.0.jar
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[GitHub] zeppelin pull request #1258: [ ZEPPELIN-1266 ] Code editor Optimization
Github user cloverhearts closed the pull request at: https://github.com/apache/zeppelin/pull/1258 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1258: [ ZEPPELIN-1266 ] Code editor Optimization
Github user cloverhearts commented on the issue: https://github.com/apache/zeppelin/pull/1258 ci trigger. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #1258: [ ZEPPELIN-1266 ] Code editor Optimization
GitHub user cloverhearts reopened a pull request: https://github.com/apache/zeppelin/pull/1258 [ ZEPPELIN-1266 ] Code editor Optimization ### What is this PR for? If the result of many para- graph, the code editor is very slow. ### What type of PR is it? Improvement ### Todos - [x] removed call to function in template. - [x] changed event (aceChange event to ace input event) ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1266 ### How should this be tested? 1. going to r tutorial notebook. 2. write to paragraph on anyway. (many many.. fast.. fast typing.) ### Screenshots (if appropriate) Before optimization.  After optimization.  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no You can merge this pull request into a Git repository by running: $ git pull https://github.com/cloverhearts/zeppelin dev/aceeditorperformance Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/1258.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1258 commit 86ba5c42a6eb9ea9ba22d90c11dbb823e5b81ce2 Author: CloverHearts Date: 2016-08-02T07:19:30Z ace editor performance up commit 979e2f3a05bdeba14f297d0bcb4e85d1e593424a Author: CloverHearts Date: 2016-08-02T08:20:28Z ace editor performance up - remove call to template function commit af5e18f275ebe0850649e7956c1be3673214aaf0 Author: CloverHearts Date: 2016-08-02T08:38:09Z ace editor optimize - get isChange paragraph text value in template --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #1258: [ ZEPPELIN-1266 ] Code editor Optimization
GitHub user cloverhearts opened a pull request: https://github.com/apache/zeppelin/pull/1258 [ ZEPPELIN-1266 ] Code editor Optimization ### What is this PR for? If the result of many para- graph, the code editor is very slow. ### What type of PR is it? Improvement ### Todos - [x] removed call to function in template. - [x] changed event (aceChange event to ace input event) ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1266 ### How should this be tested? 1. going to r tutorial notebook. 2. write to paragraph on anyway. (many many.. fast.. fast typing.) ### Screenshots (if appropriate) Before optimization.  After optimization.  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no You can merge this pull request into a Git repository by running: $ git pull https://github.com/cloverhearts/zeppelin dev/aceeditorperformance Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/1258.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1258 commit 86ba5c42a6eb9ea9ba22d90c11dbb823e5b81ce2 Author: CloverHearts Date: 2016-08-02T07:19:30Z ace editor performance up commit 979e2f3a05bdeba14f297d0bcb4e85d1e593424a Author: CloverHearts Date: 2016-08-02T08:20:28Z ace editor performance up - remove call to template function commit af5e18f275ebe0850649e7956c1be3673214aaf0 Author: CloverHearts Date: 2016-08-02T08:38:09Z ace editor optimize - get isChange paragraph text value in template --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (ZEPPELIN-1266) If the result of many paragraph, the code editor is very slow
CloverHearts created ZEPPELIN-1266: -- Summary: If the result of many paragraph, the code editor is very slow Key: ZEPPELIN-1266 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1266 Project: Zeppelin Issue Type: Bug Reporter: CloverHearts Assignee: CloverHearts If the result of many paragraph, the code editor is very slow. for example, writing to r tutorial notebook -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] zeppelin issue #1210: [ZEPPELIN-1220] Add geographical map as visualization ...
Github user corneadoug commented on the issue: https://github.com/apache/zeppelin/pull/1210 @mwpenny Alright, so after taking a look, here are my feedbacks: Overall PR * License of angular-esri-map will need to be added in [this file](https://github.com/apache/zeppelin/blob/master/zeppelin-distribution/src/bin_license/LICENSE) (That folder also contains single files if license needs to be copied) * There is 2 files to commit: `index.html` and `karma.conf.js` which have changes after we build. * I think it could be nice to have a page in the documentation, but let's make that in a different PR. The Map * The mouse scroll to zoom in the map should be deactivated, if you scroll down the notebook you might zoom out and then the map vanishes. * Could we have the map unzoomed to show the world when loaded (Its fine to keep it centered on Canada ;) ) * The Map height do not scale when we make the paragraph bigger * The Map is going out of the paragraph instead of being contained or fitting the size: https://cloud.githubusercontent.com/assets/710411/17321366/31e0d1a8-58d3-11e6-8a17-e383f8912b3b.png";> * When I click on a Pin it moves me somewhere else  Options & Pivot * Let's remove the `height:36px` style for the pivot area, I know it was copy pasted from other place in the code, but its better to have all of them with the same height. * The BaseMap option isn't removed when we switch graphs, seems to be a mistake [here](https://github.com/mwpenny/zeppelin-esri/blob/esri/zeppelin-web/src/app/notebook/paragraph/paragraph-graphOptions.html#L31) with ng-if inside a class I will spend more time on checking the code, and would leave inline comments if there is --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
