[GitHub] zeppelin pull request #1032: ZEPPELIN-1027: Python - add basic matplotlib ex...
GitHub user bzz opened a pull request: https://github.com/apache/zeppelin/pull/1032 ZEPPELIN-1027: Python - add basic matplotlib example notebook ### What is this PR for? It adds basic matplotlib example notebook. ### What type of PR is it? Improvement | Documentation | Hot Fix ### What is the Jira issue? [ZEPPELIN-1027](https://issues.apache.org/jira/browse/ZEPPELIN-1027) ### How should this be tested? New [zeppelin notebook]() shows up in the list. ### Screenshots (if appropriate) ![screen shot 2016-06-17 at 14 49 31](https://cloud.githubusercontent.com/assets/5582506/16141850/bc0c70b0-349a-11e6-81d1-98d8b1d2af4c.png) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No You can merge this pull request into a Git repository by running: $ git pull https://github.com/bzz/incubator-zeppelin python/add-example-notebook Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/1032.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1032 commit 192f57b6c0fd278780d274030f5bbe96ee8d77bb Author: Alexander BezzubovDate: 2016-06-17T05:45:43Z Python: add basic matplotlib example notebook --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (ZEPPELIN-1027) add python tutorial notebook
Alexander Bezzubov created ZEPPELIN-1027: Summary: add python tutorial notebook Key: ZEPPELIN-1027 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1027 Project: Zeppelin Issue Type: Improvement Reporter: Alexander Bezzubov Assignee: Alexander Bezzubov We have Apache Spark and R tutorials, this task is about building one for Python users -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1026) Pick editor's syntax highlight based on default binded interpreter
Alexander Bezzubov created ZEPPELIN-1026: Summary: Pick editor's syntax highlight based on default binded interpreter Key: ZEPPELIN-1026 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1026 Project: Zeppelin Issue Type: Improvement Reporter: Alexander Bezzubov Depending on what interpreter is binded for the notebook first, syntax of the paragraph editors should be highlighted differently. I.e one might choose %python to be default so we should highlight it as python. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: [GSoC-2016][Zeppelin Notebooks] Second Notebook Review
Thanks for the appreciation, mentors, I'm encouraged to work on more notebooks and have already started work on the third one. As for the viewer link, all the results(graphs) display completely well on my Zeppelin instance but a lot of the graphs don't display at all on the viewer - this includes all: the default visualizations of Zeppelin, the custom visualizations using html display and the Helium application output. Anish. On Fri, Jun 17, 2016 at 9:05 AM, Alexander Bezzubovwrote: > Thank you for sharing, the data about Africa looks really interesting! > > Code-wise, I just wish the data import could be done in less "manual" > fascion somehow (less `sed`) but that's minor. > > One thing I noticed, and not sure if that is expected result or not, over > the last link you shared, in Viewer some graphs are not showing > > > > Does this look the same inside your Zeppelin instance? > > -- > Alex > > On Fri, Jun 17, 2016 at 12:28 AM, moon soo Lee wrote: > >> Hi Anish, >> >> Thanks for sharing. >> It looks really good to me and i think it shows how Zeppelin can be used >> really well. >> >> Appreciate for your hard work! >> >> Thanks, >> moon >> >> On Wed, Jun 15, 2016 at 9:00 AM anish singh wrote: >> >> > Hello, >> > >> > Second notebook is up for review at [0]. Custom visualizations for the >> > notebook were created using html display and Helium Application. I'm >> Sorry >> > for delay in creating the notebook as filtering and cleaning the >> datasets >> > for this notebook took a lot of time. >> > >> > Documentation for the notebook is ready at [2]. >> > >> > Zeppelin Hub viewer link for the notebook is [3]. A lot of the >> > visualizations don't display completely on the viewer and so a sample >> demo >> > run of the Helium application on my machine is shared at [1]. >> > >> > Meanwhile, I'll do more of flink and start work on the third notebook on >> > European Union transportation and communication datasets. >> > >> > [0]. >> > https://github.com/anish18sun/Zeppelin-Notebooks/tree/master/2BP12534C >> > [1]. https://drive.google.com/open?id=0ByXTtaL2yHBuejVUQ0k3ek1IdGc >> > [2]. http://zeppelinnotes.blogspot.in/ >> > [3]. >> > >> > >> https://www.zeppelinhub.com/viewer/notebooks/aHR0cHM6Ly9yYXcuZ2l0aHVidXNlcmNvbnRlbnQuY29tL2FuaXNoMThzdW4vWmVwcGVsaW4tTm90ZWJvb2tzL21hc3Rlci8yQlAxMjUzNEMvbm90ZS5qc29u >> > >> > Thanks, >> > Anish. >> > >> > >
[GitHub] zeppelin pull request #1031: [ZEPPELIN-1018] Apply auto "Table of Contents" ...
GitHub user AhyoungRyu opened a pull request: https://github.com/apache/zeppelin/pull/1031 [ZEPPELIN-1018] Apply auto "Table of Contents" generator to Zeppelin docs website ### What is this PR for? I added auto TOC(Table of Contents) generator for Zeppelin documentation website. TOC can help people looking through whole contents at a glance and finding what they want quickly. I just added `` to the each documentation header. [`toc`](https://github.com/apache/zeppelin/compare/master...AhyoungRyu:ZEPPELIN-1018?expand=1#diff-85af09fb498a5667ea455391533f945dR3) recognize `` & `` as a title in the docs and it automatically generate TOC. So I set a rule for this work. (I'll write this rule on `docs/CONTRIBUTING.md` or [docs/howtocontributewebsite](https://zeppelin.apache.org/docs/0.6.0-SNAPSHOT/development/howtocontributewebsite.html)). ``` # Level-1 Heading <- Use only for the main title of the page ## Level-2 Heading <- Start with this one ### Level-3 heading <- Only use this one for child of Level-2 toc only recognize Level-2 & Level-3 ``` Please see the below attached screenshot image. ### What type of PR is it? Improvement & Documentation ### Todos * [x] - Add TOC generator * [x] - Apply TOC(``) to every documentation and reorganize each headers(apply the above rule) * [x] - Fix some broken code block in several docs * [ ] - Apply TOC to `r.md` (Currently R docs has some duplicated info since [this one](https://github.com/apache/zeppelin/commit/d5e87fb8ba98f08db5b0a4995104ce19f182c678) and [this one](https://github.com/apache/zeppelin/commit/7d6cc7e99154e2d337c11fdf8be1a874ed3e9ada) ) * [ ] - Apply TOC to `install.md` after #1010 merged ### What is the Jira issue? [ZEPPELIN-1018](https://issues.apache.org/jira/browse/ZEPPELIN-1018) ### How should this be tested? 1. Apply this patch and build `docs/` with [this guide](https://github.com/apache/zeppelin/tree/master/docs#build-documentation) 2. Visit some docs page. Then you can see TOC in the header of page. ### Screenshots (if appropriate) - Automatically generated TOC in Spark interpreter docs page https://cloud.githubusercontent.com/assets/10060731/16140902/945b9c7a-340a-11e6-91f3-b6174738bed0.png;> ### Questions: * Does the licenses files need update? No. Actually I used [jekyll-table-of-contents#copyright](https://github.com/ghiculescu/jekyll-table-of-contents#copyright). But I don't need to add a license for this :) * Is there breaking changes for older versions? No * Does this needs documentation? Maybe You can merge this pull request into a Git repository by running: $ git pull https://github.com/AhyoungRyu/incubator-zeppelin ZEPPELIN-1018 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/1031.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1031 commit 162193a8a57475480898ee84290e83d36462febe Author: AhyoungRyuDate: 2016-06-17T01:10:06Z Add toc.js for auto generating TOC commit ba57b519c3f12bc61ecbb80b0d0c06158c08c485 Author: AhyoungRyu Date: 2016-06-17T02:40:17Z Change toc configuration commit 711ab09f8dd6c056dedf3fb4c8bd43633fa3e8d2 Author: AhyoungRyu Date: 2016-06-17T02:41:49Z Apply auto TOC to all of docs under docs/security/ commit c9848c47ba5963db2b1946260f251fe3288675fe Author: AhyoungRyu Date: 2016-06-17T02:42:17Z Apply auto TOC to all of docs under docs/interpreter/ commit 796530e350b76a5ed36a4a6e516cd2eee0248bcc Author: AhyoungRyu Date: 2016-06-17T02:42:32Z Apply auto TOC to all of docs under docs/development/ commit 002ec825e7f7edb5f88372e298501c2bffcbdbf6 Author: AhyoungRyu Date: 2016-06-17T02:42:46Z Apply auto TOC to all of docs under docs/manual/ commit a79fef6ec27ffdf5abf623cc1580301b5fed3d02 Author: AhyoungRyu Date: 2016-06-17T02:42:59Z Apply auto TOC to all of docs under docs/rest-api/ commit 41fbdeb1418a4db91b9362586e002608e135844b Author: AhyoungRyu Date: 2016-06-17T02:43:15Z Apply auto TOC to all of docs under docs/displaysystem/ commit 3f9fd674c1b1b86a04c4d4b03f636a2af1acf651 Author: AhyoungRyu Date: 2016-06-17T02:43:28Z Apply auto TOC to all of docs under docs/install/ commit f62fb1b77fd32b3e850c1aee166f4cfcebba094e Author: AhyoungRyu Date: 2016-06-17T02:43:40Z Apply auto TOC to all of docs under docs/quickstart/ commit 17ff694d93e4871e69dd667f293b1bf6b38c5e2f Author: AhyoungRyu Date:
[GitHub] zeppelin pull request #1029: [ZEPPELIN-698] #756 Added new shortcuts but did...
Github user asfgit closed the pull request at: https://github.com/apache/zeppelin/pull/1029 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #928: [ZEPPELIN-116][WIP] Add Mahout Support for Spark Interp...
Github user rawkintrevo commented on the issue: https://github.com/apache/zeppelin/pull/928 @bzz not quite done. A little more testing and I realized, jars aren't being properly loaded when Spark is in cluster mode. Think you could take a peek and try to give me a hint why that might be? Either way, I hope to to have it all worked out by EOD tomorrow. Will rebase when I get cluster working then should be gtg! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1028: [Zeppelin-1022] Apply new mechanism to LivyInterpreter
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/1028 @prabhjyotsingh if we could point what is the reason of failure and link to either PR or existing JIRA issue that handles it - that could help improve our infrastructure a lot Looks good to me \cc @jongyoul as an author of new interpreter registration system for a reivew --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1024: Add force layout visualization in paragraphs for SQL q...
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/1024 Now this PR contains some commits that do not belong here, and it either needs to be re-created from a separate branch as @corneadoug points out, or interactively rebased with keeping only good commits here --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #928: [ZEPPELIN-116][WIP] Add Mahout Support for Spark Interp...
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/928 Great work, @rawkintrevo ! It looks like a rebase on the latest master is needed now --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
Re: [GSoC-2016][Zeppelin Notebooks] Second Notebook Review
Thank you for sharing, the data about Africa looks really interesting! Code-wise, I just wish the data import could be done in less "manual" fascion somehow (less `sed`) but that's minor. One thing I noticed, and not sure if that is expected result or not, over the last link you shared, in Viewer some graphs are not showing Does this look the same inside your Zeppelin instance? -- Alex On Fri, Jun 17, 2016 at 12:28 AM, moon soo Leewrote: > Hi Anish, > > Thanks for sharing. > It looks really good to me and i think it shows how Zeppelin can be used > really well. > > Appreciate for your hard work! > > Thanks, > moon > > On Wed, Jun 15, 2016 at 9:00 AM anish singh wrote: > > > Hello, > > > > Second notebook is up for review at [0]. Custom visualizations for the > > notebook were created using html display and Helium Application. I'm > Sorry > > for delay in creating the notebook as filtering and cleaning the datasets > > for this notebook took a lot of time. > > > > Documentation for the notebook is ready at [2]. > > > > Zeppelin Hub viewer link for the notebook is [3]. A lot of the > > visualizations don't display completely on the viewer and so a sample > demo > > run of the Helium application on my machine is shared at [1]. > > > > Meanwhile, I'll do more of flink and start work on the third notebook on > > European Union transportation and communication datasets. > > > > [0]. > > https://github.com/anish18sun/Zeppelin-Notebooks/tree/master/2BP12534C > > [1]. https://drive.google.com/open?id=0ByXTtaL2yHBuejVUQ0k3ek1IdGc > > [2]. http://zeppelinnotes.blogspot.in/ > > [3]. > > > > > https://www.zeppelinhub.com/viewer/notebooks/aHR0cHM6Ly9yYXcuZ2l0aHVidXNlcmNvbnRlbnQuY29tL2FuaXNoMThzdW4vWmVwcGVsaW4tTm90ZWJvb2tzL21hc3Rlci8yQlAxMjUzNEMvbm90ZS5qc29u > > > > Thanks, > > Anish. > > >
[GitHub] zeppelin issue #1015: [ZEPPPELIN-1009] Trying to Fix selenium modal error
Github user corneadoug commented on the issue: https://github.com/apache/zeppelin/pull/1015 @bzz where did you get the screenshot from? The modal is supposed to show, I modified the test in this PR to have a check on that, and current scenario looks like this: * Find the paragraph icon-setting and click on it * Find the remove paragraph button and click on it * Does Modal Exist? -> True * Find the Modal Ok button and Click on It -> failed --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #928: [ZEPPELIN-116][WIP] Add Mahout Support for Spark Interp...
Github user rawkintrevo commented on the issue: https://github.com/apache/zeppelin/pull/928 Per this: http://stackoverflow.com/questions/32498891/spark-read-and-write-to-parquet-leads-to-outofmemoryerror-java-heap-space and this: http://spark.apache.org/docs/latest/configuration.html#compression-and-serialization I set the buffer to 64k and the buffer.max to 1g, and that seems to have solved it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #986: [Zeppelin 946] Permissions not honoring group
Github user prabhjyotsingh commented on the issue: https://github.com/apache/zeppelin/pull/986 I think we should as this is to do with AD auth. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #986: [Zeppelin 946] Permissions not honoring group
Github user Leemoonsoo commented on the issue: https://github.com/apache/zeppelin/pull/986 @prabhjyotsingh is it going to be merged to 0.6-branch, too? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #986: [Zeppelin 946] Permissions not honoring group
Github user prabhjyotsingh commented on the issue: https://github.com/apache/zeppelin/pull/986 Merging this if no more discussion. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #1026: [ZEPPELIN-1021] delete reduplicate dependency a...
Github user shijinkui closed the pull request at: https://github.com/apache/zeppelin/pull/1026 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #1026: [ZEPPELIN-1021] delete reduplicate dependency a...
GitHub user shijinkui reopened a pull request: https://github.com/apache/zeppelin/pull/1026 [ZEPPELIN-1021] delete reduplicate dependency and add scala version properties ### What is this PR for? 1. reduplicate dependency 2. scala version properties ### What type of PR is it? Improvement ### Todos ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1021 ### How should this be tested? ### Screenshots (if appropriate) ### Questions: You can merge this pull request into a Git repository by running: $ git pull https://github.com/shijinkui/incubator-zeppelin reduplicate_deps Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/1026.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1026 commit 362b23d9c9bdb7aafc7b134860fe11b1123bccfa Author: shijinkuiDate: 2016-06-16T11:00:12Z 1. reduplicate dependency 2. scala version properties --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1023: [gh-pages][ZEPPELIN-996] Update first page of Zeppelin...
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/1023 Looks great to me, thank you @AhyoungRyu @felixcheung ! Let's merge if there is no further discussion --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1010: [ZEPPELIN-998][WIP] Extend install.md -> Quick Start
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/1010 Looks great to me, thank you @AhyoungRyu Will merge to master, if there is no further discussion --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #1007: Update and refactor NotebookRepo versioning API
Github user asfgit closed the pull request at: https://github.com/apache/zeppelin/pull/1007 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1018: Blocking the zeppelin-web build error.
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/1018 Sounds great, thank you for explanation --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #747: [ZEPPELIN-605][WIP] Add support for Scala 2.11
Github user lresende commented on the issue: https://github.com/apache/zeppelin/pull/747 Ok, things are looking better now, the branch is rebased and I have started more testing based on Zeppelin and Spark 1.6.1 both compiled with Scala 2.11. I can run parts of the Zeppelin tutorial notebook, but the sql queries are hanging on the zeppelin side and I am investigating it now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1016: Bump up version to 0.7.0-SNAPSHOT
Github user felixcheung commented on the issue: https://github.com/apache/zeppelin/pull/1016 ok, thanks for clarification. It's a bit different from our release process (ie. 0.5.5, 0.5.6) before, but I like this better. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #928: [ZEPPELIN-116][WIP] Add Mahout Support for Spark Interp...
Github user rawkintrevo commented on the issue: https://github.com/apache/zeppelin/pull/928 As I am playing with this, things seem to stop/start working at random... The Thrift Server error in the Zepplin context, with Java Heap Space errors related to the kryo serializer in the logs. Some sort of mis-configuration errors (?) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #928: [ZEPPELIN-116][WIP] Add Mahout Support for Spark Interp...
Github user rawkintrevo commented on the issue: https://github.com/apache/zeppelin/pull/928 UPDATE: Sorry for the quick one-two punch. But the above error only occurs in Spark cluster mode, not in Spark local mode. Leading me to believe jars aren't getting loaded up. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #928: [ZEPPELIN-116][WIP] Add Mahout Support for Spark Interp...
Github user rawkintrevo commented on the issue: https://github.com/apache/zeppelin/pull/928 Consider the code ```scala %mahout val mxRnd = Matrices.symmetricUniformView(5000, 2, 1234) val drmRand = drmParallelize(mxRnd) val drmSin = drmRand.mapBlock() {case (keys, block) => val blockB = block.like() for (i <- 0 until block.nrow) { blockB(i, 0) = block(i, 0) blockB(i, 1) = Math.sin((block(i, 0) * 8)) } keys -> blockB } val drmRand = drmParallelize(mxRnd) drmSampleToTSV(drmRand, 0.5) ``` Works fine, I can take the resulting string and do things with it. However when I run ```scala drmRand.collect(::, 1) ``` The error depends if I am using the Zeppelin Dependency Resolver (e.g. downloading jars from Maven) or pointing to `MAHOUT_HOME`. If using the dependency resolver, the error is: org.apache.thrift.transport.TTransportException at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132) at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86) at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429) ... ^^ This is a standard error message when Zepplin-Spark and the Spark on the Cluster are version mismatched, however this was curious as I was running Spark in local mode. I added provided to the zeppelin-spark dependency in the mahout pom.xml, now both local and MAHOUT_HOME give the same error message which is as follows. This lead me to believe (and I still do) the problem lies in version mismatching?: org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 0.0 failed 4 times, most recent failure: Lost task 0.3 in stage 0.0 (TID 3, 192.168.86.152): java.lang.IllegalStateException: unread block data at java.io.ObjectInputStream$BlockDataInputStream.setBlockDataMode(ObjectInputStream.java:2431) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1383) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2000) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1924) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:76) at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:115) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:207) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Driver stacktrace: at org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$failJobAndIndependentStages(DAGScheduler.scala:1431) at org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1419) at org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1418) at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59) at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47) at org.apache.spark.scheduler.DAGScheduler.abortStage(DAGScheduler.scala:1418) at org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:799) at org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:799) at scala.Option.foreach(Option.scala:236) at org.apache.spark.scheduler.DAGScheduler.handleTaskSetFailed(DAGScheduler.scala:799) at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.doOnReceive(DAGScheduler.scala:1640) at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1599) at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1588) at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48) at org.apache.spark.scheduler.DAGScheduler.runJob(DAGScheduler.scala:620) at org.apache.spark.SparkContext.runJob(SparkContext.scala:1832) at org.apache.spark.SparkContext.runJob(SparkContext.scala:1845) at org.apache.spark.SparkContext.runJob(SparkContext.scala:1858) at org.apache.spark.SparkContext.runJob(SparkContext.scala:1929) at org.apache.spark.rdd.RDD$$anonfun$collect$1.apply(RDD.scala:927) at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:150) at
[GitHub] zeppelin issue #928: [ZEPPELIN-116][WIP] Add Mahout Support for Spark Interp...
Github user dlyubimov commented on the issue: https://github.com/apache/zeppelin/pull/928 what's the message? `DRMLike.collect()`, eventually, is a translation to `RDD.collect()` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #928: [ZEPPELIN-116][WIP] Add Mahout Support for Spark Interp...
Github user rawkintrevo commented on the issue: https://github.com/apache/zeppelin/pull/928 This appears to be working, but there is a bug when doing OLS regarding the thift server. It is the same error message one normally gets when trying to use incompatible versoin of spark. Is triggered by ".collect" method on drm. But works fine for other operations. Very confusing. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (ZEPPELIN-1024) Zeppelin Git commit fails if notebook folder is a git submodule
John J. Howard created ZEPPELIN-1024: Summary: Zeppelin Git commit fails if notebook folder is a git submodule Key: ZEPPELIN-1024 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1024 Project: Zeppelin Issue Type: Bug Components: zeppelin-interpreter Affects Versions: 0.6.0 Environment: Ubuntu 14.04, Java 1.8 Git 1.9.1 Reporter: John J. Howard Steps to reproduce: 1. git pull zeppelin 2. git submodule add g...@github.com:user/my_notebook.git 3. Modify zeppelin-notebook-dir property in zeppelin-site.xml to point to my_notebook folder 4. Uncomment GitNotebookRepo value for zeppelin.notebook.storage property in zeppelin-site.xml 5. Attempt to do a git commit from zeppelin GUI The following stacktrace is logged. I believe this has something to do with the fact that .git items in submodules are text files (not folders as they are in normal git repos) that point back to the parent repo's .git folder. ERROR [2016-06-16 17:21:04,226] ({qtp1856056345-17} NotebookServer.java[onMessage]:210) - Can't handle message org.eclipse.jgit.api.errors.JGitInternalException: Exception caught during execution of add command at org.eclipse.jgit.api.AddCommand.call(AddCommand.java:211) at org.apache.zeppelin.notebook.repo.GitNotebookRepo.checkpoint(GitNotebookRepo.java:84) at org.apache.zeppelin.notebook.repo.NotebookRepoSync.checkpoint(NotebookRepoSync.java:363) at org.apache.zeppelin.notebook.Notebook.checkpointNote(Notebook.java:321) at org.apache.zeppelin.socket.NotebookServer.checkpointNotebook(NotebookServer.java:1047) at org.apache.zeppelin.socket.NotebookServer.onMessage(NotebookServer.java:204) at org.apache.zeppelin.socket.NotebookSocket.onWebSocketText(NotebookSocket.java:56) at org.eclipse.jetty.websocket.common.events.JettyListenerEventDriver.onTextMessage(JettyListenerEventDriver.java:128) at org.eclipse.jetty.websocket.common.message.SimpleTextMessage.messageComplete(SimpleTextMessage.java:69) at org.eclipse.jetty.websocket.common.events.AbstractEventDriver.appendMessage(AbstractEventDriver.java:65) at org.eclipse.jetty.websocket.common.events.JettyListenerEventDriver.onTextFrame(JettyListenerEventDriver.java:122) at org.eclipse.jetty.websocket.common.events.AbstractEventDriver.incomingFrame(AbstractEventDriver.java:161) at org.eclipse.jetty.websocket.common.WebSocketSession.incomingFrame(WebSocketSession.java:309) at org.eclipse.jetty.websocket.common.extensions.ExtensionStack.incomingFrame(ExtensionStack.java:214) at org.eclipse.jetty.websocket.common.Parser.notifyFrame(Parser.java:220) at org.eclipse.jetty.websocket.common.Parser.parse(Parser.java:258) at org.eclipse.jetty.websocket.common.io.AbstractWebSocketConnection.readParse(AbstractWebSocketConnection.java:632) at org.eclipse.jetty.websocket.common.io.AbstractWebSocketConnection.onFillable(AbstractWebSocketConnection.java:480) at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:745) Caused by: java.io.IOException: Creating directories for /usr/local/zeppelin/zeppelin-0.6.0-incubating-SNAPSHOT/notebook_idslab/.git failed at org.eclipse.jgit.util.FileUtils.mkdirs(FileUtils.java:370) at org.eclipse.jgit.internal.storage.file.LockFile.lock(LockFile.java:158) at org.eclipse.jgit.dircache.DirCache.lock(DirCache.java:583) at org.eclipse.jgit.dircache.DirCache.lock(DirCache.java:223) at org.eclipse.jgit.dircache.DirCache.lock(DirCache.java:301) at org.eclipse.jgit.dircache.DirCache.lock(DirCache.java:267) at org.eclipse.jgit.lib.Repository.lockDirCache(Repository.java:1053) at org.eclipse.jgit.api.AddCommand.call(AddCommand.java:142) ... 21 more -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] zeppelin issue #1016: Bump up version to 0.7.0-SNAPSHOT
Github user minahlee commented on the issue: https://github.com/apache/zeppelin/pull/1016 @Leemoonsoo Thanks for the explanation! @felixcheung as @Leemoonsoo said, branch-0.6 will be bumped up to 0.6.1-SNAPSHOT once I create v0.6.0-rc1 tag. We have documented this versioning policy in [wiki](https://cwiki.apache.org/confluence/display/ZEPPELIN/Preparing+Zeppelin+Release#PreparingZeppelinRelease-Createreleasebranch) few months ago. Bug fixes will keep being merged both in master and branch-0.6 and I hope we deliver those maintenance release in one or two month so many users can take advantage of it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #994: [ZEPPELIN-986] Create publish release script
Github user minahlee commented on the issue: https://github.com/apache/zeppelin/pull/994 @bzz Sorry for late response, I am working on it and going to push commits by today. Thanks for heads up :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1013: [ZEPPELIN-1002] Move configuration menus under dropdow...
Github user minahlee commented on the issue: https://github.com/apache/zeppelin/pull/1013 Thanks for the feedback guys! I've just pushed some commits and updated description with new screenshot. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #747: [ZEPPELIN-605][WIP] Add support for Scala 2.11
Github user lresende commented on the issue: https://github.com/apache/zeppelin/pull/747 @prasadwagle Looks like a merge conflict, waiting for local build before pushing a fix for this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1029: [ZEPPELIN-698] #756 Added new shortcuts but didn't rem...
Github user Leemoonsoo commented on the issue: https://github.com/apache/zeppelin/pull/1029 Thanks @prabhjyotsingh for the review. CI failure is irrelevant. Merge if there're no more discussions. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1030: [ZEPPELIN-1023] Add more credential apis.
Github user cloverhearts commented on the issue: https://github.com/apache/zeppelin/pull/1030 LGTM +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #966: [ZEPPELIN-958] Support syntax highlight for python and ...
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/966 Yes.. and this method does not work if the default interpreter is set to Python for the notebook ![screen shot 2016-06-17 at 01 03 50](https://cloud.githubusercontent.com/assets/5582506/16123862/71798088-3427-11e6-8422-463a6e65fd3a.png) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1021: Python interpreter and doc cleanup
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/1021 Thank you for prompt reviews! Merging if there is no more discussion. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1013: [ZEPPELIN-1002] Move configuration menus under dropdow...
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/1013 @corneadoug thanks for posting screen! It looks reasonable > and put every items under this single button? > Either way, i think it's better than now. True, as soon as it works on mobile as well and Integration tests are updated there is not that much difference and we can change it again later. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #933: [ZEPPELIN-905] fix failed notebook import bug
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/933 @swkimme ping on the status of this patch --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #994: [ZEPPELIN-986] Create publish release script
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/994 @minahlee Great! I think it should be ready to merge as soon as issues highlighted above a. failing networking `curl` b. build configuration duplication are addressed --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1029: [ZEPPELIN-698] #756 Added new shortcuts but didn't rem...
Github user prabhjyotsingh commented on the issue: https://github.com/apache/zeppelin/pull/1029 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
Re: [GSoC-2016][Zeppelin Notebooks] Second Notebook Review
Hi Anish, Thanks for sharing. It looks really good to me and i think it shows how Zeppelin can be used really well. Appreciate for your hard work! Thanks, moon On Wed, Jun 15, 2016 at 9:00 AM anish singhwrote: > Hello, > > Second notebook is up for review at [0]. Custom visualizations for the > notebook were created using html display and Helium Application. I'm Sorry > for delay in creating the notebook as filtering and cleaning the datasets > for this notebook took a lot of time. > > Documentation for the notebook is ready at [2]. > > Zeppelin Hub viewer link for the notebook is [3]. A lot of the > visualizations don't display completely on the viewer and so a sample demo > run of the Helium application on my machine is shared at [1]. > > Meanwhile, I'll do more of flink and start work on the third notebook on > European Union transportation and communication datasets. > > [0]. > https://github.com/anish18sun/Zeppelin-Notebooks/tree/master/2BP12534C > [1]. https://drive.google.com/open?id=0ByXTtaL2yHBuejVUQ0k3ek1IdGc > [2]. http://zeppelinnotes.blogspot.in/ > [3]. > > https://www.zeppelinhub.com/viewer/notebooks/aHR0cHM6Ly9yYXcuZ2l0aHVidXNlcmNvbnRlbnQuY29tL2FuaXNoMThzdW4vWmVwcGVsaW4tTm90ZWJvb2tzL21hc3Rlci8yQlAxMjUzNEMvbm90ZS5qc29u > > Thanks, > Anish. >
[GitHub] zeppelin pull request #1030: [ZEPPELIN-1023] Add more credential apis.
GitHub user astroshim opened a pull request: https://github.com/apache/zeppelin/pull/1030 [ZEPPELIN-1023] Add more credential apis. ### What is this PR for? This PR is for supporting various Credential APIs for users. ### What type of PR is it? Improvement ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1023 ### How should this be tested? - to create credential information. ``` curl -XPUT -H "Content-Type: application/json" "http://localhost:8080/api/credential; -d '{"entity" : "e1", "username" : "user1", "password" : "testpass"}' ``` - to get credential information. ``` curl -XGET -H "Content-Type: application/json" "http://localhost:8080/api/credential; ``` - to remove credential entity information. ``` curl -vvv -XDELETE -H "Content-Type: application/json" "http://localhost:8080/api/credential/e1; ``` - to remove all credential information. ``` curl -vvv -XDELETE -H "Content-Type: application/json" "http://localhost:8080/api/credential; ``` ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? yes You can merge this pull request into a Git repository by running: $ git pull https://github.com/astroshim/zeppelin ZEPPELIN-1023 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/1030.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1030 commit 03717018b88d4a4d02f0ce153bb006c5474f7dd7 Author: astroshimDate: 2016-06-16T15:05:42Z add more credential apis. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (ZEPPELIN-1023) Add Credentials APIs
Shim HyungSung created ZEPPELIN-1023: Summary: Add Credentials APIs Key: ZEPPELIN-1023 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1023 Project: Zeppelin Issue Type: Improvement Reporter: Shim HyungSung There is only PUT Credential REST API. We need also GET and DELETE APIs. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] zeppelin pull request #984: [ZEPPELIN-982] Improve interpreter completion AP...
Github user asfgit closed the pull request at: https://github.com/apache/zeppelin/pull/984 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #998: Authenticated user aware notebook storage layer
Github user Leemoonsoo commented on the issue: https://github.com/apache/zeppelin/pull/998 Thanks @khalidhuseynov for the improvement. LGTM and merge it into 0.6 and master if there're no more discussions. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #756: [ZEPPELIN-698] Change shortcut for changing paragraph w...
Github user Leemoonsoo commented on the issue: https://github.com/apache/zeppelin/pull/756 @duhlin Ah,, I have reopened issue and created a [fix](https://github.com/apache/zeppelin/pull/1029) for it --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #1029: [ZEPPELIN-698] #756 Added new shortcuts but did...
GitHub user Leemoonsoo opened a pull request: https://github.com/apache/zeppelin/pull/1029 [ZEPPELIN-698] #756 Added new shortcuts but didn't removed old one ### What is this PR for? #756 Added new shortcuts but didn't removed old one https://github.com/apache/zeppelin/pull/756#issuecomment-226423090 ### What type of PR is it? Bug Fix ### Todos * [x] - Remove old shortcuts ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-698 ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no You can merge this pull request into a Git repository by running: $ git pull https://github.com/Leemoonsoo/zeppelin ZEPPELIN-698-FOLLOWUP Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/1029.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1029 commit 33f6a4628e572c25bcda43c62064ad5a82df8701 Author: Lee moon sooDate: 2016-06-16T14:58:52Z Remove shortcuts ctrl+alt+1~0-= --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1024: Add force layout visualization in paragraphs for SQL q...
Github user corneadoug commented on the issue: https://github.com/apache/zeppelin/pull/1024 @davidtzoor Seems it is really not working, please create a branch for your PR (`git checkout -b nameOfMyBranch`) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #806: [ZEPPELIN-707]Automatically adds %.* of previous paragr...
Github user mwkang commented on the issue: https://github.com/apache/zeppelin/pull/806 I am not sure that this test case is you expected --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #1028: [Zeppelin-1022] Apply new mechanism to LivyInte...
GitHub user prabhjyotsingh opened a pull request: https://github.com/apache/zeppelin/pull/1028 [Zeppelin-1022] Apply new mechanism to LivyInterpreter ### What is this PR for? Apply new mechanism to LivyInterpreter ### What type of PR is it? [Improvement] ### Todos * [x] - Apply new mechanism to LivyInterpreter * [x] - rename zeppelin.livy.url to livy.host.url to make all params look livy.* * [x] - surround interpreterContext.getAuthenticationInfo().getUser() with "" ### What is the Jira issue? * [Zeppelin-1022](https://issues.apache.org/jira/browse/ZEPPELIN-1022) ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no You can merge this pull request into a Git repository by running: $ git pull https://github.com/prabhjyotsingh/zeppelin ZEPPELIN-1022 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/1028.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1028 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #1008: [ZEPPELIN-997] Export data to csv
Github user asfgit closed the pull request at: https://github.com/apache/zeppelin/pull/1008 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #746: [ZEPPELIN-699] Add new synchronous paragraph run...
GitHub user doanduyhai reopened a pull request: https://github.com/apache/zeppelin/pull/746 [ZEPPELIN-699] Add new synchronous paragraph run REST API ### What is this PR for? Right now, when calling the REST API `http://:/api/notebook/job//` Zeppelin always returns **OK** as shown by this source code: https://github.com/apache/incubator-zeppelin/blob/master/zeppelin-server/src/main/java/org/apache/zeppelin/rest/NotebookRestApi.java#L477 This ticket will update the behavior so that Zeppelin also return the result of the paragraph execution ### What type of PR is it? [Improvement] ### Todos * [ ] - Code Review * [ ] - Simple Test ### Is there a relevant Jira issue? **[ZEPPELIN-699]** ### How should this be tested? * `git fetch origin pull/746/head:ParagraphExecutionRESTAPI` * `git checkout ParagraphExecutionRESTAPI` * `mvn clean package -DskipTests` * `bin/zeppelin-daemon.sh restart` * Create a new note * In the first paragraph, put the following code ```scala %sh echo "Current time = "`date +"%T" ``` * Retrieve the current note id in the URL * Retrieve the current paragraph id * Use a REST Client like **[POSTman]** to create a HTTP POST query `http://:/api/notebook/run//` * You should receive something similar as follow for answer ``` { "status": "OK", "body": { "code": "SUCCESS", "type": "TEXT", "msg": "Current time = 16:14:18\n" } } ``` ### Screenshots (if appropriate) ![zeppelin_synchronous_rest_api](https://cloud.githubusercontent.com/assets/1532977/15748069/b4a26a46-28dd-11e6-8f51-aa13ddba3f1c.gif) API Documentation update **Existing asynchronous API** ![image](https://cloud.githubusercontent.com/assets/1532977/15773274/5b508cae-2976-11e6-9e52-14d8b7e7828e.png) **New synchronous API** ![image](https://cloud.githubusercontent.com/assets/1532977/15773309/84965a94-2976-11e6-9719-81d8b555c3c4.png) ### Questions: * Does the licenses files need update? --> **No** * Is there breaking changes for older versions? --> **No** * Does this needs documentation? --> **Yes** [ZEPPELIN-699]: https://issues.apache.org/jira/browse/ZEPPELIN-699 [POSTman]: https://www.getpostman.com/ You can merge this pull request into a Git repository by running: $ git pull https://github.com/doanduyhai/incubator-zeppelin ZEPPELIN-699 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/746.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #746 commit 090d9de360b2130d2fee135949ef31a35642934f Author: DuyHai DOANDate: 2016-06-02T14:15:46Z [ZEPPELIN-699] Add new synchronous paragraph run REST API commit faf9542feee910cb4d584b4b49927136a3f839f7 Author: DuyHai DOAN Date: 2016-06-02T14:24:38Z [ZEPPELIN-699] Update Notebook REST API documentation commit 0106cf5735912467ee36aaf37edefd617548863e Author: DuyHai DOAN Date: 2016-06-03T08:20:17Z [ZEPPELIN-699] Fix doc after code review --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #746: [ZEPPELIN-699] Add new synchronous paragraph run...
Github user doanduyhai closed the pull request at: https://github.com/apache/zeppelin/pull/746 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #806: [ZEPPELIN-707]Automatically adds %.* of previous paragr...
Github user jongyoul commented on the issue: https://github.com/apache/zeppelin/pull/806 @mwkang Could you please re-trigger this PR? Close and reopen this issue. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1019: [ZEPPELIN-1015] Cron job fails to run a paragraph when...
Github user cloverhearts commented on the issue: https://github.com/apache/zeppelin/pull/1019 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #998: Authenticated user aware notebook storage layer
Github user echarles commented on the issue: https://github.com/apache/zeppelin/pull/998 LGTM I have tested and works well for me. Gone through the code and changes make sense. Will be useful to get it into 0.6 release (especially if #836 is also in 0.6, as methods are added in the NotebookServer, which will have impact on this PR). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #1026: [ZEPPELIN-1021] delete reduplicate dependency a...
GitHub user shijinkui opened a pull request: https://github.com/apache/zeppelin/pull/1026 [ZEPPELIN-1021] delete reduplicate dependency and add scala version properties ### What is this PR for? 1. reduplicate dependency 2. scala version properties ### What type of PR is it? Improvement ### Todos ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1021 ### How should this be tested? ### Screenshots (if appropriate) ### Questions: You can merge this pull request into a Git repository by running: $ git pull https://github.com/shijinkui/incubator-zeppelin reduplicate_deps Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/1026.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1026 commit 362b23d9c9bdb7aafc7b134860fe11b1123bccfa Author: shijinkuiDate: 2016-06-16T11:00:12Z 1. reduplicate dependency 2. scala version properties --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (ZEPPELIN-1021) delete reduplicate dependency and add scala version properties
shijinkui created ZEPPELIN-1021: --- Summary: delete reduplicate dependency and add scala version properties Key: ZEPPELIN-1021 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1021 Project: Zeppelin Issue Type: Improvement Components: build Reporter: shijinkui 1. reduplicate dependency 2. scala version properties -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] zeppelin pull request #1025: ZEPPELIN-964 ] Jobmanagement - (2) basic front-...
GitHub user cloverhearts opened a pull request: https://github.com/apache/zeppelin/pull/1025 ZEPPELIN-964 ] Jobmanagement - (2) basic front-end ### What is this PR for? Job manger basic front end. You can check to paragraph and notebook information. It is created with the following additional functions PR. (E. G., Filter and sort) this PR is divided from the https://github.com/apache/zeppelin/pull/921 ### What type of PR is it? Featrue ### Todos - [x] - notebook information - [x] - viewing status for paragraph - [x] - feat. running progress bar. - [x] - added job menu in navbar. (It can be modified by the following (https://github.com/apache/zeppelin/pull/1013) ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-964 ### How should this be tested? 1. create and running, modified notebook and paragraph. 2. check to cron or normal notebook status in job manager. ### Screenshots (if appropriate) https://cloud.githubusercontent.com/assets/10525473/16113612/0120dec8-33f8-11e6-8dec-c74048fae637.png;> ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? yes You can merge this pull request into a Git repository by running: $ git pull https://github.com/cloverhearts/zeppelin dev/jobmanager/step/02-basic-front Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/1025.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1025 commit 18db280fb18e2b32aa0f384adfbbc27efd056a57 Author: CloverHeartsDate: 2016-06-16T08:40:12Z modifed get run status for paragraph and bug fixed. commit 75186c77c87a72c7f775b6e937353c147c627b14 Author: CloverHearts Date: 2016-06-16T10:11:48Z implement basic - frontend for job manager. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (ZEPPELIN-1020) Suggestion List should remove on click.
Suvam Mohanty created ZEPPELIN-1020: --- Summary: Suggestion List should remove on click. Key: ZEPPELIN-1020 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1020 Project: Zeppelin Issue Type: Bug Reporter: Suvam Mohanty Priority: Minor The suggestion list under note permissions for readers, writers & owners should hide on-click anywhere on the notebook. Now it hides only on pressing enter in the input field of the permission. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] zeppelin issue #1013: [ZEPPELIN-1002] Move configuration menus under dropdow...
Github user minahlee commented on the issue: https://github.com/apache/zeppelin/pull/1013 One question, if `Confidential` is per user menu, should it be shown when only user logged in? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1021: Python interpreter and doc cleanup
Github user AhyoungRyu commented on the issue: https://github.com/apache/zeppelin/pull/1021 LGTM ð --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1017: Add force layout visualization in paragraphs for SQL q...
Github user davidtzoor commented on the issue: https://github.com/apache/zeppelin/pull/1017 closing this issue since new PR has been opened (#1024) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1023: [gh-pages][ZEPPELIN-996] Update first page of Zeppelin...
Github user felixcheung commented on the issue: https://github.com/apache/zeppelin/pull/1023 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1017: Add force layout visualization in paragraphs for SQL q...
Github user cloverhearts commented on the issue: https://github.com/apache/zeppelin/pull/1017 LGTM! +1 good visualize! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1018: Blocking the zeppelin-web build error.
Github user corneadoug commented on the issue: https://github.com/apache/zeppelin/pull/1018 Merging if there is no more discussions --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1018: Blocking the zeppelin-web build error.
Github user cloverhearts commented on the issue: https://github.com/apache/zeppelin/pull/1018 Looks good! +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1024: Add force layout visualization in paragraphs for SQL q...
Github user davidtzoor commented on the issue: https://github.com/apache/zeppelin/pull/1024 @corneadoug I recreated the PR after doing the rebasing from scratch and it now has no conflict. Hope it works out this time. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #1024: Add force layout visualization in paragraphs fo...
GitHub user davidtzoor opened a pull request: https://github.com/apache/zeppelin/pull/1024 Add force layout visualization in paragraphs for SQL queries ### What is this PR for? Add force layout (graph) visualization to the existing set of visualizations in Zeppelin Web notp. ### What type of PR is it? [Feature] ### What is the Jira issue? [ZEPPELIN-1011] ### How should this be tested? The testes are incorporated within the existing test suite. ### Screenshots (if appropriate) ![eeffbb58-3238-11e6-92ea-148a4063d353](https://cloud.githubusercontent.com/assets/8441214/16072738/18feac4a-32eb-11e6-8e13-63ff04fa1df0.png) ### Questions: * Does the licenses files need update? No. * Is there breaking changes for older versions? No. * Does this needs documentation? We can add some documentation explaining about the different fields that need to be selected in order to generate the force layout component. You can merge this pull request into a Git repository by running: $ git pull https://github.com/davidtzoor/zeppelin master Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/1024.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1024 commit 619376b54ba4064d58e1ac9c8dba9ce9be103a4a Author: David TzoorDate: 2016-06-16T06:26:17Z add force layout button commit ea6c346a90f38f6e413bbbe646d2fcf96620e4cc Author: David Tzoor Date: 2016-06-16T06:27:18Z add div and svg tags that will contain the force layout object commit 7048e8ebb55bcd570b0374afe9ac284696c7284c Author: David Tzoor Date: 2016-06-16T06:39:30Z add column drop boxes for column selection for source and destination nodes commit c9a11c6150a50c66ff7d15739532b117aa48ddef Author: David Tzoor Date: 2016-06-16T06:44:54Z add force layout rendering and column selection handling methods commit 045251e3ed214be1f50876b80db2bbc638ce7dd7 Author: David Tzoor Date: 2016-06-16T06:45:58Z add force layout and tooltip CSS --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (ZEPPELIN-1016) Remove Zeppelin-web deprecated dependencies warnings
CORNEAU Damien created ZEPPELIN-1016: Summary: Remove Zeppelin-web deprecated dependencies warnings Key: ZEPPELIN-1016 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1016 Project: Zeppelin Issue Type: Improvement Reporter: CORNEAU Damien Priority: Minor When building zeppelin-web from clean repo, we have a few warnings shown as [ERROR] from some dependencies. You can see those if you build inside zeppelin-web directory using `mvn clean package -DskipTests`: ``` [ERROR] npm WARN deprecated lodash@1.0.2: lodash@<3.0.0 is no longer maintained. Upgrade to lodash@^4.0.0. [ERROR] npm WARN deprecated graceful-fs@2.0.3: graceful-fs v3.0.0 and before will fail on node releases >= v7.0. Please update to graceful-fs@^4.0.0 as soon as possible. Use 'npm ls graceful-fs' to find it in the tree. [ERROR] npm WARN deprecated graceful-fs@1.2.3: graceful-fs v3.0.0 and before will fail on node releases >= v7.0. Please update to graceful-fs@^4.0.0 as soon as possible. Use 'npm ls graceful-fs' to find it in the tree. [ERROR] npm WARN deprecated graceful-fs@3.0.8: graceful-fs v3.0.0 and before will fail on node releases >= v7.0. Please update to graceful-fs@^4.0.0 as soon as possible. Use 'npm ls graceful-fs' to find it in the tree. [ERROR] npm WARN deprecated CSSselect@0.7.0: the module is now available as 'css-select' [ERROR] npm WARN deprecated CSSwhat@0.4.7: the module is now available as 'css-what' ``` -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] zeppelin issue #1021: Python interpreter and doc cleanup
Github user felixcheung commented on the issue: https://github.com/apache/zeppelin/pull/1021 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1008: [ZEPPELIN-997] Export data to csv
Github user corneadoug commented on the issue: https://github.com/apache/zeppelin/pull/1008 Merging in Master if there is no more discussions --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1013: [ZEPPELIN-1002] Move configuration menus under dropdow...
Github user minahlee commented on the issue: https://github.com/apache/zeppelin/pull/1013 @corneadoug Having separate menu for the anonymous user totally makes sense. Then the next question would be where do we want to place it? Next to Notebook? - will give less confusion who is used to current layout, but there won't be big problem once they recognize it On the right side of nav bar? - will take less space since it will use gear icon instead of `Settings` text. I have no special preference on setting menu location. @corneadoug, @bzz, @Leemoonsoo what is your opinion here? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #971: [ZEPPELIN-961] Longer names to the notebook make the na...
Github user sagarkulkarni3592 commented on the issue: https://github.com/apache/zeppelin/pull/971 I have adjusted the noteAction size by adjusting name component of the noteAction bar. ![screen shot 2016-06-16 at 11 46 44 am](https://cloud.githubusercontent.com/assets/12127192/16107170/14c1c39c-33b8-11e6-87af-50f2b6fb4e3e.png) But, still there is a problem if the window size is reduced below that. It is because, all the buttons can not be fit in that div. So they overflow. Below is the screenshot if we don't show the name at all. ![screen shot 2016-06-16 at 11 53 09 am](https://cloud.githubusercontent.com/assets/12127192/16107264/f477ead4-33b8-11e6-9cc0-2716f8cc180b.png) What should be the exact requirement in this case? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #1022: [HOTFIX][DOC] Fix image path again
Github user minahlee commented on the issue: https://github.com/apache/zeppelin/pull/1022 @corneadoug yes, the doc for 0.6.0 will be published based on branch-0.6 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---