[GitHub] zeppelin pull request #2272: ZEPPELIN-2397. Add toJson and fromJson method f...
GitHub user zjffdu opened a pull request: https://github.com/apache/zeppelin/pull/2272 ZEPPELIN-2397. Add toJson and fromJson method for serializable objects ### What is this PR for? Add toJson and fromJson method for all the objects that need ser/der in zeppelin. ### What type of PR is it? [Refactoring] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-2397?filter=-2 ### How should this be tested? Outline the steps to test the PR here. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No You can merge this pull request into a Git repository by running: $ git pull https://github.com/zjffdu/zeppelin ZEPPELIN-2397 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/2272.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2272 commit 043868602c9e9a092c385b946ec49eb3ecd6b4ca Author: Jeff ZhangDate: 2017-04-12T10:43:34Z ZEPPELIN-2397. Add toJson and fromJson method for serializable objects --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2270: [ZEPPELIN-2409] DON'T block body scrolling in results ...
Github user 1ambda commented on the issue: https://github.com/apache/zeppelin/pull/2270 @soralee Please help review this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2267: [ZEPPELIN-2435](WIP) Add logging level facility to fro...
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/2267 @1ambda Thanks --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (ZEPPELIN-2436) ZEPPELIN_IMPERSONATE_CMD doesn't support echo command
heyang wang created ZEPPELIN-2436: - Summary: ZEPPELIN_IMPERSONATE_CMD doesn't support echo command Key: ZEPPELIN-2436 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2436 Project: Zeppelin Issue Type: Bug Components: Interpreters Affects Versions: 0.7.1 Environment: Spark 2.0,livy 3.0,hadoop 2.7.2,centos 6,ldap Reporter: heyang wang I followed the doc on https://zeppelin.apache.org/docs/0.7.0/manual/userimpersonation.html to enable user impersontaion. I did export ZEPPELIN_IMPERSONATE_CMD='sudo -H -u ${ZEPPELIN_IMPERSONATE_USER} bash -c ' in zeppelin-env.sh. However, since I am also using ldap, the user is of form n...@company.com and useradd can't add such user with the @ mark. So I thought I could get only the username without the @ subfix using the following command: export ZEPPELIN_IMPERSONATE_CMD='echo ${ZEPPELIN_IMPERSONATE_USER} | cut -d \@ -f 1 |xargs -I {} sudo -H -u {} bash -c ' However this setting bring error like "sudo no such user {}". The reason is because the following line of code in bin/interpreter.sh: ZEPPELIN_IMPERSONATE_RUN_CMD=$(eval "echo ${ZEPPELIN_IMPERSONATE_CMD} ") The eval echo before ZEPPELIN_IMPERSONATE_CMD actually execute the ZEPPELIN_IMPERSONATE_CMD which cause the error. My temporary workaround is change the above code to: ZEPPELIN_IMPERSONATE_RUN_CMD=$ZEPPELIN_IMPERSONATE_CMD It seems the "eval echo " is placed there for some checking. Is there a better solution to support costume ZEPPELIN_IMPERSONATE_CMD? -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[GitHub] zeppelin issue #2267: [ZEPPELIN-2435](WIP) Add logging level facility to fro...
Github user 1ambda commented on the issue: https://github.com/apache/zeppelin/pull/2267 created issue https://issues.apache.org/jira/browse/ZEPPELIN-2435 Let me work it on this PR. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (ZEPPELIN-2435) Add logging level facility to frontend
Hoon Park created ZEPPELIN-2435: --- Summary: Add logging level facility to frontend Key: ZEPPELIN-2435 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2435 Project: Zeppelin Issue Type: Improvement Components: front-end Reporter: Hoon Park Add logging level facility to frontend -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[GitHub] zeppelin issue #2267: [MINOR] Verbose logging in zeppelin-web
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/2267 @1ambda What I want to see is plain text json. But the expanded object seems not plain text, it contains fields `__proto__`. Make sense to add logging level, but not sure how to add that, I am not expert of front end, could you help add that ? Thanks --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2267: [MINOR] Verbose logging in zeppelin-web
Github user 1ambda commented on the issue: https://github.com/apache/zeppelin/pull/2267 Or do you want to see the details without click? Then, we need something like logging level in frontend. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2267: [MINOR] Verbose logging in zeppelin-web
Github user 1ambda commented on the issue: https://github.com/apache/zeppelin/pull/2267 @zjffdu you can expand it in browser console by clicking it. ![minor_logging](https://cloud.githubusercontent.com/assets/4968473/25261865/6ab69df2-268f-11e7-81d8-7a60f44ac0cb.gif) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2271: [ZEPPELIN-2414] Memory leak under scoped mode of Spark...
Github user hammertank commented on the issue: https://github.com/apache/zeppelin/pull/2271 @Jongyoul Lee Ready to review. Please help. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #2271: [ZEPPELIN-2414] Memory leak under scoped mode o...
GitHub user hammertank opened a pull request: https://github.com/apache/zeppelin/pull/2271 [ZEPPELIN-2414] Memory leak under scoped mode of SparkInterpreter caused by inapproprately setting Thread.contextClassLoader ### What is this PR for? Fix memory leak under scoped mode of SparkInterpreter which is caused by inapproprately setting Thread.contextClassLoader. ### What type of PR is it? Bug Fix ### Todos Rest Thread.contextClassLoader in Methods: * [ ] - public void open() * [ ] - private Results.Result interpret(String line) * [ ] - public List completion(String buf, int cursor) ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-2414 ### How should this be tested? TestCase SparkInterpreterTest#testContextClassLoader ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No You can merge this pull request into a Git repository by running: $ git pull https://github.com/hammertank/zeppelin ZEPPELIN-2414 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/2271.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2271 commit 312b972bfd1a33cf1ec439e480795be151f63c87 Author: z0621Date: 2017-04-18T02:42:23Z [ZEPPELIN-2414] Memory leak under scoped mode of SparkInterpreter caused by inapproprately setting Thread.contextClassLoader commit 8be737b120c1a614547df17454c03da2848aefe6 Author: z0621 Date: 2017-04-19T02:32:27Z [HOTFIX] CAN'T install cran packages using apt in Travis CI commit 79d005fd64b4e9e9334975611d6dd421b0258e30 Author: z0621 Date: 2017-04-19T03:12:23Z [ZEPPELIN-1455] Fix flaky test: AbstractAngularElemTest commit a7953cffd10f89ead29987281fd9052e8c5cc6b9 Author: z0621 Date: 2017-04-19T03:54:24Z Fix CI build failure on branch-0.6 commit e971e610d2e626f310f123efd2ef09c26f432a85 Author: z0621 Date: 2017-04-19T06:58:25Z [ZEPPELIN-1972] Preserve context classloader commit 36c82419b27646df8bc0b6f6aac224b23f7ee630 Author: z0621 Date: 2017-04-19T07:51:36Z Merge branch 'HOTFIX' into ZEPPELIN-2414 commit 9df575da5d6998135e010c44f2b296850536ee49 Author: z0621 Date: 2017-04-19T09:20:30Z [ZEPPELIN-2414] Memory leak under scoped mode of SparkInterpreter caused by inapproprately setting Thread.contextClassLoader commit d59ea0836a03c7e55228ff2888d0261b8222c7c2 Author: z0621 Date: 2017-04-19T09:21:42Z Add travis_check.py from master commit 959011130c2dfa2cccdb0b68c8d9f12020383d18 Author: z0621 Date: 2017-04-19T10:19:10Z Merge branch 'HOTFIX' into ZEPPELIN-2414 commit 230e5db11f101ce99127f3a2fc1972e3a0bcddb6 Author: z0621 Date: 2017-04-20T05:28:11Z [ZEPPELIN-2414] Memory leak under scoped mode of SparkInterpreter caused by inapproprately setting Thread.contextClassLoader commit f5b6f1238e258f2ea7a33ba524b19bea243acfd7 Author: z0621 Date: 2017-04-20T06:26:37Z [ZEPPELIN-2414] Memory leak under scoped mode of SparkInterpreter caused by inapproprately setting Thread.contextClassLoader --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #2270: [ZEPPELIN-2409] DON'T block body scrolling in r...
GitHub user 1ambda opened a pull request: https://github.com/apache/zeppelin/pull/2270 [ZEPPELIN-2409] DON'T block body scrolling in results scrollbar ### What is this PR for? DON'T block body scrolling in results scrollbar. See the GIFs below. ### What type of PR is it? [Improvement] ### Todos NONE ### What is the Jira issue? [ZEPPELIN-2409](https://issues.apache.org/jira/browse/ZEPPELIN-2409) ### How should this be tested? 1. Create multiple paragraphs including scrollbar in result. For example, ``` bank.printSchema bank.show() ``` 2. Scrolling down, up ### Screenshots (if appropriate) Before ![2407_before](https://cloud.githubusercontent.com/assets/4968473/25261209/f25c2956-268b-11e7-877d-28c6281f7567.gif) After ![2407_after](https://cloud.githubusercontent.com/assets/4968473/25261212/f5773bb2-268b-11e7-9c20-e998a06f5ee2.gif) ### Questions: * Does the licenses files need update? * Is there breaking changes for older versions? * Does this needs documentation? You can merge this pull request into a Git repository by running: $ git pull https://github.com/1ambda/zeppelin ZEPPELIN-2407/dont-block-body-scroll-in-para-results Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/2270.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2270 commit 33a7c368ffc917b53597dc5633c845e6c116d15f Author: 1ambda <1am...@gmail.com> Date: 2017-04-21T03:11:19Z fix: DON'T block body scrolling in para results scrollbar --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #2263: ZEPPELIN-2421. AngularObject miss AngularObject...
Github user asfgit closed the pull request at: https://github.com/apache/zeppelin/pull/2263 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #2269: [ZEPPELIN-2434] Credential feature does work in...
GitHub user Leemoonsoo opened a pull request: https://github.com/apache/zeppelin/pull/2269 [ZEPPELIN-2434] Credential feature does work in JDBC interpreter ### What is this PR for? Credential feature does not work in JDBC interpreter. This PR fixes unittest that does not detect this bug and fix jdbc interpreter to correctly read credential. ### What type of PR is it? Bug Fix ### Todos * [x] - Fix unittest * [x] - Fix condition when use credential, when use property. ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-2434 ### How should this be tested? Set empty `default.user` property and set id/pw in 'credential' menu. And try use jdbc interpreter. ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no You can merge this pull request into a Git repository by running: $ git pull https://github.com/Leemoonsoo/zeppelin jdbc_credential Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/2269.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2269 commit 1de7ea62fec40a503272db5737af47fa284fb0e2 Author: Lee moon sooDate: 2017-04-21T00:31:44Z Use crednetial information instead of property when user is empty string. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2263: ZEPPELIN-2421. AngularObject miss AngularObjectListene...
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/2263 Thanks @Leemoonsoo , will merge it if no more comments --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (ZEPPELIN-2434) Credential feature does work in JDBC interpreter
Lee moon soo created ZEPPELIN-2434: -- Summary: Credential feature does work in JDBC interpreter Key: ZEPPELIN-2434 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2434 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.1 Reporter: Lee moon soo Fix For: 0.7.2 Credential feature does work in JDBC interpreter Problem reported https://lists.apache.org/thread.html/5138345b37492b7973e309d22fc1ecbd44dadd7b0e20b7f72fc03579@%3Cusers.zeppelin.apache.org%3E -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[GitHub] zeppelin issue #2267: [MINOR] Verbose logging in zeppelin-web
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/2267 @1ambda `event.data` is useful for me to see what is in the json data. Could we keep that ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2267: [MINOR] Verbose logging in zeppelin-web
Github user Leemoonsoo commented on the issue: https://github.com/apache/zeppelin/pull/2267 LGTM and merge to master if no further comment. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
Re: shiro.ini : Zeppelin interpreter authorization: lock to one user
Hi, https://issues.apache.org/jira/browse/ZEPPELIN-2236 tracks restricting interpreter setting to admin group. And we're trying to solve this problem in 0.8.0 [1]. Please keep an eye on this issue and feel free to make any contributions. Thanks, moon [1] https://lists.apache.org/thread.html/f4be5635e6e72d2a9dc23771ceeaef8a8e5933bfb14db7cab303bc22@%3Cdev.zeppelin.apache.org%3E On Wed, Apr 12, 2017 at 6:48 PM Arun Khetarpalwrote: > Hi - > > I think the ask is that currently it seems that activeDirectoryGroupRealm > maps each active directory group to a shiro role. Later we can authorize > urls with roles in our urls section of shiro file. > > Our problem is that we don't really have an admin group handy in our AD - > due to which there is a bit of a problem in setting the correct > authorization of some urls. We were able to play around with > ActiveDirectoryGroupRealm and modify in such a way that an internal role is > created for systemUser and then authorize urls for him based on the > internal role. > > Later we placed this modified ActiveDirectoryGroupRealm in Class path and > everything works as expected. So my question is - > > a. Is there a better way provided by zeppelin for users to provide their > own implementation of ActiveDirectoryGroupRealm ? > b. Is the community interested in modifying ActiveDirectoryGroupRealm with > our tweaks ? > > > Regards, > Arun > > > > > On 12 April 2017 at 15:55, Vartul Gupta > wrote: > > > Hi Team, > > > > I am trying to setup authentication and authorization for Zeppelin using > > Shiro file. > > Now my question is How we can set Zeppelin interpreter settings to be > > restricted to a particular AD admin user. > > > > Here is the sample of my shiro file . > > > > [main] > > activeDirectoryRealm = > org.apache.zeppelin.realm.ActiveDirectoryGroupRealm > > activeDirectoryRealm.systemUsername = adminuser1 > > activeDirectoryRealm.systemPassword = ^^ > > #activeDirectoryRealm.hadoopSecurityCredentialPath = > > jceks://user/zeppelin/zeppelin.jceks > > activeDirectoryRealm.searchBase = "OU=AADDC > Users,DC=team2testdomain,DC=testabc > > ,DC=com" > > activeDirectoryRealm.url = ldaps://team2testdomain.testabc.com:636 > > activeDirectoryRealm.principalSuffix = @TEAM2TESTDOMAIN.testabc.COM > > activeDirectoryRealm.groupRolesMap = "OU=AADDC > > Users,DC=team2testdomain,DC= testabc,DC=com":"admin" > > activeDirectoryRealm.authorizationCachingEnabled = true > > sessionManager = > org.apache.shiro.web.session.mgt.DefaultWebSessionManager > > cacheManager = org.apache.shiro.cache.MemoryConstrainedCacheManager > > securityManager.cacheManager = $cacheManager > > securityManager.sessionManager = $sessionManager > > # 86,400,000 milliseconds = 24 hour > > securityManager.sessionManager.globalSessionTimeout = 8640 > > shiro.loginUrl = /api/login > > > > [urls] > > # anon means the access is anonymous. > > # authcBasic means Basic Auth Security > > # To enfore security, comment the line below and uncomment the next one > > #/** = anon > > /** = authc > > > > Thanks > > Vartul > > >
[GitHub] zeppelin issue #2263: ZEPPELIN-2421. AngularObject miss AngularObjectListene...
Github user Leemoonsoo commented on the issue: https://github.com/apache/zeppelin/pull/2263 Thanks @zjffdu for the fix. LGTM! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2260: [ZEPPELIN-2408] Should use $uibTooltip instead of $too...
Github user Leemoonsoo commented on the issue: https://github.com/apache/zeppelin/pull/2260 LGTM and merge to master and branch-0.7 if no further discussions. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #2261: [ZEPPELIN-2420] Slow notebook listing in navbar
Github user asfgit closed the pull request at: https://github.com/apache/zeppelin/pull/2261 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
Re: Access to Spark Context from a Custom Interpreter
Hi Michael, Interpreter does not close / open between paragraphs. That means you can just keep any object as member variable in your interpreter implementation. For example SparkInterpreter [1] keeps IMain as a member variable. Interpreter shipped in Zeppelin codebase is developed with the same API that custom interpreter uses. They have no differences. Hope this helps! Thanks, moon [1] https://github.com/apache/zeppelin/blob/v0.7.1/spark/src/main/java/org/apache/zeppelin/spark/SparkInterpreter.java#L102 On Thu, Apr 20, 2017 at 9:42 AM Michael Marconiwrote: > Hi – I'd like to know if it's possible to access the SparkContext from a > Custom Interpreter I am developing. I need access to DataFrames created in > earlier paragraphs, so I can transform them and make the results available > to subsequent paragraphs. > > I was expecting to find the Spark Context on the Interpreter Context that > is handed to my Custom Interpreter but this is not the case. > > I've come across this similar request StackOverflow but it doesn't answer > the question: > http://stackoverflow.com/questions/37099590/zeppelin-how-to-create-dataframe-from-within-custom-interpreter > > Can you advise whether this is possible with an externally-contributed > Custom Interpreter or would I need to fork the Zeppelin codebase and pull a > new interpreter into the Spark package? > > Many thanks, > Michael >
[GitHub] zeppelin issue #2234: [ZEPPELIN-2374] sorting notes tree
Github user Leemoonsoo commented on the issue: https://github.com/apache/zeppelin/pull/2234 LGTM and merge to master if no further discussions! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
Access to Spark Context from a Custom Interpreter
Hi â I'd like to know if it's possible to access the SparkContext from a Custom Interpreter I am developing. I need access to DataFrames created in earlier paragraphs, so I can transform them and make the results available to subsequent paragraphs. I was expecting to find the Spark Context on the Interpreter Context that is handed to my Custom Interpreter but this is not the case. I've come across this similar request StackOverflow but it doesn't answer the question: http://stackoverflow.com/questions/37099590/zeppelin-how-to-create-dataframe-from-within-custom-interpreter Can you advise whether this is possible with an externally-contributed Custom Interpreter or would I need to fork the Zeppelin codebase and pull a new interpreter into the Spark package? Many thanks, Michael
Spark Context in custom interpreter
I am developing a custom interpreter that needs access to the Spark Context, so that he can transform data stored in DataFrames created in other paragraphs. Can anyone advise me on the best way to get hold of that Context please?
[jira] [Created] (ZEPPELIN-2433) Notebook cell's text disappearing randomly - Git storage
Guillaume Van Delsen created ZEPPELIN-2433: -- Summary: Notebook cell's text disappearing randomly - Git storage Key: ZEPPELIN-2433 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2433 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.1 Reporter: Guillaume Van Delsen Priority: Critical Hello, Since we have multiple users working with Zeppelin, we are facing weird issue. Cell text randomly disappeared, sometimes just few cells and sometimes the whole notebook gets ripped off. I've identified in the log files the following lines ; INFO [2017-04-20 14:44:49,870] ({qtp1393931310-804} Folder.java[addNote]:184) - Add note 2CH2QEE4J to folder acc INFO [2017-04-20 14:44:49,941] ({qtp1393931310-785} NotebookServer.java[sendNote]:705) - New operation from 10.10.249.138 : 58626 : golardp : GET_NOTE : 2CE86BXSP INFO [2017-04-20 14:44:49,945] ({qtp1393931310-815} NotebookServer.java[sendNote]:705) - New operation from 10.10.249.138 : 59174 : golardp : GET_NOTE : 2CH2QEE4J INFO [2017-04-20 14:44:49,946] ({qtp1393931310-804} NotebookServer.java[sendNote]:705) - New operation from 10.10.249.142 : 35234 : lonckem : GET_NOTE : 2CC4Y88BK INFO [2017-04-20 14:44:50,000] ({qtp1393931310-815} NotebookServer.java[sendNote]:705) - New operation from 10.10.249.138 : 59174 : golardp : GET_NOTE : 2CH2QEE4J ERROR [2017-04-20 14:44:58,149] ({qtp1393931310-815} NotebookServer.java[onMessage]:357) - Can't handle message java.lang.NullPointerException ERROR [2017-04-20 14:44:58,153] ({qtp1393931310-804} NotebookServer.java[onMessage]:357) - Can't handle message java.lang.NullPointerException But have a look at the files here ; https://drive.google.com/drive/folders/0B4flaCIh3sQHSE1aUDJDN09ZbXc?usp=sharing As you can see this error occurs quite often and is a real pain is the ass to live with. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2432) Commit button return line in dropdown menu
Guillaume Van Delsen created ZEPPELIN-2432: -- Summary: Commit button return line in dropdown menu Key: ZEPPELIN-2432 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2432 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.1 Reporter: Guillaume Van Delsen See screenshot : https://drive.google.com/file/d/0B4flaCIh3sQHVmppX0ZmQnZ2VmM/view?usp=sharing -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[GitHub] zeppelin issue #2262: [HOTFIX] Fix CI build failure on branch-0.6
Github user jongyoul commented on the issue: https://github.com/apache/zeppelin/pull/2262 @hammertank Good to know. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2264: [ZEPPELIN-1711] Create `Dockerfile`s for released bin
Github user 1ambda commented on the issue: https://github.com/apache/zeppelin/pull/2264 @astroshim --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #2267: [MINOR] Verbose logging in zeppelin-web
Github user 1ambda closed the pull request at: https://github.com/apache/zeppelin/pull/2267 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #2267: [MINOR] Verbose logging in zeppelin-web
GitHub user 1ambda reopened a pull request: https://github.com/apache/zeppelin/pull/2267 [MINOR] Verbose logging in zeppelin-web ### What is this PR for? Verbose logging in zeppelin-web. See the screenshot below. - Remove the first `console.log` since it's already printed in the following statement. ### What type of PR is it? [Improvement] ### Todos NONE ### What is the Jira issue? MINOR ### How should this be tested? 1. start Zeppelin in dev mode (`:9000`) 2. open browser console ### Screenshots (if appropriate) Before https://cloud.githubusercontent.com/assets/4968473/25227897/352e49a8-2605-11e7-98dc-58c3810e1971.png;> After https://cloud.githubusercontent.com/assets/4968473/25227904/37be8db8-2605-11e7-84cb-bc981d85d04d.png;> ### Questions: * Does the licenses files need update? * Is there breaking changes for older versions? * Does this needs documentation? You can merge this pull request into a Git repository by running: $ git pull https://github.com/1ambda/zeppelin MINOR/verbose-logging Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/2267.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2267 commit 7448e52ddcb76443f60c37961da503a719923cb2 Author: 1ambda <1am...@gmail.com> Date: 2017-04-20T11:05:10Z fix: Use console.log with JSON.parse --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2265: [ZEPPELIN-2427] Hide navbar and noteAction bar when sc...
Github user 1ambda commented on the issue: https://github.com/apache/zeppelin/pull/2265 @Leemoonsoo Please help review this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #2267: [MINOR] Verbose logging in zeppelin-web
GitHub user 1ambda opened a pull request: https://github.com/apache/zeppelin/pull/2267 [MINOR] Verbose logging in zeppelin-web ### What is this PR for? Verbose logging in zeppelin-web. See the screenshot below. - Remove the first `console.log` since it's already printed in the following statement. ### What type of PR is it? [Improvement] ### Todos NONE ### What is the Jira issue? MINOR ### How should this be tested? 1. start Zeppelin in dev mode (`:9000`) 2. open browser console ### Screenshots (if appropriate) Before https://cloud.githubusercontent.com/assets/4968473/25227897/352e49a8-2605-11e7-98dc-58c3810e1971.png;> After https://cloud.githubusercontent.com/assets/4968473/25227904/37be8db8-2605-11e7-84cb-bc981d85d04d.png;> ### Questions: * Does the licenses files need update? * Is there breaking changes for older versions? * Does this needs documentation? You can merge this pull request into a Git repository by running: $ git pull https://github.com/1ambda/zeppelin MINOR/verbose-logging Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/2267.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2267 commit 7448e52ddcb76443f60c37961da503a719923cb2 Author: 1ambda <1am...@gmail.com> Date: 2017-04-20T11:05:10Z fix: Use console.log with JSON.parse --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2260: [ZEPPELIN-2408] Should use $uibTooltip instead of $too...
Github user 1ambda commented on the issue: https://github.com/apache/zeppelin/pull/2260 @soralee I just rebased. thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2262: [HOTFIX] Fix CI build failure on branch-0.6
Github user hammertank commented on the issue: https://github.com/apache/zeppelin/pull/2262 @jongyoul currently, our project is using zeppelin as a restful webservice to execute spark code. zeppelin-0.6.2 has got everything we need. Anyway, we'll consider to upgrade zeppelin in the next version of our own project. Thank you for your suggestion. :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2260: [ZEPPELIN-2408] Should use $uibTooltip instead of $too...
Github user soralee commented on the issue: https://github.com/apache/zeppelin/pull/2260 @1ambda could you rebase this PR? :slightly_smiling_face: --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #2239: Show dialog if owners field set to be empty on ...
GitHub user soralee reopened a pull request: https://github.com/apache/zeppelin/pull/2239 Show dialog if owners field set to be empty on shiro ### What is this PR for? This PR is for a showing dialog when note's permission set `Readers/Writers` but `Owners` is empty. Currently, after merged #849, if user set `Owners` is empty, it's automatically set as the current user. So, It would be better to show a dialog before `Owners` is fill with the current user because user might think it is not intended. Plus, if a user only set `Readers` role, all field(`Writers` and `Owners`) role is filled as the current user like below. It's not necessary to our because the `Owner` role can read and write note. ![not_need_wirters](https://cloud.githubusercontent.com/assets/8110458/24869746/2a77d2da-1e4f-11e7-86a5-794e1aac02d0.gif) ### What type of PR is it? [ Improvement ] ### What is the Jira issue? * [ZEPPELIN-2206; Be added a writer account when adding a reader account on Shiro](https://issues.apache.org/jira/browse/ZEPPELIN-2206) * [ZEPPELIN-2418; show dialog if user set to the empty owner permission](https://issues.apache.org/jira/browse/ZEPPELIN-2418) ### How should this be tested? 1. Turn on shiro. 2. Set permission `Writers` and `Readers` except `Owner` role. 3. Check the dialog appears ### Screenshots (if appropriate) [Before] * Set `Readers` and `Writers` except `Owners` ![zeppelin-2206_auto_shiro_b_1](https://cloud.githubusercontent.com/assets/8110458/24869964/cf382676-1e4f-11e7-8e95-30c149a4aba5.gif) * Set only 'Writers` ![zeppelin-2206_auto_shiro_b_2](https://cloud.githubusercontent.com/assets/8110458/24870112/3821f518-1e50-11e7-9310-fcafd4e26376.gif) * set only `Readers`; this screen is attached above. [After] * Set `Readers` and `Writers` except `Owners` ( Set only `Writers`; this result is same) ![zeppelin-2206_auto_shiro_a_1](https://cloud.githubusercontent.com/assets/8110458/24870781/61d8f1c0-1e52-11e7-8faa-38ff4fd64f6f.gif) * Set only 'Readers` ![zeppelin-2206_auto_shiro_a_2](https://cloud.githubusercontent.com/assets/8110458/24870811/76f547ca-1e52-11e7-98b2-f6a5541284ab.gif) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No You can merge this pull request into a Git repository by running: $ git pull https://github.com/soralee/zeppelin ZEPPELIN-2206_auto_shiro Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/2239.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2239 commit af4ff29be8a20f597670e7610305d5956243ac2e Author: soraleeDate: 2017-04-10T09:54:25Z rebase master and revert notebookRestApi commit 047029944014c606f25df6b0c3b4fe82a394caca Author: soralee Date: 2017-04-20T05:05:07Z modify title of dialogs commit 3913e00f07a3bfeae802043dcbb93857d6c6ab14 Author: soralee Date: 2017-04-20T06:05:59Z rebase notebook.controller commit 783fd948a4dc87d07fb581a957fb9933fb504542 Author: soralee Date: 2017-04-20T08:34:15Z add to check whitespace commit 5ed8b26c47859a01286f1dbf40b11008916a06dc Author: soralee Date: 2017-04-20T09:03:51Z add to check whitespace commit ea274830bbf0dd81389c99f20630565f3feefec4 Author: soralee Date: 2017-04-20T09:24:10Z add if statement for checking whitespace --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #2239: Show dialog if owners field set to be empty on ...
Github user soralee closed the pull request at: https://github.com/apache/zeppelin/pull/2239 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (ZEPPELIN-2431) Raise Exception when remove note in folder
CloverHearts created ZEPPELIN-2431: -- Summary: Raise Exception when remove note in folder Key: ZEPPELIN-2431 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2431 Project: Zeppelin Issue Type: Bug Reporter: CloverHearts Assignee: CloverHearts When remove note in folder, raise exception on zeppelin server ``` ERROR [2017-04-20 18:53:56,917] ({qtp1459672753-16} NotebookServer.java[onMessage]:357) - Can't handle message java.lang.NullPointerException at org.apache.zeppelin.interpreter.InterpreterSettingManager.removeInterpretersForNote(InterpreterSettingManager.java:806) at org.apache.zeppelin.interpreter.InterpreterSettingManager.removeNoteInterpreterSettingBinding(InterpreterSettingManager.java:895) at org.apache.zeppelin.notebook.Notebook.removeNote(Notebook.java:341) at org.apache.zeppelin.socket.NotebookServer.removeNote(NotebookServer.java:973) at org.apache.zeppelin.socket.NotebookServer.onMessage(NotebookServer.java:232) at org.apache.zeppelin.socket.NotebookSocket.onWebSocketText(NotebookSocket.java:59) at org.eclipse.jetty.websocket.common.events.JettyListenerEventDriver.onTextMessage(JettyListenerEventDriver.java:128) at org.eclipse.jetty.websocket.common.message.SimpleTextMessage.messageComplete(SimpleTextMessage.java:69) at org.eclipse.jetty.websocket.common.events.AbstractEventDriver.appendMessage(AbstractEventDriver.java:65) at org.eclipse.jetty.websocket.common.events.JettyListenerEventDriver.onTextFrame(JettyListenerEventDriver.java:122) at org.eclipse.jetty.websocket.common.events.AbstractEventDriver.incomingFrame(AbstractEventDriver.java:161) at org.eclipse.jetty.websocket.common.WebSocketSession.incomingFrame(WebSocketSession.java:309) at org.eclipse.jetty.websocket.common.extensions.ExtensionStack.incomingFrame(ExtensionStack.java:214) at org.eclipse.jetty.websocket.common.Parser.notifyFrame(Parser.java:220) at org.eclipse.jetty.websocket.common.Parser.parse(Parser.java:258) at org.eclipse.jetty.websocket.common.io.AbstractWebSocketConnection.readParse(AbstractWebSocketConnection.java:632) at org.eclipse.jetty.websocket.common.io.AbstractWebSocketConnection.onFillable(AbstractWebSocketConnection.java:480) at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:745) ``` -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2430) overlap in xLabel text of Line chart
Sora Lee created ZEPPELIN-2430: -- Summary: overlap in xLabel text of Line chart Key: ZEPPELIN-2430 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2430 Project: Zeppelin Issue Type: Improvement Reporter: Sora Lee Assignee: Sora Lee Attachments: screenshot-1.png -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[GitHub] zeppelin issue #2239: Show dialog if owners field set to be empty on shiro
Github user soralee commented on the issue: https://github.com/apache/zeppelin/pull/2239 I modified dialog title and `OK` button. I've checked the `whitespace` and the `$scope.permissions.owners` array don't insert `whitespace` originally. But for stability, I added `if statement`. @felixcheung, @1ambda could you guys review this again, please? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #2251: [ZEPPELIN-2403] added interpreter property type...
Github user tinkoff-dwh closed the pull request at: https://github.com/apache/zeppelin/pull/2251 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2262: [HOTFIX] Fix CI build failure on branch-0.6
Github user jongyoul commented on the issue: https://github.com/apache/zeppelin/pull/2262 Merging it if there's no more discussion --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2262: [HOTFIX] Fix CI build failure on branch-0.6
Github user jongyoul commented on the issue: https://github.com/apache/zeppelin/pull/2262 @hammertank Thanks for letting me know. LGTM for your changes. BTW, new version of Zeppelin has better features. Why don't you use it? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2229: [Zeppelin 2367] Hive JDBC proxy user option should be ...
Github user prabhjyotsingh commented on the issue: https://github.com/apache/zeppelin/pull/2229 Sure, got it, have renamed it to "appendProxyUserToURL". --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2239: Show dialog if owners field set to be empty on shiro
Github user soralee commented on the issue: https://github.com/apache/zeppelin/pull/2239 @1ambda Thanks for information always :+1: I already worked to rebase and run build successfully, but now, I'm checking the `white space` problem. Let me updated ASAP! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #2258: [ZEPPELIN-2096] Conserve class loader after run...
Github user asfgit closed the pull request at: https://github.com/apache/zeppelin/pull/2258 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2229: [Zeppelin 2367] Hive JDBC proxy user option should be ...
Github user felixcheung commented on the issue: https://github.com/apache/zeppelin/pull/2229 Perhaps generalize this to something non-Hive specific? Like a property for userStringToAppend? Add user to JDBC URL should be common place - seems like in this case we just like a way to change the name and value of the property to add on the JDBC URL. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2229: [Zeppelin 2367] Hive JDBC proxy user option should be ...
Github user prabhjyotsingh commented on the issue: https://github.com/apache/zeppelin/pull/2229 @felixcheung any specific change that you are looking for? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2239: Show dialog if owners field set to be empty on shiro
Github user 1ambda commented on the issue: https://github.com/apache/zeppelin/pull/2239 @soralee Since conflicts are about lint errors, you can simply rebase by 1. keeping your change and run `rebase --continue` 2. then, execute `eslint src --fix` in `zeppelin-web` dir. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin issue #2251: [ZEPPELIN-2403] added interpreter property types
Github user 1ambda commented on the issue: https://github.com/apache/zeppelin/pull/2251 @tinkoff-dwh Since conflicts are about lint errors, you can simply rebase by 1. keeping your change and run `rebase --continue` 2. then, execute `eslint src --fix` in `zeppelin-web` dir. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] zeppelin pull request #2247: [ZEPPELIN-2318][branch-0.7] Fix proxy configura...
Github user khalidhuseynov closed the pull request at: https://github.com/apache/zeppelin/pull/2247 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---