svn commit: r1852103 [19/30] - in /zeppelin/site/docs/0.8.1: ./ assets/themes/zeppelin/js/ development/ development/contribution/ development/helium/ interpreter/ quickstart/ setup/basics/ setup/deplo
Modified: zeppelin/site/docs/0.8.1/setup/deployment/yarn_install.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.1/setup/deployment/yarn_install.html?rev=1852103=1852102=1852103=diff == --- zeppelin/site/docs/0.8.1/setup/deployment/yarn_install.html (original) +++ zeppelin/site/docs/0.8.1/setup/deployment/yarn_install.html Fri Jan 25 09:53:09 2019 @@ -18,9 +18,9 @@ - - - + + + https://code.jquery.com/jquery-1.10.2.min.js"> - - - - - - + + + + + + - - + + @@ -56,10 +56,10 @@ http://zeppelin.apache.org;> - Zeppelin - 0.8.1 @@ -71,13 +71,13 @@ Quick Start Getting Started -Install -Explore UI -Tutorial - -Spark with Zeppelin -SQL with Zeppelin -Python with Zeppelin +Install +Explore UI +Tutorial + +Spark with Zeppelin +SQL with Zeppelin +Python with Zeppelin @@ -85,41 +85,41 @@ Usage Dynamic Form -What is Dynamic Form? +What is Dynamic Form? Display System -Text Display -HTML Display -Table Display -Network Display -Angular Display using Backend API -Angular Display using Frontend API +Text Display +HTML Display +Table Display +Network Display +Angular Display using Backend API +Angular Display using Frontend API Interpreter -Overview -Interpreter Binding Mode -User Impersonation -Dependency Management -Installing Interpreters - -Execution Hooks (Experimental) +Overview +Interpreter Binding Mode +User Impersonation +Dependency Management +Installing Interpreters + +Execution Hooks (Experimental) Other Features -Publishing Paragraphs -Personalized Mode -Customizing Zeppelin Homepage -Notebook Actions -Cron Scheduler -Zeppelin Context +Publishing Paragraphs +Personalized Mode +Customizing Zeppelin Homepage +Notebook Actions +Cron Scheduler +Zeppelin Context REST API -Interpreter API -Zeppelin Server API -Notebook API -Notebook Repository API -Configuration API -Credential API -Helium API +Interpreter API +Zeppelin Server API +Notebook API +Notebook Repository API +Configuration API +Credential API +Helium API @@ -127,37 +127,37 @@ Setup Basics -How to Build Zeppelin -Multi-user Support +How to Build Zeppelin +Multi-user Support Deployment - -Spark Cluster Mode: Standalone -Spark Cluster Mode: YARN -Spark Cluster Mode: Mesos -Zeppelin with Flink, Spark Cluster -Zeppelin on CDH -Zeppelin on VM: Vagrant +Docker Image for Zeppelin +Spark Cluster Mode: Standalone +Spark Cluster Mode: YARN +Spark Cluster Mode: Mesos +Zeppelin with Flink, Spark Cluster +Zeppelin on CDH +Zeppelin on VM: Vagrant Security -HTTP Basic Auth using NGINX -Shiro Authentication -Notebook Authorization -Data Source Authorization -HTTP Security Headers +HTTP Basic Auth using NGINX +Shiro Authentication +Notebook Authorization +
svn commit: r1852103 [23/30] - in /zeppelin/site/docs/0.8.1: ./ assets/themes/zeppelin/js/ development/ development/contribution/ development/helium/ interpreter/ quickstart/ setup/basics/ setup/deplo
Modified: zeppelin/site/docs/0.8.1/usage/display_system/angular_frontend.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.1/usage/display_system/angular_frontend.html?rev=1852103=1852102=1852103=diff == --- zeppelin/site/docs/0.8.1/usage/display_system/angular_frontend.html (original) +++ zeppelin/site/docs/0.8.1/usage/display_system/angular_frontend.html Fri Jan 25 09:53:09 2019 @@ -18,9 +18,9 @@ - - - + + + https://code.jquery.com/jquery-1.10.2.min.js"> - - - - - - + + + + + + - - + + @@ -56,10 +56,10 @@ http://zeppelin.apache.org;> - Zeppelin - 0.8.1 @@ -71,13 +71,13 @@ Quick Start Getting Started -Install -Explore UI -Tutorial - -Spark with Zeppelin -SQL with Zeppelin -Python with Zeppelin +Install +Explore UI +Tutorial + +Spark with Zeppelin +SQL with Zeppelin +Python with Zeppelin @@ -85,41 +85,41 @@ Usage Dynamic Form -What is Dynamic Form? +What is Dynamic Form? Display System -Text Display -HTML Display -Table Display -Network Display -Angular Display using Backend API -Angular Display using Frontend API +Text Display +HTML Display +Table Display +Network Display +Angular Display using Backend API +Angular Display using Frontend API Interpreter -Overview -Interpreter Binding Mode -User Impersonation -Dependency Management -Installing Interpreters - -Execution Hooks (Experimental) +Overview +Interpreter Binding Mode +User Impersonation +Dependency Management +Installing Interpreters + +Execution Hooks (Experimental) Other Features -Publishing Paragraphs -Personalized Mode -Customizing Zeppelin Homepage -Notebook Actions -Cron Scheduler -Zeppelin Context +Publishing Paragraphs +Personalized Mode +Customizing Zeppelin Homepage +Notebook Actions +Cron Scheduler +Zeppelin Context REST API -Interpreter API -Zeppelin Server API -Notebook API -Notebook Repository API -Configuration API -Credential API -Helium API +Interpreter API +Zeppelin Server API +Notebook API +Notebook Repository API +Configuration API +Credential API +Helium API @@ -127,37 +127,37 @@ Setup Basics -How to Build Zeppelin -Multi-user Support +How to Build Zeppelin +Multi-user Support Deployment - -Spark Cluster Mode: Standalone -Spark Cluster Mode: YARN -Spark Cluster Mode: Mesos -Zeppelin with Flink, Spark Cluster -Zeppelin on CDH -Zeppelin on VM: Vagrant +Docker Image for Zeppelin +Spark Cluster Mode: Standalone +Spark Cluster Mode: YARN +Spark Cluster Mode: Mesos +Zeppelin with Flink, Spark Cluster +Zeppelin on CDH +Zeppelin on VM: Vagrant Security -HTTP Basic Auth using NGINX -Shiro Authentication -Notebook Authorization -Data Source Authorization -HTTP Security Headers +HTTP Basic Auth using NGINX +Shiro Authentication +
svn commit: r1852103 [4/30] - in /zeppelin/site/docs/0.8.1: ./ assets/themes/zeppelin/js/ development/ development/contribution/ development/helium/ interpreter/ quickstart/ setup/basics/ setup/deploy
Modified: zeppelin/site/docs/0.8.1/index.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.1/index.html?rev=1852103=1852102=1852103=diff == --- zeppelin/site/docs/0.8.1/index.html (original) +++ zeppelin/site/docs/0.8.1/index.html Fri Jan 25 09:53:09 2019 @@ -18,9 +18,9 @@ - - - + + + https://code.jquery.com/jquery-1.10.2.min.js"> - - - - - - + + + + + + - - + + @@ -56,10 +56,10 @@ http://zeppelin.apache.org;> - Zeppelin - 0.8.1 @@ -71,13 +71,13 @@ Quick Start Getting Started -Install -Explore UI -Tutorial - -Spark with Zeppelin -SQL with Zeppelin -Python with Zeppelin +Install +Explore UI +Tutorial + +Spark with Zeppelin +SQL with Zeppelin +Python with Zeppelin @@ -85,41 +85,41 @@ Usage Dynamic Form -What is Dynamic Form? +What is Dynamic Form? Display System -Text Display -HTML Display -Table Display -Network Display -Angular Display using Backend API -Angular Display using Frontend API +Text Display +HTML Display +Table Display +Network Display +Angular Display using Backend API +Angular Display using Frontend API Interpreter -Overview -Interpreter Binding Mode -User Impersonation -Dependency Management -Installing Interpreters - -Execution Hooks (Experimental) +Overview +Interpreter Binding Mode +User Impersonation +Dependency Management +Installing Interpreters + +Execution Hooks (Experimental) Other Features -Publishing Paragraphs -Personalized Mode -Customizing Zeppelin Homepage -Notebook Actions -Cron Scheduler -Zeppelin Context +Publishing Paragraphs +Personalized Mode +Customizing Zeppelin Homepage +Notebook Actions +Cron Scheduler +Zeppelin Context REST API -Interpreter API -Zeppelin Server API -Notebook API -Notebook Repository API -Configuration API -Credential API -Helium API +Interpreter API +Zeppelin Server API +Notebook API +Notebook Repository API +Configuration API +Credential API +Helium API @@ -127,37 +127,37 @@ Setup Basics -How to Build Zeppelin -Multi-user Support +How to Build Zeppelin +Multi-user Support Deployment - -Spark Cluster Mode: Standalone -Spark Cluster Mode: YARN -Spark Cluster Mode: Mesos -Zeppelin with Flink, Spark Cluster -Zeppelin on CDH -Zeppelin on VM: Vagrant +Docker Image for Zeppelin +Spark Cluster Mode: Standalone +Spark Cluster Mode: YARN +Spark Cluster Mode: Mesos +Zeppelin with Flink, Spark Cluster +Zeppelin on CDH +Zeppelin on VM: Vagrant Security -HTTP Basic Auth using NGINX -Shiro Authentication -Notebook Authorization -Data Source Authorization -HTTP Security Headers +HTTP Basic Auth using NGINX +Shiro Authentication +Notebook Authorization +Data Source Authorization +HTTP Security Headers
svn commit: r1852103 [28/30] - in /zeppelin/site/docs/0.8.1: ./ assets/themes/zeppelin/js/ development/ development/contribution/ development/helium/ interpreter/ quickstart/ setup/basics/ setup/deplo
Modified: zeppelin/site/docs/0.8.1/usage/other_features/zeppelin_context.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.1/usage/other_features/zeppelin_context.html?rev=1852103=1852102=1852103=diff == --- zeppelin/site/docs/0.8.1/usage/other_features/zeppelin_context.html (original) +++ zeppelin/site/docs/0.8.1/usage/other_features/zeppelin_context.html Fri Jan 25 09:53:09 2019 @@ -18,9 +18,9 @@ - - - + + + https://code.jquery.com/jquery-1.10.2.min.js"> - - - - - - + + + + + + - - + + @@ -56,10 +56,10 @@ http://zeppelin.apache.org;> - Zeppelin - 0.8.1 @@ -71,13 +71,13 @@ Quick Start Getting Started -Install -Explore UI -Tutorial - -Spark with Zeppelin -SQL with Zeppelin -Python with Zeppelin +Install +Explore UI +Tutorial + +Spark with Zeppelin +SQL with Zeppelin +Python with Zeppelin @@ -85,41 +85,41 @@ Usage Dynamic Form -What is Dynamic Form? +What is Dynamic Form? Display System -Text Display -HTML Display -Table Display -Network Display -Angular Display using Backend API -Angular Display using Frontend API +Text Display +HTML Display +Table Display +Network Display +Angular Display using Backend API +Angular Display using Frontend API Interpreter -Overview -Interpreter Binding Mode -User Impersonation -Dependency Management -Installing Interpreters - -Execution Hooks (Experimental) +Overview +Interpreter Binding Mode +User Impersonation +Dependency Management +Installing Interpreters + +Execution Hooks (Experimental) Other Features -Publishing Paragraphs -Personalized Mode -Customizing Zeppelin Homepage -Notebook Actions -Cron Scheduler -Zeppelin Context +Publishing Paragraphs +Personalized Mode +Customizing Zeppelin Homepage +Notebook Actions +Cron Scheduler +Zeppelin Context REST API -Interpreter API -Zeppelin Server API -Notebook API -Notebook Repository API -Configuration API -Credential API -Helium API +Interpreter API +Zeppelin Server API +Notebook API +Notebook Repository API +Configuration API +Credential API +Helium API @@ -127,37 +127,37 @@ Setup Basics -How to Build Zeppelin -Multi-user Support +How to Build Zeppelin +Multi-user Support Deployment - -Spark Cluster Mode: Standalone -Spark Cluster Mode: YARN -Spark Cluster Mode: Mesos -Zeppelin with Flink, Spark Cluster -Zeppelin on CDH -Zeppelin on VM: Vagrant +Docker Image for Zeppelin +Spark Cluster Mode: Standalone +Spark Cluster Mode: YARN +Spark Cluster Mode: Mesos +Zeppelin with Flink, Spark Cluster +Zeppelin on CDH +Zeppelin on VM: Vagrant Security -HTTP Basic Auth using NGINX -Shiro Authentication -Notebook Authorization -Data Source Authorization -HTTP Security Headers +HTTP Basic Auth using NGINX +Shiro Authentication +
svn commit: r1852103 [26/30] - in /zeppelin/site/docs/0.8.1: ./ assets/themes/zeppelin/js/ development/ development/contribution/ development/helium/ interpreter/ quickstart/ setup/basics/ setup/deplo
Modified: zeppelin/site/docs/0.8.1/usage/interpreter/user_impersonation.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.1/usage/interpreter/user_impersonation.html?rev=1852103=1852102=1852103=diff == --- zeppelin/site/docs/0.8.1/usage/interpreter/user_impersonation.html (original) +++ zeppelin/site/docs/0.8.1/usage/interpreter/user_impersonation.html Fri Jan 25 09:53:09 2019 @@ -18,9 +18,9 @@ - - - + + + https://code.jquery.com/jquery-1.10.2.min.js"> - - - - - - + + + + + + - - + + @@ -56,10 +56,10 @@ http://zeppelin.apache.org;> - Zeppelin - 0.8.1 @@ -71,13 +71,13 @@ Quick Start Getting Started -Install -Explore UI -Tutorial - -Spark with Zeppelin -SQL with Zeppelin -Python with Zeppelin +Install +Explore UI +Tutorial + +Spark with Zeppelin +SQL with Zeppelin +Python with Zeppelin @@ -85,41 +85,41 @@ Usage Dynamic Form -What is Dynamic Form? +What is Dynamic Form? Display System -Text Display -HTML Display -Table Display -Network Display -Angular Display using Backend API -Angular Display using Frontend API +Text Display +HTML Display +Table Display +Network Display +Angular Display using Backend API +Angular Display using Frontend API Interpreter -Overview -Interpreter Binding Mode -User Impersonation -Dependency Management -Installing Interpreters - -Execution Hooks (Experimental) +Overview +Interpreter Binding Mode +User Impersonation +Dependency Management +Installing Interpreters + +Execution Hooks (Experimental) Other Features -Publishing Paragraphs -Personalized Mode -Customizing Zeppelin Homepage -Notebook Actions -Cron Scheduler -Zeppelin Context +Publishing Paragraphs +Personalized Mode +Customizing Zeppelin Homepage +Notebook Actions +Cron Scheduler +Zeppelin Context REST API -Interpreter API -Zeppelin Server API -Notebook API -Notebook Repository API -Configuration API -Credential API -Helium API +Interpreter API +Zeppelin Server API +Notebook API +Notebook Repository API +Configuration API +Credential API +Helium API @@ -127,37 +127,37 @@ Setup Basics -How to Build Zeppelin -Multi-user Support +How to Build Zeppelin +Multi-user Support Deployment - -Spark Cluster Mode: Standalone -Spark Cluster Mode: YARN -Spark Cluster Mode: Mesos -Zeppelin with Flink, Spark Cluster -Zeppelin on CDH -Zeppelin on VM: Vagrant +Docker Image for Zeppelin +Spark Cluster Mode: Standalone +Spark Cluster Mode: YARN +Spark Cluster Mode: Mesos +Zeppelin with Flink, Spark Cluster +Zeppelin on CDH +Zeppelin on VM: Vagrant Security -HTTP Basic Auth using NGINX -Shiro Authentication -Notebook Authorization -Data Source Authorization -HTTP Security Headers +HTTP Basic Auth using NGINX +Shiro Authentication +Notebook
svn commit: r1852103 [17/30] - in /zeppelin/site/docs/0.8.1: ./ assets/themes/zeppelin/js/ development/ development/contribution/ development/helium/ interpreter/ quickstart/ setup/basics/ setup/deplo
Modified: zeppelin/site/docs/0.8.1/setup/basics/multi_user_support.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.1/setup/basics/multi_user_support.html?rev=1852103=1852102=1852103=diff == --- zeppelin/site/docs/0.8.1/setup/basics/multi_user_support.html (original) +++ zeppelin/site/docs/0.8.1/setup/basics/multi_user_support.html Fri Jan 25 09:53:09 2019 @@ -18,9 +18,9 @@ - - - + + + https://code.jquery.com/jquery-1.10.2.min.js"> - - - - - - + + + + + + - - + + @@ -56,10 +56,10 @@ http://zeppelin.apache.org;> - Zeppelin - 0.8.1 @@ -71,13 +71,13 @@ Quick Start Getting Started -Install -Explore UI -Tutorial - -Spark with Zeppelin -SQL with Zeppelin -Python with Zeppelin +Install +Explore UI +Tutorial + +Spark with Zeppelin +SQL with Zeppelin +Python with Zeppelin @@ -85,41 +85,41 @@ Usage Dynamic Form -What is Dynamic Form? +What is Dynamic Form? Display System -Text Display -HTML Display -Table Display -Network Display -Angular Display using Backend API -Angular Display using Frontend API +Text Display +HTML Display +Table Display +Network Display +Angular Display using Backend API +Angular Display using Frontend API Interpreter -Overview -Interpreter Binding Mode -User Impersonation -Dependency Management -Installing Interpreters - -Execution Hooks (Experimental) +Overview +Interpreter Binding Mode +User Impersonation +Dependency Management +Installing Interpreters + +Execution Hooks (Experimental) Other Features -Publishing Paragraphs -Personalized Mode -Customizing Zeppelin Homepage -Notebook Actions -Cron Scheduler -Zeppelin Context +Publishing Paragraphs +Personalized Mode +Customizing Zeppelin Homepage +Notebook Actions +Cron Scheduler +Zeppelin Context REST API -Interpreter API -Zeppelin Server API -Notebook API -Notebook Repository API -Configuration API -Credential API -Helium API +Interpreter API +Zeppelin Server API +Notebook API +Notebook Repository API +Configuration API +Credential API +Helium API @@ -127,37 +127,37 @@ Setup Basics -How to Build Zeppelin -Multi-user Support +How to Build Zeppelin +Multi-user Support Deployment - -Spark Cluster Mode: Standalone -Spark Cluster Mode: YARN -Spark Cluster Mode: Mesos -Zeppelin with Flink, Spark Cluster -Zeppelin on CDH -Zeppelin on VM: Vagrant +Docker Image for Zeppelin +Spark Cluster Mode: Standalone +Spark Cluster Mode: YARN +Spark Cluster Mode: Mesos +Zeppelin with Flink, Spark Cluster +Zeppelin on CDH +Zeppelin on VM: Vagrant Security -HTTP Basic Auth using NGINX -Shiro Authentication -Notebook Authorization -Data Source Authorization -HTTP Security Headers +HTTP Basic Auth using NGINX +Shiro Authentication +Notebook Authorization +
svn commit: r1852103 [10/30] - in /zeppelin/site/docs/0.8.1: ./ assets/themes/zeppelin/js/ development/ development/contribution/ development/helium/ interpreter/ quickstart/ setup/basics/ setup/deplo
Modified: zeppelin/site/docs/0.8.1/interpreter/markdown.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.1/interpreter/markdown.html?rev=1852103=1852102=1852103=diff == --- zeppelin/site/docs/0.8.1/interpreter/markdown.html (original) +++ zeppelin/site/docs/0.8.1/interpreter/markdown.html Fri Jan 25 09:53:09 2019 @@ -18,9 +18,9 @@ - - - + + + https://code.jquery.com/jquery-1.10.2.min.js"> - - - - - - + + + + + + - - + + @@ -56,10 +56,10 @@ http://zeppelin.apache.org;> - Zeppelin - 0.8.1 @@ -71,13 +71,13 @@ Quick Start Getting Started -Install -Explore UI -Tutorial - -Spark with Zeppelin -SQL with Zeppelin -Python with Zeppelin +Install +Explore UI +Tutorial + +Spark with Zeppelin +SQL with Zeppelin +Python with Zeppelin @@ -85,41 +85,41 @@ Usage Dynamic Form -What is Dynamic Form? +What is Dynamic Form? Display System -Text Display -HTML Display -Table Display -Network Display -Angular Display using Backend API -Angular Display using Frontend API +Text Display +HTML Display +Table Display +Network Display +Angular Display using Backend API +Angular Display using Frontend API Interpreter -Overview -Interpreter Binding Mode -User Impersonation -Dependency Management -Installing Interpreters - -Execution Hooks (Experimental) +Overview +Interpreter Binding Mode +User Impersonation +Dependency Management +Installing Interpreters + +Execution Hooks (Experimental) Other Features -Publishing Paragraphs -Personalized Mode -Customizing Zeppelin Homepage -Notebook Actions -Cron Scheduler -Zeppelin Context +Publishing Paragraphs +Personalized Mode +Customizing Zeppelin Homepage +Notebook Actions +Cron Scheduler +Zeppelin Context REST API -Interpreter API -Zeppelin Server API -Notebook API -Notebook Repository API -Configuration API -Credential API -Helium API +Interpreter API +Zeppelin Server API +Notebook API +Notebook Repository API +Configuration API +Credential API +Helium API @@ -127,37 +127,37 @@ Setup Basics -How to Build Zeppelin -Multi-user Support +How to Build Zeppelin +Multi-user Support Deployment - -Spark Cluster Mode: Standalone -Spark Cluster Mode: YARN -Spark Cluster Mode: Mesos -Zeppelin with Flink, Spark Cluster -Zeppelin on CDH -Zeppelin on VM: Vagrant +Docker Image for Zeppelin +Spark Cluster Mode: Standalone +Spark Cluster Mode: YARN +Spark Cluster Mode: Mesos +Zeppelin with Flink, Spark Cluster +Zeppelin on CDH +Zeppelin on VM: Vagrant Security -HTTP Basic Auth using NGINX -Shiro Authentication -Notebook Authorization -Data Source Authorization -HTTP Security Headers +HTTP Basic Auth using NGINX +Shiro Authentication +Notebook Authorization +Data Source Authorization +
svn commit: r1852103 [6/30] - in /zeppelin/site/docs/0.8.1: ./ assets/themes/zeppelin/js/ development/ development/contribution/ development/helium/ interpreter/ quickstart/ setup/basics/ setup/deploy
Modified: zeppelin/site/docs/0.8.1/interpreter/flink.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.1/interpreter/flink.html?rev=1852103=1852102=1852103=diff == --- zeppelin/site/docs/0.8.1/interpreter/flink.html (original) +++ zeppelin/site/docs/0.8.1/interpreter/flink.html Fri Jan 25 09:53:09 2019 @@ -18,9 +18,9 @@ - - - + + + https://code.jquery.com/jquery-1.10.2.min.js"> - - - - - - + + + + + + - - + + @@ -56,10 +56,10 @@ http://zeppelin.apache.org;> - Zeppelin - 0.8.1 @@ -71,13 +71,13 @@ Quick Start Getting Started -Install -Explore UI -Tutorial - -Spark with Zeppelin -SQL with Zeppelin -Python with Zeppelin +Install +Explore UI +Tutorial + +Spark with Zeppelin +SQL with Zeppelin +Python with Zeppelin @@ -85,41 +85,41 @@ Usage Dynamic Form -What is Dynamic Form? +What is Dynamic Form? Display System -Text Display -HTML Display -Table Display -Network Display -Angular Display using Backend API -Angular Display using Frontend API +Text Display +HTML Display +Table Display +Network Display +Angular Display using Backend API +Angular Display using Frontend API Interpreter -Overview -Interpreter Binding Mode -User Impersonation -Dependency Management -Installing Interpreters - -Execution Hooks (Experimental) +Overview +Interpreter Binding Mode +User Impersonation +Dependency Management +Installing Interpreters + +Execution Hooks (Experimental) Other Features -Publishing Paragraphs -Personalized Mode -Customizing Zeppelin Homepage -Notebook Actions -Cron Scheduler -Zeppelin Context +Publishing Paragraphs +Personalized Mode +Customizing Zeppelin Homepage +Notebook Actions +Cron Scheduler +Zeppelin Context REST API -Interpreter API -Zeppelin Server API -Notebook API -Notebook Repository API -Configuration API -Credential API -Helium API +Interpreter API +Zeppelin Server API +Notebook API +Notebook Repository API +Configuration API +Credential API +Helium API @@ -127,37 +127,37 @@ Setup Basics -How to Build Zeppelin -Multi-user Support +How to Build Zeppelin +Multi-user Support Deployment - -Spark Cluster Mode: Standalone -Spark Cluster Mode: YARN -Spark Cluster Mode: Mesos -Zeppelin with Flink, Spark Cluster -Zeppelin on CDH -Zeppelin on VM: Vagrant +Docker Image for Zeppelin +Spark Cluster Mode: Standalone +Spark Cluster Mode: YARN +Spark Cluster Mode: Mesos +Zeppelin with Flink, Spark Cluster +Zeppelin on CDH +Zeppelin on VM: Vagrant Security -HTTP Basic Auth using NGINX -Shiro Authentication -Notebook Authorization -Data Source Authorization -HTTP Security Headers +HTTP Basic Auth using NGINX +Shiro Authentication +Notebook Authorization +Data Source Authorization +
svn commit: r1852103 [7/30] - in /zeppelin/site/docs/0.8.1: ./ assets/themes/zeppelin/js/ development/ development/contribution/ development/helium/ interpreter/ quickstart/ setup/basics/ setup/deploy
Modified: zeppelin/site/docs/0.8.1/interpreter/hbase.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.1/interpreter/hbase.html?rev=1852103=1852102=1852103=diff == --- zeppelin/site/docs/0.8.1/interpreter/hbase.html (original) +++ zeppelin/site/docs/0.8.1/interpreter/hbase.html Fri Jan 25 09:53:09 2019 @@ -18,9 +18,9 @@ - - - + + + https://code.jquery.com/jquery-1.10.2.min.js"> - - - - - - + + + + + + - - + + @@ -56,10 +56,10 @@ http://zeppelin.apache.org;> - Zeppelin - 0.8.1 @@ -71,13 +71,13 @@ Quick Start Getting Started -Install -Explore UI -Tutorial - -Spark with Zeppelin -SQL with Zeppelin -Python with Zeppelin +Install +Explore UI +Tutorial + +Spark with Zeppelin +SQL with Zeppelin +Python with Zeppelin @@ -85,41 +85,41 @@ Usage Dynamic Form -What is Dynamic Form? +What is Dynamic Form? Display System -Text Display -HTML Display -Table Display -Network Display -Angular Display using Backend API -Angular Display using Frontend API +Text Display +HTML Display +Table Display +Network Display +Angular Display using Backend API +Angular Display using Frontend API Interpreter -Overview -Interpreter Binding Mode -User Impersonation -Dependency Management -Installing Interpreters - -Execution Hooks (Experimental) +Overview +Interpreter Binding Mode +User Impersonation +Dependency Management +Installing Interpreters + +Execution Hooks (Experimental) Other Features -Publishing Paragraphs -Personalized Mode -Customizing Zeppelin Homepage -Notebook Actions -Cron Scheduler -Zeppelin Context +Publishing Paragraphs +Personalized Mode +Customizing Zeppelin Homepage +Notebook Actions +Cron Scheduler +Zeppelin Context REST API -Interpreter API -Zeppelin Server API -Notebook API -Notebook Repository API -Configuration API -Credential API -Helium API +Interpreter API +Zeppelin Server API +Notebook API +Notebook Repository API +Configuration API +Credential API +Helium API @@ -127,37 +127,37 @@ Setup Basics -How to Build Zeppelin -Multi-user Support +How to Build Zeppelin +Multi-user Support Deployment - -Spark Cluster Mode: Standalone -Spark Cluster Mode: YARN -Spark Cluster Mode: Mesos -Zeppelin with Flink, Spark Cluster -Zeppelin on CDH -Zeppelin on VM: Vagrant +Docker Image for Zeppelin +Spark Cluster Mode: Standalone +Spark Cluster Mode: YARN +Spark Cluster Mode: Mesos +Zeppelin with Flink, Spark Cluster +Zeppelin on CDH +Zeppelin on VM: Vagrant Security -HTTP Basic Auth using NGINX -Shiro Authentication -Notebook Authorization -Data Source Authorization -HTTP Security Headers +HTTP Basic Auth using NGINX +Shiro Authentication +Notebook Authorization +Data Source Authorization +
svn commit: r1852103 [3/30] - in /zeppelin/site/docs/0.8.1: ./ assets/themes/zeppelin/js/ development/ development/contribution/ development/helium/ interpreter/ quickstart/ setup/basics/ setup/deploy
Modified: zeppelin/site/docs/0.8.1/development/helium/writing_visualization_basic.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.1/development/helium/writing_visualization_basic.html?rev=1852103=1852102=1852103=diff == --- zeppelin/site/docs/0.8.1/development/helium/writing_visualization_basic.html (original) +++ zeppelin/site/docs/0.8.1/development/helium/writing_visualization_basic.html Fri Jan 25 09:53:09 2019 @@ -18,9 +18,9 @@ - - - + + + https://code.jquery.com/jquery-1.10.2.min.js"> - - - - - - + + + + + + - - + + @@ -56,10 +56,10 @@ http://zeppelin.apache.org;> - Zeppelin - 0.8.1 @@ -71,13 +71,13 @@ Quick Start Getting Started -Install -Explore UI -Tutorial - -Spark with Zeppelin -SQL with Zeppelin -Python with Zeppelin +Install +Explore UI +Tutorial + +Spark with Zeppelin +SQL with Zeppelin +Python with Zeppelin @@ -85,41 +85,41 @@ Usage Dynamic Form -What is Dynamic Form? +What is Dynamic Form? Display System -Text Display -HTML Display -Table Display -Network Display -Angular Display using Backend API -Angular Display using Frontend API +Text Display +HTML Display +Table Display +Network Display +Angular Display using Backend API +Angular Display using Frontend API Interpreter -Overview -Interpreter Binding Mode -User Impersonation -Dependency Management -Installing Interpreters - -Execution Hooks (Experimental) +Overview +Interpreter Binding Mode +User Impersonation +Dependency Management +Installing Interpreters + +Execution Hooks (Experimental) Other Features -Publishing Paragraphs -Personalized Mode -Customizing Zeppelin Homepage -Notebook Actions -Cron Scheduler -Zeppelin Context +Publishing Paragraphs +Personalized Mode +Customizing Zeppelin Homepage +Notebook Actions +Cron Scheduler +Zeppelin Context REST API -Interpreter API -Zeppelin Server API -Notebook API -Notebook Repository API -Configuration API -Credential API -Helium API +Interpreter API +Zeppelin Server API +Notebook API +Notebook Repository API +Configuration API +Credential API +Helium API @@ -127,37 +127,37 @@ Setup Basics -How to Build Zeppelin -Multi-user Support +How to Build Zeppelin +Multi-user Support Deployment - -Spark Cluster Mode: Standalone -Spark Cluster Mode: YARN -Spark Cluster Mode: Mesos -Zeppelin with Flink, Spark Cluster -Zeppelin on CDH -Zeppelin on VM: Vagrant +Docker Image for Zeppelin +Spark Cluster Mode: Standalone +Spark Cluster Mode: YARN +Spark Cluster Mode: Mesos +Zeppelin with Flink, Spark Cluster +Zeppelin on CDH +Zeppelin on VM: Vagrant Security -HTTP Basic Auth using NGINX -Shiro Authentication -Notebook Authorization -Data Source Authorization -HTTP Security Headers +HTTP Basic Auth using NGINX +Shiro
svn commit: r1852103 [12/30] - in /zeppelin/site/docs/0.8.1: ./ assets/themes/zeppelin/js/ development/ development/contribution/ development/helium/ interpreter/ quickstart/ setup/basics/ setup/deplo
Modified: zeppelin/site/docs/0.8.1/interpreter/sap.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.1/interpreter/sap.html?rev=1852103=1852102=1852103=diff == --- zeppelin/site/docs/0.8.1/interpreter/sap.html (original) +++ zeppelin/site/docs/0.8.1/interpreter/sap.html Fri Jan 25 09:53:09 2019 @@ -18,9 +18,9 @@ - - - + + + https://code.jquery.com/jquery-1.10.2.min.js"> - - - - - - + + + + + + - - + + @@ -56,10 +56,10 @@ http://zeppelin.apache.org;> - Zeppelin - 0.8.1 @@ -71,13 +71,13 @@ Quick Start Getting Started -Install -Explore UI -Tutorial - -Spark with Zeppelin -SQL with Zeppelin -Python with Zeppelin +Install +Explore UI +Tutorial + +Spark with Zeppelin +SQL with Zeppelin +Python with Zeppelin @@ -85,41 +85,41 @@ Usage Dynamic Form -What is Dynamic Form? +What is Dynamic Form? Display System -Text Display -HTML Display -Table Display -Network Display -Angular Display using Backend API -Angular Display using Frontend API +Text Display +HTML Display +Table Display +Network Display +Angular Display using Backend API +Angular Display using Frontend API Interpreter -Overview -Interpreter Binding Mode -User Impersonation -Dependency Management -Installing Interpreters - -Execution Hooks (Experimental) +Overview +Interpreter Binding Mode +User Impersonation +Dependency Management +Installing Interpreters + +Execution Hooks (Experimental) Other Features -Publishing Paragraphs -Personalized Mode -Customizing Zeppelin Homepage -Notebook Actions -Cron Scheduler -Zeppelin Context +Publishing Paragraphs +Personalized Mode +Customizing Zeppelin Homepage +Notebook Actions +Cron Scheduler +Zeppelin Context REST API -Interpreter API -Zeppelin Server API -Notebook API -Notebook Repository API -Configuration API -Credential API -Helium API +Interpreter API +Zeppelin Server API +Notebook API +Notebook Repository API +Configuration API +Credential API +Helium API @@ -127,37 +127,37 @@ Setup Basics -How to Build Zeppelin -Multi-user Support +How to Build Zeppelin +Multi-user Support Deployment - -Spark Cluster Mode: Standalone -Spark Cluster Mode: YARN -Spark Cluster Mode: Mesos -Zeppelin with Flink, Spark Cluster -Zeppelin on CDH -Zeppelin on VM: Vagrant +Docker Image for Zeppelin +Spark Cluster Mode: Standalone +Spark Cluster Mode: YARN +Spark Cluster Mode: Mesos +Zeppelin with Flink, Spark Cluster +Zeppelin on CDH +Zeppelin on VM: Vagrant Security -HTTP Basic Auth using NGINX -Shiro Authentication -Notebook Authorization -Data Source Authorization -HTTP Security Headers +HTTP Basic Auth using NGINX +Shiro Authentication +Notebook Authorization +Data Source Authorization +HTTP
svn commit: r1852103 [21/30] - in /zeppelin/site/docs/0.8.1: ./ assets/themes/zeppelin/js/ development/ development/contribution/ development/helium/ interpreter/ quickstart/ setup/basics/ setup/deplo
Modified: zeppelin/site/docs/0.8.1/setup/security/datasource_authorization.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.1/setup/security/datasource_authorization.html?rev=1852103=1852102=1852103=diff == --- zeppelin/site/docs/0.8.1/setup/security/datasource_authorization.html (original) +++ zeppelin/site/docs/0.8.1/setup/security/datasource_authorization.html Fri Jan 25 09:53:09 2019 @@ -18,9 +18,9 @@ - - - + + + https://code.jquery.com/jquery-1.10.2.min.js"> - - - - - - + + + + + + - - + + @@ -56,10 +56,10 @@ http://zeppelin.apache.org;> - Zeppelin - 0.8.1 @@ -71,13 +71,13 @@ Quick Start Getting Started -Install -Explore UI -Tutorial - -Spark with Zeppelin -SQL with Zeppelin -Python with Zeppelin +Install +Explore UI +Tutorial + +Spark with Zeppelin +SQL with Zeppelin +Python with Zeppelin @@ -85,41 +85,41 @@ Usage Dynamic Form -What is Dynamic Form? +What is Dynamic Form? Display System -Text Display -HTML Display -Table Display -Network Display -Angular Display using Backend API -Angular Display using Frontend API +Text Display +HTML Display +Table Display +Network Display +Angular Display using Backend API +Angular Display using Frontend API Interpreter -Overview -Interpreter Binding Mode -User Impersonation -Dependency Management -Installing Interpreters - -Execution Hooks (Experimental) +Overview +Interpreter Binding Mode +User Impersonation +Dependency Management +Installing Interpreters + +Execution Hooks (Experimental) Other Features -Publishing Paragraphs -Personalized Mode -Customizing Zeppelin Homepage -Notebook Actions -Cron Scheduler -Zeppelin Context +Publishing Paragraphs +Personalized Mode +Customizing Zeppelin Homepage +Notebook Actions +Cron Scheduler +Zeppelin Context REST API -Interpreter API -Zeppelin Server API -Notebook API -Notebook Repository API -Configuration API -Credential API -Helium API +Interpreter API +Zeppelin Server API +Notebook API +Notebook Repository API +Configuration API +Credential API +Helium API @@ -127,37 +127,37 @@ Setup Basics -How to Build Zeppelin -Multi-user Support +How to Build Zeppelin +Multi-user Support Deployment - -Spark Cluster Mode: Standalone -Spark Cluster Mode: YARN -Spark Cluster Mode: Mesos -Zeppelin with Flink, Spark Cluster -Zeppelin on CDH -Zeppelin on VM: Vagrant +Docker Image for Zeppelin +Spark Cluster Mode: Standalone +Spark Cluster Mode: YARN +Spark Cluster Mode: Mesos +Zeppelin with Flink, Spark Cluster +Zeppelin on CDH +Zeppelin on VM: Vagrant Security -HTTP Basic Auth using NGINX -Shiro Authentication -Notebook Authorization -Data Source Authorization -HTTP Security Headers +HTTP Basic Auth using NGINX +Shiro Authentication +
svn commit: r1852103 [27/30] - in /zeppelin/site/docs/0.8.1: ./ assets/themes/zeppelin/js/ development/ development/contribution/ development/helium/ interpreter/ quickstart/ setup/basics/ setup/deplo
Modified: zeppelin/site/docs/0.8.1/usage/other_features/notebook_actions.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.1/usage/other_features/notebook_actions.html?rev=1852103=1852102=1852103=diff == --- zeppelin/site/docs/0.8.1/usage/other_features/notebook_actions.html (original) +++ zeppelin/site/docs/0.8.1/usage/other_features/notebook_actions.html Fri Jan 25 09:53:09 2019 @@ -18,9 +18,9 @@ - - - + + + https://code.jquery.com/jquery-1.10.2.min.js"> - - - - - - + + + + + + - - + + @@ -56,10 +56,10 @@ http://zeppelin.apache.org;> - Zeppelin - 0.8.1 @@ -71,13 +71,13 @@ Quick Start Getting Started -Install -Explore UI -Tutorial - -Spark with Zeppelin -SQL with Zeppelin -Python with Zeppelin +Install +Explore UI +Tutorial + +Spark with Zeppelin +SQL with Zeppelin +Python with Zeppelin @@ -85,41 +85,41 @@ Usage Dynamic Form -What is Dynamic Form? +What is Dynamic Form? Display System -Text Display -HTML Display -Table Display -Network Display -Angular Display using Backend API -Angular Display using Frontend API +Text Display +HTML Display +Table Display +Network Display +Angular Display using Backend API +Angular Display using Frontend API Interpreter -Overview -Interpreter Binding Mode -User Impersonation -Dependency Management -Installing Interpreters - -Execution Hooks (Experimental) +Overview +Interpreter Binding Mode +User Impersonation +Dependency Management +Installing Interpreters + +Execution Hooks (Experimental) Other Features -Publishing Paragraphs -Personalized Mode -Customizing Zeppelin Homepage -Notebook Actions -Cron Scheduler -Zeppelin Context +Publishing Paragraphs +Personalized Mode +Customizing Zeppelin Homepage +Notebook Actions +Cron Scheduler +Zeppelin Context REST API -Interpreter API -Zeppelin Server API -Notebook API -Notebook Repository API -Configuration API -Credential API -Helium API +Interpreter API +Zeppelin Server API +Notebook API +Notebook Repository API +Configuration API +Credential API +Helium API @@ -127,37 +127,37 @@ Setup Basics -How to Build Zeppelin -Multi-user Support +How to Build Zeppelin +Multi-user Support Deployment - -Spark Cluster Mode: Standalone -Spark Cluster Mode: YARN -Spark Cluster Mode: Mesos -Zeppelin with Flink, Spark Cluster -Zeppelin on CDH -Zeppelin on VM: Vagrant +Docker Image for Zeppelin +Spark Cluster Mode: Standalone +Spark Cluster Mode: YARN +Spark Cluster Mode: Mesos +Zeppelin with Flink, Spark Cluster +Zeppelin on CDH +Zeppelin on VM: Vagrant Security -HTTP Basic Auth using NGINX -Shiro Authentication -Notebook Authorization -Data Source Authorization -HTTP Security Headers +HTTP Basic Auth using NGINX +Shiro Authentication +
svn commit: r32110 - /release/zeppelin/zeppelin-0.8.1/
Author: zjffdu Date: Thu Jan 24 02:54:15 2019 New Revision: 32110 Log: Fix the zeppelin 0.8.1 checksum and signature Added: release/zeppelin/zeppelin-0.8.1/zeppelin-0.8.1-bin-all.tgz.asc release/zeppelin/zeppelin-0.8.1/zeppelin-0.8.1-bin-netinst.tgz.asc release/zeppelin/zeppelin-0.8.1/zeppelin-0.8.1.tgz.asc Removed: release/zeppelin/zeppelin-0.8.1/zeppelin-0.8.1-bin-all.tgz.md5 release/zeppelin/zeppelin-0.8.1/zeppelin-0.8.1-bin-netinst.tgz.md5 release/zeppelin/zeppelin-0.8.1/zeppelin-0.8.1.tgz.md5 Modified: release/zeppelin/zeppelin-0.8.1/zeppelin-0.8.1.tgz.sha512 Added: release/zeppelin/zeppelin-0.8.1/zeppelin-0.8.1-bin-all.tgz.asc == --- release/zeppelin/zeppelin-0.8.1/zeppelin-0.8.1-bin-all.tgz.asc (added) +++ release/zeppelin/zeppelin-0.8.1/zeppelin-0.8.1-bin-all.tgz.asc Thu Jan 24 02:54:15 2019 @@ -0,0 +1,11 @@ +-BEGIN PGP SIGNATURE- + +iQEzBAABCAAdFiEEdTXmZcpVPVDZ75cHZw1zOzU3qiUFAlxJJqYACgkQZw1zOzU3 +qiXQzAf+Pq988vvKebwJPuC4e2U1GJ+byZs+nxfwdhxbN31RvBwJLbmflUFDq12u +4EsDpzWRi+zNUNzEgOJqvqIqjwKcB2+WG244oUXVHmvufsCNFm5p8HiAXQFhbEga +fvKMed1J7Vv9A+1/xn+dibOUF8DAAf0orZfHMWCH5UCy0sf9oEySGzJ7nIJ+aM2O +/oUMVR7P9wM6sctGTU0pBuKJqeMXB7OUcRH1LGDEdMDqCPK9Ze3h9kGGzATf4n0h +lil2TLrQNWm8VfolrlWjhDjvzs49/6EUqY+iJvcxsUhWEd66RxsY0yOGSBto5tvT +lrQm1++122orTv2SBG4TdCfQvklNiQ== +=tErz +-END PGP SIGNATURE- Added: release/zeppelin/zeppelin-0.8.1/zeppelin-0.8.1-bin-netinst.tgz.asc == --- release/zeppelin/zeppelin-0.8.1/zeppelin-0.8.1-bin-netinst.tgz.asc (added) +++ release/zeppelin/zeppelin-0.8.1/zeppelin-0.8.1-bin-netinst.tgz.asc Thu Jan 24 02:54:15 2019 @@ -0,0 +1,11 @@ +-BEGIN PGP SIGNATURE- + +iQEzBAABCAAdFiEEdTXmZcpVPVDZ75cHZw1zOzU3qiUFAlxJJrkACgkQZw1zOzU3 +qiUqtQf+L8JKRc0Gxf9KTrYlUnDsVx0L2W91/z0yXNF+BsYhqj8tcmArq8r3xYax +3d5Gku0VtVV9BQUJYMY3SZzfjrUBwF60o7vNevSB35zhVEkEbOH00b8vEEHIxktp +bZ1d+pad2SZA9+5hA/eg6CrKIGUIsCaGO/FzwQYGJS6UWCvHsapYpkSjghWAuPge +2NsMLGtklkCNplBviDFd+X2vju8QB4sWyBxZup+RRSjocRvJyrvPLQ8saR/sO3ak +ZxO1l0TDe4DVnx3xJW7lk7kRkd+coTupS++LETCArGlPWcfqGTnKVubS8b/K9quZ +k6IKA3vxug1S90p4Nx+Im6dLooo5OQ== +=++Ef +-END PGP SIGNATURE- Added: release/zeppelin/zeppelin-0.8.1/zeppelin-0.8.1.tgz.asc == --- release/zeppelin/zeppelin-0.8.1/zeppelin-0.8.1.tgz.asc (added) +++ release/zeppelin/zeppelin-0.8.1/zeppelin-0.8.1.tgz.asc Thu Jan 24 02:54:15 2019 @@ -0,0 +1,11 @@ +-BEGIN PGP SIGNATURE- + +iQEzBAABCAAdFiEEdTXmZcpVPVDZ75cHZw1zOzU3qiUFAlxJJkAACgkQZw1zOzU3 +qiVSEgf9H010ysm2U9CgODBwAU9afdYzk6qYk1GtFx6tsO/SenX1QLHqwCBOw8TB +MHFPap6DntpPi7J30v6aWa2PIta3+l48B7rZvwOwzOBjGoWR922/e6oZH8XAJCGh +waSakcBUTVyW3TRI8juQ5s8IW+iexaCgXjmwOu13NPJA0t+rgmgcIF4J1qQj5Cyn +nOlDsyL4yv5ODAO8IhppxuqPgWB4FT9ON1oddTCiO7GHfY8De7eWa/YyXEpmiKI+ +vLeJQRQlRgvlJUI1HMjMs3xMSCxhta5HtPPqWv7PDerEZNAgX++3xNFxyxa8RqFT +ymYqMlfO7y1e7TG73Y8MyxYON8FElQ== +=Lxfx +-END PGP SIGNATURE- Modified: release/zeppelin/zeppelin-0.8.1/zeppelin-0.8.1.tgz.sha512 == --- release/zeppelin/zeppelin-0.8.1/zeppelin-0.8.1.tgz.sha512 (original) +++ release/zeppelin/zeppelin-0.8.1/zeppelin-0.8.1.tgz.sha512 Thu Jan 24 02:54:15 2019 @@ -0,0 +1 @@ +f6ade1369eb862b9b662ca4f045d3419391f157291a441bfe722c2fe36be2cffeb7bb92fe2743ff37d59e370030da9b8ba4efb50c6821a95a09c2a670a6d5feb zeppelin-0.8.1.tgz
svn commit: r1851991 - /zeppelin/site/releases/zeppelin-release-0.8.1.html
Author: zjffdu Date: Thu Jan 24 03:03:33 2019 New Revision: 1851991 URL: http://svn.apache.org/viewvc?rev=1851991=rev Log: Add release note of Zeppelin 0.8.1 Added: zeppelin/site/releases/zeppelin-release-0.8.1.html Added: zeppelin/site/releases/zeppelin-release-0.8.1.html URL: http://svn.apache.org/viewvc/zeppelin/site/releases/zeppelin-release-0.8.1.html?rev=1851991=auto == --- zeppelin/site/releases/zeppelin-release-0.8.1.html (added) +++ zeppelin/site/releases/zeppelin-release-0.8.1.html Thu Jan 24 03:03:33 2019 @@ -0,0 +1,226 @@ + + + + + + +Apache Zeppelin Release 0.8.1 + + + + + + + + + + +https://maxcdn.bootstrapcdn.com/font-awesome/4.7.0/css/font-awesome.min.css; rel="stylesheet" integrity="sha384-wvfXpqpZZVQGK6TAh5PVlGOfQNHSoD2xbE+QkPxCAFlNEevoEH3Sl0sibVcOQVnN" crossorigin="anonymous"> +https://fonts.googleapis.com/icon?family=Material+Icons;> + + + + + + + + + + + + + + +https://code.jquery.com/jquery-1.10.2.min.js"</a>;> +https://ajax.googleapis.com/ajax/libs/angularjs/1.3.15/angular.min.js"</a>;> +https://s3.amazonaws.com/helium-package/helium.js"</a>;> +https://s3.amazonaws.com/apache-zeppelin/post/medium.js"</a>;> +https://angular-ui.github.io/bootstrap/ui-bootstrap-tpls-2.5.0.js"</a>;> + + + + + + + + + + + + + + + + + + +Toggle navigation + + + + + + + Apache Zeppelin + + + + +Quick Start + + + Download + +Download Zeppelin +Supported Interpreters + + + + + Docs + +Release +0.8.1 +0.8.0 +0.7.3 +0.7.2 +0.6.2 +0.6.1 +Older Versions + + Snapshot(development) +0.9.0-SNAPSHOT + + + +Helium + + + Community + +Contributors +https://github.com/apache/zeppelin;>GitHub + + + + + Apache + +http://www.apache.org/foundation/how-it-works.html;>Apache Software Foundation +http://www.apache.org/licenses/;>Apache License +http://www.apache.org/foundation/sponsorship.html;>Sponsorship +Assets +http://www.apache.org/foundation/thanks.html;>Thanks + + + + + + + + + + + + + + + + + + + +Apache Zeppelin Release 0.8.1 + +The Apache Zeppelin community is pleased to announce the availability of the 0.8.1 release. + +The community put significant effort into improving Apache Zeppelin since the last release. +46 patches for improvements and bug fixes. + +We encourage to download the latest release. Feedback through the mailing lists is very welcome. + + +You can visit https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12343240styleName=projectId=12316221;>issue tracker for full list of issues that are resolved. + + + +Contributors + +This release would not be possible without the following community members contributions: + +Jeff Zhang +oxygen311 +Prabhjyot Singh +egorklimov +Jongyoul Lee +Khalid Huseynov +Savalek +Supreeth Sharma +avner +fdai +hyukjinkwon +mebelousov +Alex Bush +åæå +Jaehoon Jeong +John Lau +Lee moon soo +Maxim Belousov +Patrice Clement + + + + + + + + + + + + + + (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){ + (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o), + m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m) + })(window,document,'script','//www.google-analytics.com/analytics.js','ga'); + + ga('create', 'UA-45176241-5', 'zeppelin.apache.org'); + ga('require', 'linkid', 'linkid.js'); + ga('send', 'pageview'); + + + + + + + + + + + + + +
[zeppelin] branch master updated: [hotfix] Fix release script
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 29b301e [hotfix] Fix release script 29b301e is described below commit 29b301e1a3b58ee59682672c12a085c4c3c232a9 Author: jeffzhang.zjf AuthorDate: Thu Jan 24 10:59:09 2019 +0800 [hotfix] Fix release script (cherry picked from commit 11335ff35a272321247e5dfcc3afaa9fea189b85) --- dev/common_release.sh | 3 ++- dev/create_release.sh | 10 +- dev/publish_release.sh | 14 ++ 3 files changed, 9 insertions(+), 18 deletions(-) diff --git a/dev/common_release.sh b/dev/common_release.sh index 6b7e901..8d0434a 100644 --- a/dev/common_release.sh +++ b/dev/common_release.sh @@ -31,6 +31,7 @@ if [[ -z "${WORKING_DIR}" ]]; then WORKING_DIR="/tmp/zeppelin-release" fi +rm -rf "${WORKING_DIR}" mkdir "${WORKING_DIR}" # If set to 'yes', release script will deploy artifacts to SNAPSHOT repository. @@ -42,7 +43,7 @@ usage() { exit 1 } -function git_clone() { +function git_clone() { echo "Clone the source" # clone source git clone https://git-wip-us.apache.org/repos/asf/zeppelin.git "${WORKING_DIR}/zeppelin" diff --git a/dev/create_release.sh b/dev/create_release.sh index ac4c67d..fdd33fb 100755 --- a/dev/create_release.sh +++ b/dev/create_release.sh @@ -55,11 +55,7 @@ function make_source_package() { echo "${GPG_PASSPHRASE}" | gpg --passphrase-fd 0 --armor \ --output "zeppelin-${RELEASE_VERSION}.tgz.asc" \ --detach-sig "${WORKING_DIR}/zeppelin-${RELEASE_VERSION}.tgz" - echo "${GPG_PASSPHRASE}" | gpg --passphrase-fd 0 \ ---print-md MD5 "zeppelin-${RELEASE_VERSION}.tgz" > \ -"${WORKING_DIR}/zeppelin-${RELEASE_VERSION}.tgz.md5" - echo "${GPG_PASSPHRASE}" | gpg --passphrase-fd 0 \ ---print-md SHA512 "zeppelin-${RELEASE_VERSION}.tgz" > \ + ${SHASUM} -a 512 "zeppelin-${RELEASE_VERSION}.tgz" > \ "${WORKING_DIR}/zeppelin-${RELEASE_VERSION}.tgz.sha512" } @@ -89,15 +85,11 @@ function make_binary_release() { echo "${GPG_PASSPHRASE}" | gpg --passphrase-fd 0 --armor \ --output "zeppelin-${RELEASE_VERSION}-bin-${BIN_RELEASE_NAME}.tgz.asc" \ --detach-sig "zeppelin-${RELEASE_VERSION}-bin-${BIN_RELEASE_NAME}.tgz" - echo "${GPG_PASSPHRASE}" | gpg --passphrase-fd 0 --print-md MD5 \ -"zeppelin-${RELEASE_VERSION}-bin-${BIN_RELEASE_NAME}.tgz" > \ -"zeppelin-${RELEASE_VERSION}-bin-${BIN_RELEASE_NAME}.tgz.md5" ${SHASUM} -a 512 "zeppelin-${RELEASE_VERSION}-bin-${BIN_RELEASE_NAME}.tgz" > \ "zeppelin-${RELEASE_VERSION}-bin-${BIN_RELEASE_NAME}.tgz.sha512" mv "zeppelin-${RELEASE_VERSION}-bin-${BIN_RELEASE_NAME}.tgz" "${WORKING_DIR}/" mv "zeppelin-${RELEASE_VERSION}-bin-${BIN_RELEASE_NAME}.tgz.asc" "${WORKING_DIR}/" - mv "zeppelin-${RELEASE_VERSION}-bin-${BIN_RELEASE_NAME}.tgz.md5" "${WORKING_DIR}/" mv "zeppelin-${RELEASE_VERSION}-bin-${BIN_RELEASE_NAME}.tgz.sha512" "${WORKING_DIR}/" # clean up build dir diff --git a/dev/publish_release.sh b/dev/publish_release.sh index b569ec4..b6bf39b 100755 --- a/dev/publish_release.sh +++ b/dev/publish_release.sh @@ -54,7 +54,6 @@ NEXUS_PROFILE="153446d1ac37c4" function cleanup() { echo "Remove working directory and maven local repository" rm -rf ${WORKING_DIR} - rm -rf ${tmp_repo} } function curl_error() { @@ -126,13 +125,13 @@ function publish_to_maven() { echo "Created Nexus staging repository: ${staged_repo_id}" - tmp_repo="$(mktemp -d /tmp/zeppelin-repo-X)" + rm -rf $HOME/.m2/repository/org/apache/zeppelin # build with scala-2.10 echo "mvn clean install -DskipTests \ --Dmaven.repo.local=${tmp_repo} -Pscala-2.10 -Pbeam \ +-Pscala-2.10 -Pbeam \ ${PUBLISH_PROFILES} ${PROJECT_OPTIONS}" - mvn clean install -DskipTests -Dmaven.repo.local="${tmp_repo}" -Pscala-2.10 -Pbeam \ + mvn clean install -DskipTests -Pscala-2.10 -Pbeam \ ${PUBLISH_PROFILES} ${PROJECT_OPTIONS} if [[ $? -ne 0 ]]; then echo "Build with scala 2.10 failed." @@ -143,23 +142,22 @@ function publish_to_maven() { "${BASEDIR}/change_scala_version.sh" 2.11 echo "mvn clean install -DskipTests \ --Dmaven.repo.local=${tmp_repo} -Pscala-2.11 \ +-Pscala-2.11 \ ${PUBLISH_PROFILES} ${PROJECT_OPTIONS}" - mvn clean install -DskipTests -Dmaven.repo.local="${tmp_repo}" -Pscala-2.11 \ + mvn clean install -DskipTests -Pscala-2.11 \ ${PUBLISH_PROFILES} $
[zeppelin] branch branch-0.8 updated: [hotfix] Fix release script
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch branch-0.8 in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/branch-0.8 by this push: new 85f56cf [hotfix] Fix release script 85f56cf is described below commit 85f56cfbd39c9ef53453159bb6bbba489d419ee6 Author: jeffzhang.zjf AuthorDate: Thu Jan 24 10:59:09 2019 +0800 [hotfix] Fix release script (cherry picked from commit 11335ff35a272321247e5dfcc3afaa9fea189b85) --- dev/common_release.sh | 3 ++- dev/create_release.sh | 10 +- dev/publish_release.sh | 15 ++- 3 files changed, 9 insertions(+), 19 deletions(-) diff --git a/dev/common_release.sh b/dev/common_release.sh index 70afd1d..bc3a03d 100644 --- a/dev/common_release.sh +++ b/dev/common_release.sh @@ -31,6 +31,7 @@ if [[ -z "${WORKING_DIR}" ]]; then WORKING_DIR="/tmp/zeppelin-release" fi +rm -rf "${WORKING_DIR}" mkdir "${WORKING_DIR}" # If set to 'yes', release script will deploy artifacts to SNAPSHOT repository. @@ -42,7 +43,7 @@ usage() { exit 1 } -function git_clone() { +function git_clone() { echo "Clone the source" # clone source git clone https://git-wip-us.apache.org/repos/asf/zeppelin.git "${WORKING_DIR}/zeppelin" diff --git a/dev/create_release.sh b/dev/create_release.sh index 6836e02..f0529d5 100755 --- a/dev/create_release.sh +++ b/dev/create_release.sh @@ -55,11 +55,7 @@ function make_source_package() { echo "${GPG_PASSPHRASE}" | gpg --passphrase-fd 0 --armor \ --output "zeppelin-${RELEASE_VERSION}.tgz.asc" \ --detach-sig "${WORKING_DIR}/zeppelin-${RELEASE_VERSION}.tgz" - echo "${GPG_PASSPHRASE}" | gpg --passphrase-fd 0 \ ---print-md MD5 "zeppelin-${RELEASE_VERSION}.tgz" > \ -"${WORKING_DIR}/zeppelin-${RELEASE_VERSION}.tgz.md5" - echo "${GPG_PASSPHRASE}" | gpg --passphrase-fd 0 \ ---print-md SHA512 "zeppelin-${RELEASE_VERSION}.tgz" > \ + ${SHASUM} -a 512 "zeppelin-${RELEASE_VERSION}.tgz" > \ "${WORKING_DIR}/zeppelin-${RELEASE_VERSION}.tgz.sha512" } @@ -89,15 +85,11 @@ function make_binary_release() { echo "${GPG_PASSPHRASE}" | gpg --passphrase-fd 0 --armor \ --output "zeppelin-${RELEASE_VERSION}-bin-${BIN_RELEASE_NAME}.tgz.asc" \ --detach-sig "zeppelin-${RELEASE_VERSION}-bin-${BIN_RELEASE_NAME}.tgz" - echo "${GPG_PASSPHRASE}" | gpg --passphrase-fd 0 --print-md MD5 \ -"zeppelin-${RELEASE_VERSION}-bin-${BIN_RELEASE_NAME}.tgz" > \ -"zeppelin-${RELEASE_VERSION}-bin-${BIN_RELEASE_NAME}.tgz.md5" ${SHASUM} -a 512 "zeppelin-${RELEASE_VERSION}-bin-${BIN_RELEASE_NAME}.tgz" > \ "zeppelin-${RELEASE_VERSION}-bin-${BIN_RELEASE_NAME}.tgz.sha512" mv "zeppelin-${RELEASE_VERSION}-bin-${BIN_RELEASE_NAME}.tgz" "${WORKING_DIR}/" mv "zeppelin-${RELEASE_VERSION}-bin-${BIN_RELEASE_NAME}.tgz.asc" "${WORKING_DIR}/" - mv "zeppelin-${RELEASE_VERSION}-bin-${BIN_RELEASE_NAME}.tgz.md5" "${WORKING_DIR}/" mv "zeppelin-${RELEASE_VERSION}-bin-${BIN_RELEASE_NAME}.tgz.sha512" "${WORKING_DIR}/" # clean up build dir diff --git a/dev/publish_release.sh b/dev/publish_release.sh index 8fcd6d3..83db305 100755 --- a/dev/publish_release.sh +++ b/dev/publish_release.sh @@ -54,7 +54,6 @@ NEXUS_PROFILE="153446d1ac37c4" function cleanup() { echo "Remove working directory and maven local repository" rm -rf ${WORKING_DIR} - rm -rf ${tmp_repo} } function curl_error() { @@ -126,14 +125,13 @@ function publish_to_maven() { echo "Created Nexus staging repository: ${staged_repo_id}" - mkdir /tmp/zeppelin-repo-${RELEASE_VERSION} - tmp_repo=/tmp/zeppelin-repo-${RELEASE_VERSION} + rm -rf $HOME/.m2/repository/org/apache/zeppelin # build with scala-2.10 echo "mvn clean install -DskipTests \ --Dmaven.repo.local=${tmp_repo} -Pscala-2.10 -Pbeam \ +-Pscala-2.10 -Pbeam \ ${PUBLISH_PROFILES} ${PROJECT_OPTIONS}" - mvn clean install -DskipTests -Dmaven.repo.local="${tmp_repo}" -Pscala-2.10 -Pbeam \ + mvn clean install -DskipTests -Pscala-2.10 -Pbeam \ ${PUBLISH_PROFILES} ${PROJECT_OPTIONS} if [[ $? -ne 0 ]]; then echo "Build with scala 2.10 failed." @@ -144,23 +142,22 @@ function publish_to_maven() { "${BASEDIR}/change_scala_version.sh" 2.11 echo "mvn clean install -DskipTests \ --Dmaven.repo.local=${tmp_repo} -Pscala-2.11 \ +-Pscala-2.11 \ ${PUBLISH_PROFILES} ${PROJECT_OPTIONS}" - mvn clean install -DskipTests -Dmaven.repo.local="${tmp_repo}" -Pscala-2.11 \ + mvn clean install -DskipTest
[zeppelin] 02/02: ZEPPELIN-3951. Enable IPython in Docker
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to annotated tag v0.8.1-docker in repository https://gitbox.apache.org/repos/asf/zeppelin.git commit 436089344236a69a0e62e444bd63b6d221bb4207 Author: jeffzhang.zjf AuthorDate: Thu Jan 17 15:42:13 2019 +0800 ZEPPELIN-3951. Enable IPython in Docker --- scripts/docker/zeppelin/bin/Dockerfile | 10 +++--- 1 file changed, 7 insertions(+), 3 deletions(-) diff --git a/scripts/docker/zeppelin/bin/Dockerfile b/scripts/docker/zeppelin/bin/Dockerfile index bf0e1f3..94cd3c8 100644 --- a/scripts/docker/zeppelin/bin/Dockerfile +++ b/scripts/docker/zeppelin/bin/Dockerfile @@ -52,7 +52,7 @@ RUN echo "$LOG_TAG Install miniconda2 related packages" && \ libglib2.0-0 libxext6 libsm6 libxrender1 \ git mercurial subversion && \ echo 'export PATH=/opt/conda/bin:$PATH' > /etc/profile.d/conda.sh && \ -wget --quiet https://repo.continuum.io/miniconda/Miniconda2-4.3.11-Linux-x86_64.sh -O ~/miniconda.sh && \ +wget --quiet https://repo.continuum.io/miniconda/Miniconda2-4.2.12-Linux-x86_64.sh -O ~/miniconda.sh && \ /bin/bash ~/miniconda.sh -b -p /opt/conda && \ rm ~/miniconda.sh ENV PATH /opt/conda/bin:$PATH @@ -67,8 +67,12 @@ RUN echo "$LOG_TAG Install python related packages" && \ apt-get install -y libpng-dev libfreetype6-dev libxft-dev && \ # for tkinter apt-get install -y python-tk libxml2-dev libxslt-dev zlib1g-dev && \ -pip install numpy && \ -pip install matplotlib +conda config --set always_yes yes --set changeps1 no && \ +conda update -q conda && \ +conda info -a && \ +conda config --add channels conda-forge && \ +conda install -q numpy=1.12.1 pandas=0.21.1 matplotlib=2.1.1 pandasql=0.7.3 ipython=5.4.1 jupyter_client=5.1.0 ipykernel=4.7.0 bokeh=0.12.10 && \ +pip install -q ggplot==0.11.5 grpcio==1.8.2 bkzep==0.4.0 RUN echo "$LOG_TAG Install R related packages" && \ echo "deb http://cran.rstudio.com/bin/linux/ubuntu xenial/" | tee -a /etc/apt/sources.list && \
[zeppelin] annotated tag v0.8.1-docker created (now e5d7665)
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a change to annotated tag v0.8.1-docker in repository https://gitbox.apache.org/repos/asf/zeppelin.git. at e5d7665 (tag) tagging 436089344236a69a0e62e444bd63b6d221bb4207 (commit) replaces v0.8.1 by Jeff Zhang on Fri Jan 25 22:01:02 2019 +0800 - Log - Tag for 0.8.1 docker --- This annotated tag includes the following new commits: new 5a8c169 [HotFix] Fix Dockerfile for 0.8.1 new 4360893 ZEPPELIN-3951. Enable IPython in Docker The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[zeppelin] 01/02: [HotFix] Fix Dockerfile for 0.8.1
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to annotated tag v0.8.1-docker in repository https://gitbox.apache.org/repos/asf/zeppelin.git commit 5a8c16901427285d1ec0827afa95799ff7236416 Author: Jeff Zhang AuthorDate: Fri Jan 25 14:45:05 2019 +0800 [HotFix] Fix Dockerfile for 0.8.1 --- scripts/docker/zeppelin/bin/Dockerfile | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/docker/zeppelin/bin/Dockerfile b/scripts/docker/zeppelin/bin/Dockerfile index ceb36f4..bf0e1f3 100644 --- a/scripts/docker/zeppelin/bin/Dockerfile +++ b/scripts/docker/zeppelin/bin/Dockerfile @@ -17,7 +17,7 @@ FROM ubuntu:16.04 MAINTAINER Apache Software Foundation # `Z_VERSION` will be updated by `dev/change_zeppelin_version.sh` -ENV Z_VERSION="0.8.1-SNAPSHOT" +ENV Z_VERSION="0.8.1" ENV LOG_TAG="[ZEPPELIN_${Z_VERSION}]:" \ Z_HOME="/zeppelin" \ LANG=en_US.UTF-8 \
[zeppelin] branch master updated: ZEPPELIN-3976. Create AbstractInterprter for common usage
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 735064f ZEPPELIN-3976. Create AbstractInterprter for common usage 735064f is described below commit 735064fdc57ae958fabae85b399bb5af3cb79144 Author: Jeff Zhang AuthorDate: Tue Jan 29 15:13:02 2019 +0800 ZEPPELIN-3976. Create AbstractInterprter for common usage ### What is this PR for? This ticket create AbstractInterpreter which do some common things: * Support ZeppelinContext * Support z variable replacement ### What type of PR is it? [Refactoring] ### Todos * [ ] - Task ### What is the Jira issue? * https://jira.apache.org/jira/browse/ZEPPELIN-3976 ### How should this be tested? * CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang Closes #3293 from zjffdu/ZEPPELIN-3976 and squashes the following commits: 7b42a42f3 [Jeff Zhang] ZEPPELIN-3976. Create AbstractInterprter for common usage --- .../zeppelin/groovy/GroovyZeppelinContext.java | 2 +- .../apache/zeppelin/helium/DevZeppelinContext.java | 2 +- .../org/apache/zeppelin/jdbc/JDBCInterpreter.java | 15 -- .../jdbc/JDBCInterpreterInterpolationTest.java | 9 ++-- .../apache/zeppelin/jdbc/JDBCInterpreterTest.java | 35 -- .../zeppelin/python/PythonZeppelinContext.java | 2 +- .../apache/zeppelin/sap/UniverseInterpreter.java | 18 +-- .../apache/zeppelin/shell/ShellInterpreter.java| 19 ++-- .../zeppelin/shell/ShellInterpreterTest.java | 7 +-- .../zeppelin/spark/AbstractSparkInterpreter.java | 5 +- .../apache/zeppelin/spark/NewSparkInterpreter.java | 7 +-- .../apache/zeppelin/spark/OldSparkInterpreter.java | 3 +- .../apache/zeppelin/spark/PySparkInterpreter.java | 2 +- .../apache/zeppelin/spark/SparkInterpreter.java| 6 +-- .../apache/zeppelin/spark/SparkRInterpreter.java | 2 +- .../apache/zeppelin/spark/SparkSqlInterpreter.java | 20 ++-- .../zeppelin/interpreter/AbstractInterpreter.java | 55 ++ .../zeppelin/interpreter/BaseZeppelinContext.java | 4 +- .../zeppelin/interpreter/KerberosInterpreter.java | 4 +- .../interpreter/BaseZeppelinContextTest.java | 2 +- 20 files changed, 157 insertions(+), 62 deletions(-) diff --git a/groovy/src/main/java/org/apache/zeppelin/groovy/GroovyZeppelinContext.java b/groovy/src/main/java/org/apache/zeppelin/groovy/GroovyZeppelinContext.java index 3d17462..3f0d600 100644 --- a/groovy/src/main/java/org/apache/zeppelin/groovy/GroovyZeppelinContext.java +++ b/groovy/src/main/java/org/apache/zeppelin/groovy/GroovyZeppelinContext.java @@ -43,7 +43,7 @@ public class GroovyZeppelinContext extends BaseZeppelinContext { } @Override - protected String showData(Object obj) { + public String showData(Object obj) { return null; } } diff --git a/helium-dev/src/main/java/org/apache/zeppelin/helium/DevZeppelinContext.java b/helium-dev/src/main/java/org/apache/zeppelin/helium/DevZeppelinContext.java index 75d193c..45d8b39 100644 --- a/helium-dev/src/main/java/org/apache/zeppelin/helium/DevZeppelinContext.java +++ b/helium-dev/src/main/java/org/apache/zeppelin/helium/DevZeppelinContext.java @@ -43,7 +43,7 @@ public class DevZeppelinContext extends BaseZeppelinContext { } @Override - protected String showData(Object obj) { + public String showData(Object obj) { return null; } } diff --git a/jdbc/src/main/java/org/apache/zeppelin/jdbc/JDBCInterpreter.java b/jdbc/src/main/java/org/apache/zeppelin/jdbc/JDBCInterpreter.java index dd361f5..a547171 100644 --- a/jdbc/src/main/java/org/apache/zeppelin/jdbc/JDBCInterpreter.java +++ b/jdbc/src/main/java/org/apache/zeppelin/jdbc/JDBCInterpreter.java @@ -32,6 +32,7 @@ import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.security.UserGroupInformation; import org.apache.hadoop.security.alias.CredentialProvider; import org.apache.hadoop.security.alias.CredentialProviderFactory; +import org.apache.zeppelin.interpreter.BaseZeppelinContext; import org.slf4j.Logger; import org.slf4j.LoggerFactory; @@ -154,6 +155,11 @@ public class JDBCInterpreter extends KerberosInterpreter { } @Override + public BaseZeppelinContext getZeppelinContext() { +return null; + } + + @Override protected boolean runKerberosLogin() { try { if (UserGroupInformation.isLoginKeytabBased()) { @@ -803,9 +809,12 @@ public class JDBCInterpreter extends KerberosInterpreter { } @Override - public InterpreterResult interpret(String originalCmd, InterpreterContext contextInterpreter
[zeppelin] branch master updated: [ZEPPELIN-3978] Change Jetty Server to use QueuedThreadPool and make it configurable
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 0d3ac8a [ZEPPELIN-3978] Change Jetty Server to use QueuedThreadPool and make it configurable 0d3ac8a is described below commit 0d3ac8a56f3c7f53ecf2888ea853252794daa88a Author: fdai AuthorDate: Fri Feb 1 10:49:07 2019 -0800 [ZEPPELIN-3978] Change Jetty Server to use QueuedThreadPool and make it configurable ### What is this PR for? By default Jetty Server only supports 200 threads. On our daily use cases, we normally have more than 100 users on the single Zeppelin Server, which will create more than 200 threads in Jetty. That could cause slowness or stuck because users could not receive WebSocket message. Add configurable param feature to scale up the performance for Single Zeppelin Server whenever needs it ### What type of PR is it? Improvement ### Todos * [ ] - Task ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-3978 [ZEPPELIN-3978] ### How should this be tested? * First time? Setup Travis CI as described on https://zeppelin.apache.org/contribution/contributions.html#continuous-integration * Strongly recommended: add automated unit tests for any new or changed behavior * Outline any manual steps to test the PR here. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: fdai Closes #3294 from fred521/mainStream/fdai_increase_thread_pool_number and squashes the following commits: 62986a225 [fdai] add description to template for new param 23e79a953 [fdai] make the param to be configurable ff5b6a140 [fdai] custom the thread number to have better performance --- conf/zeppelin-site.xml.template| 22 ++ .../zeppelin/conf/ZeppelinConfiguration.java | 3 +++ .../org/apache/zeppelin/server/ZeppelinServer.java | 8 +++- 3 files changed, 32 insertions(+), 1 deletion(-) diff --git a/conf/zeppelin-site.xml.template b/conf/zeppelin-site.xml.template index 88b8d9a..4ce336b 100755 --- a/conf/zeppelin-site.xml.template +++ b/conf/zeppelin-site.xml.template @@ -495,6 +495,28 @@ + + + +
[zeppelin] branch master updated: [ZEPPELIN-3931] Redisplay angularObjectBind when the note is reopened
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 62da77c [ZEPPELIN-3931] Redisplay angularObjectBind when the note is reopened 62da77c is described below commit 62da77ca0bb61d5bffecfa9123d7f3ee8eccbcaa Author: liuxunorg <33611...@qq.com> AuthorDate: Tue Jan 1 01:12:40 2019 +0800 [ZEPPELIN-3931] Redisplay angularObjectBind when the note is reopened ### What is this PR for? At present, Bind's angularObject in note is only valid in the current operation web page. When the note is reopened, or the zeppelin service is restarted, the angularObject of Bind in the note cannot be displayed, and the bind operation must be repeated. The submarine has a lot of startup commands and parameters. In order to provide the best experience for the user, we provide the parameters to the user through the WEB control. Zeppelin's own dynamic form is more suitable for parameter input in the query, but it does not meet the needs of the submarine interpreter, so the submarine interpreter uses the angular template to generate a richer input interface. The controls in the interface are saved to the note through Bind's angularObject, so that when the user reopens the note, there is no need to re-enter it. ### What type of PR is it? [Improvement] ### Todos * [x] Save angularObject to Note in NotebookServer::angularObjectClientBind(...) function. * [x] Delete angularObject to Note in NotebookServer::angularObjectClientUnbind(...) function. * [x] Update angularObject to Note in NotebookServer:: angularObjectUpdated(...) function. * [x] Load angularObject update to Note in NotebookServer::getNote(...) function. * [x] Add test case in NotebookServerTest::testAngularObjectSaveToNote(...). * [x] Add test case in NotebookServerTest::testLoadAngularObjectFromNote(...). ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-3931 ### How should this be tested? [CI pass](https://travis-ci.org/liuxunorg/zeppelin/builds/473897099) ### Screenshots (if appropriate) ![alt text](https://github.com/liuxunorg/images/blob/master/zeppelin/angularBing-save.gif?raw=true "angularBing-save.gif") ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: liuxunorg <33611...@qq.com> Closes #3278 from liuxunorg/ZEPPELIN-3931 and squashes the following commits: 96cd90b44 [liuxunorg] ### What is this PR for? --- .../org/apache/zeppelin/socket/NotebookServer.java | 62 +-- .../apache/zeppelin/socket/NotebookServerTest.java | 161 +- .../2E1YA3X1U/angularObject_2E1YA3X1U.zpln | 188 + .../java/org/apache/zeppelin/notebook/Note.java| 82 + 4 files changed, 478 insertions(+), 15 deletions(-) diff --git a/zeppelin-server/src/main/java/org/apache/zeppelin/socket/NotebookServer.java b/zeppelin-server/src/main/java/org/apache/zeppelin/socket/NotebookServer.java index e83f26f..21cb0ff 100644 --- a/zeppelin-server/src/main/java/org/apache/zeppelin/socket/NotebookServer.java +++ b/zeppelin-server/src/main/java/org/apache/zeppelin/socket/NotebookServer.java @@ -608,8 +608,7 @@ public class NotebookServer extends WebSocketServlet return true; } - private void getNote(NotebookSocket conn, - Message fromMessage) throws IOException { + private void getNote(NotebookSocket conn, Message fromMessage) throws IOException { String noteId = (String) fromMessage.get("id"); if (noteId == null) { return; @@ -620,11 +619,37 @@ public class NotebookServer extends WebSocketServlet public void onSuccess(Note note, ServiceContext context) throws IOException { connectionManager.addNoteConnection(note.getId(), conn); conn.send(serializeMessage(new Message(OP.NOTE).put("note", note))); +updateAngularObjectRegistry(conn, note); sendAllAngularObjects(note, context.getAutheInfo().getUser(), conn); } }); } + /** + * Update the AngularObject object in the note to InterpreterGroup and AngularObjectRegistry. + */ + private void updateAngularObjectRegistry(NotebookSocket conn, Note note) { +for(Paragraph paragraph : note.getParagraphs()) { + InterpreterGroup interpreterGroup = null; + try { +interpreterGroup = findInterpreterGroupForParagraph(note, paragraph.getId()); + } catch (Exception e) { +e.printStackTrace(); + } + RemoteAngularObjectRegist
[zeppelin] branch master updated: IPythonInterpreter delete temp file and close stream
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new a2a6215 IPythonInterpreter delete temp file and close stream a2a6215 is described below commit a2a621595afcc65e965382d5a0412ade0e299610 Author: yx91490 AuthorDate: Tue Jan 22 13:47:38 2019 +0800 IPythonInterpreter delete temp file and close stream ### What is this PR for? delete temporary file and close inputstream in IPythonInterpreter.checkIPythonPrerequisite() ### What type of PR is it? [Bug Fix] ### Todos *no ### What is the Jira issue? * https://jira.apache.org/jira/browse/ZEPPELIN-3910, [ZEPPELIN-3910] ### How should this be tested? * manual. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: yx91490 Closes #3287 from yx91490/ipy_tmp_file and squashes the following commits: c811e3736 [yx91490] delete temp file and close stream --- .../apache/zeppelin/python/IPythonInterpreter.java | 48 +- 1 file changed, 28 insertions(+), 20 deletions(-) diff --git a/python/src/main/java/org/apache/zeppelin/python/IPythonInterpreter.java b/python/src/main/java/org/apache/zeppelin/python/IPythonInterpreter.java index 3c646ae..b357e88 100644 --- a/python/src/main/java/org/apache/zeppelin/python/IPythonInterpreter.java +++ b/python/src/main/java/org/apache/zeppelin/python/IPythonInterpreter.java @@ -161,38 +161,46 @@ public class IPythonInterpreter extends Interpreter implements ExecuteResultHand */ public String checkIPythonPrerequisite(String pythonExec) { ProcessBuilder processBuilder = new ProcessBuilder(pythonExec, "-m", "pip", "freeze"); +File stderrFile = null; +File stdoutFile = null; try { - File stderrFile = File.createTempFile("zeppelin", ".txt"); + stderrFile = File.createTempFile("zeppelin", ".txt"); processBuilder.redirectError(stderrFile); - File stdoutFile = File.createTempFile("zeppelin", ".txt"); + stdoutFile = File.createTempFile("zeppelin", ".txt"); processBuilder.redirectOutput(stdoutFile); Process proc = processBuilder.start(); int ret = proc.waitFor(); if (ret != 0) { -return "Fail to run pip freeze.\n" + -IOUtils.toString(new FileInputStream(stderrFile)); - } - String freezeOutput = IOUtils.toString(new FileInputStream(stdoutFile)); - if (!freezeOutput.contains("jupyter-client=")) { -return "jupyter-client is not installed."; - } - if (!freezeOutput.contains("ipykernel=")) { -return "ipykernel is not installed"; - } - if (!freezeOutput.contains("ipython=")) { -return "ipython is not installed"; - } - if (!freezeOutput.contains("grpcio=")) { -return "grpcio is not installed"; +try (FileInputStream in = new FileInputStream(stderrFile)) { + return "Fail to run pip freeze.\n" + IOUtils.toString(in); +} } - if (!freezeOutput.contains("protobuf=")) { -return "protobuf is not installed"; + try (FileInputStream in = new FileInputStream(stdoutFile)) { +String freezeOutput = IOUtils.toString(in); +if (!freezeOutput.contains("jupyter-client=")) { + return "jupyter-client is not installed."; +} +if (!freezeOutput.contains("ipykernel=")) { + return "ipykernel is not installed"; +} +if (!freezeOutput.contains("ipython=")) { + return "ipython is not installed"; +} +if (!freezeOutput.contains("grpcio=")) { + return "grpcio is not installed"; +} +if (!freezeOutput.contains("protobuf=")) { + return "protobuf is not installed"; +} +LOGGER.info("IPython prerequisite is met"); } - LOGGER.info("IPython prerequisite is met"); } catch (Exception e) { LOGGER.warn("Fail to checkIPythonPrerequisite", e); return "Fail to checkIPythonPrerequisite: " + ExceptionUtils.getStackTrace(e); +} finally { + FileUtils.deleteQuietly(stderrFile); + FileUtils.deleteQuietly(stdoutFile); } return ""; }
[zeppelin] branch master updated: [ZEPPELIN-3814] visualization - Add apply button to table settings
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 4df0897 [ZEPPELIN-3814] visualization - Add apply button to table settings 4df0897 is described below commit 4df0897e92574b8f96a06e4df27e93bacf035e92 Author: George Klimov AuthorDate: Thu Dec 20 01:54:18 2018 +0300 [ZEPPELIN-3814] visualization - Add apply button to table settings ### What is this PR for? Now changes in table settings applies only after page refreshing which isn't convenient * Settings menu before PR: ![screenshot-1](https://user-images.githubusercontent.com/6136993/47079792-f49b6580-d20e-11e8-837e-98ba5443f3b3.png) * Menu with new button: ![3814](https://user-images.githubusercontent.com/6136993/51320121-ecea9780-1a6f-11e9-850f-fcaf061ff5f3.gif) ### What type of PR is it? Improvement ### What is the Jira issue? * issue - https://issues.apache.org/jira/browse/ZEPPELIN-3814 ### How should this be tested? * CI pass * Manually tested ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: George Klimov Closes #3205 from egorklimov/DW-17956 and squashes the following commits: ffcd55ccb [George Klimov] Fix icon 7daec9278 [George Klimov] button added --- .../builtins/visualization-table-setting.html | 8 +++- .../src/app/visualization/builtins/visualization-table.js | 14 +- 2 files changed, 20 insertions(+), 2 deletions(-) diff --git a/zeppelin-web/src/app/visualization/builtins/visualization-table-setting.html b/zeppelin-web/src/app/visualization/builtins/visualization-table-setting.html index d01fd1b..4dc49b3 100644 --- a/zeppelin-web/src/app/visualization/builtins/visualization-table-setting.html +++ b/zeppelin-web/src/app/visualization/builtins/visualization-table-setting.html @@ -17,8 +17,14 @@ limitations under the License. Table Options + + + + diff --git a/zeppelin-web/src/app/visualization/builtins/visualization-table.js b/zeppelin-web/src/app/visualization/builtins/visualization-table.js index 4227258..270a694 100644 --- a/zeppelin-web/src/app/visualization/builtins/visualization-table.js +++ b/zeppelin-web/src/app/visualization/builtins/visualization-table.js @@ -66,6 +66,7 @@ export default class TableVisualization extends Visualization { this.passthrough = new PassthroughTransformation(config); this.emitTimeout = null; this.isRestoring = false; +this.isUpdated = false; initializeTableConfig(config, TABLE_OPTION_SPECS); } @@ -382,7 +383,12 @@ export default class TableVisualization extends Visualization { // gridApi.selection.on.rowSelectionChangedBatch(scope, () => { self.persistConfigWithGridState(self.config) }) }; -if (!gridElem) { +if (!gridElem || this.isUpdated) { + if (this.isUpdated) { +this.targetEl.find(gridElem).off(); +this.targetEl.find(gridElem).detach(); +this.isUpdated = false; + } // create, compile and append grid elem gridElem = angular.element( ` { + this.isUpdated = true; + // emit config to re-render table + configObj.initialized = true; + self.persistConfig(configObj); +}, tableWidgetOnKeyDown: (event, optSpec) => { const code = event.keyCode || event.which; if (code === 13 && isInputWidget(optSpec)) {
[zeppelin] branch master updated: [ZEPPELIN-4043]. Create shell script for moving note permission info from notebook-authorization.json to note file
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new f63a619 [ZEPPELIN-4043]. Create shell script for moving note permission info from notebook-authorization.json to note file f63a619 is described below commit f63a6196761fa5f4b961c544fbcbe535ed746ba5 Author: Jeff Zhang AuthorDate: Mon Apr 1 10:27:46 2019 +0800 [ZEPPELIN-4043]. Create shell script for moving note permission info from notebook-authorization.json to note file ### What is this PR for? This PR is followup of ZEPPELIN-3985. It will help user to do the note upgrade (moving permission info from notebook-authorization.json to note file) ### What type of PR is it? [ Improvement ] ### Todos * [ ] - Task ### What is the Jira issue? * https://jira.apache.org/jira/browse/ZEPPELIN-4043 ### How should this be tested? * CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang Closes #3345 from zjffdu/ZEPPELIN-4043 and squashes the following commits: 98b363455 [Jeff Zhang] [ZEPPELIN-4043]. Create shell script for moving note permission info from notebook-authorization.json to note file --- docs/setup/operation/upgrading.md | 2 +- .../zeppelin/notebook/repo/NotebookRepoSync.java | 19 +++ .../zeppelin/notebook/repo/UpgradeNoteFileTool.java | 1 + 3 files changed, 21 insertions(+), 1 deletion(-) diff --git a/docs/setup/operation/upgrading.md b/docs/setup/operation/upgrading.md index a3941c3..99b239b 100644 --- a/docs/setup/operation/upgrading.md +++ b/docs/setup/operation/upgrading.md @@ -37,7 +37,7 @@ So, copying `notebook` and `conf` directory should be enough. ### Upgrading from Zeppelin 0.8 to 0.9 - - From 0.9, we change the notes file name structure ([ZEPPELIN-2619](https://issues.apache.org/jira/browse/ZEPPELIN-2619)). So when you upgrading zeppelin to 0.9, you need to upgrade note file. Here's steps you need to follow: + - From 0.9, we change the notes file name structure ([ZEPPELIN-2619](https://issues.apache.org/jira/browse/ZEPPELIN-2619)) and move permissions info from `notebook-authorization.json` into note file itself [ZEPPELIN-3985](https://issues.apache.org/jira/browse/ZEPPELIN-3985). So when you upgrading zeppelin to 0.9, you need to upgrade note file. Here's steps you need to follow: 1. Backup your notes file in case the upgrade fails 2. Call `bin/upgrade-note.sh -d` to upgrade note, `-d` option means to delete the old note file, missing this option will keep the old file. diff --git a/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/repo/NotebookRepoSync.java b/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/repo/NotebookRepoSync.java index dd43d20..9a5e829 100644 --- a/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/repo/NotebookRepoSync.java +++ b/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/repo/NotebookRepoSync.java @@ -23,8 +23,10 @@ import org.apache.zeppelin.conf.ZeppelinConfiguration; import org.apache.zeppelin.conf.ZeppelinConfiguration.ConfVars; import org.apache.zeppelin.notebook.Note; import org.apache.zeppelin.notebook.NoteInfo; +import org.apache.zeppelin.notebook.NotebookAuthorization; import org.apache.zeppelin.notebook.OldNoteInfo; import org.apache.zeppelin.notebook.Paragraph; +import org.apache.zeppelin.notebook.repo.zeppelinhub.security.Authentication; import org.apache.zeppelin.plugin.PluginManager; import org.apache.zeppelin.user.AuthenticationInfo; import org.apache.zeppelin.util.Util; @@ -142,6 +144,23 @@ public class NotebookRepoSync implements NotebookRepoWithVersionControl { } } + public void mergeAuthorizationInfo() throws IOException { +LOGGER.info("Merge AuthorizationInfo into note file"); +NotebookAuthorization notebookAuthorization = NotebookAuthorization.getInstance(); +for (int i = 0; i < repos.size(); ++i) { + NotebookRepo notebookRepo = repos.get(i); + Map notesInfo = notebookRepo.list(AuthenticationInfo.ANONYMOUS); + for (NoteInfo noteInfo : notesInfo.values()) { +Note note = notebookRepo.get(noteInfo.getId(), noteInfo.getPath(), AuthenticationInfo.ANONYMOUS); +note.setOwners(notebookAuthorization.getOwners(noteInfo.getId())); +note.setRunners(notebookAuthorization.getRunners(noteInfo.getId())); +note.setReaders(notebookAuthorization.getReaders(noteInfo.getId())); +note.setWriters(notebookAuthorization.getWriters(noteInfo.getId())); +notebookRepo.save(note, AuthenticationI
[zeppelin] branch branch-0.8 updated: [HOTFIX] Fix compilation error
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch branch-0.8 in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/branch-0.8 by this push: new 2ffb5a2 [HOTFIX] Fix compilation error 2ffb5a2 is described below commit 2ffb5a229594da777adb54dc6d1e0ef9305f401a Author: Jeff Zhang AuthorDate: Thu Apr 11 13:41:32 2019 +0800 [HOTFIX] Fix compilation error --- .../src/test/java/org/apache/zeppelin/python/IPythonInterpreterTest.java | 1 - 1 file changed, 1 deletion(-) diff --git a/python/src/test/java/org/apache/zeppelin/python/IPythonInterpreterTest.java b/python/src/test/java/org/apache/zeppelin/python/IPythonInterpreterTest.java index dea9766..5e256f9 100644 --- a/python/src/test/java/org/apache/zeppelin/python/IPythonInterpreterTest.java +++ b/python/src/test/java/org/apache/zeppelin/python/IPythonInterpreterTest.java @@ -77,7 +77,6 @@ public class IPythonInterpreterTest { } @Test -<<<<<<< HEAD public void testGrpcFrameSize() throws InterpreterException, IOException { Properties properties = new Properties(); properties.setProperty("zeppelin.ipython.grpc.message_size", "4");
[zeppelin] branch master updated: ZEPPELIN-4038. Deprecate spark 2.2 and earlier
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 8e6974f ZEPPELIN-4038. Deprecate spark 2.2 and earlier 8e6974f is described below commit 8e6974fdc33e834bc01a5ee594e2cfca4ff3045f Author: Jeff Zhang AuthorDate: Mon Mar 25 17:56:52 2019 +0800 ZEPPELIN-4038. Deprecate spark 2.2 and earlier ### What is this PR for? This PR is to deprecate spark 2.2 and earlier. It would display a warning message in frontend, and user can disable this message by configure `zeppelin.spark.deprecatedMsg.show` to false, by default it is true. ### What type of PR is it? [Bug Fix] ### Todos * [ ] - Task ### What is the Jira issue? * https://jira.apache.org/jira/browse/ZEPPELIN-4038 ### How should this be tested? * CI pass ### Screenshots (if appropriate) ![image](https://user-images.githubusercontent.com/164491/54910937-4ebff580-4f28-11e9-8bdf-a4327f814990.png) ### Questions: * Does the licenses files need update? * Is there breaking changes for older versions? * Does this needs documentation? Author: Jeff Zhang Closes #3341 from zjffdu/ZEPPELIN-4038 and squashes the following commits: a66445678 [Jeff Zhang] ZEPPELIN-4038. Deprecate spark 2.2 and earlier --- .../zeppelin/img/docs-img/spark_deprecate.png | Bin 0 -> 176802 bytes docs/interpreter/spark.md | 6 ++ .../apache/zeppelin/spark/IPySparkInterpreter.java | 1 + .../apache/zeppelin/spark/PySparkInterpreter.java | 1 + .../apache/zeppelin/spark/SparkInterpreter.java| 2 ++ .../apache/zeppelin/spark/SparkRInterpreter.java | 3 ++- .../apache/zeppelin/spark/SparkSqlInterpreter.java | 2 +- .../org/apache/zeppelin/spark/SparkVersion.java| 1 + .../main/java/org/apache/zeppelin/spark/Utils.java | 22 + .../src/main/resources/interpreter-setting.json| 7 +++ .../zeppelin/spark/IPySparkInterpreterTest.java| 1 + .../zeppelin/spark/NewSparkInterpreterTest.java| 7 +++ .../zeppelin/spark/NewSparkSqlInterpreterTest.java | 1 + .../zeppelin/spark/OldSparkInterpreterTest.java| 1 + .../zeppelin/spark/OldSparkSqlInterpreterTest.java | 1 + .../spark/PySparkInterpreterMatplotlibTest.java| 1 + .../zeppelin/spark/PySparkInterpreterTest.java | 1 + .../zeppelin/spark/SparkRInterpreterTest.java | 3 ++- .../zeppelin/spark/BaseSparkScalaInterpreter.scala | 2 +- .../integration/ZeppelinSparkClusterTest.java | 2 ++ 20 files changed, 61 insertions(+), 4 deletions(-) diff --git a/docs/assets/themes/zeppelin/img/docs-img/spark_deprecate.png b/docs/assets/themes/zeppelin/img/docs-img/spark_deprecate.png new file mode 100644 index 000..8a867cc Binary files /dev/null and b/docs/assets/themes/zeppelin/img/docs-img/spark_deprecate.png differ diff --git a/docs/interpreter/spark.md b/docs/interpreter/spark.md index 9140825..c3c9fd7 100644 --- a/docs/interpreter/spark.md +++ b/docs/interpreter/spark.md @@ -374,6 +374,12 @@ Logical setup with Zeppelin, Kerberos Key Distribution Center (KDC), and Spark o +## Deprecate Spark 2.2 and earlier versions +Starting from 0.9, Zeppelin deprecate Spark 2.2 and earlier versions. So you will see a warning message when you use Spark 2.2 and earlier. +You can get rid of this message by setting `zeppelin.spark.deprecatedMsg.show` to `false`. + + + ### Configuration Setup 1. On the server that Zeppelin is installed, install Kerberos client modules and configuration, krb5.conf. diff --git a/spark/interpreter/src/main/java/org/apache/zeppelin/spark/IPySparkInterpreter.java b/spark/interpreter/src/main/java/org/apache/zeppelin/spark/IPySparkInterpreter.java index 594c171..c69e6fd 100644 --- a/spark/interpreter/src/main/java/org/apache/zeppelin/spark/IPySparkInterpreter.java +++ b/spark/interpreter/src/main/java/org/apache/zeppelin/spark/IPySparkInterpreter.java @@ -85,6 +85,7 @@ public class IPySparkInterpreter extends IPythonInterpreter { @Override public InterpreterResult interpret(String st, InterpreterContext context) throws InterpreterException { +Utils.printDeprecateMessage(sparkInterpreter.getSparkVersion(), context, properties); InterpreterContext.set(context); String jobGroupId = Utils.buildJobGroupId(context); String jobDesc = Utils.buildJobDesc(context); diff --git a/spark/interpreter/src/main/java/org/apache/zeppelin/spark/PySparkInterpreter.java b/spark/interpreter/src/main/java/org/apache/zeppelin/spark/PySparkInterpreter.java index 486eca0..c365345 100644 --- a/spark/interpreter/src/main/java/org/apache/zeppelin/spark/PySparkInterpreter.java +++ b/spark/interpreter/src/main/java/
[zeppelin] branch master updated: [ZEPPELIN-4066]. Introduce ProcessLauncher to encapsulate process launch
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 8fa5343 [ZEPPELIN-4066]. Introduce ProcessLauncher to encapsulate process launch 8fa5343 is described below commit 8fa534343beccb797f9f1850ec43673ac830b73e Author: Jeff Zhang AuthorDate: Thu Apr 11 14:32:25 2019 +0800 [ZEPPELIN-4066]. Introduce ProcessLauncher to encapsulate process launch ### What is this PR for? There're several places in zeppelin to launch processes, such as interpreter process launch, python process launch. Sometimes it is very hard to diagnose if the process is failed to launch or some error happens during its lifecycle. This PR introduce ProcessLauncher to encapsulate process launch. ProcessLauncher will do most of the process launching stuff but also allow for customization. E.g. how to check the process is started properly. And when error happens, ProcessLauncher will [...] ### What type of PR is it? [ Improvement | Refactoring] ### Todos * [ ] - Task ### What is the Jira issue? * https://jira.apache.org/jira/browse/ZEPPELIN-4066 ### How should this be tested? * Ci pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang Closes #3346 from zjffdu/ZEPPELIN-4066 and squashes the following commits: b847d6d86 [Jeff Zhang] Add state COMPLETED & also add transition method for more detail logging 97049bd55 [Jeff Zhang] [ZEPPELIN-4066]. Introduce ProcessLauncher to encapsulate process launch --- .../apache/zeppelin/python/IPythonInterpreter.java | 150 - .../apache/zeppelin/python/PythonInterpreter.java | 166 +-- .../zeppelin/python/IPythonInterpreterTest.java| 20 ++- .../zeppelin/python/PythonInterpreterTest.java | 33 +++- .../zeppelin/spark/IPySparkInterpreterTest.java| 23 ++- .../zeppelin/spark/PySparkInterpreterTest.java | 46 ++ zeppelin-interpreter-api/pom.xml | 4 + .../integration/ZeppelinSparkClusterTest.java | 40 - .../remote/RemoteInterpreterServer.java| 11 +- .../org/apache/zeppelin/util/ProcessLauncher.java | 165 +++ .../launcher/K8sRemoteInterpreterProcess.java | 5 + .../interpreter/remote/RemoteInterpreter.java | 9 ++ .../remote/RemoteInterpreterManagedProcess.java| 163 --- .../remote/RemoteInterpreterProcess.java | 2 + .../remote/RemoteInterpreterRunningProcess.java| 5 + .../org/apache/zeppelin/notebook/Paragraph.java| 179 +++-- .../interpreter/remote/RemoteInterpreterTest.java | 89 +- .../src/test/resources/bin/interpreter_invalid.sh | 19 +++ .../src/test/resources/bin/interpreter_timeout.sh | 19 +++ 19 files changed, 780 insertions(+), 368 deletions(-) diff --git a/python/src/main/java/org/apache/zeppelin/python/IPythonInterpreter.java b/python/src/main/java/org/apache/zeppelin/python/IPythonInterpreter.java index f4c753d..9f4c355 100644 --- a/python/src/main/java/org/apache/zeppelin/python/IPythonInterpreter.java +++ b/python/src/main/java/org/apache/zeppelin/python/IPythonInterpreter.java @@ -17,14 +17,9 @@ package org.apache.zeppelin.python; +import com.google.common.annotations.VisibleForTesting; import io.grpc.ManagedChannelBuilder; import org.apache.commons.exec.CommandLine; -import org.apache.commons.exec.DefaultExecutor; -import org.apache.commons.exec.ExecuteException; -import org.apache.commons.exec.ExecuteResultHandler; -import org.apache.commons.exec.ExecuteWatchdog; -import org.apache.commons.exec.LogOutputStream; -import org.apache.commons.exec.PumpStreamHandler; import org.apache.commons.exec.environment.EnvironmentUtils; import org.apache.commons.io.FileUtils; import org.apache.commons.io.IOUtils; @@ -48,6 +43,7 @@ import org.apache.zeppelin.python.proto.IPythonStatus; import org.apache.zeppelin.python.proto.StatusRequest; import org.apache.zeppelin.python.proto.StatusResponse; import org.apache.zeppelin.python.proto.StopRequest; +import org.apache.zeppelin.util.ProcessLauncher; import org.slf4j.Logger; import org.slf4j.LoggerFactory; import py4j.GatewayServer; @@ -66,23 +62,22 @@ import java.util.Properties; /** * IPython Interpreter for Zeppelin */ -public class IPythonInterpreter extends Interpreter implements ExecuteResultHandler { +public class IPythonInterpreter extends Interpreter { private static final Logger LOGGER = LoggerFactory.getLogger(IPythonInterpreter.class); - private ExecuteWatchdog watchDog; + private IPythonProcessLauncher iPythonProcessLaun
[zeppelin] branch master updated: ZEPPELIN-4062. Don't wait ipython kernel if python process failed
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 65a824e ZEPPELIN-4062. Don't wait ipython kernel if python process failed 65a824e is described below commit 65a824e9315649a4d349c7717f6b990d76239c9b Author: Jeff Zhang AuthorDate: Wed Mar 13 10:31:00 2019 +0800 ZEPPELIN-4062. Don't wait ipython kernel if python process failed ### What is this PR for? This PR will exist wait ipython process loop if the python process is failed. This can save time to exit the waiting loop earlier, otherwise it would wait until timeout (30 seconds by default) ### What type of PR is it? [Improvement] ### Todos * [ ] - Task ### What is the Jira issue? * https://jira.apache.org/jira/browse/ZEPPELIN-4062 ### How should this be tested? * Manually tested. Before this PR ``` INFO [2019-03-13 10:06:30,070] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:313) - Wait for IPython Kernel to be started INFO [2019-03-13 10:06:30,175] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:313) - Wait for IPython Kernel to be started INFO [2019-03-13 10:06:30,281] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:313) - Wait for IPython Kernel to be started INFO [2019-03-13 10:06:30,386] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:313) - Wait for IPython Kernel to be started INFO [2019-03-13 10:06:30,489] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:313) - Wait for IPython Kernel to be started INFO [2019-03-13 10:06:30,595] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:313) - Wait for IPython Kernel to be started INFO [2019-03-13 10:06:30,700] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:313) - Wait for IPython Kernel to be started INFO [2019-03-13 10:06:30,805] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:313) - Wait for IPython Kernel to be started WARN [2019-03-13 10:06:30,810] ({Exec Default Executor} IPythonInterpreter.java[onProcessFailed]:419) - Exception happens in Python Process org.apache.commons.exec.ExecuteException: Process exited with an error: 1 (Exit value: 1) at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:404) at org.apache.commons.exec.DefaultExecutor.access$200(DefaultExecutor.java:48) at org.apache.commons.exec.DefaultExecutor$1.run(DefaultExecutor.java:200) at java.lang.Thread.run(Thread.java:748) INFO [2019-03-13 10:06:30,910] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:313) - Wait for IPython Kernel to be started INFO [2019-03-13 10:06:31,015] ({FIFOScheduler-Worker-1} ``` After this PR ``` INFO [2019-03-13 10:28:12,805] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:314) - Wait for IPython Kernel to be started INFO [2019-03-13 10:28:12,907] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:314) - Wait for IPython Kernel to be started INFO [2019-03-13 10:28:13,011] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:314) - Wait for IPython Kernel to be started INFO [2019-03-13 10:28:13,116] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:314) - Wait for IPython Kernel to be started INFO [2019-03-13 10:28:13,220] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:314) - Wait for IPython Kernel to be started INFO [2019-03-13 10:28:13,325] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:314) - Wait for IPython Kernel to be started WARN [2019-03-13 10:28:13,347] ({Exec Default Executor} IPythonInterpreter.java[onProcessFailed]:423) - Exception happens in Python Process org.apache.commons.exec.ExecuteException: Process exited with an error: 1 (Exit value: 1) at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:404) at org.apache.commons.exec.DefaultExecutor.access$200(DefaultExecutor.java:48) at org.apache.commons.exec.DefaultExecutor$1.run(DefaultExecutor.java:200) at java.lang.Thread.run(Thread.java:748) INFO [2019-03-13 10:28:13,430] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:314) - Wait for IPython Kernel to be started WARN [2019-03-13 10:28:13,431] ({FIFOScheduler-Worker-1} PythonInterpreter.java[open]:98) - Fail to open IPythonInterpreter java.lang.RuntimeException: Fail to open IPythonInterpreter at org.apache.zeppelin.python.IPythonInterpreter.open
[zeppelin] branch branch-0.8 updated: ZEPPELIN-4062. Don't wait ipython kernel if python process failed
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch branch-0.8 in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/branch-0.8 by this push: new c49b0b6 ZEPPELIN-4062. Don't wait ipython kernel if python process failed c49b0b6 is described below commit c49b0b6d3fd471025e43b9e18b298355c079c0b4 Author: Jeff Zhang AuthorDate: Wed Mar 13 10:31:00 2019 +0800 ZEPPELIN-4062. Don't wait ipython kernel if python process failed ### What is this PR for? This PR will exist wait ipython process loop if the python process is failed. This can save time to exit the waiting loop earlier, otherwise it would wait until timeout (30 seconds by default) ### What type of PR is it? [Improvement] ### Todos * [ ] - Task ### What is the Jira issue? * https://jira.apache.org/jira/browse/ZEPPELIN-4062 ### How should this be tested? * Manually tested. Before this PR ``` INFO [2019-03-13 10:06:30,070] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:313) - Wait for IPython Kernel to be started INFO [2019-03-13 10:06:30,175] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:313) - Wait for IPython Kernel to be started INFO [2019-03-13 10:06:30,281] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:313) - Wait for IPython Kernel to be started INFO [2019-03-13 10:06:30,386] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:313) - Wait for IPython Kernel to be started INFO [2019-03-13 10:06:30,489] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:313) - Wait for IPython Kernel to be started INFO [2019-03-13 10:06:30,595] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:313) - Wait for IPython Kernel to be started INFO [2019-03-13 10:06:30,700] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:313) - Wait for IPython Kernel to be started INFO [2019-03-13 10:06:30,805] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:313) - Wait for IPython Kernel to be started WARN [2019-03-13 10:06:30,810] ({Exec Default Executor} IPythonInterpreter.java[onProcessFailed]:419) - Exception happens in Python Process org.apache.commons.exec.ExecuteException: Process exited with an error: 1 (Exit value: 1) at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:404) at org.apache.commons.exec.DefaultExecutor.access$200(DefaultExecutor.java:48) at org.apache.commons.exec.DefaultExecutor$1.run(DefaultExecutor.java:200) at java.lang.Thread.run(Thread.java:748) INFO [2019-03-13 10:06:30,910] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:313) - Wait for IPython Kernel to be started INFO [2019-03-13 10:06:31,015] ({FIFOScheduler-Worker-1} ``` After this PR ``` INFO [2019-03-13 10:28:12,805] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:314) - Wait for IPython Kernel to be started INFO [2019-03-13 10:28:12,907] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:314) - Wait for IPython Kernel to be started INFO [2019-03-13 10:28:13,011] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:314) - Wait for IPython Kernel to be started INFO [2019-03-13 10:28:13,116] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:314) - Wait for IPython Kernel to be started INFO [2019-03-13 10:28:13,220] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:314) - Wait for IPython Kernel to be started INFO [2019-03-13 10:28:13,325] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:314) - Wait for IPython Kernel to be started WARN [2019-03-13 10:28:13,347] ({Exec Default Executor} IPythonInterpreter.java[onProcessFailed]:423) - Exception happens in Python Process org.apache.commons.exec.ExecuteException: Process exited with an error: 1 (Exit value: 1) at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:404) at org.apache.commons.exec.DefaultExecutor.access$200(DefaultExecutor.java:48) at org.apache.commons.exec.DefaultExecutor$1.run(DefaultExecutor.java:200) at java.lang.Thread.run(Thread.java:748) INFO [2019-03-13 10:28:13,430] ({FIFOScheduler-Worker-1} IPythonInterpreter.java[launchIPythonKernel]:314) - Wait for IPython Kernel to be started WARN [2019-03-13 10:28:13,431] ({FIFOScheduler-Worker-1} PythonInterpreter.java[open]:98) - Fail to open IPythonInterpreter java.lang.RuntimeException: Fail to open IPythonInterpreter at org.apache.zeppelin.python.IPythonInterpreter.open
[zeppelin] branch master updated: [ZEPPELIN-4152]. Use spark 2.2 as the default profile
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 584e28f [ZEPPELIN-4152]. Use spark 2.2 as the default profile 584e28f is described below commit 584e28f72db275bc81a7314213e5367decd92504 Author: Jeff Zhang AuthorDate: Mon May 13 10:06:31 2019 +0800 [ZEPPELIN-4152]. Use spark 2.2 as the default profile ### What is this PR for? Trivial PR to use spark 2.2 as the default profile so that the default build command can pass ``` mvn clean package -DskipTests ``` ### What type of PR is it? [ Improvement ] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-4152 ### How should this be tested? * CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang Closes #3360 from zjffdu/ZEPPELIN-4152 and squashes the following commits: 629ae1afd [Jeff Zhang] [ZEPPELIN-4152]. Use spark 2.2 as the default profile --- spark/pom.xml | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/spark/pom.xml b/spark/pom.xml index 0d88246..9b703ca 100644 --- a/spark/pom.xml +++ b/spark/pom.xml @@ -196,9 +196,6 @@ 2.5.0 0.10.7 - -true - @@ -212,6 +209,9 @@ spark-2.2 + +true + 2.2.1 0.10.4
[zeppelin] branch master updated: [ZEPPELIN-4148]. Move GitNotebookRepo into zeppelin-zengine as default NotebookRepo
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 9f63320 [ZEPPELIN-4148]. Move GitNotebookRepo into zeppelin-zengine as default NotebookRepo 9f63320 is described below commit 9f63320fd5099bb124ce5321cc571cd0799b88aa Author: Jeff Zhang AuthorDate: Thu May 9 17:48:38 2019 +0800 [ZEPPELIN-4148]. Move GitNotebookRepo into zeppelin-zengine as default NotebookRepo ### What is this PR for? We should make zeppelin-zengine work without building plugins. So it make sense to move `GitNotebookRepo` into zeppelin-zengine as it is also the default NotebookRepo if not specified in `zeppelin-site.xml` ### What type of PR is it? [ Improvement ] ### Todos * [ ] - Task ### What is the Jira issue? * https://jira.apache.org/jira/browse/ZEPPELIN-4148 ### How should this be tested? * CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang Closes #3366 from zjffdu/ZEPPELIN-4148 and squashes the following commits: 5c5b2e5ca [Jeff Zhang] [ZEPPELIN-4148]. Move GitNotebookRepo into zeppelin-zengine as default NotebookRepo --- zeppelin-plugins/notebookrepo/git/pom.xml | 79 -- .../git/src/test/resources/log4j.properties| 50 -- zeppelin-plugins/notebookrepo/github/pom.xml | 8 --- zeppelin-plugins/notebookrepo/vfs/pom.xml | 66 -- zeppelin-plugins/pom.xml | 2 - zeppelin-zengine/pom.xml | 20 ++ .../zeppelin/notebook/repo/GitNotebookRepo.java| 0 .../zeppelin/notebook/repo/OldGitNotebookRepo.java | 0 .../zeppelin/notebook/repo/OldVFSNotebookRepo.java | 0 .../zeppelin/notebook/repo/VFSNotebookRepo.java| 0 .../org/apache/zeppelin/plugin/PluginManager.java | 19 +++--- .../notebook/repo/GitNotebookRepoTest.java | 5 +- .../repo/NotebookRepoSyncInitializationTest.java | 0 .../notebook/repo/NotebookRepoSyncTest.java| 0 .../notebook/repo/VFSNotebookRepoTest.java | 0 .../notebook/repo/mock/VFSNotebookRepoMock.java| 0 .../notebook/my_project/my_note1_2A94M5J1Z.zpln| 0 .../notebook/my_project/my_note2_2A94M5J2Z.zpln| 0 18 files changed, 31 insertions(+), 218 deletions(-) diff --git a/zeppelin-plugins/notebookrepo/git/pom.xml b/zeppelin-plugins/notebookrepo/git/pom.xml deleted file mode 100644 index 6f75502..000 --- a/zeppelin-plugins/notebookrepo/git/pom.xml +++ /dev/null @@ -1,79 +0,0 @@ - - - -http://maven.apache.org/POM/4.0.0; - xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance; - xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd;> - -4.0.0 - - -zengine-plugins-parent -org.apache.zeppelin -0.9.0-SNAPSHOT -../../../zeppelin-plugins - - -org.apache.zeppelin -notebookrepo-git -jar -0.9.0-SNAPSHOT -Zeppelin: Plugin GitNotebookRepo -NotebookRepo implementation based on Git - - -4.5.4.201711221230-r -0.27 -NotebookRepo/GitNotebookRepo - - - - -org.apache.zeppelin -notebookrepo-vfs -${project.version} - - - -org.eclipse.jgit -org.eclipse.jgit -${eclipse.jgit.version} - - - -com.google.truth -truth -${google.truth.version} -test - - -com.google.guava -guava - - - - - - - - -maven-dependency-plugin - - - - diff --git a/zeppelin-plugins/notebookrepo/git/src/test/resources/log4j.properties b/zeppelin-plugins/notebookrepo/git/src/test/resources/log4j.properties deleted file mode 100644 index 661632b..000 --- a/zeppelin-plugins/notebookrepo/git/src/test/resources/log4j.properties +++ /dev/null @@ -1,50 +0,0 @@ -# -# Licensed to the Apache Software Foundation (ASF) under one or more -# contributor license agreements. See the NOTICE file distributed with -# this work for additional information regarding copyright ownership. -# The ASF licenses this file to You under the Apache License, Version 2.0 -# (the "License"); you may not use this file except in compliance with -# the License. You may obtain a copy of the License at -# -#http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing,
[zeppelin] branch master updated: [ZEPPELIN-4132]. Spark Interpreter has issue of SPARK-22393
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 1ca7039 [ZEPPELIN-4132]. Spark Interpreter has issue of SPARK-22393 1ca7039 is described below commit 1ca7039f02c81fdaa41d185c67810fcf197da3a9 Author: Jeff Zhang AuthorDate: Wed Apr 24 17:05:42 2019 +0800 [ZEPPELIN-4132]. Spark Interpreter has issue of SPARK-22393 ### What is this PR for? This PR fix the issue of SPARK-22393 in zeppelin. We can fix this by using `SparkIMain` instead of `IMain`. ### What type of PR is it? [Bug Fix] ### Todos * [ ] - Task ### What is the Jira issue? * https://jira.apache.org/jira/browse/ZEPPELIN-4132 ### How should this be tested? * Unit test is added ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang Closes #3353 from zjffdu/ZEPPELIN-4132 and squashes the following commits: c94b34af2 [Jeff Zhang] [ZEPPELIN-4132]. Spark Interpreter has issue of SPARK-22393 --- .travis.yml| 2 +- .../java/org/apache/zeppelin/spark/NewSparkInterpreterTest.java| 7 +++ .../scala/org/apache/zeppelin/spark/SparkScala211Interpreter.scala | 5 +++-- 3 files changed, 11 insertions(+), 3 deletions(-) diff --git a/.travis.yml b/.travis.yml index 7a9fedf..2335911 100644 --- a/.travis.yml +++ b/.travis.yml @@ -109,7 +109,7 @@ matrix: - sudo: required jdk: "oraclejdk8" dist: trusty - env: BUILD_PLUGINS="true" PYTHON="3" SCALA_VER="2.11" PROFILE="-Pspark-2.2 -Pscala-2.11 -Phadoop2 -Pintegration" SPARKR="true" BUILD_FLAG="install -DskipTests -DskipRat -am" TEST_FLAG="test -DskipRat -am" MODULES="-pl zeppelin-interpreter-integration,zeppelin-web,spark/spark-dependencies" TEST_PROJECTS="-Dtest=ZeppelinSparkClusterTest22,SparkIntegrationTest22,org.apache.zeppelin.spark.* -DfailIfNoTests=false" + env: BUILD_PLUGINS="true" PYTHON="3" SCALA_VER="2.10" PROFILE="-Pspark-2.2 -Pscala-2.10 -Phadoop2 -Pintegration" SPARKR="true" BUILD_FLAG="install -DskipTests -DskipRat -am" TEST_FLAG="test -DskipRat -am" MODULES="-pl zeppelin-interpreter-integration,zeppelin-web,spark/spark-dependencies" TEST_PROJECTS="-Dtest=ZeppelinSparkClusterTest22,SparkIntegrationTest22,org.apache.zeppelin.spark.* -DfailIfNoTests=false" # ZeppelinSparkClusterTest21, SparkIntegrationTest21, Unit test of Spark 2.1 - sudo: required diff --git a/spark/interpreter/src/test/java/org/apache/zeppelin/spark/NewSparkInterpreterTest.java b/spark/interpreter/src/test/java/org/apache/zeppelin/spark/NewSparkInterpreterTest.java index 773deae..7faae2c 100644 --- a/spark/interpreter/src/test/java/org/apache/zeppelin/spark/NewSparkInterpreterTest.java +++ b/spark/interpreter/src/test/java/org/apache/zeppelin/spark/NewSparkInterpreterTest.java @@ -164,6 +164,13 @@ public class NewSparkInterpreterTest { "val circle1 = new Circle(5.0)", getInterpreterContext()); assertEquals(InterpreterResult.Code.SUCCESS, result.code()); +// class extend +result = interpreter.interpret("import java.util.ArrayList", getInterpreterContext()); +assertEquals(InterpreterResult.Code.SUCCESS, result.code()); + +result = interpreter.interpret("class MyArrayList extends ArrayList{}", getInterpreterContext()); +assertEquals(InterpreterResult.Code.SUCCESS, result.code()); + // spark rdd operation result = interpreter.interpret("sc\n.range(1, 10)\n.sum", getInterpreterContext()); assertEquals(InterpreterResult.Code.SUCCESS, result.code()); diff --git a/spark/scala-2.11/src/main/scala/org/apache/zeppelin/spark/SparkScala211Interpreter.scala b/spark/scala-2.11/src/main/scala/org/apache/zeppelin/spark/SparkScala211Interpreter.scala index 0956e04..8465145 100644 --- a/spark/scala-2.11/src/main/scala/org/apache/zeppelin/spark/SparkScala211Interpreter.scala +++ b/spark/scala-2.11/src/main/scala/org/apache/zeppelin/spark/SparkScala211Interpreter.scala @@ -22,6 +22,7 @@ import java.net.URLClassLoader import java.nio.file.{Files, Paths} import org.apache.spark.SparkConf +import org.apache.spark.repl.SparkILoop import org.apache.zeppelin.interpreter.thrift.InterpreterCompletion import org.apache.zeppelin.interpreter.util.InterpreterOutputStream import org.apache.zeppelin.interpreter.{InterpreterContext, InterpreterResult} @@ -43,7 +44,7 @@ class SparkScala211Interpre
[zeppelin] branch branch-0.8 updated: [ZEPPELIN-4132]. Spark Interpreter has issue of SPARK-22393
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch branch-0.8 in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/branch-0.8 by this push: new a006aff [ZEPPELIN-4132]. Spark Interpreter has issue of SPARK-22393 a006aff is described below commit a006affe46c0d4826aa2ddcb1493d743e2a33a8d Author: Jeff Zhang AuthorDate: Wed Apr 24 17:05:42 2019 +0800 [ZEPPELIN-4132]. Spark Interpreter has issue of SPARK-22393 This PR fix the issue of SPARK-22393 in zeppelin. We can fix this by using `SparkIMain` instead of `IMain`. [Bug Fix] * [ ] - Task * https://jira.apache.org/jira/browse/ZEPPELIN-4132 * Unit test is added * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang Closes #3353 from zjffdu/ZEPPELIN-4132 and squashes the following commits: c94b34af2 [Jeff Zhang] [ZEPPELIN-4132]. Spark Interpreter has issue of SPARK-22393 (cherry picked from commit 1ca7039f02c81fdaa41d185c67810fcf197da3a9) Signed-off-by: Jeff Zhang --- .travis.yml| 2 +- .../java/org/apache/zeppelin/spark/NewSparkInterpreterTest.java| 7 +++ .../scala/org/apache/zeppelin/spark/SparkScala211Interpreter.scala | 5 +++-- 3 files changed, 11 insertions(+), 3 deletions(-) diff --git a/.travis.yml b/.travis.yml index aaf4892..e01a715 100644 --- a/.travis.yml +++ b/.travis.yml @@ -101,7 +101,7 @@ matrix: - sudo: required jdk: "oraclejdk8" dist: trusty - env: PYTHON="3" SCALA_VER="2.11" PROFILE="-Pspark-2.2 -Pscala-2.11 -Phadoop2 -Pintegration" SPARKR="true" BUILD_FLAG="install -DskipTests -DskipRat -am" TEST_FLAG="test -DskipRat -am" MODULES="-pl zeppelin-server,zeppelin-web,spark/interpreter,spark/spark-dependencies" TEST_PROJECTS="-Dtest=ZeppelinSparkClusterTest22,SparkIntegrationTest22,org.apache.zeppelin.spark.* -DfailIfNoTests=false" + env: PYTHON="3" SCALA_VER="2.10" PROFILE="-Pspark-2.2 -Pscala-2.10 -Phadoop2 -Pintegration" SPARKR="true" BUILD_FLAG="install -DskipTests -DskipRat -am" TEST_FLAG="test -DskipRat -am" MODULES="-pl zeppelin-server,zeppelin-web,spark/interpreter,spark/spark-dependencies" TEST_PROJECTS="-Dtest=ZeppelinSparkClusterTest22,SparkIntegrationTest22,org.apache.zeppelin.spark.* -DfailIfNoTests=false" # ZeppelinSparkClusterTest21, SparkIntegrationTest21, Unit test of Spark 2.1 - sudo: required diff --git a/spark/interpreter/src/test/java/org/apache/zeppelin/spark/NewSparkInterpreterTest.java b/spark/interpreter/src/test/java/org/apache/zeppelin/spark/NewSparkInterpreterTest.java index a0d1d67..312839a 100644 --- a/spark/interpreter/src/test/java/org/apache/zeppelin/spark/NewSparkInterpreterTest.java +++ b/spark/interpreter/src/test/java/org/apache/zeppelin/spark/NewSparkInterpreterTest.java @@ -159,6 +159,13 @@ public class NewSparkInterpreterTest { "object Counter {\n def apply(x: Long) = new Counter()\n}", getInterpreterContext()); assertEquals(InterpreterResult.Code.SUCCESS, result.code()); +// class extend +result = interpreter.interpret("import java.util.ArrayList", getInterpreterContext()); +assertEquals(InterpreterResult.Code.SUCCESS, result.code()); + +result = interpreter.interpret("class MyArrayList extends ArrayList{}", getInterpreterContext()); +assertEquals(InterpreterResult.Code.SUCCESS, result.code()); + // spark rdd operation result = interpreter.interpret("sc.range(1, 10).sum", getInterpreterContext()); assertEquals(InterpreterResult.Code.SUCCESS, result.code()); diff --git a/spark/scala-2.11/src/main/scala/org/apache/zeppelin/spark/SparkScala211Interpreter.scala b/spark/scala-2.11/src/main/scala/org/apache/zeppelin/spark/SparkScala211Interpreter.scala index 0956e04..8465145 100644 --- a/spark/scala-2.11/src/main/scala/org/apache/zeppelin/spark/SparkScala211Interpreter.scala +++ b/spark/scala-2.11/src/main/scala/org/apache/zeppelin/spark/SparkScala211Interpreter.scala @@ -22,6 +22,7 @@ import java.net.URLClassLoader import java.nio.file.{Files, Paths} import org.apache.spark.SparkConf +import org.apache.spark.repl.SparkILoop import org.apache.zeppelin.interpreter.thrift.InterpreterCompletion import org.apache.zeppelin.interpreter.util.InterpreterOutputStream import org.apache.zeppelin.interpreter.{InterpreterContext, InterpreterResult} @@ -43,7 +44,7 @@ class SparkScala211Interpreter(override val conf: SparkConf, lazy override val LOGGER: Logger = LoggerFactory.getLogger(getClass) - private
[zeppelin] branch branch-0.8 updated: [ZEPPELIN-3529] Add uName into jobGroupId for checking user
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch branch-0.8 in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/branch-0.8 by this push: new aefe527 [ZEPPELIN-3529] Add uName into jobGroupId for checking user aefe527 is described below commit aefe5272ff699aaffbbacc6a9b08cd5e84df417f Author: Jaehoon Jeong AuthorDate: Tue Jun 5 21:02:16 2018 +0900 [ZEPPELIN-3529] Add uName into jobGroupId for checking user ### What is this PR for? Need to check user in jobGroupId because when some paragraph is running, who run paragraph cannot be found in spark application web UI. I just add to userId. ### What type of PR is it? [Improvement] ### Todos * [x] - Modify Code ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-3529 ### How should this be tested? * Check jobGroupId in Spark Application Web UI of Zeppelin Spark Interpreter ### Questions: * Does the licenses files need update? * No * Is there breaking changes for older versions? * No * Does this needs documentation? * No Author: Jaehoon Jeong Closes #3006 from woowahan-jaehoon/ZEPPELIN-3529 and squashes the following commits: b1da18c46 [Jaehoon Jeong] [ZEPPELIN-3529] Add uName into jobGroupId for checking user (cherry picked from commit 80de4bbc0233815200f1baf8d6c4e570073bcc79) Signed-off-by: Jeff Zhang --- .../interpreter/src/main/java/org/apache/zeppelin/spark/Utils.java | 6 +- 1 file changed, 5 insertions(+), 1 deletion(-) diff --git a/spark/interpreter/src/main/java/org/apache/zeppelin/spark/Utils.java b/spark/interpreter/src/main/java/org/apache/zeppelin/spark/Utils.java index 82bf210..ccfc348 100644 --- a/spark/interpreter/src/main/java/org/apache/zeppelin/spark/Utils.java +++ b/spark/interpreter/src/main/java/org/apache/zeppelin/spark/Utils.java @@ -149,7 +149,11 @@ class Utils { } public static String buildJobGroupId(InterpreterContext context) { -return "zeppelin-" + context.getNoteId() + "-" + context.getParagraphId(); +String uName = "anonymous"; +if (context.getAuthenticationInfo() != null) { + uName = getUserName(context.getAuthenticationInfo()); +} +return "zeppelin-" + uName + "-" + context.getNoteId() + "-" + context.getParagraphId(); } public static String getNoteId(String jobgroupId) {
[zeppelin] branch master updated: changed-readme-for-python-interpreter-for-apache-zeppelin
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 2ba03d0 changed-readme-for-python-interpreter-for-apache-zeppelin 2ba03d0 is described below commit 2ba03d03aa6c450751d35b20e2ddae64f4f301ca Author: Nikhil Nagpal AuthorDate: Sun Apr 7 11:51:54 2019 +0530 changed-readme-for-python-interpreter-for-apache-zeppelin ### What is this PR for? Fixed some of the grammatical issues with the documentation for Python Interpreter for Apache Zeppelin. ### What type of PR is it? Documentation ### What is the Jira issue? * Issue link :- https://issues.apache.org/jira/browse/ZEPPELIN-4111 Author: Nikhil Nagpal Author: d3adp007 Closes #3348 from d3adp007/master and squashes the following commits: 41bcd2b4b [Nikhil Nagpal] updated-after-changes-suggested 33cd8d89c [d3adp007] changed-readme-for-python-interpreter-for-apache-zeppelin --- python/README.md | 8 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/python/README.md b/python/README.md index 1b9e91b..29dc1f0 100644 --- a/python/README.md +++ b/python/README.md @@ -24,7 +24,7 @@ mvn -Dpython.test.exclude='' test -pl python -am * Python 2 or 3 installed with py4j (0.9.2) and matplotlib (1.31 or later) installed on each - * Tests only checks the interpreter logic and starts any Python process! Python process is mocked with a class that simply output it input. + * Tests only checks the interpreter logic and starts any Python process! Python process is mocked with a class that simply output its input. * Code wrote in `bootstrap.py` and `bootstrap_input.py` should always be Python 2 and 3 compliant. @@ -38,13 +38,13 @@ mvn -Dpython.test.exclude='' test -pl python -am * When interpreter is starting, it sends some Python code (bootstrap.py and bootstrap_input.py) to initialize default behavior and functions (`help(), z.input()...`). bootstrap_input.py is sent only if py4j library is detected inside Python process. - * [Py4J](https://www.py4j.org/) python and java libraries is used to load Input zeppelin Java class into the python process (make java code with python code !). Therefore the interpreter can directly create Zeppelin input form inside the Python process (and eventually with some python variable already defined). JVM opens a random open port to be accessible from python process. + * [Py4J](https://www.py4j.org/) Python and Java libraries are used to load input zeppelin Java class into the python process (make java code with python code !). Therefore the interpreter can directly create Zeppelin input form inside the Python process (and eventually with some python variable already defined). JVM opens a random open port to be accessible from python process. - * JavaBuilder can't send SIGINT signal to interrupt paragraph execution. Therefore interpreter directly send a `kill SIGINT PID` to python process to interrupt execution. Python process catch SIGINT signal with some code defined in bootstrap.py + * JavaBuilder can't send SIGINT signal to interrupt paragraph execution. Therefore interpreter will directly send a `kill SIGINT PID` to python process to interrupt execution. Python process catches SIGINT signal with some code defined in bootstrap.py * Matplotlib figures are displayed inline with the notebook automatically using a built-in backend for zeppelin in conjunction with a post-execute hook. - * `%python.sql` support for Pandas DataFrames is optional and provided using https://github.com/yhat/pandasql if user have one installed + * `%python.sql` support for Pandas DataFrames is optional but can be downloaded from [here](https://github.com/yhat/pandasql) if user does not have one installed. # IPython Overview
[zeppelin] branch master updated: ZEPPELIN-4161. Add travis job for default build
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new b56c216 ZEPPELIN-4161. Add travis job for default build b56c216 is described below commit b56c21626d23df59ae85fc2668787dafb123c9cf Author: Jeff Zhang AuthorDate: Wed May 15 17:30:22 2019 +0800 ZEPPELIN-4161. Add travis job for default build ### What is this PR for? This PR add one travis job to build zeppelin by default command: ``` mvn clean package -DskipTests ``` ### What type of PR is it? [Improvement] ### Todos * [ ] - Task ### What is the Jira issue? * https://jira.apache.org/jira/browse/ZEPPELIN-4161 ### How should this be tested? * CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang Closes #3368 from zjffdu/ZEPPELIN-4161 and squashes the following commits: 358438c60 [Jeff Zhang] ZEPPELIN-4161. Add travis job for default build --- .travis.yml | 6 ++ 1 file changed, 6 insertions(+) diff --git a/.travis.yml b/.travis.yml index 2335911..0a02d08 100644 --- a/.travis.yml +++ b/.travis.yml @@ -57,6 +57,12 @@ matrix: dist: trusty env: SCALA_VER="2.11" PROFILE="-Prat" BUILD_FLAG="clean" TEST_FLAG="org.apache.rat:apache-rat-plugin:check" TEST_PROJECTS="" +# Default build command, no tests +- sudo: required + jdk: "oraclejdk8" + dist: trusty + env: BUILD_FLAG="clean package -DskipTests" TEST_FLAG="test -DskipTests" + # Run e2e tests (in zeppelin-web) # chrome dropped the support for precise (ubuntu 12.04), so need to use trusty # also, can't use JDK 7 in trusty: https://github.com/travis-ci/travis-ci/issues/7884
[zeppelin] branch master updated: ZEPPELIN-4153. Move zeppelin-interpreter-api jar out of interpreter jar
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new ecb59de ZEPPELIN-4153. Move zeppelin-interpreter-api jar out of interpreter jar ecb59de is described below commit ecb59de25b6722e2dd7d2905365fe773b6e33434 Author: Jeff Zhang AuthorDate: Tue May 14 23:10:18 2019 +0800 ZEPPELIN-4153. Move zeppelin-interpreter-api jar out of interpreter jar ### What is this PR for? This PR is to move zeppelin-interpreter-api jar out of interpreter jar, and put it under folder ${ZEPPELIN_HOME}/interpreter which is shared between all interpreters. ### What type of PR is it? [Improvement] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-4153 ### How should this be tested? * CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang Closes #3361 from zjffdu/ZEPPELIN-4153 and squashes the following commits: 4491b0c0f [Jeff Zhang] address comment for pom file of cassandra e12563dc2 [Jeff Zhang] [ZEPPELIN-4153]. Move zeppelin-interpreter-api jar out of interpreter jar --- bin/interpreter.sh | 3 +- cassandra/pom.xml | 6 ++ python/pom.xml | 5 ++ spark/interpreter/pom.xml | 120 +--- zeppelin-interpreter-api/pom.xml| 20 ++ zeppelin-interpreter-parent/pom.xml | 6 ++ 6 files changed, 41 insertions(+), 119 deletions(-) diff --git a/bin/interpreter.sh b/bin/interpreter.sh index 0bbfd0c..1ad7b1d 100755 --- a/bin/interpreter.sh +++ b/bin/interpreter.sh @@ -69,7 +69,8 @@ fi . "${bin}/common.sh" -ZEPPELIN_INTP_CLASSPATH="${CLASSPATH}" +ZEPPELIN_INTERPRETER_API_JAR=$(find "${ZEPPELIN_HOME}/interpreter" -name 'zeppelin-interpreter-api-*.jar') +ZEPPELIN_INTP_CLASSPATH="${CLASSPATH}:${ZEPPELIN_INTERPRETER_API_JAR}" # construct classpath if [[ -d "${ZEPPELIN_HOME}/zeppelin-interpreter/target/classes" ]]; then diff --git a/cassandra/pom.xml b/cassandra/pom.xml index 8e6b708..80a0658 100644 --- a/cassandra/pom.xml +++ b/cassandra/pom.xml @@ -59,6 +59,12 @@ zeppelin-interpreter ${project.version} test + + +org.hamcrest +hamcrest-all + + diff --git a/python/pom.xml b/python/pom.xml index 2700cba..d2eb09d 100644 --- a/python/pom.xml +++ b/python/pom.xml @@ -190,6 +190,11 @@ reference.conf + + + org.apache.zeppelin:zeppelin-interpreter-api + + ${project.build.directory}/../../interpreter/python/${interpreter.jar.name}-${project.version}.jar diff --git a/spark/interpreter/pom.xml b/spark/interpreter/pom.xml index d32e3bd..72f00ae 100644 --- a/spark/interpreter/pom.xml +++ b/spark/interpreter/pom.xml @@ -157,124 +157,7 @@ ${spark.version} provided - - - - org.apache.maven - maven-plugin-api - ${maven.plugin.api.version} - - - org.codehaus.plexus - plexus-utils - - - org.sonatype.sisu - sisu-inject-plexus - - - org.apache.maven - maven-model - - - - - - org.sonatype.aether - aether-api - ${aether.version} - - - - org.sonatype.aether - aether-util - ${aether.version} - - - - org.sonatype.aether - aether-impl - ${aether.version} - - - - org.apache.maven - maven-aether-provider - ${maven.aeither.provider.version} - - - org.sonatype.aether - aether-api - - - org.sonatype.aether - aether-spi - - - org.sonatype.aether - aether-util - - - org.sonatype.aether - aether-impl - - - org.codehaus.plexus - plexus-utils - - - - - - org.sonatype.aether - aether-connector-file - ${aether.version} - - - - org.sonatype.aether - aether-connector-wagon - ${aether.version} - - - org.apache.maven.wagon - wagon-provider-api - - - - - - org.apache.maven.wagon - wagon-provider-api - ${wagon.version} - - -
[zeppelin] branch master updated: [HOTFIX] Specify scipy version to fix travis failure
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new f3f4c90 [HOTFIX] Specify scipy version to fix travis failure f3f4c90 is described below commit f3f4c900f50e2d0b3c6e37a81a0d7353717a2444 Author: Jeff Zhang AuthorDate: Tue May 21 12:10:05 2019 +0800 [HOTFIX] Specify scipy version to fix travis failure --- testing/install_external_dependencies.sh | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/testing/install_external_dependencies.sh b/testing/install_external_dependencies.sh index a5ceac2..47ab9e7 100755 --- a/testing/install_external_dependencies.sh +++ b/testing/install_external_dependencies.sh @@ -47,8 +47,8 @@ if [[ -n "$PYTHON" ]] ; then conda info -a conda config --add channels conda-forge - conda install -q numpy=1.12.1 pandas=0.21.1 matplotlib=2.1.1 pandasql=0.7.3 ipython=5.4.1 jupyter_client=5.1.0 ipykernel=4.7.0 bokeh=0.12.10 - pip install -q ggplot==0.11.5 grpcio==1.8.2 bkzep==0.4.0 + conda install -q numpy=1.13.3 pandas=0.21.1 matplotlib=2.1.1 pandasql=0.7.3 ipython=5.4.1 jupyter_client=5.1.0 ipykernel=4.7.0 bokeh=0.12.10 + pip install -q scipy==0.18.0 ggplot==0.11.5 grpcio==1.8.2 bkzep==0.4.0 if [[ -n "$TENSORFLOW" ]] ; then check_results=`conda search -c conda-forge tensorflow`
[zeppelin] branch master updated: [ZEPPELIN-4147]. Fail to rename folder
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 8babd76 [ZEPPELIN-4147]. Fail to rename folder 8babd76 is described below commit 8babd76f3f2093695e045e4b47fa54c7d5104757 Author: Jeff Zhang AuthorDate: Thu May 9 17:35:04 2019 +0800 [ZEPPELIN-4147]. Fail to rename folder ### What is this PR for? It is a trivial bug fox for rename folder failure. The root cause is that the folder path is not including leading `/` which is required by NotebookRepo. ### What type of PR is it? [Bug Fix] ### Todos * [ ] - Task ### What is the Jira issue? * https://jira.apache.org/jira/browse/ZEPPELIN-4147 ### How should this be tested? * CI Pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang Closes #3367 from zjffdu/ZEPPELIN-4147 and squashes the following commits: 51c05c168 [Jeff Zhang] [ZEPPELIN-4147]. Fail to rename folder --- .../main/java/org/apache/zeppelin/service/NotebookService.java | 10 +- .../java/org/apache/zeppelin/service/NotebookServiceTest.java | 9 - .../apache/zeppelin/notebook/repo/InMemoryNotebookRepo.java| 6 ++ 3 files changed, 23 insertions(+), 2 deletions(-) diff --git a/zeppelin-server/src/main/java/org/apache/zeppelin/service/NotebookService.java b/zeppelin-server/src/main/java/org/apache/zeppelin/service/NotebookService.java index 2b829fd..bb42ce2 100644 --- a/zeppelin-server/src/main/java/org/apache/zeppelin/service/NotebookService.java +++ b/zeppelin-server/src/main/java/org/apache/zeppelin/service/NotebookService.java @@ -156,6 +156,13 @@ public class NotebookService { } } + /** + * normalize both note name and note folder + * + * @param notePath + * @return + * @throws IOException + */ String normalizeNotePath(String notePath) throws IOException { if (StringUtils.isBlank(notePath)) { notePath = "/Untitled Note"; @@ -949,7 +956,8 @@ public class NotebookService { //TODO(zjffdu) folder permission check try { - notebook.moveFolder(folderPath, newFolderPath, context.getAutheInfo()); + notebook.moveFolder(normalizeNotePath(folderPath), + normalizeNotePath(newFolderPath), context.getAutheInfo()); List notesInfo = notebook.getNotesInfo( noteId -> authorizationService.isReader(noteId, context.getUserAndRoles())); callback.onSuccess(notesInfo, context); diff --git a/zeppelin-server/src/test/java/org/apache/zeppelin/service/NotebookServiceTest.java b/zeppelin-server/src/test/java/org/apache/zeppelin/service/NotebookServiceTest.java index f37418e..e4df8c3 100644 --- a/zeppelin-server/src/test/java/org/apache/zeppelin/service/NotebookServiceTest.java +++ b/zeppelin-server/src/test/java/org/apache/zeppelin/service/NotebookServiceTest.java @@ -175,6 +175,13 @@ public class NotebookServiceTest { assertEquals(1, notesInfo.size()); assertEquals("/folder_3/new_name", notesInfo.get(0).getPath()); +// move folder in case of folder path without prefix '/' +reset(callback); +notesInfo = notebookService.renameFolder("folder_3", "folder_4", context, callback); +verify(callback).onSuccess(notesInfo, context); +assertEquals(1, notesInfo.size()); +assertEquals("/folder_4/new_name", notesInfo.get(0).getPath()); + // create another note note2 = notebookService.createNote("/note2", "test", context, callback); assertEquals("note2", note2.getName()); @@ -204,7 +211,7 @@ public class NotebookServiceTest { verify(callback).onSuccess(notesInfo, context); // delete folder -notesInfo = notebookService.removeFolder("/folder_3", context, callback); +notesInfo = notebookService.removeFolder("/folder_4", context, callback); verify(callback).onSuccess(notesInfo, context); // list note again diff --git a/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/repo/InMemoryNotebookRepo.java b/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/repo/InMemoryNotebookRepo.java index 1793f9c..187cfc0 100644 --- a/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/repo/InMemoryNotebookRepo.java +++ b/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/repo/InMemoryNotebookRepo.java @@ -71,6 +71,12 @@ public class InMemoryNotebookRepo implements NotebookRepo { @Override public void move(String folderPath, String newFolderPath, AuthenticationInfo subject) { +if (!folderPath.startsWith("/
[zeppelin] branch master updated: [HOTFIX] Fix spark integration test fail
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 4fc7f08 [HOTFIX] Fix spark integration test fail 4fc7f08 is described below commit 4fc7f0881ea1390d0b21da9fbd38fc2d9c3dac73 Author: Jeff Zhang AuthorDate: Fri Apr 19 15:12:14 2019 +0800 [HOTFIX] Fix spark integration test fail (cherry picked from commit 081d6d832caaf6e6d9e75a45a419db0d39f0e14b) --- .travis.yml | 4 ++-- testing/downloadSpark.sh | 2 +- .../java/org/apache/zeppelin/integration/SparkIntegrationTest.java| 3 +++ .../org/apache/zeppelin/integration/ZeppelinSparkClusterTest.java | 2 +- 4 files changed, 7 insertions(+), 4 deletions(-) diff --git a/.travis.yml b/.travis.yml index 5334760..7a9fedf 100644 --- a/.travis.yml +++ b/.travis.yml @@ -79,12 +79,12 @@ matrix: dist: trusty env: PYTHON="3" SPARKR="true" PROFILE="-Pspark-2.2 -Phelium-dev -Pexamples -Pscala-2.11" BUILD_FLAG="install -Pbuild-distr -DskipRat" TEST_FLAG="verify -Pusing-packaged-distr -DskipRat" MODULES="-pl ${INTERPRETERS}" TEST_PROJECTS="-Dtests.to.exclude=**/JdbcIntegrationTest.java,**/SparkIntegrationTest.java,**/ZeppelinSparkClusterTest.java,**/org/apache/zeppelin/spark/*,**/HeliumApplicationFactoryTest.java -DfailIfNoTests=false" -# Test selenium with spark module for 1.6.3 +# Test selenium with spark module for spark 2.3 - jdk: "oraclejdk8" dist: trusty addons: firefox: "31.0" - env: BUILD_PLUGINS="true" CI="true" PYTHON="2" SCALA_VER="2.10" SPARK_VER="1.6.3" HADOOP_VER="2.6" PROFILE="-Pspark-1.6 -Phadoop2 -Phelium-dev -Pexamples -Pintegration -Pscala-2.10" BUILD_FLAG="install -DskipTests -DskipRat -pl ${INTERPRETERS}" TEST_FLAG="verify -DskipRat" TEST_PROJECTS="-pl zeppelin-integration -DfailIfNoTests=false" + env: BUILD_PLUGINS="true" CI="true" PYTHON="2" SCALA_VER="2.11" SPARK_VER="2.3.2" HADOOP_VER="2.6" PROFILE="-Pspark-2.3 -Phadoop2 -Phelium-dev -Pexamples -Pintegration -Pscala-2.11" BUILD_FLAG="install -DskipTests -DskipRat -pl ${INTERPRETERS}" TEST_FLAG="verify -DskipRat" TEST_PROJECTS="-pl zeppelin-integration -DfailIfNoTests=false" # Test interpreter modules - jdk: "oraclejdk8" diff --git a/testing/downloadSpark.sh b/testing/downloadSpark.sh index 8aad2d8..9c19e82 100755 --- a/testing/downloadSpark.sh +++ b/testing/downloadSpark.sh @@ -66,7 +66,7 @@ if [[ ! -d "${SPARK_HOME}" ]]; then echo "${SPARK_VERSION} being downloaded from archives" STARTTIME=`date +%s` #timeout -s KILL "${MAX_DOWNLOAD_TIME_SEC}" wget "http://archive.apache.org/dist/spark/spark-${SPARK_VERSION}/${SPARK_ARCHIVE}.tgz; -download_with_retry "http://d3kbcqa49mib13.cloudfront.net/${SPARK_ARCHIVE}.tgz; +download_with_retry "http://archive.apache.org/dist/spark/spark-${SPARK_VERSION}/${SPARK_ARCHIVE}.tgz; ENDTIME=`date +%s` DOWNLOADTIME="$((ENDTIME-STARTTIME))" fi diff --git a/zeppelin-interpreter-integration/src/test/java/org/apache/zeppelin/integration/SparkIntegrationTest.java b/zeppelin-interpreter-integration/src/test/java/org/apache/zeppelin/integration/SparkIntegrationTest.java index 94a6a40..d5d07a0 100644 --- a/zeppelin-interpreter-integration/src/test/java/org/apache/zeppelin/integration/SparkIntegrationTest.java +++ b/zeppelin-interpreter-integration/src/test/java/org/apache/zeppelin/integration/SparkIntegrationTest.java @@ -148,6 +148,7 @@ public abstract class SparkIntegrationTest { sparkInterpreterSetting.setProperty("zeppelin.spark.useHiveContext", "false"); sparkInterpreterSetting.setProperty("zeppelin.pyspark.useIPython", "false"); sparkInterpreterSetting.setProperty("zeppelin.spark.scala.color", "false"); +sparkInterpreterSetting.setProperty("zeppelin.spark.deprecatedMsg.show", "false"); testInterpreterBasics(); @@ -171,6 +172,7 @@ public abstract class SparkIntegrationTest { sparkInterpreterSetting.setProperty("PYSPARK_PYTHON", getPythonExec()); sparkInterpreterSetting.setProperty("spark.driver.memory", "512m"); sparkInterpreterSetting.setProperty("zeppelin.spark.scala.color", "false"); +sparkInterpreterSetting.setProperty("zeppelin.spark.deprecatedMsg.sho
[zeppelin] branch branch-0.8 updated: [ZEPPELIN-4133]. Idle sessions are no longer being closed even though TimeoutLifecycleManagement is configured properly
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch branch-0.8 in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/branch-0.8 by this push: new 4bfb6b8 [ZEPPELIN-4133]. Idle sessions are no longer being closed even though TimeoutLifecycleManagement is configured properly 4bfb6b8 is described below commit 4bfb6b83518463d2576774e6323ede055c53168f Author: Jeff Zhang AuthorDate: Thu Apr 25 15:44:07 2019 +0800 [ZEPPELIN-4133]. Idle sessions are no longer being closed even though TimeoutLifecycleManagement is configured properly ### What is this PR for? The root cause is that we use Timer to scheduler periodical interpreter checking task. But java Timer has one critical issue that once the Timer thread is crashed, subsequent task will be suppressed. This PR use ScheduledExecutorService instead to fix this issue. ### What type of PR is it? [Bug Fix] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-4133 ### How should this be tested? * CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang Closes #3355 from zjffdu/ZEPPELIN-4133 and squashes the following commits: 0223640fa [Jeff Zhang] put try catch arround close c4057694c [Jeff Zhang] [ZEPPELIN-4133]. Idle sessions are no longer being closed even though TimeoutLifecycleManagement is configured properly (cherry picked from commit 723e0615d0ea7c99118bad8b88ef9b4ef8d3d17f) Signed-off-by: Jeff Zhang --- .../lifecycle/TimeoutLifecycleManager.java | 33 -- 1 file changed, 18 insertions(+), 15 deletions(-) diff --git a/zeppelin-zengine/src/main/java/org/apache/zeppelin/interpreter/lifecycle/TimeoutLifecycleManager.java b/zeppelin-zengine/src/main/java/org/apache/zeppelin/interpreter/lifecycle/TimeoutLifecycleManager.java index 90f3f55..390159b 100644 --- a/zeppelin-zengine/src/main/java/org/apache/zeppelin/interpreter/lifecycle/TimeoutLifecycleManager.java +++ b/zeppelin-zengine/src/main/java/org/apache/zeppelin/interpreter/lifecycle/TimeoutLifecycleManager.java @@ -7,9 +7,11 @@ import org.slf4j.Logger; import org.slf4j.LoggerFactory; import java.util.Map; -import java.util.Timer; -import java.util.TimerTask; import java.util.concurrent.ConcurrentHashMap; +import java.util.concurrent.Executors; +import java.util.concurrent.ScheduledExecutorService; + +import static java.util.concurrent.TimeUnit.MILLISECONDS; /** @@ -30,29 +32,30 @@ public class TimeoutLifecycleManager implements LifecycleManager { private long checkInterval; private long timeoutThreshold; - private Timer checkTimer; + private ScheduledExecutorService checkScheduler; public TimeoutLifecycleManager(ZeppelinConfiguration zConf) { this.checkInterval = zConf.getLong(ZeppelinConfiguration.ConfVars .ZEPPELIN_INTERPRETER_LIFECYCLE_MANAGER_TIMEOUT_CHECK_INTERVAL); this.timeoutThreshold = zConf.getLong( ZeppelinConfiguration.ConfVars.ZEPPELIN_INTERPRETER_LIFECYCLE_MANAGER_TIMEOUT_THRESHOLD); -this.checkTimer = new Timer(true); -this.checkTimer.scheduleAtFixedRate(new TimerTask() { - @Override - public void run() { -long now = System.currentTimeMillis(); -for (Map.Entry entry : interpreterGroups.entrySet()) { - ManagedInterpreterGroup interpreterGroup = entry.getKey(); - Long lastTimeUsing = entry.getValue(); - if ((now - lastTimeUsing) > timeoutThreshold ) { -LOGGER.info("InterpreterGroup {} is timeout.", interpreterGroup.getId()); +this.checkScheduler = Executors.newScheduledThreadPool(1); +this.checkScheduler.scheduleAtFixedRate(() -> { + long now = System.currentTimeMillis(); + for (Map.Entry entry : interpreterGroups.entrySet()) { +ManagedInterpreterGroup interpreterGroup = entry.getKey(); +Long lastTimeUsing = entry.getValue(); +if ((now - lastTimeUsing) > timeoutThreshold) { + LOGGER.info("InterpreterGroup {} is timeout.", interpreterGroup.getId()); + try { interpreterGroup.close(); -interpreterGroups.remove(entry.getKey()); + } catch (Exception e) { +LOGGER.warn("Fail to close interpreterGroup: " + interpreterGroup.getId(), e); } + interpreterGroups.remove(entry.getKey()); } } -}, checkInterval, checkInterval); +}, checkInterval, checkInterval, MILLISECONDS); LOGGER.info("TimeoutLifecycleManager is started with checkinterval: " + checkInterval + ", timeoutThreshold: " + timeoutThreshold); }
[zeppelin] branch master updated: [ZEPPELIN-4224]. commons-exec is missing in zeppelin-interpreter-parent
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 0878ae7 [ZEPPELIN-4224]. commons-exec is missing in zeppelin-interpreter-parent 0878ae7 is described below commit 0878ae70bd6a576802b8e02d7b988dbbcf93fc6b Author: Jeff Zhang AuthorDate: Fri Jul 5 13:30:15 2019 +0800 [ZEPPELIN-4224]. commons-exec is missing in zeppelin-interpreter-parent ### What is this PR for? commons-exec is excluded in zeppelin-interpeter-api which is the shaded zeppelin-interpreter. So we should add common-exec explicitly in zeppelin-interpreter-parent so that all interpreter can use it and include it their packaged jar. ### What type of PR is it? [Bug Fix] ### Todos * [ ] - Task ### What is the Jira issue? * https://jira.apache.org/jira/browse/ZEPPELIN-4224 ### How should this be tested? * CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang Closes #3399 from zjffdu/ZEPPELIN-4224 and squashes the following commits: b0eb0d51d [Jeff Zhang] [ZEPPELIN-4224]. commons-exec is missing in zeppelin-interpreter-parent --- pom.xml | 7 +++ zeppelin-interpreter-parent/pom.xml | 5 + zeppelin-interpreter/pom.xml| 2 -- 3 files changed, 12 insertions(+), 2 deletions(-) diff --git a/pom.xml b/pom.xml index 17774c0..2854b16 100644 --- a/pom.xml +++ b/pom.xml @@ -117,6 +117,7 @@ 4.0.2 2.5 1.9 +1.3 1.5 2.4 3.2.2 @@ -210,6 +211,12 @@ +org.apache.commons +commons-exec +${commons.exec.version} + + + com.google.code.gson gson ${gson.version} diff --git a/zeppelin-interpreter-parent/pom.xml b/zeppelin-interpreter-parent/pom.xml index 74d091e..8f3e5ec 100644 --- a/zeppelin-interpreter-parent/pom.xml +++ b/zeppelin-interpreter-parent/pom.xml @@ -63,6 +63,11 @@ + org.apache.commons + commons-exec + + + log4j log4j diff --git a/zeppelin-interpreter/pom.xml b/zeppelin-interpreter/pom.xml index 0a6d92d..085a4f5 100644 --- a/zeppelin-interpreter/pom.xml +++ b/zeppelin-interpreter/pom.xml @@ -38,7 +38,6 @@ 2.3 -1.3 3.0 1.12 3.0.3 @@ -116,7 +115,6 @@ org.apache.commons commons-exec - ${commons.exec.version}
[zeppelin] branch master updated: [MINOR] Change package of ProcessLauncher
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new d1f9800 [MINOR] Change package of ProcessLauncher d1f9800 is described below commit d1f98003c0ecce21db31497098649b6cb452483e Author: Jeff Zhang AuthorDate: Thu Jul 11 10:46:04 2019 +0800 [MINOR] Change package of ProcessLauncher --- python/src/main/java/org/apache/zeppelin/python/IPythonInterpreter.java | 2 +- python/src/main/java/org/apache/zeppelin/python/PythonInterpreter.java | 2 +- .../org/apache/zeppelin/{ => interpreter}/util/ProcessLauncher.java | 2 +- .../zeppelin/interpreter/remote/RemoteInterpreterManagedProcess.java| 2 +- 4 files changed, 4 insertions(+), 4 deletions(-) diff --git a/python/src/main/java/org/apache/zeppelin/python/IPythonInterpreter.java b/python/src/main/java/org/apache/zeppelin/python/IPythonInterpreter.java index 9f4c355..d6e17cf 100644 --- a/python/src/main/java/org/apache/zeppelin/python/IPythonInterpreter.java +++ b/python/src/main/java/org/apache/zeppelin/python/IPythonInterpreter.java @@ -43,7 +43,7 @@ import org.apache.zeppelin.python.proto.IPythonStatus; import org.apache.zeppelin.python.proto.StatusRequest; import org.apache.zeppelin.python.proto.StatusResponse; import org.apache.zeppelin.python.proto.StopRequest; -import org.apache.zeppelin.util.ProcessLauncher; +import org.apache.zeppelin.interpreter.util.ProcessLauncher; import org.slf4j.Logger; import org.slf4j.LoggerFactory; import py4j.GatewayServer; diff --git a/python/src/main/java/org/apache/zeppelin/python/PythonInterpreter.java b/python/src/main/java/org/apache/zeppelin/python/PythonInterpreter.java index 982b3a0..eb76de3 100644 --- a/python/src/main/java/org/apache/zeppelin/python/PythonInterpreter.java +++ b/python/src/main/java/org/apache/zeppelin/python/PythonInterpreter.java @@ -37,7 +37,7 @@ import org.apache.zeppelin.interpreter.InvalidHookException; import org.apache.zeppelin.interpreter.remote.RemoteInterpreterUtils; import org.apache.zeppelin.interpreter.thrift.InterpreterCompletion; import org.apache.zeppelin.interpreter.util.InterpreterOutputStream; -import org.apache.zeppelin.util.ProcessLauncher; +import org.apache.zeppelin.interpreter.util.ProcessLauncher; import org.slf4j.Logger; import org.slf4j.LoggerFactory; import py4j.GatewayServer; diff --git a/zeppelin-interpreter/src/main/java/org/apache/zeppelin/util/ProcessLauncher.java b/zeppelin-interpreter/src/main/java/org/apache/zeppelin/interpreter/util/ProcessLauncher.java similarity index 99% rename from zeppelin-interpreter/src/main/java/org/apache/zeppelin/util/ProcessLauncher.java rename to zeppelin-interpreter/src/main/java/org/apache/zeppelin/interpreter/util/ProcessLauncher.java index bdea797..14558a1 100644 --- a/zeppelin-interpreter/src/main/java/org/apache/zeppelin/util/ProcessLauncher.java +++ b/zeppelin-interpreter/src/main/java/org/apache/zeppelin/interpreter/util/ProcessLauncher.java @@ -15,7 +15,7 @@ * limitations under the License. */ -package org.apache.zeppelin.util; +package org.apache.zeppelin.interpreter.util; import org.apache.commons.exec.CommandLine; import org.apache.commons.exec.DefaultExecutor; diff --git a/zeppelin-zengine/src/main/java/org/apache/zeppelin/interpreter/remote/RemoteInterpreterManagedProcess.java b/zeppelin-zengine/src/main/java/org/apache/zeppelin/interpreter/remote/RemoteInterpreterManagedProcess.java index 6d91f1d..ccac30b 100644 --- a/zeppelin-zengine/src/main/java/org/apache/zeppelin/interpreter/remote/RemoteInterpreterManagedProcess.java +++ b/zeppelin-zengine/src/main/java/org/apache/zeppelin/interpreter/remote/RemoteInterpreterManagedProcess.java @@ -22,7 +22,7 @@ import org.apache.commons.exec.CommandLine; import org.apache.commons.exec.ExecuteException; import org.apache.commons.exec.environment.EnvironmentUtils; import org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService; -import org.apache.zeppelin.util.ProcessLauncher; +import org.apache.zeppelin.interpreter.util.ProcessLauncher; import org.slf4j.Logger; import org.slf4j.LoggerFactory;
[zeppelin] branch master updated: [ZEPPELIN-4232]. push local notes to remote upstream when initializing GitHubNotebook
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 7a78cf3 [ZEPPELIN-4232]. push local notes to remote upstream when initializing GitHubNotebook 7a78cf3 is described below commit 7a78cf31d829e10b19e56b574ae650ab9f5c2350 Author: Jeff Zhang AuthorDate: Tue Jul 9 15:11:35 2019 +0800 [ZEPPELIN-4232]. push local notes to remote upstream when initializing GitHubNotebook ### What is this PR for? This is a trivial PR that will push local notes to remote upstream when initializing GitHubNotebook ### What type of PR is it? [Improvement] ### Todos * [ ] - Task ### What is the Jira issue? * https://jira.apache.org/jira/browse/ZEPPELIN-4232 ### How should this be tested? * CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang Closes #3401 from zjffdu/ZEPPELIN-4232 and squashes the following commits: fac6cf1b2 [Jeff Zhang] [ZEPPELIN-4232]. push local notes to remote upstream when initializing GitHubNotebook --- .../main/java/org/apache/zeppelin/notebook/repo/GitHubNotebookRepo.java | 1 + 1 file changed, 1 insertion(+) diff --git a/zeppelin-plugins/notebookrepo/github/src/main/java/org/apache/zeppelin/notebook/repo/GitHubNotebookRepo.java b/zeppelin-plugins/notebookrepo/github/src/main/java/org/apache/zeppelin/notebook/repo/GitHubNotebookRepo.java index 48131c6..010d998 100644 --- a/zeppelin-plugins/notebookrepo/github/src/main/java/org/apache/zeppelin/notebook/repo/GitHubNotebookRepo.java +++ b/zeppelin-plugins/notebookrepo/github/src/main/java/org/apache/zeppelin/notebook/repo/GitHubNotebookRepo.java @@ -61,6 +61,7 @@ public class GitHubNotebookRepo extends GitNotebookRepo { configureRemoteStream(); pullFromRemoteStream(); +pushToRemoteSteam(); } @Override
[zeppelin] branch master updated: [ZEPPELIN-4219] User can start interpreter when interpreter dependencies jars are not downloaded
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 720b265 [ZEPPELIN-4219] User can start interpreter when interpreter dependencies jars are not downloaded 720b265 is described below commit 720b26561fb9fe6dab05fdb2c154cbfdb72a933a Author: Jeff Zhang AuthorDate: Fri Jul 5 15:33:08 2019 +0800 [ZEPPELIN-4219] User can start interpreter when interpreter dependencies jars are not downloaded ### What is this PR for? Now interpreter can start even when it is downloading dependencies. It will cause ClassNotFound exception. The root cause is that the status of InterpreterSetting is incorrectly set to `READY`. This PR fix this issue. ### What type of PR is it? [Bug Fix ] ### Todos * [ ] - Task ### What is the Jira issue? * https://jira.apache.org/jira/browse/ZEPPELIN-4219 ### How should this be tested? * CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang Closes #3398 from zjffdu/ZEPPELIN-4219 and squashes the following commits: d8d8309c6 [Jeff Zhang] [ZEPPELIN-4219] User can start interpreter when interpreter dependencies jars are not downloaded --- .../apache/zeppelin/dep/DependencyResolver.java| 6 +-- .../zeppelin/interpreter/InterpreterSetting.java | 6 ++- .../interpreter/InterpreterSettingManager.java | 52 ++ 3 files changed, 31 insertions(+), 33 deletions(-) diff --git a/zeppelin-interpreter/src/main/java/org/apache/zeppelin/dep/DependencyResolver.java b/zeppelin-interpreter/src/main/java/org/apache/zeppelin/dep/DependencyResolver.java index 495c69b..0acfca9 100644 --- a/zeppelin-interpreter/src/main/java/org/apache/zeppelin/dep/DependencyResolver.java +++ b/zeppelin-interpreter/src/main/java/org/apache/zeppelin/dep/DependencyResolver.java @@ -96,7 +96,7 @@ public class DependencyResolver extends AbstractDependencyResolver { File destFile = new File(destPath, srcFile.getName()); if (!destFile.exists() || !FileUtils.contentEquals(srcFile, destFile)) { FileUtils.copyFile(srcFile, destFile); - logger.debug("copy {} to {}", srcFile.getAbsolutePath(), destPath); + logger.info("copy {} to {}", srcFile.getAbsolutePath(), destPath); } } } @@ -114,7 +114,7 @@ public class DependencyResolver extends AbstractDependencyResolver { if (!destFile.exists() || !FileUtils.contentEquals(srcFile, destFile)) { FileUtils.copyFile(srcFile, destFile); - logger.debug("copy {} to {}", srcFile.getAbsolutePath(), destPath); + logger.info("copy {} to {}", srcFile.getAbsolutePath(), destPath); } } @@ -142,7 +142,7 @@ public class DependencyResolver extends AbstractDependencyResolver { List files = new LinkedList<>(); for (ArtifactResult artifactResult : listOfArtifact) { files.add(artifactResult.getArtifact().getFile()); - logger.debug("load {}", artifactResult.getArtifact().getFile().getAbsolutePath()); + logger.info("load {}", artifactResult.getArtifact().getFile().getAbsolutePath()); } return files; diff --git a/zeppelin-zengine/src/main/java/org/apache/zeppelin/interpreter/InterpreterSetting.java b/zeppelin-zengine/src/main/java/org/apache/zeppelin/interpreter/InterpreterSetting.java index 82ff9c2..4bac54c 100644 --- a/zeppelin-zengine/src/main/java/org/apache/zeppelin/interpreter/InterpreterSetting.java +++ b/zeppelin-zengine/src/main/java/org/apache/zeppelin/interpreter/InterpreterSetting.java @@ -103,7 +103,7 @@ public class InterpreterSetting { */ private Object properties = new Properties(); - private Status status; + private Status status = Status.READY; private String errorReason; @SerializedName("interpreterGroup") @@ -265,7 +265,6 @@ public class InterpreterSetting { } void postProcessing() { -this.status = Status.READY; this.id = this.name; if (this.lifecycleManager == null) { this.lifecycleManager = new NullLifecycleManager(conf); @@ -657,6 +656,7 @@ public class InterpreterSetting { } public void setStatus(Status status) { +LOGGER.info(String.format("Set interpreter %s status to %s", name, status.name())); this.status = status; } @@ -867,6 +867,7 @@ public class InterpreterSetting { // load dependencies List deps = getDependencies(); if (deps != null) { +LOGGER.info("Start to download dependencies for interpreter:
[zeppelin] branch master updated: [MINOR] Remove annoying exception in PluginManager
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new d4aa8e4 [MINOR] Remove annoying exception in PluginManager d4aa8e4 is described below commit d4aa8e463e23021f3618b598e30f94e63c1a77aa Author: Jeff Zhang AuthorDate: Tue Jul 9 15:13:54 2019 +0800 [MINOR] Remove annoying exception in PluginManager --- .../src/main/java/org/apache/zeppelin/plugin/PluginManager.java | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/zeppelin-zengine/src/main/java/org/apache/zeppelin/plugin/PluginManager.java b/zeppelin-zengine/src/main/java/org/apache/zeppelin/plugin/PluginManager.java index 5f715c9..c3a2b9b 100644 --- a/zeppelin-zengine/src/main/java/org/apache/zeppelin/plugin/PluginManager.java +++ b/zeppelin-zengine/src/main/java/org/apache/zeppelin/plugin/PluginManager.java @@ -65,7 +65,7 @@ public class PluginManager { (Class.forName(notebookRepoClassName).newInstance()); return notebookRepo; } catch (InstantiationException | IllegalAccessException | ClassNotFoundException e) { - LOGGER.warn("Fail to instantiate notebookrepo from classpath directly:" + notebookRepoClassName, e); + LOGGER.warn("Fail to instantiate notebookrepo from classpath directly:" + notebookRepoClassName); } String simpleClassName = notebookRepoClassName.substring(notebookRepoClassName.lastIndexOf(".") + 1); @@ -109,7 +109,7 @@ public class PluginManager { (Class.forName(notebookRepoClassName).newInstance()); return notebookRepo; } catch (InstantiationException | IllegalAccessException | ClassNotFoundException e) { -LOGGER.warn("Fail to instantiate notebookrepo from classpath directly:" + notebookRepoClassName, e); +LOGGER.warn("Fail to instantiate notebookrepo from classpath directly:" + notebookRepoClassName); } }
[zeppelin] branch master updated: [ZEPPELIN-4216]. Introduce ZEPPELIN_SERVER_IP to specify the ip address of thrift server
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 80cc7e2 [ZEPPELIN-4216]. Introduce ZEPPELIN_SERVER_IP to specify the ip address of thrift server 80cc7e2 is described below commit 80cc7e27ac6001e415b6e0bac9321f6dc3a7b642 Author: Jeff Zhang AuthorDate: Mon Jul 1 22:31:53 2019 +0800 [ZEPPELIN-4216]. Introduce ZEPPELIN_SERVER_IP to specify the ip address of thrift server ### What is this PR for? This PR use introduce env `ZEPPELIN_SERVER_IP` to specify the ip address of thrift server. It is used when you are in a complex network environment where yo might have multiple network cards or you use proxy. If it is not specified, it would still use the old approach to choose one IP randomly. ### What type of PR is it? [ Improvement ] ### Todos * [ ] - Task ### What is the Jira issue? * https://jira.apache.org/jira/browse/ZEPPELIN-4216 ### How should this be tested? * CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang Closes #3392 from zjffdu/ZEPPELIN-4216 and squashes the following commits: 35fbcd51f [Jeff Zhang] [ZEPPELIN-4216]. Introduce ZEPPELIN_SERVER_IP to specify the ip address of thrift server --- conf/zeppelin-env.sh.template| 1 + .../apache/zeppelin/interpreter/remote/RemoteInterpreterUtils.java | 5 + 2 files changed, 6 insertions(+) diff --git a/conf/zeppelin-env.sh.template b/conf/zeppelin-env.sh.template index d8e265a..9f10be8 100644 --- a/conf/zeppelin-env.sh.template +++ b/conf/zeppelin-env.sh.template @@ -18,6 +18,7 @@ # export JAVA_HOME= # export MASTER= # Spark master url. eg. spark://master_addr:7077. Leave empty if you want to use local mode. +# export ZEPPELIN_LOCAL_IP # Zeppelin's thrift server ip address, if not specified, one random IP address will be choosen. # export ZEPPELIN_JAVA_OPTS# Additional jvm options. for example, export ZEPPELIN_JAVA_OPTS="-Dspark.executor.memory=8g -Dspark.cores.max=16" # export ZEPPELIN_MEM # Zeppelin jvm mem options Default -Xms1024m -Xmx1024m -XX:MaxPermSize=512m # export ZEPPELIN_INTP_MEM # zeppelin interpreter process jvm mem options. Default -Xms1024m -Xmx1024m -XX:MaxPermSize=512m diff --git a/zeppelin-interpreter/src/main/java/org/apache/zeppelin/interpreter/remote/RemoteInterpreterUtils.java b/zeppelin-interpreter/src/main/java/org/apache/zeppelin/interpreter/remote/RemoteInterpreterUtils.java index 7e9ff13..4ebc2a2 100644 --- a/zeppelin-interpreter/src/main/java/org/apache/zeppelin/interpreter/remote/RemoteInterpreterUtils.java +++ b/zeppelin-interpreter/src/main/java/org/apache/zeppelin/interpreter/remote/RemoteInterpreterUtils.java @@ -94,6 +94,11 @@ public class RemoteInterpreterUtils { } public static String findAvailableHostAddress() throws UnknownHostException, SocketException { +String zeppelinServerIP = System.getenv("ZEPPELIN_LOCAL_IP"); +if (zeppelinServerIP != null) { + return zeppelinServerIP; +} + InetAddress address = InetAddress.getLocalHost(); if (address.isLoopbackAddress()) { for (NetworkInterface networkInterface : Collections
[zeppelin] branch master updated: [HOTFIX] Fix scala version mismatch in spark interpreter
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 6569c19 [HOTFIX] Fix scala version mismatch in spark interpreter 6569c19 is described below commit 6569c19add5e10b9913ffb002de7a82a0c0a7b9f Author: Jeff Zhang AuthorDate: Sun Jun 30 21:18:31 2019 +0800 [HOTFIX] Fix scala version mismatch in spark interpreter --- spark/pom.xml | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/spark/pom.xml b/spark/pom.xml index b83281d..713ded1 100644 --- a/spark/pom.xml +++ b/spark/pom.xml @@ -45,8 +45,8 @@ 2.15.2 2.2.3 -2.11 -2.11.12 +2.11.12 +2.11 0.10.7 spark-${spark.version} @@ -183,7 +183,7 @@ true -2.11.8 +2.11.12 2.11
[zeppelin] branch master updated: [ZEPPELIN-4217]. Remove semicolon at the end of sql statement for JdbcInterpreter
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new a8e7b96 [ZEPPELIN-4217]. Remove semicolon at the end of sql statement for JdbcInterpreter a8e7b96 is described below commit a8e7b961756e83bf8b193754da8bf2e9c6f14c80 Author: Jeff Zhang AuthorDate: Fri Jul 5 16:13:48 2019 +0800 [ZEPPELIN-4217]. Remove semicolon at the end of sql statement for JdbcInterpreter ### What is this PR for? It is very possible for user to add semicolon at the end of sql statement. Some jdbc engine will handle the semicolon for users, while others won't, e.g. hive. This PR will remove the semicolon at the end of sql. ### What type of PR is it? [Bug Fix] ### Todos * [ ] - Task ### What is the Jira issue? * https://jira.apache.org/jira/browse/ZEPPELIN-4217 ### How should this be tested? * CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang Closes #3400 from zjffdu/ZEPPELIN-4217 and squashes the following commits: 3142c6ad5 [Jeff Zhang] [ZEPPELIN-4217]. Remove semicolon at the end of sql statement for JdbcInterpreter --- jdbc/src/main/java/org/apache/zeppelin/jdbc/JDBCInterpreter.java | 4 jdbc/src/test/java/org/apache/zeppelin/jdbc/JDBCInterpreterTest.java | 4 ++-- 2 files changed, 6 insertions(+), 2 deletions(-) diff --git a/jdbc/src/main/java/org/apache/zeppelin/jdbc/JDBCInterpreter.java b/jdbc/src/main/java/org/apache/zeppelin/jdbc/JDBCInterpreter.java index 000b46f..0d1f087 100644 --- a/jdbc/src/main/java/org/apache/zeppelin/jdbc/JDBCInterpreter.java +++ b/jdbc/src/main/java/org/apache/zeppelin/jdbc/JDBCInterpreter.java @@ -710,9 +710,13 @@ public class JDBCInterpreter extends KerberosInterpreter { try { List sqlArray; + sql = sql.trim(); if (splitQuery) { sqlArray = splitSqlQueries(sql); } else { +if (sql.endsWith(";")) { + sql = sql.substring(0, sql.length() - 1); +} sqlArray = Arrays.asList(sql); } diff --git a/jdbc/src/test/java/org/apache/zeppelin/jdbc/JDBCInterpreterTest.java b/jdbc/src/test/java/org/apache/zeppelin/jdbc/JDBCInterpreterTest.java index c7d417d..e08f071 100644 --- a/jdbc/src/test/java/org/apache/zeppelin/jdbc/JDBCInterpreterTest.java +++ b/jdbc/src/test/java/org/apache/zeppelin/jdbc/JDBCInterpreterTest.java @@ -181,7 +181,7 @@ public class JDBCInterpreterTest extends BasicJDBCTestCaseAdapter { JDBCInterpreter t = new JDBCInterpreter(properties); t.open(); -String sqlQuery = "select * from test_table WHERE ID in ('a', 'b')"; +String sqlQuery = "select * from test_table WHERE ID in ('a', 'b'); "; InterpreterResult interpreterResult = t.interpret(sqlQuery, interpreterContext); @@ -229,7 +229,7 @@ public class JDBCInterpreterTest extends BasicJDBCTestCaseAdapter { "select '\\', ';';" + "select , ';';" + "select /*+ scan */ * from test_table;" + -"--singleLineComment\nselect * from test_table"; +"--singleLineComment\nselect * from test_table;"; Properties properties = new Properties();
[zeppelin] branch master updated: ZEPPELIN-3552. Support Scala 2.12 of SparkInterpreter
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new f61bddd ZEPPELIN-3552. Support Scala 2.12 of SparkInterpreter f61bddd is described below commit f61bddd233587642ec7b792bb182a06d2f54dbf8 Author: Jeff Zhang AuthorDate: Wed Jun 12 19:20:59 2019 +0800 ZEPPELIN-3552. Support Scala 2.12 of SparkInterpreter ### What is this PR for? This PR add support for scala 2.12 of SparkInterpreter. In this PR, I did some refactoring of whole spark modules. Each scala version interrpeter will be loaded dynamically via URLClassLoad, so that we can just write code once and compile it multiple times via different scala version and load it dynamically based on the current scala version. ### What type of PR is it? [Feature | Refactoring] ### Todos * [ ] - Task ### What is the Jira issue? * https://jira.apache.org/jira/browse/ZEPPELIN-3552 ### How should this be tested? * CI passed, UT of scala 2.12 is added and passed ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang Closes #3034 from zjffdu/ZEPPELIN-3552 and squashes the following commits: fe9c9eb12 [Jeff Zhang] [ZEPPELIN-3552]. Support Scala 2.12 of SparkInterpreter --- .travis.yml| 34 ++-- pom.xml| 2 +- spark/interpreter/pom.xml | 42 ++--- .../spark/AbstractSparkScalaInterpreter.java | 71 + .../apache/zeppelin/spark/PySparkInterpreter.java | 2 +- .../apache/zeppelin/spark/SparkInterpreter.java| 119 -- .../apache/zeppelin/spark/SparkRInterpreter.java | 8 +- .../main/java/org/apache/zeppelin/spark/Utils.java | 40 - .../java/org/apache/zeppelin/spark/ZeppelinR.java | 2 +- .../apache/zeppelin/spark/ZeppelinRContext.java| 7 +- .../apache/zeppelin/spark/ZeppelinRDisplay.scala | 12 +- .../src/test/resources/log4j.properties| 2 +- spark/pom.xml | 70 + spark/scala-2.10/pom.xml | 27 +++- .../zeppelin/spark/SparkScala210Interpreter.scala | 25 ++- spark/scala-2.11/pom.xml | 27 +++- .../zeppelin/spark/SparkScala211Interpreter.scala | 29 +++- spark/{scala-2.10 => scala-2.12}/pom.xml | 37 +++-- spark/scala-2.12/spark-scala-parent| 1 + .../src/main}/resources/log4j.properties | 8 +- .../zeppelin/spark/SparkScala212Interpreter.scala} | 112 - spark/spark-dependencies/pom.xml | 46 -- spark/spark-scala-parent/pom.xml | 61 ++-- .../zeppelin/spark/BaseSparkScalaInterpreter.scala | 72 + .../apache/zeppelin/spark/JobProgressUtil.scala| 4 +- .../zeppelin/spark/SparkZeppelinContext.scala | 11 +- .../org/apache/zeppelin/spark/SparkShims.java | 1 - spark/spark2-shims/pom.xml | 2 +- zeppelin-display/pom.xml | 2 +- .../display/angular/AbstractAngularElem.scala | 4 +- zeppelin-interpreter-integration/pom.xml | 14 ++ .../zeppelin/integration/FlinkIntegrationTest.java | 1 + .../zeppelin/integration/SparkIntegrationTest.java | 27 +++- .../integration/SparkIntegrationTest24.java| 2 +- .../integration/ZeppelinSparkClusterTest.java | 5 +- .../integration/ZeppelinSparkClusterTest24.java| 2 +- .../src/test/resources/log4j.properties| 1 + .../org/apache/zeppelin/util/ProcessLauncher.java | 1 - zeppelin-plugins/launcher/spark/pom.xml| 10 ++ .../launcher/SparkInterpreterLauncher.java | 173 - .../launcher/SparkInterpreterLauncherTest.java | 100 +--- .../launcher/StandardInterpreterLauncher.java | 2 +- zeppelin-plugins/pom.xml | 8 + zeppelin-zengine/pom.xml | 5 + .../interpreter}/integration/DownloadUtils.java| 4 +- 45 files changed, 814 insertions(+), 421 deletions(-) diff --git a/.travis.yml b/.travis.yml index 0a02d08..76125d1 100644 --- a/.travis.yml +++ b/.travis.yml @@ -83,14 +83,14 @@ matrix: - sudo: required jdk: "oraclejdk8" dist: trusty - env: PYTHON="3" SPARKR="true" PROFILE="-Pspark-2.2 -Phelium-dev -Pexamples -Pscala-2.11" BUILD_FLAG="install -Pbuild-distr -DskipRat" TEST_FLAG="verify -Pusing-packaged-distr -DskipRat" MODULES="-pl ${INTERPRET
[zeppelin] branch master updated: [HOTFIX] zeppelin-interpreter-api jar is missing in interpreter folder
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 0da6f9f [HOTFIX] zeppelin-interpreter-api jar is missing in interpreter folder 0da6f9f is described below commit 0da6f9f11708ac2f694f556fdcab0d205a6c6ff9 Author: Jeff Zhang AuthorDate: Tue Jul 2 15:56:19 2019 +0800 [HOTFIX] zeppelin-interpreter-api jar is missing in interpreter folder --- zeppelin-interpreter-api/pom.xml | 3 +++ 1 file changed, 3 insertions(+) diff --git a/zeppelin-interpreter-api/pom.xml b/zeppelin-interpreter-api/pom.xml index c1f0ae8..61be599 100644 --- a/zeppelin-interpreter-api/pom.xml +++ b/zeppelin-interpreter-api/pom.xml @@ -159,6 +159,9 @@ copy-to-interpreter package + + run + ANT TASK - copying files
[zeppelin] branch master updated: [ZEPPELIN-4207]. zeppelin-interpreter.jar and zeppelin-interpreter-api are both used by interpreter process
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 979e133 [ZEPPELIN-4207]. zeppelin-interpreter.jar and zeppelin-interpreter-api are both used by interpreter process 979e133 is described below commit 979e133597d642024d31ea18f935bf7faf10bbf5 Author: Jeff Zhang AuthorDate: Fri Jun 28 18:08:12 2019 +0800 [ZEPPELIN-4207]. zeppelin-interpreter.jar and zeppelin-interpreter-api are both used by interpreter process ### What is this PR for? zeppelin-interpreter jar (unshaded jar) should be used by zeppelin server and zeppelin-interpreter-api jar (shaded jar) should be used by interpreter process. ### What type of PR is it? [Bug Fix ] ### Todos * [ ] - Task ### What is the Jira issue? * https://jira.apache.org/jira/browse/ZEPPELIN-4207 ### How should this be tested? * CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang Closes #3388 from zjffdu/ZEPPELIN-4207 and squashes the following commits: 510ec612a [Jeff Zhang] [ZEPPELIN-4207]. zeppelin-interpreter.jar and zeppelin-interpreter-api are both used by interpreter process --- bin/interpreter.sh | 1 - zeppelin-distribution/src/assemble/distribution.xml | 11 --- 2 files changed, 12 deletions(-) diff --git a/bin/interpreter.sh b/bin/interpreter.sh index 1ad7b1d..0c09c55 100755 --- a/bin/interpreter.sh +++ b/bin/interpreter.sh @@ -84,7 +84,6 @@ if [[ -d "${ZEPPELIN_HOME}/zeppelin-zengine/target/test-classes" ]]; then fi addJarInDirForIntp "${ZEPPELIN_HOME}/zeppelin-interpreter-api/target" -addJarInDirForIntp "${ZEPPELIN_HOME}/lib/interpreter" addJarInDirForIntp "${INTERPRETER_DIR}" HOSTNAME=$(hostname) diff --git a/zeppelin-distribution/src/assemble/distribution.xml b/zeppelin-distribution/src/assemble/distribution.xml index 378ecab..0c5e8b6 100644 --- a/zeppelin-distribution/src/assemble/distribution.xml +++ b/zeppelin-distribution/src/assemble/distribution.xml @@ -39,15 +39,8 @@ false - /lib/interpreter - -${project.groupId}:zeppelin-interpreter - - - /lib -${project.groupId}:zeppelin-interpreter ${project.groupId}:zeppelin-web false @@ -98,10 +91,6 @@ ../k8s - /lib/interpreter - ../zeppelin-interpreter/target/lib - - /lib/node_modules/zeppelin-vis ../zeppelin-web/src/app/visualization
[zeppelin] branch branch-0.8 updated: [ZEPPELIN-1070]: Inject Credentials in any Interpreter-Code - 0.8x
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch branch-0.8 in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/branch-0.8 by this push: new 7d4b4b4 [ZEPPELIN-1070]: Inject Credentials in any Interpreter-Code - 0.8x 7d4b4b4 is described below commit 7d4b4b4f698692e77e9b651b495658365fd0f39a Author: Pascal Pellmont AuthorDate: Mon Aug 12 14:45:55 2019 -0400 [ZEPPELIN-1070]: Inject Credentials in any Interpreter-Code - 0.8x ### What is this PR for? This PR is a re-submission of the original ZEPPELIN-1070 PR. The original PR seems to be abandoned and I am currently creating custom builds of Zeppelin with the ZEPPELIN-1070 PR included so I am interested in getting the PR merged. I am submitting two PRs one for 0.8X branch and one that includes fixes for merge conflicts to the master branch. Original PR Description: > This PR enables a generic syntax for inserting credentials. A username can be inserted by $[user.entry] where "entry" is the name of the credential. A password can be inserted by $[password.entry]. > To avoid output of the password all occurences of the password-String in the Interpreter-output will be replaced by "###". This should not be a really secure feature (since the runner of the notebook knows the password anyway), but it should avoid accidential exposure of the used passwords by any sort of interpreter ### What type of PR is it? Feature ### Todos * [ ] - Documentation ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1070 ### How should this be tested? Unit tests are included in PR ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? **No** * Is there breaking changes for older versions? **Only in very unlikely circumstances. IE: code that matched {user.VALID_CREDENTIAL_ENTITY} or {password.VALID_CREDENTIAL_ENTITY}.** * Does this needs documentation? **Yes** Author: Pascal Pellmont Author: jpmcmu Closes #3415 from jpmcmu/ZEPPELIN-1070-0.8 and squashes the following commits: 66e69441e [jpmcmu] Code review changes 7e56bf443 [jpmcmu] Code review changes de714c31c [Pascal Pellmont] [ZEPPELIN-1070] if credential entry is not found then leave the pattern as is 21d9556db [Pascal Pellmont] [ZEPPELIN-1070] Replaced $[...] pattern with {...} pattern e7060f56d [Pascal Pellmont] [ZEPPELIN-1070] Inject Credentials in any Interpreter-Code --- .../zeppelin/img/screenshots/credential_entry.png | Bin 0 -> 3067 bytes .../screenshots/credential_injection_setting.PNG | Bin 0 -> 2183 bytes docs/usage/interpreter/overview.md | 16 +++ .../org/apache/zeppelin/interpreter/Constants.java | 2 + .../zeppelin/notebook/CredentialInjector.java | 110 + .../org/apache/zeppelin/notebook/Paragraph.java| 15 ++- .../zeppelin/notebook/CredentialInjectorTest.java | 86 .../apache/zeppelin/notebook/ParagraphTest.java| 63 ++-- 8 files changed, 285 insertions(+), 7 deletions(-) diff --git a/docs/assets/themes/zeppelin/img/screenshots/credential_entry.png b/docs/assets/themes/zeppelin/img/screenshots/credential_entry.png new file mode 100644 index 000..745e91d Binary files /dev/null and b/docs/assets/themes/zeppelin/img/screenshots/credential_entry.png differ diff --git a/docs/assets/themes/zeppelin/img/screenshots/credential_injection_setting.PNG b/docs/assets/themes/zeppelin/img/screenshots/credential_injection_setting.PNG new file mode 100644 index 000..ca98ca5 Binary files /dev/null and b/docs/assets/themes/zeppelin/img/screenshots/credential_injection_setting.PNG differ diff --git a/docs/usage/interpreter/overview.md b/docs/usage/interpreter/overview.md index 5b567c7..4098202 100644 --- a/docs/usage/interpreter/overview.md +++ b/docs/usage/interpreter/overview.md @@ -152,3 +152,19 @@ In such cases, interpreter process recovery is necessary. Starting from 0.8.0, u `org.apache.zeppelin.interpreter.recovery.FileSystemRecoveryStorage` or other implementations if available in future, by default it is `org.apache.zeppelin.interpreter.recovery.NullRecoveryStorage` which means recovery is not enabled. Enable recover means shutting down Zeppelin would not terminating interpreter process, and when Zeppelin is restarted, it would try to reconnect to the existing running interpreter processes. If you want to kill all the interpreter processes after terminating Zeppelin even when recovery is enabled, you can run `bin/stop-interpreter.sh` + +## Credential Injection + +Credentials from the credential manager can be injected into Notebooks. Credential injection works by replacing the following patterns in Note
[zeppelin] branch branch-0.8 updated: [ZEPPELIN-4150] Livy interpreter session auto restart doesn't work with livy 0.6.0
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch branch-0.8 in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/branch-0.8 by this push: new c77f22f [ZEPPELIN-4150] Livy interpreter session auto restart doesn't work with livy 0.6.0 c77f22f is described below commit c77f22f829acf6a6745eced57328339f92fbd27e Author: sergeymazin AuthorDate: Thu Jul 4 02:07:52 2019 +0300 [ZEPPELIN-4150] Livy interpreter session auto restart doesn't work with livy 0.6.0 Change SESSION_NOT_FOUND_PATTERN to match JSON response body from Livy 0.6.0. [Bug Fix] * [ ] - Task * https://issues.apache.org/jira/browse/ZEPPELIN-4150 * CI pass * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: sergeymazin Closes #3396 from sergeymazin/master and squashes the following commits: f99b3488c [sergeymazin] change SESSION_NOT_FOUND_PATTERN to match JSON response body (cherry picked from commit a47f8e1f0d271e8b8bbd8d425cd86eba8cb92648) Signed-off-by: Jeff Zhang --- livy/src/main/java/org/apache/zeppelin/livy/BaseLivyInterpreter.java | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/livy/src/main/java/org/apache/zeppelin/livy/BaseLivyInterpreter.java b/livy/src/main/java/org/apache/zeppelin/livy/BaseLivyInterpreter.java index 75a116a..11d88b1 100644 --- a/livy/src/main/java/org/apache/zeppelin/livy/BaseLivyInterpreter.java +++ b/livy/src/main/java/org/apache/zeppelin/livy/BaseLivyInterpreter.java @@ -89,7 +89,7 @@ public abstract class BaseLivyInterpreter extends Interpreter { protected static final Logger LOGGER = LoggerFactory.getLogger(BaseLivyInterpreter.class); private static Gson gson = new GsonBuilder().setPrettyPrinting().disableHtmlEscaping().create(); - private static String SESSION_NOT_FOUND_PATTERN = "\"Session '\\d+' not found.\""; + private static final String SESSION_NOT_FOUND_PATTERN = "(.*)\"Session '\\d+' not found.\"(.*)"; protected volatile SessionInfo sessionInfo; private String livyURL;
[zeppelin] branch master updated: [ZEPPELIN-4150] Livy interpreter session auto restart doesn't work with livy 0.6.0
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new a47f8e1 [ZEPPELIN-4150] Livy interpreter session auto restart doesn't work with livy 0.6.0 a47f8e1 is described below commit a47f8e1f0d271e8b8bbd8d425cd86eba8cb92648 Author: sergeymazin AuthorDate: Thu Jul 4 02:07:52 2019 +0300 [ZEPPELIN-4150] Livy interpreter session auto restart doesn't work with livy 0.6.0 ### What is this PR for? Change SESSION_NOT_FOUND_PATTERN to match JSON response body from Livy 0.6.0. ### What type of PR is it? [Bug Fix] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-4150 ### How should this be tested? * CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: sergeymazin Closes #3396 from sergeymazin/master and squashes the following commits: f99b3488c [sergeymazin] change SESSION_NOT_FOUND_PATTERN to match JSON response body --- livy/src/main/java/org/apache/zeppelin/livy/BaseLivyInterpreter.java | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/livy/src/main/java/org/apache/zeppelin/livy/BaseLivyInterpreter.java b/livy/src/main/java/org/apache/zeppelin/livy/BaseLivyInterpreter.java index 95674ea..d47a322 100644 --- a/livy/src/main/java/org/apache/zeppelin/livy/BaseLivyInterpreter.java +++ b/livy/src/main/java/org/apache/zeppelin/livy/BaseLivyInterpreter.java @@ -86,7 +86,7 @@ public abstract class BaseLivyInterpreter extends Interpreter { protected static final Logger LOGGER = LoggerFactory.getLogger(BaseLivyInterpreter.class); private static Gson gson = new GsonBuilder().setPrettyPrinting().disableHtmlEscaping().create(); - private static final String SESSION_NOT_FOUND_PATTERN = "\"Session '\\d+' not found.\""; + private static final String SESSION_NOT_FOUND_PATTERN = "(.*)\"Session '\\d+' not found.\"(.*)"; protected volatile SessionInfo sessionInfo; private String livyURL;
[zeppelin] branch master updated: ZEPPELIN-4304 Allow to override useNativeGit property of the gitcommitid plugin
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new b80c3a4 ZEPPELIN-4304 Allow to override useNativeGit property of the gitcommitid plugin b80c3a4 is described below commit b80c3a4d6ab40dd8146cb30013b25742640dac0d Author: Alex Ott AuthorDate: Sun Aug 18 16:43:51 2019 +0200 ZEPPELIN-4304 Allow to override useNativeGit property of the gitcommitid plugin ## What is this PR for? It's now possible to override value of the `useNativeGit` configuration property of the git commit id plugin with `plugin.gitcommitid.useNativeGit` property, like this: ``` mvn package -Dplugin.gitcommitid.useNativeGit=true ``` ### What type of PR is it? Improvement ### Todos * [ ] - Task ### What is the Jira issue? ZEPPELIN-4304 ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Alex Ott Closes #3427 from alexott/ZEPPELIN-4304 and squashes the following commits: 3a6d9555e [Alex Ott] ZEPPELIN-4304 Allow to override useNativeGit property of the gitcommitid plugin --- pom.xml | 3 +++ 1 file changed, 3 insertions(+) diff --git a/pom.xml b/pom.xml index c962eb4..6f32b9b 100644 --- a/pom.xml +++ b/pom.xml @@ -152,6 +152,8 @@ 2.8.2 3.1.1 +false + 64m 512m @@ -527,6 +529,7 @@ false ${project.basedir}/.git + ${plugin.gitcommitid.useNativeGit} true ${project.build.outputDirectory}/git.properties false
[zeppelin] branch master updated: ZEPPELIN-4272: Zeppelin fails to compile when hadoop3 is enabled
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 0c491e4 ZEPPELIN-4272: Zeppelin fails to compile when hadoop3 is enabled 0c491e4 is described below commit 0c491e466525e547b1b8cd2bfb49d26cd9d264b3 Author: Bhavik Patel AuthorDate: Mon Jul 22 15:06:14 2019 +0530 ZEPPELIN-4272: Zeppelin fails to compile when hadoop3 is enabled ### What is this PR for? To compile and build Zeppelin with hadoop3 added couple of missing dependencies ### What type of PR is it? [Bug Fix] ### What is the Jira issue? * [ZEPPELIN-4272](https://issues.apache.org/jira/browse/ZEPPELIN-4272) ### How should this be tested? * CI green ### Screenshots (if appropriate) ![apache_zepp](https://user-images.githubusercontent.com/9100442/61625654-dc261300-ac98-11e9-88c3-a85668e050e3.png) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? Yes, added 'kerberos-client' dependency for hadoop3 * Does this needs documentation? No Author: Bhavik Patel Closes #3411 from bhavikpatel9977/ZEPPELIN-4272 and squashes the following commits: 40f65d605 [Bhavik Patel] ZEPPELIN-4272: Zeppelin fails to use s3a configured for zeppelin.notebook.dir --- zeppelin-zengine/pom.xml | 29 + .../zeppelin/notebook/FileSystemStorage.java | 36 +++--- .../zeppelinhub/websocket/ZeppelinhubClient.java | 6 ++-- 3 files changed, 57 insertions(+), 14 deletions(-) diff --git a/zeppelin-zengine/pom.xml b/zeppelin-zengine/pom.xml index 3fd44c7..715f6f9 100644 --- a/zeppelin-zengine/pom.xml +++ b/zeppelin-zengine/pom.xml @@ -48,6 +48,8 @@ 1.10.62 2.2 4.5.4.201711221230-r +1.4.0 +2.0.0-M15 0.27 0.32.0-alpha @@ -160,12 +162,6 @@ - com.amazonaws - aws-java-sdk-s3 - ${aws.sdk.s3.version} - - - com.github.eirslett frontend-maven-plugin ${frontend.maven.plugin.version} @@ -313,6 +309,12 @@ + com.amazonaws + aws-java-sdk-s3 + ${aws.sdk.s3.version} + + + org.apache.hadoop hadoop-client ${hadoop.version} @@ -650,6 +652,21 @@ ${hadoop.version} test + + org.codehaus.jettison + jettison + ${jettison.version} + + + org.apache.hadoop + hadoop-aws + ${hadoop.version} + + + org.apache.directory.server + kerberos-client + ${kerberos-client.version} + diff --git a/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/FileSystemStorage.java b/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/FileSystemStorage.java index 122848e..f47cf65 100644 --- a/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/FileSystemStorage.java +++ b/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/FileSystemStorage.java @@ -29,6 +29,8 @@ import java.util.List; public class FileSystemStorage { private static Logger LOGGER = LoggerFactory.getLogger(FileSystemStorage.class); + private static final String S3A = "s3a"; + private static final String FS_DEFAULTFS = "fs.defaultFS"; // only do UserGroupInformation.loginUserFromKeytab one time, otherwise you will still get // your ticket expired. @@ -60,18 +62,42 @@ public class FileSystemStorage { public FileSystemStorage(ZeppelinConfiguration zConf, String path) throws IOException { this.zConf = zConf; this.hadoopConf = new Configuration(); +URI zepConfigURI; +URI defaultFSURI; + +try { + zepConfigURI = new URI(path); +} catch (URISyntaxException e) { + LOGGER.error("Failed to get Zeppelin config URI"); + throw new IOException(e); +} // disable checksum for local file system. because interpreter.json may be updated by // non-hadoop filesystem api -// disable caching for file:// scheme to avoid getting LocalFS which does CRC checks -this.hadoopConf.setBoolean("fs.file.impl.disable.cache", true); -this.hadoopConf.set("fs.file.impl", RawLocalFileSystem.class.getName()); -this.isSecurityEnabled = UserGroupInformation.isSecurityEnabled(); +// disable caching for file:// scheme to avoid getting LocalFS which does CRC checks. +this.hadoopConf.setBoolean("fs.file.impl.disable.cache", true); +String defaultFS = this.hadoopConf.get(FS_DEFAULTFS); try { - this.fs = FileSystem.get(new URI(path), this.hadoopConf); + defaultFS
[zeppelin] branch master updated: [ZEPPELIN-4306] Add ForwardedRequestCustomizer to httpConfig
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 65ec6eb [ZEPPELIN-4306] Add ForwardedRequestCustomizer to httpConfig 65ec6eb is described below commit 65ec6ebd7a651af7f5167867a1a432738376ebef Author: Philipp Dallig AuthorDate: Mon Aug 19 14:18:17 2019 +0200 [ZEPPELIN-4306] Add ForwardedRequestCustomizer to httpConfig ### What is this PR for? With this PR the jetty customizer `ForwardedRequestCustomizer` is enabled to correct jetty behavior, if zeppelin is running behind a proxy. ### What type of PR is it? Improvement ### What is the Jira issue? [ZEPPELIN-4306](https://issues.apache.org/jira/browse/ZEPPELIN-4306) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Philipp Dallig Closes #3429 from Reamer/ForwardedRequestCustomizer and squashes the following commits: 08beb1dea [Philipp Dallig] Add ForwardedRequestCustomizer to httpConfig --- .../src/main/java/org/apache/zeppelin/server/ZeppelinServer.java| 6 -- 1 file changed, 4 insertions(+), 2 deletions(-) diff --git a/zeppelin-server/src/main/java/org/apache/zeppelin/server/ZeppelinServer.java b/zeppelin-server/src/main/java/org/apache/zeppelin/server/ZeppelinServer.java index 29fbd07..2aaad7a 100644 --- a/zeppelin-server/src/main/java/org/apache/zeppelin/server/ZeppelinServer.java +++ b/zeppelin-server/src/main/java/org/apache/zeppelin/server/ZeppelinServer.java @@ -66,6 +66,7 @@ import org.apache.zeppelin.util.ReflectionUtils; import org.eclipse.jetty.http.HttpVersion; import org.eclipse.jetty.jmx.ConnectorServer; import org.eclipse.jetty.jmx.MBeanContainer; +import org.eclipse.jetty.server.ForwardedRequestCustomizer; import org.eclipse.jetty.server.HttpConfiguration; import org.eclipse.jetty.server.HttpConnectionFactory; import org.eclipse.jetty.server.SecureRequestCustomizer; @@ -295,9 +296,10 @@ public class ZeppelinServer extends ResourceConfig { final Server server = new Server(threadPool); ServerConnector connector; +HttpConfiguration httpConfig = new HttpConfiguration(); +httpConfig.addCustomizer(new ForwardedRequestCustomizer()); if (conf.useSsl()) { LOG.debug("Enabling SSL for Zeppelin Server on port " + conf.getServerSslPort()); - HttpConfiguration httpConfig = new HttpConfiguration(); httpConfig.setSecureScheme("https"); httpConfig.setSecurePort(conf.getServerSslPort()); httpConfig.setOutputBufferSize(32768); @@ -314,7 +316,7 @@ public class ZeppelinServer extends ResourceConfig { new SslConnectionFactory(getSslContextFactory(conf), HttpVersion.HTTP_1_1.asString()), new HttpConnectionFactory(httpsConfig)); } else { - connector = new ServerConnector(server); + connector = new ServerConnector(server, new HttpConnectionFactory(httpConfig)); } configureRequestHeaderSize(conf, connector);
[zeppelin] branch branch-0.8 updated: [ZEPPELIN-4278]: Fixed closing bracket in bin/common.cmd
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch branch-0.8 in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/branch-0.8 by this push: new e11b819 [ZEPPELIN-4278]: Fixed closing bracket in bin/common.cmd e11b819 is described below commit e11b819903e28bd3a337f65532aadc45c470d5c3 Author: msid AuthorDate: Tue Aug 27 20:08:53 2019 +0300 [ZEPPELIN-4278]: Fixed closing bracket in bin/common.cmd ### What is this PR for? Fixed closing bracket in common.cmd file, that was causing error on running zeppelin in Windows environment ### What type of PR is it? Bug Fix ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-4278 ### How should this be tested? User should be able to run Zeppelin on Windows environment ### Questions: * Does the licenses files need update? * No * Is there breaking changes for older versions? * No * Does this needs documentation? * No Author: msid Closes #3433 from msid/ZEPPELIN-4278 and squashes the following commits: 61338e65c [msid] [ZEPPELIN-4278]: Fixed closing bracket in bin/common.cmd --- bin/common.cmd | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/bin/common.cmd b/bin/common.cmd index 21657c1..b9e4ea0 100644 --- a/bin/common.cmd +++ b/bin/common.cmd @@ -74,7 +74,7 @@ if not defined ZEPPELIN_JAVA_OPTS ( if defined ZEPPELIN_JMX_ENABLE ( if not defined ZEPPELIN_JMX_PORT ( set ZEPPELIN_JMX_PORT="9996" - } + ) set JMX_JAVA_OPTS=" -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.port=${ZEPPELIN_JMX_PORT} -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false" set ZEPPELIN_JAVA_OPTS=%JMX_JAVA_OPTS% %ZEPPELIN_JAVA_OPTS )
[zeppelin] branch master updated: [ZEPPELIN-4305] LocalStorageConfig.atomicWriteToFile throws exception
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 30ce442 [ZEPPELIN-4305] LocalStorageConfig.atomicWriteToFile throws exception 30ce442 is described below commit 30ce442a768c0717f3424088426faaf3cf95f18c Author: Alex Ott AuthorDate: Mon Aug 19 18:47:05 2019 +0200 [ZEPPELIN-4305] LocalStorageConfig.atomicWriteToFile throws exception ### What is this PR for? The hotfix that was made several weeks ago changed behavior of LocalStorageConfig.atomicWriteToFile, that started to atomically move files to destination. But this works without errors only when temporary directory and destination are on the same disk. When they are on different disks, atomic move isn't possible, so the exception is thrown. This PR fixes this by performing non-atomic move to temp file on destination file system, and then atomically rename it to destination file. ### What type of PR is it? Bug Fix ### What is the Jira issue? ZEPPELIN-4305 ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Alex Ott Closes #3428 from alexott/ZEPPELIN-4305 and squashes the following commits: 90e9c59f6 [Alex Ott] added unit test, and fix resource leak f36508056 [Alex Ott] instead moving 2 times, just extract temp file into dest dir 293af1536 [Alex Ott] further improvements after code review 349188a44 [Alex Ott] [ZEPPELIN-4305] LocalStorageConfig.atomicWriteToFile throws exception --- .../zeppelin/storage/LocalConfigStorage.java | 24 ++- .../zeppelin/storage/LocalConfigStorageTest.java | 50 ++ 2 files changed, 63 insertions(+), 11 deletions(-) diff --git a/zeppelin-zengine/src/main/java/org/apache/zeppelin/storage/LocalConfigStorage.java b/zeppelin-zengine/src/main/java/org/apache/zeppelin/storage/LocalConfigStorage.java index b92182d..1bdb13b 100644 --- a/zeppelin-zengine/src/main/java/org/apache/zeppelin/storage/LocalConfigStorage.java +++ b/zeppelin-zengine/src/main/java/org/apache/zeppelin/storage/LocalConfigStorage.java @@ -17,6 +17,7 @@ package org.apache.zeppelin.storage; +import com.google.common.annotations.VisibleForTesting; import org.apache.commons.io.IOUtils; import org.apache.zeppelin.conf.ZeppelinConfiguration; import org.apache.zeppelin.interpreter.InterpreterInfoSaving; @@ -103,14 +104,19 @@ public class LocalConfigStorage extends ConfigStorage { atomicWriteToFile(credentials, credentialPath); } - private String readFromFile(File file) throws IOException { -return IOUtils.toString(new FileInputStream(file)); + @VisibleForTesting + static String readFromFile(File file) throws IOException { +try (FileInputStream is = new FileInputStream(file)) { + return IOUtils.toString(is); +} } - private void atomicWriteToFile(String content, File file) throws IOException { -File tempFile = Files.createTempFile(file.getName(), null).toFile(); -FileOutputStream out = new FileOutputStream(tempFile); -try { + @VisibleForTesting + static void atomicWriteToFile(String content, File file) throws IOException { +FileSystem defaultFileSystem = FileSystems.getDefault(); +Path destinationFilePath = defaultFileSystem.getPath(file.getCanonicalPath()); +File tempFile = Files.createTempFile(destinationFilePath.getParent(), file.getName(), null).toFile(); +try (FileOutputStream out = new FileOutputStream(tempFile)) { IOUtils.write(content, out); } catch (IOException iox) { if (!tempFile.delete()) { @@ -118,13 +124,9 @@ public class LocalConfigStorage extends ConfigStorage { } throw iox; } -out.close(); -FileSystem defaultFileSystem = FileSystems.getDefault(); -Path destinationFilePath = defaultFileSystem.getPath(file.getCanonicalPath()); try { file.getParentFile().mkdirs(); - Files.move(tempFile.toPath(), destinationFilePath, - StandardCopyOption.ATOMIC_MOVE); + Files.move(tempFile.toPath(), destinationFilePath, StandardCopyOption.ATOMIC_MOVE); } catch (IOException iox) { if (!tempFile.delete()) { tempFile.deleteOnExit(); diff --git a/zeppelin-zengine/src/test/java/org/apache/zeppelin/storage/LocalConfigStorageTest.java b/zeppelin-zengine/src/test/java/org/apache/zeppelin/storage/LocalConfigStorageTest.java new file mode 100644 index 000..2006a69 --- /dev/null +++ b/zeppelin-zengine/src/test/java/org/apache/zeppelin/storage/LocalConfigStorageTest.java @@ -0,0 +1,50 @@ +package org.apache.zeppelin.storage; + +import org.apache.commons.io.IOUtils; +import org.junit.Test; + +import
[zeppelin] branch master updated: [HOTFIX] Add apache licence header to LocalConfigStorageTest
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new e0bee71 [HOTFIX] Add apache licence header to LocalConfigStorageTest e0bee71 is described below commit e0bee71e00819b53db8543b8b4b679fcd56657aa Author: Jeff Zhang AuthorDate: Wed Sep 4 16:03:18 2019 +0800 [HOTFIX] Add apache licence header to LocalConfigStorageTest --- .../apache/zeppelin/storage/LocalConfigStorageTest.java | 17 + 1 file changed, 17 insertions(+) diff --git a/zeppelin-zengine/src/test/java/org/apache/zeppelin/storage/LocalConfigStorageTest.java b/zeppelin-zengine/src/test/java/org/apache/zeppelin/storage/LocalConfigStorageTest.java index 2006a69..9e4b6a8 100644 --- a/zeppelin-zengine/src/test/java/org/apache/zeppelin/storage/LocalConfigStorageTest.java +++ b/zeppelin-zengine/src/test/java/org/apache/zeppelin/storage/LocalConfigStorageTest.java @@ -1,3 +1,20 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with + * this work for additional information regarding copyright ownership. + * The ASF licenses this file to You under the Apache License, Version 2.0 + * (the "License"); you may not use this file except in compliance with + * the License. You may obtain a copy of the License at + * + *http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, software + * distributed under the License is distributed on an "AS IS" BASIS, + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + * See the License for the specific language governing permissions and + * limitations under the License. + */ + package org.apache.zeppelin.storage; import org.apache.commons.io.IOUtils;
[zeppelin] branch master updated: [HOTFIX] [ZEPPELIN-4305] make sure that destination directory exists
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 333a34a [HOTFIX] [ZEPPELIN-4305] make sure that destination directory exists 333a34a is described below commit 333a34a92f54783005fd5f3cadbfe5b10067f110 Author: Alex Ott AuthorDate: Thu Sep 5 08:47:11 2019 +0200 [HOTFIX] [ZEPPELIN-4305] make sure that destination directory exists ### What is this PR for? This is a fix for issue reported in #3428 - this may happen when destination directory doesn't exist. The given PR is explicitly create destination directory. ### What type of PR is it? Hot Fix Author: Alex Ott Closes #3439 from alexott/ZEPPELIN-4305-fix and squashes the following commits: cd3d12b48 [Alex Ott] [HOTFIX] [ZEPPELIN-4305] make sure that destination directory exists --- .../apache/zeppelin/storage/LocalConfigStorage.java | 4 +++- .../zeppelin/storage/LocalConfigStorageTest.java | 20 2 files changed, 23 insertions(+), 1 deletion(-) diff --git a/zeppelin-zengine/src/main/java/org/apache/zeppelin/storage/LocalConfigStorage.java b/zeppelin-zengine/src/main/java/org/apache/zeppelin/storage/LocalConfigStorage.java index 1bdb13b..0f5999d 100644 --- a/zeppelin-zengine/src/main/java/org/apache/zeppelin/storage/LocalConfigStorage.java +++ b/zeppelin-zengine/src/main/java/org/apache/zeppelin/storage/LocalConfigStorage.java @@ -115,7 +115,9 @@ public class LocalConfigStorage extends ConfigStorage { static void atomicWriteToFile(String content, File file) throws IOException { FileSystem defaultFileSystem = FileSystems.getDefault(); Path destinationFilePath = defaultFileSystem.getPath(file.getCanonicalPath()); -File tempFile = Files.createTempFile(destinationFilePath.getParent(), file.getName(), null).toFile(); +Path destinationDirectory = destinationFilePath.getParent(); +Files.createDirectories(destinationDirectory); +File tempFile = Files.createTempFile(destinationDirectory, file.getName(), null).toFile(); try (FileOutputStream out = new FileOutputStream(tempFile)) { IOUtils.write(content, out); } catch (IOException iox) { diff --git a/zeppelin-zengine/src/test/java/org/apache/zeppelin/storage/LocalConfigStorageTest.java b/zeppelin-zengine/src/test/java/org/apache/zeppelin/storage/LocalConfigStorageTest.java index 9e4b6a8..cf0ac63 100644 --- a/zeppelin-zengine/src/test/java/org/apache/zeppelin/storage/LocalConfigStorageTest.java +++ b/zeppelin-zengine/src/test/java/org/apache/zeppelin/storage/LocalConfigStorageTest.java @@ -26,6 +26,8 @@ import java.io.IOException; import java.io.InputStream; import java.nio.file.Files; import java.nio.file.Path; +import java.nio.file.Paths; +import java.util.Random; import static org.junit.Assert.*; @@ -48,6 +50,24 @@ public class LocalConfigStorageTest { } @Test +public void testWritingAtomicallyNonExistingDir() throws IOException { +Random rnd = new Random(); +final Path destDir = Paths.get(System.getProperty("java.io.tmpdir"), "non-existing-" + rnd.nextLong()); +final Path destination = Paths.get(destDir.toString(),"test-" + rnd.nextLong() + "-file"); +final File destinationFile = destination.toFile(); +try { +LocalConfigStorage.atomicWriteToFile(TEST_STRING, destinationFile); +try (InputStream is = Files.newInputStream(destination)) { +String read = IOUtils.toString(is); +assertEquals(TEST_STRING, read); +} +} finally { +Files.deleteIfExists(destination); +Files.deleteIfExists(destDir); +} +} + +@Test public void testReading() throws IOException { final Path destination = Files.createTempFile("test-", "file"); final File destinationFile = destination.toFile();
[zeppelin] branch master updated: [ZEPPELIN-4091] Fix concurrent autocomplete and execute for Ipython
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 7ccf608 [ZEPPELIN-4091] Fix concurrent autocomplete and execute for Ipython 7ccf608 is described below commit 7ccf608ee72470a38cf07ea16cba2cd292b6f39c Author: marc hurabielle AuthorDate: Sat Sep 7 15:22:32 2019 +0900 [ZEPPELIN-4091] Fix concurrent autocomplete and execute for Ipython ### What is this PR for? The pr is to fix a bug that will make the **ipython** `execute_interactive` hang forever if a auto `complete` call is make at the same time. (see unit test for example that is failing on master). For now the fix is to synchronize those method : `execute` / `complete`. It will not bring regression because anyway, the kernel does not support concurrent execute and auto complete (see https://github.com/jupyter/notebook/issues/3763) ### What type of PR is it? Bug Fix ### Todos * [x] - unit test failing in master / succeed on this branch * [x] - fix with lock ### What is the Jira issue? It is one part of the jira issue. Other fix will come soon https://issues.apache.org/jira/browse/ZEPPELIN-4091 ### How should this be tested? * First time? Setup Travis CI as described on https://zeppelin.apache.org/contribution/contributions.html#continuous-integration * Strongly recommended: add automated unit tests for any new or changed behavior * Outline any manual steps to test the PR here. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: marc hurabielle Closes #3336 from AyWa/fix/concurrent-auto-complete and squashes the following commits: 86dab7345 [marc hurabielle] fix rebase 5bed19496 [marc hurabielle] fix lint 6e48c1380 [marc hurabielle] try single threaded f14d8b242 [marc hurabielle] Revert "just test ci behavior" be6663f89 [marc hurabielle] just test ci behavior bc2b4f6e6 [marc hurabielle] bring back test d43f03da9 [marc hurabielle] use initIntpProperties instead of empty one c37414cc2 [marc hurabielle] increase timeout f7cae9538 [marc hurabielle] move synchronize near the thread check 616f0122f [marc hurabielle] add test to ensure that autocomplete and interpret can be call concurrently 409b75f0f [marc hurabielle] add lock to ensure ipython execute will not be stuck forever when complete is call --- .../main/resources/grpc/python/ipython_server.py | 74 -- .../zeppelin/python/IPythonInterpreterTest.java| 50 +++ 2 files changed, 89 insertions(+), 35 deletions(-) diff --git a/python/src/main/resources/grpc/python/ipython_server.py b/python/src/main/resources/grpc/python/ipython_server.py index 3fd0a8c..47f67b7 100644 --- a/python/src/main/resources/grpc/python/ipython_server.py +++ b/python/src/main/resources/grpc/python/ipython_server.py @@ -38,6 +38,10 @@ class IPython(ipython_pb2_grpc.IPythonServicer): def __init__(self, server): self._status = ipython_pb2.STARTING self._server = server +# issue with execute_interactive and auto completion: https://github.com/jupyter/jupyter_client/issues/429 +# in all case because ipython does not support run and auto completion at the same time: https://github.com/jupyter/notebook/issues/3763 +# For now we will lock to ensure that there is no concurrent bug that can "hang" the kernel +self._lock = threading.Lock() def start(self): print("starting...") @@ -83,43 +87,42 @@ class IPython(ipython_pb2_grpc.IPythonServicer): payload_reply = [] def execute_worker(): reply = self._kc.execute_interactive(request.code, -output_hook=_output_hook, -timeout=None) + output_hook=_output_hook, + timeout=None) payload_reply.append(reply) t = threading.Thread(name="ConsumerThread", target=execute_worker) -t.start() - -# We want to ensure that the kernel is alive because in case of OOM or other errors -# Execution might be stuck there: -# https://github.com/jupyter/jupyter_client/blob/master/jupyter_client/blocking/client.py#L32 -while t.is_alive() and self.isKernelAlive(): -while not text_queue.empty(): -output = text_queue.get() -yield ipython_pb2.ExecuteResponse(status=ipython_pb2.SUCCESS, -
[zeppelin] branch master updated: [ZEPPELIN-4298] Fix broken link on credentials page
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 6450a00 [ZEPPELIN-4298] Fix broken link on credentials page 6450a00 is described below commit 6450a00b0e5f6a1eb9bcf982b355ee421d06135f Author: Jay Jin AuthorDate: Tue Sep 3 00:05:43 2019 +0900 [ZEPPELIN-4298] Fix broken link on credentials page ### What is this PR for? Fix broken link on credentials page Problem: The doc url changed for the `datasource_authorization.html` changed over the version 0.7 (Under version 0.7) https://zeppelin.apache.org/docs/`0.7.3/`security/datasource_authorization.html (Over version 0.7) https://zeppelin.apache.org/docs/`0.8.1/setup/`security/datasource_authorization.html https://zeppelin.apache.org/docs/`0.9.0-SNAPSHOT/setup/`security/datasource_authorization.html ### What type of PR is it? Bug Fix ### Todos * [ ] - Task ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-4307 ### How should this be tested? * First time? Setup Travis CI as described on https://zeppelin.apache.org/contribution/contributions.html#continuous-integration * Strongly recommended: add automated unit tests for any new or changed behavior * Outline any manual steps to test the PR here. ### Screenshots (if appropriate) ![Sep-03-2019 00-14-43](https://user-images.githubusercontent.com/3839771/64123633-e54de800-cddf-11e9-8047-e3c7ea23cf7b.gif) ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Jay Jin Closes #3435 from milooy/master and squashes the following commits: 9606ec004 [Jay Jin] Add '/setup' to doc link on the version over 0.7.0 --- zeppelin-web/src/app/credential/credential.controller.js | 13 - zeppelin-web/src/app/credential/credential.html | 2 +- 2 files changed, 13 insertions(+), 2 deletions(-) diff --git a/zeppelin-web/src/app/credential/credential.controller.js b/zeppelin-web/src/app/credential/credential.controller.js index cf6c340..7de383e 100644 --- a/zeppelin-web/src/app/credential/credential.controller.js +++ b/zeppelin-web/src/app/credential/credential.controller.js @@ -14,7 +14,7 @@ angular.module('zeppelinWebApp').controller('CredentialCtrl', CredentialController); -function CredentialController($scope, $http, baseUrlSrv, ngToast) { +function CredentialController($scope, $rootScope, $http, baseUrlSrv, ngToast) { 'ngInject'; ngToast.dismiss(); @@ -198,6 +198,17 @@ function CredentialController($scope, $http, baseUrlSrv, ngToast) { } } + $scope.getCredentialDocsLink = function() { +const currentVersion = $rootScope.zeppelinVersion; +const isVersionOver0Point7 = currentVersion && currentVersion.split('.')[1] > 7; +/* + * Add '/setup' to doc link on the version over 0.7.0 + */ +return `https://zeppelin.apache.org/docs/${currentVersion}${ + isVersionOver0Point7 ? '/setup' : '' +}/security/datasource_authorization.html`; + }; + let init = function() { getAvailableInterpreters(); getCredentialInfo(); diff --git a/zeppelin-web/src/app/credential/credential.html b/zeppelin-web/src/app/credential/credential.html index cf283d6..7c9414d 100644 --- a/zeppelin-web/src/app/credential/credential.html +++ b/zeppelin-web/src/app/credential/credential.html @@ -21,7 +21,7 @@ limitations under the License. http://zeppelin.apache.org/docs/{{zeppelinVersion}}/security/datasource_authorization.html; + ng-href="{{getCredentialDocsLink()}}" tooltip-placement="bottom" uib-tooltip="Learn more">
[zeppelin] branch master updated: [ZEPPELIN-4324]: Support two-way SSL authentication.
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 79f751a [ZEPPELIN-4324]: Support two-way SSL authentication. 79f751a is described below commit 79f751a0e03c9fe731a2c44238976cdab479b2d5 Author: fdeantoni AuthorDate: Mon Sep 9 12:56:54 2019 +0800 [ZEPPELIN-4324]: Support two-way SSL authentication. ### What is this PR for? Livy can run behind a reverse proxy that requires SSL authentication. To support this, three additional properties have been added: - zeppelin.livy.ssl.keyStore - zeppelin.livy.ssl.keyStorePassword - zeppelin.livy.ssl.keyStoreType The keystore type can either be JKS or PKCS12. The default is JKS. To keep things streamlined, a property `zeppelin.livy.ssl.trustStoreType` has been been added as well. Default value is also JKS. ### What type of PR is it? Improvement ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-4324 ### How should this be tested? Set up a livy instance behind a reverse proxy (e.g. HAProxy) that requires two way SSL authentication to access it. Configure the Livy interpreter to access this instance by setting the following properties: - zeppelin.livy.ssl.keyStore: Path to keystore containing client certificate and key - zeppelin.livy.ssl.keyStorePassword: Password of keystore - zeppelin.livy.ssl.keyStoreType: Either JKS or PKCS12 - zeppelin.livy.ssl.trustStore: Path to trust store containing proxy host certificate - zeppelin.livy.ssl.trustStorePassword: Password of trust store - zeppelin.livy.ssl.keyStoreType: Either JKS or PKCS12 Author: fdeantoni Closes #3441 from fdeantoni/two-way-ssl and squashes the following commits: a0f18cc7c [fdeantoni] ZEPPELIN-4324: Support two-way SSL authentication. --- docs/interpreter/livy.md | 25 .../apache/zeppelin/livy/BaseLivyInterpreter.java | 127 + 2 files changed, 104 insertions(+), 48 deletions(-) diff --git a/docs/interpreter/livy.md b/docs/interpreter/livy.md index 954eb8c..c7a96ba 100644 --- a/docs/interpreter/livy.md +++ b/docs/interpreter/livy.md @@ -146,6 +146,31 @@ Example: `spark.driver.memory` to `livy.spark.driver.memory` password for trustStore file. Used when livy ssl is enabled +zeppelin.livy.ssl.trustStoreType +JKS +type of truststore. Either JKS or PKCS12. + + +zeppelin.livy.ssl.keyStore + +client keyStore file. Needed if Livy requires two way SSL authentication. + + +zeppelin.livy.ssl.keyStorePassword + +password for keyStore file. + + +zeppelin.livy.ssl.keyStoreType +JKS +type of keystore. Either JKS or PKCS12. + + +zeppelin.livy.ssl.keyPassword + +password for key in the keyStore file. Defaults to zeppelin.livy.ssl.keyStorePassword. + + zeppelin.livy.http.headers key_1: value_1; key_2: value_2 custom http headers when calling livy rest api. Each http header is separated by `;`, and each header is one key value pair where key value is separated by `:` diff --git a/livy/src/main/java/org/apache/zeppelin/livy/BaseLivyInterpreter.java b/livy/src/main/java/org/apache/zeppelin/livy/BaseLivyInterpreter.java index d47a322..afaf55c 100644 --- a/livy/src/main/java/org/apache/zeppelin/livy/BaseLivyInterpreter.java +++ b/livy/src/main/java/org/apache/zeppelin/livy/BaseLivyInterpreter.java @@ -34,6 +34,7 @@ import org.apache.http.config.Registry; import org.apache.http.config.RegistryBuilder; import org.apache.http.conn.ssl.SSLConnectionSocketFactory; import org.apache.http.conn.ssl.SSLContexts; +import org.apache.http.conn.ssl.SSLContextBuilder; import org.apache.http.impl.auth.SPNegoSchemeFactory; import org.apache.http.impl.client.BasicCredentialsProvider; import org.apache.http.impl.client.HttpClientBuilder; @@ -55,7 +56,7 @@ import org.springframework.web.client.RestTemplate; import java.io.FileInputStream; import java.io.IOException; -import java.nio.charset.Charset; +import java.nio.charset.StandardCharsets; import java.security.KeyStore; import java.security.Principal; import java.util.ArrayList; @@ -571,6 +572,59 @@ public abstract class BaseLivyInterpreter extends Interpreter { callRestAPI("/sessions/" + sessionInfo.id + "/statements/" + statementId + "/cancel", "POST"); } + private SSLContext getSslContext() { +try { + // Build truststore + String trustStoreFile = getProperty("zeppelin.livy.ssl.trustStore"); + String trustStorePassword = getProperty("zeppelin.livy.ssl.trustStorePassword"); + String trustStoreType = getProperty("zeppelin
[zeppelin] branch master updated: [ZEPPELIN-4014] Show note name on the search list, not the note id
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 08d4b9a [ZEPPELIN-4014] Show note name on the search list, not the note id 08d4b9a is described below commit 08d4b9a3bf31e02d9ff4c7a47cf3821061458eaa Author: Jay Jin AuthorDate: Tue Sep 3 01:25:55 2019 +0900 [ZEPPELIN-4014] Show note name on the search list, not the note id ### What is this PR for? The note IDs were shown on the search list(even if it's filtered by note's name) Need to show note name rather than id. ### What type of PR is it? Bug Fix ### Todos * [ ] - Task ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-4014 ### How should this be tested? * First time? Setup Travis CI as described on https://zeppelin.apache.org/contribution/contributions.html#continuous-integration * Strongly recommended: add automated unit tests for any new or changed behavior * Outline any manual steps to test the PR here. ### Screenshots (if appropriate) (Before: Notebook IDs are shown) ![image](https://user-images.githubusercontent.com/3839771/64126895-8346b000-cdea-11e9-87a7-54cf5c3a21d9.png) (After: Notebook names are shown) ![image](https://user-images.githubusercontent.com/3839771/64126858-5f836a00-cdea-11e9-9604-91622c52bfba.png) ### Questions: * Does the licenses files need update? * Is there breaking changes for older versions? * Does this needs documentation? Author: Jay Jin Closes #3436 from milooy/feat/ZEPPELIN-4014 and squashes the following commits: 8818febb4 [Jay Jin] Return note name on the notes.flatList to show note name in the search list --- zeppelin-web/src/components/note-list/note-list.factory.js | 4 1 file changed, 4 insertions(+) diff --git a/zeppelin-web/src/components/note-list/note-list.factory.js b/zeppelin-web/src/components/note-list/note-list.factory.js index 20310e3..ecb04bf 100644 --- a/zeppelin-web/src/components/note-list/note-list.factory.js +++ b/zeppelin-web/src/components/note-list/note-list.factory.js @@ -25,8 +25,12 @@ function NoteListFactory(arrayOrderingSrv, TRASH_FOLDER_ID) { setNotes: function(notesList) { // a flat list to boost searching notes.flatList = _.map(notesList, (note) => { +let notePath = note.path || note.id; +let nodes = notePath.match(/([^\/][^\/]*)/g) || []; + note.isTrash = note.path ? note.path.split('/')[1] === TRASH_FOLDER_ID : false; +note.name = nodes.pop(); return note; });
[zeppelin] branch master updated: [ZEPPELIN-4322] Flaky test: NotebookRestApiTest#testRunWithServerRestart
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 21cca11 [ZEPPELIN-4322] Flaky test: NotebookRestApiTest#testRunWithServerRestart 21cca11 is described below commit 21cca11400aaa2cd603461d8600c5a1fc7ed4afe Author: Jeff Zhang AuthorDate: Tue Sep 10 21:57:29 2019 +0800 [ZEPPELIN-4322] Flaky test: NotebookRestApiTest#testRunWithServerRestart ### What is this PR for? The root cause of this flaky test is due to that the note may be removed when paragraph job is still running. And the job will still send rpc message to zeppelin-server side which may cause unexpected exception. ### What type of PR is it? [Bug Fix] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-4322 ### How should this be tested? * CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang Closes #3448 from zjffdu/ZEPPELIN-4322 and squashes the following commits: b31f38f68 [Jeff Zhang] [ZEPPELIN-4322] Flaky test: NotebookRestApiTest#testRunWithServerRestart --- .../org/apache/zeppelin/socket/NotebookServer.java| 19 ++- .../apache/zeppelin/cluster/ZeppelinServerMock.java | 6 ++ .../org/apache/zeppelin/notebook/NoteManager.java | 1 + 3 files changed, 21 insertions(+), 5 deletions(-) diff --git a/zeppelin-server/src/main/java/org/apache/zeppelin/socket/NotebookServer.java b/zeppelin-server/src/main/java/org/apache/zeppelin/socket/NotebookServer.java index 0bfd389..ce3f9b6 100644 --- a/zeppelin-server/src/main/java/org/apache/zeppelin/socket/NotebookServer.java +++ b/zeppelin-server/src/main/java/org/apache/zeppelin/socket/NotebookServer.java @@ -1603,10 +1603,14 @@ public class NotebookServer extends WebSocketServlet @Override public void onOutputClear(String noteId, String paragraphId) { final Note note = getNotebook().getNote(noteId); - -note.clearParagraphOutput(paragraphId); -Paragraph paragraph = note.getParagraph(paragraphId); -broadcastParagraph(note, paragraph); +if (note == null) { + // It is possible the note is removed, but the job is still running + LOG.warn("Note {} doesn't existed, it maybe deleted.", noteId); +} else { + note.clearParagraphOutput(paragraphId); + Paragraph paragraph = note.getParagraph(paragraphId); + broadcastParagraph(note, paragraph); +} } /** @@ -1808,7 +1812,12 @@ public class NotebookServer extends WebSocketServlet } try { -getNotebook().saveNote(p.getNote(), p.getAuthenticationInfo()); +if (getNotebook().getNote(p.getNote().getId()) == null) { + // It is possible the note is removed, but the job is still running + LOG.warn("Note {} doesn't existed.", p.getNote().getId()); +} else { + getNotebook().saveNote(p.getNote(), p.getAuthenticationInfo()); +} } catch (IOException e) { LOG.error(e.toString(), e); } diff --git a/zeppelin-server/src/test/java/org/apache/zeppelin/cluster/ZeppelinServerMock.java b/zeppelin-server/src/test/java/org/apache/zeppelin/cluster/ZeppelinServerMock.java index 9d1c893..4614dc4 100644 --- a/zeppelin-server/src/test/java/org/apache/zeppelin/cluster/ZeppelinServerMock.java +++ b/zeppelin-server/src/test/java/org/apache/zeppelin/cluster/ZeppelinServerMock.java @@ -174,6 +174,12 @@ public class ZeppelinServerMock { ZeppelinServer.jettyWebServer.stop(); executor.shutdown(); PluginManager.reset(); + System.clearProperty(ZeppelinConfiguration.ConfVars.ZEPPELIN_HOME.getVarName()); + System.clearProperty(ZeppelinConfiguration.ConfVars.ZEPPELIN_WAR.getVarName()); + System.clearProperty(ZeppelinConfiguration.ConfVars.ZEPPELIN_CONF_DIR.getVarName()); + System.clearProperty(ZeppelinConfiguration.ConfVars.ZEPPELIN_CONFIG_FS_DIR.getVarName()); + System.clearProperty(ZeppelinConfiguration.ConfVars.ZEPPELIN_INTERPRETER_GROUP_DEFAULT.getVarName()); + System.clearProperty(ZeppelinConfiguration.ConfVars.ZEPPELIN_NOTEBOOK_DIR.getVarName()); long s = System.currentTimeMillis(); boolean started = true; diff --git a/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/NoteManager.java b/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/NoteManager.java index 4b6ba48..5ac3633 100644 --- a/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/NoteManager.java +++ b/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/NoteManager.java @@ -53,6 +
[zeppelin] branch gh-pages updated: [Website] fix some broken links. Update some link pointing old docs.
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch gh-pages in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/gh-pages by this push: new 7a72111 [Website] fix some broken links. Update some link pointing old docs. 7a72111 is described below commit 7a72111ec9c3bbc18f0879ca9d0b6bc0038ec6eb Author: Lee moon soo AuthorDate: Mon Mar 11 17:36:16 2019 -0700 [Website] fix some broken links. Update some link pointing old docs. ### What is this PR for? Zeppelin Website has some broken links and links that points an old version of docs. ### What type of PR is it? Bug Fix, Improvement ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Lee moon soo Closes #3329 from Leemoonsoo/update_links and squashes the following commits: 05e0f1df6 [Lee moon soo] update more outdated link d72517f35 [Lee moon soo] update link 9f01b45b5 [Lee moon soo] update website url rewrite rule for 0.8.0 doc --- _includes/themes/zeppelin/_navigation.html | 2 +- index.md | 12 ++-- technologies_deployments.md| 12 ++-- whats_new.md | 12 ++-- 4 files changed, 19 insertions(+), 19 deletions(-) diff --git a/_includes/themes/zeppelin/_navigation.html b/_includes/themes/zeppelin/_navigation.html index 2950a6e..c3ceb2d 100644 --- a/_includes/themes/zeppelin/_navigation.html +++ b/_includes/themes/zeppelin/_navigation.html @@ -82,7 +82,7 @@ - GET STARTED diff --git a/index.md b/index.md index efeab16..b19dee5 100644 --- a/index.md +++ b/index.md @@ -43,12 +43,12 @@ limitations under the License. ## Multiple Language Backend -[Apache Zeppelin interpreter](./docs/latest/manual/interpreters.html) concept allows any language/data-processing-backend to be plugged into Zeppelin. +[Apache Zeppelin interpreter](./docs/latest/usage/interpreter/overview.html) concept allows any language/data-processing-backend to be plugged into Zeppelin. Currently Apache Zeppelin supports many interpreters such as Apache Spark, Python, JDBC, Markdown and Shell. -Adding new language-backend is really simple. Learn [how to create a new interpreter](./docs/latest/development/writingzeppelininterpreter.html#make-your-own-interpreter). +Adding new language-backend is really simple. Learn [how to create a new interpreter](./docs/latest/development/writing_zeppelin_interpreter.html#make-your-own-interpreter). Apache Spark integration Especially, Apache Zeppelin provides built-in [Apache Spark](http://spark.apache.org/) integration. You don't need to build a separate module, plugin or library for it. @@ -87,7 +87,7 @@ Apache Zeppelin aggregates values and displays them in pivot chart with simple d -Learn more about [basic display systems](./docs/latest/displaysystem/basicdisplaysystem.html) and Angular API([frontend](./docs/latest/displaysystem/front-end-angular.html) , [backend](./docs/latest/displaysystem/back-end-angular.html)) in Apache Zeppelin. +Learn more about [basic display systems](./docs/latest/usage/display_system/basic.html) and Angular API([frontend](./docs/latest/usage/display_system/angular_frontend.html) , [backend](./docs/latest/usage/display_system/angular_backend.html)) in Apache Zeppelin. ## Dynamic forms @@ -98,7 +98,7 @@ Apache Zeppelin can dynamically create some input forms in your notebook. -Learn more about [Dynamic Forms](./docs/latest/manual/dynamicform.html). +Learn more about [Dynamic Forms](./docs/latest/usage/dynamic_form/intro.html). ## Collaborate by sharing your Notebook & Paragraph @@ -112,14 +112,14 @@ Your notebook URL can be shared among collaborators. Then Apache Zeppelin will b Apache Zeppelin provides an URL to display the result only, that page does not include any menus and buttons inside of notebooks. You can easily embed it as an iframe inside of your website in this way. -If you want to learn more about this feature, please visit [this page](./docs/latest/manual/publish.html). +If you want to learn more about this feature, please visit [this page](./docs/latest/usage/other_features/publishing_paragraphs.html). ## 100% Opensource -Apache Zeppelin is Apache2 Licensed software. Please check out the [source repository](http://git.apache.org/zeppelin.git) and [how to contribute](./docs/latest/development/howtocontribute.html). +Apache Zeppelin is Apache2 Licensed software. Please check out the [source repository](https://github.com/apache/zeppelin) and [how to contribute](./docs/latest/development/contribution/how_to_contribute_code.html). Apache Zeppelin has a very active develop
[zeppelin] branch master updated: ZEPPELIN-4227. Move StandardInterpreterLauncher and SparkInterpreterLauncher into zeppelin-zengine
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new b9006a2 ZEPPELIN-4227. Move StandardInterpreterLauncher and SparkInterpreterLauncher into zeppelin-zengine b9006a2 is described below commit b9006a247043aa3151a798d10c85b7edf6ea9fe3 Author: Jeff Zhang AuthorDate: Sun Jul 7 22:25:17 2019 +0800 ZEPPELIN-4227. Move StandardInterpreterLauncher and SparkInterpreterLauncher into zeppelin-zengine ### What is this PR for? We should include these default interpreter launcher into zeppelin-zengine, so that user can use zeppelin even without building zeppelin-plugins module. ### What type of PR is it? [Improvement] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-4227 ### How should this be tested? * CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang Closes #3421 from zjffdu/ZEPPELIN-4227 and squashes the following commits: ee1c7bcc1 [Jeff Zhang] ZEPPELIN-4227. Move StandardInterpreterLauncher and SparkInterpreterLauncher into zeppelin-zengine --- .travis.yml| 4 +- zeppelin-plugins/launcher/cluster/pom.xml | 7 +-- zeppelin-plugins/launcher/docker/pom.xml | 5 -- zeppelin-plugins/launcher/spark/pom.xml| 67 -- zeppelin-plugins/launcher/standard/pom.xml | 49 zeppelin-plugins/pom.xml | 2 - .../apache/zeppelin/rest/NotebookRestApiTest.java | 4 +- .../launcher/SparkInterpreterLauncher.java | 0 .../launcher/StandardInterpreterLauncher.java | 0 .../org/apache/zeppelin/plugin/PluginManager.java | 13 + .../launcher/SparkInterpreterLauncherTest.java | 9 +++ .../launcher/StandardInterpreterLauncherTest.java | 0 12 files changed, 27 insertions(+), 133 deletions(-) diff --git a/.travis.yml b/.travis.yml index ef2193a..2838e1b 100644 --- a/.travis.yml +++ b/.travis.yml @@ -86,7 +86,7 @@ matrix: - sudo: required jdk: "openjdk8" dist: xenial - env: PYTHON="3" SPARKR="true" PROFILE="-Pspark-2.2 -Phelium-dev -Pexamples -Pspark-scala-2.11" BUILD_FLAG="clean install -Pbuild-distr -DskipRat" TEST_FLAG="verify -Pusing-packaged-distr -DskipRat" MODULES="-pl ${INTERPRETERS}" TEST_PROJECTS="-Dtests.to.exclude=**/JdbcIntegrationTest.java,**/SparkIntegrationTest.java,**/ZeppelinSparkClusterTest.java,**/org/apache/zeppelin/spark/*,**/HeliumApplicationFactoryTest.java -DfailIfNoTests=false" + env: PYTHON="3" SPARKR="true" PROFILE="-Pspark-2.2 -Phelium-dev -Pexamples -Pspark-scala-2.11" BUILD_FLAG="install -Pbuild-distr -DskipRat -DskipTests" TEST_FLAG="verify -Pusing-packaged-distr -DskipRat" MODULES="-pl ${INTERPRETERS}" TEST_PROJECTS="-Dtests.to.exclude=**/JdbcIntegrationTest.java,**/SparkIntegrationTest.java,**/ZeppelinSparkClusterTest.java,**/org/apache/zeppelin/spark/*,**/HeliumApplicationFactoryTest.java -DfailIfNoTests=false" # Test selenium with spark module for spark 2.3 - jdk: "openjdk8" @@ -98,7 +98,7 @@ matrix: # Test interpreter modules - jdk: "openjdk8" dist: xenial - env: PYTHON="3" SPARKR="true" SCALA_VER="2.10" TENSORFLOW="1.0.0" PROFILE="-Pscala-2.10" BUILD_FLAG="clean install -DskipTests -DskipRat -am" TEST_FLAG="test -DskipRat" MODULES="-pl $(echo .,zeppelin-interpreter,zeppelin-interpreter-api,${INTERPRETERS} | sed 's/!//g')" TEST_PROJECTS="" + env: PYTHON="3" SPARKR="true" SCALA_VER="2.10" TENSORFLOW="1.0.0" PROFILE="-Pscala-2.10" BUILD_FLAG="install -DskipTests -DskipRat -am" TEST_FLAG="test -DskipRat" MODULES="-pl $(echo .,zeppelin-interpreter,zeppelin-interpreter-api,${INTERPRETERS} | sed 's/!//g')" TEST_PROJECTS="" # Run Spark integration test and unit test separately for each spark version diff --git a/zeppelin-plugins/launcher/cluster/pom.xml b/zeppelin-plugins/launcher/cluster/pom.xml index bf24546..08b03be 100644 --- a/zeppelin-plugins/launcher/cluster/pom.xml +++ b/zeppelin-plugins/launcher/cluster/pom.xml @@ -39,15 +39,10 @@ Launcher/ClusterInterpreterLauncher - + org.apache.zeppelin - launcher-standard
[zeppelin] branch web_vue updated (c876a37 -> 7d7628e)
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a change to branch web_vue in repository https://gitbox.apache.org/repos/asf/zeppelin.git. from c876a37 [ZEPPELIN-4273] Support Flink 1.9 for Flink Interpreter add 7d7628e [ZEPPELIN-4166] Change default binding address to 127.0.0.1 (previously 0.0.0.0) No new revisions were added by this update. Summary of changes: conf/zeppelin-env.sh.template | 2 ++ conf/zeppelin-site.xml.template | 4 ++-- docs/setup/operation/configuration.md | 6 ++ docs/setup/operation/upgrading.md | 6 +- .../main/java/org/apache/zeppelin/conf/ZeppelinConfiguration.java | 2 +- 5 files changed, 16 insertions(+), 4 deletions(-)
[zeppelin] branch web_vue created (now c876a37)
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a change to branch web_vue in repository https://gitbox.apache.org/repos/asf/zeppelin.git. at c876a37 [ZEPPELIN-4273] Support Flink 1.9 for Flink Interpreter No new revisions were added by this update.
[zeppelin] branch master updated: ZEPPELIN-4329 fix building Scio with Scala 2.11
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new f825fec ZEPPELIN-4329 fix building Scio with Scala 2.11 f825fec is described below commit f825fecf3872c3f6dd7bfbbf3b203fb5f58a6699 Author: Alex Ott AuthorDate: Sun Sep 15 14:05:51 2019 +0200 ZEPPELIN-4329 fix building Scio with Scala 2.11 ### What is this PR for? Goal is to make Scio & Beam interpreters buildable with Scala 2.11 profile. Now both Scio & Beam interpreters explicitly use Scala 2.10, so it's possible to compile both if Scala 2.11 profile is enabled. Also was need to add missing dependency for Beam interpreter, otherwise it didn't work. Plus small rework of the properties, so the Scala 2.10 version could be explicitly used in the interpreters. (Also, tried Scala 2.10.7, and it didn't work, so we must stay on 2.10.5). ### What type of PR is it? Bug Fix ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-4329 ### How should this be tested? * Tested manually by building both default & Scala 2.10 profiles * Travis CI build: https://travis-ci.org/alexott/zeppelin/builds/585186691 Author: Alex Ott Closes #3446 from alexott/ZEPPELIN-4329 and squashes the following commits: ff973414b [Alex Ott] ZEPPELIN-4329 fix building Scio with Scala 2.11 --- beam/pom.xml | 27 +-- pom.xml | 8 +--- scio/pom.xml | 26 +++--- 3 files changed, 33 insertions(+), 28 deletions(-) diff --git a/beam/pom.xml b/beam/pom.xml index 6c60fbb..006469f 100644 --- a/beam/pom.xml +++ b/beam/pom.xml @@ -34,15 +34,18 @@ Zeppelin: Beam interpreter +beam + 2.3.0 1.6.2 2.0.0 +2.10 4.1.1.Final 3.1.0 1.3 -beam +1.8.1 @@ -54,7 +57,7 @@ org.apache.spark - spark-core_2.10 + spark-core_${beam.scala.binary.version} ${beam.spark.version} @@ -66,15 +69,15 @@ io.netty - akka-actor_2.10 + akka-actor_${beam.scala.binary.version} org.spark-project.akka - akka-remote_2.10 + akka-remote_${beam.scala.binary.version} org.spark-project.akka - akka-slf4j_2.10 + akka-slf4j_${beam.scala.binary.version} org.spark-project.akka @@ -82,7 +85,7 @@ org.apache.spark - spark-streaming_2.10 + spark-streaming_${beam.scala.binary.version} ${beam.spark.version} @@ -118,7 +121,7 @@ org.apache.zeppelin - zeppelin-scio_${scala.binary.version} + zeppelin-scio ${project.version} @@ -222,10 +225,8 @@ org.apache.beam - beam-runners-flink_${scala.binary.version} + beam-runners-flink_${beam.scala.binary.version} ${beam.beam.version} - - @@ -240,6 +241,12 @@ ${commons.exec.version} + + org.apache.avro + avro + ${avro.version} + + diff --git a/pom.xml b/pom.xml index 6f32b9b..15e6c2c 100644 --- a/pom.xml +++ b/pom.xml @@ -95,8 +95,10 @@ 1.8 -2.10.5 +2.10.5 +${scala.2.10.version} 2.10 +2.11.8 3.0.7 1.12.5 @@ -752,7 +754,7 @@ true -2.10.5 +${scala.2.10.version} 2.10 @@ -760,7 +762,7 @@ scala-2.11 -2.11.8 +${scala.2.11.version} 2.11 diff --git a/scio/pom.xml b/scio/pom.xml index b6bd7dc..9687326 100644 --- a/scio/pom.xml +++ b/scio/pom.xml @@ -28,7 +28,7 @@ org.apache.zeppelin - zeppelin-scio_2.10 + zeppelin-scio jar 0.9.0-SNAPSHOT Zeppelin: Scio @@ -39,6 +39,8 @@ 0.2.4 14.0.1 +${scala.2.10.version} +2.10 2.15.2 @@ -52,7 +54,7 @@ com.spotify - scio-repl_${scala.binary.version} + scio-repl_${scio.scala.binary.version} ${scio.version} @@ -65,25 +67,25 @@ org.scala-lang scala-library - ${scala.version} + ${scala.2.10.version} org.scala-lang scala-compiler - ${scala.version} + ${scala.2.10.version} org.scala-lang scala-reflect - ${scala.version} + ${scala.2.10.version} org.scalatest - scalatest_${scala.binary.version} + scalatest_${scio.scala.binary.version} ${scalatest.version} test @@ -137,6 +139,9 @@ org.scala-tools maven-scala-plugin ${plugin.s
[zeppelin] branch master updated: ZEPPELIN-4275. No error message when no interpreter is found
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 09c8d13 ZEPPELIN-4275. No error message when no interpreter is found 09c8d13 is described below commit 09c8d1336a8b6e178be4df3628bb34a946c476da Author: Jeff Zhang AuthorDate: Tue Jul 30 19:45:38 2019 +0800 ZEPPELIN-4275. No error message when no interpreter is found ### What is this PR for? This is a trivial PR to display an error message when user specifies invalid interpreter name. ### What type of PR is it? [Bug Fix] ### Todos * [ ] - Task ### What is the Jira issue? * https://jira.apache.org/jira/browse/ZEPPELIN-4275 ### How should this be tested? * CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang Closes #3417 from zjffdu/ZEPPELIN-4275 and squashes the following commits: 841f70c93 [Jeff Zhang] ZEPPELIN-4275. No error message when no interpreter is found --- .../java/org/apache/zeppelin/notebook/Paragraph.java| 5 +++-- .../java/org/apache/zeppelin/notebook/NotebookTest.java | 17 + 2 files changed, 20 insertions(+), 2 deletions(-) diff --git a/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/Paragraph.java b/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/Paragraph.java index 5865df2..0100afe 100644 --- a/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/Paragraph.java +++ b/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/Paragraph.java @@ -426,10 +426,11 @@ public class Paragraph extends JobWithProgressPoller implemen } } catch (InterpreterNotFoundException e) { InterpreterResult intpResult = - new InterpreterResult(InterpreterResult.Code.ERROR); + new InterpreterResult(InterpreterResult.Code.ERROR, + String.format("Interpreter %s not found", this.intpText)); setReturn(intpResult, e); setStatus(Job.Status.ERROR); - throw new RuntimeException(e); + return false; } } diff --git a/zeppelin-zengine/src/test/java/org/apache/zeppelin/notebook/NotebookTest.java b/zeppelin-zengine/src/test/java/org/apache/zeppelin/notebook/NotebookTest.java index 49023e7..5a984ae 100644 --- a/zeppelin-zengine/src/test/java/org/apache/zeppelin/notebook/NotebookTest.java +++ b/zeppelin-zengine/src/test/java/org/apache/zeppelin/notebook/NotebookTest.java @@ -433,6 +433,23 @@ public class NotebookTest extends AbstractInterpreterTest implements ParagraphJo } @Test + public void testInvalidInterpreter() throws IOException, InterruptedException { +Note note = notebook.createNote("note1", anonymous); +Paragraph p1 = note.addNewParagraph(AuthenticationInfo.ANONYMOUS); +p1.setText("%invalid abc"); +p1.setAuthenticationInfo(anonymous); +note.run(p1.getId()); + +Thread.sleep(2 * 1000); +assertEquals(p1.getStatus(), Status.ERROR); +InterpreterResult result = p1.getReturn(); +assertEquals(InterpreterResult.Code.ERROR, result.code()); +assertEquals("Interpreter invalid not found", result.message().get(0).getData()); +assertNull(p1.getDateStarted()); +notebook.removeNote(note.getId(), anonymous); + } + + @Test public void testRunAll() throws IOException { Note note = notebook.createNote("note1", anonymous);
[zeppelin] branch master updated: [ZEPPELIN-4265]. Support more types of output for IPythonInterpreter
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new a04bdb3 [ZEPPELIN-4265]. Support more types of output for IPythonInterpreter a04bdb3 is described below commit a04bdb349bc9ff8f3ccf68687f60f5938a88cec0 Author: Jeff Zhang AuthorDate: Mon Aug 5 10:31:44 2019 +0800 [ZEPPELIN-4265]. Support more types of output for IPythonInterpreter ### What is this PR for? The final target of IPythonInterpreter is to make zeppelin IPythonInterpreter compatible with jupyter. I tried several popular python viz tools. And find some of them doesn't work due to IPythonInterpreter's limitation. This PR is trying to support more types of output for IPythonInterpreter. ### What type of PR is it? [Improvement] ### Todos * [ ] - Task ### What is the Jira issue? * Open an issue on Jira https://issues.apache.org/jira/browse/ZEPPELIN/ * Put link here, and add [ZEPPELIN-*Jira number*] in PR title, eg. [ZEPPELIN-533] ### How should this be tested? ### Screenshots (if appropriate) **Pands** ![image](https://user-images.githubusercontent.com/164491/62295599-fe414180-b49f-11e9-930c-461c83fb7285.png) **Altair** ![image](https://user-images.githubusercontent.com/164491/62284745-d1ccfb80-b486-11e9-9c97-01fc2dda5975.png) **HoloView** ![image](https://user-images.githubusercontent.com/164491/62285001-5ddf2300-b487-11e9-825f-0de4bc051012.png) **HvPlot** ![image](https://user-images.githubusercontent.com/164491/62285038-6d5e6c00-b487-11e9-8eed-39bd6a405545.png) **Pandas Bokeh** ![image](https://user-images.githubusercontent.com/164491/62285342-fd9cb100-b487-11e9-94c8-b4da33cfe672.png) **Plotnine** ![image](https://user-images.githubusercontent.com/164491/62304961-9a277900-b4b1-11e9-91d3-51687cab90be.png) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang Closes #3419 from zjffdu/ZEPPELIN-4265 and squashes the following commits: 475a91f16 [Jeff Zhang] revert changes in ipython_client.py 2ebac7568 [Jeff Zhang] [ZEPPELIN-4265]. Support more types of output for IPythonInterpreter --- .../org/apache/zeppelin/python/IPythonClient.java | 42 ++- python/src/main/proto/ipython.proto| 7 +- .../src/main/resources/grpc/python/ipython_pb2.py | 398 ++--- .../main/resources/grpc/python/ipython_server.py | 70 +++- .../zeppelin/python/IPythonInterpreterTest.java| 35 +- .../apache/zeppelin/dep/DependencyResolver.java| 6 +- .../zeppelin/notebook/repo/VFSNotebookRepo.java| 4 + 7 files changed, 239 insertions(+), 323 deletions(-) diff --git a/python/src/main/java/org/apache/zeppelin/python/IPythonClient.java b/python/src/main/java/org/apache/zeppelin/python/IPythonClient.java index c729898..ec0c052 100644 --- a/python/src/main/java/org/apache/zeppelin/python/IPythonClient.java +++ b/python/src/main/java/org/apache/zeppelin/python/IPythonClient.java @@ -88,35 +88,47 @@ public class IPythonClient { LOGGER.debug("stream_execute code:\n" + request.getCode()); asyncStub.execute(request, new StreamObserver() { int index = 0; - boolean isPreviousOutputImage = false; @Override public void onNext(ExecuteResponse executeResponse) { +LOGGER.debug("Interpreter Streaming Output: " + executeResponse.getType() + +"\t" + executeResponse.getOutput()); +if (index != 0) { + try { +// We need to add line separator first, because zeppelin only recoginize the % at +// the line beginning. +interpreterOutput.write("\n".getBytes()); + } catch (IOException e) { +LOGGER.error("Unexpected IOException", e); + } +} + if (executeResponse.getType() == OutputType.TEXT) { try { -LOGGER.debug("Interpreter Streaming Output: " + executeResponse.getOutput()); -if (isPreviousOutputImage) { - // add '\n' when switch from image to text - interpreterOutput.write("\n%text ".getBytes()); +if (executeResponse.getOutput().startsWith("%")) { + // the output from ipython kernel maybe specify format already. + interpreterOutput.write((executeResponse.getOutput()).getBytes()); +} else { + interpreterOutput.write(("%text " + executeResponse.getOutput()).getBytes()); } -isPreviousOutp
[zeppelin] branch master updated: [HOTFIX] Fix travis CI
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new de4c0bc [HOTFIX] Fix travis CI de4c0bc is described below commit de4c0bc4a2d99143b8459a9fb0d4ba59cac084dd Author: Jeff Zhang AuthorDate: Wed Jul 24 16:15:56 2019 +0800 [HOTFIX] Fix travis CI (cherry picked from commit 4d62ad3b05c2adf13c827c85a4b08343d2ac808f) --- .travis.yml| 67 +++--- .../zeppelin/integration/JdbcIntegrationTest.java | 2 +- .../apache/zeppelin/cluster/ClusterEventTest.java | 21 --- .../cluster/ClusterNoteEventListenerTest.java | 12 ++-- .../zeppelin/cluster/ZeppelinServerMock.java | 14 ++--- .../apache/zeppelin/rest/AbstractTestRestApi.java | 13 +++-- .../src/test/resources/log4j.properties| 4 +- zeppelin-zengine/pom.xml | 2 +- .../zeppelin/storage/LocalConfigStorage.java | 9 +-- .../src/test/resources/log4j.properties| 2 +- 10 files changed, 77 insertions(+), 69 deletions(-) diff --git a/.travis.yml b/.travis.yml index 8eacc4c..ef2193a 100644 --- a/.travis.yml +++ b/.travis.yml @@ -45,6 +45,9 @@ addons: - mysql-server - mysql-client +services: + - mysql + env: global: # Interpreters does not required by zeppelin-server integration tests @@ -53,14 +56,14 @@ env: matrix: include: # Test License compliance using RAT tool -- jdk: "oraclejdk8" - dist: trusty +- jdk: "openjdk8" + dist: xenial env: SCALA_VER="2.11" PROFILE="-Prat" BUILD_FLAG="clean" TEST_FLAG="org.apache.rat:apache-rat-plugin:check" TEST_PROJECTS="" # Default build command, no tests - sudo: required - jdk: "oraclejdk8" - dist: trusty + jdk: "openjdk8" + dist: xenial env: BUILD_FLAG="clean package -DskipTests" TEST_FLAG="test -DskipTests" # Run e2e tests (in zeppelin-web) @@ -68,8 +71,8 @@ matrix: # also, can't use JDK 7 in trusty: https://github.com/travis-ci/travis-ci/issues/7884 - os: linux sudo: false - dist: trusty - jdk: "oraclejdk8" + dist: xenial + jdk: "openjdk8" env: CI="true" WEB_E2E="true" PYTHON="2" SCALA_VER="2.11" SPARK_VER="2.1.0" HADOOP_VER="2.6" PROFILE="-Phadoop2 -Pscala-2.11" BUILD_FLAG="install -DskipTests -DskipRat" TEST_FLAG="verify -DskipRat" MODULES="-pl ${INTERPRETERS}" TEST_MODULES="-pl zeppelin-web" TEST_PROJECTS="-Pweb-e2e" addons: apt: @@ -81,75 +84,75 @@ matrix: # HeliumApplicationFactoryTest - https://issues.apache.org/jira/browse/ZEPPELIN-2470 # After issues are fixed these tests need to be included back by removing them from the "-Dtests.to.exclude" property - sudo: required - jdk: "oraclejdk8" - dist: trusty - env: PYTHON="3" SPARKR="true" PROFILE="-Pspark-2.2 -Phelium-dev -Pexamples -Pspark-scala-2.11" BUILD_FLAG="install -Pbuild-distr -DskipRat" TEST_FLAG="verify -Pusing-packaged-distr -DskipRat" MODULES="-pl ${INTERPRETERS}" TEST_PROJECTS="-Dtests.to.exclude=**/JdbcIntegrationTest.java,**/SparkIntegrationTest.java,**/ZeppelinSparkClusterTest.java,**/org/apache/zeppelin/spark/*,**/HeliumApplicationFactoryTest.java -DfailIfNoTests=false" + jdk: "openjdk8" + dist: xenial + env: PYTHON="3" SPARKR="true" PROFILE="-Pspark-2.2 -Phelium-dev -Pexamples -Pspark-scala-2.11" BUILD_FLAG="clean install -Pbuild-distr -DskipRat" TEST_FLAG="verify -Pusing-packaged-distr -DskipRat" MODULES="-pl ${INTERPRETERS}" TEST_PROJECTS="-Dtests.to.exclude=**/JdbcIntegrationTest.java,**/SparkIntegrationTest.java,**/ZeppelinSparkClusterTest.java,**/org/apache/zeppelin/spark/*,**/HeliumApplicationFactoryTest.java -DfailIfNoTests=false" # Test selenium with spark module for spark 2.3 -- jdk: "oraclejdk8" - dist: trusty +- jdk: "openjdk8" + dist: xenial addons: firefox: "31.0" - env: BUILD_PLUGINS="true" CI="true" PYTHON="2" SCALA_VER="2.11" SPARK_VER="2.3.2" HADOOP_VER="2.6" PROFILE="-Pspark-2.3 -Phadoop2 -Phelium-dev -Pexamples -Pintegration -Pspark-scala-2.11" BUILD_FLAG="install -DskipTests -DskipRat -pl ${INTERPRETERS}" TEST_FLAG="verify -DskipRat" TEST_PROJECTS="-pl zeppelin-integration -DfailIfNoTe
[zeppelin] branch master updated: ZEPPELIN-4234. Python test is missing in travis
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 4c30e66 ZEPPELIN-4234. Python test is missing in travis 4c30e66 is described below commit 4c30e66aed1b194927225ffb745e427f3c7c0718 Author: Jeff Zhang AuthorDate: Wed Jul 10 09:41:49 2019 +0800 ZEPPELIN-4234. Python test is missing in travis ### What is this PR for? For now, python test is missing in travis, this PR enable it. But we have to disable some test, because some test will fail, I will fix them in a followup ticket. ### What type of PR is it? [Bug Fix] ### Todos * [ ] - Task ### What is the Jira issue? * https://jira.apache.org/jira/browse/ZEPPELIN-4234 ### How should this be tested? * CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang Closes #3408 from zjffdu/ZEPPELIN-4234 and squashes the following commits: 42d6877aa [Jeff Zhang] ZEPPELIN-4234. Python test is missing in travis --- .travis.yml| 8 .../org/apache/zeppelin/python/IPythonInterpreter.java | 11 ++- .../apache/zeppelin/python/BasePythonInterpreterTest.java | 12 +++- .../org/apache/zeppelin/python/IPythonInterpreterTest.java | 14 ++ python/src/test/resources/log4j.properties | 4 +++- spark/interpreter/src/test/resources/log4j.properties | 1 + 6 files changed, 31 insertions(+), 19 deletions(-) diff --git a/.travis.yml b/.travis.yml index 76125d1..8eacc4c 100644 --- a/.travis.yml +++ b/.travis.yml @@ -111,17 +111,17 @@ matrix: dist: trusty env: BUILD_PLUGINS="true" PYTHON="2" SCALA_VER="2.12" PROFILE="-Pspark-2.4 -Pspark-scala-2.12 -Phadoop2 -Pintegration" SPARKR="true" BUILD_FLAG="install -DskipTests -DskipRat -am" TEST_FLAG="test -DskipRat -am" MODULES="-pl zeppelin-interpreter-integration,jdbc,zeppelin-web,spark/spark-dependencies" TEST_PROJECTS="-Dtest=ZeppelinSparkClusterTest24,SparkIntegrationTest24,JdbcIntegrationTest,org.apache.zeppelin.spark.* -DfailIfNoTests=false" -# ZeppelinSparkClusterTest23, SparkIntegrationTest23, Unit test of Spark 2.3 (Scala-2.11) +# ZeppelinSparkClusterTest23, SparkIntegrationTest23, Unit test of Spark 2.3 (Scala-2.11) and Unit test PythonInterpreter under python2 - sudo: required jdk: "oraclejdk8" dist: trusty - env: BUILD_PLUGINS="true" PYTHON="2" SCALA_VER="2.11" PROFILE="-Pspark-2.3 -Pspark-scala-2.11 -Phadoop2 -Pintegration" SPARKR="true" BUILD_FLAG="install -DskipTests -DskipRat -am" TEST_FLAG="test -DskipRat -am" MODULES="-pl zeppelin-interpreter-integration,zeppelin-web,spark/spark-dependencies" TEST_PROJECTS="-Dtest=ZeppelinSparkClusterTest23,SparkIntegrationTest23,org.apache.zeppelin.spark.* -DfailIfNoTests=false" + env: BUILD_PLUGINS="true" PYTHON="2" SCALA_VER="2.11" PROFILE="-Pspark-2.3 -Pspark-scala-2.11 -Phadoop2 -Pintegration" SPARKR="true" BUILD_FLAG="install -DskipTests -DskipRat -am" TEST_FLAG="test -DskipRat -am" MODULES="-pl zeppelin-interpreter-integration,zeppelin-web,spark/spark-dependencies" TEST_PROJECTS="-Dtest=ZeppelinSparkClusterTest23,SparkIntegrationTest23,org.apache.zeppelin.spark.*,apache.zeppelin.python.* -DfailIfNoTests=false" -# ZeppelinSparkClusterTest22, SparkIntegrationTest22, Unit test of Spark 2.2 (Scala-2.10) +# ZeppelinSparkClusterTest22, SparkIntegrationTest22, Unit test of Spark 2.2 (Scala-2.10) and Unit test PythonInterpreter under python3 - sudo: required jdk: "oraclejdk8" dist: trusty - env: BUILD_PLUGINS="true" PYTHON="3" SCALA_VER="2.10" PROFILE="-Pspark-2.2 -Pspark-scala-2.10 -Phadoop2 -Pintegration" SPARKR="true" BUILD_FLAG="install -DskipTests -DskipRat -am" TEST_FLAG="test -DskipRat -am" MODULES="-pl zeppelin-interpreter-integration,zeppelin-web,spark/spark-dependencies" TEST_PROJECTS="-Dtest=ZeppelinSparkClusterTest22,SparkIntegrationTest22,org.apache.zeppelin.spark.* -DfailIfNoTests=false" + env: BUILD_PLUGINS="true" PYTHON="3" SCALA_VER="2.10" PROFILE="-Pspark-2.2 -Pspark-scala-2.10 -Phadoop2 -Pintegration" SPARKR="true" BUILD_FLAG="install -DskipTes
[zeppelin] branch master updated: [ZEPPELIN-4068] Implement MongoNotebookRepo.
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new bb17274 [ZEPPELIN-4068] Implement MongoNotebookRepo. bb17274 is described below commit bb172749a65bc3b4ef689a355b62c2168c7ae7e7 Author: yx91490 AuthorDate: Thu Aug 29 09:28:46 2019 +0800 [ZEPPELIN-4068] Implement MongoNotebookRepo. ### What is this PR for? the format of note storage file name is changed in 0.9, this is the implementation of MongoNotebookRepo.please refer to [ZEPPELIN-2619](https://issues.apache.org/jira/browse/ZEPPELIN-2619). this patch use a folder collection to store path hierarchy. ### What type of PR is it? [Bug Fix | Improvement | Feature | Documentation | Hot Fix | Refactoring] Feature ### Todos * [ ] - this implementation need mongoDB 3.4. ### What is the Jira issue? [https://issues.apache.org/jira/browse/ZEPPELIN-4068](https://issues.apache.org/jira/browse/ZEPPELIN-4068) ### How should this be tested? manual ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: yx91490 Closes #3432 from yx91490/mongo and squashes the following commits: 6b832db13 [yx91490] remove apache license 5970f912e [yx91490] [ZEPPELIN-4068] use get to assert 19689d029 [yx91490] [ZEPPELIN-4068] spell correct 3c8e0a46d [yx91490] [ZEPPELIN-4068] Add license header fe790879d [yx91490] [ZEPPELIN-4068] Add license header 11c0c5244 [yx91490] [ZEPPELIN-4068] Add comment f232ee7a5 [yx91490] [ZEPPELIN-4068] add Embedded MongoDB license 14d828ef5 [yx91490] [ZEPPELIN-4068] Implement MongoNotebookRepo,based on 0.9 5c0b2fbe6 [yx91490] [ZEPPELIN-4068] Implement MongoNotebookRepo --- LICENSE| 1 + conf/zeppelin-site.xml.template| 2 +- .../zeppelin/conf/ZeppelinConfiguration.java | 4 + zeppelin-plugins/notebookrepo/mongo/pom.xml| 75 .../apache/zeppelin/notebook/repo/AutoLock.java| 24 ++ .../zeppelin/notebook/repo/AutoReadWriteLock.java | 57 +++ .../zeppelin/notebook/repo/MongoNotebookRepo.java | 470 + .../notebook/repo/OldMongoNotebookRepo.java| 235 +++ .../notebook/repo/MongoNotebookRepoTest.java | 127 ++ .../zeppelin/notebook/repo/ToPathArrayTest.java| 101 + zeppelin-plugins/pom.xml | 1 + 11 files changed, 1096 insertions(+), 1 deletion(-) diff --git a/LICENSE b/LICENSE index f75c453..40c1143 100644 --- a/LICENSE +++ b/LICENSE @@ -261,6 +261,7 @@ The text of each license is also included at licenses/LICENSE-[project]-[version (Apache 2.0) jarchivelib (https://github.com/thrau/jarchivelib) (Apache 2.0) Google Cloud Client Library for Java (https://github.com/GoogleCloudPlatform/google-cloud-java) (Apache 2.0) concurrentunit (https://github.com/jhalterman/concurrentunit) +(Apache 2.0) Embedded MongoDB (https://github.com/flapdoodle-oss/de.flapdoodle.embed.mongo) BSD 3-Clause licenses diff --git a/conf/zeppelin-site.xml.template b/conf/zeppelin-site.xml.template index 1b88e46..e02722b 100755 --- a/conf/zeppelin-site.xml.template +++ b/conf/zeppelin-site.xml.template @@ -286,7 +286,7 @@ zeppelin.notebook.mongo.autoimport false - import local notes into MongoDB automatically on startup + import local notes into MongoDB automatically on startup, reset to false after import to avoid repeated import --> diff --git a/zeppelin-interpreter/src/main/java/org/apache/zeppelin/conf/ZeppelinConfiguration.java b/zeppelin-interpreter/src/main/java/org/apache/zeppelin/conf/ZeppelinConfiguration.java index c6d63ea..88b8e3c 100644 --- a/zeppelin-interpreter/src/main/java/org/apache/zeppelin/conf/ZeppelinConfiguration.java +++ b/zeppelin-interpreter/src/main/java/org/apache/zeppelin/conf/ZeppelinConfiguration.java @@ -465,6 +465,9 @@ public class ZeppelinConfiguration extends XMLConfiguration { return getString(ConfVars.ZEPPELIN_NOTEBOOK_MONGO_COLLECTION); } + public String getMongoFolder() { +return getString(ConfVars.ZEPPELIN_NOTEBOOK_MONGO_FOLDER); + } public boolean getMongoAutoimport() { return getBoolean(ConfVars.ZEPPELIN_NOTEBOOK_MONGO_AUTOIMPORT); } @@ -839,6 +842,7 @@ public class ZeppelinConfiguration extends XMLConfiguration { ZEPPELIN_NOTEBOOK_AZURE_USER("zeppelin.notebook.azure.user", "user"), ZEPPELIN_NOTEBOOK_MONGO_DATABASE("zeppelin.notebook.mongo.database", "zeppelin"
[zeppelin] branch master updated: [ZEPPELIN-4331] Use latest version of Java driver for Cassandra
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/master by this push: new 0f03e1b [ZEPPELIN-4331] Use latest version of Java driver for Cassandra 0f03e1b is described below commit 0f03e1bb9a889c9bd486deed202472f0fff54c8d Author: Alex Ott AuthorDate: Tue Sep 17 07:32:12 2019 +0100 [ZEPPELIN-4331] Use latest version of Java driver for Cassandra ### What is this PR for? This change will allow to get access to latest fixes & improvements implemented in the Datastax Java driver for Cassandra. ### What type of PR is it? Improvement ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-4331 ### How should this be tested? * Automated build: https://travis-ci.org/alexott/zeppelin/builds/585461796 * Manually tested CQL commands Author: Alex Ott Closes #3447 from alexott/ZEPPELIN-4331 and squashes the following commits: 6924e38d6 [Alex Ott] [ZEPPELIN-4331] Updated license information 98fe07e7c [Alex Ott] [ZEPPELIN-4331] Update changelog 96c9c85a9 [Alex Ott] [ZEPPELIN-4331] Use latest version of Java driver for Cassandra --- cassandra/pom.xml | 14 +++--- docs/interpreter/cassandra.md | 4 zeppelin-distribution/src/bin_license/LICENSE | 3 ++- 3 files changed, 13 insertions(+), 8 deletions(-) diff --git a/cassandra/pom.xml b/cassandra/pom.xml index 65f36d8..1452ff9 100644 --- a/cassandra/pom.xml +++ b/cassandra/pom.xml @@ -26,19 +26,19 @@ org.apache.zeppelin -zeppelin-cassandra_2.10 +zeppelin-cassandra jar 0.9.0-SNAPSHOT Zeppelin: Apache Cassandra interpreter Zeppelin cassandra support -3.0.1 -1.0.5.4 -1.3.0 +3.7.2 +1.1.2.6 +1.4.1 3.3.2 1.7.1 -16.0.1 +19.0 3.2.4-Zeppelin @@ -88,8 +88,8 @@ -net.jpountz.lz4 -lz4 +org.lz4 +lz4-java ${lz4.version} diff --git a/docs/interpreter/cassandra.md b/docs/interpreter/cassandra.md index 5a20d82..43a93ae 100644 --- a/docs/interpreter/cassandra.md +++ b/docs/interpreter/cassandra.md @@ -812,6 +812,10 @@ Below are the configuration parameters and their default values. ## Change Log +**3.1** _(Zeppelin {{ site.ZEPPELIN_VERSION }})_ : + +* Upgrade Java driver to 3.7.2 ([ZEPPELIN-4331](https://issues.apache.org/jira/browse/ZEPPELIN-4331); + **3.0** _(Zeppelin {{ site.ZEPPELIN_VERSION }})_ : * Update documentation diff --git a/zeppelin-distribution/src/bin_license/LICENSE b/zeppelin-distribution/src/bin_license/LICENSE index 62201af..c115e9f 100644 --- a/zeppelin-distribution/src/bin_license/LICENSE +++ b/zeppelin-distribution/src/bin_license/LICENSE @@ -67,8 +67,9 @@ The following components are provided under Apache License. (Apache 2.0) xml apis (xml-apis:xml-apis:jar:1.4.01 - http://xerces.apache.org/xml-commons/components/external) (Apache 2.0) java-xmlbuilder (com.jamesmurty.utils:java-xmlbuilder:jar:1.0 - https://github.com/jmurty/java-xmlbuilder) (Apache 2.0) compress-lzf (com.ning:compress-lzf:jar:1.0.3 - https://github.com/ning/compress) Copyright 2009-2010 Ning, Inc. +(Apache 2.0) java-driver-core (com.datastax.oss:java-driver-core:jar:3.7.2 - https://github.com/datastax/java-driver) (Apache 2.0) Snappy-java (org.xerial.snappy:snappy-java:1.1.2.4 - https://github.com/xerial/snappy-java/) -(Apache 2.0) lz4-java (net.jpountz.lz4:lz4:jar:1.3.0 - https://github.com/jpountz/lz4-java) +(Apache 2.0) lz4-java (org.lz4:lz4-java:jar:1.4.1 - https://github.com/lz4/lz4-java) (Apache 2.0) RoaringBitmap (org.roaringbitmap:RoaringBitmap:jar:0.5.11 - https://github.com/lemire/RoaringBitmap) (Apache 2.0) json4s (org.json4s:json4s-ast_2.10:jar:3.2.10 - https://github.com/json4s/json4s) (Apache 2.0) HPPC Collections (com.carrotsearch:hppc:0.7.1 - http://labs.carrotsearch.com/hppc.html/hppc)
svn commit: r36040 - /dev/zeppelin/zeppelin-0.8.2-rc1/
Author: zjffdu Date: Thu Sep 26 04:13:08 2019 New Revision: 36040 Log: Upload 0.8.2 rc1 Modified: dev/zeppelin/zeppelin-0.8.2-rc1/zeppelin-0.8.2-bin-all.tgz dev/zeppelin/zeppelin-0.8.2-rc1/zeppelin-0.8.2-bin-all.tgz.asc dev/zeppelin/zeppelin-0.8.2-rc1/zeppelin-0.8.2-bin-all.tgz.sha512 dev/zeppelin/zeppelin-0.8.2-rc1/zeppelin-0.8.2-bin-netinst.tgz dev/zeppelin/zeppelin-0.8.2-rc1/zeppelin-0.8.2-bin-netinst.tgz.asc dev/zeppelin/zeppelin-0.8.2-rc1/zeppelin-0.8.2-bin-netinst.tgz.sha512 dev/zeppelin/zeppelin-0.8.2-rc1/zeppelin-0.8.2.tgz dev/zeppelin/zeppelin-0.8.2-rc1/zeppelin-0.8.2.tgz.asc dev/zeppelin/zeppelin-0.8.2-rc1/zeppelin-0.8.2.tgz.sha512 Modified: dev/zeppelin/zeppelin-0.8.2-rc1/zeppelin-0.8.2-bin-all.tgz == Binary files - no diff available. Modified: dev/zeppelin/zeppelin-0.8.2-rc1/zeppelin-0.8.2-bin-all.tgz.asc == --- dev/zeppelin/zeppelin-0.8.2-rc1/zeppelin-0.8.2-bin-all.tgz.asc (original) +++ dev/zeppelin/zeppelin-0.8.2-rc1/zeppelin-0.8.2-bin-all.tgz.asc Thu Sep 26 04:13:08 2019 @@ -1,16 +1,16 @@ -BEGIN PGP SIGNATURE- -iQIzBAABCAAdFiEE9k6XRfAhCMKdxRepCQ++FNmxfR8FAl2LBc8ACgkQCQ++FNmx -fR+iwA//Rr7inwdWXaMjD59XcnX4jdPyBY0E69mF7NmY+Bk2brimI306WyISzzBe -vAtEc7hChmmfJYFO8XaEFsuD4SPcxKamjxzRcS+BZpSJ3dqcLmp45ut/e/o2bUBf -0L8lfspHx2QwQmSW9JfO/6aLunMyA5D9lywHJGQqT4CDn/NP8mCghIBRp0cU9TxA -59fP71r5VIcW4DDcaVUsXhH8h7hky2B1FfcxBHWjmIF94WLeG7fVPEkFX/yeI7FK -TwH7iNSne9vpgI+vALu7GJNYJ9Hfj2fTYCIdJO1hpsENx2WWWagI8e1IcbwJSioB -Nsln3D+Onz5p60Mdyw39DmLDoH1NMsjC6x0g+F1dEk3GPXZPm6zOfFknG3oXy7EA -T6RMj3gf4YTdhCTAog3JOkDB+Lpvxyf5Q/XBoOIitsmWLR3QqZftxNTJZx4NmBBG -RnXWGCXLmOQ6q7KYSOPCOKl9cxzTZuVkQs4I9PzaAQsZFc5xq3czsfxehgb0CiqZ -NhvuLuXjTDvrdKsjSsR/i3m+lBjUF8IOZlkUPyC+lfIi6i5Ww1fia8J76piECfYX -k9jgfhkRo1HmxGJ0RSIdN5RIpleQza6M7KAnsGtfYbFrobsyDHWAhPjw2dQDQ8pH -yn6Tvi5eABOHTDSBZwHki4nzxyc5hRYDBtfvM28MPeZjm2kX0Dc= -=Q0pt +iQIzBAABCAAdFiEE9k6XRfAhCMKdxRepCQ++FNmxfR8FAl2MNZIACgkQCQ++FNmx +fR9stw/8CKjXHLaSOgZDJsZZH2gNdlRd83NAaETA7pRHIbeiVvkVHJ3b6mPfKi2a +CWoEpw1tvoT4Du4MkP4V3a75itKtcZhjHAzk+Ih8DqQzgqbbHOnRbio264+CjOj0 +R8kPf6qiUAnHEFjFtVFKtp/fj89f+Ka+LQhiiBG6K/CS3xnIx9tXoiiNlh1/u/GX +sZIxneJet3L2dbKcHYB1g61tw0PA3Ut6ndncR/apDbIMrtGNzcGDUMRK83v1GCXD +qujxc3o3yNB6t8oxEH5CvrUQ81g6VX6jR3PCq8P7z0lKu78VtxKyhv2NqQQOchIT +dR3uJGFfiZTgpWCFyQRQ24QV77mTgqn5jsj9k0yD/lXJvY5wGFrgu2wc+eGJa4a7 +e7YdU61Cu74DNr6bJ84tpt3qB3E3R0NJHLZUrn7Zxk7WG+sSmEStP0y/bKPKzjVL +nmQdykhxMs5D11JoqMzptDTgSsdHTU3Bs3sV2JjQwG3R500GDFszsVDCjJoMLoYQ +e8ldMee6nkm0uPgSYna5e0yIK7r+aeWLcxoR8goL48lfkkyl1TFlQAa6xun8uSrw +Vn4SMoucC6GvURyrEOic2CHwPDSS2KIhENHBZ0V5nrILCUgZT26NFM4ybwPgFUsu +HYHKqyR7j3zGzyNs42kLHVr4mguBW6++GDlN0e4Sh8Eg0BwZg9A= +=XslM -END PGP SIGNATURE- Modified: dev/zeppelin/zeppelin-0.8.2-rc1/zeppelin-0.8.2-bin-all.tgz.sha512 == --- dev/zeppelin/zeppelin-0.8.2-rc1/zeppelin-0.8.2-bin-all.tgz.sha512 (original) +++ dev/zeppelin/zeppelin-0.8.2-rc1/zeppelin-0.8.2-bin-all.tgz.sha512 Thu Sep 26 04:13:08 2019 @@ -1 +1 @@ -30d2336f6e2b6bf7e0180dc92fcdffb6ed438af7a2af27a13ecc62d1cb778bcee011c1035285287aa7cae639d8afab4ba21213ed2bb3880a2f2f7846306d1cf5 zeppelin-0.8.2-bin-all.tgz +91a785153bc47b087f90fac0f83066fdede041d5193506b231af1b6855b150307873c92cea462c6dd48ef6d38caa37934591a08542199ac4b02d9493298fbd43 zeppelin-0.8.2-bin-all.tgz Modified: dev/zeppelin/zeppelin-0.8.2-rc1/zeppelin-0.8.2-bin-netinst.tgz == Binary files - no diff available. Modified: dev/zeppelin/zeppelin-0.8.2-rc1/zeppelin-0.8.2-bin-netinst.tgz.asc == --- dev/zeppelin/zeppelin-0.8.2-rc1/zeppelin-0.8.2-bin-netinst.tgz.asc (original) +++ dev/zeppelin/zeppelin-0.8.2-rc1/zeppelin-0.8.2-bin-netinst.tgz.asc Thu Sep 26 04:13:08 2019 @@ -1,16 +1,16 @@ -BEGIN PGP SIGNATURE- -iQIzBAABCAAdFiEE9k6XRfAhCMKdxRepCQ++FNmxfR8FAl2LB+MACgkQCQ++FNmx -fR9yLRAAorZDrDGhxHDHK/L/CzXtMsQMIInkXMgypy00Bj8+VPLIlOJExHFEi49G -OjmcLuB/5OMg0Tl2L1v4fKbcRrG7nOdC25Vw7vflXPT0ThZs2/Kxtwcq09j04HTf -9GmetQ3mXtRIGvAP4DljFOzZyuMus52HiSbW0fz9U6EGWDiUch7N1AQXA97IpALM -M9GxLqY1um5GyZujdEWgJ/+YA5Uij/lTj1qL4VNRI6+X/+d7k7AVkCnpwjfpz+l3 -nUEG6X2eoL5KKznlKaWpr3i/oPrf8pBYliPm/vcWyVrFjC0YCM+Ilhey97RLZhVo -3ZL6P9I8jsOXvcPWdL3MGE51oRfrqB8ZtuwCw/Xoi/+bKA4EDNXEv6E/z86aqk2N -EMHaZy21SBrORdt5jMXrJZXy9Xwlf8rzp+06JlTcP1rtb8fULfDBiev+QzI1c7q7 -lui81BpEGbMc4U5LOZsrvwKsPClt+Gc1NxSIJiB5TuwADd+i4eiQXabQJ/L2jE6M -zC0SJ9Yv8Rkg073a7A2ii2/VWKMHv2bj3TgYSytTI3ighnYiXaOU/oL0U9GXZQPV -XJZ0RUvS0auXNe6dA74p/0hjGUAmpUWuaE9J2OaxtM4j52h8yShy8cCugs9SGLnS -xH25fEc3JxNKxMhINU+P8qAnO3OdTmhIyt1B5lZYXqyRClSKPS4= -=Hlyi +iQIzBAABCAAdFiEE9k6XRfAhCMKdxRepCQ++FNmxfR8FAl2MOGYACgkQCQ++FNmx +fR/FnQ//U710/WylMS8P4L1XXulWqFDgDVE4HBueIO
svn commit: r36114 - /dev/zeppelin/zeppelin-0.8.2-rc1/ /release/zeppelin/zeppelin-0.8.2/
Author: zjffdu Date: Sun Sep 29 06:05:35 2019 New Revision: 36114 Log: Move 0.8.2 to release folder Added: release/zeppelin/zeppelin-0.8.2/ - copied from r36113, dev/zeppelin/zeppelin-0.8.2-rc1/ Removed: dev/zeppelin/zeppelin-0.8.2-rc1/
svn commit: r1867692 [10/31] - in /zeppelin/site/docs/0.8.2: ./ assets/themes/zeppelin/js/ development/ development/contribution/ development/helium/ interpreter/ quickstart/ setup/basics/ setup/deplo
Modified: zeppelin/site/docs/0.8.2/interpreter/markdown.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.2/interpreter/markdown.html?rev=1867692=1867691=1867692=diff == --- zeppelin/site/docs/0.8.2/interpreter/markdown.html (original) +++ zeppelin/site/docs/0.8.2/interpreter/markdown.html Sun Sep 29 07:25:59 2019 @@ -3,7 +3,7 @@ -Apache Zeppelin 0.8.0 Documentation: Markdown Interpreter for Apache Zeppelin +Apache Zeppelin 0.8.2 Documentation: Markdown Interpreter for Apache Zeppelin @@ -18,9 +18,9 @@ - - - + + + https://code.jquery.com/jquery-1.10.2.min.js"> - - - - - - + + + + + + - - + + @@ -56,11 +56,11 @@ http://zeppelin.apache.org;> - Zeppelin - 0.8.0 + 0.8.2 @@ -71,13 +71,13 @@ Quick Start Getting Started -Install -Explore UI -Tutorial - -Spark with Zeppelin -SQL with Zeppelin -Python with Zeppelin +Install +Explore UI +Tutorial + +Spark with Zeppelin +SQL with Zeppelin +Python with Zeppelin @@ -85,41 +85,41 @@ Usage Dynamic Form -What is Dynamic Form? +What is Dynamic Form? Display System -Text Display -HTML Display -Table Display -Network Display -Angular Display using Backend API -Angular Display using Frontend API +Text Display +HTML Display +Table Display +Network Display +Angular Display using Backend API +Angular Display using Frontend API Interpreter -Overview -Interpreter Binding Mode -User Impersonation -Dependency Management -Installing Interpreters - -Execution Hooks (Experimental) +Overview +Interpreter Binding Mode +User Impersonation +Dependency Management +Installing Interpreters + +Execution Hooks (Experimental) Other Features -Publishing Paragraphs -Personalized Mode -Customizing Zeppelin Homepage -Notebook Actions -Cron Scheduler -Zeppelin Context +Publishing Paragraphs +Personalized Mode +Customizing Zeppelin Homepage +Notebook Actions +Cron Scheduler +Zeppelin Context REST API -Interpreter API -Zeppelin Server API -Notebook API -Notebook Repository API -Configuration API -Credential API -Helium API +Interpreter API +Zeppelin Server API +Notebook API +Notebook Repository API +Configuration API +Credential API +Helium API @@ -127,37 +127,37 @@ Setup Basics -How to Build Zeppelin -Multi-user Support +How to Build Zeppelin +Multi-user Support Deployment - -Spark Cluster Mode: Standalone -Spark Cluster Mode: YARN -Spark Cluster Mode: Mesos -Zeppelin with Flink, Spark Cluster -Zeppelin on CDH -Zeppelin on VM: Vagrant + +Spark Cluster Mode: Standalone +Spark Cluster Mode: YARN +Spark Cluster Mode: Mesos +Zeppelin with Flink, Spark Cluster +Zeppelin on CDH +Zeppelin on VM: Vagrant Security -HTTP Basic Auth using NGINX -Shiro Authentication -Notebook Authorization -Data Source Authorization -
svn commit: r1867692 [20/31] - in /zeppelin/site/docs/0.8.2: ./ assets/themes/zeppelin/js/ development/ development/contribution/ development/helium/ interpreter/ quickstart/ setup/basics/ setup/deplo
Modified: zeppelin/site/docs/0.8.2/setup/operation/proxy_setting.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.2/setup/operation/proxy_setting.html?rev=1867692=1867691=1867692=diff == --- zeppelin/site/docs/0.8.2/setup/operation/proxy_setting.html (original) +++ zeppelin/site/docs/0.8.2/setup/operation/proxy_setting.html Sun Sep 29 07:25:59 2019 @@ -3,7 +3,7 @@ -Apache Zeppelin 0.8.0 Documentation: Proxy Setting in Apache Zeppelin +Apache Zeppelin 0.8.2 Documentation: Proxy Setting in Apache Zeppelin @@ -18,9 +18,9 @@ - - - + + + https://code.jquery.com/jquery-1.10.2.min.js"> - - - - - - + + + + + + - - + + @@ -56,11 +56,11 @@ http://zeppelin.apache.org;> - Zeppelin - 0.8.0 + 0.8.2 @@ -71,13 +71,13 @@ Quick Start Getting Started -Install -Explore UI -Tutorial - -Spark with Zeppelin -SQL with Zeppelin -Python with Zeppelin +Install +Explore UI +Tutorial + +Spark with Zeppelin +SQL with Zeppelin +Python with Zeppelin @@ -85,41 +85,41 @@ Usage Dynamic Form -What is Dynamic Form? +What is Dynamic Form? Display System -Text Display -HTML Display -Table Display -Network Display -Angular Display using Backend API -Angular Display using Frontend API +Text Display +HTML Display +Table Display +Network Display +Angular Display using Backend API +Angular Display using Frontend API Interpreter -Overview -Interpreter Binding Mode -User Impersonation -Dependency Management -Installing Interpreters - -Execution Hooks (Experimental) +Overview +Interpreter Binding Mode +User Impersonation +Dependency Management +Installing Interpreters + +Execution Hooks (Experimental) Other Features -Publishing Paragraphs -Personalized Mode -Customizing Zeppelin Homepage -Notebook Actions -Cron Scheduler -Zeppelin Context +Publishing Paragraphs +Personalized Mode +Customizing Zeppelin Homepage +Notebook Actions +Cron Scheduler +Zeppelin Context REST API -Interpreter API -Zeppelin Server API -Notebook API -Notebook Repository API -Configuration API -Credential API -Helium API +Interpreter API +Zeppelin Server API +Notebook API +Notebook Repository API +Configuration API +Credential API +Helium API @@ -127,37 +127,37 @@ Setup Basics -How to Build Zeppelin -Multi-user Support +How to Build Zeppelin +Multi-user Support Deployment - -Spark Cluster Mode: Standalone -Spark Cluster Mode: YARN -Spark Cluster Mode: Mesos -Zeppelin with Flink, Spark Cluster -Zeppelin on CDH -Zeppelin on VM: Vagrant + +Spark Cluster Mode: Standalone +Spark Cluster Mode: YARN +Spark Cluster Mode: Mesos +Zeppelin with Flink, Spark Cluster +Zeppelin on CDH +Zeppelin on VM: Vagrant Security -HTTP Basic Auth using NGINX -Shiro Authentication -Notebook Authorization -Data
svn commit: r1867692 [1/31] - in /zeppelin/site/docs/0.8.2: ./ assets/themes/zeppelin/js/ development/ development/contribution/ development/helium/ interpreter/ quickstart/ setup/basics/ setup/deploy
Author: zjffdu Date: Sun Sep 29 07:25:59 2019 New Revision: 1867692 URL: http://svn.apache.org/viewvc?rev=1867692=rev Log: Update 0.8.2 Modified: zeppelin/site/docs/0.8.2/assets/themes/zeppelin/js/search.js zeppelin/site/docs/0.8.2/atom.xml zeppelin/site/docs/0.8.2/development/contribution/how_to_contribute_code.html zeppelin/site/docs/0.8.2/development/contribution/how_to_contribute_website.html zeppelin/site/docs/0.8.2/development/contribution/useful_developer_tools.html zeppelin/site/docs/0.8.2/development/helium/overview.html zeppelin/site/docs/0.8.2/development/helium/writing_application.html zeppelin/site/docs/0.8.2/development/helium/writing_spell.html zeppelin/site/docs/0.8.2/development/helium/writing_visualization_basic.html zeppelin/site/docs/0.8.2/development/helium/writing_visualization_transformation.html zeppelin/site/docs/0.8.2/development/writing_zeppelin_interpreter.html zeppelin/site/docs/0.8.2/index.html zeppelin/site/docs/0.8.2/interpreter/alluxio.html zeppelin/site/docs/0.8.2/interpreter/beam.html zeppelin/site/docs/0.8.2/interpreter/bigquery.html zeppelin/site/docs/0.8.2/interpreter/cassandra.html zeppelin/site/docs/0.8.2/interpreter/elasticsearch.html zeppelin/site/docs/0.8.2/interpreter/flink.html zeppelin/site/docs/0.8.2/interpreter/geode.html zeppelin/site/docs/0.8.2/interpreter/groovy.html zeppelin/site/docs/0.8.2/interpreter/hbase.html zeppelin/site/docs/0.8.2/interpreter/hdfs.html zeppelin/site/docs/0.8.2/interpreter/hive.html zeppelin/site/docs/0.8.2/interpreter/ignite.html zeppelin/site/docs/0.8.2/interpreter/jdbc.html zeppelin/site/docs/0.8.2/interpreter/kylin.html zeppelin/site/docs/0.8.2/interpreter/lens.html zeppelin/site/docs/0.8.2/interpreter/mahout.html zeppelin/site/docs/0.8.2/interpreter/markdown.html zeppelin/site/docs/0.8.2/interpreter/neo4j.html zeppelin/site/docs/0.8.2/interpreter/postgresql.html zeppelin/site/docs/0.8.2/interpreter/python.html zeppelin/site/docs/0.8.2/interpreter/r.html zeppelin/site/docs/0.8.2/interpreter/sap.html zeppelin/site/docs/0.8.2/interpreter/scalding.html zeppelin/site/docs/0.8.2/interpreter/scio.html zeppelin/site/docs/0.8.2/interpreter/shell.html zeppelin/site/docs/0.8.2/interpreter/spark.html zeppelin/site/docs/0.8.2/pleasecontribute.html zeppelin/site/docs/0.8.2/quickstart/explore_ui.html zeppelin/site/docs/0.8.2/quickstart/install.html zeppelin/site/docs/0.8.2/quickstart/python_with_zeppelin.html zeppelin/site/docs/0.8.2/quickstart/spark_with_zeppelin.html zeppelin/site/docs/0.8.2/quickstart/sql_with_zeppelin.html zeppelin/site/docs/0.8.2/quickstart/tutorial.html zeppelin/site/docs/0.8.2/rss.xml zeppelin/site/docs/0.8.2/screenshots.html zeppelin/site/docs/0.8.2/search.html zeppelin/site/docs/0.8.2/search_data.json zeppelin/site/docs/0.8.2/setup/basics/how_to_build.html zeppelin/site/docs/0.8.2/setup/basics/multi_user_support.html zeppelin/site/docs/0.8.2/setup/deployment/cdh.html zeppelin/site/docs/0.8.2/setup/deployment/docker.html zeppelin/site/docs/0.8.2/setup/deployment/flink_and_spark_cluster.html zeppelin/site/docs/0.8.2/setup/deployment/spark_cluster_mode.html zeppelin/site/docs/0.8.2/setup/deployment/virtual_machine.html zeppelin/site/docs/0.8.2/setup/deployment/yarn_install.html zeppelin/site/docs/0.8.2/setup/operation/configuration.html zeppelin/site/docs/0.8.2/setup/operation/proxy_setting.html zeppelin/site/docs/0.8.2/setup/operation/trouble_shooting.html zeppelin/site/docs/0.8.2/setup/operation/upgrading.html zeppelin/site/docs/0.8.2/setup/security/authentication_nginx.html zeppelin/site/docs/0.8.2/setup/security/datasource_authorization.html zeppelin/site/docs/0.8.2/setup/security/http_security_headers.html zeppelin/site/docs/0.8.2/setup/security/notebook_authorization.html zeppelin/site/docs/0.8.2/setup/security/shiro_authentication.html zeppelin/site/docs/0.8.2/setup/storage/storage.html zeppelin/site/docs/0.8.2/usage/display_system/angular_backend.html zeppelin/site/docs/0.8.2/usage/display_system/angular_frontend.html zeppelin/site/docs/0.8.2/usage/display_system/basic.html zeppelin/site/docs/0.8.2/usage/dynamic_form/intro.html zeppelin/site/docs/0.8.2/usage/interpreter/dependency_management.html zeppelin/site/docs/0.8.2/usage/interpreter/dynamic_loading.html zeppelin/site/docs/0.8.2/usage/interpreter/execution_hooks.html zeppelin/site/docs/0.8.2/usage/interpreter/installation.html zeppelin/site/docs/0.8.2/usage/interpreter/interpreter_binding_mode.html zeppelin/site/docs/0.8.2/usage/interpreter/overview.html zeppelin/site/docs/0.8.2/usage/interpreter/user_impersonation.html zeppelin/site/docs/0.8.2/usage/other_features/cron_scheduler.html zeppelin/site/docs/0.8.2/usage/other_features
svn commit: r1867697 [1/7] - in /zeppelin/site/docs/0.8.2: ./ development/ development/contribution/ development/helium/ interpreter/ quickstart/ setup/basics/ setup/deployment/ setup/operation/ setup
Author: zjffdu Date: Sun Sep 29 07:49:17 2019 New Revision: 1867697 URL: http://svn.apache.org/viewvc?rev=1867697=rev Log: Update 0.8.2 Modified: zeppelin/site/docs/0.8.2/Gemfile zeppelin/site/docs/0.8.2/Gemfile.lock zeppelin/site/docs/0.8.2/atom.xml zeppelin/site/docs/0.8.2/development/contribution/how_to_contribute_code.html zeppelin/site/docs/0.8.2/development/contribution/how_to_contribute_website.html zeppelin/site/docs/0.8.2/development/contribution/useful_developer_tools.html zeppelin/site/docs/0.8.2/development/helium/writing_application.html zeppelin/site/docs/0.8.2/development/helium/writing_spell.html zeppelin/site/docs/0.8.2/development/helium/writing_visualization_basic.html zeppelin/site/docs/0.8.2/development/helium/writing_visualization_transformation.html zeppelin/site/docs/0.8.2/development/writing_zeppelin_interpreter.html zeppelin/site/docs/0.8.2/interpreter/alluxio.html zeppelin/site/docs/0.8.2/interpreter/beam.html zeppelin/site/docs/0.8.2/interpreter/bigquery.html zeppelin/site/docs/0.8.2/interpreter/cassandra.html zeppelin/site/docs/0.8.2/interpreter/elasticsearch.html zeppelin/site/docs/0.8.2/interpreter/flink.html zeppelin/site/docs/0.8.2/interpreter/geode.html zeppelin/site/docs/0.8.2/interpreter/groovy.html zeppelin/site/docs/0.8.2/interpreter/hbase.html zeppelin/site/docs/0.8.2/interpreter/hdfs.html zeppelin/site/docs/0.8.2/interpreter/hive.html zeppelin/site/docs/0.8.2/interpreter/ignite.html zeppelin/site/docs/0.8.2/interpreter/jdbc.html zeppelin/site/docs/0.8.2/interpreter/kylin.html zeppelin/site/docs/0.8.2/interpreter/lens.html zeppelin/site/docs/0.8.2/interpreter/mahout.html zeppelin/site/docs/0.8.2/interpreter/neo4j.html zeppelin/site/docs/0.8.2/interpreter/python.html zeppelin/site/docs/0.8.2/interpreter/r.html zeppelin/site/docs/0.8.2/interpreter/sap.html zeppelin/site/docs/0.8.2/interpreter/scalding.html zeppelin/site/docs/0.8.2/interpreter/scio.html zeppelin/site/docs/0.8.2/interpreter/shell.html zeppelin/site/docs/0.8.2/interpreter/spark.html zeppelin/site/docs/0.8.2/quickstart/install.html zeppelin/site/docs/0.8.2/quickstart/sql_with_zeppelin.html zeppelin/site/docs/0.8.2/quickstart/tutorial.html zeppelin/site/docs/0.8.2/rss.xml zeppelin/site/docs/0.8.2/search_data.json zeppelin/site/docs/0.8.2/setup/basics/how_to_build.html zeppelin/site/docs/0.8.2/setup/deployment/cdh.html zeppelin/site/docs/0.8.2/setup/deployment/docker.html zeppelin/site/docs/0.8.2/setup/deployment/flink_and_spark_cluster.html zeppelin/site/docs/0.8.2/setup/deployment/spark_cluster_mode.html zeppelin/site/docs/0.8.2/setup/deployment/virtual_machine.html zeppelin/site/docs/0.8.2/setup/deployment/yarn_install.html zeppelin/site/docs/0.8.2/setup/operation/configuration.html zeppelin/site/docs/0.8.2/setup/security/authentication_nginx.html zeppelin/site/docs/0.8.2/setup/security/http_security_headers.html zeppelin/site/docs/0.8.2/setup/security/notebook_authorization.html zeppelin/site/docs/0.8.2/setup/security/shiro_authentication.html zeppelin/site/docs/0.8.2/setup/storage/storage.html zeppelin/site/docs/0.8.2/sitemap.txt zeppelin/site/docs/0.8.2/usage/display_system/angular_backend.html zeppelin/site/docs/0.8.2/usage/display_system/angular_frontend.html zeppelin/site/docs/0.8.2/usage/display_system/basic.html zeppelin/site/docs/0.8.2/usage/dynamic_form/intro.html zeppelin/site/docs/0.8.2/usage/interpreter/dependency_management.html zeppelin/site/docs/0.8.2/usage/interpreter/dynamic_loading.html zeppelin/site/docs/0.8.2/usage/interpreter/execution_hooks.html zeppelin/site/docs/0.8.2/usage/interpreter/installation.html zeppelin/site/docs/0.8.2/usage/interpreter/overview.html zeppelin/site/docs/0.8.2/usage/interpreter/user_impersonation.html zeppelin/site/docs/0.8.2/usage/other_features/customizing_homepage.html zeppelin/site/docs/0.8.2/usage/other_features/publishing_paragraphs.html zeppelin/site/docs/0.8.2/usage/other_features/zeppelin_context.html Modified: zeppelin/site/docs/0.8.2/Gemfile URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.2/Gemfile?rev=1867697=1867696=1867697=diff == --- zeppelin/site/docs/0.8.2/Gemfile (original) +++ zeppelin/site/docs/0.8.2/Gemfile Sun Sep 29 07:49:17 2019 @@ -15,5 +15,3 @@ # source 'https://rubygems.org' gem 'github-pages' -gem 'redcarpet' -gem 'pygments.rb' Modified: zeppelin/site/docs/0.8.2/Gemfile.lock URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.2/Gemfile.lock?rev=1867697=1867696=1867697=diff == --- zeppelin/site/docs/0.8.2/Gemfile.lock (original) +++ zeppelin/site/docs/0.8.2/Gemfile.lock Sun Sep 29 07:49:17
svn commit: r1867697 [6/7] - in /zeppelin/site/docs/0.8.2: ./ development/ development/contribution/ development/helium/ interpreter/ quickstart/ setup/basics/ setup/deployment/ setup/operation/ setup
Modified: zeppelin/site/docs/0.8.2/setup/security/http_security_headers.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.2/setup/security/http_security_headers.html?rev=1867697=1867696=1867697=diff == --- zeppelin/site/docs/0.8.2/setup/security/http_security_headers.html (original) +++ zeppelin/site/docs/0.8.2/setup/security/http_security_headers.html Sun Sep 29 07:49:17 2019 @@ -268,7 +268,7 @@ limitations under the License. It also prevents MITM attack by not allowing User to override the invalid certificate message, when Attacker presents invalid SSL certificate to the User. The following property needs to be updated in the zeppelin-site.xml in order to enable HSTS. You can choose appropriate value for max-age. -property +property namezeppelin.server.strict.transport/name valuemax-age=631138519/value descriptionThe HTTP Strict-Transport-Security response header is a security feature that lets a web site tell browsers that it should only be communicated with using HTTPS, instead of using HTTP. Enable this when Zeppelin is running on HTTPS. Value is in Seconds, the default value is equivalent to 20 years./description @@ -289,7 +289,7 @@ It also prevents MITM attack by not allo The HTTP X-XSS-Protection response header is a feature of Internet Explorer, Chrome and Safari Web browsers that initiates configured action when they detect reflected cross-site scripting (XSS) attacks. The following property needs to be updated in the zeppelin-site.xml in order to set X-XSS-PROTECTION header. -property +property namezeppelin.server.xxss.protection/name value1; mode=block/value descriptionThe HTTP X-XSS-Protection response header is a feature of Internet Explorer, Chrome and Safari that stops pages from loading when they detect reflected cross-site scripting (XSS) attacks. When value is set to 1 and a cross-site scripting attack is detected, the browser will sanitize the page (remove the unsafe parts)./description @@ -310,7 +310,7 @@ It also prevents MITM attack by not allo The X-Frame-Options HTTP response header can indicate browser to avoid clickjacking attacks, by ensuring that their content is not embedded into other sites in a frame,iframe or object. The following property needs to be updated in the zeppelin-site.xml in order to set X-Frame-Options header. -property +property namezeppelin.server.xframe.options/name valueSAMEORIGIN/value descriptionThe X-Frame-Options HTTP response header can be used to indicate whether or not a browser should be allowed to render a page in a frame/iframe/object./description @@ -329,7 +329,7 @@ It also prevents MITM attack by not allo Security conscious organisations does not want to reveal the Application Server name and version to prevent finding this information easily by Attacker while fingerprinting the Application. The exact version number can tell an Attacker if the current Application Server is patched for or vulnerable to certain publicly known CVE associated to it. The following property needs to be updated in the zeppelin-site.xml in order to set Server header. -property +property namezeppelin.server.jetty.name/name valueJetty(7.6.0.v20120127)/value descriptionHardcoding Application Server name to Prevent Fingerprinting/description Modified: zeppelin/site/docs/0.8.2/setup/security/notebook_authorization.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.2/setup/security/notebook_authorization.html?rev=1867697=1867696=1867697=diff == --- zeppelin/site/docs/0.8.2/setup/security/notebook_authorization.html (original) +++ zeppelin/site/docs/0.8.2/setup/security/notebook_authorization.html Sun Sep 29 07:49:17 2019 @@ -294,10 +294,10 @@ or someone who doesnt have Separate notebook workspaces (public vs. private) By default, the authorization rights allow other users to see the newly created note, meaning the workspace is public. This behavior is controllable and can be set through either ZEPPELIN_NOTEBOOK_PUBLIC variable in conf/zeppelin-env.sh, or through zeppelin.notebook.public property in conf/zeppelin-site.xml. Thus, in order to make newly created note appear only in your private workspace by default, you can set either ZEPPELIN_NOTEBOOK_PUBLIC to false in your conf/zeppelin-env.sh as follows: -export ZEPPELIN_NOTEBOOK_PUBLIC=false +export ZEPPELIN_NOTEBOOK_PUBLIC=false or set zeppelin.notebook.public property to false in conf/zeppelin-site.xml as follows: -property +property namezeppelin.notebook.public/name valuefalse/value descriptionMake notebook public by default when created, private otherwise/description Modified: zeppelin/site/docs/0.8.2/setup/security/shiro_authentication.html URL:
svn commit: r1867697 [2/7] - in /zeppelin/site/docs/0.8.2: ./ development/ development/contribution/ development/helium/ interpreter/ quickstart/ setup/basics/ setup/deployment/ setup/operation/ setup
Modified: zeppelin/site/docs/0.8.2/interpreter/cassandra.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.2/interpreter/cassandra.html?rev=1867697=1867696=1867697=diff == --- zeppelin/site/docs/0.8.2/interpreter/cassandra.html (original) +++ zeppelin/site/docs/0.8.2/interpreter/cassandra.html Sun Sep 29 07:49:17 2019 @@ -335,7 +335,7 @@ limitations under the License. CQL statements This interpreter is compatible with any CQL statement supported by Cassandra. Ex: -INSERT INTO users(login,name) VALUES(jdoe,John DOE); +INSERT INTO users(login,name) VALUES(jdoe,John DOE); SELECT * FROM users WHERE login=jdoe; Each statement should be separated by a semi-colon ( ; ) except the special commands below: @@ -353,7 +353,7 @@ limitations under the License. Multi-line statements as well as multiple statements on the same line are also supported as long as they are separated by a semi-colon. Ex: -USE spark_demo; +USE spark_demo; SELECT * FROM albums_by_country LIMIT 1; SELECT * FROM countries LIMIT 1; @@ -362,18 +362,18 @@ limitations under the License. WHERE login=jlennon; Batch statements are supported and can span multiple lines, as well as DDL (CREATE/ALTER/DROP) statements: -BEGIN BATCH +BEGIN BATCH INSERT INTO users(login,name) VALUES(jdoe,John DOE); INSERT INTO users_preferences(login,account_type) VALUES(jdoe,BASIC); APPLY BATCH; -CREATE TABLE IF NOT EXISTS test( +CREATE TABLE IF NOT EXISTS test( key int PRIMARY KEY, value text ); CQL statements are case-insensitive (except for column names and values). This means that the following statements are equivalent and valid: -INSERT INTO users(login,name) VALUES(jdoe,John DOE); +INSERT INTO users(login,name) VALUES(jdoe,John DOE); Insert into users(login,name) vAlues(hsue,Helen SUE); The complete list of all CQL statements and versions can be found below: @@ -426,7 +426,7 @@ limitations under the License. Comments in statements It is possible to add comments between statements. Single line comments start with the hash sign (#) or double slashes (//). Multi-line comments are enclosed between /** and **/. Ex: -#Single line comment style 1 +#Single line comment style 1 INSERT INTO users(login,name) VALUES(jdoe,John DOE); //Single line comment style 2 @@ -621,7 +621,7 @@ There is a drop-down menu on the top lef Some examples: -CREATE TABLE IF NOT EXISTS spark_demo.ts( +CREATE TABLE IF NOT EXISTS spark_demo.ts( key int PRIMARY KEY, value text ); @@ -666,7 +666,7 @@ There is a drop-down menu on the top lef Example: -@prepare[statement-name]=... +@prepare[statement-name]=... @bind[statement-name]=âtextâ, 1223, â2015-07-30 12:00:01â, null, true, [âlist_item1â, âlist_item2â] @@ -688,7 +688,7 @@ there is only one instance of the interp Example: -@prepare[select]=SELECT * FROM spark_demo.albums LIMIT ? +@prepare[select]=SELECT * FROM spark_demo.albums LIMIT ? @prepare[select]=SELECT * FROM spark_demo.artists LIMIT ? @@ -701,7 +701,7 @@ thus it is necessary to avoid re @bind Once the statement is prepared (possibly in a separated notebook/paragraph). You can bind values to it: -@bind[select_first]=10 +@bind[select_first]=10 Bound values are not mandatory for the @bind statement. However if you provide bound values, they need to comply to some syntax: @@ -728,7 +728,7 @@ thus it is necessary to avoid re It is possible to use the @bind statement inside a batch: -BEGIN BATCH +BEGIN BATCH @bind[insert_user]=jdoe,John DOE UPDATE users SET age = 27 WHERE login=hsue; APPLY BATCH; @@ -756,7 +756,7 @@ the first time the paragraph is executed Example: -#Secondary index on performer style +#Secondary index on performer style SELECT name, country, performer FROM spark_demo.performers WHERE name=${performer=Sheryl Crow|Doof|Fanfarlo|Los Paranoia} @@ -771,7 +771,7 @@ We could have also use the ${sty It is also possible to use dynamic forms for prepared statements: -@bind[select]==${performer=Sheryl Crow|Doof|Fanfarlo|Los Paranoia}, ${style=Rock} +@bind[select]==${performer=Sheryl Crow|Doof|Fanfarlo|Los Paranoia}, ${style=Rock} Shared states Modified: zeppelin/site/docs/0.8.2/interpreter/elasticsearch.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.2/interpreter/elasticsearch.html?rev=1867697=1867696=1867697=diff == --- zeppelin/site/docs/0.8.2/interpreter/elasticsearch.html (original) +++ zeppelin/site/docs/0.8.2/interpreter/elasticsearch.html Sun Sep 29 07:49:17 2019 @@ -329,11 +329,11 @@ It is generally used as the underlying e In a paragraph, use %elasticsearch to select the Elasticsearch interpreter and then input all commands. To get the list of available commands, use help. -%elasticsearch +%elasticsearch help Elasticsearch
svn commit: r1867697 [3/7] - in /zeppelin/site/docs/0.8.2: ./ development/ development/contribution/ development/helium/ interpreter/ quickstart/ setup/basics/ setup/deployment/ setup/operation/ setup
Modified: zeppelin/site/docs/0.8.2/interpreter/python.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.2/interpreter/python.html?rev=1867697=1867696=1867697=diff == --- zeppelin/site/docs/0.8.2/interpreter/python.html (original) +++ zeppelin/site/docs/0.8.2/interpreter/python.html Sun Sep 29 07:49:17 2019 @@ -310,28 +310,28 @@ The interpreter can use all modules alre get the Conda Infomation: -%python.conda info +%python.conda info list the Conda environments: -%python.conda env list +%python.conda env list create a conda enviornment: -%python.conda create --name [ENV NAME] +%python.conda create --name [ENV NAME] activate an environment (python interpreter will be restarted): -%python.conda activate [ENV NAME] +%python.conda activate [ENV NAME] deactivate -%python.conda deactivate +%python.conda deactivate get installed package list inside the current environment -%python.conda list +%python.conda list install package -%python.conda install [PACKAGE NAME] +%python.conda install [PACKAGE NAME] uninstall package -%python.conda uninstall [PACKAGE NAME] +%python.conda uninstall [PACKAGE NAME] @@ -343,18 +343,18 @@ The interpreter can use all modules alre activate an environment -%python.docker activate [Repository] +%python.docker activate [Repository] %python.docker activate [Repository:Tag] %python.docker activate [Image Id] deactivate -%python.docker deactivate +%python.docker deactivate Here is an example -# activate latest tensorflow image as a python environment +# activate latest tensorflow image as a python environment %python.docker activate gcr.io/tensorflow/tensorflow:latest Using Zeppelin Dynamic Forms @@ -364,25 +364,25 @@ Here is an example Zeppelin Dynamic Form can only be used if py4j Python library is installed in your system. If not, you can install it with pip install py4j. Example : -%python -### Input form -print (z.input(f1,defaultValue)) +%python +### Input form +print (z.input(f1,defaultValue)) -### Select form -print (z.select(f1,[(o1,1),(o2,2)],2)) +### Select form +print (z.select(f1,[(o1,1),(o2,2)],2)) -### Checkbox form -print(.join(z.checkbox(f3, [(o1,1), (o2,2)],[1]))) +### Checkbox form +print(.join(z.checkbox(f3, [(o1,1), (o2,2)],[1]))) Matplotlib integration The python interpreter can display matplotlib figures inline automatically using the pyplot module: -%python +%python import matplotlib.pyplot as plt plt.plot([1, 2, 3]) This is the recommended method for using matplotlib from within a Zeppelin notebook. The output of this command will by default be converted to HTML by implicitly making use of the %html magic. Additional configuration can be achieved using the builtin z.configure_mpl() method. For example, -z.configure_mpl(width=400, height=300, fmt=svg) +z.configure_mpl(width=400, height=300, fmt=svg) plt.plot([1, 2, 3]) Will produce a 400x300 image in SVG format, which by default are normally 600x400 and PNG respectively. @@ -394,7 +394,7 @@ More details can be found in the include then the backend will automatically be set to agg, and the (otherwise deprecated) instructions below can be used for more limited inline plotting. If you are unable to load the inline backend, use z.show(plt): -%python +%python import matplotlib.pyplot as plt plt.figure() (.. ..) @@ -402,9 +402,9 @@ then the backend will automatically be s plt.close() The z.show() function can take optional parameters to adapt graph dimensions (width and height) as well as output format (png or optionally svg). -%python -z.show(plt, width=50px) -z.show(plt, height=150px, fmt=svg) +%python +z.show(plt, width=50px) +z.show(plt, height=150px, fmt=svg) @@ -415,8 +415,8 @@ Python interpreter leverages it to visua same as with Matplotlib integration. Example: -import pandas as pd -rates = pd.read_csv(bank.csv, sep=;) +import pandas as pd +rates = pd.read_csv(bank.csv, sep=;) z.show(rates) SQL over Pandas DataFrames @@ -435,17 +435,16 @@ visualization of results though built-in In case default binded interpreter is Python (first in the interpreter list, under the Gear Icon), you can just use it as %sql i.e -first paragraph - -import pandas as pd -rates = pd.read_csv(bank.csv, sep=;) - - -next paragraph - -%sql +first paragraph +import pandas as pd +rates = pd.read_csv(bank.csv, sep=;) + +next paragraph +%sql SELECT * FROM rates WHERE age 40 - + + + Otherwise it can be referred to as %python.sql IPython Support @@ -453,7 +452,7 @@ visualization of results though built-in IPython is more powerful than the default python interpreter with extra functionality. You can use IPython with Python2 or Python3 which depends on which python you set zeppelin.python. Pre-requests -- Jupyter `pip install jupyter` +- Jupyter `pip install jupyter` - grpcio `pip install grpcio` - protobuf `pip install
svn commit: r1867697 [5/7] - in /zeppelin/site/docs/0.8.2: ./ development/ development/contribution/ development/helium/ interpreter/ quickstart/ setup/basics/ setup/deployment/ setup/operation/ setup
Modified: zeppelin/site/docs/0.8.2/setup/basics/how_to_build.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.2/setup/basics/how_to_build.html?rev=1867697=1867696=1867697=diff == --- zeppelin/site/docs/0.8.2/setup/basics/how_to_build.html (original) +++ zeppelin/site/docs/0.8.2/setup/basics/how_to_build.html Sun Sep 29 07:49:17 2019 @@ -286,23 +286,23 @@ limitations under the License. If you havent installed Git and Maven yet, check the Build requirements section and follow the step by step instructions from there. 1. Clone the Apache Zeppelin repository -git clone https://github.com/apache/zeppelin.git +git clone https://github.com/apache/zeppelin.git 2. Build source You can build Zeppelin with following maven command: -mvn clean package -DskipTests [Options] +mvn clean package -DskipTests [Options] If youre unsure about the options, use the same commands that creates official binary package. -# update all pom.xml to use scala 2.11 -./dev/change_scala_version.sh 2.11 -# build zeppelin with all interpreters and include latest version of Apache spark support for local mode. +# update all pom.xml to use scala 2.11 +./dev/change_scala_version.sh 2.11 +# build zeppelin with all interpreters and include latest version of Apache spark support for local mode. mvn clean package -DskipTests -Pspark-2.0 -Phadoop-2.4 -Pr -Pscala-2.11 3. Done You can directly start Zeppelin by running after successful build: -./bin/zeppelin-daemon.sh start +./bin/zeppelin-daemon.sh start Check build-profiles section for further build options. If you are behind proxy, follow instructions in Proxy setting section. @@ -320,7 +320,7 @@ If you are behind proxy, follow instruct Set spark major version Available profiles are --Pspark-2.1 +-Pspark-2.1 -Pspark-2.0 -Pspark-1.6 -Pspark-1.5 @@ -338,7 +338,7 @@ If you are behind proxy, follow instruct set hadoop major version Available profiles are --Phadoop-0.23 +-Phadoop-0.23 -Phadoop-1 -Phadoop-2.2 -Phadoop-2.3 @@ -352,7 +352,7 @@ If you are behind proxy, follow instruct set scala version (default 2.10) Available profiles are --Pscala-2.10 +-Pscala-2.10 -Pscala-2.11 -Pr (optional) @@ -369,7 +369,7 @@ Available profiles are The correct Maven artifacts can be found for every version of MapR at http://doc.mapr.com Available profiles are --Pmapr3 +-Pmapr3 -Pmapr40 -Pmapr41 -Pmapr50 @@ -382,52 +382,52 @@ The correct Maven artifacts can be found Build command examples Here are some examples with several options: -# build with spark-2.1, scala-2.11 -./dev/change_scala_version.sh 2.11 +# build with spark-2.1, scala-2.11 +./dev/change_scala_version.sh 2.11 mvn clean package -Pspark-2.1 -Phadoop-2.4 -Pscala-2.11 -DskipTests -# build with spark-2.0, scala-2.11 -./dev/change_scala_version.sh 2.11 +# build with spark-2.0, scala-2.11 +./dev/change_scala_version.sh 2.11 mvn clean package -Pspark-2.0 -Phadoop-2.4 -Pscala-2.11 -DskipTests -# build with spark-1.6, scala-2.10 +# build with spark-1.6, scala-2.10 mvn clean package -Pspark-1.6 -Phadoop-2.4 -DskipTests -# spark-cassandra integration -mvn clean package -Pcassandra-spark-1.5 -Dhadoop.version=2.6.0 -Phadoop-2.6 -DskipTests -DskipTests +# spark-cassandra integration +mvn clean package -Pcassandra-spark-1.5 -Dhadoop.version=2.6.0 -Phadoop-2.6 -DskipTests -DskipTests -# with CDH -mvn clean package -Pspark-1.5 -Dhadoop.version=2.6.0-cdh5.5.0 -Phadoop-2.6 -Pvendor-repo -DskipTests +# with CDH +mvn clean package -Pspark-1.5 -Dhadoop.version=2.6.0-cdh5.5.0 -Phadoop-2.6 -Pvendor-repo -DskipTests -# with MapR +# with MapR mvn clean package -Pspark-1.5 -Pmapr50 -DskipTests Ignite Interpreter -mvn clean package -Dignite.version=1.9.0 -DskipTests +mvn clean package -Dignite.version=1.9.0 -DskipTests Scalding Interpreter -mvn clean package -Pscalding -DskipTests +mvn clean package -Pscalding -DskipTests Optional configurations Here are additional configurations that could be optionally tuned using the trailing -D option for maven commands Spark package -spark.archive # default spark-${spark.version} -spark.src.download.url # default http://d3kbcqa49mib13.cloudfront.net/${spark.archive}.tgz -spark.bin.download.url # default http://d3kbcqa49mib13.cloudfront.net/${spark.archive}-bin-without-hadoop.tgz +spark.archive # default spark-${spark.version} +spark.src.download.url # default http://d3kbcqa49mib13.cloudfront.net/${spark.archive}.tgz +spark.bin.download.url # default http://d3kbcqa49mib13.cloudfront.net/${spark.archive}-bin-without-hadoop.tgz Py4J package -python.py4j.version # default 0.9.2 -pypi.repo.url # default https://pypi.python.org/packages -python.py4j.repo.folder # default /64/5c/01e13b68e8caafece40d549f232c9b5677ad1016071a48d04cc3895acaa3 +python.py4j.version # default 0.9.2 +pypi.repo.url # default https://pypi.python.org/packages +python.py4j.repo.folder
svn commit: r1867697 [4/7] - in /zeppelin/site/docs/0.8.2: ./ development/ development/contribution/ development/helium/ interpreter/ quickstart/ setup/basics/ setup/deployment/ setup/operation/ setup
Modified: zeppelin/site/docs/0.8.2/search_data.json URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.2/search_data.json?rev=1867697=1867696=1867697=diff == --- zeppelin/site/docs/0.8.2/search_data.json (original) +++ zeppelin/site/docs/0.8.2/search_data.json Sun Sep 29 07:49:17 2019 @@ -1,925 +1,947 @@ { -"interpreter-alluxio": { - "title": "Alluxio Interpreter for Apache Zeppelin", - "content" : "Alluxio Interpreter for Apache ZeppelinOverviewAlluxio is a memory-centric distributed storage system enabling reliable data sharing at memory-speed across cluster frameworks.Configuration NameClass Descriptionalluxio.master.hostnamelocalhostAlluxio master hostnamealluxio.master.port19998Alluxio master port Enabling Alluxio InterpreterIn a notebook, to enable the Alluxio interpreter, click on the Gear icon and select Alluxio.Using the Alluxio InterpreterIn a paragraph, use %alluxio to select the Alluxio interpreter and then input all commands.%alluxiohelpTip : Use ( Ctrl + . ) for autocompletion.Interpreter CommandsThe Alluxio interpreter accepts the following commands. Operation Syntax Description cat cat quot;pathquot; Print the content of the file to the console. chgrp chgrp quot;groupquot; quot;pathquot; Change the grou p of the directory or file. chmod chmod quot;permissionquot; quot;pathquot; Change the permission of the directory or file. chown chown quot;ownerquot; quot;pathquot; Change the owner of the directory or file. copyFromLocal copyFromLocal quot;source pathquot; quot;remote pathquot; Copy the specified file specified by quot;source pathquot; to the path specified by quot;remote pathquot;. This command will fail if quot;remote pathquot; already exists. copyToLocal copyToLocal quot;remote pathquot; quot;local pathquot; Copy the specified file from the path specified by quot;remote pathquot; to a local destination. count count quot;pathquot; Display the number of folders and files matching the specified prefix in quot;pathquot;. du du quot;pathquot; Display the size of a file or a directory specified by the input path. fileInfo fileInfo quot;pathquot; Print the information of the blocks of a specified file. free free quot;pathquot; Free a file or all files under a directory from Alluxio. If the file/directory is also in under storage, it will still be available there. getCapacityBytes getCapacityBytes Get the capacity of the AlluxioFS. getUsedBytes getUsedBytes Get number of bytes used in the AlluxioFS. load load quot;pathquot; Load the data of a file or a directory from under storage into Alluxio. loadMetadata loadMetadata quot;pathquot; Load the metadata of a file or a directory from under storage into Alluxio. location location quot;pathquot; Display a list of hos ts that have the file data. ls ls quot;pathquot; List all the files and directories directly under the given path with information such as size. mkdir mkdir quot;path1quot; ... quot;pathnquot; Create directory(ies) under the given paths, along with any necessary parent directories. Multiple paths separated by spaces or tabs. This command will fail if any of the given paths already exist. mount mount quot;pathquot; quot;uriquot; Mount the underlying file system path quot;uriquot; into the Alluxio namespace as quot;pathquot;. The quot;pathquot; is assumed not to exist and is created by the operation. No data or metadata is loaded from under storage into Alluxio. After a path is mounted, operations on objects under the mounted path are mirror to the mounted under storage. mv mv quot;sour cequot; quot;destinationquot; Move a file or directory specified by quot;sourcequot; to a new location quot;destinationquot;. This command will fail if quot;destinationquot; already exists. persist persist quot;pathquot; Persist a file or directory currently stored only in Alluxio to the underlying file system. pin pin quot;pathquot; Pin the given file to avoid evicting it from memory. If the given path is a directory, it recursively pins all the files contained and any new files created within this directory. report report quot;pathquot; Report to the master that a file is lost. rm rm quot;pathquot; Remove a file. This command will fail if the given
[zeppelin] branch branch-0.8 updated: [HOTFIX] HotFix for publishing
This is an automated email from the ASF dual-hosted git repository. zjffdu pushed a commit to branch branch-0.8 in repository https://gitbox.apache.org/repos/asf/zeppelin.git The following commit(s) were added to refs/heads/branch-0.8 by this push: new 93535d9 [HOTFIX] HotFix for publishing 93535d9 is described below commit 93535d9fdff94bcd44e1a22986c0e43dd0cbf1e4 Author: Jeff Zhang AuthorDate: Sun Sep 29 15:51:10 2019 +0800 [HOTFIX] HotFix for publishing --- dev/publish_release.sh | 11 ++- docs/_config.yml | 7 +++ 2 files changed, 9 insertions(+), 9 deletions(-) diff --git a/dev/publish_release.sh b/dev/publish_release.sh index 83db305..15f6ea1 100755 --- a/dev/publish_release.sh +++ b/dev/publish_release.sh @@ -125,14 +125,14 @@ function publish_to_maven() { echo "Created Nexus staging repository: ${staged_repo_id}" - rm -rf $HOME/.m2/repository/org/apache/zeppelin + #rm -rf $HOME/.m2/repository/org/apache/zeppelin # build with scala-2.10 echo "mvn clean install -DskipTests \ -Pscala-2.10 -Pbeam \ ${PUBLISH_PROFILES} ${PROJECT_OPTIONS}" - mvn clean install -DskipTests -Pscala-2.10 -Pbeam \ -${PUBLISH_PROFILES} ${PROJECT_OPTIONS} + #mvn clean install -DskipTests -Pscala-2.10 -Pbeam \ + # ${PUBLISH_PROFILES} ${PROJECT_OPTIONS} if [[ $? -ne 0 ]]; then echo "Build with scala 2.10 failed." exit 1 @@ -144,8 +144,8 @@ function publish_to_maven() { echo "mvn clean install -DskipTests \ -Pscala-2.11 \ ${PUBLISH_PROFILES} ${PROJECT_OPTIONS}" - mvn clean install -DskipTests -Pscala-2.11 \ -${PUBLISH_PROFILES} ${PROJECT_OPTIONS} + #mvn clean install -DskipTests -Pscala-2.11 \ + # ${PUBLISH_PROFILES} ${PROJECT_OPTIONS} if [[ $? -ne 0 ]]; then echo "Build with scala 2.11 failed." exit 1 @@ -158,6 +158,7 @@ function publish_to_maven() { for file in $(find . -type f); do echo "${GPG_PASSPHRASE}" | gpg --passphrase-fd 0 --output "${file}.asc" \ --detach-sig --armor "${file}" +md5 -q "${file}" > "${file}.md5" ${SHASUM} -a 1 "${file}" | cut -f1 -d' ' > "${file}.sha1" done diff --git a/docs/_config.yml b/docs/_config.yml index 372bc80..ea4eca5 100644 --- a/docs/_config.yml +++ b/docs/_config.yml @@ -21,8 +21,7 @@ author : twitter : ASF feedburner : feedname -ZEPPELIN_VERSION : 0.8.0 - +ZEPPELIN_VERSION : 0.8.2 # The production_url is only used when full-domain names are needed # such as sitemap.txt # Most places will/should use BASE_PATH to make the urls @@ -59,7 +58,7 @@ JB : # - Only the following values are falsy: ["", null, false] # - When setting BASE_PATH it must be a valid url. # This means always setting the protocol (http|https) or prefixing with "/" - BASE_PATH : /docs/0.8.0 + BASE_PATH : /docs/0.8.2 # By default, the asset_path is automatically defined relative to BASE_PATH plus the enabled theme. # ex: [BASE_PATH]/assets/themes/[THEME-NAME] @@ -69,7 +68,7 @@ JB : # http://s3.amazonaws.com/yoursite/themes/watermelon # /assets # - ASSET_PATH : false + ASSET_PATH : /docs/0.8.2/assets/themes/zeppelin # These paths are to the main pages Jekyll-Bootstrap ships with. # Some JB helpers refer to these paths; change them here if needed.
svn commit: r1867689 - in /zeppelin/site: ./ contribution/ contribution/zeppelinweb/ releases/
Author: zjffdu Date: Sun Sep 29 06:59:08 2019 New Revision: 1867689 URL: http://svn.apache.org/viewvc?rev=1867689=rev Log: Update doc for 0.8.2 Modified: zeppelin/site/assets.html zeppelin/site/atom.xml zeppelin/site/community.html zeppelin/site/contribution/contributions.html zeppelin/site/contribution/documentation.html zeppelin/site/contribution/webapplication.html zeppelin/site/contribution/zeppelinweb/goodPracticeGuide01.html zeppelin/site/contribution/zeppelinweb/goodPracticeGuide02.html zeppelin/site/contribution/zeppelinweb/goodPracticeGuide03.html zeppelin/site/contribution/zeppelinweb/goodPracticeGuide04.html zeppelin/site/doap.rdf zeppelin/site/documentation.html zeppelin/site/download.html zeppelin/site/helium_packages.html zeppelin/site/index.html zeppelin/site/releases/zeppelin-release-0.5.0-incubating.html zeppelin/site/releases/zeppelin-release-0.5.5-incubating.html zeppelin/site/releases/zeppelin-release-0.5.6-incubating.html zeppelin/site/releases/zeppelin-release-0.6.0.html zeppelin/site/releases/zeppelin-release-0.6.1.html zeppelin/site/releases/zeppelin-release-0.6.2.html zeppelin/site/releases/zeppelin-release-0.7.0.html zeppelin/site/releases/zeppelin-release-0.7.1.html zeppelin/site/releases/zeppelin-release-0.7.2.html zeppelin/site/releases/zeppelin-release-0.7.3.html zeppelin/site/releases/zeppelin-release-0.8.0.html zeppelin/site/releases/zeppelin-release-0.8.1.html zeppelin/site/rss.xml zeppelin/site/screenshots.html zeppelin/site/sitemap.txt zeppelin/site/supported_interpreters.html zeppelin/site/whats_new.md Modified: zeppelin/site/assets.html URL: http://svn.apache.org/viewvc/zeppelin/site/assets.html?rev=1867689=1867688=1867689=diff == --- zeppelin/site/assets.html (original) +++ zeppelin/site/assets.html Sun Sep 29 06:59:08 2019 @@ -73,7 +73,7 @@ -Quick Start +Quick Start Download @@ -87,6 +87,7 @@ Docs Release +0.8.2 0.8.1 0.8.0 0.7.3 Modified: zeppelin/site/atom.xml URL: http://svn.apache.org/viewvc/zeppelin/site/atom.xml?rev=1867689=1867688=1867689=diff == --- zeppelin/site/atom.xml (original) +++ zeppelin/site/atom.xml Sun Sep 29 06:59:08 2019 @@ -4,7 +4,7 @@ Apache Zeppelin http://zeppelin.apache.org/; rel="self"/> http://zeppelin.apache.org"/> - 2019-01-23T14:21:08+08:00 + 2019-09-29T14:51:56+08:00 http://zeppelin.apache.org The Apache Software Foundation Modified: zeppelin/site/community.html URL: http://svn.apache.org/viewvc/zeppelin/site/community.html?rev=1867689=1867688=1867689=diff == --- zeppelin/site/community.html (original) +++ zeppelin/site/community.html Sun Sep 29 06:59:08 2019 @@ -73,7 +73,7 @@ -Quick Start +Quick Start Download @@ -87,6 +87,7 @@ Docs Release +0.8.2 0.8.1 0.8.0 0.7.3 Modified: zeppelin/site/contribution/contributions.html URL: http://svn.apache.org/viewvc/zeppelin/site/contribution/contributions.html?rev=1867689=1867688=1867689=diff == --- zeppelin/site/contribution/contributions.html (original) +++ zeppelin/site/contribution/contributions.html Sun Sep 29 06:59:08 2019 @@ -73,7 +73,7 @@ -Quick Start +Quick Start Download @@ -87,6 +87,7 @@ Docs Release +0.8.2 0.8.1 0.8.0 0.7.3 @@ -166,6 +167,10 @@ + + + + Documentation @@ -180,10 +185,6 @@ - - - - @@ -240,6 +241,12 @@ + + + + + + Modified: zeppelin/site/contribution/documentation.html URL: http://svn.apache.org/viewvc/zeppelin/site/contribution/documentation.html?rev=1867689=1867688=1867689=diff == --- zeppelin/site/contribution/documentation.html (original) +++ zeppelin/site/contribution/documentation.html Sun Sep 29 06:59:08 2019 @@ -73,7 +73,7 @@ -Quick Start +Quick Start Download @@ -87,6 +87,7 @@ Docs Release +0.8.2 0.8.1 0.8.0 0.
svn commit: r1867697 [7/7] - in /zeppelin/site/docs/0.8.2: ./ development/ development/contribution/ development/helium/ interpreter/ quickstart/ setup/basics/ setup/deployment/ setup/operation/ setup
Modified: zeppelin/site/docs/0.8.2/usage/dynamic_form/intro.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.2/usage/dynamic_form/intro.html?rev=1867697=1867696=1867697=diff == --- zeppelin/site/docs/0.8.2/usage/dynamic_form/intro.html (original) +++ zeppelin/site/docs/0.8.2/usage/dynamic_form/intro.html Sun Sep 29 07:49:17 2019 @@ -334,16 +334,18 @@ You can control this by unchecking the b -%spark -println(Hello +z.textbox(name)) +%spark +println(Hello +z.textbox(name)) + -%pyspark -print(Hello +z.textbox(name)) +%pyspark +print(Hello +z.textbox(name)) + @@ -357,16 +359,18 @@ You can control this by unchecking the b -%spark -println(Hello +z.textbox(name, sun)) +%spark +println(Hello +z.textbox(name, sun)) + -%pyspark -print(Hello +z.textbox(name, sun)) +%pyspark +print(Hello +z.textbox(name, sun)) + @@ -380,28 +384,30 @@ You can control this by unchecking the b -%spark +%spark println(Hello +z.select(day, Seq((1,mon), (2,tue), (3,wed), (4,thurs), (5,fri), (6,sat), -(7,sun +(7,sun + -%pyspark -print(Hello +z.select(day, [(1,mon), -(2,tue), -(3,wed), -(4,thurs), -(5,fri), -(6,sat), -(7,sun)])) +%pyspark +print(Hello +z.select(day, [(1,mon), +(2,tue), +(3,wed), +(4,thurs), +(5,fri), +(6,sat), +(7,sun)])) + @@ -415,18 +421,20 @@ You can control this by unchecking the b -%spark +%spark val options = Seq((apple,Apple), (banana,Banana), (orange,Orange)) -println(Hello +z.checkbox(fruit, options).mkString( and )) +println(Hello +z.checkbox(fruit, options).mkString( and )) + -%pyspark -options = [(apple,Apple), (banana,Banana), (orange,Orange)] -print(Hello + and .join(z.checkbox(fruit, options, [apple]))) +%pyspark +options = [(apple,Apple), (banana,Banana), (orange,Orange)] +print(Hello + and .join(z.checkbox(fruit, options, [apple]))) + Modified: zeppelin/site/docs/0.8.2/usage/interpreter/dependency_management.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.2/usage/interpreter/dependency_management.html?rev=1867697=1867696=1867697=diff == --- zeppelin/site/docs/0.8.2/usage/interpreter/dependency_management.html (original) +++ zeppelin/site/docs/0.8.2/usage/interpreter/dependency_management.html Sun Sep 29 07:49:17 2019 @@ -269,7 +269,8 @@ limitations under the License. Automatically add libraries to SparkCluster - + + @@ -280,15 +281,17 @@ limitations under the License. Load Dependencies to Interpreter - Click Interpreter menu in navigation bar. - Click edit button of the interpreter which you want to load dependencies to. + Click 'Interpreter' menu in navigation bar. + Click 'edit' button of the interpreter which you want to load dependencies to. Fill artifact and exclude field to your needs. You can enter not only groupId:artifactId:version but also local file in artifact field. - Press Save to restart the interpreter with loaded libraries. + Press 'Save' to restart the interpreter with loaded libraries. + + @@ -302,15 +305,15 @@ limitations under the License. Add repository for dependency resolving - Press icon in Interpreter menu on the top right side. + Press icon in 'Interpreter' menu on the top right side. It will show you available repository lists. If you need to resolve dependencies from other than central maven repository or local ~/.m2 repository, hit icon next to repository lists. - Fill out the form and click Add button, then you will be able to see that new repository is added. + Fill out the form and click 'Add' button, then you will be able to see that new repository is added. Optionally, if you are behind a corporate firewall, you can specify also all proxy settings so that Zeppelin can download the dependencies using the given credentials - + Modified: zeppelin/site/docs/0.8.2/usage/interpreter/dynamic_loading.html URL:
svn commit: r1867696 [3/3] - in /zeppelin/site/docs/0.8.2: ./ development/ development/contribution/ development/helium/ interpreter/ quickstart/ setup/basics/ setup/deployment/ setup/operation/ setup
Modified: zeppelin/site/docs/0.8.2/usage/interpreter/dynamic_loading.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.2/usage/interpreter/dynamic_loading.html?rev=1867696=1867695=1867696=diff == --- zeppelin/site/docs/0.8.2/usage/interpreter/dynamic_loading.html (original) +++ zeppelin/site/docs/0.8.2/usage/interpreter/dynamic_loading.html Sun Sep 29 07:44:31 2019 @@ -18,9 +18,9 @@ - - - + + + https://code.jquery.com/jquery-1.10.2.min.js"> - - - - - - + + + + + + Modified: zeppelin/site/docs/0.8.2/usage/interpreter/execution_hooks.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.2/usage/interpreter/execution_hooks.html?rev=1867696=1867695=1867696=diff == --- zeppelin/site/docs/0.8.2/usage/interpreter/execution_hooks.html (original) +++ zeppelin/site/docs/0.8.2/usage/interpreter/execution_hooks.html Sun Sep 29 07:44:31 2019 @@ -18,9 +18,9 @@ - - - + + + https://code.jquery.com/jquery-1.10.2.min.js"> - - - - - - + + + + + + Modified: zeppelin/site/docs/0.8.2/usage/interpreter/installation.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.2/usage/interpreter/installation.html?rev=1867696=1867695=1867696=diff == --- zeppelin/site/docs/0.8.2/usage/interpreter/installation.html (original) +++ zeppelin/site/docs/0.8.2/usage/interpreter/installation.html Sun Sep 29 07:44:31 2019 @@ -18,9 +18,9 @@ - - - + + + https://code.jquery.com/jquery-1.10.2.min.js"> - - - - - - + + + + + + Modified: zeppelin/site/docs/0.8.2/usage/interpreter/interpreter_binding_mode.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.2/usage/interpreter/interpreter_binding_mode.html?rev=1867696=1867695=1867696=diff == --- zeppelin/site/docs/0.8.2/usage/interpreter/interpreter_binding_mode.html (original) +++ zeppelin/site/docs/0.8.2/usage/interpreter/interpreter_binding_mode.html Sun Sep 29 07:44:31 2019 @@ -18,9 +18,9 @@ - - - + + + https://code.jquery.com/jquery-1.10.2.min.js"> - - - - - - + + + + + + Modified: zeppelin/site/docs/0.8.2/usage/interpreter/overview.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.2/usage/interpreter/overview.html?rev=1867696=1867695=1867696=diff == --- zeppelin/site/docs/0.8.2/usage/interpreter/overview.html (original) +++ zeppelin/site/docs/0.8.2/usage/interpreter/overview.html Sun Sep 29 07:44:31 2019 @@ -18,9 +18,9 @@ - - - + + + https://code.jquery.com/jquery-1.10.2.min.js"> - - - - - - + + + + + + Modified: zeppelin/site/docs/0.8.2/usage/interpreter/user_impersonation.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.2/usage/interpreter/user_impersonation.html?rev=1867696=1867695=1867696=diff == --- zeppelin/site/docs/0.8.2/usage/interpreter/user_impersonation.html (original) +++ zeppelin/site/docs/0.8.2/usage/interpreter/user_impersonation.html Sun Sep 29 07:44:31 2019 @@ -18,9 +18,9 @@ - - - + + + https://code.jquery.com/jquery-1.10.2.min.js"> - - - - - - + + + + + + Modified: zeppelin/site/docs/0.8.2/usage/other_features/cron_scheduler.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.2/usage/other_features/cron_scheduler.html?rev=1867696=1867695=1867696=diff == --- zeppelin/site/docs/0.8.2/usage/other_features/cron_scheduler.html (original) +++ zeppelin/site/docs/0.8.2/usage/other_features/cron_scheduler.html Sun Sep 29 07:44:31 2019 @@ -18,9 +18,9 @@ - - - + + + https://code.jquery.com/jquery-1.10.2.min.js"> - - - - - - + + + + + + Modified: zeppelin/site/docs/0.8.2/usage/other_features/customizing_homepage.html URL:
svn commit: r1867696 [1/3] - in /zeppelin/site/docs/0.8.2: ./ development/ development/contribution/ development/helium/ interpreter/ quickstart/ setup/basics/ setup/deployment/ setup/operation/ setup
Author: zjffdu Date: Sun Sep 29 07:44:31 2019 New Revision: 1867696 URL: http://svn.apache.org/viewvc?rev=1867696=rev Log: Update 0.8.2 Modified: zeppelin/site/docs/0.8.2/atom.xml zeppelin/site/docs/0.8.2/development/contribution/how_to_contribute_code.html zeppelin/site/docs/0.8.2/development/contribution/how_to_contribute_website.html zeppelin/site/docs/0.8.2/development/contribution/useful_developer_tools.html zeppelin/site/docs/0.8.2/development/helium/overview.html zeppelin/site/docs/0.8.2/development/helium/writing_application.html zeppelin/site/docs/0.8.2/development/helium/writing_spell.html zeppelin/site/docs/0.8.2/development/helium/writing_visualization_basic.html zeppelin/site/docs/0.8.2/development/helium/writing_visualization_transformation.html zeppelin/site/docs/0.8.2/development/writing_zeppelin_interpreter.html zeppelin/site/docs/0.8.2/index.html zeppelin/site/docs/0.8.2/interpreter/alluxio.html zeppelin/site/docs/0.8.2/interpreter/beam.html zeppelin/site/docs/0.8.2/interpreter/bigquery.html zeppelin/site/docs/0.8.2/interpreter/cassandra.html zeppelin/site/docs/0.8.2/interpreter/elasticsearch.html zeppelin/site/docs/0.8.2/interpreter/flink.html zeppelin/site/docs/0.8.2/interpreter/geode.html zeppelin/site/docs/0.8.2/interpreter/groovy.html zeppelin/site/docs/0.8.2/interpreter/hbase.html zeppelin/site/docs/0.8.2/interpreter/hdfs.html zeppelin/site/docs/0.8.2/interpreter/hive.html zeppelin/site/docs/0.8.2/interpreter/ignite.html zeppelin/site/docs/0.8.2/interpreter/jdbc.html zeppelin/site/docs/0.8.2/interpreter/kylin.html zeppelin/site/docs/0.8.2/interpreter/lens.html zeppelin/site/docs/0.8.2/interpreter/mahout.html zeppelin/site/docs/0.8.2/interpreter/markdown.html zeppelin/site/docs/0.8.2/interpreter/neo4j.html zeppelin/site/docs/0.8.2/interpreter/postgresql.html zeppelin/site/docs/0.8.2/interpreter/python.html zeppelin/site/docs/0.8.2/interpreter/r.html zeppelin/site/docs/0.8.2/interpreter/sap.html zeppelin/site/docs/0.8.2/interpreter/scalding.html zeppelin/site/docs/0.8.2/interpreter/scio.html zeppelin/site/docs/0.8.2/interpreter/shell.html zeppelin/site/docs/0.8.2/interpreter/spark.html zeppelin/site/docs/0.8.2/pleasecontribute.html zeppelin/site/docs/0.8.2/quickstart/explore_ui.html zeppelin/site/docs/0.8.2/quickstart/install.html zeppelin/site/docs/0.8.2/quickstart/python_with_zeppelin.html zeppelin/site/docs/0.8.2/quickstart/spark_with_zeppelin.html zeppelin/site/docs/0.8.2/quickstart/sql_with_zeppelin.html zeppelin/site/docs/0.8.2/quickstart/tutorial.html zeppelin/site/docs/0.8.2/rss.xml zeppelin/site/docs/0.8.2/screenshots.html zeppelin/site/docs/0.8.2/search.html zeppelin/site/docs/0.8.2/setup/basics/how_to_build.html zeppelin/site/docs/0.8.2/setup/basics/multi_user_support.html zeppelin/site/docs/0.8.2/setup/deployment/cdh.html zeppelin/site/docs/0.8.2/setup/deployment/docker.html zeppelin/site/docs/0.8.2/setup/deployment/flink_and_spark_cluster.html zeppelin/site/docs/0.8.2/setup/deployment/spark_cluster_mode.html zeppelin/site/docs/0.8.2/setup/deployment/virtual_machine.html zeppelin/site/docs/0.8.2/setup/deployment/yarn_install.html zeppelin/site/docs/0.8.2/setup/operation/configuration.html zeppelin/site/docs/0.8.2/setup/operation/proxy_setting.html zeppelin/site/docs/0.8.2/setup/operation/trouble_shooting.html zeppelin/site/docs/0.8.2/setup/operation/upgrading.html zeppelin/site/docs/0.8.2/setup/security/authentication_nginx.html zeppelin/site/docs/0.8.2/setup/security/datasource_authorization.html zeppelin/site/docs/0.8.2/setup/security/http_security_headers.html zeppelin/site/docs/0.8.2/setup/security/notebook_authorization.html zeppelin/site/docs/0.8.2/setup/security/shiro_authentication.html zeppelin/site/docs/0.8.2/setup/storage/storage.html zeppelin/site/docs/0.8.2/usage/display_system/angular_backend.html zeppelin/site/docs/0.8.2/usage/display_system/angular_frontend.html zeppelin/site/docs/0.8.2/usage/display_system/basic.html zeppelin/site/docs/0.8.2/usage/dynamic_form/intro.html zeppelin/site/docs/0.8.2/usage/interpreter/dependency_management.html zeppelin/site/docs/0.8.2/usage/interpreter/dynamic_loading.html zeppelin/site/docs/0.8.2/usage/interpreter/execution_hooks.html zeppelin/site/docs/0.8.2/usage/interpreter/installation.html zeppelin/site/docs/0.8.2/usage/interpreter/interpreter_binding_mode.html zeppelin/site/docs/0.8.2/usage/interpreter/overview.html zeppelin/site/docs/0.8.2/usage/interpreter/user_impersonation.html zeppelin/site/docs/0.8.2/usage/other_features/cron_scheduler.html zeppelin/site/docs/0.8.2/usage/other_features/customizing_homepage.html zeppelin/site/docs/0.8.2/usage/other_features/notebook_actions.html zeppelin/site
svn commit: r1867698 - in /zeppelin/site/docs/0.8.2/interpreter: livy.html pig.html
Author: zjffdu Date: Sun Sep 29 07:53:07 2019 New Revision: 1867698 URL: http://svn.apache.org/viewvc?rev=1867698=rev Log: Add missing interpreter Added: zeppelin/site/docs/0.8.2/interpreter/livy.html zeppelin/site/docs/0.8.2/interpreter/pig.html Added: zeppelin/site/docs/0.8.2/interpreter/livy.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.2/interpreter/livy.html?rev=1867698=auto == --- zeppelin/site/docs/0.8.2/interpreter/livy.html (added) +++ zeppelin/site/docs/0.8.2/interpreter/livy.html Sun Sep 29 07:53:07 2019 @@ -0,0 +1,514 @@ + + + + + +Apache Zeppelin 0.8.2 Documentation: Livy Interpreter for Apache Zeppelin + + + + + + + + + + + + + + + + + + + +https://code.jquery.com/jquery-1.10.2.min.js"</a>;> + + + + + + + + + + + + + + + + + + +Toggle navigation + + + + + +http://zeppelin.apache.org;> + + Zeppelin + 0.8.2 + + + + + + + + Quick Start + +Getting Started +Install +Explore UI +Tutorial + +Spark with Zeppelin +SQL with Zeppelin +Python with Zeppelin + + + + + Usage + +Dynamic Form +What is Dynamic Form? + +Display System +Text Display +HTML Display +Table Display +Network Display +Angular Display using Backend API +Angular Display using Frontend API + +Interpreter +Overview +Interpreter Binding Mode +User Impersonation +Dependency Management +Installing Interpreters + +Execution Hooks (Experimental) + +Other Features +Publishing Paragraphs +Personalized Mode +Customizing Zeppelin Homepage +Notebook Actions +Cron Scheduler +Zeppelin Context + +REST API +Interpreter API +Zeppelin Server API +Notebook API +Notebook Repository API +Configuration API +Credential API +Helium API + + + + + Setup + +Basics +How to Build Zeppelin +Multi-user Support + +Deployment + +Spark Cluster Mode: Standalone +Spark Cluster Mode: YARN +Spark Cluster Mode: Mesos +Zeppelin with Flink, Spark Cluster +Zeppelin on CDH +Zeppelin on VM: Vagrant + +Security +HTTP Basic Auth using NGINX +Shiro Authentication +Notebook Authorization +Data Source Authorization +HTTP Security Headers + +Notebook Storage +Git Storage +S3 Storage +Azure Storage +ZeppelinHub Storage +MongoDB Storage + +Operation +Configuration +Proxy Setting +Upgrading +Trouble Shooting + + + + + Interpreter + +Interpreters +Overview + +Spark +JDBC +Python + +Alluxio +Beam +BigQuery +Cassandra +Elasticsearch +Flink +Geode +Groovy +HBase +HDFS +Hive +Ignite +Kylin +Lens +Livy +Markdown +Neo4j +Pig +Postgresql, HAWQ +R +Scalding +Scio +Shell + + + + More + +Extending Zeppelin +W
svn commit: r1867692 [6/31] - in /zeppelin/site/docs/0.8.2: ./ assets/themes/zeppelin/js/ development/ development/contribution/ development/helium/ interpreter/ quickstart/ setup/basics/ setup/deploy
Modified: zeppelin/site/docs/0.8.2/interpreter/flink.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.2/interpreter/flink.html?rev=1867692=1867691=1867692=diff == --- zeppelin/site/docs/0.8.2/interpreter/flink.html (original) +++ zeppelin/site/docs/0.8.2/interpreter/flink.html Sun Sep 29 07:25:59 2019 @@ -3,7 +3,7 @@ -Apache Zeppelin 0.8.0 Documentation: Flink Interpreter for Apache Zeppelin +Apache Zeppelin 0.8.2 Documentation: Flink Interpreter for Apache Zeppelin @@ -18,9 +18,9 @@ - - - + + + https://code.jquery.com/jquery-1.10.2.min.js"> - - - - - - + + + + + + - - + + @@ -56,11 +56,11 @@ http://zeppelin.apache.org;> - Zeppelin - 0.8.0 + 0.8.2 @@ -71,13 +71,13 @@ Quick Start Getting Started -Install -Explore UI -Tutorial - -Spark with Zeppelin -SQL with Zeppelin -Python with Zeppelin +Install +Explore UI +Tutorial + +Spark with Zeppelin +SQL with Zeppelin +Python with Zeppelin @@ -85,41 +85,41 @@ Usage Dynamic Form -What is Dynamic Form? +What is Dynamic Form? Display System -Text Display -HTML Display -Table Display -Network Display -Angular Display using Backend API -Angular Display using Frontend API +Text Display +HTML Display +Table Display +Network Display +Angular Display using Backend API +Angular Display using Frontend API Interpreter -Overview -Interpreter Binding Mode -User Impersonation -Dependency Management -Installing Interpreters - -Execution Hooks (Experimental) +Overview +Interpreter Binding Mode +User Impersonation +Dependency Management +Installing Interpreters + +Execution Hooks (Experimental) Other Features -Publishing Paragraphs -Personalized Mode -Customizing Zeppelin Homepage -Notebook Actions -Cron Scheduler -Zeppelin Context +Publishing Paragraphs +Personalized Mode +Customizing Zeppelin Homepage +Notebook Actions +Cron Scheduler +Zeppelin Context REST API -Interpreter API -Zeppelin Server API -Notebook API -Notebook Repository API -Configuration API -Credential API -Helium API +Interpreter API +Zeppelin Server API +Notebook API +Notebook Repository API +Configuration API +Credential API +Helium API @@ -127,37 +127,37 @@ Setup Basics -How to Build Zeppelin -Multi-user Support +How to Build Zeppelin +Multi-user Support Deployment - -Spark Cluster Mode: Standalone -Spark Cluster Mode: YARN -Spark Cluster Mode: Mesos -Zeppelin with Flink, Spark Cluster -Zeppelin on CDH -Zeppelin on VM: Vagrant + +Spark Cluster Mode: Standalone +Spark Cluster Mode: YARN +Spark Cluster Mode: Mesos +Zeppelin with Flink, Spark Cluster +Zeppelin on CDH +Zeppelin on VM: Vagrant Security -HTTP Basic Auth using NGINX -Shiro Authentication -Notebook Authorization -Data Source Authorization -
svn commit: r1867692 [3/31] - in /zeppelin/site/docs/0.8.2: ./ assets/themes/zeppelin/js/ development/ development/contribution/ development/helium/ interpreter/ quickstart/ setup/basics/ setup/deploy
Modified: zeppelin/site/docs/0.8.2/development/helium/writing_visualization_basic.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.2/development/helium/writing_visualization_basic.html?rev=1867692=1867691=1867692=diff == --- zeppelin/site/docs/0.8.2/development/helium/writing_visualization_basic.html (original) +++ zeppelin/site/docs/0.8.2/development/helium/writing_visualization_basic.html Sun Sep 29 07:25:59 2019 @@ -3,7 +3,7 @@ -Apache Zeppelin 0.8.0 Documentation: Writing a new Helium Visualization: basic +Apache Zeppelin 0.8.2 Documentation: Writing a new Helium Visualization: basic @@ -18,9 +18,9 @@ - - - + + + https://code.jquery.com/jquery-1.10.2.min.js"> - - - - - - + + + + + + - - + + @@ -56,11 +56,11 @@ http://zeppelin.apache.org;> - Zeppelin - 0.8.0 + 0.8.2 @@ -71,13 +71,13 @@ Quick Start Getting Started -Install -Explore UI -Tutorial - -Spark with Zeppelin -SQL with Zeppelin -Python with Zeppelin +Install +Explore UI +Tutorial + +Spark with Zeppelin +SQL with Zeppelin +Python with Zeppelin @@ -85,41 +85,41 @@ Usage Dynamic Form -What is Dynamic Form? +What is Dynamic Form? Display System -Text Display -HTML Display -Table Display -Network Display -Angular Display using Backend API -Angular Display using Frontend API +Text Display +HTML Display +Table Display +Network Display +Angular Display using Backend API +Angular Display using Frontend API Interpreter -Overview -Interpreter Binding Mode -User Impersonation -Dependency Management -Installing Interpreters - -Execution Hooks (Experimental) +Overview +Interpreter Binding Mode +User Impersonation +Dependency Management +Installing Interpreters + +Execution Hooks (Experimental) Other Features -Publishing Paragraphs -Personalized Mode -Customizing Zeppelin Homepage -Notebook Actions -Cron Scheduler -Zeppelin Context +Publishing Paragraphs +Personalized Mode +Customizing Zeppelin Homepage +Notebook Actions +Cron Scheduler +Zeppelin Context REST API -Interpreter API -Zeppelin Server API -Notebook API -Notebook Repository API -Configuration API -Credential API -Helium API +Interpreter API +Zeppelin Server API +Notebook API +Notebook Repository API +Configuration API +Credential API +Helium API @@ -127,37 +127,37 @@ Setup Basics -How to Build Zeppelin -Multi-user Support +How to Build Zeppelin +Multi-user Support Deployment - -Spark Cluster Mode: Standalone -Spark Cluster Mode: YARN -Spark Cluster Mode: Mesos -Zeppelin with Flink, Spark Cluster -Zeppelin on CDH -Zeppelin on VM: Vagrant + +Spark Cluster Mode: Standalone +Spark Cluster Mode: YARN +Spark Cluster Mode: Mesos +Zeppelin with Flink, Spark Cluster +Zeppelin on CDH +Zeppelin on VM: Vagrant Security -HTTP Basic Auth using NGINX -
svn commit: r1867692 [9/31] - in /zeppelin/site/docs/0.8.2: ./ assets/themes/zeppelin/js/ development/ development/contribution/ development/helium/ interpreter/ quickstart/ setup/basics/ setup/deploy
Modified: zeppelin/site/docs/0.8.2/interpreter/kylin.html URL: http://svn.apache.org/viewvc/zeppelin/site/docs/0.8.2/interpreter/kylin.html?rev=1867692=1867691=1867692=diff == --- zeppelin/site/docs/0.8.2/interpreter/kylin.html (original) +++ zeppelin/site/docs/0.8.2/interpreter/kylin.html Sun Sep 29 07:25:59 2019 @@ -3,7 +3,7 @@ -Apache Zeppelin 0.8.0 Documentation: Apache Kylin Interpreter for Apache Zeppelin +Apache Zeppelin 0.8.2 Documentation: Apache Kylin Interpreter for Apache Zeppelin @@ -18,9 +18,9 @@ - - - + + + https://code.jquery.com/jquery-1.10.2.min.js"> - - - - - - + + + + + + - - + + @@ -56,11 +56,11 @@ http://zeppelin.apache.org;> - Zeppelin - 0.8.0 + 0.8.2 @@ -71,13 +71,13 @@ Quick Start Getting Started -Install -Explore UI -Tutorial - -Spark with Zeppelin -SQL with Zeppelin -Python with Zeppelin +Install +Explore UI +Tutorial + +Spark with Zeppelin +SQL with Zeppelin +Python with Zeppelin @@ -85,41 +85,41 @@ Usage Dynamic Form -What is Dynamic Form? +What is Dynamic Form? Display System -Text Display -HTML Display -Table Display -Network Display -Angular Display using Backend API -Angular Display using Frontend API +Text Display +HTML Display +Table Display +Network Display +Angular Display using Backend API +Angular Display using Frontend API Interpreter -Overview -Interpreter Binding Mode -User Impersonation -Dependency Management -Installing Interpreters - -Execution Hooks (Experimental) +Overview +Interpreter Binding Mode +User Impersonation +Dependency Management +Installing Interpreters + +Execution Hooks (Experimental) Other Features -Publishing Paragraphs -Personalized Mode -Customizing Zeppelin Homepage -Notebook Actions -Cron Scheduler -Zeppelin Context +Publishing Paragraphs +Personalized Mode +Customizing Zeppelin Homepage +Notebook Actions +Cron Scheduler +Zeppelin Context REST API -Interpreter API -Zeppelin Server API -Notebook API -Notebook Repository API -Configuration API -Credential API -Helium API +Interpreter API +Zeppelin Server API +Notebook API +Notebook Repository API +Configuration API +Credential API +Helium API @@ -127,37 +127,37 @@ Setup Basics -How to Build Zeppelin -Multi-user Support +How to Build Zeppelin +Multi-user Support Deployment - -Spark Cluster Mode: Standalone -Spark Cluster Mode: YARN -Spark Cluster Mode: Mesos -Zeppelin with Flink, Spark Cluster -Zeppelin on CDH -Zeppelin on VM: Vagrant + +Spark Cluster Mode: Standalone +Spark Cluster Mode: YARN +Spark Cluster Mode: Mesos +Zeppelin with Flink, Spark Cluster +Zeppelin on CDH +Zeppelin on VM: Vagrant Security -HTTP Basic Auth using NGINX -Shiro Authentication -Notebook Authorization -Data Source Authorization -