Letsencrypt

[tog]

Hi

Does someone has already configured zeppelin on https using letsencrypt.org
?

Cheers
Guillaume

Re: Problem with angular scope

[Corneau Damien]

Yes, it was merged, you can see the discussion in that PR.
The compatibility was only restored for paragraph so that it allow this
method to work:
https://gist.github.com/granturing/a09aed4a302a7367be92

Access from app level wasn't restored

On Tue, Mar 22, 2016 at 2:40 PM, Balachandar R.A. 
wrote:

> Hi
>
> I see this issue was discussed in
> https://github.com/apache/incubator-zeppelin/pull/720 and looks like for
> providing backward compatibility, the compiledScope is made available. I
> checked the master version and I see the below lines in
> https://github.com/apache/incubator-zeppelin/blob/master/zeppelin-web/src/app/notebook/paragraph/paragraph.controller.js
>
> $scope.paragraph = null;
> $scope.originalText = '';
> $scope.editor = null;
> var paragraphScope = $rootScope.$new(true, $rootScope);
> // to keep backward compatibility
> $scope.compiledScope = paragraphScope
>
>
>
> I thought the commit for backward compatibiity is merged with the master
> and it should work if we use master now. No?
>
> regards
> Bala
>
> On 21 March 2016 at 19:49, Corneau Damien  wrote:
>
>> Hi,
>> If you use master, this won't work.
>> The scope storage was changed, and it is now kept in the paragraph
>> controller only. (Scope can be applied to notebook or specific paragraphs
>> from backend)
>>
>> One way to deal with this would be to have a div with an id in your
>> paragraph 2, then access that dom element parent scope (which would be the
>> paragraph scope)
>> On Mar 21, 2016 5:58 PM, "Balachandar R.A." 
>> wrote:
>>
>>> Hello
>>>
>>> This is my para 1
>>>
>>>
>>> var name = "bala"
>>> z.angularBind("name",name)
>>>
>>> This is my para2
>>>
>>> %angular
>>> 
>>> var controllerElement = document.querySelector('[ng-app]');
>>> var scope = angular.element(controllerElement).scope().compiledScope;
>>> console.log(scope.name);
>>> 
>>>
>>>
>>> I ran para 1 and then para 2. Expected to see "bala" as output but this
>>> did not print anything. what could be the issue here? I do not see any
>>> error log as well in my browser console.
>>>
>>> regards
>>> Bala
>>>
>>
>

Re: Problem with angular scope

[Balachandar R.A.]

Hi

I see this issue was discussed in
https://github.com/apache/incubator-zeppelin/pull/720 and looks like for
providing backward compatibility, the compiledScope is made available. I
checked the master version and I see the below lines in
https://github.com/apache/incubator-zeppelin/blob/master/zeppelin-web/src/app/notebook/paragraph/paragraph.controller.js

$scope.paragraph = null;
$scope.originalText = '';
$scope.editor = null;
var paragraphScope = $rootScope.$new(true, $rootScope);
// to keep backward compatibility
$scope.compiledScope = paragraphScope



I thought the commit for backward compatibiity is merged with the master
and it should work if we use master now. No?

regards
Bala

On 21 March 2016 at 19:49, Corneau Damien  wrote:

> Hi,
> If you use master, this won't work.
> The scope storage was changed, and it is now kept in the paragraph
> controller only. (Scope can be applied to notebook or specific paragraphs
> from backend)
>
> One way to deal with this would be to have a div with an id in your
> paragraph 2, then access that dom element parent scope (which would be the
> paragraph scope)
> On Mar 21, 2016 5:58 PM, "Balachandar R.A." 
> wrote:
>
>> Hello
>>
>> This is my para 1
>>
>>
>> var name = "bala"
>> z.angularBind("name",name)
>>
>> This is my para2
>>
>> %angular
>> 
>> var controllerElement = document.querySelector('[ng-app]');
>> var scope = angular.element(controllerElement).scope().compiledScope;
>> console.log(scope.name);
>> 
>>
>>
>> I ran para 1 and then para 2. Expected to see "bala" as output but this
>> did not print anything. what could be the issue here? I do not see any
>> error log as well in my browser console.
>>
>> regards
>> Bala
>>
>

Re: [DISCUSS] Update Roadmap

[Nikolay Voronchikhin]

Hi Zeppelin Users and Developers,

Do you know if MapR will be adding Zeppelin to its roadmap for the next
version after MapR 5.1?

We see in Hue 3.9 that it provides notebooks for R Shell, Python Shell,
PySpark, SparkR, Hive SQL, Impala SQL, and Spark SQL, but no Drill SQL
notebook.
We are looking for an Apache Project that focuses on a Drill Notebook UI
that performs better than the Drill Web Console UI itself.

Sincerely,
*Nikolay Voronchikhin*
*Big Data/Data Warehouse/Data Science/Data Platforms Engineer at Cisco*
https://www.linkedin.com/in/nvoronchikhin
*E-mail: nvoronchik...@gmail.com *
*Mobile: 951-288-2778*


On Mon, Mar 21, 2016 at 2:44 PM, rohit choudhary  wrote:

> Dear All,
>
> I think direction setting is important for Enterprise readiness. I have a
> little bit of an overview of Ambari Views, which is very similar in nature
> to Zeppelin. Please let me explain:
>
> Hive View - interacts with Hive
> Pig View - interacts with Pig
> Workflow Designer - interacts with Oozie
>
> We have a very similar architecture in Zeppelin where we interact with
> these systems through Interpreters. The usage will also be similar, as both
> with interact with Hadoop clusters or in some cases Spark with Yarn on
> HDFS. Our priorities should include:
>
> - Design & implement for multi-tenancy
> - Auditability from Data/State and Lineage perspective
> - Ability to share Notebooks/Data/State across users, preferably through
> SparkContext sharing
> - Security between Zeppelin and the other systems, not limited to Spark
> through Kerberos. (@Rick +1)
>
> I will share an initial draft of the thoughts I have in mind, in the next
> couple of days.
>
> Thanks,
> Rohit.
>
>
>
> On Thu, Mar 3, 2016 at 7:54 AM, moon soo Lee  wrote:
>
>> Shabeel, thanks for the feedback about rest api and custom id. that might
>> help avoid multiple rest api calls.
>>
>> Thanks everyone for valuable feedback. Looks like all we're going to the
>> same direction. I have updated wiki.
>> https://cwiki.apache.org/confluence/display/ZEPPELIN/Zeppelin+Roadmap
>> Please take a look.
>>
>> I'm sure there're many missing details in this roadmap. I must say
>> something not on this roadmap doesn't mean community is not working on or
>> can't be included in the Zeppelin. Roadmap represents more like community
>> interest and overall direction.
>> We're not changing roadmap everyday, but that doesn't mean roadmap is set
>> in stone and never be changed. We can improve it continuously.
>>
>> Please feel free to fork the this mail thread for any further discussion
>> on specific subject. (e.g. job scheduling)
>>
>> Thanks,
>> moon
>>
>> On Wed, Mar 2, 2016 at 12:31 AM Shabeel Syed 
>> wrote:
>>
>>> Also we need better rest api support for creating and fetching the
>>> notebooks and paragraphs.
>>> for example if I can set custom defined notebookid and paragraphid , we
>>> can avoid multiple rest api calls.
>>>
>>> http://localhost:8080/#/notebook/
>>> /paragraph/?asIframe
>>> should return me error if notebook or paragraph deos not exists.
>>>
>>> and while creating notebook or paragraph I should be able to mention my
>>> custom ids.
>>>
>>> Regards
>>> Shabeel
>>>
>>> On Wed, Mar 2, 2016 at 11:55 AM, Zhong Wang 
>>> wrote:
>>>
 +1 on @rick. quality is really important... I am still encountering
 bugs consistently

 On Tue, Mar 1, 2016 at 10:16 AM, TEJA SRIVASTAV <
 tejasrivas...@gmail.com> wrote:

> +1 on @rick
>
> On Tue, Mar 1, 2016 at 11:26 PM Benjamin Kim 
> wrote:
>
>> I see in the Enterprise section that multi-tenancy will be included,
>> will this have user impersonation too? In this way, the user executing 
>> will
>> be the user owning the process.
>>
>> On Mar 1, 2016, at 12:51 AM, Shabeel Syed 
>> wrote:
>>
>> +1
>>
>> Hi Tamas,
>>Pluggable external visualization is really a GREAT feature to
>> have. I'm looking forward to this :)
>>
>> Regards
>> Shabeel
>>
>> On Tue, Mar 1, 2016 at 2:16 PM, Tamas Szuromi <
>> tamas.szur...@odigeo.com> wrote:
>>
>>> Hey,
>>>
>>> Really promising roadmap.
>>>
>>> I'd only push more visualization options. I agree built in
>>> visualization is needed with limited charting options but I think we 
>>> also
>>> need somehow 'inject' external js visualizations also.
>>>
>>>
>>> For scheduling Zeppelin notebooks  we use
>>>  https://github.com/airbnb/airflow
>>>  through the job rest api. It's
>>> an enterprise ready and very robust solution right now.
>>>
>>>
>>> *Tamas*
>>>
>>> On 1 March 2016 at 09:12, Eran Witkon  wrote:
>>>
 One point to clarify, I don't want to suggest Oozie in specific, I
 want to think about which features we develop and which ones we 
 integrate
 external, preferred Apache, technology? We don't think about building 
>>>

RE: volatile table or temp views using sparksql

[Joel Van Veluwen]

Hi Amber,

As per Spark in general you can register temporary tables…

Paragraph (1)
%spark

sqlContext.sql(“select * from db.table where col = 
‘buyer’”).registerTempTable(“tempBuyer”)


Paragraph (2)
%sql

Select * from tempBuyer

You can also load dependencies and use these to create temporary tables as per 
the Spark documentation…

CREATE TEMPORARY TABLE jsonTable
USING org.apache.spark.sql.json
OPTIONS (
  path "examples/src/main/resources/people.json"
)

SELECT * FROM jsonTable
Cheers,


Joel Van Veluwen
QUANTIUM
Level 25, 8 Chifley
8-12 Chifley Square
Sydney NSW 2000

T: +61 2 8224 8981
M: +61 403 153 265
F: +61 2 9292 6444

W: quantium.com.au



linkedin.com/company/quantium
facebook.com/QuantiumAustralia
twitter.com/QuantiumAU

The contents of this email, including attachments, may be confidential 
information. If you are not the intended recipient, any use, disclosure or 
copying of the information is unauthorised. If you have received this email in 
error, we would be grateful if you would notify us immediately by email reply, 
phone (+ 61 2 9292 6400) or fax (+ 61 2 9292 6444) and delete the message from 
your system.

From: Amber Li [mailto:am...@picsart.com]
Sent: Tuesday, 22 March 2016 10:29 AM
To: users@zeppelin.incubator.apache.org
Subject: volatile table or temp views using sparksql

Hi

I am new to Zeppelin. I wonder if we could create volatile tables or temp views 
as some middle steps at a single window on Zeppelin? Or the middle step tables 
need to stored as a physical table somewhere and then to be reloaded for 
further calculation?

Thanks!
Amber

volatile table or temp views using sparksql

[Amber Li]

Hi

I am new to Zeppelin. I wonder if we could create volatile tables or temp
views as some middle steps at a single window on Zeppelin? Or the middle
step tables need to stored as a physical table somewhere and then to be
reloaded for further calculation?

Thanks!
Amber

sql visualization

[Preeti]

Hi,

I was wondering if it is possible to change parameters like color of the
points, text that is displayed while hovering over a point on a scatter
plot etc. If yes, how to go about it?

Thanks.

Re: [DISCUSS] Update Roadmap

[rohit choudhary]

Dear All,

I think direction setting is important for Enterprise readiness. I have a
little bit of an overview of Ambari Views, which is very similar in nature
to Zeppelin. Please let me explain:

Hive View - interacts with Hive
Pig View - interacts with Pig
Workflow Designer - interacts with Oozie

We have a very similar architecture in Zeppelin where we interact with
these systems through Interpreters. The usage will also be similar, as both
with interact with Hadoop clusters or in some cases Spark with Yarn on
HDFS. Our priorities should include:

- Design & implement for multi-tenancy
- Auditability from Data/State and Lineage perspective
- Ability to share Notebooks/Data/State across users, preferably through
SparkContext sharing
- Security between Zeppelin and the other systems, not limited to Spark
through Kerberos. (@Rick +1)

I will share an initial draft of the thoughts I have in mind, in the next
couple of days.

Thanks,
Rohit.



On Thu, Mar 3, 2016 at 7:54 AM, moon soo Lee  wrote:

> Shabeel, thanks for the feedback about rest api and custom id. that might
> help avoid multiple rest api calls.
>
> Thanks everyone for valuable feedback. Looks like all we're going to the
> same direction. I have updated wiki.
> https://cwiki.apache.org/confluence/display/ZEPPELIN/Zeppelin+Roadmap
> Please take a look.
>
> I'm sure there're many missing details in this roadmap. I must say
> something not on this roadmap doesn't mean community is not working on or
> can't be included in the Zeppelin. Roadmap represents more like community
> interest and overall direction.
> We're not changing roadmap everyday, but that doesn't mean roadmap is set
> in stone and never be changed. We can improve it continuously.
>
> Please feel free to fork the this mail thread for any further discussion
> on specific subject. (e.g. job scheduling)
>
> Thanks,
> moon
>
> On Wed, Mar 2, 2016 at 12:31 AM Shabeel Syed 
> wrote:
>
>> Also we need better rest api support for creating and fetching the
>> notebooks and paragraphs.
>> for example if I can set custom defined notebookid and paragraphid , we
>> can avoid multiple rest api calls.
>>
>> http://localhost:8080/#/notebook/
>> /paragraph/?asIframe
>> should return me error if notebook or paragraph deos not exists.
>>
>> and while creating notebook or paragraph I should be able to mention my
>> custom ids.
>>
>> Regards
>> Shabeel
>>
>> On Wed, Mar 2, 2016 at 11:55 AM, Zhong Wang 
>> wrote:
>>
>>> +1 on @rick. quality is really important... I am still encountering bugs
>>> consistently
>>>
>>> On Tue, Mar 1, 2016 at 10:16 AM, TEJA SRIVASTAV >> > wrote:
>>>
 +1 on @rick

 On Tue, Mar 1, 2016 at 11:26 PM Benjamin Kim 
 wrote:

> I see in the Enterprise section that multi-tenancy will be included,
> will this have user impersonation too? In this way, the user executing 
> will
> be the user owning the process.
>
> On Mar 1, 2016, at 12:51 AM, Shabeel Syed 
> wrote:
>
> +1
>
> Hi Tamas,
>Pluggable external visualization is really a GREAT feature to
> have. I'm looking forward to this :)
>
> Regards
> Shabeel
>
> On Tue, Mar 1, 2016 at 2:16 PM, Tamas Szuromi <
> tamas.szur...@odigeo.com> wrote:
>
>> Hey,
>>
>> Really promising roadmap.
>>
>> I'd only push more visualization options. I agree built in
>> visualization is needed with limited charting options but I think we also
>> need somehow 'inject' external js visualizations also.
>>
>>
>> For scheduling Zeppelin notebooks  we use
>>  https://github.com/airbnb/airflow
>>  through the job rest api. It's
>> an enterprise ready and very robust solution right now.
>>
>>
>> *Tamas*
>>
>> On 1 March 2016 at 09:12, Eran Witkon  wrote:
>>
>>> One point to clarify, I don't want to suggest Oozie in specific, I
>>> want to think about which features we develop and which ones we 
>>> integrate
>>> external, preferred Apache, technology? We don't think about building 
>>> our
>>> own storage services so why build our own scheduler?
>>> Eran
>>> On Tue, 1 Mar 2016 at 09:49 moon soo Lee  wrote:
>>>
 @Vinayak, @Eran, @Benjamin, @Guilherme, @Sourav, @Rick
 Now I can see a lot of demands around enterprise level job
 scheduling. Either external or built-in, I completely agree having
 enterprise level job scheduling support on the roadmap.
 ZEPPELIN-137 ,
 ZEPPELIN-531  are
 related issues i can find in our JIRA.

 @Vinayak
 Regarding importing notebook from github, Zeppelin has pluggable
 notebook storage layer (see related package
 

Re: Problem with angular scope

[Corneau Damien]

Hi,
If you use master, this won't work.
The scope storage was changed, and it is now kept in the paragraph
controller only. (Scope can be applied to notebook or specific paragraphs
from backend)

One way to deal with this would be to have a div with an id in your
paragraph 2, then access that dom element parent scope (which would be the
paragraph scope)
On Mar 21, 2016 5:58 PM, "Balachandar R.A." 
wrote:

> Hello
>
> This is my para 1
>
>
> var name = "bala"
> z.angularBind("name",name)
>
> This is my para2
>
> %angular
> 
> var controllerElement = document.querySelector('[ng-app]');
> var scope = angular.element(controllerElement).scope().compiledScope;
> console.log(scope.name);
> 
>
>
> I ran para 1 and then para 2. Expected to see "bala" as output but this
> did not print anything. what could be the issue here? I do not see any
> error log as well in my browser console.
>
> regards
> Bala
>

Re: Shiro authentication dialog does not appear

[Peter Briggs]

Hi Moon,

Yes, no problem. I edited zeppelin-site.xml as follows:


  zeppelin.server.addr
  localhost
  Server address


...


  zeppelin.anonymous.allowed
  false
  Anonymous user allowed by default




And my shiro.ini file looks like this:



#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements.  See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License.  You may obtain a copy of the License at
#
#http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#

[users]
# List of users with their password allowed to access Zeppelin.
# To use a different strategy (LDAP / Database / ...) check the shiro doc at 
http://shiro.apache.org/configuration.html#Configuration-INISections
admin = password1
user1 = password2, role1, role2
user2 = password3, role3
user3 = password4, role2

# Sample LDAP configuration, for user Authentication, currently tested for 
single Realm
[main]
#ldapRealm = org.apache.shiro.realm.ldap.JndiLdapRealm
#ldapRealm.userDnTemplate = cn={0},cn=engg,ou=testdomain,dc=testdomain,dc=com
#ldapRealm.contextFactory.url = ldap://ldaphost:389
#ldapRealm.contextFactory.authenticationMechanism = SIMPLE

[urls]
# anon means the access is anonymous.
# authcBasic means Basic Auth Security
# To enfore security, comment the line below and uncomment the next one
#/** = anon
/** = authcBasic


Also, here is a screenshot of what my Zeppelin site's home screen looks like: 
http://pasteboard.co/2qLfOO0y.png

Thanks,
Peter

> On 18 Mar 2016, at 17:54, moon soo Lee  wrote:
> 
> Hi Peter,
> 
> There're no special flag for maven build process.
> Could you share how you modified your shiro.ini?
> 
> Thanks,
> moon
> 
> On Fri, Mar 18, 2016 at 2:45 AM Peter Briggs  > wrote:
> Hi Moon,
> 
> Thanks for the reply. Yes, I tried cleaning the cache, and I also get the 
> same result in Chrome incognito mode.
> 
> I wonder is there some option that I need to add as part of the maven build 
> process to enable auth? I just built zeppelin with the defaults and then 
> followed the instructions for enabling authentication in the shiro.ini and 
> zeppelin-site.xml config files.
> 
> Thanks,
> Peter
> 
>> On 17 Mar 2016, at 23:03, moon soo Lee > > wrote:
>> 
>> Hi Peter,
>> 
>> Thanks sharing the problem. That seems unusual. Have you tried clean browser 
>> cache?
>> 
>> Thanks,
>> moon
>> 
>> On Tue, Mar 15, 2016 at 3:48 PM Peter Briggs > > wrote:
>> Hi,
>> 
>> I am having trouble getting the Shiro user authentication to work for 
>> Zeppelin - the issue is that when I open the Zeppelin home page in browser, 
>> the login dialog does not appear as expected. I’ve tested in Chrome and 
>> Safari, which the same results.
>> 
>> I downloaded the latest 0.6.0-incubating-SNAPSHOT, and followed the config 
>> instructions here: 
>> https://zeppelin.incubator.apache.org/docs/0.6.0-incubating-SNAPSHOT/manual/shiroauthentication.html
>>  
>> 
>>  
>> 
>> The config setting that disables anonymous access seems to work ok though, 
>> as I can’t access any notebooks on the site when I apply those settings. The 
>> DEBUG logs seem to confirm that the shiro.ini file has been found and used 
>> for configuration. And the logs also show that my requests to the site are 
>> considered anonymous, which is to be expected given I haven’t logged in yet.
>> 
>> Anyone have any ideas where I might be going wrong?
>> 
>> Thanks,
>> Peter
> 

Problem with angular scope

[Balachandar R.A.]

Hello

This is my para 1


var name = "bala"
z.angularBind("name",name)

This is my para2

%angular

var controllerElement = document.querySelector('[ng-app]');
var scope = angular.element(controllerElement).scope().compiledScope;
console.log(scope.name);



I ran para 1 and then para 2. Expected to see "bala" as output but this did
not print anything. what could be the issue here? I do not see any error
log as well in my browser console.

regards
Bala

Re: Shorten build time

[Eran Witkon]

if you add -pl ![interpreter-name] this will omit the interpreter from the
build
example -pl !flink will not include flink in the build.

if you are using bash don't forget \
mnv clean package -DskipTests -pl \!flink,\!cassandra


On Mon, Mar 21, 2016 at 10:43 AM tog  wrote:

> Hi there
>
> I cannot remember how to build zeppelin with only Spark and Python support
> ?
> Can someone reming me the magic build command?
>
> Cheers
> Guillaume
>

Shorten build time

[tog]

Hi there

I cannot remember how to build zeppelin with only Spark and Python support ?
Can someone reming me the magic build command?

Cheers
Guillaume