Re: Is it possible to run Zeppelin on cluster

[Michael Segel]

Yeah, but each instance is separate.  I don’t think that’s what OP meant since 
he referenced Hadoop.

As others point out the Notebook dir has to be accessible to all instances.

On Apr 30, 2018, at 5:04 PM, ankit jain 
mailto:ankitjain@gmail.com>> wrote:

You can probably deploy Zeppelin on n machines and manage behind a LoadBalancer?

Thanks
Ankit

On Mon, Apr 30, 2018 at 6:42 AM, Michael Segel 
mailto:msegel_had...@hotmail.com>> wrote:
Ok..
The answer is no.

You have a web interface. It runs on a web server.  Does the web server run in 
a cluster?


On Apr 30, 2018, at 12:24 AM, Soheil Pourbafrani 
mailto:soheil.i...@gmail.com>> wrote:

Thanks, I meant the Zeppelin itself, not it's jobs.

On Sun, Apr 29, 2018 at 11:51 PM, Michael Segel 
mailto:msegel_had...@hotmail.com>> wrote:
Yes if you mean to run the spark jobs on a cluster.


On Apr 29, 2018, at 7:25 AM, Soheil Pourbafrani 
mailto:soheil.i...@gmail.com>> wrote:

I mean to configure Zeppelin in multimode.

On Sun, Apr 29, 2018 at 4:49 PM, Soheil Pourbafrani 
mailto:soheil.i...@gmail.com>> wrote:
Something like Kafka or Hadoop cluster?







--
Thanks & Regards,
Ankit.

Re: Is it possible to run Zeppelin on cluster

[ankit jain]

Yeah LB will need to make sure requests for a notebook always go to same
machine - then it will be like a single machine deployment, multiple users
using the notebook at same time.

On Mon, Apr 30, 2018 at 3:19 PM, Ruslan Dautkhanov 
wrote:

> It probably would work for an active-passive Zeppelin cluster if all files
> are in a shared NFS directory for example, not as active-active.
> One simple example - they would keep overwriting configuration files /
> notebook files etc.
>
>
>
> --
> Ruslan Dautkhanov
>
> On Mon, Apr 30, 2018 at 4:04 PM, ankit jain 
> wrote:
>
>> You can probably deploy Zeppelin on n machines and manage behind a
>> LoadBalancer?
>>
>> Thanks
>> Ankit
>>
>> On Mon, Apr 30, 2018 at 6:42 AM, Michael Segel > > wrote:
>>
>>> Ok..
>>> The answer is no.
>>>
>>> You have a web interface. It runs on a web server.  Does the web server
>>> run in a cluster?
>>>
>>>
>>> On Apr 30, 2018, at 12:24 AM, Soheil Pourbafrani 
>>> wrote:
>>>
>>> Thanks, I meant the Zeppelin itself, not it's jobs.
>>>
>>> On Sun, Apr 29, 2018 at 11:51 PM, Michael Segel <
>>> msegel_had...@hotmail.com> wrote:
>>>
 Yes if you mean to run the spark jobs on a cluster.


 On Apr 29, 2018, at 7:25 AM, Soheil Pourbafrani 
 wrote:

 I mean to configure Zeppelin in multimode.

 On Sun, Apr 29, 2018 at 4:49 PM, Soheil Pourbafrani <
 soheil.i...@gmail.com> wrote:

> Something like Kafka or Hadoop cluster?
>



>>>
>>>
>>
>>
>> --
>> Thanks & Regards,
>> Ankit.
>>
>
>


-- 
Thanks & Regards,
Ankit.

Re: Is it possible to run Zeppelin on cluster

[Ruslan Dautkhanov]

It probably would work for an active-passive Zeppelin cluster if all files
are in a shared NFS directory for example, not as active-active.
One simple example - they would keep overwriting configuration files /
notebook files etc.



-- 
Ruslan Dautkhanov

On Mon, Apr 30, 2018 at 4:04 PM, ankit jain  wrote:

> You can probably deploy Zeppelin on n machines and manage behind a
> LoadBalancer?
>
> Thanks
> Ankit
>
> On Mon, Apr 30, 2018 at 6:42 AM, Michael Segel 
> wrote:
>
>> Ok..
>> The answer is no.
>>
>> You have a web interface. It runs on a web server.  Does the web server
>> run in a cluster?
>>
>>
>> On Apr 30, 2018, at 12:24 AM, Soheil Pourbafrani 
>> wrote:
>>
>> Thanks, I meant the Zeppelin itself, not it's jobs.
>>
>> On Sun, Apr 29, 2018 at 11:51 PM, Michael Segel <
>> msegel_had...@hotmail.com> wrote:
>>
>>> Yes if you mean to run the spark jobs on a cluster.
>>>
>>>
>>> On Apr 29, 2018, at 7:25 AM, Soheil Pourbafrani 
>>> wrote:
>>>
>>> I mean to configure Zeppelin in multimode.
>>>
>>> On Sun, Apr 29, 2018 at 4:49 PM, Soheil Pourbafrani <
>>> soheil.i...@gmail.com> wrote:
>>>
 Something like Kafka or Hadoop cluster?

>>>
>>>
>>>
>>
>>
>
>
> --
> Thanks & Regards,
> Ankit.
>

Re: Is it possible to run Zeppelin on cluster

[ankit jain]

You can probably deploy Zeppelin on n machines and manage behind a
LoadBalancer?

Thanks
Ankit

On Mon, Apr 30, 2018 at 6:42 AM, Michael Segel 
wrote:

> Ok..
> The answer is no.
>
> You have a web interface. It runs on a web server.  Does the web server
> run in a cluster?
>
>
> On Apr 30, 2018, at 12:24 AM, Soheil Pourbafrani 
> wrote:
>
> Thanks, I meant the Zeppelin itself, not it's jobs.
>
> On Sun, Apr 29, 2018 at 11:51 PM, Michael Segel  > wrote:
>
>> Yes if you mean to run the spark jobs on a cluster.
>>
>>
>> On Apr 29, 2018, at 7:25 AM, Soheil Pourbafrani 
>> wrote:
>>
>> I mean to configure Zeppelin in multimode.
>>
>> On Sun, Apr 29, 2018 at 4:49 PM, Soheil Pourbafrani <
>> soheil.i...@gmail.com> wrote:
>>
>>> Something like Kafka or Hadoop cluster?
>>>
>>
>>
>>
>
>


-- 
Thanks & Regards,
Ankit.

Re: save data in a notebook to use in subsequent scripts

[Ruslan Dautkhanov]

Not sure if Spark-Cassandra connector would be helpful?

https://github.com/datastax/spark-cassandra-connector




-- 
Ruslan Dautkhanov

On Mon, Apr 30, 2018 at 7:38 AM, Soheil Pourbafrani 
wrote:

> Is it possible to save a Cassandra query result in a variable to use in
> subsequent scripts?
>

Re: zeppelin 0.8 tar file

[Felix Cheung]

0.8 is not released yet.


From: Soheil Pourbafrani 
Sent: Sunday, April 29, 2018 9:18:10 AM
To: users@zeppelin.apache.org
Subject: zeppelin 0.8 tar file

Is there any pre-compiled tar file of Zeppelin 0.8 to download?

Re: How to compile Zeppelin with just some desired interpreter

[Soheil Pourbafrani]

Greate man!

On Mon, Apr 30, 2018 at 8:16 PM, Ruslan Dautkhanov 
wrote:

> You could also add a list of interpreters that you'd like to exclude from
> the build:
>
> maven ... -pl '!cassandra,!bigquery,...'
>
>
>
> --
> Ruslan Dautkhanov
>
> On Mon, Apr 30, 2018 at 7:53 AM, Soheil Pourbafrani  > wrote:
>
>> -DskipTests is in the command?
>>
>> On Mon, Apr 30, 2018 at 6:17 PM, Jeff Zhang  wrote:
>>
>>>
>>> Add -DskipTests to disable test
>>>
>>>
>>> Soheil Pourbafrani 于2018年4月30日周一 下午9:11写道：
>>>
 I downlodaed source of Zeppelin 0.8.1 from github and using the command
 mvn clean package -Pspark-2.1 -Phadoop-2.7 -Pyarn -Ppyspark -Psparkr
 -Pscala-2.11 -DskipTests -Pbuild-distr

 but it errors:
 Failed to execute goal org.apache.maven.plugins:maven
 -compiler-plugin:3.1:testCompile (default-testCompile) on project
 zeppelin-bigquery: Compilation failure: Compilation failure:
 [ERROR] /home/Downloads/untitled folder/zeppelin-branch-0.8/big
 query/src/test/java/org/apache/zeppelin/bigquery/BigQueryInterpreterTest.java:[132,1]
 illegal start of type

 It's about big query
 is it possible to compile Zepplin including just Spark and Cassandra
 interpreter?

>>>
>>
>

Re: How to compile Zeppelin with just some desired interpreter

[Ruslan Dautkhanov]

You could also add a list of interpreters that you'd like to exclude from
the build:

maven ... -pl '!cassandra,!bigquery,...'



-- 
Ruslan Dautkhanov

On Mon, Apr 30, 2018 at 7:53 AM, Soheil Pourbafrani 
wrote:

> -DskipTests is in the command?
>
> On Mon, Apr 30, 2018 at 6:17 PM, Jeff Zhang  wrote:
>
>>
>> Add -DskipTests to disable test
>>
>>
>> Soheil Pourbafrani 于2018年4月30日周一 下午9:11写道：
>>
>>> I downlodaed source of Zeppelin 0.8.1 from github and using the command
>>> mvn clean package -Pspark-2.1 -Phadoop-2.7 -Pyarn -Ppyspark -Psparkr
>>> -Pscala-2.11 -DskipTests -Pbuild-distr
>>>
>>> but it errors:
>>> Failed to execute goal org.apache.maven.plugins:maven
>>> -compiler-plugin:3.1:testCompile (default-testCompile) on project
>>> zeppelin-bigquery: Compilation failure: Compilation failure:
>>> [ERROR] /home/Downloads/untitled folder/zeppelin-branch-0.8/big
>>> query/src/test/java/org/apache/zeppelin/bigquery/BigQueryInterpreterTest.java:[132,1]
>>> illegal start of type
>>>
>>> It's about big query
>>> is it possible to compile Zepplin including just Spark and Cassandra
>>> interpreter?
>>>
>>
>

Re: How to compile Zeppelin with just some desired interpreter

[Soheil Pourbafrani]

-DskipTests is in the command?

On Mon, Apr 30, 2018 at 6:17 PM, Jeff Zhang  wrote:

>
> Add -DskipTests to disable test
>
>
> Soheil Pourbafrani 于2018年4月30日周一 下午9:11写道：
>
>> I downlodaed source of Zeppelin 0.8.1 from github and using the command
>> mvn clean package -Pspark-2.1 -Phadoop-2.7 -Pyarn -Ppyspark -Psparkr
>> -Pscala-2.11 -DskipTests -Pbuild-distr
>>
>> but it errors:
>> Failed to execute goal org.apache.maven.plugins:
>> maven-compiler-plugin:3.1:testCompile (default-testCompile) on project
>> zeppelin-bigquery: Compilation failure: Compilation failure:
>> [ERROR] /home/Downloads/untitled folder/zeppelin-branch-0.8/
>> bigquery/src/test/java/org/apache/zeppelin/bigquery/
>> BigQueryInterpreterTest.java:[132,1] illegal start of type
>>
>> It's about big query
>> is it possible to compile Zepplin including just Spark and Cassandra
>> interpreter?
>>
>

Re: How to compile Zeppelin with just some desired interpreter

[Jeff Zhang]

Add -DskipTests to disable test


Soheil Pourbafrani 于2018年4月30日周一 下午9:11写道：

> I downlodaed source of Zeppelin 0.8.1 from github and using the command
> mvn clean package -Pspark-2.1 -Phadoop-2.7 -Pyarn -Ppyspark -Psparkr
> -Pscala-2.11 -DskipTests -Pbuild-distr
>
> but it errors:
> Failed to execute goal
> org.apache.maven.plugins:maven-compiler-plugin:3.1:testCompile
> (default-testCompile) on project zeppelin-bigquery: Compilation failure:
> Compilation failure:
> [ERROR] /home/Downloads/untitled
> folder/zeppelin-branch-0.8/bigquery/src/test/java/org/apache/zeppelin/bigquery/BigQueryInterpreterTest.java:[132,1]
> illegal start of type
>
> It's about big query
> is it possible to compile Zepplin including just Spark and Cassandra
> interpreter?
>

Re: Is it possible to run Zeppelin on cluster

[Michael Segel]

Ok..
The answer is no.

You have a web interface. It runs on a web server.  Does the web server run in 
a cluster?

On Apr 30, 2018, at 12:24 AM, Soheil Pourbafrani 
mailto:soheil.i...@gmail.com>> wrote:

Thanks, I meant the Zeppelin itself, not it's jobs.

On Sun, Apr 29, 2018 at 11:51 PM, Michael Segel 
mailto:msegel_had...@hotmail.com>> wrote:
Yes if you mean to run the spark jobs on a cluster.


On Apr 29, 2018, at 7:25 AM, Soheil Pourbafrani 
mailto:soheil.i...@gmail.com>> wrote:

I mean to configure Zeppelin in multimode.

On Sun, Apr 29, 2018 at 4:49 PM, Soheil Pourbafrani 
mailto:soheil.i...@gmail.com>> wrote:
Something like Kafka or Hadoop cluster?

save data in a notebook to use in subsequent scripts

[Soheil Pourbafrani]

Is it possible to save a Cassandra query result in a variable to use in
subsequent scripts?

How to compile Zeppelin with just some desired interpreter

[Soheil Pourbafrani]

I downlodaed source of Zeppelin 0.8.1 from github and using the command
mvn clean package -Pspark-2.1 -Phadoop-2.7 -Pyarn -Ppyspark -Psparkr
-Pscala-2.11 -DskipTests -Pbuild-distr

but it errors:
Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:3.1:testCompile
(default-testCompile) on project zeppelin-bigquery: Compilation failure:
Compilation failure:
[ERROR] /home/Downloads/untitled
folder/zeppelin-branch-0.8/bigquery/src/test/java/org/apache/zeppelin/bigquery/BigQueryInterpreterTest.java:[132,1]
illegal start of type

It's about big query
is it possible to compile Zepplin including just Spark and Cassandra
interpreter?

Re: Scheduler in Zeppelin 0.9

[Soheil Pourbafrani]

Greate!

On Mon, Apr 30, 2018 at 5:18 PM, Jeff Zhang  wrote:

>
> It is not removed, but disabled by default.
> You can enable it via setting zeppelin.notebook.cron.enable to true in
> zeppelin-site.xml
>
>
>
> Soheil Pourbafrani 于2018年4月30日周一 下午7:42写道：
>
>> I used to use Zeppelin 0.7.3 scheduler at top of each note, but in
>> Zeppelin 0.9 Snapshot the scheduler is removed! How can I schedule notes in
>> Zeppelin 0.9?
>>
>

Re: Scheduler in Zeppelin 0.9

[Jeff Zhang]

It is not removed, but disabled by default.
You can enable it via setting zeppelin.notebook.cron.enable to true in
zeppelin-site.xml



Soheil Pourbafrani 于2018年4月30日周一 下午7:42写道：

> I used to use Zeppelin 0.7.3 scheduler at top of each note, but in
> Zeppelin 0.9 Snapshot the scheduler is removed! How can I schedule notes in
> Zeppelin 0.9?
>

Scheduler in Zeppelin 0.9

[Soheil Pourbafrani]

I used to use Zeppelin 0.7.3 scheduler at top of each note, but in Zeppelin
0.9 Snapshot the scheduler is removed! How can I schedule notes in Zeppelin
0.9?

Re: Zeppelin 0.8

[Rotem Herzberg]

Thanks

On Mon, Apr 30, 2018 at 11:16 AM, Jeff Zhang  wrote:

>
> I am preparing the RC for 0.8
>
>
> Rotem Herzberg 于2018年4月30日周一 下午3:57写道：
>
>> Hi,
>>
>> What is the release date for Zeppelin 0.8? (support for spark 2.3)
>>
>> Thanks,
>>
>> --
>> 
>> *Rotem Herzberg*
>> SW Engineer | GigaSpaces Technologies
>>
>> rotem.herzb...@gigaspaces.com   | M +972547718880
>>
>>   
>> 
>> 
>>
>


-- 

*Rotem Herzberg*
SW Engineer | GigaSpaces Technologies

rotem.herzb...@gigaspaces.com   | M +972547718880

  

Re: Zeppelin 0.8

[Jeff Zhang]

I am preparing the RC for 0.8


Rotem Herzberg 于2018年4月30日周一 下午3:57写道：

> Hi,
>
> What is the release date for Zeppelin 0.8? (support for spark 2.3)
>
> Thanks,
>
> --
> 
> *Rotem Herzberg*
> SW Engineer | GigaSpaces Technologies
>
> rotem.herzb...@gigaspaces.com   | M +972547718880
>
>   
> 
> 
>

Zeppelin 0.8

[Rotem Herzberg]

Hi,

What is the release date for Zeppelin 0.8? (support for spark 2.3)

Thanks,

-- 

*Rotem Herzberg*
SW Engineer | GigaSpaces Technologies

rotem.herzb...@gigaspaces.com   | M +972547718880

  

Re: Compile Zepplin source and get output like tar file structure

[Soheil Pourbafrani]

Thanks

On Mon, Apr 30, 2018 at 12:01 PM, Jeff Zhang  wrote:

>
> Add this to your maven build command:
>
> -Pbuild-distr
>
> Soheil Pourbafrani 于2018年4月30日周一 下午3:26写道：
>
>> Thanks, How should I enable build-distr ?
>>
>> On Mon, Apr 30, 2018 at 11:32 AM, Jeff Zhang  wrote:
>>
>>>
>>> What do you mean the outputs are messy ? If you want to build binary
>>> distribution, please enable profile  build-distr ?
>>>
>>>
>>> Soheil Pourbafrani 于2018年4月30日周一 下午2:24写道：
>>>
 Using the command
 mvn clean package -DskipTests -Pspark-2.0 -Phadoop-2.4 -Pr -Pscala-2.11

 I compiled Zeppelin source but the outputs are messy and unstructured.
 How can I compile it to get output like Zeppelin binary tar file structure?

>>>
>>

Re: Compile Zepplin source and get output like tar file structure

[Jeff Zhang]

Add this to your maven build command:

-Pbuild-distr

Soheil Pourbafrani 于2018年4月30日周一 下午3:26写道：

> Thanks, How should I enable build-distr ?
>
> On Mon, Apr 30, 2018 at 11:32 AM, Jeff Zhang  wrote:
>
>>
>> What do you mean the outputs are messy ? If you want to build binary
>> distribution, please enable profile  build-distr ?
>>
>>
>> Soheil Pourbafrani 于2018年4月30日周一 下午2:24写道：
>>
>>> Using the command
>>> mvn clean package -DskipTests -Pspark-2.0 -Phadoop-2.4 -Pr -Pscala-2.11
>>>
>>> I compiled Zeppelin source but the outputs are messy and unstructured.
>>> How can I compile it to get output like Zeppelin binary tar file structure?
>>>
>>
>

Re: Compile Zepplin source and get output like tar file structure

[Soheil Pourbafrani]

Thanks, How should I enable build-distr ?

On Mon, Apr 30, 2018 at 11:32 AM, Jeff Zhang  wrote:

>
> What do you mean the outputs are messy ? If you want to build binary
> distribution, please enable profile  build-distr ?
>
>
> Soheil Pourbafrani 于2018年4月30日周一 下午2:24写道：
>
>> Using the command
>> mvn clean package -DskipTests -Pspark-2.0 -Phadoop-2.4 -Pr -Pscala-2.11
>>
>> I compiled Zeppelin source but the outputs are messy and unstructured.
>> How can I compile it to get output like Zeppelin binary tar file structure?
>>
>

Re: Compile Zepplin source and get output like tar file structure

[Jeff Zhang]

What do you mean the outputs are messy ? If you want to build binary
distribution, please enable profile  build-distr ?


Soheil Pourbafrani 于2018年4月30日周一 下午2:24写道：

> Using the command
> mvn clean package -DskipTests -Pspark-2.0 -Phadoop-2.4 -Pr -Pscala-2.11
>
> I compiled Zeppelin source but the outputs are messy and unstructured. How
> can I compile it to get output like Zeppelin binary tar file structure?
>