Re: Is it possible to run Zeppelin on cluster
Yeah, but each instance is separate. I don’t think that’s what OP meant since he referenced Hadoop. As others point out the Notebook dir has to be accessible to all instances. On Apr 30, 2018, at 5:04 PM, ankit jain mailto:ankitjain@gmail.com>> wrote: You can probably deploy Zeppelin on n machines and manage behind a LoadBalancer? Thanks Ankit On Mon, Apr 30, 2018 at 6:42 AM, Michael Segel mailto:msegel_had...@hotmail.com>> wrote: Ok.. The answer is no. You have a web interface. It runs on a web server. Does the web server run in a cluster? On Apr 30, 2018, at 12:24 AM, Soheil Pourbafrani mailto:soheil.i...@gmail.com>> wrote: Thanks, I meant the Zeppelin itself, not it's jobs. On Sun, Apr 29, 2018 at 11:51 PM, Michael Segel mailto:msegel_had...@hotmail.com>> wrote: Yes if you mean to run the spark jobs on a cluster. On Apr 29, 2018, at 7:25 AM, Soheil Pourbafrani mailto:soheil.i...@gmail.com>> wrote: I mean to configure Zeppelin in multimode. On Sun, Apr 29, 2018 at 4:49 PM, Soheil Pourbafrani mailto:soheil.i...@gmail.com>> wrote: Something like Kafka or Hadoop cluster? -- Thanks & Regards, Ankit.
Re: Is it possible to run Zeppelin on cluster
Yeah LB will need to make sure requests for a notebook always go to same machine - then it will be like a single machine deployment, multiple users using the notebook at same time. On Mon, Apr 30, 2018 at 3:19 PM, Ruslan Dautkhanov wrote: > It probably would work for an active-passive Zeppelin cluster if all files > are in a shared NFS directory for example, not as active-active. > One simple example - they would keep overwriting configuration files / > notebook files etc. > > > > -- > Ruslan Dautkhanov > > On Mon, Apr 30, 2018 at 4:04 PM, ankit jain > wrote: > >> You can probably deploy Zeppelin on n machines and manage behind a >> LoadBalancer? >> >> Thanks >> Ankit >> >> On Mon, Apr 30, 2018 at 6:42 AM, Michael Segel > > wrote: >> >>> Ok.. >>> The answer is no. >>> >>> You have a web interface. It runs on a web server. Does the web server >>> run in a cluster? >>> >>> >>> On Apr 30, 2018, at 12:24 AM, Soheil Pourbafrani >>> wrote: >>> >>> Thanks, I meant the Zeppelin itself, not it's jobs. >>> >>> On Sun, Apr 29, 2018 at 11:51 PM, Michael Segel < >>> msegel_had...@hotmail.com> wrote: >>> Yes if you mean to run the spark jobs on a cluster. On Apr 29, 2018, at 7:25 AM, Soheil Pourbafrani wrote: I mean to configure Zeppelin in multimode. On Sun, Apr 29, 2018 at 4:49 PM, Soheil Pourbafrani < soheil.i...@gmail.com> wrote: > Something like Kafka or Hadoop cluster? > >>> >>> >> >> >> -- >> Thanks & Regards, >> Ankit. >> > > -- Thanks & Regards, Ankit.
Re: Is it possible to run Zeppelin on cluster
It probably would work for an active-passive Zeppelin cluster if all files are in a shared NFS directory for example, not as active-active. One simple example - they would keep overwriting configuration files / notebook files etc. -- Ruslan Dautkhanov On Mon, Apr 30, 2018 at 4:04 PM, ankit jain wrote: > You can probably deploy Zeppelin on n machines and manage behind a > LoadBalancer? > > Thanks > Ankit > > On Mon, Apr 30, 2018 at 6:42 AM, Michael Segel > wrote: > >> Ok.. >> The answer is no. >> >> You have a web interface. It runs on a web server. Does the web server >> run in a cluster? >> >> >> On Apr 30, 2018, at 12:24 AM, Soheil Pourbafrani >> wrote: >> >> Thanks, I meant the Zeppelin itself, not it's jobs. >> >> On Sun, Apr 29, 2018 at 11:51 PM, Michael Segel < >> msegel_had...@hotmail.com> wrote: >> >>> Yes if you mean to run the spark jobs on a cluster. >>> >>> >>> On Apr 29, 2018, at 7:25 AM, Soheil Pourbafrani >>> wrote: >>> >>> I mean to configure Zeppelin in multimode. >>> >>> On Sun, Apr 29, 2018 at 4:49 PM, Soheil Pourbafrani < >>> soheil.i...@gmail.com> wrote: >>> Something like Kafka or Hadoop cluster? >>> >>> >>> >> >> > > > -- > Thanks & Regards, > Ankit. >
Re: Is it possible to run Zeppelin on cluster
You can probably deploy Zeppelin on n machines and manage behind a LoadBalancer? Thanks Ankit On Mon, Apr 30, 2018 at 6:42 AM, Michael Segel wrote: > Ok.. > The answer is no. > > You have a web interface. It runs on a web server. Does the web server > run in a cluster? > > > On Apr 30, 2018, at 12:24 AM, Soheil Pourbafrani > wrote: > > Thanks, I meant the Zeppelin itself, not it's jobs. > > On Sun, Apr 29, 2018 at 11:51 PM, Michael Segel > wrote: > >> Yes if you mean to run the spark jobs on a cluster. >> >> >> On Apr 29, 2018, at 7:25 AM, Soheil Pourbafrani >> wrote: >> >> I mean to configure Zeppelin in multimode. >> >> On Sun, Apr 29, 2018 at 4:49 PM, Soheil Pourbafrani < >> soheil.i...@gmail.com> wrote: >> >>> Something like Kafka or Hadoop cluster? >>> >> >> >> > > -- Thanks & Regards, Ankit.
Re: Is it possible to run Zeppelin on cluster
Ok.. The answer is no. You have a web interface. It runs on a web server. Does the web server run in a cluster? On Apr 30, 2018, at 12:24 AM, Soheil Pourbafrani mailto:soheil.i...@gmail.com>> wrote: Thanks, I meant the Zeppelin itself, not it's jobs. On Sun, Apr 29, 2018 at 11:51 PM, Michael Segel mailto:msegel_had...@hotmail.com>> wrote: Yes if you mean to run the spark jobs on a cluster. On Apr 29, 2018, at 7:25 AM, Soheil Pourbafrani mailto:soheil.i...@gmail.com>> wrote: I mean to configure Zeppelin in multimode. On Sun, Apr 29, 2018 at 4:49 PM, Soheil Pourbafrani mailto:soheil.i...@gmail.com>> wrote: Something like Kafka or Hadoop cluster?
Re: Is it possible to run Zeppelin on cluster
Thanks, I meant the Zeppelin itself, not it's jobs. On Sun, Apr 29, 2018 at 11:51 PM, Michael Segel wrote: > Yes if you mean to run the spark jobs on a cluster. > > > On Apr 29, 2018, at 7:25 AM, Soheil Pourbafrani > wrote: > > I mean to configure Zeppelin in multimode. > > On Sun, Apr 29, 2018 at 4:49 PM, Soheil Pourbafrani > wrote: > >> Something like Kafka or Hadoop cluster? >> > > >
Re: Is it possible to run Zeppelin on cluster
Yes if you mean to run the spark jobs on a cluster. On Apr 29, 2018, at 7:25 AM, Soheil Pourbafrani mailto:soheil.i...@gmail.com>> wrote: I mean to configure Zeppelin in multimode. On Sun, Apr 29, 2018 at 4:49 PM, Soheil Pourbafrani mailto:soheil.i...@gmail.com>> wrote: Something like Kafka or Hadoop cluster?
Re: Is it possible to run Zeppelin on cluster
I mean to configure Zeppelin in multimode. On Sun, Apr 29, 2018 at 4:49 PM, Soheil Pourbafrani wrote: > Something like Kafka or Hadoop cluster? >
