R and Authenticatio

2016-04-29 Thread Sourav Mazumder

Re: [DISCUSS] Update Roadmap

2016-02-29 Thread Sourav Mazumder
gt;> of scala compiler. That's why user can not run multiple paragraph >>>> concurrently when they work with SparkInterpreter. >>>> But as Zhong Wang mentioned, pr-703 enables each notebook will have >>>> separate scala compiler so paragraphs run concurrently, whil

Re: [DISCUSS] Update Roadmap

2016-02-27 Thread Sourav Mazumder
Hi Moon, This looks great. My only suggestion would be to include a PR/feature - Support for Running Concurrent paragraphs/queries in Zeppelin. Right now if more than one user tries to run paragraphs in multiple notebooks concurrently through a single Zeppelin instance (and single interpreter

Re: Error while querying Df temp Tweet table

2016-02-24 Thread Sourav Mazumder
Do u get the same error even in case you use SPARK_SUBMIT_OPTIONS to specify the jar file for the twitter instead of %dep ? Regards, Sourav On Wed, Feb 24, 2016 at 9:20 PM, Vinayak Agrawal wrote: > Hi All, > I am trying to run Zeppelin Streaming example from

Re: Error while Running the Spark Streaming example from Tutorial

2016-02-24 Thread Sourav Mazumder
Adding the jar to SPARK_SUBMIT_OPTIONS is one approach. But you can try out %dep also. Regards, Sourav On Wed, Feb 24, 2016 at 1:54 PM, Felipe Almeida wrote: > There's z.load("maven-package") but I myself have had no luck with it (I > get weird errors). > > I generally

Multiple queries to single Spark interpreter

2016-02-10 Thread Sourav Mazumder
Hi, I'm sending multiple queries/tasks to a single Zeppelin instance from different browsers through various notebooks. Now I understand all the queries/tasks will share the same Spark Interpreter process. In that case will the Spark Interpreter process will process those queries sequentially or

Re: R interpreters

2015-12-24 Thread Sourav Mazumder
In my experience parameter passing between R, scala, Spark SQL SparkR worked great in rZeppelin. I could successfully build a model using SparkR's GLM algorithm, done a prediction using the model, then I could create a SparkR datafarme from the predicted dataset. Then used the same to visualize

Re: Zeppelin UI appears blank after successful build

2015-12-20 Thread Sourav Mazumder
/, > did not find org.apache.jasper.servlet.JspServlet > INFO [2015-12-19 11:14:45,154] ({main} > AbstractConnector.java[doStart]:338) - Started > SelectChannelConnector@0.0.0.0:9191 > INFO [2015-12-19 11:14:45,155] ({main} ZeppelinServer.java[main]:108) - > Started zeppelin server > &

Re: Zeppelin UI appears blank after successful build

2015-12-19 Thread Sourav Mazumder
Sometimes u can see this error if the port Zeppelin started with is already used. Zeppelin by default starts at 8080. But that port may be already in use. So you need to change the port in zeppelin-site.xml and restart. Regards, Sourav > On Dec 19, 2015, at 11:00 AM, Girish Reddy

Re: Question & Suggestions

2015-12-17 Thread Sourav Mazumder
Hi Darren, Another way to achieve the #3 is - 1. Writing an interpreter which is bundled with the REST client library. 2. The interpreter can call any REST service runnning in any remote machine using the sa me. May be you can create it as a generic Rest intepreter which can be used by anyone

Multi tenancy support

2015-12-16 Thread Sourav Mazumder
Hi, I understand there is some work going on to provide multi-tenancy support in Zepplin. Can anyone point me to the PR for the same or any other relevant info ? Regards, Sourav

Re: Zeppelin+spark+R+hive

2015-12-15 Thread Sourav Mazumder
I believe that is not going to solve the problem. If you need to run spark on Yarn (assuming that it is your requirement) ensure that you run it in Yarn Client mode. Yarn Clustre mode is not supported with Zeppelin yet. Regards, Sourav On Tue, Dec 15, 2015 at 9:32 AM, Felix Cheung

Re: Interpreters for Unix editors in Zeppelin

2015-12-14 Thread Sourav Mazumder
n Mon, Dec 14, 2015 at 8:57 AM -0800, "Sourav Mazumder" < > sourav.mazumde...@gmail.com> wrote: > > Hi, > > Is there any work going on for supporting Unix Editors like VI, Emacs, > Textmate in Zeppelin ? > > I believe Jupyter supports few of them. > > Regards, > Sourav >

Cannot use arbitrary external jar files in spark_submit through Zeppelin - should be fixed

2015-10-20 Thread Sourav Mazumder
Looks like right now there is no way one can pass additional jar files to spark_submit from Zeppelin.The same works fine if I am not using spark_submit option (by not specifying spark_home). When I checked the code interpreter.sh I found that for the class path it only passes the

Is Spark 1.5.1 not supported by Zeppelin if I set the same as SPARK_HOME ?

2015-10-15 Thread Sourav Mazumder
I have an existing zeppelin build (which I built using spark 1.4). I want to try it now with Spark 1.5.1. According to the github documentataion ( https://github.com/apache/incubator-zeppelin) - "If you want to use system provided Spark and Hadoop, export SPARK_HOME and HADOOP_HOME in

Re: Zeppelin fails to submit Spark job in Yarn Cluster mode - a Bug ?

2015-10-11 Thread Sourav Mazumder
t your error shows that "please use spark-submit". > > Thanks, > moon > On 2015년 10월 8일 (목) at 오후 9:14 Sourav Mazumder < > sourav.mazumde...@gmail.com> wrote: > >> Hi Deepak/Moon, >> >> After seeing the stack trace of the error and the code >> org

Re: Zeppelin fails to submit Spark job in Yarn Cluster mode - a Bug ?

2015-10-11 Thread Sourav Mazumder
of the question. Yarn-cluster > mode. Zeppelin is not expected to work with yarn-cluster mode at the moment. > > Is there any special reason you need to use yarn-cluster mode instead of > yarn-client mode? > > Thanks, > moon > >> On 2015년 10월 11일 (일) at 오후 8:41 Sou

Re: Running Zeppelin remotely to submit Spark job in Yarn Cluster mode

2015-10-05 Thread Sourav Mazumder
HADOOP_CONF_DIR=/etc/hadoop/conf > > Most likely you have this as your able to run with yarn-client. > > > Looks like the issue is to not be able to run the driver program on > cluster. > > On Mon, Oct 5, 2015 at 11:13 AM, Sourav Mazumder < > sourav.mazumde...@gmail.com&

Re: Running Zeppelin remotely to submit Spark job in Yarn Cluster mode

2015-10-05 Thread Sourav Mazumder
you using? > > Master branch uses spark-submit command, when SPARK_HOME is defined in > conf/zeppelin-env.sh > > If you're not on master branch, recommend try it with SPARK_HOME defined. > > Hope this helps, > moon > > On Wed, Sep 23, 2015 at 10:21 PM Sourav Mazumder < >

Re: Zeppelin integration with Apache Lens -- Strata NY

2015-09-30 Thread Sourav Mazumder
What time and venue ? Regards, Sourav > On Sep 29, 2015, at 3:56 PM, Pranav Kumar Agarwal wrote: > > Hi All, > > Tomorrow I'll be at Strata conference, New York, showcasing on how we at > Flipkart.com use Apache Zeppelin for data exploration using Apache Spark and >

Running Zeppelin remotely to submit Spark job in Yarn Cluster mode

2015-09-23 Thread Sourav Mazumder
Hi, When I try to run Spark Interpreter in Yarn Cluster mode from a remote machine I always get the error saying try spark-submit than using spark context. Mu Zeppelin process runs in a separate machine remote to the YARN cluster. Any idea why is this error ? Regards, Sourav

Zeppelin for Windows

2015-09-17 Thread Sourav Mazumder
Hi, Is there any plan to have a version ready for Windows so that people running standalone spark on Windows can use the same ? Regards, Sourav

Re: Zeppelin for Windows

2015-09-17 Thread Sourav Mazumder
. 28 more Not sure whether this source code level problem will get solved or not if I created a build using cygwin. Regards, Sourav On Thu, Sep 17, 2015 at 9:40 PM, madhuka udantha <madhukaudan...@gmail.com> wrote: > Hi, Sourav > > On Fri, Sep 18, 2015 at 9:04 AM, Sourav Mazumder <

Running Spark with Yarn from Zeppelin giving error - Can't get RemoteInterpreterEvent

2015-09-16 Thread Sourav Mazumder
Hi, I am trying to run Zeppelin with Spark On Yarn. Looks like (from the logs) the processing goes fine. But when it is trying to return back teh result it is not able to find the RemoteInterpreterEvent. The error in the log file shows - Can't get RemoteInterpreterEvent

Re: Few Qs on Zeppelin

2015-09-09 Thread Sourav Mazumder
e it in action in the video on the Zeppelin >> website >> >> Regards, >> Leonardo >> >> On Tue, Sep 8, 2015 at 7:09 PM, Sourav Mazumder < >> sourav.mazumde...@gmail.com> wrote: >> >>> Hi, >>> >>> Wanted to get some ide