RE: Yarn + Spark + Zepplin ?

Hi Deepak, I have documented everything here. Please check published document. https://software.intel.com/sites/default/files/managed/bb/bf/Apache-Zeppelin.pdf Thanks Karthik Vadla From: ÐΞ€ρ@Ҝ (๏̯͡๏) [mailto:deepuj...@gmail.com] Sent: Sunday, August 2, 2015 9:25 PM To:

Documented and Published- Install zeppelin on CDH

Hi All, Recently we have published a document on how to build zeppelin binaries with different profiles(pyspark , yarn) and setup zeppelin on CDH. Please check the document. https://software.intel.com/sites/default/files/managed/bb/bf/Apache-Zeppelin.pdf or Same our document re-published by

Re: Table not found (python to sql)‏

I think you would need to create a dataframe from this RDD with schema and then register as temp table to use with %sql. Sent from my iPhone, plaese excuse any typos :) On Aug 3, 2015, at 7:19 PM, Braden Callahan1 brad...@us.ibm.com wrote: I have an issue where I create a table in Python

Re: Add jar file for spark interpreter use

I am using Spark in standalone mode. I am not using YARN. Thanks. On Mon, Aug 3, 2015 at 2:43 PM, ÐΞ€ρ@Ҝ (๏̯͡๏) deepuj...@gmail.com wrote: How about setting spark.yarn.jar from Spark interpreter from UI spark.yarn.jar a.jar:b.jar:c.jar On Mon, Aug 3, 2015 at 2:38 PM, Ming Han Teh

Table not found (python to sql)‏

I have an issue where I create a table in Python (pyspark) and the sql interpreter does not see the table. If I create it using scala both python and sql pick it up without an issue. Example: %pyspark sqlContext = SQLContext(sc) tweet = sqlContext.read.json(/temp/twitter_data_small/)

Zeppelin examples

Could some one share list of comprehensive examples to test out various charts features of Zeppelin with sample datasets that i can download along with queries. (I have spark + yarn + zeppelin, hence those examples are preferred) -- Deepak

Re: Add jar file for spark interpreter use

How about setting spark.yarn.jar from Spark interpreter from UI spark.yarn.jar a.jar:b.jar:c.jar On Mon, Aug 3, 2015 at 2:38 PM, Ming Han Teh tehming...@gmail.com wrote: Hi, I am trying to add a jar file which contains a UDF to be used in the zeppelin spark interpreter. Is there a

Re: Unsubscribe

YOU SHALL NOT PASS! On Aug 3, 2015 1:23 PM, Aries Kay ariesk1...@gmail.com wrote: On Mon, Aug 3, 2015 at 1:00 PM, ÐΞ€ρ@Ҝ (๏̯͡๏) deepuj...@gmail.com wrote: Thanks a lot for all these documents. Appreciate your effort time. On Mon, Aug 3, 2015 at 10:15 AM, Christian Tzolov

Re: Yarn + Spark + Zepplin ?

Hi, inside %spark you do not need to create SqlContext manually: as with sc for SparkContext, Interpreter already have injected sqlc val. Also AFAIK println statement should be in the separate paragraph. Can you try using that and see if it helps? -- Kind regards, Alexander On 04 Aug 2015,

Add jar file for spark interpreter use

Hi, I am trying to add a jar file which contains a UDF to be used in the zeppelin spark interpreter. Is there a difference between the below two approaches: *Approach 1)* %dep z.load(somefile) *Approach 2)* sc.addJar(somejar) The first approach appears to load the jar file, but %sql fails

Re: Yarn + Spark + Zepplin ?

ÐΞ€ρ@Ҝ (๏̯͡๏), I've successfully run Zeppelin with Spark on YARN. I'm using Ambari and PivotalHD30. PHD30 is ODP compliant so you should be able to repeat the configuration for HDP (e.g. hortonworks). 1. Before you start with Zeppelin, make sure that your Spark/YARN env. works from the command

Re: [ANNOUNCE] Apache Zeppelin 0.5.0-incubating released

Congratulations on achieving this milestone and good luck for many more to achieve in near future! Best, Dhaval Sent from my iPhone, plaese excuse any typos :) On Aug 3, 2015, at 1:29 AM, Rajat Gupta rajat.iit...@gmail.com wrote: congrats guys On Mon, Aug 3, 2015 at 9:41 AM, Luke

Re: Yarn + Spark + Zepplin ?

Hi Deepak, Hortonworks has its own howto post here: http://hortonworks.com/blog/introduction-to-data-science-with-apache-spark/ Hope it helps. Thanks, -Randy From: ÐΞ€ρ@Ҝ (๏̯͡๏) Reply-To: users@zeppelin.incubator.apache.orgmailto:users@zeppelin.incubator.apache.org Date: Monday, August 3,

Re: Yarn + Spark + Zepplin ?

Fixed it mvn clean package -Pspark-1.3 -Dspark.version=1.3.1 -Dhadoop.version=2.7.0 -Phadoop-2.6 -Pyarn -DskipTests Earlier i had mvn clean install -DskipTests -Pspark-1.3 -Dspark.version=1.3.1 -Phadoop-2.7 -Pyarn On Mon, Aug 3, 2015 at 1:31 PM, ÐΞ€ρ@Ҝ (๏̯͡๏) deepuj...@gmail.com wrote: I

Re: Yarn + Spark + Zepplin ?

I have hadoop cluster up using Ambari. It also allowed me to install Spark 1.3.1 and i can run sample spark application Yarn application. So cluster is up and running fine. I got Zeppelin setup on a new box and was able to launch UI. I modified spark interpreter to set

Unsubscribe

On Mon, Aug 3, 2015 at 1:00 PM, ÐΞ€ρ@Ҝ (๏̯͡๏) deepuj...@gmail.com wrote: Thanks a lot for all these documents. Appreciate your effort time. On Mon, Aug 3, 2015 at 10:15 AM, Christian Tzolov ctzo...@pivotal.io wrote: ÐΞ€ρ@Ҝ (๏̯͡๏), I've successfully run Zeppelin with Spark on YARN. I'm