Re: Help with loading a CSV using Spark-SQL & Spark-CSV

2015-10-06 Thread Felix Cheung
Do you have the %spark line in the middle of a notebook "box"? It should be only at the beginning of a paragraph. On Tue, Oct 6, 2015 at 6:42 AM -0700, "Alexander Bezzubov" wrote: Hi, it's really hard to say more without looking into the logs of Zeppelin Server and Spark interpreter in yo

Re: Help with loading a CSV using Spark-SQL & Spark-CSV

2015-10-06 Thread Alexander Bezzubov
Hi, it's really hard to say more without looking into the logs of Zeppelin Server and Spark interpreter in your case. They way you do it seems to be right and I had no problems before, using it exactly the same way to read csv, except that I never used %spark explicitly but always made sure that

Re: Help with loading a CSV using Spark-SQL & Spark-CSV

2015-09-30 Thread Ryan
Any updates on this? Or perhaps tutorials that successfully integrate spark-csv into Zeppelin? If I can rule out the code as the problem I can start looking into the install to see what's going wrong. Thanks, Ryan On Tue, Sep 29, 2015 at 9:09 AM, Ryan wrote: > Hi Alex, > > Thank you for getting

Re: Help with loading a CSV using Spark-SQL & Spark-CSV

2015-09-29 Thread Ryan
Hi Alex, Thank you for getting back to me! The tutorial code was a bit confusing and made it seem like sqlContext was the proper variable to use: // Zeppelin creates and injects sc (SparkContext) and sqlContext (HiveContext or SqlContext) I tried as you mentioned, but am still getting similar er

Re: Help with loading a CSV using Spark-SQL & Spark-CSV

2015-09-28 Thread Alexander Bezzubov
Hi, thank you for your interested in Zeppelin! Couple of things I noticed: as you probably already know , %dep and %spark parts should always be in separate paragraphs. %spark already exposes sql context though `sqlc` variable, so you better use sqlc.load("...") instead. And of course to be abl

Help with loading a CSV using Spark-SQL & Spark-CSV

2015-09-28 Thread Ryan
Hi, In a Zeppelin notebook, I am trying to load a csv using the spark-csv package by databricks. I am using the Hortonworks sandbox to run Zeppelin on. Unfortunately, the methods I have been trying have not been working. My latest attempt is: %dep z.load("com.databricks:spark-csv_2.10:1.2.0") %sp