Re: Problems with reading data from parquet files in a HDFS remotely

2016-01-08 Thread Henrik Baastrup
I use the wrong port in the hdfs:// URI above? Henrik On 07/01/2016 19:41, Ewan Leith wrote: > > Try the path > > > "hdfs:///user/hdfs/parquet-multi/BICC" > Thanks, > Ewan > > > -- Original message-- > > *From: *Henrik Baastrup > &g

Re: Problems with reading data from parquet files in a HDFS remotely

2016-01-08 Thread Henrik Baastrup
calling='6287870642893' AND p_endtime=14494224"); filtered.show(); Henrik On 07/01/2016 19:41, Ewan Leith wrote: > > Try the path > > > "hdfs:///user/hdfs/parquet-multi/BICC" > Thanks, > Ewan > > > -- Original message-- > > *F

Problems with reading data from parquet files in a HDFS remotely

2016-01-07 Thread Henrik Baastrup
Hi All, I have a small Hadoop cluster where I have stored a lot of data in parquet files. I have installed a Spark master service on one of the nodes and now would like to query my parquet files from a Spark client. When I run the following program from the spark-shell on the Spark Master node