Re: Problem while loading saved data

2015-09-04 Thread Amila De Silva
12 > > *To: *Ewan Leith; > > *Cc: *user@spark.apache.org; > > *Subject:*Re: Problem while loading saved data > > > Hi Ewan, > > Yes, 'people.parquet' is from the first attempt and in that attempt it > tried to save the same people.json. > > It seems that the sam

Re: Problem while loading saved data

2015-09-03 Thread Ewan Leith
c: user@spark.apache.org<mailto:user@spark.apache.org> Subject: Re: Problem while loading saved data Hi Guru, Thanks for the reply. Yes, I checked if the file exists. But instead of a single file what I found was a directory having the following structure. people.parquet └── _temporary └── 0

RE: Problem while loading saved data

2015-09-03 Thread Ewan Leith
normally be created when the write completes, can you show us your write output? Thanks, Ewan From: Amila De Silva [mailto:jaa...@gmail.com] Sent: 03 September 2015 05:44 To: Guru Medasani <gdm...@gmail.com> Cc: user@spark.apache.org Subject: Re: Problem while loading saved data H

Re: Problem while loading saved data

2015-09-02 Thread Guru Medasani
Hi Amila, Error says that the ‘people.parquet’ file does not exist. Can you manually check to see if that file exists? > Py4JJavaError: An error occurred while calling o53840.parquet. > : java.lang.AssertionError: assertion failed: No schema defined, and no > Parquet data file or summary file

Re: Problem while loading saved data

2015-09-02 Thread Amila De Silva
Hi Guru, Thanks for the reply. Yes, I checked if the file exists. But instead of a single file what I found was a directory having the following structure. people.parquet └── _temporary └── 0 ├── task_201509030057_4699_m_00 │ └──