RE: Should I convert json into parquet?

://hortonworks.com/blog/bringing-orc-support-into-apache-spark/ Thanks, Ewan -Original Message- From: Jörn Franke [mailto:jornfra...@gmail.com] Sent: 19 October 2015 06:32 To: Gavin Yue <yue.yuany...@gmail.com> Cc: user <user@spark.apache.org> Subject: Re: Should I

Re: Should I convert json into parquet?

t-into-apache-spark/ > >Thanks, >Ewan > >-Original Message- >From: Jörn Franke [mailto:jornfra...@gmail.com] >Sent: 19 October 2015 06:32 >To: Gavin Yue <yue.yuany...@gmail.com> >Cc: user <user@spark.apache.org> >Subject: Re: Should I convert json into parqu

Re: Should I convert json into parquet?

Good Formats are Parquet or ORC. Both can be useful with compression, such as Snappy. They are much faster than JSON. however, the table structure is up to you and depends on your use case. > On 17 Oct 2015, at 23:07, Gavin Yue wrote: > > I have json files which