Re: Parquet versus ORC

2016-03-06 Thread Marcin Tustin
ious why you think that Parquet does not have metadat at file, row >> group or column level. >> Please refer here to the type of metadata that Parquet supports in the >> docs http://parquet.apache.org/documentation/latest/ >> >> >> n 06/03/2016 15:26, Mich Talebzadeh wr

Re: Parquet versus ORC

2016-03-06 Thread Mich Talebzadeh
Parquet supports in the > docs http://parquet.apache.org/documentation/latest/ > > > n 06/03/2016 15:26, Mich Talebzadeh wrote: > > Hi. > > I have been hearing a fair bit about Parquet versus ORC tables. > > In a nutshell I can say that Parquet is a predecessor to ORC (both

Re: Parquet versus ORC

2016-03-06 Thread Uli Bethke
bit about Parquet versus ORC tables. In a nutshell I can say that Parquet is a predecessor to ORC (both provide columnar type storage) but I notice that it is still being used especially with Spark users. In mitigation it appears that Spark users are reluctant to use ORC despite the fact

Parquet versus ORC

2016-03-06 Thread Mich Talebzadeh
Hi. I have been hearing a fair bit about Parquet versus ORC tables. In a nutshell I can say that Parquet is a predecessor to ORC (both provide columnar type storage) but I notice that it is still being used especially with Spark users. In mitigation it appears that Spark users are reluctant