Re: orc/parquet sql conf

2016-07-25 Thread Ovidiu-Cristian MARCU
Thank you! Any chance for this work being reviewed and integrated with next Spark release? Best, Ovidiu > On 25 Jul 2016, at 12:20, Hyukjin Kwon wrote: > > For the question 1., It is possible but not supported yet. Please refer > https://github.com/apache/spark/pull/13775 >

Re: orc/parquet sql conf

2016-07-25 Thread Hyukjin Kwon
For the question 1., It is possible but not supported yet. Please refer https://github.com/apache/spark/pull/13775 Thanks! 2016-07-25 19:01 GMT+09:00 Ovidiu-Cristian MARCU < ovidiu-cristian.ma...@inria.fr>: > Hi, > > Assuming I have some data in both ORC/Parquet formats, and some complex > workf

orc/parquet sql conf

2016-07-25 Thread Ovidiu-Cristian MARCU
Hi, Assuming I have some data in both ORC/Parquet formats, and some complex workflow that eventually combine results of some queries on these datasets, I would like to get the best execution and looking at the default configs I noticed: 1) Vectorized query execution possible with Parquet only,