...@gmail.com]
*Sent:* Thursday, April 03, 2014 11:06 AM
*To:* user@hive.apache.org
*Subject:* Predicate pushdown optimisation not working for ORC
I am new to Hive, apologise for asking such a basic question.
Following exercise was done with hive .12 and hadoop 0.20.203
I created a ORC file
I was able to find the property with some digging around and
experimentation. Never knew that ppd had something to do with this
property.
On Thu, Apr 3, 2014 at 7:23 PM, Stephen Sprague sprag...@gmail.com wrote:
wow. good find. i hope these config settings are well documented and that
you
I was able to resolve the issue by setting hive.optimize.index.filter to
true.
In the hadoop logs
syslog:2014-04-03 05:44:51,204 INFO
org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: included column ids =
3,8,13
syslog:2014-04-03 05:44:51,204 INFO
org.apache.hadoop.hive.ql.io.orc.OrcInputFormat:
wow. good find. i hope these config settings are well documented and that
you didn't have to spend alot time searching for that. Interesting that
the default isn't true for this one.
On Wed, Apr 2, 2014 at 11:00 PM, Abhay Bansal abhaybansal.1...@gmail.comwrote:
I was able to resolve the issue
...@gmail.com]
Sent: Thursday, April 03, 2014 11:06 AM
To: user@hive.apache.org
Subject: Predicate pushdown optimisation not working for ORC
I am new to Hive, apologise for asking such a basic question.
Following exercise was done with hive .12 and hadoop 0.20.203
I created a ORC file form java
I am new to Hive, apologise for asking such a basic question.
Following exercise was done with hive .12 and hadoop 0.20.203
I created a ORC file form java, and pushed it into a table with the same
schema. I checked the conf
property propertynamehive.optimize.ppd/namevaluetrue/value/property
HI Abhay,
What is the DDL for your test table?
2014-04-02 22:36 GMT-07:00 Abhay Bansal abhaybansal.1...@gmail.com:
I am new to Hive, apologise for asking such a basic question.
Following exercise was done with hive .12 and hadoop 0.20.203
I created a ORC file form java, and pushed it
