Re: sum a double in ORC bug?

2015-01-20 Thread Prasanth Jayachandran
Hi Nick




Can you try disabling predicate pushdown in ORC and see if you are getting 
correct results?




set hive.optimize.index.filter=false;




This is just to rule out the possibility of bug in predicate pushdown. 


- Prasanth

On Wed, Jan 14, 2015 at 6:46 PM, Martin, Nick nimar...@pssd.com wrote:

 *Hive 13
 I'm storing a sales amount column as a double in an ORC table and when I do:
 select sum(x) from sometable
 I get a value like 4.79165141174808E9
 A visual inspection of the column values reveals no glaring anomalies...all 
 looks pretty normal. If I do the same thing in a textfile table I get a 
 perfectly fine aggregation of the double field.
 I couldn't find anything like this already reported so I filed a bug (9385).
-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


sum a double in ORC bug?

2015-01-14 Thread Martin, Nick
*Hive 13

I'm storing a sales amount column as a double in an ORC table and when I do:

select sum(x) from sometable

I get a value like 4.79165141174808E9

A visual inspection of the column values reveals no glaring anomalies...all 
looks pretty normal. If I do the same thing in a textfile table I get a 
perfectly fine aggregation of the double field.

I couldn't find anything like this already reported so I filed a bug (9385).