[blocker] ArrayIndexoutofbound in a hive query

2015-07-31 Thread ravi teja
Hi, We are facing issue with our hive query with ArrayIndexoutofbound exception. I have tried googling out and I see many users facing the same error, but no solution yet. This is a blocker for our production and we really need help on this. We are using Hive version : 1.3.0. Our query is doing

Re: [blocker] ArrayIndexoutofbound in a hive query

2015-07-31 Thread ravi teja
Hi Nithin, Thanks for replying. The select query runs like a charm, but only when insertion into a table, then this problem occurs. Please find the answers inline. Thanks, Ravi On Fri, Jul 31, 2015 at 12:34 PM, Nitin Pawar nitinpawar...@gmail.com wrote: sorry but i could not find following

Re: [blocker] ArrayIndexoutofbound in a hive query

2015-07-31 Thread ravi teja
OK I will try it out, I see this info log in the MR log, should this be a problem? 2015-07-31 11:27:47,487 INFO [main] org.apache.hadoop.hive.serde2.lazybinary.LazyBinaryStruct: Missing fields! Expected 14 fields but only got 7! Last field end 97 and serialize buffer end 61. Ignoring similar

Re: [blocker] ArrayIndexoutofbound in a hive query

2015-07-31 Thread Nitin Pawar
sorry but i could not find following info 1) are you using tez as execution engine? if yes make sure its not snapshot version 2) are you using orc file format? if yes then set flag to ignore corrupt data 3) are there nulls on your join condition columns if possible share the query and underlying

Re: [blocker] ArrayIndexoutofbound in a hive query

2015-07-31 Thread Nitin Pawar
is there a different output format or the output table bucketed? can you try putting a not null condition on join columns On Fri, Jul 31, 2015 at 12:45 PM, ravi teja raviort...@gmail.com wrote: Hi Nithin, Thanks for replying. The select query runs like a charm, but only when insertion into a