Re: hive 0.14.1 + tez 0.4 sometimes throws NPE on small data

2015-01-09 Thread Alexander Pivovarov
Thank you correction, we are using hive-0.13.1 Thank you for pointing me to the JIRA On Fri, Jan 9, 2015 at 12:13 PM, Gopal V wrote: > On 1/9/15, 11:53 AM, Alexander Pivovarov wrote: > >> I noticed that if amount of data which should be sent to reducers is small >> then tez might throw NPE. >>

Re: hive 0.14.1 + tez 0.4 sometimes throws NPE on small data

2015-01-09 Thread Gopal V
On 1/9/15, 11:53 AM, Alexander Pivovarov wrote: I noticed that if amount of data which should be sent to reducers is small then tez might throw NPE. I noticed that you sent it to the tez lists as well. This is a hive specific issue. https://issues.apache.org/jira/browse/HIVE-8361 to be prec

hive 0.14.1 + tez 0.4 sometimes throws NPE on small data

2015-01-09 Thread Alexander Pivovarov
I noticed that if amount of data which should be sent to reducers is small then tez might throw NPE. workaround is to set number of reducers to some small value. e.g. if initially I have set hive.exec.reducers.max=25; then to solve the issue I might try set hive.exec.reducers.max=13; or even small