Re: Hive shell code exception, urgent help needed

2014-07-31 Thread Juan Martin Pampliega
Depending on the size of the data you are processing 4gb might not be enough. Do you have any idea what's the size of your data? Have you tried limiting the queries with LIMIT keyword to a few hundred rows and seeing if they run ok? On Jul 25, 2014 6:55 AM, Sarfraz Ramay sarfraz.ra...@gmail.com

Re: Hive shell code exception, urgent help needed

2014-07-25 Thread Sarfraz Ramay
Hi, I have 4 instances on ec2 1 master with namenode and YARN running on it 1 for secondary namenode and 2 slaves I used t2.medium instance for the master node only and left the rest as they were and still i got the same exception. t2.medium is a decent instance with 4GB RAM and 2 CPUs so i

Re: Hive shell code exception, urgent help needed

2014-07-24 Thread Sarfraz Ramay
Can anyone please help with this ? [image: Inline image 1] i followed the advice here http://stackoverflow.com/questions/20390217/mapreduce-job-in-headless-environment-fails-n-times-due-to-am-container-exceptio and added to mapred-site.xml following properties but still getting the same error.

Re: Hive shell code exception, urgent help needed

2014-07-24 Thread Juan Martin Pampliega
Hi, The actual useful part of the error is: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask If you do a search for this plus EC2 in Google you will find a couple of results that point to memory exhaustion issues. You should try increasing the configurated memory

Re: Hive shell code exception, urgent help needed

2014-07-24 Thread Sarfraz Ramay
Hi, Thanks for your reply. Have been following links for the past two days now. Finally got hadoop natively compiled. Let's see if that solves the problem. Yes, increasing the memory was on my list but i think i tried that, didn't work. Memory can be issue as it is working perfectly fine for