Re: What is the class that launches the reducers?

2016-08-26 Thread Hitesh Shah
Have you considered trying to use Tez with a 3-vertex DAG instead of trying to change the MR framework? i.e. A->B, A->C, B->C where A is the original map, C is the reducer and B being the verification stage I assume and C is configured to not start doing any work until B’s verification completes

Re: java.lang.NoSuchFieldError: HADOOP_CLASSPATH

2016-08-26 Thread Rakesh Radhakrishnan
Hi Senthil, There might be case of including the wrong version of a jar file, could you please check "Environment.HADOOP_CLASSPATH" enum variable in "org.apache.hadoop.yarn.api.ApplicationConstants.java" class in your hadoop jar file?. I think it is throwing "NoSuchFieldError" as its not seeing th

RE: Help starting RangerKMS

2016-08-26 Thread Benjamin Ross
I actually figured this out. It was pretty simple - the issue was that the ranger KMS master key was generated when the system didn't have JCE installed. So I had to delete the master key and let the system regenerate it. From: Benjamin Ross Sent: Friday, Augu

Help starting RangerKMS

2016-08-26 Thread Benjamin Ross
Hey guys, I'm trying to start the RangerKMS server and I'm running into this very obscure error. Any help would be appreciated. We have confirmed JCE is installed on the node running RangerKMS. We're using Java JDK 1.7 and Ranger 0.5.0.2.3 (HDP 2.3.6.0-3796). [root@bodcdevhdp6 kms]# cat cat

java.lang.NoSuchFieldError: HADOOP_CLASSPATH

2016-08-26 Thread kumar, Senthil(AWF)
Dear All , Facing No Such Field Error when I run Map Reduce Job.. I have correct HADOOP_CLASSPATH in cluster .. Not sure what causing issue here .. java.lang.NoSuchFieldError: HADOOP_CLASSPATH at org.apache.hadoop.mapreduce.v2.util.MRApps.setClasspath(MRApps.java:248) at org.