This is due to hadoop 1 and 2 incompatibility. Did you compile Pig with -Dhadoopversion=23?
On Thu, Jul 31, 2014 at 9:13 AM, Quang-Nhat HOANG-XUAN < hxquangn...@gmail.com> wrote: > Hi, > I've rebased my patch to trunk, but I cannot run it on our cluster. > Our hadoop version is 2.0.0-cdh4.4.0. > Do you know why this happened? > > This is the error log from Pig Stack Trace: > > ERROR 2998: Unhandled internal error. > > org.apache.hadoop.mapred.jobcontrol.JobControl.addJob(Lorg/apache/hadoop/mapred/jobcontrol/Job;)Ljava/lang/String; > > java.lang.NoSuchMethodError: > > org.apache.hadoop.mapred.jobcontrol.JobControl.addJob(Lorg/apache/hadoop/mapred/jobcontrol/Job;)Ljava/lang/String; > at > > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:327) > at > > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:195) > at > > org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.launchPig(HExecutionEngine.java:279) > at org.apache.pig.PigServer.launchPlan(PigServer.java:1378) > at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1363) > at org.apache.pig.PigServer.execute(PigServer.java:1352) > at org.apache.pig.PigServer.executeBatch(PigServer.java:403) > at org.apache.pig.PigServer.executeBatch(PigServer.java:386) > at > org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:170) > at > > org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:233) > at > > org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:204) > at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81) > at org.apache.pig.Main.run(Main.java:620) > at org.apache.pig.Main.main(Main.java:168) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.util.RunJar.main(RunJar.java:208) > > Thank you. > > Quang-Nhat > > > On Thu, Jul 24, 2014 at 10:32 PM, Quang-Nhat HOANG-XUAN < > hxquangn...@gmail.com> wrote: > > > Very helpful comments. > > I will fix them up. > > > > Thank you > > > > Quang-Nhat > > > > > > On Thu, Jul 24, 2014 at 9:54 PM, Cheolsoo Park <piaozhe...@gmail.com> > > wrote: > > > >> I added some comments to the review board. I love the idea, but the > patch > >> needs to be cleaned up to get committed. Also, please provide a patch > that > >> is based to trunk. Or it's not easy to test. > >> > >> Thanks! > >> Cheolsoo > >> > >> > >> > >> > >> On Thu, Jul 24, 2014 at 5:06 AM, Nhat Hoang <hxquangn...@gmail.com> > >> wrote: > >> > >> > Hello everyone, > >> > > >> > I am currently a master student at EURECOM (www.eurecom.fr). I am > >> working > >> > on a project related to Apache Pig in the context of a EU-funded > project > >> > Bigfoot (www.bigfootproject.eu). > >> > > >> > Based on our previous work: “Duy-Hung Phan, Matteo Dell’Amico, Pietro > >> > Michiardi: On the design space of MapReduce ROLLUP aggregates” ( > >> > > http://www.eurecom.fr/en/publication/4212/download/rs-publi-4212_2.pdf), > >> I > >> > am working on a new family of algorithms to address some limitations > of > >> the > >> > current ROLLUP operator in Apache Pig: the IRG (in-reducer grouping), > >> the > >> > hybrid IRG, and chained-IRG. I have an implementation that indicates > >> > superior performance to the existing ROLLUP implementation. > >> > > >> > You can find out more information on this work here: > >> > https://issues.apache.org/jira/browse/PIG-4066. I've also created a > >> review > >> > request on the review board: https://reviews.apache.org/r/23804/ > >> > It would be very helpful for me if someone can review and have some > >> > feedback on this patch. > >> > > >> > > >> > Looking forward for the feedback. > >> > > >> > Regards, > >> > Quang-Nhat HOANG-XUAN > >> > > >> > > > > >
