Hi, I've rebased my patch to trunk, but I cannot run it on our cluster. Our hadoop version is 2.0.0-cdh4.4.0. Do you know why this happened?
This is the error log from Pig Stack Trace: ERROR 2998: Unhandled internal error. org.apache.hadoop.mapred.jobcontrol.JobControl.addJob(Lorg/apache/hadoop/mapred/jobcontrol/Job;)Ljava/lang/String; java.lang.NoSuchMethodError: org.apache.hadoop.mapred.jobcontrol.JobControl.addJob(Lorg/apache/hadoop/mapred/jobcontrol/Job;)Ljava/lang/String; at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:327) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:195) at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.launchPig(HExecutionEngine.java:279) at org.apache.pig.PigServer.launchPlan(PigServer.java:1378) at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1363) at org.apache.pig.PigServer.execute(PigServer.java:1352) at org.apache.pig.PigServer.executeBatch(PigServer.java:403) at org.apache.pig.PigServer.executeBatch(PigServer.java:386) at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:170) at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:233) at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:204) at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81) at org.apache.pig.Main.run(Main.java:620) at org.apache.pig.Main.main(Main.java:168) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:208) Thank you. Quang-Nhat On Thu, Jul 24, 2014 at 10:32 PM, Quang-Nhat HOANG-XUAN < [email protected]> wrote: > Very helpful comments. > I will fix them up. > > Thank you > > Quang-Nhat > > > On Thu, Jul 24, 2014 at 9:54 PM, Cheolsoo Park <[email protected]> > wrote: > >> I added some comments to the review board. I love the idea, but the patch >> needs to be cleaned up to get committed. Also, please provide a patch that >> is based to trunk. Or it's not easy to test. >> >> Thanks! >> Cheolsoo >> >> >> >> >> On Thu, Jul 24, 2014 at 5:06 AM, Nhat Hoang <[email protected]> >> wrote: >> >> > Hello everyone, >> > >> > I am currently a master student at EURECOM (www.eurecom.fr). I am >> working >> > on a project related to Apache Pig in the context of a EU-funded project >> > Bigfoot (www.bigfootproject.eu). >> > >> > Based on our previous work: “Duy-Hung Phan, Matteo Dell’Amico, Pietro >> > Michiardi: On the design space of MapReduce ROLLUP aggregates” ( >> > http://www.eurecom.fr/en/publication/4212/download/rs-publi-4212_2.pdf), >> I >> > am working on a new family of algorithms to address some limitations of >> the >> > current ROLLUP operator in Apache Pig: the IRG (in-reducer grouping), >> the >> > hybrid IRG, and chained-IRG. I have an implementation that indicates >> > superior performance to the existing ROLLUP implementation. >> > >> > You can find out more information on this work here: >> > https://issues.apache.org/jira/browse/PIG-4066. I've also created a >> review >> > request on the review board: https://reviews.apache.org/r/23804/ >> > It would be very helpful for me if someone can review and have some >> > feedback on this patch. >> > >> > >> > Looking forward for the feedback. >> > >> > Regards, >> > Quang-Nhat HOANG-XUAN >> > >> > >
