Yes, I did try. In the last trunk (r1579421), it worked perfectly when i compiled with -Dhadoopversion23.
Quang-Nhat On Thu, Jul 31, 2014 at 6:46 PM, Cheolsoo Park <piaozhe...@gmail.com> wrote: > This is due to hadoop 1 and 2 incompatibility. Did you compile Pig with > -Dhadoopversion=23? > > > On Thu, Jul 31, 2014 at 9:13 AM, Quang-Nhat HOANG-XUAN < > hxquangn...@gmail.com> wrote: > > > Hi, > > I've rebased my patch to trunk, but I cannot run it on our cluster. > > Our hadoop version is 2.0.0-cdh4.4.0. > > Do you know why this happened? > > > > This is the error log from Pig Stack Trace: > > > > ERROR 2998: Unhandled internal error. > > > > > org.apache.hadoop.mapred.jobcontrol.JobControl.addJob(Lorg/apache/hadoop/mapred/jobcontrol/Job;)Ljava/lang/String; > > > > java.lang.NoSuchMethodError: > > > > > org.apache.hadoop.mapred.jobcontrol.JobControl.addJob(Lorg/apache/hadoop/mapred/jobcontrol/Job;)Ljava/lang/String; > > at > > > > > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:327) > > at > > > > > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:195) > > at > > > > > org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.launchPig(HExecutionEngine.java:279) > > at org.apache.pig.PigServer.launchPlan(PigServer.java:1378) > > at > org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1363) > > at org.apache.pig.PigServer.execute(PigServer.java:1352) > > at org.apache.pig.PigServer.executeBatch(PigServer.java:403) > > at org.apache.pig.PigServer.executeBatch(PigServer.java:386) > > at > > org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:170) > > at > > > > > org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:233) > > at > > > > > org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:204) > > at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81) > > at org.apache.pig.Main.run(Main.java:620) > > at org.apache.pig.Main.main(Main.java:168) > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > at > > > > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > > at > > > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > > at java.lang.reflect.Method.invoke(Method.java:597) > > at org.apache.hadoop.util.RunJar.main(RunJar.java:208) > > > > Thank you. > > > > Quang-Nhat > > > > > > On Thu, Jul 24, 2014 at 10:32 PM, Quang-Nhat HOANG-XUAN < > > hxquangn...@gmail.com> wrote: > > > > > Very helpful comments. > > > I will fix them up. > > > > > > Thank you > > > > > > Quang-Nhat > > > > > > > > > On Thu, Jul 24, 2014 at 9:54 PM, Cheolsoo Park <piaozhe...@gmail.com> > > > wrote: > > > > > >> I added some comments to the review board. I love the idea, but the > > patch > > >> needs to be cleaned up to get committed. Also, please provide a patch > > that > > >> is based to trunk. Or it's not easy to test. > > >> > > >> Thanks! > > >> Cheolsoo > > >> > > >> > > >> > > >> > > >> On Thu, Jul 24, 2014 at 5:06 AM, Nhat Hoang <hxquangn...@gmail.com> > > >> wrote: > > >> > > >> > Hello everyone, > > >> > > > >> > I am currently a master student at EURECOM (www.eurecom.fr). I am > > >> working > > >> > on a project related to Apache Pig in the context of a EU-funded > > project > > >> > Bigfoot (www.bigfootproject.eu). > > >> > > > >> > Based on our previous work: “Duy-Hung Phan, Matteo Dell’Amico, > Pietro > > >> > Michiardi: On the design space of MapReduce ROLLUP aggregates” ( > > >> > > > http://www.eurecom.fr/en/publication/4212/download/rs-publi-4212_2.pdf), > > >> I > > >> > am working on a new family of algorithms to address some limitations > > of > > >> the > > >> > current ROLLUP operator in Apache Pig: the IRG (in-reducer > grouping), > > >> the > > >> > hybrid IRG, and chained-IRG. I have an implementation that indicates > > >> > superior performance to the existing ROLLUP implementation. > > >> > > > >> > You can find out more information on this work here: > > >> > https://issues.apache.org/jira/browse/PIG-4066. I've also created a > > >> review > > >> > request on the review board: https://reviews.apache.org/r/23804/ > > >> > It would be very helpful for me if someone can review and have some > > >> > feedback on this patch. > > >> > > > >> > > > >> > Looking forward for the feedback. > > >> > > > >> > Regards, > > >> > Quang-Nhat HOANG-XUAN > > >> > > > >> > > > > > > > > >
