Hi Richard, I am not sure what's your problem, but I suggest you can debug your program in pig's local mode.
And you can even debug it in pig's mapreduce mode locally Jeff zhang 2009/10/25 RichardGUO Fei <gladiato...@hotmail.com> > > Hi, > > > > I implemented a custom loadfunc class to read data from a database. This > class implements both Slicer and LoadFunc. It also generates the slices > properly. The problem is that when I perform this query: > > > > A = LOAD 'table_name' USING CustomStorage; > > DUMP A; > > > > The PIG gives the following error message: > > 2009-10-25 23:27:34,308 [main] INFO > > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher > - 0% complete > 2009-10-25 23:27:39,920 [main] ERROR org.apache.pig.tools.grunt.Grunt - > ERROR 6017: Execution failed, while processing > hdfs://access0:9000/tmp/temp1662058595/tmp-659297059 > 2009-10-25 23:27:39,920 [main] ERROR org.apache.pig.tools.grunt.Grunt - > org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to > open iterator for alias A > at org.apache.pig.PigServer.openIterator(PigServer.java:475) > at > org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:532) > at > org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:190) > at > org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:166) > at > org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:142) > at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:89) > at org.apache.pig.Main.main(Main.java:320) > Caused by: org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1002: > Unable to store alias A > at org.apache.pig.PigServer.store(PigServer.java:530) > at org.apache.pig.PigServer.openIterator(PigServer.java:458) > ... 6 more > Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR > 6017: Execution failed, while processing > hdfs://access0:9000/tmp/temp1662058595/tmp-659297059 > at > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:181) > at > org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:265) > at > org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:773) > at org.apache.pig.PigServer.store(PigServer.java:522) > ... 7 more > > > I am sure that getLocations returns the correct paths. And when I try to > add in more log displays in my custom Slice, it does not show up as it runs > in Map/Reduce. > > > > How am I supposed to debug this? Is there any way to retrieve more detailed > exception from the plan execution? > > > > Thanks, > > Richard > > _________________________________________________________________ > 全新 Windows 7:简化您的日常工作。寻找最适合您的 PC。 > http://www.microsoft.com/china/windows/buy/