Pig is unable to handle counters for glob paths ?
-------------------------------------------------
Key: PIG-1685
URL: https://issues.apache.org/jira/browse/PIG-1685
Project: Pig
Issue Type: Bug
Components: impl
Affects Versions: 0.8.0
Reporter: Mridul Muralidharan
We get the following exception, which seems to be related to processing
counters per path :
java.net.URISyntaxException: Illegal character in path at index 71:
/projects/gridfaces/mridulm/doopdex/k_data_index/20100830_cdxcore_10.7_{00,01,02,03,04,05,06,07,08}.bz2
at java.net.URI$Parser.fail(URI.java:2809)
at java.net.URI$Parser.checkChars(URI.java:2982)
at java.net.URI$Parser.parseHierarchical(URI.java:3066)
at java.net.URI$Parser.parse(URI.java:3024)
at java.net.URI.<init>(URI.java:578)
at
org.apache.pig.tools.pigstats.PigStatsUtil.getMultiInputsCounterName(PigStatsUtil.java:128)
at
org.apache.pig.tools.pigstats.JobStats.addInputStatistics(JobStats.java:523)
at
org.apache.pig.tools.pigstats.PigStatsUtil.accumulateSuccessStatistics(PigStatsUtil.java:340)
at
org.apache.pig.tools.pigstats.PigStatsUtil.accumulateStats(PigStatsUtil.java:249)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:315)
at
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:301)
at
org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1197)
at org.apache.pig.PigServer.execute(PigServer.java:1189)
at org.apache.pig.PigServer.access$100(PigServer.java:127)
at org.apache.pig.PigServer$Graph.execute(PigServer.java:1513)
at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1560)
at org.apache.pig.PigServer.registerQuery(PigServer.java:522)
at
org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:868)
at
org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:386)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:165)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:141)
at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:90)
at org.apache.pig.Main.run(Main.java:498)
at org.apache.pig.Main.main(Main.java:107)
It results is (notice -1) among others:
Input(s):
Successfully read -1 records from:
"/projects/gridfaces/mridulm/doopdex/k_data_index/20100830_cdxcore_10.7_{00,01,02,03,04,05,06,07,08}.bz2"
Thankfully, there is no direct functional impact except for inability to depend
on counters.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
