[
https://issues.apache.org/jira/browse/PIG-1685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan updated PIG-1685:
-------------------------------------
Description:
We get the following exception, which seems to be related to processing
counters per path :
java.net.URISyntaxException: Illegal character in path at index 71:
$path_prefix/20100830_cdxcore_10.7_{00,01,02,03,04,05,06,07,08}.bz2
at java.net.URI$Parser.fail(URI.java:2809)
at java.net.URI$Parser.checkChars(URI.java:2982)
at java.net.URI$Parser.parseHierarchical(URI.java:3066)
at java.net.URI$Parser.parse(URI.java:3024)
at java.net.URI.<init>(URI.java:578)
at
org.apache.pig.tools.pigstats.PigStatsUtil.getMultiInputsCounterName(PigStatsUtil.java:128)
at
org.apache.pig.tools.pigstats.JobStats.addInputStatistics(JobStats.java:523)
at
org.apache.pig.tools.pigstats.PigStatsUtil.accumulateSuccessStatistics(PigStatsUtil.java:340)
at
org.apache.pig.tools.pigstats.PigStatsUtil.accumulateStats(PigStatsUtil.java:249)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:315)
at
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:301)
at
org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1197)
at org.apache.pig.PigServer.execute(PigServer.java:1189)
at org.apache.pig.PigServer.access$100(PigServer.java:127)
at org.apache.pig.PigServer$Graph.execute(PigServer.java:1513)
at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1560)
at org.apache.pig.PigServer.registerQuery(PigServer.java:522)
at
org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:868)
at
org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:386)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:165)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:141)
at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:90)
at org.apache.pig.Main.run(Main.java:498)
at org.apache.pig.Main.main(Main.java:107)
It results is (notice -1) among others:
Input(s):
Successfully read -1 records from:
"$path_prefix/20100830_cdxcore_10.7_{00,01,02,03,04,05,06,07,08}.bz2"
Thankfully, there is no direct functional impact except for inability to depend
on counters.
was:
We get the following exception, which seems to be related to processing
counters per path :
java.net.URISyntaxException: Illegal character in path at index 71:
/projects/gridfaces/mridulm/doopdex/k_data_index/20100830_cdxcore_10.7_{00,01,02,03,04,05,06,07,08}.bz2
at java.net.URI$Parser.fail(URI.java:2809)
at java.net.URI$Parser.checkChars(URI.java:2982)
at java.net.URI$Parser.parseHierarchical(URI.java:3066)
at java.net.URI$Parser.parse(URI.java:3024)
at java.net.URI.<init>(URI.java:578)
at
org.apache.pig.tools.pigstats.PigStatsUtil.getMultiInputsCounterName(PigStatsUtil.java:128)
at
org.apache.pig.tools.pigstats.JobStats.addInputStatistics(JobStats.java:523)
at
org.apache.pig.tools.pigstats.PigStatsUtil.accumulateSuccessStatistics(PigStatsUtil.java:340)
at
org.apache.pig.tools.pigstats.PigStatsUtil.accumulateStats(PigStatsUtil.java:249)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:315)
at
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:301)
at
org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1197)
at org.apache.pig.PigServer.execute(PigServer.java:1189)
at org.apache.pig.PigServer.access$100(PigServer.java:127)
at org.apache.pig.PigServer$Graph.execute(PigServer.java:1513)
at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1560)
at org.apache.pig.PigServer.registerQuery(PigServer.java:522)
at
org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:868)
at
org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:386)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:165)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:141)
at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:90)
at org.apache.pig.Main.run(Main.java:498)
at org.apache.pig.Main.main(Main.java:107)
It results is (notice -1) among others:
Input(s):
Successfully read -1 records from:
"/projects/gridfaces/mridulm/doopdex/k_data_index/20100830_cdxcore_10.7_{00,01,02,03,04,05,06,07,08}.bz2"
Thankfully, there is no direct functional impact except for inability to depend
on counters.
Modified description to remove internal path ... my mistake.
> Pig is unable to handle counters for glob paths ?
> -------------------------------------------------
>
> Key: PIG-1685
> URL: https://issues.apache.org/jira/browse/PIG-1685
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.8.0
> Reporter: Mridul Muralidharan
> Assignee: Daniel Dai
> Fix For: 0.8.0
>
> Attachments: PIG-1685-1.patch
>
>
> We get the following exception, which seems to be related to processing
> counters per path :
> java.net.URISyntaxException: Illegal character in path at index 71:
> $path_prefix/20100830_cdxcore_10.7_{00,01,02,03,04,05,06,07,08}.bz2
> at java.net.URI$Parser.fail(URI.java:2809)
> at java.net.URI$Parser.checkChars(URI.java:2982)
> at java.net.URI$Parser.parseHierarchical(URI.java:3066)
> at java.net.URI$Parser.parse(URI.java:3024)
> at java.net.URI.<init>(URI.java:578)
> at
> org.apache.pig.tools.pigstats.PigStatsUtil.getMultiInputsCounterName(PigStatsUtil.java:128)
> at
> org.apache.pig.tools.pigstats.JobStats.addInputStatistics(JobStats.java:523)
> at
> org.apache.pig.tools.pigstats.PigStatsUtil.accumulateSuccessStatistics(PigStatsUtil.java:340)
> at
> org.apache.pig.tools.pigstats.PigStatsUtil.accumulateStats(PigStatsUtil.java:249)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:315)
> at
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:301)
> at
> org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1197)
> at org.apache.pig.PigServer.execute(PigServer.java:1189)
> at org.apache.pig.PigServer.access$100(PigServer.java:127)
> at org.apache.pig.PigServer$Graph.execute(PigServer.java:1513)
> at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1560)
> at org.apache.pig.PigServer.registerQuery(PigServer.java:522)
> at
> org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:868)
> at
> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:386)
> at
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:165)
> at
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:141)
> at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:90)
> at org.apache.pig.Main.run(Main.java:498)
> at org.apache.pig.Main.main(Main.java:107)
> It results is (notice -1) among others:
> Input(s):
> Successfully read -1 records from:
> "$path_prefix/20100830_cdxcore_10.7_{00,01,02,03,04,05,06,07,08}.bz2"
> Thankfully, there is no direct functional impact except for inability to
> depend on counters.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
