[
https://issues.apache.org/jira/browse/PIG-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13144371#comment-13144371
]
Daniel Dai commented on PIG-2209:
---------------------------------
I checked the code again, we don't do extensive globStatus. Only one globStatus
will be called in the case of globbing. So if we agree we want to pay this
price in trade of the benefit of schema file, the only thing left is just bug
fix. TestPigStorage do have test cases cover basic schema/noschema, we do need
to add some globbing tests.
I will submit a patch shortly.
> JsonMetadata fails to find schema for glob paths
> ------------------------------------------------
>
> Key: PIG-2209
> URL: https://issues.apache.org/jira/browse/PIG-2209
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.10
> Reporter: Dmitriy V. Ryaboy
> Assignee: Dmitriy V. Ryaboy
> Priority: Blocker
> Fix For: 0.10
>
>
> JsonMetadata, used in PigStorage to work with serialized schemas, does not
> correctly interpret paths like '/foo/bar/{1,2,3}' and throws an exception:
> {code}
> Caused by: org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1131:
> Could not find schema file for file:///foo/bar/{1,2}
> at
> org.apache.pig.builtin.JsonMetadata.nullOrException(JsonMetadata.java:217)
> at org.apache.pig.builtin.JsonMetadata.getSchema(JsonMetadata.java:186)
> at org.apache.pig.builtin.PigStorage.getSchema(PigStorage.java:438)
> at
> org.apache.pig.newplan.logical.relational.LOLoad.getSchemaFromMetaData(LOLoad.java:150)
> ... 17 more
> Caused by: java.io.IOException: Unable to read file:///foo/bar/z/{1,2}
> at
> org.apache.pig.builtin.JsonMetadata.findMetaFile(JsonMetadata.java:106)
> at org.apache.pig.builtin.JsonMetadata.getSchema(JsonMetadata.java:183)
> ... 19 more
> Caused by: java.net.URISyntaxException: Illegal character in path at index
> 36: file:///foo/bar/{1,2}
> at java.net.URI$Parser.fail(URI.java:2809)
> at java.net.URI$Parser.checkChars(URI.java:2982)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
