[
https://issues.apache.org/jira/browse/PIG-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13143603#comment-13143603
]
Dmitriy V. Ryaboy commented on PIG-2209:
----------------------------------------
I think the behavior we want is
1) if the schema exists, use it
2) if the schema does not exist, behave as it behaves currently.
If we get rid of the per-file schema thing, and instead always only look for a
.pig_schema file in the directory that contains the files, the cost should be
relatively small.
> JsonMetadata fails to find schema for glob paths
> ------------------------------------------------
>
> Key: PIG-2209
> URL: https://issues.apache.org/jira/browse/PIG-2209
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.10
> Reporter: Dmitriy V. Ryaboy
> Assignee: Dmitriy V. Ryaboy
> Priority: Blocker
> Fix For: 0.10
>
>
> JsonMetadata, used in PigStorage to work with serialized schemas, does not
> correctly interpret paths like '/foo/bar/{1,2,3}' and throws an exception:
> {code}
> Caused by: org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1131:
> Could not find schema file for file:///foo/bar/{1,2}
> at
> org.apache.pig.builtin.JsonMetadata.nullOrException(JsonMetadata.java:217)
> at org.apache.pig.builtin.JsonMetadata.getSchema(JsonMetadata.java:186)
> at org.apache.pig.builtin.PigStorage.getSchema(PigStorage.java:438)
> at
> org.apache.pig.newplan.logical.relational.LOLoad.getSchemaFromMetaData(LOLoad.java:150)
> ... 17 more
> Caused by: java.io.IOException: Unable to read file:///foo/bar/z/{1,2}
> at
> org.apache.pig.builtin.JsonMetadata.findMetaFile(JsonMetadata.java:106)
> at org.apache.pig.builtin.JsonMetadata.getSchema(JsonMetadata.java:183)
> ... 19 more
> Caused by: java.net.URISyntaxException: Illegal character in path at index
> 36: file:///foo/bar/{1,2}
> at java.net.URI$Parser.fail(URI.java:2809)
> at java.net.URI$Parser.checkChars(URI.java:2982)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
