[ 
https://issues.apache.org/jira/browse/PIG-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13144247#comment-13144247
 ] 

Olga Natkovich commented on PIG-2209:
-------------------------------------

My concern is that the data is generated by one set of users but used by 
another and I am not sure how well we have tested the code that messages the 
data since that was not a very common use case. 

I could howevere see that if the schema file is not there nothing changes which 
could be good enough. I do recommend that we at least add more test case for 
schema provided both in file and in load statement
                
> JsonMetadata fails to find schema for glob paths
> ------------------------------------------------
>
>                 Key: PIG-2209
>                 URL: https://issues.apache.org/jira/browse/PIG-2209
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.10
>            Reporter: Dmitriy V. Ryaboy
>            Assignee: Dmitriy V. Ryaboy
>            Priority: Blocker
>             Fix For: 0.10
>
>
> JsonMetadata, used in PigStorage to work with serialized schemas, does not 
> correctly interpret paths like '/foo/bar/{1,2,3}' and throws an exception:
> {code}
> Caused by: org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1131: 
> Could not find schema file for file:///foo/bar/{1,2}
>       at 
> org.apache.pig.builtin.JsonMetadata.nullOrException(JsonMetadata.java:217)
>       at org.apache.pig.builtin.JsonMetadata.getSchema(JsonMetadata.java:186)
>       at org.apache.pig.builtin.PigStorage.getSchema(PigStorage.java:438)
>       at 
> org.apache.pig.newplan.logical.relational.LOLoad.getSchemaFromMetaData(LOLoad.java:150)
>       ... 17 more
> Caused by: java.io.IOException: Unable to read file:///foo/bar/z/{1,2}
>       at 
> org.apache.pig.builtin.JsonMetadata.findMetaFile(JsonMetadata.java:106)
>       at org.apache.pig.builtin.JsonMetadata.getSchema(JsonMetadata.java:183)
>       ... 19 more
> Caused by: java.net.URISyntaxException: Illegal character in path at index 
> 36: file:///foo/bar/{1,2}
>       at java.net.URI$Parser.fail(URI.java:2809)
>       at java.net.URI$Parser.checkChars(URI.java:2982)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to