[ 
https://issues.apache.org/jira/browse/PIG-3815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13939728#comment-13939728
 ] 

Aniket Mokashi commented on PIG-3815:
-------------------------------------

Thanks for your comments, [~rohini]. I was not aware of limitations on the HDFS 
streams, I have attached a patch (PIG-3815-2.patch) to fix those problems.

Hadoop Jira: https://issues.apache.org/jira/browse/MAPREDUCE-2361. Looks like 
this was fixed here - 
http://svn.apache.org/viewvc?view=revision&revision=1077790. 



> Hadoop bug causes to pig to fail silently with jar cache
> --------------------------------------------------------
>
>                 Key: PIG-3815
>                 URL: https://issues.apache.org/jira/browse/PIG-3815
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.13.0
>            Reporter: Aniket Mokashi
>            Assignee: Aniket Mokashi
>             Fix For: 0.13.0
>
>         Attachments: PIG-3815-1.patch, PIG-3815-2.patch, PIG-3815.patch
>
>
> Pig uses DistributedCache.addFileToClassPath api that puts jars on 
> distributed cache configuration. This uses : to separate list of files to be 
> put of classpath via distributed cache. If fs.default.name has port number in 
> it, it causes the tokenization logic to fail in hadoop for retrieving list of 
> cache filenames in backend.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to