[
https://issues.apache.org/jira/browse/PIG-2672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13779290#comment-13779290
]
Rohini Palaniswamy commented on PIG-2672:
-----------------------------------------
bq. We might need little more refactoring before we change permissions on
temporary path. Currently FileLocalizer.getTemporaryPath(pigContext); is
getting used for several things. (+for intermediate data, I think)
Yes. All intermediate data go into that. Setting 700 should not cause
problems but ElementDescriptor does not have methods for chmod and that would
require refactoring and that is what you probably meant. So a separate jira
sounds good.
> Optimize the use of DistributedCache
> ------------------------------------
>
> Key: PIG-2672
> URL: https://issues.apache.org/jira/browse/PIG-2672
> Project: Pig
> Issue Type: Improvement
> Reporter: Rohini Palaniswamy
> Fix For: 0.12.0
>
> Attachments: PIG-2672.patch
>
>
> Pig currently copies jar files to a temporary location in hdfs and then adds
> them to DistributedCache for each job launched. This is inefficient in terms
> of
> * Space - The jars are distributed to task trackers for every job taking
> up lot of local temporary space in tasktrackers.
> * Performance - The jar distribution impacts the job launch time.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
