[
https://issues.apache.org/jira/browse/PIG-2796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
John Gordon updated PIG-2796:
-----------------------------
Attachment: 0006-Local-Remote-file-mapping-for-tests-with-temps.patch
Test fixes for local file path usage in HDFS. Largely, it is removing the
colon in windows paths and minimizing the number of direct File.toString()
usage to create HDFS paths.
> Local temporary paths are not always valid HDFS path names.
> -----------------------------------------------------------
>
> Key: PIG-2796
> URL: https://issues.apache.org/jira/browse/PIG-2796
> Project: Pig
> Issue Type: Sub-task
> Reporter: John Gordon
> Attachments: 0006-Local-Remote-file-mapping-for-tests-with-temps.patch
>
>
> A number of pig scripts follow the pattern:
> File tempFile = File.createTempFile("this", ".txt");
> copyFromLocalToCluster (tempFile.to_string(), tempFile.to_string());
> tempFile.delete();
> The goal, here, seems to be to generate a temp filename to avoid issues on
> the next run if the file doesn't get cleaned up. The problem is that
> File.createTempFile on Windows creates files with names like
> C:\users\myuser\App data\local\temp\file.txt. The problem is that ":" is not
> a valid DFS character and so the put fails.
> The easy fix on this is to remove colons from the path before upload. Then
> we get something like C\users\myuser\App data\local\temp\file.txt which is a
> valid DFS pathname with minimal impact to the tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
