[
https://issues.apache.org/jira/browse/HADOOP-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
giovanni delussu updated HADOOP-9084:
-------------------------------------
Status: Patch Available (was: Open)
*This patch works by keeping the fs and the jobconf working directories
different. In hdfs we don't need it because the "local" fs is different from
the default fs.
*potential problems of this patch: if a user creates a file ( with relative
path) in the mapper/reducer phase this file will be created in the attempt
directory and then deleted on cleanup. Without the patch the file would be
created in the current working directory of the filesystem, i.e. the directory
from which the user launched hadoop.
> TotalOrderPartitioner fails on hadoop running on top of gpfs (or any parallel
> or distributed filesystem)
> --------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-9084
> URL: https://issues.apache.org/jira/browse/HADOOP-9084
> Project: Hadoop Common
> Issue Type: Bug
> Components: filecache, fs, native
> Affects Versions: 1.0.4, 1.0.3
> Reporter: giovanni delussu
> Assignee: giovanni delussu
> Priority: Critical
> Fix For: 1.0.4, 1.0.3
>
>
> When running a job who uses TotalOrderPartitioner (like TeraSort or
> BulkImport of HBase) on hadoop running on top of gpfs (instead of hdfs) the
> program fails to find the file _partition.lst because is looking for it in
> the wrong directory. The confusion is between local fs meaning not hdfs and
> local meaning distributed fs.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
