[
https://issues.apache.org/jira/browse/HADOOP-2567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12558920#action_12558920
]
Amar Kamat commented on HADOOP-2567:
------------------------------------
The log messages are as follows
{code}
bash$ bin/hadoop jar build/hadoop-*-test.jar testmapredsort -sortInput
input-randomwrite-test -sortOutput output-randomwrite-test
SortValidator.RecordStatsChecker: Validate sort from
hdfs://localhost:9000/user/user/input-randomwrite-test (4 files),
hdfs://localhost:9000/user/user/output-randomwrite-test (1 files) into
hdfs://localhost:9000/tmp/sortvalidate/recordstatschecker with 1 reducer.
Job started: Tue Jan 15 10:27:00 IST 2008
08/01/15 10:27:01 INFO mapred.FileInputFormat: Total input paths to process : 5
08/01/15 10:27:01 INFO mapred.JobClient: Running job: job_200801151024_0002
08/01/15 10:27:02 INFO mapred.JobClient: map 0% reduce 0%
08/01/15 10:27:06 INFO mapred.JobClient: map 20% reduce 0%
08/01/15 10:27:11 INFO mapred.JobClient: Task Id :
task_200801151024_0002_m_0000 01_0, Status : FAILED
java.io.IOException: Partitions do not match for record# 0 ! - '2' v/s '0'
at
org.apache.hadoop.mapred.SortValidator$RecordStatsChecker$Map.map(Sor
tValidator.java:267)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
at
org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2049 )
task_200801151024_0002_m_000001_0: rawClass: class
org.apache.hadoop.io.BytesWri table
task_200801151024_0002_m_000001_0: Returning class
org.apache.hadoop.mapred.Sort Validator$RecordStatsChecker$RawBytesWritable
task_200801151024_0002_m_000001_0: rawClass: class
org.apache.hadoop.io.BytesWri table
task_200801151024_0002_m_000001_0: Returning class
org.apache.hadoop.mapred.Sort Validator$RecordStatsChecker$RawBytesWritable
08/01/15 10:27:12 INFO mapred.JobClient: map 40% reduce 0%
{code}
> add FileSystem#getHomeDirectory() method
> ----------------------------------------
>
> Key: HADOOP-2567
> URL: https://issues.apache.org/jira/browse/HADOOP-2567
> Project: Hadoop
> Issue Type: New Feature
> Components: fs
> Reporter: Doug Cutting
> Assignee: Doug Cutting
> Fix For: 0.16.0
>
> Attachments: 2567-3.patch, HADOOP-2567-1.patch, HADOOP-2567-2.patch,
> HADOOP-2567.patch
>
>
> The FileSystem API would benefit from a getHomeDirectory() method.
> The default implementation would return "/user/$USER/".
> RawLocalFileSystem would return System.getProperty("user.home").
> HADOOP-2514 can use this to implement per-user trash.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
