[
https://issues.apache.org/jira/browse/MAPREDUCE-4012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13229733#comment-13229733
]
Koji Noguchi commented on MAPREDUCE-4012:
-----------------------------------------
Full log.
On the webUI
{noformat}
Error initializing attempt_201202130706_49976_m_000004_0:
java.io.IOException: Job initialization failed (255)
at
org.apache.hadoop.mapred.LinuxTaskController.initializeJob(LinuxTaskController.java:192)
at org.apache.hadoop.mapred.TaskTracker$4.run(TaskTracker.java:1201)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1082)
at
org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1176)
at
org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1091)
at org.apache.hadoop.mapred.TaskTracker$5.run(TaskTracker.java:2360)
at java.lang.Thread.run(Thread.java:619)
Caused by: org.apache.hadoop.util.Shell$ExitCodeException:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:255)
at org.apache.hadoop.util.Shell.run(Shell.java:182)
at
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:375)
at
org.apache.hadoop.mapred.LinuxTaskController.initializeJob(LinuxTaskController.java:185)
... 8 more
{noformat}
On the tasktracker log
{noformat}
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:
org.apache.hadoop.security.AccessControlException:
org.apache.hadoop.security.AccessControlException: Permission denied:
user=user1, access=READ, inode="testfile":user2:users:rw-------
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: at
sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: at
java.lang.reflect.Constructor.newInstance(Constructor.java:513)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: at
org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:95)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: at
org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:57)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: at
org.apache.hadoop.hdfs.DFSClient.callGetBlockLocations(DFSClient.java:441)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: at
org.apache.hadoop.hdfs.DFSClient.access$400(DFSClient.java:74)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: at
org.apache.hadoop.hdfs.DFSClient$DFSInputStream.openInfo(DFSClient.java:1683)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: at
org.apache.hadoop.hdfs.DFSClient$DFSInputStream.<init>(DFSClient.java:1676)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: at
org.apache.hadoop.hdfs.DFSClient.open(DFSClient.java:479)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: at
org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:154)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: at
org.apache.hadoop.fs.FileSystem.open(FileSystem.java:427)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: at
org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:228)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: at
org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:163)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: at
org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1173)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: at
org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1154)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: at
org.apache.hadoop.filecache.TrackerDistributedCacheManager.downloadCacheObject(TrackerDistributedCacheManager.java:415)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: at
org.apache.hadoop.mapred.JobLocalizer.downloadPrivateCacheObjects(JobLocalizer.java:324)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: at
org.apache.hadoop.mapred.JobLocalizer.downloadPrivateCache(JobLocalizer.java:349)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: at
org.apache.hadoop.mapred.JobLocalizer.localizeJobFiles(JobLocalizer.java:383)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: at
org.apache.hadoop.mapred.JobLocalizer.runSetup(JobLocalizer.java:477)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: at
org.apache.hadoop.mapred.JobLocalizer$3.run(JobLocalizer.java:534)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: at
org.apache.hadoop.mapred.JobLocalizer$3.run(JobLocalizer.java:531)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: at
java.security.AccessController.doPrivileged(Native Method)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: at
javax.security.auth.Subject.doAs(Subject.java:396)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1082)
2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: at
org.apache.hadoop.mapred.JobLocalizer.main(JobLocalizer.java:530)
{noformat}
> Hadoop Job setup error leaves no useful info to users (when
> LinuxTaskController is used)
> ----------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4012
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4012
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 1.0.0
> Reporter: Koji Noguchi
> Priority: Minor
>
> When distributed cache pull fail on the TaskTracker, job webUI only shows
> {noformat}
> Job initialization failed (255)
> {noformat}
> leaving users confused.
> On the TaskTracker log, there is a log with useful info
> {noformat}
> 2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:
> org.apache.hadoop.security.AccessControlException:
> org.apache.hadoop.security.AccessControlException:
> Permission denied: user=user1, access=READ,
> inode="testfile":user3:users:rw-------
> ...
> 2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: at
> org.apache.hadoop.filecache.TrackerDistributedCacheManager.downloadCacheObject(TrackerDistributedCacheManager.java:415)
> ...
> 2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: at
> org.apache.hadoop.mapred.JobLocalizer.main(JobLocalizer.java:530)
> {noformat}
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
