[jira] [Commented] (YARN-3120) YarnException on windows + org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local dirnm-local-dir, which was marked as good.
[ https://issues.apache.org/jira/browse/YARN-3120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17004422#comment-17004422 ] Wei Zhang commented on YARN-3120: - I face the same issue when i start-yarn in Windows10 today. The hadoop version is 2.8.3. The logs in nodemanager as below: {code:java} 19/12/28 15:49:09 WARN localizer.ResourceLocalizationService: Permissions incorrectly set for dir /tmp/hadoop-xxx/nm-local-dir/usercache, should be rwxr-xr-x, actual value = rwxrwxr-x 19/12/28 15:49:09 INFO localizer.ResourceLocalizationService: Attempting to initialize /tmp/hadoop-xxx/nm-local-dir 19/12/28 15:49:09 WARN localizer.ResourceLocalizationService: Permissions incorrectly set for dir /tmp/hadoop-xxx/nm-local-dir/usercache, should be rwxr-xr-x, actual value = rwxrwxr-x 19/12/28 15:49:09 WARN localizer.ResourceLocalizationService: Failed to setup local dir /tmp/hadoop-xxx/nm-local-dir, which was marked as good. org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Permissions incorrectly set for dir /tmp/hadoop-xxx/nm-local-dir/usercache, should be rwxr-xr-x, actual value = rwxrwxr-x at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.checkLocalDir(ResourceLocalizationService.java:1562) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.checkAndInitializeLocalDirs(ResourceLocalizationService.java:1530) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$1.onDirsChanged(ResourceLocalizationService.java:271) at org.apache.hadoop.yarn.server.nodemanager.DirectoryCollection.registerDirsChangeListener(DirectoryCollection.java:197) at org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService.registerLocalDirsChangeListener(LocalDirsHandlerService.java:242) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.serviceStart(ResourceLocalizationService.java:372) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceStart(ContainerManagerImpl.java:502) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:369) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:637) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:684) 19/12/28 15:49:09 INFO service.AbstractService: Service org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService failed in state STARTED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local dir /tmp/hadoop-xxx/nm-local-dir, which was marked as good. org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local dir /tmp/hadoop-xxx/nm-local-dir, which was marked as good. at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.checkAndInitializeLocalDirs(ResourceLocalizationService.java:1535) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$1.onDirsChanged(ResourceLocalizationService.java:271) at org.apache.hadoop.yarn.server.nodemanager.DirectoryCollection.registerDirsChangeListener(DirectoryCollection.java:197) at org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService.registerLocalDirsChangeListener(LocalDirsHandlerService.java:242) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.serviceStart(ResourceLocalizationService.java:372) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceStart(ContainerManagerImpl.java:502) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:369) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.yarn.server.nodemanag
[jira] [Commented] (YARN-3120) YarnException on windows + org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local dirnm-local-dir, which was marked as good.
[ https://issues.apache.org/jira/browse/YARN-3120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17004425#comment-17004425 ] Wei Zhang commented on YARN-3120: - I resolved it. I use admin account to open the PowerShell in windows, then i start yarn. It works and the nodemanager has no warn logs. > YarnException on windows + > org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local > dirnm-local-dir, which was marked as good. > --- > > Key: YARN-3120 > URL: https://issues.apache.org/jira/browse/YARN-3120 > Project: Hadoop YARN > Issue Type: Bug >Affects Versions: 2.6.0 > Environment: Windows 8 , Hadoop 2.6.0 >Reporter: vaidhyanathan >Priority: Major > > Hi, > I tried to follow the instructiosn in > http://wiki.apache.org/hadoop/Hadoop2OnWindows and have setup > hadoop-2.6.0.jar in my windows system. > I was able to start everything properly but when i try to run the job > wordcount as given in the above URL , the job fails with the below exception . > 15/01/30 12:56:09 INFO localizer.ResourceLocalizationService: Localizer failed > org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local > di > r /tmp/hadoop-haremangala/nm-local-dir, which was marked as good. > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. > ResourceLocalizationService.getInitializedLocalDirs(ResourceLocalizationService. > java:1372) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. > ResourceLocalizationService.access$900(ResourceLocalizationService.java:137) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. > ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java > :1085) -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-3120) YarnException on windows + org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local dirnm-local-dir, which was marked as good.
[ https://issues.apache.org/jira/browse/YARN-3120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128253#comment-15128253 ] kumar ranganathan commented on YARN-3120: - Hi, I have facing the same problem in Hadoop-2.7.2 in Windows. I have found the logs in nodemanager as below and it should be the actual root cause {panel} WARN localizer.ResourceLocalizationService: Failed to setup local dir /tmp/hadoop-SYSTEM/nm-local-dir, which was marked as good. org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Permissions incorrectly set for dir /tmp/hadoop-SYSTEM/nm-local-dir/usercache, should be rwxr-xr-x, actual value = rwxrwxr-x at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.checkLocalDir(ResourceLocalizationService.java:1443) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.getInitializedLocalDirs(ResourceLocalizationService.java:1410) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.access$800(ResourceLocalizationService.java:140) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java:1110) 16/02/02 18:50:45 INFO localizer.ResourceLocalizationService: Localizer failed org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local dir /tmp/hadoop-SYSTEM/nm-local-dir, which was marked as good. {panel} I found another jira task related to this issue [https://issues.apache.org/jira/browse/YARN-3962] Even though i applied patch, the problem isn't resolved. So i have changed the code manually by commenting the condition check as below, {code:title=ResourceLocalizationService.java|borderStyle=solid} private boolean checkLocalDir(String localDir) { Map pathPermissionMap = getLocalDirsPathPermissionsMap(localDir); for (Map.Entry entry : pathPermissionMap.entrySet()) { FileStatus status; try { status = lfs.getFileStatus(entry.getKey()); } catch (Exception e) { String msg = "Could not carry out resource dir checks for " + localDir + ", which was marked as good"; LOG.warn(msg, e); throw new YarnRuntimeException(msg, e); } // if (!status.getPermission().equals(entry.getValue())) { //String msg = //"Permissions incorrectly set for dir " + entry.getKey() //+ ", should be " + entry.getValue() + ", actual value = " //+ status.getPermission(); //LOG.warn(msg); //throw new YarnRuntimeException(msg); // } } return true; } {code} Now it works fine without any issue. It seems we can ignore this condition for virtual account in windows. > YarnException on windows + > org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local > dirnm-local-dir, which was marked as good. > --- > > Key: YARN-3120 > URL: https://issues.apache.org/jira/browse/YARN-3120 > Project: Hadoop YARN > Issue Type: Bug >Affects Versions: 2.6.0 > Environment: Windows 8 , Hadoop 2.6.0 >Reporter: vaidhyanathan > > Hi, > I tried to follow the instructiosn in > http://wiki.apache.org/hadoop/Hadoop2OnWindows and have setup > hadoop-2.6.0.jar in my windows system. > I was able to start everything properly but when i try to run the job > wordcount as given in the above URL , the job fails with the below exception . > 15/01/30 12:56:09 INFO localizer.ResourceLocalizationService: Localizer failed > org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local > di > r /tmp/hadoop-haremangala/nm-local-dir, which was marked as good. > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. > ResourceLocalizationService.getInitializedLocalDirs(ResourceLocalizationService. > java:1372) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. > ResourceLocalizationService.access$900(ResourceLocalizationService.java:137) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. > ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java > :1085) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3120) YarnException on windows + org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local dirnm-local-dir, which was marked as good.
[ https://issues.apache.org/jira/browse/YARN-3120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038679#comment-16038679 ] Animesh Sonkar commented on YARN-3120: -- Hi, I had setup hadoop 2.8.0 an using the steps mentioned in hadoop2onwindows wiki, was trying to setup the same. I am facing the same issue. I do not have the source and cant make changes as done by kumar ranganathan. I just want to get the setup working to learn hadoop. Was this fixed in 2.8.0? Id there any workaround available other than changing the source? I tried changing permissions of the dir for domain users and Administrators in windows, but it did not work. Thanks, Animesh Kumar Sonkar > YarnException on windows + > org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local > dirnm-local-dir, which was marked as good. > --- > > Key: YARN-3120 > URL: https://issues.apache.org/jira/browse/YARN-3120 > Project: Hadoop YARN > Issue Type: Bug >Affects Versions: 2.6.0 > Environment: Windows 8 , Hadoop 2.6.0 >Reporter: vaidhyanathan > > Hi, > I tried to follow the instructiosn in > http://wiki.apache.org/hadoop/Hadoop2OnWindows and have setup > hadoop-2.6.0.jar in my windows system. > I was able to start everything properly but when i try to run the job > wordcount as given in the above URL , the job fails with the below exception . > 15/01/30 12:56:09 INFO localizer.ResourceLocalizationService: Localizer failed > org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local > di > r /tmp/hadoop-haremangala/nm-local-dir, which was marked as good. > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. > ResourceLocalizationService.getInitializedLocalDirs(ResourceLocalizationService. > java:1372) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. > ResourceLocalizationService.access$900(ResourceLocalizationService.java:137) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. > ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java > :1085) -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-3120) YarnException on windows + org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local dirnm-local-dir, which was marked as good.
[ https://issues.apache.org/jira/browse/YARN-3120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14299111#comment-14299111 ] vaidhyanathan commented on YARN-3120: - I tried to change the folder permission for nmprivate manually by using chmod 700 as its expecting but the issue doesnt see to be resolved. > YarnException on windows + > org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local > dirnm-local-dir, which was marked as good. > --- > > Key: YARN-3120 > URL: https://issues.apache.org/jira/browse/YARN-3120 > Project: Hadoop YARN > Issue Type: Bug >Affects Versions: 2.6.0 > Environment: Windows 8 , Hadoop 2.6.0 >Reporter: vaidhyanathan > > Hi, > I tried to follow the instructiosn in > http://wiki.apache.org/hadoop/Hadoop2OnWindows and have setup > hadoop-2.6.0.jar in my windows system. > I was able to start everything properly but when i try to run the job > wordcount as given in the above URL , the job fails with the below exception . > 15/01/30 12:56:09 INFO localizer.ResourceLocalizationService: Localizer failed > org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local > di > r /tmp/hadoop-haremangala/nm-local-dir, which was marked as good. > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. > ResourceLocalizationService.getInitializedLocalDirs(ResourceLocalizationService. > java:1372) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. > ResourceLocalizationService.access$900(ResourceLocalizationService.java:137) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. > ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java > :1085) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3120) YarnException on windows + org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local dirnm-local-dir, which was marked as good.
[ https://issues.apache.org/jira/browse/YARN-3120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14299677#comment-14299677 ] Varun Vasudev commented on YARN-3120: - Are you running everything on your install drive(C:)? Windows has special security permissions on the install drive. Try creating another partition and set the local dirs on that partition. > YarnException on windows + > org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local > dirnm-local-dir, which was marked as good. > --- > > Key: YARN-3120 > URL: https://issues.apache.org/jira/browse/YARN-3120 > Project: Hadoop YARN > Issue Type: Bug >Affects Versions: 2.6.0 > Environment: Windows 8 , Hadoop 2.6.0 >Reporter: vaidhyanathan > > Hi, > I tried to follow the instructiosn in > http://wiki.apache.org/hadoop/Hadoop2OnWindows and have setup > hadoop-2.6.0.jar in my windows system. > I was able to start everything properly but when i try to run the job > wordcount as given in the above URL , the job fails with the below exception . > 15/01/30 12:56:09 INFO localizer.ResourceLocalizationService: Localizer failed > org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local > di > r /tmp/hadoop-haremangala/nm-local-dir, which was marked as good. > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. > ResourceLocalizationService.getInitializedLocalDirs(ResourceLocalizationService. > java:1372) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. > ResourceLocalizationService.access$900(ResourceLocalizationService.java:137) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. > ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java > :1085) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3120) YarnException on windows + org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local dirnm-local-dir, which was marked as good.
[ https://issues.apache.org/jira/browse/YARN-3120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309867#comment-14309867 ] vaidhyanathan commented on YARN-3120: - Hi Varun, Thanks for responding. I started running the yarn cmd files by running as administrator and it worked . Also i opened the command prompt and ran it in the administrator mode. The word count example worked fine for the first time but now im facing a different issue , When i run it now with the earlier setup , job doesnt proceed after this step '15/02/06 15:38:26 INFO mapreduce.Job: Running job: job_1423255041751_0001' and when i check the consolde the status is 'Accepted' and the final status is 'Undefined' > YarnException on windows + > org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local > dirnm-local-dir, which was marked as good. > --- > > Key: YARN-3120 > URL: https://issues.apache.org/jira/browse/YARN-3120 > Project: Hadoop YARN > Issue Type: Bug >Affects Versions: 2.6.0 > Environment: Windows 8 , Hadoop 2.6.0 >Reporter: vaidhyanathan > > Hi, > I tried to follow the instructiosn in > http://wiki.apache.org/hadoop/Hadoop2OnWindows and have setup > hadoop-2.6.0.jar in my windows system. > I was able to start everything properly but when i try to run the job > wordcount as given in the above URL , the job fails with the below exception . > 15/01/30 12:56:09 INFO localizer.ResourceLocalizationService: Localizer failed > org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local > di > r /tmp/hadoop-haremangala/nm-local-dir, which was marked as good. > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. > ResourceLocalizationService.getInitializedLocalDirs(ResourceLocalizationService. > java:1372) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. > ResourceLocalizationService.access$900(ResourceLocalizationService.java:137) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. > ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java > :1085) -- This message was sent by Atlassian JIRA (v6.3.4#6332)