zhihai xu created YARN-3602: ------------------------------- Summary: TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IOException from cleanup Key: YARN-3602 URL: https://issues.apache.org/jira/browse/YARN-3602 Project: Hadoop YARN Issue Type: Bug Components: test Reporter: zhihai xu Assignee: zhihai xu Priority: Minor
ResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IOException from cleanup. The stack trace is the following from test report at https://builds.apache.org/job/PreCommit-YARN-Build/7729/testReport/org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer/TestResourceLocalizationService/testPublicResourceInitializesLocalDir/ {code} Error Message Unable to delete directory target/org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService/2/filecache. Stacktrace java.io.IOException: Unable to delete directory target/org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService/2/filecache. at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1541) at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:2270) at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1653) at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1535) at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:2270) at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1653) at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1535) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService.cleanup(TestResourceLocalizationService.java:187) {code} It looks like we can safely ignore the IOException in cleanup which is called after test. The IOException may be due to the test machine environment because TestResourceLocalizationService/2/filecache is created by ResourceLocalizationService#initializeLocalDir. testPublicResourceInitializesLocalDir created 0/filecache, 1/filecache, 2/filecache and 3/filecache {code} for (int i = 0; i < 4; ++i) { localDirs.add(lfs.makeQualified(new Path(basedir, i + ""))); sDirs[i] = localDirs.get(i).toString(); } {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)