[ https://issues.apache.org/jira/browse/HADOOP-16665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16972683#comment-16972683 ]
Hudson commented on HADOOP-16665: --------------------------------- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17633 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/17633/]) HADOOP-16665. Filesystems to be closed if they failed during (stevel: rev 990063d2af0a37e9474949f33128805e34c3f016) * (edit) hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/test/HadoopTestBase.java * (edit) hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3ADataBlocks.java * (edit) hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFileSystemInitialization.java * (edit) hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/MockS3AFileSystem.java * (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java * (edit) hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java * (add) hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/test/AbstractHadoopTestBase.java * (edit) hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/auth/ITestRestrictedReadAccess.java * (edit) hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/auth/ITestAssumeRole.java * (edit) hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/auth/ITestAssumedRoleCommitOperations.java * (edit) hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3ABlockOutputStream.java * (edit) hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AUtils.java > Filesystems to be closed if they failed during initialize() > ----------------------------------------------------------- > > Key: HADOOP-16665 > URL: https://issues.apache.org/jira/browse/HADOOP-16665 > Project: Hadoop Common > Issue Type: Bug > Components: fs, fs/s3 > Affects Versions: 3.2.1, 3.1.3 > Reporter: Steve Loughran > Assignee: Steve Loughran > Priority: Major > Fix For: 3.3.0 > > > We seen this with S3A but it is likely to apply to the other file systems too: > If the file system raises an exception during initialize() then it is not > close()'d. Any resources threads etc created during initialisation may be > leaked. > I'm going to fix S3A to clean up internally, but the FileSystem get() and > newInstance() methods should also catch and close if an IOE or RTE is raised. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org