Gabor Bota created HADOOP-15796:
-----------------------------------

             Summary: ClassCastException: S3AFileSystem cannot be cast to 
MockS3AFileSystem when fs caching is disabled
                 Key: HADOOP-15796
                 URL: https://issues.apache.org/jira/browse/HADOOP-15796
             Project: Hadoop Common
          Issue Type: Bug
          Components: fs/s3
    Affects Versions: 3.1.1
            Reporter: Gabor Bota


Sometimes we get {{java.io.IOException: s3a://TEST-BUCKET: FileSystem is 
closed!}} when running tests, because of filesystem caching: an fs instance is 
closed from a test teardown while another test is still using it. (That should 
be fixed in another issue.)

To avoid test errors introduced by closed fs I've disabled fs caching while 
testing. This caused the following issue in lots of test:

{noformat}
[ERROR] 
testPartitionsResolution(org.apache.hadoop.fs.s3a.commit.staging.TestStagingPartitionedFileListing)
  Time elapsed: 1.994 s  <<< ERROR!
java.lang.ClassCastException: org.apache.hadoop.fs.s3a.S3AFileSystem cannot be 
cast to org.apache.hadoop.fs.s3a.MockS3AFileSystem
        at 
org.apache.hadoop.fs.s3a.commit.staging.StagingTestBase.lookupWrapperFS(StagingTestBase.java:145)
        at 
org.apache.hadoop.fs.s3a.commit.staging.StagingTestBase$JobCommitterTest.setupJob(StagingTestBase.java:294)
{noformat}

We should fix the casting during these tests



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Reply via email to