[ https://issues.apache.org/jira/browse/HADOOP-13651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aaron Fabbri updated HADOOP-13651: ---------------------------------- Attachment: HADOOP-13651-HADOOP-13345.002.patch Attaching v2 patch. We should consider merging this soon as it makes a lot of changes in the MetadataStore test code around the new requirement for fully-qualified paths. Implements keeping {{S3AFileStatus#isEmptyDirectory()}} updated. Also hardens treatment of Path objects, so we are consistently dealing with fully qualified paths. All unit and integration tests pass as is. If you enable LocalMetadataStore with authoritative = true (See commented-out core-site.xml changes in patch), all tests pass except I see occasional failures in {{ ITestS3AContractRootDir>AbstractContractRootDirectoryTest.testRecursiveRootListing}}. I'm still working on that one. If you enable LocalMetadataStore with authoritative = false, almost all tests are passing as well, but I think I need to fix a FS statistics delta test that is off-by-one still. > S3Guard: S3AFileSystem Integration with MetadataStore > ----------------------------------------------------- > > Key: HADOOP-13651 > URL: https://issues.apache.org/jira/browse/HADOOP-13651 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/s3 > Reporter: Aaron Fabbri > Assignee: Aaron Fabbri > Attachments: HADOOP-13651-HADOOP-13345.001.patch, > HADOOP-13651-HADOOP-13345.002.patch > > > Modify S3AFileSystem et al. to optionally use a MetadataStore for metadata > consistency and caching. > Implementation should have minimal overhead when no MetadataStore is > configured. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org