[ https://issues.apache.org/jira/browse/HBASE-20429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16443065#comment-16443065 ]
Umesh Agashe commented on HBASE-20429: -------------------------------------- [~apurtell], [~zyork]: HBASE-14090 had multiple objectives and one of them was supporting file systems other than HDFS. Currently that work is on hold. I also found that along with atomic rename, at couple of places we check file permissions (rwx) which is not supported by, say, S3. > Support for mixed or write-heavy workloads on non-HDFS filesystems > ------------------------------------------------------------------ > > Key: HBASE-20429 > URL: https://issues.apache.org/jira/browse/HBASE-20429 > Project: HBase > Issue Type: Umbrella > Reporter: Andrew Purtell > Priority: Major > > We can support reasonably well use cases on non-HDFS filesystems, like S3, > where an external writer has loaded (and continues to load) HFiles via the > bulk load mechanism, and then we serve out a read only workload at the HBase > API. > Mixed workloads or write-heavy workloads won't fare as well. In fact, data > loss seems certain. It will depend in the specific filesystem, but all of the > S3 backed Hadoop filesystems suffer from a couple of obvious problems, > notably a lack of atomic rename. > This umbrella will serve to collect some related ideas for consideration. -- This message was sent by Atlassian JIRA (v7.6.3#76005)