[
https://issues.apache.org/jira/browse/HBASE-17437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yishan Yang updated HBASE-17437:
--------------------------------
Description:
Currently, the WAL and the StoreFiles need to be on the same FileSystem. Some
FileSystems (such as Amazon S3) don’t support append or consistent writes.
These two properties are imperative for the WAL in order to avoid loss of
writes. However, StoreFiles don’t necessarily need the same consistency
guarantees (since writes are cached locally and if writes fail, they can always
be replayed from the WAL).
This JIRA aims to allow users to configure a log directory (for WALs) that is
outside of the root directory or even in a different FileSystem. The default
value will still put the log directory under the root directory.
was:Currently, the WAL and the StoreFiles need to be on the same FileSystem.
Some FileSystems (such as Amazon S3) don’t support append or consistent writes.
These two properties are imperative for the WAL in order to avoid loss of
writes. However, StoreFiles don’t necessarily need the same consistency
guarantees (since writes are cached locally and if writes fail, they can always
be replayed from the WAL).
> Support specifying WAL directory to different directory with different file
> system (For example: S3)
> ----------------------------------------------------------------------------------------------------
>
> Key: HBASE-17437
> URL: https://issues.apache.org/jira/browse/HBASE-17437
> Project: HBase
> Issue Type: Bug
> Affects Versions: 1.2.4
> Reporter: Yishan Yang
> Labels: patch
> Fix For: 2.0.0, 1.2.5
>
> Attachments: hbase-17437-branch-1.2.patch, hbase-17437-master.patch
>
>
> Currently, the WAL and the StoreFiles need to be on the same FileSystem. Some
> FileSystems (such as Amazon S3) don’t support append or consistent writes.
> These two properties are imperative for the WAL in order to avoid loss of
> writes. However, StoreFiles don’t necessarily need the same consistency
> guarantees (since writes are cached locally and if writes fail, they can
> always be replayed from the WAL).
>
> This JIRA aims to allow users to configure a log directory (for WALs) that is
> outside of the root directory or even in a different FileSystem. The default
> value will still put the log directory under the root directory.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
