[
https://issues.apache.org/jira/browse/HBASE-15709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15598202#comment-15598202
]
stack commented on HBASE-15709:
-------------------------------
bq. And please stop the 'write a block larger than the specific block size'
feature for HDFS in the future,...
Is there such a JIRA? Block size is advisory no? You can't cut off block at
some arbitrary limit. We'll roll the WAL when we hit block size.
Yeah, block sizing is done in the dfsclient... It'll roll block when we go over
configured size. AsyncWAL could punt to upper layer for roll for now at least.
> Handle large edits for asynchronous WAL
> ---------------------------------------
>
> Key: HBASE-15709
> URL: https://issues.apache.org/jira/browse/HBASE-15709
> Project: HBase
> Issue Type: Sub-task
> Components: io, wal
> Reporter: Duo Zhang
> Priority: Critical
>
> First, FanOutOneBlockAsyncDFSOutput can not work if the buffered data is
> larger than PacketReceiver.MAX_PACKET_SIZE(16MB).
> Second, since we only allow one block here, we need to make sure we do not
> exceed the block size after writing a large chunk of data.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
