[
https://issues.apache.org/jira/browse/HBASE-2368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12849563#action_12849563
]
Kay Kay commented on HBASE-2368:
--------------------------------
oops. cross post. But part of the answer given above - (1:N puts, with better
throughput expectation + tracking puts retries / failures ).
To add more - our rows are pretty uniform in size ( in the number of columns) ,
with the number of columns per column family the same for the entire table.
| one thing to keep in mind is we do not offer atomic guarantees for multiple
rows or API calls.
Good point, ryan. That is understandable and for our scenario, is ok to get
throughput in return. But the fact that puts are batched / flushCommitted
behind the scenes makes it hard to map the failed puts with the corresponding
input keys, for restarts.
> BulkPut - Writable class compatible with TableRecordWriter for bulk puts
> agnostic of region server mapping at Mapper/Combiner level
> ------------------------------------------------------------------------------------------------------------------------------------
>
> Key: HBASE-2368
> URL: https://issues.apache.org/jira/browse/HBASE-2368
> Project: Hadoop HBase
> Issue Type: Improvement
> Components: client
> Reporter: Kay Kay
> Fix For: 0.21.0
>
> Attachments: HBASE-2368.patch
>
>
> TableRecordWriter currently accepts only a put/delete as writables. Some
> mapper processes might want to consolidate the 'put's and insert them in
> bulk. Useful in combiners / mappers - to send across a bunch of puts from one
> stage to another , while maintaining a very similar region-server-mapping
> agnostic api at respective levels.
> New type - BulkPut ( Writable ) introduced that is just a consolidation of
> Puts. Eventually , the TableRecordWriter bulk inserts the puts together into
> the hbase eco-system.
> Patch made against trunk only. But since , it does not break any backward
> compatibility - it can be an useful addition to the branch as well.
> Let me know your comments on the same.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
