[
https://issues.apache.org/jira/browse/HUDI-2199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17464856#comment-17464856
]
Biswajit mohapatra commented on HUDI-2199:
------------------------------------------
Insert and upsert is completed and testing is in progress , rollback is still
leftÂ
As dynamodb only can efficiently search using hash key and sort key and both of
them are already used by hudi primary key and partition key so using commit_ts
one gsi index needs to be created for efficent rollbackÂ
> DynamoDB based external index implementation
> --------------------------------------------
>
> Key: HUDI-2199
> URL: https://issues.apache.org/jira/browse/HUDI-2199
> Project: Apache Hudi
> Issue Type: Sub-task
> Components: Index
> Reporter: Vinoth Chandar
> Assignee: Biswajit mohapatra
> Priority: Major
>
> We have a HBaseIndex, that provides uses with ability to store fileID <=>
> recordKey mappings in an external kv store, for fast lookups during upsert
> operations. We can potentially create a similar one for DynamoDB.
> We just use a single column family in HBase, so we should be able to largely
> re-use the code/key-value schema across them even.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
