Ryan Pifer created HUDI-1188: -------------------------------- Summary: MOR hbase index tables not deduplicating records Key: HUDI-1188 URL: https://issues.apache.org/jira/browse/HUDI-1188 Project: Apache Hudi Issue Type: Bug Reporter: Ryan Pifer Assignee: Ryan Pifer
After fetching hbase index for a record, Hudi performs a validation that the commit timestamp stored in hbase for that record is a commit on the timeline. This makes any record that is stored to hbase index during a deltacommit (upsert on MOR table) considered an invalid commit and treated as a new record. This causes the hbase index to be updated every time which leads to records being able to be in multiple partitions and even in different file groups within same partition. -- This message was sent by Atlassian Jira (v8.3.4#803005)