[ https://issues.apache.org/jira/browse/HUDI-2809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinoth Chandar updated HUDI-2809: --------------------------------- Sprint: Hudi-Sprint-Jan-24, Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-Sprint-Jan-24, Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-7) > Introduce a checksum mechanism for validating hoodie.properties > --------------------------------------------------------------- > > Key: HUDI-2809 > URL: https://issues.apache.org/jira/browse/HUDI-2809 > Project: Apache Hudi > Issue Type: Improvement > Components: writer-core > Reporter: Vinoth Chandar > Assignee: Sagar Sumit > Priority: Blocker > Labels: pull-request-available > Fix For: 0.11.0 > > > Idea here is to add a > {_}hoodie.checksum=<hash_of_table_name{_}> > entry as the last value of hoodie.properties and throw an error if it does > not validate. this is to guard partial writes on HDFS > > Main implementation issue is use of Properties which is a hashtable, so the > entry is not added as the last value necessarily. > -- This message was sent by Atlassian Jira (v8.20.1#820001)