[ https://issues.apache.org/jira/browse/HUDI-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17112712#comment-17112712 ]
Raymond Xu commented on HUDI-648: --------------------------------- I guess RFC may not be necessary. Had a look into HoodieWriteClient and it seems that `postWrite()` `postCommit()` `completeCompaction()` are suitable places to write errors into the metadata dir. WDYT? [~vinoth][~liujinhui] > Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction > writes > ------------------------------------------------------------------------------------ > > Key: HUDI-648 > URL: https://issues.apache.org/jira/browse/HUDI-648 > Project: Apache Hudi (incubating) > Issue Type: New Feature > Components: DeltaStreamer, Spark Integration, Writer Core > Reporter: Vinoth Chandar > Priority: Major > > We would like a way to hand the erroring records from writing or compaction > back to the users, in a separate table or log. This needs to work generically > across all the different writer paths. -- This message was sent by Atlassian Jira (v8.3.4#803005)