Hi all,
I'd like to bring up this discussion around handling errors in Hudi write
paths.
https://issues.apache.org/jira/browse/HUDI-648
Trying to gather some feedbacks about the implementation details
1. Error location
I'm thinking of writing the failed records to `.hoodie/errors/` for
a) encapsu
Hi Raymond,
Thanks for starting this discussion.
Agree on 1.. (we may also need some CLI support for inspecting bad/record
and also code samples to consume them etc?)
On 2, these place seem appropriate. We can figure it out, in more detail
when we get to implementation?
On 3. +1 on logs.. We sh
Thank you for the feedback, Vinoth. Agreed with your points. Also created a
small RFC for easy alignment on the changes
https://cwiki.apache.org/confluence/display/HUDI/RFC+-+20+%3A+handle+failed+records
On Sun, May 24, 2020 at 12:06 AM Vinoth Chandar wrote:
> Hi Raymond,
>
> Thanks for starting
Thanks! Will review and get back to you
On Tue, Jun 2, 2020 at 10:37 AM Shiyan Xu
wrote:
> Thank you for the feedback, Vinoth. Agreed with your points. Also created a
> small RFC for easy alignment on the changes
>
> https://cwiki.apache.org/confluence/display/HUDI/RFC+-+20+%3A+handle+failed+rec
