[jira] [Updated] (HUDI-7298) Write bad records to error table in more cases instead of failing stream

2024-06-06 Thread Ethan Guo (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-7298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ethan Guo updated HUDI-7298:

Fix Version/s: 0.15.0
   1.0.0

> Write bad records to error table in more cases instead of failing stream
> 
>
> Key: HUDI-7298
> URL: https://issues.apache.org/jira/browse/HUDI-7298
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: deltastreamer, spark
>Reporter: Jonathan Vexler
>Assignee: Jonathan Vexler
>Priority: Critical
>  Labels: pull-request-available
> Fix For: 0.15.0, 1.0.0
>
>
> If no transformer is used, but schema provider is used, records with the 
> incorrect schema will not be detected and will fail the stream during 
> HoodieRecord creation. Additionally, during keygeneration the stream can 
> crash if required fields are null.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (HUDI-7298) Write bad records to error table in more cases instead of failing stream

2024-01-15 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-7298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated HUDI-7298:
-
Labels: pull-request-available  (was: )

> Write bad records to error table in more cases instead of failing stream
> 
>
> Key: HUDI-7298
> URL: https://issues.apache.org/jira/browse/HUDI-7298
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: deltastreamer, spark
>Reporter: Jonathan Vexler
>Assignee: Jonathan Vexler
>Priority: Critical
>  Labels: pull-request-available
>
> If no transformer is used, but schema provider is used, records with the 
> incorrect schema will not be detected and will fail the stream during 
> HoodieRecord creation. Additionally, during keygeneration the stream can 
> crash if required fields are null.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)