[jira] [Updated] (HUDI-2752) The MOR DELETE block breaks the event time sequence of CDC

2022-03-28 Thread Raymond Xu (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raymond Xu updated HUDI-2752:
-
Sprint: Hudi-Sprint-Jan-3, Hudi-Sprint-Jan-10, Hudi-Sprint-Feb-22, 
Hudi-Sprint-Mar-01, Hudi-Sprint-Mar-07, Hudi-Sprint-Mar-14, Hudi-Sprint-Mar-21, 
Hudi-Sprint-Mar-22  (was: Hudi-Sprint-Jan-3, Hudi-Sprint-Jan-10, 
Hudi-Sprint-Feb-22, Hudi-Sprint-Mar-01, Hudi-Sprint-Mar-07, Hudi-Sprint-Mar-14, 
Hudi-Sprint-Mar-21)

> The MOR DELETE block breaks the event time sequence of CDC
> --
>
> Key: HUDI-2752
> URL: https://issues.apache.org/jira/browse/HUDI-2752
> Project: Apache Hudi
>  Issue Type: Bug
>  Components: flink
>Reporter: Danny Chen
>Assignee: Danny Chen
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 0.11.0
>
>
> Currently, the DELETE blocks are always written after the data blocks for one 
> batch of data write, when there are INSERT/UPDATEs after the DELETE, the data 
> would lost.
> What i can thought of is that the DELETE block should at least keep the event 
> time sequence for #preCombine with other record payloads.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (HUDI-2752) The MOR DELETE block breaks the event time sequence of CDC

2022-03-22 Thread Raymond Xu (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raymond Xu updated HUDI-2752:
-
Sprint: Hudi-Sprint-Jan-3, Hudi-Sprint-Jan-10, Hudi-Sprint-Feb-22, 
Hudi-Sprint-Mar-01, Hudi-Sprint-Mar-07, Hudi-Sprint-Mar-14, Hudi-Sprint-Mar-21  
(was: Hudi-Sprint-Jan-3, Hudi-Sprint-Jan-10, Hudi-Sprint-Feb-22, 
Hudi-Sprint-Mar-01, Hudi-Sprint-Mar-07, Hudi-Sprint-Mar-14)

> The MOR DELETE block breaks the event time sequence of CDC
> --
>
> Key: HUDI-2752
> URL: https://issues.apache.org/jira/browse/HUDI-2752
> Project: Apache Hudi
>  Issue Type: Bug
>  Components: flink
>Reporter: Danny Chen
>Assignee: Danny Chen
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 0.11.0
>
>
> Currently, the DELETE blocks are always written after the data blocks for one 
> batch of data write, when there are INSERT/UPDATEs after the DELETE, the data 
> would lost.
> What i can thought of is that the DELETE block should at least keep the event 
> time sequence for #preCombine with other record payloads.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (HUDI-2752) The MOR DELETE block breaks the event time sequence of CDC

2022-03-14 Thread Raymond Xu (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raymond Xu updated HUDI-2752:
-
Story Points: 1  (was: 4)

> The MOR DELETE block breaks the event time sequence of CDC
> --
>
> Key: HUDI-2752
> URL: https://issues.apache.org/jira/browse/HUDI-2752
> Project: Apache Hudi
>  Issue Type: Bug
>  Components: flink
>Reporter: Danny Chen
>Assignee: Danny Chen
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 0.11.0
>
>
> Currently, the DELETE blocks are always written after the data blocks for one 
> batch of data write, when there are INSERT/UPDATEs after the DELETE, the data 
> would lost.
> What i can thought of is that the DELETE block should at least keep the event 
> time sequence for #preCombine with other record payloads.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (HUDI-2752) The MOR DELETE block breaks the event time sequence of CDC

2022-03-14 Thread Raymond Xu (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raymond Xu updated HUDI-2752:
-
Sprint: Hudi-Sprint-Jan-3, Hudi-Sprint-Jan-10, Hudi-Sprint-Feb-22, 
Hudi-Sprint-Mar-01, Hudi-Sprint-Mar-07, Hudi-Sprint-Mar-14  (was: 
Hudi-Sprint-Jan-3, Hudi-Sprint-Jan-10, Hudi-Sprint-Feb-22, Hudi-Sprint-Mar-01, 
Hudi-Sprint-Mar-07)

> The MOR DELETE block breaks the event time sequence of CDC
> --
>
> Key: HUDI-2752
> URL: https://issues.apache.org/jira/browse/HUDI-2752
> Project: Apache Hudi
>  Issue Type: Bug
>  Components: flink
>Reporter: Danny Chen
>Assignee: Danny Chen
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 0.11.0
>
>
> Currently, the DELETE blocks are always written after the data blocks for one 
> batch of data write, when there are INSERT/UPDATEs after the DELETE, the data 
> would lost.
> What i can thought of is that the DELETE block should at least keep the event 
> time sequence for #preCombine with other record payloads.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (HUDI-2752) The MOR DELETE block breaks the event time sequence of CDC

2022-03-07 Thread Raymond Xu (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raymond Xu updated HUDI-2752:
-
Sprint: Hudi-Sprint-Jan-3, Hudi-Sprint-Jan-10, Hudi-Sprint-Feb-22, 
Hudi-Sprint-Mar-01, Hudi-Sprint-Mar-07  (was: Hudi-Sprint-Jan-3, 
Hudi-Sprint-Jan-10, Hudi-Sprint-Feb-22, Hudi-Sprint-Mar-01)

> The MOR DELETE block breaks the event time sequence of CDC
> --
>
> Key: HUDI-2752
> URL: https://issues.apache.org/jira/browse/HUDI-2752
> Project: Apache Hudi
>  Issue Type: Bug
>  Components: flink
>Reporter: Danny Chen
>Assignee: Danny Chen
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 0.11.0
>
>
> Currently, the DELETE blocks are always written after the data blocks for one 
> batch of data write, when there are INSERT/UPDATEs after the DELETE, the data 
> would lost.
> What i can thought of is that the DELETE block should at least keep the event 
> time sequence for #preCombine with other record payloads.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (HUDI-2752) The MOR DELETE block breaks the event time sequence of CDC

2022-03-04 Thread Raymond Xu (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raymond Xu updated HUDI-2752:
-
Reviewers: Alexey Kudinkin, sivabalan narayanan  (was: Alexey Kudinkin, 
Raymond Xu, sivabalan narayanan)

> The MOR DELETE block breaks the event time sequence of CDC
> --
>
> Key: HUDI-2752
> URL: https://issues.apache.org/jira/browse/HUDI-2752
> Project: Apache Hudi
>  Issue Type: Bug
>  Components: flink
>Reporter: Danny Chen
>Assignee: Danny Chen
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 0.11.0
>
>
> Currently, the DELETE blocks are always written after the data blocks for one 
> batch of data write, when there are INSERT/UPDATEs after the DELETE, the data 
> would lost.
> What i can thought of is that the DELETE block should at least keep the event 
> time sequence for #preCombine with other record payloads.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (HUDI-2752) The MOR DELETE block breaks the event time sequence of CDC

2022-02-28 Thread Raymond Xu (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raymond Xu updated HUDI-2752:
-
Sprint: Hudi-Sprint-Jan-3, Hudi-Sprint-Jan-10, Hudi-Sprint-Feb-22, 
Hudi-Sprint-Mar-01  (was: Hudi-Sprint-Jan-3, Hudi-Sprint-Jan-10, 
Hudi-Sprint-Feb-22)

> The MOR DELETE block breaks the event time sequence of CDC
> --
>
> Key: HUDI-2752
> URL: https://issues.apache.org/jira/browse/HUDI-2752
> Project: Apache Hudi
>  Issue Type: Bug
>  Components: flink
>Reporter: Danny Chen
>Assignee: Danny Chen
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 0.11.0
>
>
> Currently, the DELETE blocks are always written after the data blocks for one 
> batch of data write, when there are INSERT/UPDATEs after the DELETE, the data 
> would lost.
> What i can thought of is that the DELETE block should at least keep the event 
> time sequence for #preCombine with other record payloads.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (HUDI-2752) The MOR DELETE block breaks the event time sequence of CDC

2022-02-28 Thread Raymond Xu (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raymond Xu updated HUDI-2752:
-
Reviewers: Alexey Kudinkin, Raymond Xu, sivabalan narayanan  (was: Alexey 
Kudinkin, Raymond Xu)

> The MOR DELETE block breaks the event time sequence of CDC
> --
>
> Key: HUDI-2752
> URL: https://issues.apache.org/jira/browse/HUDI-2752
> Project: Apache Hudi
>  Issue Type: Bug
>  Components: flink
>Reporter: Danny Chen
>Assignee: Danny Chen
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 0.11.0
>
>
> Currently, the DELETE blocks are always written after the data blocks for one 
> batch of data write, when there are INSERT/UPDATEs after the DELETE, the data 
> would lost.
> What i can thought of is that the DELETE block should at least keep the event 
> time sequence for #preCombine with other record payloads.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (HUDI-2752) The MOR DELETE block breaks the event time sequence of CDC

2022-02-25 Thread Alexey Kudinkin (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alexey Kudinkin updated HUDI-2752:
--
Reviewers: Alexey Kudinkin, Raymond Xu  (was: Raymond Xu)

> The MOR DELETE block breaks the event time sequence of CDC
> --
>
> Key: HUDI-2752
> URL: https://issues.apache.org/jira/browse/HUDI-2752
> Project: Apache Hudi
>  Issue Type: Bug
>  Components: flink
>Reporter: Danny Chen
>Assignee: Danny Chen
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 0.11.0
>
>
> Currently, the DELETE blocks are always written after the data blocks for one 
> batch of data write, when there are INSERT/UPDATEs after the DELETE, the data 
> would lost.
> What i can thought of is that the DELETE block should at least keep the event 
> time sequence for #preCombine with other record payloads.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (HUDI-2752) The MOR DELETE block breaks the event time sequence of CDC

2022-02-24 Thread Raymond Xu (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raymond Xu updated HUDI-2752:
-
Issue Type: Bug  (was: Task)

> The MOR DELETE block breaks the event time sequence of CDC
> --
>
> Key: HUDI-2752
> URL: https://issues.apache.org/jira/browse/HUDI-2752
> Project: Apache Hudi
>  Issue Type: Bug
>  Components: flink
>Reporter: Danny Chen
>Assignee: Danny Chen
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 0.11.0
>
>
> Currently, the DELETE blocks are always written after the data blocks for one 
> batch of data write, when there are INSERT/UPDATEs after the DELETE, the data 
> would lost.
> What i can thought of is that the DELETE block should at least keep the event 
> time sequence for #preCombine with other record payloads.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (HUDI-2752) The MOR DELETE block breaks the event time sequence of CDC

2022-02-23 Thread Raymond Xu (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raymond Xu updated HUDI-2752:
-
Sprint: Hudi-Sprint-Jan-3, Hudi-Sprint-Jan-10, Hudi-Sprint-Feb-22  (was: 
Hudi-Sprint-Jan-3, Hudi-Sprint-Jan-10)

> The MOR DELETE block breaks the event time sequence of CDC
> --
>
> Key: HUDI-2752
> URL: https://issues.apache.org/jira/browse/HUDI-2752
> Project: Apache Hudi
>  Issue Type: Task
>  Components: flink
>Reporter: Danny Chen
>Assignee: Danny Chen
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 0.11.0
>
>
> Currently, the DELETE blocks are always written after the data blocks for one 
> batch of data write, when there are INSERT/UPDATEs after the DELETE, the data 
> would lost.
> What i can thought of is that the DELETE block should at least keep the event 
> time sequence for #preCombine with other record payloads.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (HUDI-2752) The MOR DELETE block breaks the event time sequence of CDC

2022-02-22 Thread Raymond Xu (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raymond Xu updated HUDI-2752:
-
Reviewers: Raymond Xu

> The MOR DELETE block breaks the event time sequence of CDC
> --
>
> Key: HUDI-2752
> URL: https://issues.apache.org/jira/browse/HUDI-2752
> Project: Apache Hudi
>  Issue Type: Task
>  Components: flink
>Reporter: Danny Chen
>Assignee: Danny Chen
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 0.11.0
>
>
> Currently, the DELETE blocks are always written after the data blocks for one 
> batch of data write, when there are INSERT/UPDATEs after the DELETE, the data 
> would lost.
> What i can thought of is that the DELETE block should at least keep the event 
> time sequence for #preCombine with other record payloads.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (HUDI-2752) The MOR DELETE block breaks the event time sequence of CDC

2022-02-22 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated HUDI-2752:
-
Labels: pull-request-available  (was: )

> The MOR DELETE block breaks the event time sequence of CDC
> --
>
> Key: HUDI-2752
> URL: https://issues.apache.org/jira/browse/HUDI-2752
> Project: Apache Hudi
>  Issue Type: Task
>  Components: flink
>Reporter: Danny Chen
>Assignee: Alexey Kudinkin
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 0.11.0
>
>
> Currently, the DELETE blocks are always written after the data blocks for one 
> batch of data write, when there are INSERT/UPDATEs after the DELETE, the data 
> would lost.
> What i can thought of is that the DELETE block should at least keep the event 
> time sequence for #preCombine with other record payloads.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (HUDI-2752) The MOR DELETE block breaks the event time sequence of CDC

2022-01-10 Thread Vinoth Chandar (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vinoth Chandar updated HUDI-2752:
-
Story Points: 4

> The MOR DELETE block breaks the event time sequence of CDC
> --
>
> Key: HUDI-2752
> URL: https://issues.apache.org/jira/browse/HUDI-2752
> Project: Apache Hudi
>  Issue Type: Task
>  Components: Flink Integration
>Reporter: Danny Chen
>Assignee: Alexey Kudinkin
>Priority: Blocker
> Fix For: 0.11.0
>
>
> Currently, the DELETE blocks are always written after the data blocks for one 
> batch of data write, when there are INSERT/UPDATEs after the DELETE, the data 
> would lost.
> What i can thought of is that the DELETE block should at least keep the event 
> time sequence for #preCombine with other record payloads.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (HUDI-2752) The MOR DELETE block breaks the event time sequence of CDC

2022-01-10 Thread Vinoth Chandar (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vinoth Chandar updated HUDI-2752:
-
Sprint: Hudi-Sprint-Jan-3, Hudi-Sprint-Jan-10  (was: Hudi-Sprint-Jan-3)

> The MOR DELETE block breaks the event time sequence of CDC
> --
>
> Key: HUDI-2752
> URL: https://issues.apache.org/jira/browse/HUDI-2752
> Project: Apache Hudi
>  Issue Type: Task
>  Components: Flink Integration
>Reporter: Danny Chen
>Assignee: Alexey Kudinkin
>Priority: Blocker
> Fix For: 0.11.0
>
>
> Currently, the DELETE blocks are always written after the data blocks for one 
> batch of data write, when there are INSERT/UPDATEs after the DELETE, the data 
> would lost.
> What i can thought of is that the DELETE block should at least keep the event 
> time sequence for #preCombine with other record payloads.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (HUDI-2752) The MOR DELETE block breaks the event time sequence of CDC

2022-01-03 Thread Vinoth Chandar (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vinoth Chandar updated HUDI-2752:
-
Sprint: Hudi-Sprint-Jan-3

> The MOR DELETE block breaks the event time sequence of CDC
> --
>
> Key: HUDI-2752
> URL: https://issues.apache.org/jira/browse/HUDI-2752
> Project: Apache Hudi
>  Issue Type: Task
>  Components: Flink Integration
>Reporter: Danny Chen
>Assignee: Alexey Kudinkin
>Priority: Blocker
> Fix For: 0.11.0
>
>
> Currently, the DELETE blocks are always written after the data blocks for one 
> batch of data write, when there are INSERT/UPDATEs after the DELETE, the data 
> would lost.
> What i can thought of is that the DELETE block should at least keep the event 
> time sequence for #preCombine with other record payloads.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (HUDI-2752) The MOR DELETE block breaks the event time sequence of CDC

2021-11-18 Thread Rajesh Mahindra (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rajesh Mahindra updated HUDI-2752:
--
Priority: Blocker  (was: Major)

> The MOR DELETE block breaks the event time sequence of CDC
> --
>
> Key: HUDI-2752
> URL: https://issues.apache.org/jira/browse/HUDI-2752
> Project: Apache Hudi
>  Issue Type: Sub-task
>  Components: Flink Integration
>Reporter: Danny Chen
>Priority: Blocker
> Fix For: 0.11.0
>
>
> Currently, the DELETE blocks are always written after the data blocks for one 
> batch of data write, when there are INSERT/UPDATEs after the DELETE, the data 
> would lost.
> What i can thought of is that the DELETE block should at least keep the event 
> time sequence for #preCombine with other record payloads.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)