[jira] [Updated] (HUDI-3330) TestHoodieDeltaStreamerWithMultiWriter: Use HoodieTestDataGenerator to generate backfill dataset

2022-01-31 Thread Rajesh Mahindra (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-3330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rajesh Mahindra updated HUDI-3330:
--
Sprint: Hudi-Sprint-Jan-24, Hudi-Sprint-Jan-31  (was: Hudi-Sprint-Jan-24)

> TestHoodieDeltaStreamerWithMultiWriter: Use HoodieTestDataGenerator to 
> generate backfill dataset
> 
>
> Key: HUDI-3330
> URL: https://issues.apache.org/jira/browse/HUDI-3330
> Project: Apache Hudi
>  Issue Type: Task
>Reporter: Manoj Govindassamy
>Assignee: Raymond Xu
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 0.11.0
>
>
> TestHoodieDeltaStreamerWithMultiWriter uses zip artifacts with pre-generated 
> dataset for its backfill jobs. Anytime the metadata table schema changes, the 
> records in the artifacts need to be regenerated. Better if we can do the 
> standard way of dataset generation using HoodieTestDataGenerator for this 
> test.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (HUDI-3330) TestHoodieDeltaStreamerWithMultiWriter: Use HoodieTestDataGenerator to generate backfill dataset

2022-01-27 Thread Raymond Xu (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-3330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raymond Xu updated HUDI-3330:
-
Status: In Progress  (was: Open)

> TestHoodieDeltaStreamerWithMultiWriter: Use HoodieTestDataGenerator to 
> generate backfill dataset
> 
>
> Key: HUDI-3330
> URL: https://issues.apache.org/jira/browse/HUDI-3330
> Project: Apache Hudi
>  Issue Type: Task
>Reporter: Manoj Govindassamy
>Assignee: Raymond Xu
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 0.11.0
>
>
> TestHoodieDeltaStreamerWithMultiWriter uses zip artifacts with pre-generated 
> dataset for its backfill jobs. Anytime the metadata table schema changes, the 
> records in the artifacts need to be regenerated. Better if we can do the 
> standard way of dataset generation using HoodieTestDataGenerator for this 
> test.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (HUDI-3330) TestHoodieDeltaStreamerWithMultiWriter: Use HoodieTestDataGenerator to generate backfill dataset

2022-01-27 Thread Raymond Xu (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-3330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raymond Xu updated HUDI-3330:
-
Status: Patch Available  (was: In Progress)

> TestHoodieDeltaStreamerWithMultiWriter: Use HoodieTestDataGenerator to 
> generate backfill dataset
> 
>
> Key: HUDI-3330
> URL: https://issues.apache.org/jira/browse/HUDI-3330
> Project: Apache Hudi
>  Issue Type: Task
>Reporter: Manoj Govindassamy
>Assignee: Raymond Xu
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 0.11.0
>
>
> TestHoodieDeltaStreamerWithMultiWriter uses zip artifacts with pre-generated 
> dataset for its backfill jobs. Anytime the metadata table schema changes, the 
> records in the artifacts need to be regenerated. Better if we can do the 
> standard way of dataset generation using HoodieTestDataGenerator for this 
> test.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (HUDI-3330) TestHoodieDeltaStreamerWithMultiWriter: Use HoodieTestDataGenerator to generate backfill dataset

2022-01-27 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-3330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated HUDI-3330:
-
Labels: pull-request-available  (was: )

> TestHoodieDeltaStreamerWithMultiWriter: Use HoodieTestDataGenerator to 
> generate backfill dataset
> 
>
> Key: HUDI-3330
> URL: https://issues.apache.org/jira/browse/HUDI-3330
> Project: Apache Hudi
>  Issue Type: Task
>Reporter: Manoj Govindassamy
>Assignee: Raymond Xu
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 0.11.0
>
>
> TestHoodieDeltaStreamerWithMultiWriter uses zip artifacts with pre-generated 
> dataset for its backfill jobs. Anytime the metadata table schema changes, the 
> records in the artifacts need to be regenerated. Better if we can do the 
> standard way of dataset generation using HoodieTestDataGenerator for this 
> test.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (HUDI-3330) TestHoodieDeltaStreamerWithMultiWriter: Use HoodieTestDataGenerator to generate backfill dataset

2022-01-26 Thread Raymond Xu (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-3330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raymond Xu updated HUDI-3330:
-
Sprint: Hudi-Sprint-Jan-24

> TestHoodieDeltaStreamerWithMultiWriter: Use HoodieTestDataGenerator to 
> generate backfill dataset
> 
>
> Key: HUDI-3330
> URL: https://issues.apache.org/jira/browse/HUDI-3330
> Project: Apache Hudi
>  Issue Type: Task
>Reporter: Manoj Govindassamy
>Assignee: Raymond Xu
>Priority: Blocker
> Fix For: 0.11.0
>
>
> TestHoodieDeltaStreamerWithMultiWriter uses zip artifacts with pre-generated 
> dataset for its backfill jobs. Anytime the metadata table schema changes, the 
> records in the artifacts need to be regenerated. Better if we can do the 
> standard way of dataset generation using HoodieTestDataGenerator for this 
> test.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (HUDI-3330) TestHoodieDeltaStreamerWithMultiWriter: Use HoodieTestDataGenerator to generate backfill dataset

2022-01-26 Thread Raymond Xu (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-3330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raymond Xu updated HUDI-3330:
-
Story Points: 1

> TestHoodieDeltaStreamerWithMultiWriter: Use HoodieTestDataGenerator to 
> generate backfill dataset
> 
>
> Key: HUDI-3330
> URL: https://issues.apache.org/jira/browse/HUDI-3330
> Project: Apache Hudi
>  Issue Type: Task
>Reporter: Manoj Govindassamy
>Assignee: Raymond Xu
>Priority: Blocker
> Fix For: 0.11.0
>
>
> TestHoodieDeltaStreamerWithMultiWriter uses zip artifacts with pre-generated 
> dataset for its backfill jobs. Anytime the metadata table schema changes, the 
> records in the artifacts need to be regenerated. Better if we can do the 
> standard way of dataset generation using HoodieTestDataGenerator for this 
> test.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)