[GitHub] [hudi] xushiyan commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

xushiyan commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r981216616 ## rfc/rfc-51/rfc-51.md: ## @@ -148,20 +155,46 @@ hudi_cdc_table/ Under a partition directory, the `.log` file with `CDCBlock` above will keep the changing data we

[GitHub] [hudi] xushiyan commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

xushiyan commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r979374427 ## rfc/rfc-51/rfc-51.md: ## @@ -62,73 +63,79 @@ We follow the debezium output format: four columns as shown below - u: represent `update`; when `op` is `u`, both

[GitHub] [hudi] xushiyan commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

xushiyan commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r979374352 ## rfc/rfc-51/rfc-51.md: ## @@ -62,73 +63,79 @@ We follow the debezium output format: four columns as shown below - u: represent `update`; when `op` is `u`, both

[GitHub] [hudi] xushiyan commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

xushiyan commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r979372604 ## rfc/rfc-51/rfc-51.md: ## @@ -148,20 +152,27 @@ hudi_cdc_table/ Under a partition directory, the `.log` file with `CDCBlock` above will keep the changing data we

[GitHub] [hudi] xushiyan commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

xushiyan commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r979371837 ## rfc/rfc-51/rfc-51.md: ## @@ -64,69 +65,72 @@ We follow the debezium output format: four columns as shown below Note: the illustration here ignores all the Hudi

[GitHub] [hudi] xushiyan commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

xushiyan commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r979371774 ## rfc/rfc-51/rfc-51.md: ## @@ -148,20 +155,46 @@ hudi_cdc_table/ Under a partition directory, the `.log` file with `CDCBlock` above will keep the changing data we

[GitHub] [hudi] xushiyan commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

xushiyan commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r973655202 ## rfc/rfc-51/rfc-51.md: ## @@ -215,18 +245,31 @@ Note: - Only instants that are active can be queried in a CDC scenario. - `CDCReader` manages all the things on CDC,

[GitHub] [hudi] xushiyan commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

xushiyan commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r973653224 ## rfc/rfc-51/rfc-51.md: ## @@ -148,20 +152,46 @@ hudi_cdc_table/ Under a partition directory, the `.log` file with `CDCBlock` above will keep the changing data we

[GitHub] [hudi] xushiyan commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

xushiyan commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r973652274 ## rfc/rfc-51/rfc-51.md: ## @@ -62,73 +63,79 @@ We follow the debezium output format: four columns as shown below - u: represent `update`; when `op` is `u`, both

[GitHub] [hudi] xushiyan commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

xushiyan commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r969293443 ## rfc/rfc-51/rfc-51.md: ## @@ -215,18 +245,31 @@ Note: - Only instants that are active can be queried in a CDC scenario. - `CDCReader` manages all the things on CDC,

[GitHub] [hudi] xushiyan commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

xushiyan commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r965393070 ## rfc/rfc-51/rfc-51.md: ## @@ -215,18 +245,31 @@ Note: - Only instants that are active can be queried in a CDC scenario. - `CDCReader` manages all the things on CDC,

[GitHub] [hudi] xushiyan commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

xushiyan commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r965380973 ## rfc/rfc-51/rfc-51.md: ## @@ -148,20 +152,46 @@ hudi_cdc_table/ Under a partition directory, the `.log` file with `CDCBlock` above will keep the changing data we

[GitHub] [hudi] xushiyan commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

xushiyan commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r965380973 ## rfc/rfc-51/rfc-51.md: ## @@ -148,20 +152,46 @@ hudi_cdc_table/ Under a partition directory, the `.log` file with `CDCBlock` above will keep the changing data we

[GitHub] [hudi] xushiyan commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

xushiyan commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r965376782 ## rfc/rfc-51/rfc-51.md: ## @@ -64,69 +65,72 @@ We follow the debezium output format: four columns as shown below Note: the illustration here ignores all the Hudi

[GitHub] [hudi] xushiyan commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

xushiyan commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r964213596 ## rfc/rfc-51/rfc-51.md: ## @@ -64,71 +65,74 @@ We follow the debezium output format: four columns as shown below Note: the illustration here ignores all the Hudi

[GitHub] [hudi] xushiyan commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

xushiyan commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r964192075 ## rfc/rfc-51/rfc-51.md: ## @@ -42,11 +43,11 @@ In cases where Hudi tables used as streaming sources, we want to be aware of all To implement this feature, we need to

[GitHub] [hudi] xushiyan commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

xushiyan commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r964188336 ## rfc/rfc-51/rfc-51.md: ## @@ -148,20 +152,46 @@ hudi_cdc_table/ Under a partition directory, the `.log` file with `CDCBlock` above will keep the changing data we

[GitHub] [hudi] xushiyan commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

xushiyan commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r964188068 ## rfc/rfc-51/rfc-51.md: ## @@ -148,20 +152,46 @@ hudi_cdc_table/ Under a partition directory, the `.log` file with `CDCBlock` above will keep the changing data we

[GitHub] [hudi] xushiyan commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

xushiyan commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r964166807 ## rfc/rfc-51/rfc-51.md: ## @@ -64,69 +65,72 @@ We follow the debezium output format: four columns as shown below Note: the illustration here ignores all the Hudi

[GitHub] [hudi] xushiyan commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

xushiyan commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r964163474 ## rfc/rfc-51/rfc-51.md: ## @@ -64,69 +65,72 @@ We follow the debezium output format: four columns as shown below Note: the illustration here ignores all the Hudi

[GitHub] [hudi] xushiyan commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

xushiyan commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r945245688 ## rfc/rfc-51/rfc-51.md: ## @@ -64,69 +65,72 @@ We follow the debezium output format: four columns as shown below Note: the illustration here ignores all the Hudi

[GitHub] [hudi] xushiyan commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

xushiyan commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r945243884 ## rfc/rfc-51/rfc-51.md: ## @@ -64,69 +65,72 @@ We follow the debezium output format: four columns as shown below Note: the illustration here ignores all the Hudi

[GitHub] [hudi] xushiyan commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

xushiyan commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r945242880 ## rfc/rfc-51/rfc-51.md: ## @@ -64,69 +65,72 @@ We follow the debezium output format: four columns as shown below Note: the illustration here ignores all the Hudi

[GitHub] [hudi] xushiyan commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

xushiyan commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r945242513 ## rfc/rfc-51/rfc-51.md: ## @@ -64,69 +65,72 @@ We follow the debezium output format: four columns as shown below Note: the illustration here ignores all the Hudi

[GitHub] [hudi] xushiyan commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

xushiyan commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r945241280 ## rfc/rfc-51/rfc-51.md: ## @@ -148,20 +152,27 @@ hudi_cdc_table/ Under a partition directory, the `.log` file with `CDCBlock` above will keep the changing data we

[GitHub] [hudi] xushiyan commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

xushiyan commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r945241280 ## rfc/rfc-51/rfc-51.md: ## @@ -148,20 +152,27 @@ hudi_cdc_table/ Under a partition directory, the `.log` file with `CDCBlock` above will keep the changing data we

[GitHub] [hudi] xushiyan commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

xushiyan commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r945241280 ## rfc/rfc-51/rfc-51.md: ## @@ -148,20 +152,27 @@ hudi_cdc_table/ Under a partition directory, the `.log` file with `CDCBlock` above will keep the changing data we

[GitHub] [hudi] xushiyan commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

xushiyan commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r933909927 ## rfc/rfc-51/rfc-51.md: ## @@ -64,69 +65,72 @@ We follow the debezium output format: four columns as shown below Note: the illustration here ignores all the Hudi