[GitHub] [hudi] hudi-bot commented on pull request #6491: [HUDI-4714] HoodieFlinkWriteClient can't load callback config to Hood…

hudi-bot commented on PR #6491: URL: https://github.com/apache/hudi/pull/6491#issuecomment-1228125027 ## CI report: * 2883376d8b111516cd5997822ff1326d1db9cae2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1094

[GitHub] [hudi] hudi-bot commented on pull request #6489: [HUDI-4485] [cli] Bumped spring shell to 2.1.1. Updated the default …

hudi-bot commented on PR #6489: URL: https://github.com/apache/hudi/pull/6489#issuecomment-1228125005 ## CI report: * 47680402da599615de30c13a1f22f79f3573ee30 UNKNOWN * 5613f14b3d5f1c8aaf8de1730e2f21b78a657150 UNKNOWN * a0e2f520a7f422bd396b984c3cec2c5653a41743 Azure: [FAILUR

[GitHub] [hudi] hudi-bot commented on pull request #6139: [HUDI-4396] Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes

hudi-bot commented on PR #6139: URL: https://github.com/apache/hudi/pull/6139#issuecomment-1228124552 ## CI report: * a9e86bb7588ad10579e2ef02a0e41f1ce661aeaa Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1090

[GitHub] [hudi] hudi-bot commented on pull request #6491: [HUDI-4714] HoodieFlinkWriteClient can't load callback config to Hood…

hudi-bot commented on PR #6491: URL: https://github.com/apache/hudi/pull/6491#issuecomment-1228121493 ## CI report: * 2883376d8b111516cd5997822ff1326d1db9cae2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1094

[GitHub] [hudi] hudi-bot commented on pull request #6139: [HUDI-4396] Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes

hudi-bot commented on PR #6139: URL: https://github.com/apache/hudi/pull/6139#issuecomment-1228121019 ## CI report: * a9e86bb7588ad10579e2ef02a0e41f1ce661aeaa Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1090

[GitHub] [hudi] danny0405 commented on a diff in pull request #6384: [HUDI-4613] Avoid the use of regex expressions when call hoodieFileGroup#addLogFile function

danny0405 commented on code in PR #6384: URL: https://github.com/apache/hudi/pull/6384#discussion_r955711974 ## hudi-common/src/main/java/org/apache/hudi/common/fs/FSUtils.java: ## @@ -64,19 +64,17 @@ import java.util.function.Function; import java.util.function.Predicate; im

[GitHub] [hudi] paul8263 commented on pull request #6489: [HUDI-4485] [cli] Bumped spring shell to 2.1.1. Updated the default …

paul8263 commented on PR #6489: URL: https://github.com/apache/hudi/pull/6489#issuecomment-1228117137 The unit test crashed on hudi_utilities_2.11 as insufficient heap memory. Plan to increase the limit to 4G. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hudi] JerryYue-M commented on pull request #6491: [HUDI-4714] HoodieFlinkWriteClient can't load callback config to Hood…

JerryYue-M commented on PR #6491: URL: https://github.com/apache/hudi/pull/6491#issuecomment-1228105210 > > Can you rebase the latest master and force-push again @danny0405 done ,thanks -- This is an automated message from the Apache Git Service. To respond to the m

[GitHub] [hudi] honeyaya commented on a diff in pull request #6139: [HUDI-4396] Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes

honeyaya commented on code in PR #6139: URL: https://github.com/apache/hudi/pull/6139#discussion_r955694404 ## hudi-sync/hudi-hive-sync/src/main/java/org/apache/hudi/hive/HiveSyncConfig.java: ## @@ -129,6 +129,8 @@ public static class HiveSyncConfigParams { public Boolean c

[GitHub] [hudi] hudi-bot commented on pull request #6384: [HUDI-4613] Avoid the use of regex expressions when call hoodieFileGroup#addLogFile function

hudi-bot commented on PR #6384: URL: https://github.com/apache/hudi/pull/6384#issuecomment-1228077953 ## CI report: * be94781340ba821d5de240c1a4eed249efa2e0db Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1075

[GitHub] [hudi] hudi-bot commented on pull request #6384: [HUDI-4613] Avoid the use of regex expressions when call hoodieFileGroup#addLogFile function

hudi-bot commented on PR #6384: URL: https://github.com/apache/hudi/pull/6384#issuecomment-1228073942 ## CI report: * be94781340ba821d5de240c1a4eed249efa2e0db Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1075

[GitHub] [hudi] hudi-bot commented on pull request #5629: [HUDI-3384][HUDI-3385] Spark specific file reader/writer.

hudi-bot commented on PR #5629: URL: https://github.com/apache/hudi/pull/5629#issuecomment-1228073114 ## CI report: * d0f078159313f8b35a41b1d1e016583204811383 UNKNOWN * 8bd34a6bee3084bdc6029f3c0740cf06906acfd5 UNKNOWN * 858a47a5b106462a5089ecf77278196bc7c7a0a8 Azure: [FAILUR

[GitHub] [hudi] ThinkerLei commented on a diff in pull request #6384: [HUDI-4613] Avoid the use of regex expressions when call hoodieFileGroup#addLogFile function

ThinkerLei commented on code in PR #6384: URL: https://github.com/apache/hudi/pull/6384#discussion_r955653574 ## hudi-common/src/main/java/org/apache/hudi/common/fs/FSUtils.java: ## @@ -64,19 +64,17 @@ import java.util.function.Function; import java.util.function.Predicate; i

[GitHub] [hudi] danny0405 commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

danny0405 commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r955645966 ## rfc/rfc-51/rfc-51.md: ## @@ -215,18 +245,31 @@ Note: - Only instants that are active can be queried in a CDC scenario. - `CDCReader` manages all the things on CDC,

[GitHub] [hudi] danny0405 commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

danny0405 commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r955644523 ## rfc/rfc-51/rfc-51.md: ## @@ -148,20 +152,46 @@ hudi_cdc_table/ Under a partition directory, the `.log` file with `CDCBlock` above will keep the changing data we ha

[GitHub] [hudi] danny0405 commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

danny0405 commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r955643711 ## rfc/rfc-51/rfc-51.md: ## @@ -148,20 +152,46 @@ hudi_cdc_table/ Under a partition directory, the `.log` file with `CDCBlock` above will keep the changing data we ha

[GitHub] [hudi] danny0405 commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

danny0405 commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r955642598 ## rfc/rfc-51/rfc-51.md: ## @@ -64,69 +65,72 @@ We follow the debezium output format: four columns as shown below Note: the illustration here ignores all the Hudi met

[GitHub] [hudi] danny0405 commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

danny0405 commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r955641659 ## rfc/rfc-51/rfc-51.md: ## @@ -64,71 +65,74 @@ We follow the debezium output format: four columns as shown below Note: the illustration here ignores all the Hudi met

[GitHub] [hudi] danny0405 commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

danny0405 commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r955641659 ## rfc/rfc-51/rfc-51.md: ## @@ -64,71 +65,74 @@ We follow the debezium output format: four columns as shown below Note: the illustration here ignores all the Hudi met

[GitHub] [hudi] hudi-bot commented on pull request #6347: [HUDI-4582] Support batch synchronization of partition to hive metastore to avoid timeout with --sync-mode="hms" and use-jdbc=false

hudi-bot commented on PR #6347: URL: https://github.com/apache/hudi/pull/6347#issuecomment-1228042484 ## CI report: * 386a9eb87a073a4c956fc5f5329701feeb012227 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1070

[GitHub] [hudi] danny0405 commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

danny0405 commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r955640553 ## rfc/rfc-51/rfc-51.md: ## @@ -64,71 +65,74 @@ We follow the debezium output format: four columns as shown below Note: the illustration here ignores all the Hudi met

[GitHub] [hudi] hudi-bot commented on pull request #6347: [HUDI-4582] Support batch synchronization of partition to hive metastore to avoid timeout with --sync-mode="hms" and use-jdbc=false

hudi-bot commented on PR #6347: URL: https://github.com/apache/hudi/pull/6347#issuecomment-1228039780 ## CI report: * 386a9eb87a073a4c956fc5f5329701feeb012227 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1070

[GitHub] [hudi] danny0405 commented on a diff in pull request #6256: [RFC-51][HUDI-3478] Update RFC: CDC support

danny0405 commented on code in PR #6256: URL: https://github.com/apache/hudi/pull/6256#discussion_r955638291 ## rfc/rfc-51/rfc-51.md: ## @@ -42,11 +43,11 @@ In cases where Hudi tables used as streaming sources, we want to be aware of all To implement this feature, we need to

[GitHub] [hudi] hudi-bot commented on pull request #6438: [HUDI-4642] Adding support to hudi-cli to repair depcrated partition

hudi-bot commented on PR #6438: URL: https://github.com/apache/hudi/pull/6438#issuecomment-1228037192 ## CI report: * 9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1096

[GitHub] [hudi] hudi-bot commented on pull request #6489: [HUDI-4485] [cli] Bumped spring shell to 2.1.1. Updated the default …

hudi-bot commented on PR #6489: URL: https://github.com/apache/hudi/pull/6489#issuecomment-1228037279 ## CI report: * 47680402da599615de30c13a1f22f79f3573ee30 UNKNOWN * 5613f14b3d5f1c8aaf8de1730e2f21b78a657150 UNKNOWN * a0e2f520a7f422bd396b984c3cec2c5653a41743 Azure: [FAILUR

[GitHub] [hudi] danny0405 commented on a diff in pull request #6384: [HUDI-4613] Avoid the use of regex expressions when call hoodieFileGroup#addLogFile function

danny0405 commented on code in PR #6384: URL: https://github.com/apache/hudi/pull/6384#discussion_r955636239 ## hudi-common/src/main/java/org/apache/hudi/common/fs/FSUtils.java: ## @@ -64,19 +64,17 @@ import java.util.function.Function; import java.util.function.Predicate; im

[GitHub] [hudi] danny0405 commented on pull request #6491: [HUDI-4714] HoodieFlinkWriteClient can't load callback config to Hood…

danny0405 commented on PR #6491: URL: https://github.com/apache/hudi/pull/6491#issuecomment-1228035391 Can you rebase the latest master and force-push again -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hudi] honeyaya commented on a diff in pull request #6347: [HUDI-4582] Support batch synchronization of partition to hive metastore to avoid timeout with --sync-mode="hms" and use-jdbc=false

honeyaya commented on code in PR #6347: URL: https://github.com/apache/hudi/pull/6347#discussion_r955632739 ## hudi-sync/hudi-hive-sync/src/main/java/org/apache/hudi/hive/ddl/HMSDDLExecutor.java: ## @@ -192,18 +194,31 @@ public void addPartitionsToTable(String tableName, List p

[GitHub] [hudi] honeyaya commented on a diff in pull request #6347: [HUDI-4582] Support batch synchronization of partition to hive metastore to avoid timeout with --sync-mode="hms" and use-jdbc=false

honeyaya commented on code in PR #6347: URL: https://github.com/apache/hudi/pull/6347#discussion_r955632261 ## hudi-sync/hudi-hive-sync/src/main/java/org/apache/hudi/hive/ddl/HMSDDLExecutor.java: ## @@ -192,18 +194,31 @@ public void addPartitionsToTable(String tableName, List p

[jira] [Updated] (HUDI-4721) Fix thread safety w/ RemoteTableFileSystemView

[ https://issues.apache.org/jira/browse/HUDI-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-4721: - Fix Version/s: 0.12.1 > Fix thread safety w/ RemoteTableFileSystemView >

[GitHub] [hudi] xiarixiaoyao commented on issue #6496: [SUPPORT] Hudi schema evolution, Null for oldest values

xiarixiaoyao commented on issue #6496: URL: https://github.com/apache/hudi/issues/6496#issuecomment-1228023484 @Armelabdelkbir spark now not support default value， maybe https://github.com/apache/spark/pull/36672/files can help you， thanks -- This is an automated message from the Apac

[GitHub] [hudi] danny0405 opened a new pull request, #6507: [DO NOT MERGE] 0.12.0 release patch branch

danny0405 opened a new pull request, #6507: URL: https://github.com/apache/hudi/pull/6507 ### Change Logs _Describe context and summary for this change. Highlight if any code was copied._ ### Impact _Describe any public API or user-facing feature change or any performanc

[GitHub] [hudi] kk17 commented on pull request #5920: [HUDI-4326] add updateTableSerDeInfo for HiveSyncTool

kk17 commented on PR #5920: URL: https://github.com/apache/hudi/pull/5920#issuecomment-1228016989 @nsivabalan @minihippo minihippowill try to add a test in the next two coming weeks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

[GitHub] [hudi] veenaypatil commented on a diff in pull request #6111: [HUDI-4399][RFC-57] Protobuf support in DeltaStreamer

veenaypatil commented on code in PR #6111: URL: https://github.com/apache/hudi/pull/6111#discussion_r955617721 ## rfc/rfc-57/rfc-57.md: ## @@ -0,0 +1,85 @@ + +# RFC-57: DeltaStreamer Protobuf Support + + + +## Proposers + +- @the-other-tim-brown + +## Approvers +- @bhasudha +- @

[GitHub] [hudi] hudi-bot commented on pull request #6387: [HUDI-4615] Return checkpoint as null for empty data from events queue.

hudi-bot commented on PR #6387: URL: https://github.com/apache/hudi/pull/6387#issuecomment-1228010409 ## CI report: * fb86adcdcf26b1565cccf6e89c30c6058477cd85 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1096

[GitHub] [hudi] hudi-bot commented on pull request #6500: [HUDI-4720] Fix HoodieInternalRow return wrong num of fields when sou…

hudi-bot commented on PR #6500: URL: https://github.com/apache/hudi/pull/6500#issuecomment-1228008168 ## CI report: * 5edcd57668db6ed3de47f484020d00600b3e8d81 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1095

[GitHub] [hudi] hudi-bot commented on pull request #6486: [HUDI-4706] Fix InternalSchemaChangeApplier#applyAddChange error to add nest type

hudi-bot commented on PR #6486: URL: https://github.com/apache/hudi/pull/6486#issuecomment-1228008105 ## CI report: * d6b7c487e76c46460a2fb0c9647aeea901d17995 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1092

[GitHub] [hudi] hudi-bot commented on pull request #5629: [HUDI-3384][HUDI-3385] Spark specific file reader/writer.

hudi-bot commented on PR #5629: URL: https://github.com/apache/hudi/pull/5629#issuecomment-1228007439 ## CI report: * d0f078159313f8b35a41b1d1e016583204811383 UNKNOWN * 8bd34a6bee3084bdc6029f3c0740cf06906acfd5 UNKNOWN * 64ddff55a9f3083be754e0951bf5f082fecca9e5 Azure: [FAILUR

[GitHub] [hudi] hudi-bot commented on pull request #6500: [HUDI-4720] Fix HoodieInternalRow return wrong num of fields when sou…

hudi-bot commented on PR #6500: URL: https://github.com/apache/hudi/pull/6500#issuecomment-1228005628 ## CI report: * 5edcd57668db6ed3de47f484020d00600b3e8d81 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1095

[GitHub] [hudi] hudi-bot commented on pull request #6499: [HUDI-4703] use the historical schema to response time travel query

hudi-bot commented on PR #6499: URL: https://github.com/apache/hudi/pull/6499#issuecomment-1228005604 ## CI report: * 91e047073b4ff4389bf1e3e4f5ce59342756ebd1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1095

[GitHub] [hudi] hudi-bot commented on pull request #6486: [HUDI-4706] Fix InternalSchemaChangeApplier#applyAddChange error to add nest type

hudi-bot commented on PR #6486: URL: https://github.com/apache/hudi/pull/6486#issuecomment-1228005564 ## CI report: * d6b7c487e76c46460a2fb0c9647aeea901d17995 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1092

[GitHub] [hudi] hudi-bot commented on pull request #5629: [HUDI-3384][HUDI-3385] Spark specific file reader/writer.

hudi-bot commented on PR #5629: URL: https://github.com/apache/hudi/pull/5629#issuecomment-1228004890 ## CI report: * d0f078159313f8b35a41b1d1e016583204811383 UNKNOWN * 8bd34a6bee3084bdc6029f3c0740cf06906acfd5 UNKNOWN * 64ddff55a9f3083be754e0951bf5f082fecca9e5 Azure: [FAILUR

[GitHub] [hudi] hudi-bot commented on pull request #6506: Allow hoodie read client to choose index

hudi-bot commented on PR #6506: URL: https://github.com/apache/hudi/pull/6506#issuecomment-1228000512 ## CI report: * 48a24245761ca6a1b910aa2f39ba1fb2a596a048 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1096

[GitHub] [hudi] hudi-bot commented on pull request #6499: [HUDI-4703] use the historical schema to response time travel query

hudi-bot commented on PR #6499: URL: https://github.com/apache/hudi/pull/6499#issuecomment-1228000366 ## CI report: * 91e047073b4ff4389bf1e3e4f5ce59342756ebd1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1095

[GitHub] [hudi] YannByron commented on pull request #6499: [HUDI-4703] use the historical schema to response time travel query

YannByron commented on PR #6499: URL: https://github.com/apache/hudi/pull/6499#issuecomment-1227975465 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

[GitHub] [hudi] wzx140 commented on a diff in pull request #6500: [HUDI-4720] Fix HoodieInternalRow return wrong num of fields when sou…

wzx140 commented on code in PR #6500: URL: https://github.com/apache/hudi/pull/6500#discussion_r955588339 ## hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/model/HoodieInternalRow.java: ## @@ -94,7 +94,11 @@ private HoodieInternalRow(UTF8String[] metaFields,

[GitHub] [hudi] LinMingQiang commented on pull request #6393: [HUDI-4619] Fix The retry mechanism of remotehoodietablefilesystemvie…

LinMingQiang commented on PR #6393: URL: https://github.com/apache/hudi/pull/6393#issuecomment-1227964420 I understand what you mean. I'll fix it here. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [hudi] hudi-bot commented on pull request #6489: [HUDI-4485] [cli] Bumped spring shell to 2.1.1. Updated the default …

hudi-bot commented on PR #6489: URL: https://github.com/apache/hudi/pull/6489#issuecomment-1227964038 ## CI report: * 47680402da599615de30c13a1f22f79f3573ee30 UNKNOWN * 5613f14b3d5f1c8aaf8de1730e2f21b78a657150 UNKNOWN * b26294c07ac06186c66a10444e7677656be94037 Azure: [FAILUR

[GitHub] [hudi] hudi-bot commented on pull request #6489: [HUDI-4485] [cli] Bumped spring shell to 2.1.1. Updated the default …

hudi-bot commented on PR #6489: URL: https://github.com/apache/hudi/pull/6489#issuecomment-1227958050 ## CI report: * 47680402da599615de30c13a1f22f79f3573ee30 UNKNOWN * 5613f14b3d5f1c8aaf8de1730e2f21b78a657150 UNKNOWN * b26294c07ac06186c66a10444e7677656be94037 Azure: [FAILUR

[GitHub] [hudi] hudi-bot commented on pull request #6505: AwsglueSync Turn already exist error into warning

hudi-bot commented on PR #6505: URL: https://github.com/apache/hudi/pull/6505#issuecomment-1227947525 ## CI report: * 24c8b543afd26438898efff96c98c81130c9ca54 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1096

[GitHub] [hudi] danny0405 commented on a diff in pull request #5884: [HUDI-3669] Add a remote request retry mechanism for 'Remotehoodietablefiles…

danny0405 commented on code in PR #5884: URL: https://github.com/apache/hudi/pull/5884#discussion_r955568822 ## hudi-common/src/main/java/org/apache/hudi/common/table/view/RemoteHoodieTableFileSystemView.java: ## @@ -165,17 +179,9 @@ private T executeRequest(String requestPath,

[GitHub] [hudi] brskiran1 commented on issue #6304: Hudi MultiTable Deltastreamer not updating glue catalog when new column added on Source

brskiran1 commented on issue #6304: URL: https://github.com/apache/hudi/issues/6304#issuecomment-1227907870 @rmahindra123 please let me know if you have an update on this? I have tried with hoodie.schema.on.read.enable ==true but still no change -- This is an automated message from the A

[GitHub] [hudi] hudi-bot commented on pull request #6387: [HUDI-4615] Return checkpoint as null for empty data from events queue.

hudi-bot commented on PR #6387: URL: https://github.com/apache/hudi/pull/6387#issuecomment-1227900507 ## CI report: * bdddf2706b8e0e362ad2777282ade733a45d8f03 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1075

[GitHub] [hudi] hudi-bot commented on pull request #6438: [HUDI-4642] Adding support to hudi-cli to repair depcrated partition

hudi-bot commented on PR #6438: URL: https://github.com/apache/hudi/pull/6438#issuecomment-1227900600 ## CI report: * fea65135a8035ef70929759594da64dc985a2d0a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1092

[GitHub] [hudi] hudi-bot commented on pull request #6438: [HUDI-4642] Adding support to hudi-cli to repair depcrated partition

hudi-bot commented on PR #6438: URL: https://github.com/apache/hudi/pull/6438#issuecomment-1227897904 ## CI report: * fea65135a8035ef70929759594da64dc985a2d0a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1092

[GitHub] [hudi] hudi-bot commented on pull request #6387: [HUDI-4615] Return checkpoint as null for empty data from events queue.

hudi-bot commented on PR #6387: URL: https://github.com/apache/hudi/pull/6387#issuecomment-1227897790 ## CI report: * bdddf2706b8e0e362ad2777282ade733a45d8f03 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1075

[GitHub] [hudi] hudi-bot commented on pull request #6506: Allow hoodie read client to choose index

hudi-bot commented on PR #6506: URL: https://github.com/apache/hudi/pull/6506#issuecomment-1227895179 ## CI report: * 1cc9581196646dc677a0940c169d30407188b178 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1095

[GitHub] [hudi] nsivabalan commented on pull request #6000: [HUDI-4340] fix not parsable text DateTimeParseException in HoodieInstantTimeGenerator.parseDateFromInstantTime

nsivabalan commented on PR #6000: URL: https://github.com/apache/hudi/pull/6000#issuecomment-1227872985 can you rebase w/ latest master and address minor comments from danny. we can land it then. -- This is an automated message from the Apache Git Service. To respond to the message, pleas

[GitHub] [hudi] nsivabalan commented on issue #6341: [SUPPORT] Hudi delete not working via spark apis

nsivabalan commented on issue #6341: URL: https://github.com/apache/hudi/issues/6341#issuecomment-1227867862 yes. likely the issue could be (3) from yann's comment above. if you are setting it as delete operation, you don't need to override the payload class. if you are explicitly setting i

[GitHub] [hudi] hudi-bot commented on pull request #6505: AwsglueSync Turn already exist error into warning

hudi-bot commented on PR #6505: URL: https://github.com/apache/hudi/pull/6505#issuecomment-1227863447 ## CI report: * cd3d263bc18ea422b3ab124e109cdebcdfda26a3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1095

[GitHub] [hudi] nsivabalan commented on pull request #6393: [HUDI-4619] Fix The retry mechanism of remotehoodietablefilesystemvie…

nsivabalan commented on PR #6393: URL: https://github.com/apache/hudi/pull/6393#issuecomment-1227856444 hey folks. I reverted the original patch as it could lead to data issues. https://github.com/apache/hudi/pull/6501 You can put up the patch again w/ proper fix around thread safety.

[jira] [Updated] (HUDI-4674) change the default value of inputFormat for the MOR table

[ https://issues.apache.org/jira/browse/HUDI-4674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4674: - Status: In Progress (was: Open) > change the default value of inputFormat for the MOR table > ---

[jira] [Updated] (HUDI-3861) 'path' in CatalogTable#properties failed to be updated when renaming table

[ https://issues.apache.org/jira/browse/HUDI-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3861: - Status: In Progress (was: Open) > 'path' in CatalogTable#properties failed to be updated when renaming ta

[jira] [Updated] (HUDI-3861) 'path' in CatalogTable#properties failed to be updated when renaming table

[ https://issues.apache.org/jira/browse/HUDI-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3861: - Status: Patch Available (was: In Progress) > 'path' in CatalogTable#properties failed to be updated when

[jira] [Updated] (HUDI-4297) Test TestHoodieDeltaStreamerWithMultiWriter.testUpsertsContinuousModeWithMultipleWriters* is flaky

[ https://issues.apache.org/jira/browse/HUDI-4297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4297: - Status: In Progress (was: Open) > Test > TestHoodieDeltaStreamerWithMultiWriter.testUpsertsContinuousMod

[hudi] branch master updated (e90872b396 -> 11f85d1efb)

This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from e90872b396 [HUDI-4696] Fix flaky TestHoodieCombineHiveInputFormat (#6494) add 11f85d1efb Revert "[HUDI-3669] Add a

[GitHub] [hudi] yihua merged pull request #6501: [HUDI-4721] Revert "[HUDI-3669] Add a remote request retry mechanism for 'RemoteHoodietablefiles… (#5884)"

yihua merged PR #6501: URL: https://github.com/apache/hudi/pull/6501 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

[jira] [Closed] (HUDI-4696) Flaky: TestHoodieCombineHiveInputFormat.setUpClass:86 » NullPointer

[ https://issues.apache.org/jira/browse/HUDI-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-4696. Resolution: Fixed > Flaky: TestHoodieCombineHiveInputFormat.setUpClass:86 » NullPointer > -

[GitHub] [hudi] hudi-bot commented on pull request #6506: Allow hoodie read client to choose index

hudi-bot commented on PR #6506: URL: https://github.com/apache/hudi/pull/6506#issuecomment-1227828149 ## CI report: * 1cc9581196646dc677a0940c169d30407188b178 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1095

[GitHub] [hudi] hudi-bot commented on pull request #6505: AwsglueSync Turn already exist error into warning

hudi-bot commented on PR #6505: URL: https://github.com/apache/hudi/pull/6505#issuecomment-1227825299 ## CI report: * cd3d263bc18ea422b3ab124e109cdebcdfda26a3 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1095

[GitHub] [hudi] hudi-bot commented on pull request #6506: Allow hoodie read client to choose index

hudi-bot commented on PR #6506: URL: https://github.com/apache/hudi/pull/6506#issuecomment-1227822500 ## CI report: * 1cc9581196646dc677a0940c169d30407188b178 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1095

[GitHub] [hudi] hudi-bot commented on pull request #6505: AwsglueSync Turn already exist error into warning

hudi-bot commented on PR #6505: URL: https://github.com/apache/hudi/pull/6505#issuecomment-1227822474 ## CI report: * cd3d263bc18ea422b3ab124e109cdebcdfda26a3 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1095

[GitHub] [hudi] hudi-bot commented on pull request #6506: Allow hoodie read client to choose index

hudi-bot commented on PR #6506: URL: https://github.com/apache/hudi/pull/6506#issuecomment-1227819012 ## CI report: * 1cc9581196646dc677a0940c169d30407188b178 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1095

[GitHub] [hudi] hudi-bot commented on pull request #6501: [HUDI-4721] Revert "[HUDI-3669] Add a remote request retry mechanism for 'RemoteHoodietablefiles… (#5884)"

hudi-bot commented on PR #6501: URL: https://github.com/apache/hudi/pull/6501#issuecomment-1227818974 ## CI report: * f07b0630b9654b1c9b10ff5efc0e5989625404da Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1095

[hudi] branch master updated: [HUDI-4696] Fix flaky TestHoodieCombineHiveInputFormat (#6494)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new e90872b396 [HUDI-4696] Fix flaky TestHoodieComb

[GitHub] [hudi] nsivabalan merged pull request #6494: [HUDI-4696] Fix flaky TestHoodieCombineHiveInputFormat

nsivabalan merged PR #6494: URL: https://github.com/apache/hudi/pull/6494 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apach

[jira] [Updated] (HUDI-3391) presto and hive beeline fails to read MOR table w/ 2 or more array fields

[ https://issues.apache.org/jira/browse/HUDI-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3391: - Reviewers: sivabalan narayanan > presto and hive beeline fails to read MOR table w/ 2 or more array fields

[jira] [Updated] (HUDI-4650) Commits Command: Include both active and archive timeline for a given range of intants

[ https://issues.apache.org/jira/browse/HUDI-4650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4650: - Reviewers: Raymond Xu (was: sivabalan narayanan) > Commits Command: Include both active and archive timel

[jira] [Updated] (HUDI-4389) Make HoodieStreamingSink idempotent

[ https://issues.apache.org/jira/browse/HUDI-4389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4389: - Reviewers: sivabalan narayanan > Make HoodieStreamingSink idempotent > ---

[jira] [Updated] (HUDI-4648) Add command to rename partition

[ https://issues.apache.org/jira/browse/HUDI-4648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4648: - Reviewers: Raymond Xu > Add command to rename partition > --- > >

[jira] [Updated] (HUDI-4633) Add command to trace partition through a range of commits

[ https://issues.apache.org/jira/browse/HUDI-4633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4633: - Reviewers: Raymond Xu (was: sivabalan narayanan) > Add command to trace partition through a range of comm

[jira] [Updated] (HUDI-4528) Diff tool to compare metadata across snapshots in a given time range

[ https://issues.apache.org/jira/browse/HUDI-4528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4528: - Reviewers: Raymond Xu (was: sivabalan narayanan) > Diff tool to compare metadata across snapshots in a gi

[GitHub] [hudi] hudi-bot commented on pull request #6506: Allow hoodie read client to choose index

hudi-bot commented on PR #6506: URL: https://github.com/apache/hudi/pull/6506#issuecomment-1227784163 ## CI report: * 1cc9581196646dc677a0940c169d30407188b178 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[jira] [Assigned] (HUDI-4485) Hudi cli got empty result for command show fsview all

[ https://issues.apache.org/jira/browse/HUDI-4485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-4485: Assignee: Yao Zhang > Hudi cli got empty result for command show fsview all > -

[GitHub] [hudi] hudi-bot commented on pull request #6502: HUDI-4722 Added locking metrics for Hudi

hudi-bot commented on PR #6502: URL: https://github.com/apache/hudi/pull/6502#issuecomment-1227779992 ## CI report: * fbedf9a29c4c574ad4d69406416dbb057c080345 UNKNOWN * 8b1585464429a60d9eff4cfa2cb9f937b1ac6f0d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #6505: AwsglueSync Turn already exist error into warning

hudi-bot commented on PR #6505: URL: https://github.com/apache/hudi/pull/6505#issuecomment-1227780026 ## CI report: * cd3d263bc18ea422b3ab124e109cdebcdfda26a3 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1095

[GitHub] [hudi] parisni opened a new pull request, #6506: Allow hoodie read client to choose index

parisni opened a new pull request, #6506: URL: https://github.com/apache/hudi/pull/6506 ### Change Logs Currently the hudi read client use BLOOM and this cannot be overwriten. This allows to use GLOBAL_BLOOM and provides fast lookup on the primary key (without partition keys)

[GitHub] [hudi] the-other-tim-brown commented on a diff in pull request #6111: [HUDI-4399][RFC-57] Protobuf support in DeltaStreamer

the-other-tim-brown commented on code in PR #6111: URL: https://github.com/apache/hudi/pull/6111#discussion_r955436628 ## rfc/rfc-57/rfc-57.md: ## @@ -0,0 +1,85 @@ + +# RFC-57: DeltaStreamer Protobuf Support + + + +## Proposers + +- @the-other-tim-brown + +## Approvers +- @bhasu

[GitHub] [hudi] the-other-tim-brown commented on a diff in pull request #6111: [HUDI-4399][RFC-57] Protobuf support in DeltaStreamer

the-other-tim-brown commented on code in PR #6111: URL: https://github.com/apache/hudi/pull/6111#discussion_r955436277 ## rfc/rfc-57/rfc-57.md: ## @@ -0,0 +1,85 @@ + +# RFC-57: DeltaStreamer Protobuf Support + + + +## Proposers + +- @the-other-tim-brown + +## Approvers +- @bhasu

[GitHub] [hudi] hudi-bot commented on pull request #6502: HUDI-4722 Added locking metrics for Hudi

hudi-bot commented on PR #6502: URL: https://github.com/apache/hudi/pull/6502#issuecomment-1227775803 ## CI report: * fbedf9a29c4c574ad4d69406416dbb057c080345 UNKNOWN * 8b1585464429a60d9eff4cfa2cb9f937b1ac6f0d UNKNOWN Bot commands @hudi-bot supports the following

[GitHub] [hudi] hudi-bot commented on pull request #6505: AwsglueSync Turn already exist error into warning

hudi-bot commented on PR #6505: URL: https://github.com/apache/hudi/pull/6505#issuecomment-1227775849 ## CI report: * cd3d263bc18ea422b3ab124e109cdebcdfda26a3 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] yihua commented on issue #6056: [SUPPORT] Metadata table suddenly not cleaned / compacted anymore

yihua commented on issue #6056: URL: https://github.com/apache/hudi/issues/6056#issuecomment-1227773266 Here's the tracking Jira ticket: [HUDI-4688](https://issues.apache.org/jira/browse/HUDI-4688). -- This is an automated message from the Apache Git Service. To respond to the message, pl

[jira] [Updated] (HUDI-4722) Add support for metrics for locking infra

[ https://issues.apache.org/jira/browse/HUDI-4722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-4722: - Labels: pull-request-available (was: ) > Add support for metrics for locking infra >

[jira] [Updated] (HUDI-4485) Hudi cli got empty result for command show fsview all

[ https://issues.apache.org/jira/browse/HUDI-4485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4485: - Priority: Major (was: Minor) > Hudi cli got empty result for command show fsview all > --

[GitHub] [hudi] hudi-bot commented on pull request #6502: HUDI-4722 Added locking metrics for Hudi

hudi-bot commented on PR #6502: URL: https://github.com/apache/hudi/pull/6502#issuecomment-1227771890 ## CI report: * fbedf9a29c4c574ad4d69406416dbb057c080345 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] parisni opened a new pull request, #6505: AwsglueSync Turn already exist error into warning

parisni opened a new pull request, #6505: URL: https://github.com/apache/hudi/pull/6505 ### Change Logs This avoids the sync to fail when likely concurrent sync happens or other cases fixes #5960 ### Impact _Describe any public API or user-facing feature change

[GitHub] [hudi] santoshraj123 opened a new issue, #6504: [SUPPORT]

santoshraj123 opened a new issue, #6504: URL: https://github.com/apache/hudi/issues/6504 Hello, we are facing issue when running the spark-submit command after performing a DELETE operation on the PostGres database. The spark command, schema and properties file are given. The spark co

[GitHub] [hudi] maduraitech opened a new issue, #6503: Hudi Merge Into with larger volume

maduraitech opened a new issue, #6503: URL: https://github.com/apache/hudi/issues/6503 Use case: We are trying to perform merge into for update partial columns, else insert new records in single command. Issue: Data is not updating as expected rather it’s trying to insert the record

[jira] [Updated] (HUDI-4722) Add support for metrics for locking infra

[ https://issues.apache.org/jira/browse/HUDI-4722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagmeet bali updated HUDI-4722: --- Description: Added metrics for following # Lock request latency # Count of Lock success # Count of

[jira] [Updated] (HUDI-4722) Add support for metrics for locking infra

[ https://issues.apache.org/jira/browse/HUDI-4722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagmeet bali updated HUDI-4722: --- Priority: Minor (was: Major) > Add support for metrics for locking infra > --

  1   2   3   >