[GitHub] [hudi] hudi-bot commented on pull request #5885: [HUDI-3478] Support CDC for Spark in Hudi

hudi-bot commented on PR #5885: URL: https://github.com/apache/hudi/pull/5885#issuecomment-1204845643 ## CI report: * 2d407c1c3bae26425b0c8bc6d5d47c7f385dfb0b Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=104

[GitHub] [hudi] hudi-bot commented on pull request #5885: [HUDI-3478] Support CDC for Spark in Hudi

hudi-bot commented on PR #5885: URL: https://github.com/apache/hudi/pull/5885#issuecomment-1204841423 ## CI report: * 2d407c1c3bae26425b0c8bc6d5d47c7f385dfb0b Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=104

[GitHub] [hudi] brskiran1 commented on issue #4947: [SUPPORT] Hudi 0.9 couldn't process older timestamp column from parquet files in delta streamer with Spark 3.1.2

brskiran1 commented on issue #4947: URL: https://github.com/apache/hudi/issues/4947#issuecomment-1204840315 This issue is still existing with Hudi 0.11. Please note when a Hudi table is created from a spark data frame , with the spark confs there is no issue. However the same spark confs us

[GitHub] [hudi] hudi-bot commented on pull request #6295: [HUDI-4514] optimize CTAS to adapt to saveAsTable api in different modes

hudi-bot commented on PR #6295: URL: https://github.com/apache/hudi/pull/6295#issuecomment-1204838191 ## CI report: * fc4d811551d8a7ccaba3852e93b215360f3b7e3d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1057

[GitHub] [hudi] hudi-bot commented on pull request #6295: [HUDI-4514] optimize CTAS to adapt to saveAsTable api in different modes

hudi-bot commented on PR #6295: URL: https://github.com/apache/hudi/pull/6295#issuecomment-1204834194 ## CI report: * fc4d811551d8a7ccaba3852e93b215360f3b7e3d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1057

[GitHub] [hudi] hudi-bot commented on pull request #6144: [HUDI-4424] add new compactoin trigger stratgy: NUM_COMMITS_AFTER_REQ…

hudi-bot commented on PR #6144: URL: https://github.com/apache/hudi/pull/6144#issuecomment-120482 ## CI report: * d56deaa3232958df6a3d3b930891ab7188b78580 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1057

[GitHub] [hudi] trushev commented on a diff in pull request #6276: [HUDI-4523] Sequential submitting of flink jobs leads to java.net.ConnectException

trushev commented on code in PR #6276: URL: https://github.com/apache/hudi/pull/6276#discussion_r937371673 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/embedded/EmbeddedTimelineService.java: ## @@ -124,10 +124,8 @@ public FileSystemViewManager getViewMa

[GitHub] [hudi] nsivabalan commented on a diff in pull request #6248: [HUDI-4303] Adding 4 to 5 upgrade handler to check for old deprecated "default" partition value

nsivabalan commented on code in PR #6248: URL: https://github.com/apache/hudi/pull/6248#discussion_r937381710 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/upgrade/FourToFiveUpgradeHandler.java: ## @@ -0,0 +1,68 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] nsivabalan commented on a diff in pull request #6248: [HUDI-4303] Adding 4 to 5 upgrade handler to check for old deprecated "default" partition value

nsivabalan commented on code in PR #6248: URL: https://github.com/apache/hudi/pull/6248#discussion_r937381710 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/upgrade/FourToFiveUpgradeHandler.java: ## @@ -0,0 +1,68 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] trushev commented on a diff in pull request #6276: [HUDI-4523] Sequential submitting of flink jobs leads to java.net.ConnectException

trushev commented on code in PR #6276: URL: https://github.com/apache/hudi/pull/6276#discussion_r937377702 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/embedded/EmbeddedTimelineService.java: ## @@ -124,10 +124,8 @@ public FileSystemViewManager getViewMa

[GitHub] [hudi] trushev commented on a diff in pull request #6276: [HUDI-4523] Sequential submitting of flink jobs leads to java.net.ConnectException

trushev commented on code in PR #6276: URL: https://github.com/apache/hudi/pull/6276#discussion_r937377702 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/embedded/EmbeddedTimelineService.java: ## @@ -124,10 +124,8 @@ public FileSystemViewManager getViewMa

[GitHub] [hudi] trushev commented on a diff in pull request #6276: [HUDI-4523] Sequential submitting of flink jobs leads to java.net.ConnectException

trushev commented on code in PR #6276: URL: https://github.com/apache/hudi/pull/6276#discussion_r937371673 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/embedded/EmbeddedTimelineService.java: ## @@ -124,10 +124,8 @@ public FileSystemViewManager getViewMa

[GitHub] [hudi] trushev commented on a diff in pull request #6276: [HUDI-4523] Sequential submitting of flink jobs leads to java.net.ConnectException

trushev commented on code in PR #6276: URL: https://github.com/apache/hudi/pull/6276#discussion_r937371673 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/embedded/EmbeddedTimelineService.java: ## @@ -124,10 +124,8 @@ public FileSystemViewManager getViewMa

[GitHub] [hudi] trushev commented on a diff in pull request #6276: [HUDI-4523] Sequential submitting of flink jobs leads to java.net.ConnectException

trushev commented on code in PR #6276: URL: https://github.com/apache/hudi/pull/6276#discussion_r937371673 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/embedded/EmbeddedTimelineService.java: ## @@ -124,10 +124,8 @@ public FileSystemViewManager getViewMa

[GitHub] [hudi] trushev commented on a diff in pull request #6276: [HUDI-4523] Sequential submitting of flink jobs leads to java.net.ConnectException

trushev commented on code in PR #6276: URL: https://github.com/apache/hudi/pull/6276#discussion_r937371673 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/embedded/EmbeddedTimelineService.java: ## @@ -124,10 +124,8 @@ public FileSystemViewManager getViewMa

[GitHub] [hudi] danny0405 commented on issue #6289: [SUPPORT] hudi support ingest oracle data with flink cdc？

danny0405 commented on issue #6289: URL: https://github.com/apache/hudi/issues/6289#issuecomment-1204785306 Yes, oracle is also supported. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

[GitHub] [hudi] danny0405 commented on a diff in pull request #6273: [HUDI-4521] Ensure flink coordinator do re-commit during restart for changing write.tasks number (i.e., write parallelism)

danny0405 commented on code in PR #6273: URL: https://github.com/apache/hudi/pull/6273#discussion_r937366454 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/StreamWriteOperatorCoordinator.java: ## @@ -378,6 +378,27 @@ private void startInstant() {

[GitHub] [hudi] danny0405 commented on a diff in pull request #6276: [HUDI-4523] Sequential submitting of flink jobs leads to java.net.ConnectException

danny0405 commented on code in PR #6276: URL: https://github.com/apache/hudi/pull/6276#discussion_r937363820 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/embedded/EmbeddedTimelineService.java: ## @@ -124,10 +124,8 @@ public FileSystemViewManager getView

[GitHub] [hudi] danny0405 commented on pull request #6093: [HUDI-4385] Support to trigger the compaction in the flink batch mode write.

danny0405 commented on PR #6093: URL: https://github.com/apache/hudi/pull/6093#issuecomment-1204778626 Thanks for the fix, i have applied a fix patch: [4385.patch.zip](https://github.com/apache/hudi/files/9256858/4385.patch.zip) -- This is an automated message from the Apache Gi

[GitHub] [hudi] hudi-bot commented on pull request #6295: [HUDI-4514] optimize CTAS to adapt to saveAsTable api in different modes

hudi-bot commented on PR #6295: URL: https://github.com/apache/hudi/pull/6295#issuecomment-1204778175 ## CI report: * fc4d811551d8a7ccaba3852e93b215360f3b7e3d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1057

[GitHub] [hudi] hudi-bot commented on pull request #6296: [HUDI-4534] Fixing upgrade to reload Metaclient for deltastreamer writes

hudi-bot commented on PR #6296: URL: https://github.com/apache/hudi/pull/6296#issuecomment-1204750195 ## CI report: * 1f840660aec7949ed60158c459ed4e5c64fd32c8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1057

[GitHub] [hudi] XuQianJin-Stars commented on a diff in pull request #6284: [HUDI-4526] Improve spillableMapBasePath disk directory is full

XuQianJin-Stars commented on code in PR #6284: URL: https://github.com/apache/hudi/pull/6284#discussion_r937334947 ## hudi-common/src/main/java/org/apache/hudi/common/table/log/HoodieMergedLogRecordScanner.java: ## @@ -92,11 +92,12 @@ protected HoodieMergedLogRecordScanner(FileS

[hudi] branch master updated (bab8254fb8 -> b13cc76b5e)

This is an automated email from the ASF dual-hosted git repository. forwardxu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from bab8254fb8 [HUDI-4487] support to create ro/rt table by spark sql (#6262) add b13cc76b5e [HUDI-4533] Fix RunCle

[GitHub] [hudi] XuQianJin-Stars merged pull request #6293: [HUDI-4533] Fix RunCleanProcedure's ArrayIndexOutOfBoundsException

XuQianJin-Stars merged PR #6293: URL: https://github.com/apache/hudi/pull/6293 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.

[GitHub] [hudi] hudi-bot commented on pull request #6293: [HUDI-4533] Fix RunCleanProcedure's ArrayIndexOutOfBoundsException

hudi-bot commented on PR #6293: URL: https://github.com/apache/hudi/pull/6293#issuecomment-1204744655 ## CI report: * 72fd17fac42202fb9a685b5bce97b00b9b045d2a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1056

[GitHub] [hudi] hudi-bot commented on pull request #6144: [HUDI-4424] add new compactoin trigger stratgy: NUM_COMMITS_AFTER_REQ…

hudi-bot commented on PR #6144: URL: https://github.com/apache/hudi/pull/6144#issuecomment-1204744457 ## CI report: * 469c8e2f73816aaac5a5a2eb78028115275d0eae Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1048

[GitHub] [hudi] XuQianJin-Stars commented on a diff in pull request #6284: [HUDI-4526] Improve spillableMapBasePath disk directory is full

XuQianJin-Stars commented on code in PR #6284: URL: https://github.com/apache/hudi/pull/6284#discussion_r937334947 ## hudi-common/src/main/java/org/apache/hudi/common/table/log/HoodieMergedLogRecordScanner.java: ## @@ -92,11 +92,12 @@ protected HoodieMergedLogRecordScanner(FileS

[GitHub] [hudi] hudi-bot commented on pull request #6144: [HUDI-4424] add new compactoin trigger stratgy: NUM_COMMITS_AFTER_REQ…

hudi-bot commented on PR #6144: URL: https://github.com/apache/hudi/pull/6144#issuecomment-1204741764 ## CI report: * 469c8e2f73816aaac5a5a2eb78028115275d0eae Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1048

[GitHub] [hudi] hudi-bot commented on pull request #6284: [HUDI-4526] Improve spillableMapBasePath disk directory is full

hudi-bot commented on PR #6284: URL: https://github.com/apache/hudi/pull/6284#issuecomment-1204738947 ## CI report: * 026dbfc7a6d4d7e489e8c8671a84e143bdb01758 UNKNOWN * 0ea0766862c16ccec08c7c621f98ca8402f772ff Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] fujianhua168 opened a new issue, #6297: [SUPPORT] Flink SQL client cow table query error "org/apache/parquet/column/ColumnDescriptor" (but mor table query normal)

fujianhua168 opened a new issue, #6297: URL: https://github.com/apache/hudi/issues/6297 **Describe the problem you faced** i create a cow table named 'hudi_cow_tbl' and a mor table named 'hudi_mor_tbl' with thd flink sql client mode, then both insert into row data. after that, i

[GitHub] [hudi] fengjian428 commented on a diff in pull request #6144: [HUDI-4424] add new compactoin trigger stratgy: NUM_COMMITS_AFTER_REQ…

fengjian428 commented on code in PR #6144: URL: https://github.com/apache/hudi/pull/6144#discussion_r937323677 ## hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/action/compact/TestInlineCompaction.java: ## @@ -93,6 +96,50 @@ public void testSuccessfulCompactio

[GitHub] [hudi] fujianhua168 closed issue #6285: [SUPPORT] Cow non-partition table upsert action effect when preCombineField field value change to Smaller (SparkSQL)

fujianhua168 closed issue #6285: [SUPPORT] Cow non-partition table upsert action effect when preCombineField field value change to Smaller (SparkSQL) URL: https://github.com/apache/hudi/issues/6285 -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hudi] YuweiXiao commented on a diff in pull request #6273: [HUDI-4521] Ensure flink coordinator do re-commit during restart for changing write.tasks number (i.e., write parallelism)

YuweiXiao commented on code in PR #6273: URL: https://github.com/apache/hudi/pull/6273#discussion_r937320948 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/StreamWriteOperatorCoordinator.java: ## @@ -378,6 +378,27 @@ private void startInstant() {

[GitHub] [hudi] fengjian428 commented on a diff in pull request #6144: [HUDI-4424] add new compactoin trigger stratgy: NUM_COMMITS_AFTER_REQ…

fengjian428 commented on code in PR #6144: URL: https://github.com/apache/hudi/pull/6144#discussion_r937320646 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/compact/ScheduleCompactionActionExecutor.java: ## @@ -140,6 +140,17 @@ private Option> get

[GitHub] [hudi] danny0405 commented on issue #5690: [SUPPORT] Flink stream write hudi, failed to checkpoint

danny0405 commented on issue #5690: URL: https://github.com/apache/hudi/issues/5690#issuecomment-1204722139 > really unstable You may need to set up the job correctly. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hudi] danny0405 commented on a diff in pull request #6273: [HUDI-4521] Ensure flink coordinator do re-commit during restart for changing write.tasks number (i.e., write parallelism)

danny0405 commented on code in PR #6273: URL: https://github.com/apache/hudi/pull/6273#discussion_r937320012 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/StreamWriteOperatorCoordinator.java: ## @@ -378,6 +378,27 @@ private void startInstant() {

[GitHub] [hudi] danny0405 commented on a diff in pull request #6246: Be able to disable precombine field when table schema contains a field named ts

danny0405 commented on code in PR #6246: URL: https://github.com/apache/hudi/pull/6246#discussion_r937318329 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/table/HoodieTableFactory.java: ## @@ -147,7 +147,7 @@ private void sanityCheck(Configuration conf, Resol

[GitHub] [hudi] danny0405 commented on a diff in pull request #6246: Be able to disable precombine field when table schema contains a field named ts

danny0405 commented on code in PR #6246: URL: https://github.com/apache/hudi/pull/6246#discussion_r937318329 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/table/HoodieTableFactory.java: ## @@ -147,7 +147,7 @@ private void sanityCheck(Configuration conf, Resol

[GitHub] [hudi] danny0405 commented on a diff in pull request #6144: [HUDI-4424] add new compactoin trigger stratgy: NUM_COMMITS_AFTER_REQ…

danny0405 commented on code in PR #6144: URL: https://github.com/apache/hudi/pull/6144#discussion_r937317636 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/compact/ScheduleCompactionActionExecutor.java: ## @@ -140,6 +140,17 @@ private Option> getLa

[GitHub] [hudi] danny0405 commented on a diff in pull request #6248: [HUDI-4303] Adding 4 to 5 upgrade handler to check for old deprecated "default" partition value

danny0405 commented on code in PR #6248: URL: https://github.com/apache/hudi/pull/6248#discussion_r937316252 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/upgrade/FourToFiveUpgradeHandler.java: ## @@ -0,0 +1,68 @@ +/* + * Licensed to the Apache Software F

[GitHub] [hudi] hudi-bot commented on pull request #6295: [HUDI-4514] optimize CTAS to adapt to saveAsTable api in different modes

hudi-bot commented on PR #6295: URL: https://github.com/apache/hudi/pull/6295#issuecomment-1204713001 ## CI report: * 9a2180d45aec6886bb2cd91b79090e72eee486ef Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1056

[GitHub] [hudi] danny0405 commented on a diff in pull request #6284: [HUDI-4526] Improve spillableMapBasePath disk directory is full

danny0405 commented on code in PR #6284: URL: https://github.com/apache/hudi/pull/6284#discussion_r937313484 ## hudi-common/src/main/java/org/apache/hudi/common/table/log/HoodieMergedLogRecordScanner.java: ## @@ -92,11 +92,12 @@ protected HoodieMergedLogRecordScanner(FileSystem

[GitHub] [hudi] hudi-bot commented on pull request #6296: [HUDI-4534] Fixing upgrade to reload Metaclient for deltastreamer writes

hudi-bot commented on PR #6296: URL: https://github.com/apache/hudi/pull/6296#issuecomment-1204710637 ## CI report: * 1f840660aec7949ed60158c459ed4e5c64fd32c8 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1057

[GitHub] [hudi] hudi-bot commented on pull request #6295: [HUDI-4514] optimize CTAS to adapt to saveAsTable api in different modes

hudi-bot commented on PR #6295: URL: https://github.com/apache/hudi/pull/6295#issuecomment-1204710619 ## CI report: * 9a2180d45aec6886bb2cd91b79090e72eee486ef Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1056

[GitHub] [hudi] hudi-bot commented on pull request #6296: [HUDI-4534] Fixing upgrade to reload Metaclient for deltastreamer writes

hudi-bot commented on PR #6296: URL: https://github.com/apache/hudi/pull/6296#issuecomment-1204708236 ## CI report: * 1f840660aec7949ed60158c459ed4e5c64fd32c8 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #6284: [HUDI-4526] Improve spillableMapBasePath disk directory is full

hudi-bot commented on PR #6284: URL: https://github.com/apache/hudi/pull/6284#issuecomment-1204708180 ## CI report: * 026dbfc7a6d4d7e489e8c8671a84e143bdb01758 UNKNOWN * d8d834d4f66fe195d009331395c12f33029e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[jira] [Updated] (HUDI-4526) improve spillableMapBasePath disk directory is full

[ https://issues.apache.org/jira/browse/HUDI-4526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-4526: - Labels: pull-request-available (was: ) > improve spillableMapBasePath disk directory is full > --

[GitHub] [hudi] hudi-bot commented on pull request #6284: [HUDI-4526] Improve spillableMapBasePath disk directory is full

hudi-bot commented on PR #6284: URL: https://github.com/apache/hudi/pull/6284#issuecomment-1204705699 ## CI report: * 026dbfc7a6d4d7e489e8c8671a84e143bdb01758 UNKNOWN * d8d834d4f66fe195d009331395c12f33029e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #6248: [HUDI-4303] Adding 4 to 5 upgrade handler to check for old deprecated "default" partition value

hudi-bot commented on PR #6248: URL: https://github.com/apache/hudi/pull/6248#issuecomment-1204705596 ## CI report: * a2da187e83c39188fe8783743e7e3f6f1816691a UNKNOWN * f9a56355c62858901b4ec1f53e31f971eef56f81 UNKNOWN * 7b874997625becffbcad6cba0c51ceca9fd5080c Azure: [SUCCES

[GitHub] [hudi] KnightChess commented on issue #6194: [SUPPORT] repair deduplicate unable to find `_hoodie_record_key` in data

KnightChess commented on issue #6194: URL: https://github.com/apache/hudi/issues/6194#issuecomment-1204702856 @ehurheap look like `repair deduplicate` target is base file. Is there any duplicate data when you use query or other op? For log file, I think it will combine the duplicate primary

[GitHub] [hudi] yanghua commented on a diff in pull request #6144: [HUDI-4424] add new compactoin trigger stratgy: NUM_COMMITS_AFTER_REQ…

yanghua commented on code in PR #6144: URL: https://github.com/apache/hudi/pull/6144#discussion_r937298503 ## hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/action/compact/TestInlineCompaction.java: ## @@ -93,6 +96,50 @@ public void testSuccessfulCompactionBas

[hudi] branch master updated (e22b6c12b0 -> bab8254fb8)

This is an automated email from the ASF dual-hosted git repository. forwardxu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from e22b6c12b0 [HUDI-4531] Wrong partition path for flink hive catalog when the partition fields are not in the last (#6

[GitHub] [hudi] XuQianJin-Stars merged pull request #6262: [HUDI-4487] support to create ro/rt table by spark sql

XuQianJin-Stars merged PR #6262: URL: https://github.com/apache/hudi/pull/6262 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.

[jira] [Updated] (HUDI-4534) Upgrade fails when there is a partially failed commit during upgrade w/ deltastreamer

[ https://issues.apache.org/jira/browse/HUDI-4534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-4534: - Labels: pull-request-available (was: ) > Upgrade fails when there is a partially failed commit d

[GitHub] [hudi] nsivabalan opened a new pull request, #6296: [HUDI-4534] Fixing upgrade to reload Metaclient for deltastreamer writes

nsivabalan opened a new pull request, #6296: URL: https://github.com/apache/hudi/pull/6296 ## What is the purpose of the pull request - When deltastreamer is used for writes and if upgrade is required, upgrade fails when there is a partially failed commit in timeline. bcoz, Deltastrea

[jira] [Created] (HUDI-4534) Upgrade fails when there is a partially failed commit during upgrade w/ deltastreamer

sivabalan narayanan created HUDI-4534: - Summary: Upgrade fails when there is a partially failed commit during upgrade w/ deltastreamer Key: HUDI-4534 URL: https://issues.apache.org/jira/browse/HUDI-4534

[jira] [Updated] (HUDI-4520) Support qualified table 'db.table' in call procedures

[ https://issues.apache.org/jira/browse/HUDI-4520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jimmyz updated HUDI-4520: - Status: Open (was: Patch Available) > Support qualified table 'db.table' in call procedures > ---

[jira] [Updated] (HUDI-4520) Support qualified table 'db.table' in call procedures

[ https://issues.apache.org/jira/browse/HUDI-4520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jimmyz updated HUDI-4520: - Status: Patch Available (was: In Progress) > Support qualified table 'db.table' in call procedures >

[jira] [Resolved] (HUDI-4520) Support qualified table 'db.table' in call procedures

[ https://issues.apache.org/jira/browse/HUDI-4520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jimmyz resolved HUDI-4520. -- > Support qualified table 'db.table' in call procedures > - > >

[GitHub] [hudi] hudi-bot commented on pull request #6293: [HUDI-4533] Fix RunCleanProcedure's ArrayIndexOutOfBoundsException

hudi-bot commented on PR #6293: URL: https://github.com/apache/hudi/pull/6293#issuecomment-1204677241 ## CI report: * a36332015b1d0529a20a539724da39e988c88661 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1055

[GitHub] [hudi] fujianhua168 commented on issue #6285: [SUPPORT] Cow non-partition table upsert action effect when preCombineField field value change to Smaller (SparkSQL)

fujianhua168 commented on issue #6285: URL: https://github.com/apache/hudi/issues/6285#issuecomment-1204676432 @KnightChess , i try it, it's effect. thank you~ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[GitHub] [hudi] hudi-bot commented on pull request #6293: [HUDI-4533] Fix RunCleanProcedure's ArrayIndexOutOfBoundsException

hudi-bot commented on PR #6293: URL: https://github.com/apache/hudi/pull/6293#issuecomment-1204674841 ## CI report: * a36332015b1d0529a20a539724da39e988c88661 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1055

[GitHub] [hudi] danny0405 closed issue #6290: [SUPPORT] HMS Catalog on flink, define the partition field with A, but B was regard as partition field when I insert the data.

danny0405 closed issue #6290: [SUPPORT] HMS Catalog on flink, define the partition field with A, but B was regard as partition field when I insert the data. URL: https://github.com/apache/hudi/issues/6290 -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hudi] danny0405 commented on issue #6290: [SUPPORT] HMS Catalog on flink, define the partition field with A, but B was regard as partition field when I insert the data.

danny0405 commented on issue #6290: URL: https://github.com/apache/hudi/issues/6290#issuecomment-1204668783 Should be fixed with #6292 , feel free to reopen it if the bug still exists. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Commented] (HUDI-4531) Wrong partition path for flink hive catalog when the partition fields are not in the last

[ https://issues.apache.org/jira/browse/HUDI-4531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574987#comment-17574987 ] Danny Chen commented on HUDI-4531: -- Fixed via master branch: e22b6c12b00e047a8c03726c0e0c

[jira] [Resolved] (HUDI-4531) Wrong partition path for flink hive catalog when the partition fields are not in the last

[ https://issues.apache.org/jira/browse/HUDI-4531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-4531. -- > Wrong partition path for flink hive catalog when the partition fields are not > in the last > ---

[hudi] branch master updated (345dd81ec8 -> e22b6c12b0)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 345dd81ec8 [HUDI-4520] Support qualified table 'db.table' in call procedures (#6274) add e22b6c12b0 [HUDI-4531]

[GitHub] [hudi] danny0405 merged pull request #6292: [HUDI-4531] Wrong partition path for flink hive catalog when the part…

danny0405 merged PR #6292: URL: https://github.com/apache/hudi/pull/6292 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache

[hudi] branch master updated (7307ff3d5c -> 345dd81ec8)

This is an automated email from the ASF dual-hosted git repository. forwardxu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 7307ff3d5c [HUDI-4447] fix no partitioned path extractor error when sync meta (#6263) add 345dd81ec8 [HUDI-4520

[GitHub] [hudi] XuQianJin-Stars merged pull request #6274: [HUDI-4520] Support qualified table 'db.table' in call procedures

XuQianJin-Stars merged PR #6274: URL: https://github.com/apache/hudi/pull/6274 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.

[GitHub] [hudi] flashJd commented on a diff in pull request #6246: Be able to disable precombine field when table schema contains a field named ts

flashJd commented on code in PR #6246: URL: https://github.com/apache/hudi/pull/6246#discussion_r937271200 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/table/HoodieTableFactory.java: ## @@ -147,7 +147,7 @@ private void sanityCheck(Configuration conf, Resolve

[GitHub] [hudi] hudi-bot commented on pull request #6248: [HUDI-4303] Adding 4 to 5 upgrade handler to check for old deprecated "default" partition value

hudi-bot commented on PR #6248: URL: https://github.com/apache/hudi/pull/6248#issuecomment-1204644262 ## CI report: * a2da187e83c39188fe8783743e7e3f6f1816691a UNKNOWN * f9a56355c62858901b4ec1f53e31f971eef56f81 UNKNOWN * dac4eb82fb1a12f70ddac35dfb163a4d16509e3f Azure: [FAILUR

[GitHub] [hudi] hudi-bot commented on pull request #6248: [HUDI-4303] Adding 4 to 5 upgrade handler to check for old deprecated "default" partition value

hudi-bot commented on PR #6248: URL: https://github.com/apache/hudi/pull/6248#issuecomment-1204641518 ## CI report: * a2da187e83c39188fe8783743e7e3f6f1816691a UNKNOWN * f9a56355c62858901b4ec1f53e31f971eef56f81 UNKNOWN * dac4eb82fb1a12f70ddac35dfb163a4d16509e3f Azure: [FAILUR

[GitHub] [hudi] xushiyan commented on issue #5694: [SUPPORT] Querying Hudi Timeline causes Hive sync failure with AWS Glue Catalog

xushiyan commented on issue #5694: URL: https://github.com/apache/hudi/issues/5694#issuecomment-1204626523 > @xushiyan : recently we had a fix around aws glue client factory right. is that related to this issue? no recent fix which resolved the Glue catalog connection issue is not re

[GitHub] [hudi] xushiyan commented on issue #5636: [SUPPORT]Need info on the versions of hudi dependent jars which can be used with Glue 3.0

xushiyan commented on issue #5636: URL: https://github.com/apache/hudi/issues/5636#issuecomment-1204622574 pls use the matching spark bundle, for e.g., if the glue runs with spark 3.1, then use `hudi-spark3.1-bundle_2.12-0.11.1.jar`. If Glue is with spark 2.4, then use hudi-spark2.4-bundle_

[hudi] branch master updated (3042b2c7c5 -> 7307ff3d5c)

This is an automated email from the ASF dual-hosted git repository. xushiyan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 3042b2c7c5 [HUDI-4525] Fixing Spark 3.3 `AvroSerializer` implementation (#6279) add 7307ff3d5c [HUDI-4447] fix n

[GitHub] [hudi] xushiyan merged pull request #6263: [HUDI-4447] fix no partitioned path extractor error when sync meta

xushiyan merged PR #6263: URL: https://github.com/apache/hudi/pull/6263 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.

[GitHub] [hudi] hudi-bot commented on pull request #6248: [HUDI-4303] Adding 4 to 5 upgrade handler to check for old deprecated "default" partition value

hudi-bot commented on PR #6248: URL: https://github.com/apache/hudi/pull/6248#issuecomment-1204512499 ## CI report: * a2da187e83c39188fe8783743e7e3f6f1816691a UNKNOWN * f9a56355c62858901b4ec1f53e31f971eef56f81 UNKNOWN * dac4eb82fb1a12f70ddac35dfb163a4d16509e3f Azure: [FAILUR

[GitHub] [hudi] xushiyan commented on pull request #6228: [HUDI-4488] Improve S3EventsHoodieIncrSource efficiency

xushiyan commented on PR #6228: URL: https://github.com/apache/hudi/pull/6228#issuecomment-1204502758 @vamshigv IT needs some investigation (from local setup), probably not flakiness. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[hudi] branch master updated: [HUDI-4525] Fixing Spark 3.3 `AvroSerializer` implementation (#6279)

This is an automated email from the ASF dual-hosted git repository. xushiyan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 3042b2c7c5 [HUDI-4525] Fixing Spark 3.3 `AvroSer

[GitHub] [hudi] xushiyan merged pull request #6279: [HUDI-4525] Fixing Spark 3.3 `AvroSerializer` implementation

xushiyan merged PR #6279: URL: https://github.com/apache/hudi/pull/6279 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.

[GitHub] [hudi] hudi-bot commented on pull request #6248: [HUDI-4303] Adding 4 to 5 upgrade handler to check for old deprecated "default" partition value

hudi-bot commented on PR #6248: URL: https://github.com/apache/hudi/pull/6248#issuecomment-1204449264 ## CI report: * a2da187e83c39188fe8783743e7e3f6f1816691a UNKNOWN * f9a56355c62858901b4ec1f53e31f971eef56f81 UNKNOWN * 0eb0afe470c71ea39fdea7b5f8be3e0ef9f5284d Azure: [FAILUR

[GitHub] [hudi] hudi-bot commented on pull request #6248: [HUDI-4303] Adding 4 to 5 upgrade handler to check for old deprecated "default" partition value

hudi-bot commented on PR #6248: URL: https://github.com/apache/hudi/pull/6248#issuecomment-1204439603 ## CI report: * a2da187e83c39188fe8783743e7e3f6f1816691a UNKNOWN * f9a56355c62858901b4ec1f53e31f971eef56f81 UNKNOWN * 0eb0afe470c71ea39fdea7b5f8be3e0ef9f5284d Azure: [FAILUR

[GitHub] [hudi] hudi-bot commented on pull request #6248: [HUDI-4303] Adding 4 to 5 upgrade handler to check for old deprecated "default" partition value

hudi-bot commented on PR #6248: URL: https://github.com/apache/hudi/pull/6248#issuecomment-1204435223 ## CI report: * a2da187e83c39188fe8783743e7e3f6f1816691a UNKNOWN * f9a56355c62858901b4ec1f53e31f971eef56f81 UNKNOWN * 0eb0afe470c71ea39fdea7b5f8be3e0ef9f5284d Azure: [FAILUR

[GitHub] [hudi] nsivabalan commented on a diff in pull request #6248: [HUDI-4303] Adding 4 to 5 upgrade handler to check for old deprecated "default" partition value

nsivabalan commented on code in PR #6248: URL: https://github.com/apache/hudi/pull/6248#discussion_r937090253 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/upgrade/FourToFiveUpgradeHandler.java: ## @@ -0,0 +1,68 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] nsivabalan commented on pull request #6248: [HUDI-4303] Adding 4 to 5 upgrade handler to check for old deprecated "default" partition value

nsivabalan commented on PR #6248: URL: https://github.com/apache/hudi/pull/6248#issuecomment-1204418467 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #6279: [HUDI-4525] Fixing Spark 3.3 `AvroSerializer` implementation

alexeykudinkin commented on code in PR #6279: URL: https://github.com/apache/hudi/pull/6279#discussion_r937062871 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieAppendHandle.java: ## @@ -471,10 +471,12 @@ private Writer createLogWriter(Option fileSlice

[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #6279: [HUDI-4525] Fixing Spark 3.3 `AvroSerializer` implementation

alexeykudinkin commented on code in PR #6279: URL: https://github.com/apache/hudi/pull/6279#discussion_r937063323 ## hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/avro/AvroSerializer.scala: ## @@ -292,6 +309,60 @@ private[sql] class AvroSerializer(

[GitHub] [hudi] hudi-bot commented on pull request #6248: [HUDI-4303] Adding 4 to 5 upgrade handler to check for old deprecated "default" partition value

hudi-bot commented on PR #6248: URL: https://github.com/apache/hudi/pull/6248#issuecomment-1204384650 ## CI report: * a2da187e83c39188fe8783743e7e3f6f1816691a UNKNOWN * f9a56355c62858901b4ec1f53e31f971eef56f81 UNKNOWN * 0eb0afe470c71ea39fdea7b5f8be3e0ef9f5284d Azure: [FAILUR

[GitHub] [hudi] hudi-bot commented on pull request #6228: [HUDI-4488] Improve S3EventsHoodieIncrSource efficiency

hudi-bot commented on PR #6228: URL: https://github.com/apache/hudi/pull/6228#issuecomment-1204384566 ## CI report: * 153da9dd124d6a470bd4bb9d6612311573b82f4e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1048

[GitHub] [hudi] hudi-bot commented on pull request #6248: [HUDI-4303] Adding 4 to 5 upgrade handler to check for old deprecated "default" partition value

hudi-bot commented on PR #6248: URL: https://github.com/apache/hudi/pull/6248#issuecomment-1204379852 ## CI report: * Unknown: [CANCELED](TBD) * a2da187e83c39188fe8783743e7e3f6f1816691a UNKNOWN * f9a56355c62858901b4ec1f53e31f971eef56f81 UNKNOWN * 0eb0afe470c71ea39fdea7b5

[GitHub] [hudi] hudi-bot commented on pull request #6228: [HUDI-4488] Improve S3EventsHoodieIncrSource efficiency

hudi-bot commented on PR #6228: URL: https://github.com/apache/hudi/pull/6228#issuecomment-1204379787 ## CI report: * 153da9dd124d6a470bd4bb9d6612311573b82f4e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1048

[GitHub] [hudi] hudi-bot commented on pull request #6248: [HUDI-4303] Adding 4 to 5 upgrade handler to check for old deprecated "default" partition value

hudi-bot commented on PR #6248: URL: https://github.com/apache/hudi/pull/6248#issuecomment-1204375435 ## CI report: * Unknown: [CANCELED](TBD) * a2da187e83c39188fe8783743e7e3f6f1816691a UNKNOWN * f9a56355c62858901b4ec1f53e31f971eef56f81 UNKNOWN * 0eb0afe470c71ea39fdea7b5

[GitHub] [hudi] hudi-bot commented on pull request #6228: [HUDI-4488] Improve S3EventsHoodieIncrSource efficiency

hudi-bot commented on PR #6228: URL: https://github.com/apache/hudi/pull/6228#issuecomment-1204375365 ## CI report: * 153da9dd124d6a470bd4bb9d6612311573b82f4e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1048

[GitHub] [hudi] hudi-bot commented on pull request #6228: [HUDI-4488] Improve S3EventsHoodieIncrSource efficiency

hudi-bot commented on PR #6228: URL: https://github.com/apache/hudi/pull/6228#issuecomment-1204370762 ## CI report: * 153da9dd124d6a470bd4bb9d6612311573b82f4e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] xushiyan commented on a diff in pull request #6279: [HUDI-4525] Fixing Spark 3.3 `AvroSerializer` implementation

xushiyan commented on code in PR #6279: URL: https://github.com/apache/hudi/pull/6279#discussion_r937001645 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieAppendHandle.java: ## @@ -471,10 +471,12 @@ private Writer createLogWriter(Option fileSlice, Stri

[GitHub] [hudi] hudi-bot commented on pull request #6248: [HUDI-4303] Adding 4 to 5 upgrade handler to check for old deprecated "default" partition value

hudi-bot commented on PR #6248: URL: https://github.com/apache/hudi/pull/6248#issuecomment-1204308819 ## CI report: * Unknown: [CANCELED](TBD) * a2da187e83c39188fe8783743e7e3f6f1816691a UNKNOWN * f9a56355c62858901b4ec1f53e31f971eef56f81 UNKNOWN Bot commands

[GitHub] [hudi] hudi-bot commented on pull request #6295: [HUDI-4514] optimize CTAS to adapt to saveAsTable api in different modes

hudi-bot commented on PR #6295: URL: https://github.com/apache/hudi/pull/6295#issuecomment-1204303679 ## CI report: * 9a2180d45aec6886bb2cd91b79090e72eee486ef Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1056

[GitHub] [hudi] hudi-bot commented on pull request #6274: [HUDI-4520] Support qualified table 'db.table' in call procedures

hudi-bot commented on PR #6274: URL: https://github.com/apache/hudi/pull/6274#issuecomment-1204303543 ## CI report: * f8fdb5bc56f60151767e0694ecb3c8b7c2b5a890 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1055

[GitHub] [hudi] hudi-bot commented on pull request #6248: [HUDI-4303] Adding 4 to 5 upgrade handler to check for old deprecated "default" partition value

hudi-bot commented on PR #6248: URL: https://github.com/apache/hudi/pull/6248#issuecomment-1204303372 ## CI report: * Unknown: [CANCELED](TBD) * a2da187e83c39188fe8783743e7e3f6f1816691a UNKNOWN Bot commands @hudi-bot supports the following commands: - `

  1   2   3   >