[GitHub] [hudi] ms-baazi commented on issue #8835: [SUPPORT] Duplicate Data in MOR Partitioned Table

ms-baazi commented on issue #8835: URL: https://github.com/apache/hudi/issues/8835#issuecomment-1588662741 @ad1happy2go This did not work out in AWS Glue. I updated the Hudi version to 0.13.1 by adding it as a package and added the config - `hoodie.global.index.reconcile.parallelism=1`.

[GitHub] [hudi] hudi-bot commented on pull request #8911: [Hudi-8882] Compatible with versions below hive 2.3 to read hudi rt table

hudi-bot commented on PR #8911: URL: https://github.com/apache/hudi/pull/8911#issuecomment-1588655200 ## CI report: * afbd84a73cdc4621ff516adcf9445781dc3b75f7 UNKNOWN * 33e446f39c09132f2d1d88f150bfc86965f191f8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #8948: [MINOR] Upload coverage report to codecov.

hudi-bot commented on PR #8948: URL: https://github.com/apache/hudi/pull/8948#issuecomment-1588655390 ## CI report: * 699da16473cd16715c02bb160a952ab07dd24a9d UNKNOWN * 01a933bd3da5462bbece0bf4b088494c9c99b0cd Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] prashantwason commented on pull request #8948: [MINOR] Upload coverage report to codecov.

prashantwason commented on PR #8948: URL: https://github.com/apache/hudi/pull/8948#issuecomment-1588651557 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [hudi] hudi-bot commented on pull request #8911: [Hudi-8882] Compatible with versions below hive 2.3 to read hudi rt table

hudi-bot commented on PR #8911: URL: https://github.com/apache/hudi/pull/8911#issuecomment-1588645167 ## CI report: * afbd84a73cdc4621ff516adcf9445781dc3b75f7 UNKNOWN * 33e446f39c09132f2d1d88f150bfc86965f191f8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #8911: [Hudi-8882] Compatible with versions below hive 2.3 to read hudi rt table

hudi-bot commented on PR #8911: URL: https://github.com/apache/hudi/pull/8911#issuecomment-1588633923 ## CI report: * afbd84a73cdc4621ff516adcf9445781dc3b75f7 UNKNOWN * 33e446f39c09132f2d1d88f150bfc86965f191f8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #8896: [HUDI-6326] Flink write supports consistent bucket index

hudi-bot commented on PR #8896: URL: https://github.com/apache/hudi/pull/8896#issuecomment-1588633745 ## CI report: * 019919f8ca50ae094bc9bfc11fce9cbb2b5f7e04 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1779

[GitHub] [hudi] thomasg19930417 commented on a diff in pull request #8911: [Hudi-8882] Compatible with versions below hive 2.3 to read hudi rt table

thomasg19930417 commented on code in PR #8911: URL: https://github.com/apache/hudi/pull/8911#discussion_r1227598591 ## hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/shims/HiveCompatibleShimBelow23.java: ## @@ -0,0 +1,50 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] [hudi] thomasg19930417 commented on a diff in pull request #8911: [Hudi-8882] Compatible with versions below hive 2.3 to read hudi rt table

thomasg19930417 commented on code in PR #8911: URL: https://github.com/apache/hudi/pull/8911#discussion_r1227582220 ## hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/shims/HiveCompatibleShimAbove23.java: ## @@ -0,0 +1,50 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] [hudi] xicm commented on a diff in pull request #8911: [Hudi-8882] Compatible with versions below hive 2.3 to read hudi rt table

xicm commented on code in PR #8911: URL: https://github.com/apache/hudi/pull/8911#discussion_r1227578284 ## hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/shims/HiveCompatibleShimBelow23.java: ## @@ -0,0 +1,50 @@ +/* + * Licensed to the Apache Software Foundation (ASF

[GitHub] [hudi] xicm commented on a diff in pull request #8911: [Hudi-8882] Compatible with versions below hive 2.3 to read hudi rt table

xicm commented on code in PR #8911: URL: https://github.com/apache/hudi/pull/8911#discussion_r1227577203 ## hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/shims/HiveCompatibleShimAbove23.java: ## @@ -0,0 +1,50 @@ +/* + * Licensed to the Apache Software Foundation (ASF

[GitHub] [hudi] thomasg19930417 commented on a diff in pull request #8911: [Hudi-8882] Compatible with versions below hive 2.3 to read hudi rt table

thomasg19930417 commented on code in PR #8911: URL: https://github.com/apache/hudi/pull/8911#discussion_r1227574416 ## hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/shims/HiveCompatibleShimAbove23.java: ## @@ -0,0 +1,50 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] [hudi] thomasg19930417 commented on a diff in pull request #8911: [Hudi-8882] Compatible with versions below hive 2.3 to read hudi rt table

thomasg19930417 commented on code in PR #8911: URL: https://github.com/apache/hudi/pull/8911#discussion_r1227568344 ## hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/shims/HiveCompatibleShimAbove23.java: ## @@ -0,0 +1,50 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] [hudi] hudi-bot commented on pull request #7729: [HUDI-6356] Fix rollback logic on AbstractHoodieLogRecordReader when roll backed blocks are created with same instant

hudi-bot commented on PR #7729: URL: https://github.com/apache/hudi/pull/7729#issuecomment-1588587244 ## CI report: * e700f362f2953bc814da5e87bb9aa5ba9f50ccb5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1775

[GitHub] [hudi] hudi-bot commented on pull request #8950: [HUDI-6366] Prevent flink offline table service rerun completed instant

hudi-bot commented on PR #8950: URL: https://github.com/apache/hudi/pull/8950#issuecomment-1588583197 ## CI report: * 3c3905b81f2f25e9864f8dd8fe4d41d4f7f628db UNKNOWN * 379ab53b42f5d6daf6edd7f50e39a5da03621c6e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #7729: [HUDI-6356] Fix rollback logic on AbstractHoodieLogRecordReader when roll backed blocks are created with same instant

hudi-bot commented on PR #7729: URL: https://github.com/apache/hudi/pull/7729#issuecomment-1588581587 ## CI report: * e700f362f2953bc814da5e87bb9aa5ba9f50ccb5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1775

[GitHub] [hudi] hudi-bot commented on pull request #8949: [DNM] Testing Java 17

hudi-bot commented on PR #8949: URL: https://github.com/apache/hudi/pull/8949#issuecomment-1588577065 ## CI report: * 7d11c62360f33c0d496fcc4a6e3a7e87958fe3b2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1779

[GitHub] [hudi] xicm commented on a diff in pull request #8911: [Hudi-8882] Compatible with versions below hive 2.3 to read hudi rt table

xicm commented on code in PR #8911: URL: https://github.com/apache/hudi/pull/8911#discussion_r1227550989 ## hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/shims/HiveCompatibleShimBelow23.java: ## @@ -0,0 +1,50 @@ +/* + * Licensed to the Apache Software Foundation (ASF

[GitHub] [hudi] xicm commented on a diff in pull request #8911: [Hudi-8882] Compatible with versions below hive 2.3 to read hudi rt table

xicm commented on code in PR #8911: URL: https://github.com/apache/hudi/pull/8911#discussion_r1227550752 ## hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/shims/Hive3Shim.java: ## @@ -122,4 +126,16 @@ public long getMills(Object timestamp) { throw new HoodieExc

[GitHub] [hudi] ad1happy2go commented on issue #8838: [SUPPORT] Flink sql create COPY_ON_WRITE partitioned table use hive query raise `UnsupportedOperationException '

ad1happy2go commented on issue #8838: URL: https://github.com/apache/hudi/issues/8838#issuecomment-1588549901 @MarlboroBoy Were you Able to get it working with Master code. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[GitHub] [hudi] hudi-bot commented on pull request #8949: [DNM] Testing Java 17

hudi-bot commented on PR #8949: URL: https://github.com/apache/hudi/pull/8949#issuecomment-1588541811 ## CI report: * b7474d83f07597db3996e83e0bfa1decdc3bfbb5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1778

[GitHub] [hudi] hudi-bot commented on pull request #8949: [DNM] Testing Java 17

hudi-bot commented on PR #8949: URL: https://github.com/apache/hudi/pull/8949#issuecomment-1588537332 ## CI report: * b7474d83f07597db3996e83e0bfa1decdc3bfbb5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1778

[GitHub] [hudi] SteNicholas commented on pull request #8884: [HUDI-6317] Streaming read should skip compaction and clustering instants to avoid duplicates

SteNicholas commented on PR #8884: URL: https://github.com/apache/hudi/pull/8884#issuecomment-1588493713 @hbgstc123, the replacecommit which is clustering the historical partition would generate the duplicates and affects the job recovering from the latest successful checkpoint. -- This

[GitHub] [hudi] hudi-bot commented on pull request #8911: [Hudi-8882] Compatible with versions below hive 2.3 to read hudi rt table

hudi-bot commented on PR #8911: URL: https://github.com/apache/hudi/pull/8911#issuecomment-1588482177 ## CI report: * afbd84a73cdc4621ff516adcf9445781dc3b75f7 UNKNOWN * 3c7b437851141a00abd75c470702f07aedb37de1 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-

[GitHub] [hudi] hudi-bot commented on pull request #8911: [Hudi-8882] Compatible with versions below hive 2.3 to read hudi rt table

hudi-bot commented on PR #8911: URL: https://github.com/apache/hudi/pull/8911#issuecomment-1588476894 ## CI report: * afbd84a73cdc4621ff516adcf9445781dc3b75f7 UNKNOWN * d919f87b331ef3273c9910fa77c668c58fb2edc3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #8896: [HUDI-6326] Flink write supports consistent bucket index

hudi-bot commented on PR #8896: URL: https://github.com/apache/hudi/pull/8896#issuecomment-1588476843 ## CI report: * 2cf8f744f6074f7ce277de20204a70ee7dd18fb3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1778

[GitHub] [hudi] hudi-bot commented on pull request #8950: [HUDI-6366] Prevent flink offline table service rerun completed instant

hudi-bot commented on PR #8950: URL: https://github.com/apache/hudi/pull/8950#issuecomment-1588472249 ## CI report: * 3c3905b81f2f25e9864f8dd8fe4d41d4f7f628db UNKNOWN * 379ab53b42f5d6daf6edd7f50e39a5da03621c6e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #8948: [MINOR] Upload coverage report to codecov.

hudi-bot commented on PR #8948: URL: https://github.com/apache/hudi/pull/8948#issuecomment-1588472209 ## CI report: * 699da16473cd16715c02bb160a952ab07dd24a9d UNKNOWN * 01a933bd3da5462bbece0bf4b088494c9c99b0cd Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #8896: [HUDI-6326] Flink write supports consistent bucket index

hudi-bot commented on PR #8896: URL: https://github.com/apache/hudi/pull/8896#issuecomment-1588472053 ## CI report: * 2cf8f744f6074f7ce277de20204a70ee7dd18fb3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1778

[GitHub] [hudi] boneanxs commented on pull request #8452: [HUDI-6077] Add more partition push down filters

boneanxs commented on PR #8452: URL: https://github.com/apache/hudi/pull/8452#issuecomment-1588455087 Gentle ping @bvaradar, all comments are addressed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [hudi] thomasg19930417 commented on a diff in pull request #8911: [Hudi-8882] Compatible with versions below hive 2.3 to read hudi rt table

thomasg19930417 commented on code in PR #8911: URL: https://github.com/apache/hudi/pull/8911#discussion_r1227471241 ## hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/shims/Hive2Shim.java: ## @@ -53,4 +59,17 @@ public int getDays(Object dateWritable) { public long g

[GitHub] [hudi] hudi-bot commented on pull request #8950: [HUDI-6366] Prevent flink offline table service rerun completed instant

hudi-bot commented on PR #8950: URL: https://github.com/apache/hudi/pull/8950#issuecomment-1588438827 ## CI report: * 3c3905b81f2f25e9864f8dd8fe4d41d4f7f628db UNKNOWN * 379ab53b42f5d6daf6edd7f50e39a5da03621c6e UNKNOWN Bot commands @hudi-bot supports the following

[GitHub] [hudi] hudi-bot commented on pull request #8911: [Hudi-8882] Compatible with versions below hive 2.3 to read hudi rt table

hudi-bot commented on PR #8911: URL: https://github.com/apache/hudi/pull/8911#issuecomment-1588438736 ## CI report: * afbd84a73cdc4621ff516adcf9445781dc3b75f7 UNKNOWN * d919f87b331ef3273c9910fa77c668c58fb2edc3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] xicm commented on a diff in pull request #8911: [Hudi-8882] Compatible with versions below hive 2.3 to read hudi rt table

xicm commented on code in PR #8911: URL: https://github.com/apache/hudi/pull/8911#discussion_r1227456677 ## hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/shims/Hive2Shim.java: ## @@ -53,4 +59,17 @@ public int getDays(Object dateWritable) { public long getMills(Obj

[GitHub] [hudi] hudi-bot commented on pull request #8950: [HUDI-6366] Prevent flink offline table service rerun completed instant

hudi-bot commented on PR #8950: URL: https://github.com/apache/hudi/pull/8950#issuecomment-1588432173 ## CI report: * 3c3905b81f2f25e9864f8dd8fe4d41d4f7f628db UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #8911: [Hudi-8882] Compatible with versions below hive 2.3 to read hudi rt table

hudi-bot commented on PR #8911: URL: https://github.com/apache/hudi/pull/8911#issuecomment-1588432073 ## CI report: * afbd84a73cdc4621ff516adcf9445781dc3b75f7 UNKNOWN * d919f87b331ef3273c9910fa77c668c58fb2edc3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #8896: [HUDI-6326] Flink write supports consistent bucket index

hudi-bot commented on PR #8896: URL: https://github.com/apache/hudi/pull/8896#issuecomment-1588426744 ## CI report: * 2cf8f744f6074f7ce277de20204a70ee7dd18fb3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1778

[GitHub] [hudi] thomasg19930417 commented on pull request #8911: [Hudi-8882] Compatible with versions below hive 2.3 to read hudi rt table

thomasg19930417 commented on PR #8911: URL: https://github.com/apache/hudi/pull/8911#issuecomment-1588423179 @xicm The code has been moved into the new shim, please review the code -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

[jira] [Updated] (HUDI-6366) fix flink offline table service rerun issue

[ https://issues.apache.org/jira/browse/HUDI-6366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-6366: - Labels: pull-request-available (was: ) > fix flink offline table service rerun issue > --

[GitHub] [hudi] hbgstc123 opened a new pull request, #8950: [HUDI-6366] Prevent flink offline table service rerun completed instant

hbgstc123 opened a new pull request, #8950: URL: https://github.com/apache/hudi/pull/8950 If flink offline table service fail after commit the compaction/clustering instant, and a restart strategy is enable, then the completed instant will be rerun. Consequence is, if the completed i

[GitHub] [hudi] boneanxs commented on a diff in pull request #8876: [HUDI-6312] Guard incremental query for multi-writer scenario

boneanxs commented on code in PR #8876: URL: https://github.com/apache/hudi/pull/8876#discussion_r1227438042 ## hudi-common/src/main/java/org/apache/hudi/common/config/HoodieCommonConfig.java: ## @@ -72,13 +76,23 @@ public class HoodieCommonConfig extends HoodieConfig { .

[jira] [Created] (HUDI-6366) fix flink offline table service rerun issue

HBG created HUDI-6366: - Summary: fix flink offline table service rerun issue Key: HUDI-6366 URL: https://issues.apache.org/jira/browse/HUDI-6366 Project: Apache Hudi Issue Type: Bug Reporter:

[GitHub] [hudi] YannByron commented on a diff in pull request #8679: [DOCS] [RFC-69] Hudi 1.X

YannByron commented on code in PR #8679: URL: https://github.com/apache/hudi/pull/8679#discussion_r1227436740 ## rfc/rfc-69/rfc-69.md: ## @@ -0,0 +1,159 @@ + +# RFC-69: Hudi 1.X + +## Proposers + +* Vinoth Chandar + +## Approvers + +* Hudi PMC + +## Status + +Under Review + +#

[GitHub] [hudi] YannByron commented on a diff in pull request #8679: [DOCS] [RFC-69] Hudi 1.X

YannByron commented on code in PR #8679: URL: https://github.com/apache/hudi/pull/8679#discussion_r1227433131 ## rfc/rfc-69/rfc-69.md: ## @@ -0,0 +1,159 @@ + +# RFC-69: Hudi 1.X + +## Proposers + +* Vinoth Chandar + +## Approvers + +* Hudi PMC + +## Status + +Under Review + +#

[GitHub] [hudi] xicm commented on a diff in pull request #8911: [Hudi-8882] Compatible with versions below hive 2.3 to read hudi rt table

xicm commented on code in PR #8911: URL: https://github.com/apache/hudi/pull/8911#discussion_r1227427696 ## hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/hive/HoodieCombineHiveInputFormat.java: ## @@ -562,8 +568,35 @@ public RecordReader getRecordReader(InputSplit split,

[GitHub] [hudi] hudi-bot commented on pull request #8896: [HUDI-6326] Flink write supports consistent bucket index

hudi-bot commented on PR #8896: URL: https://github.com/apache/hudi/pull/8896#issuecomment-1588393556 ## CI report: * 29d4900ec4ef743a9853adb6cde41f2ea87961d6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1777

[GitHub] [hudi] hudi-bot commented on pull request #8896: [HUDI-6326] Flink write supports consistent bucket index

hudi-bot commented on PR #8896: URL: https://github.com/apache/hudi/pull/8896#issuecomment-1588385486 ## CI report: * 29d4900ec4ef743a9853adb6cde41f2ea87961d6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1777

[GitHub] [hudi] hudi-bot commented on pull request #8949: [DNM] Testing Java 17

hudi-bot commented on PR #8949: URL: https://github.com/apache/hudi/pull/8949#issuecomment-1588376527 ## CI report: * b7474d83f07597db3996e83e0bfa1decdc3bfbb5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1778

[GitHub] [hudi] hudi-bot commented on pull request #8896: [HUDI-6326] Flink write supports consistent bucket index

hudi-bot commented on PR #8896: URL: https://github.com/apache/hudi/pull/8896#issuecomment-1588376302 ## CI report: * 29d4900ec4ef743a9853adb6cde41f2ea87961d6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1777

[GitHub] [hudi] beyond1920 commented on pull request #8896: [HUDI-6326] Flink write supports consistent bucket index

beyond1920 commented on PR #8896: URL: https://github.com/apache/hudi/pull/8896#issuecomment-1588372860 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hudi] thomasg19930417 commented on a diff in pull request #8911: [Hudi-8882] Compatible with versions below hive 2.3 to read hudi rt table

thomasg19930417 commented on code in PR #8911: URL: https://github.com/apache/hudi/pull/8911#discussion_r1227399206 ## hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/hive/HoodieCombineHiveInputFormat.java: ## @@ -562,8 +568,35 @@ public RecordReader getRecordReader(InputSpl

[GitHub] [hudi] hudi-bot commented on pull request #8949: [DNM] Testing Java 17

hudi-bot commented on PR #8949: URL: https://github.com/apache/hudi/pull/8949#issuecomment-1588304502 ## CI report: * 9cf4d3329302e1f9687343e66ddeaec567e9f04b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1778

[GitHub] [hudi] hudi-bot commented on pull request #8949: [DNM] Testing Java 17

hudi-bot commented on PR #8949: URL: https://github.com/apache/hudi/pull/8949#issuecomment-1588296137 ## CI report: * 9cf4d3329302e1f9687343e66ddeaec567e9f04b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1778

[GitHub] [hudi] hudi-bot commented on pull request #8948: [MINOR] Upload coverage report to codecov.

hudi-bot commented on PR #8948: URL: https://github.com/apache/hudi/pull/8948#issuecomment-1588296110 ## CI report: * 699da16473cd16715c02bb160a952ab07dd24a9d UNKNOWN * 01a933bd3da5462bbece0bf4b088494c9c99b0cd Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] prashantwason commented on pull request #8948: [MINOR] Upload coverage report to codecov.

prashantwason commented on PR #8948: URL: https://github.com/apache/hudi/pull/8948#issuecomment-1588288368 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [hudi] hudi-bot commented on pull request #8949: [DNM] Testing Java 17

hudi-bot commented on PR #8949: URL: https://github.com/apache/hudi/pull/8949#issuecomment-1588258233 ## CI report: * 9cf4d3329302e1f9687343e66ddeaec567e9f04b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1778

[GitHub] [hudi] hudi-bot commented on pull request #8877: [DO NOT MERGE] Run GH CI with spark34 and java17 for release-0.13.1

hudi-bot commented on PR #8877: URL: https://github.com/apache/hudi/pull/8877#issuecomment-1588258093 ## CI report: * e9c9c7ad7f9c4213e72141ccc4f9ab0bc82e9abe UNKNOWN * bbf59ca8cdd2c0574aa5d86579313db4aab93704 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #8949: [DNM] Testing Java 17

hudi-bot commented on PR #8949: URL: https://github.com/apache/hudi/pull/8949#issuecomment-1588254402 ## CI report: * 9cf4d3329302e1f9687343e66ddeaec567e9f04b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #8877: [DO NOT MERGE] Run GH CI with spark34 and java17 for release-0.13.1

hudi-bot commented on PR #8877: URL: https://github.com/apache/hudi/pull/8877#issuecomment-1588254265 ## CI report: * e9c9c7ad7f9c4213e72141ccc4f9ab0bc82e9abe UNKNOWN * 154e9508b49a2582e4ecfef5cb7dd26ead79069b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #8948: [MINOR] Upload coverage report to codecov.

hudi-bot commented on PR #8948: URL: https://github.com/apache/hudi/pull/8948#issuecomment-1588248645 ## CI report: * 699da16473cd16715c02bb160a952ab07dd24a9d UNKNOWN * 01a933bd3da5462bbece0bf4b088494c9c99b0cd Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] nsivabalan commented on a diff in pull request #8899: [HUDI-6325] only filter override configs

nsivabalan commented on code in PR #8899: URL: https://github.com/apache/hudi/pull/8899#discussion_r1227328424 ## hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/functional/TestCOWDataSource.scala: ## @@ -1465,8 +1466,36 @@ class TestCOWDataSource extends Hoodie

[GitHub] [hudi] CTTY opened a new pull request, #8949: [DNM] Testing Java 17

CTTY opened a new pull request, #8949: URL: https://github.com/apache/hudi/pull/8949 ### Change Logs _Describe context and summary for this change. Highlight if any code was copied._ ### Impact _Describe any public API or user-facing feature change or any performance im

[GitHub] [hudi] hudi-bot commented on pull request #8945: [HUDI-6360]spark-memory parmater should not be forced to be true

hudi-bot commented on PR #8945: URL: https://github.com/apache/hudi/pull/8945#issuecomment-1588198127 ## CI report: * 09a49b9e90654c3b1ae1f32172af623b50011034 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1777

[GitHub] [hudi] abhisheksahani91 commented on issue #4839: Hudi upsert doesnt trigger compaction for MOR

abhisheksahani91 commented on issue #4839: URL: https://github.com/apache/hudi/issues/4839#issuecomment-1588159258 @Gatsby-Lee Below are the files present in .hoodie folder 2023-06-12 20:03:53 0 20230612143340370.compaction.inflight 2023-06-12 20:03:43 12375 2

[GitHub] [hudi] hudi-bot commented on pull request #8941: [HUDI-6363] Unify instant interface in HoodieActiveTimeline

hudi-bot commented on PR #8941: URL: https://github.com/apache/hudi/pull/8941#issuecomment-1588138436 ## CI report: * 2840b67b6d15e15dc91d330f7ce6a077d5a93664 UNKNOWN * 84d7b5aa3306e049f10423f4f0e393cc18bcc4af Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #8948: [MINOR] Upload coverage report to codecov.

hudi-bot commented on PR #8948: URL: https://github.com/apache/hudi/pull/8948#issuecomment-1588076485 ## CI report: * 699da16473cd16715c02bb160a952ab07dd24a9d UNKNOWN * 7f63c0316b4cc669f2f22809a08b18fa002dd905 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-

[GitHub] [hudi] hudi-bot commented on pull request #8948: [MINOR] Upload coverage report to codecov.

hudi-bot commented on PR #8948: URL: https://github.com/apache/hudi/pull/8948#issuecomment-1588062558 ## CI report: * 699da16473cd16715c02bb160a952ab07dd24a9d UNKNOWN * 7f63c0316b4cc669f2f22809a08b18fa002dd905 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #8944: [HUDI-6359]Spark offline compaction/clustering will never rollback when both requested and inflight states exist

hudi-bot commented on PR #8944: URL: https://github.com/apache/hudi/pull/8944#issuecomment-1588062478 ## CI report: * 4f325fba628fb015996aef1ef447043d1d7762c7 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1777

[GitHub] [hudi] hudi-bot commented on pull request #8896: [HUDI-6326] Flink write supports consistent bucket index

hudi-bot commented on PR #8896: URL: https://github.com/apache/hudi/pull/8896#issuecomment-1588049581 ## CI report: * 29d4900ec4ef743a9853adb6cde41f2ea87961d6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1777

[GitHub] [hudi] hudi-bot commented on pull request #8948: [MINOR] Upload coverage report to codecov.

hudi-bot commented on PR #8948: URL: https://github.com/apache/hudi/pull/8948#issuecomment-1587979516 ## CI report: * 699da16473cd16715c02bb160a952ab07dd24a9d UNKNOWN * 7f63c0316b4cc669f2f22809a08b18fa002dd905 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #8948: [MINOR] Upload coverage report to codecov.

hudi-bot commented on PR #8948: URL: https://github.com/apache/hudi/pull/8948#issuecomment-1587965892 ## CI report: * 699da16473cd16715c02bb160a952ab07dd24a9d UNKNOWN * 7f63c0316b4cc669f2f22809a08b18fa002dd905 UNKNOWN Bot commands @hudi-bot supports the following

[GitHub] [hudi] hudi-bot commented on pull request #8943: [HUDI-6365] Set hive sync tool only if syncs list is empty

hudi-bot commented on PR #8943: URL: https://github.com/apache/hudi/pull/8943#issuecomment-1587955211 ## CI report: * 099f6b40034d44ab744d25eecbdd714fee908aa8 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1777

[GitHub] [hudi] hudi-bot commented on pull request #8948: [MINOR] Upload coverage report to codecov.

hudi-bot commented on PR #8948: URL: https://github.com/apache/hudi/pull/8948#issuecomment-1587955306 ## CI report: * 699da16473cd16715c02bb160a952ab07dd24a9d UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #8929: [HUDI-6350] Allow athena to use the metadata table

hudi-bot commented on PR #8929: URL: https://github.com/apache/hudi/pull/8929#issuecomment-1587955091 ## CI report: * 7d809746f9d7c09c769d00e8c044d70a2bc4a782 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1777

[GitHub] [hudi] hudi-bot commented on pull request #8740: [HUDI-6231] Handle glue comments

hudi-bot commented on PR #8740: URL: https://github.com/apache/hudi/pull/8740#issuecomment-1587954388 ## CI report: * cb22b6dd9f799e2647a89f58767cc1f381f047e4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1777

[GitHub] [hudi] gtwuser closed issue #8878: [SUPPORT] Need help for generating partition from ISO timestamp in Glue 4.0

gtwuser closed issue #8878: [SUPPORT] Need help for generating partition from ISO timestamp in Glue 4.0 URL: https://github.com/apache/hudi/issues/8878 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [hudi] prashantwason commented on a diff in pull request #8684: [HUDI-6200] Enhancements to the MDT for improving performance of larger indexes.

prashantwason commented on code in PR #8684: URL: https://github.com/apache/hudi/pull/8684#discussion_r1227127259 ## hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/metadata/SparkHoodieMetadataBulkInsertPartitioner.java: ## @@ -0,0 +1,111 @@ +/* + * Licensed to the A

[GitHub] [hudi] prashantwason commented on a diff in pull request #8684: [HUDI-6200] Enhancements to the MDT for improving performance of larger indexes.

prashantwason commented on code in PR #8684: URL: https://github.com/apache/hudi/pull/8684#discussion_r1227126602 ## hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/metadata/SparkHoodieMetadataBulkInsertPartitioner.java: ## @@ -0,0 +1,111 @@ +/* + * Licensed to the A

[GitHub] [hudi] prashantwason commented on pull request #8948: [MINOR] Upload coverage report to codecov.

prashantwason commented on PR #8948: URL: https://github.com/apache/hudi/pull/8948#issuecomment-1587890793 This is WIP. Please do not merge until I have validated that code coverage is generated and uploaded correctly. -- This is an automated message from the Apache Git Service. To respon

[GitHub] [hudi] prashantwason opened a new pull request, #8948: [MINOR] Upload coverage report to codecov.

prashantwason opened a new pull request, #8948: URL: https://github.com/apache/hudi/pull/8948 [MINOR] Upload coverage report to codecov. ### Change Logs Code coverage reports are uploaded to codecov after tests are finished. Coverage should be visible at https://app.codecov.i

[GitHub] [hudi] prashantwason closed pull request #8947: [MINOR] Upload coverage report to codecov.

prashantwason closed pull request #8947: [MINOR] Upload coverage report to codecov. URL: https://github.com/apache/hudi/pull/8947 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [hudi] prashantwason commented on pull request #8947: [MINOR] Upload coverage report to codecov.

prashantwason commented on PR #8947: URL: https://github.com/apache/hudi/pull/8947#issuecomment-1587875644 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [hudi] yihua commented on issue #8925: Upsert taking too long to finish

yihua commented on issue #8925: URL: https://github.com/apache/hudi/issues/8925#issuecomment-1587874608 Hey @SamarthRaval , based on the stacktrace and Spark UI screenshots you provided, it looks like that the time-taking part is in the meta sync / table refresh in Spark, which does not use

[GitHub] [hudi] prashantwason commented on pull request #8947: [MINOR] Upload coverage report to codecov.

prashantwason commented on PR #8947: URL: https://github.com/apache/hudi/pull/8947#issuecomment-1587874814 This is WIP. Please do not merge until I have validated that code coverage is generated and uploaded correctly. -- This is an automated message from the Apache Git Service. To re

[GitHub] [hudi] prashantwason opened a new pull request, #8947: [MINOR] Upload coverage report to codecov.

prashantwason opened a new pull request, #8947: URL: https://github.com/apache/hudi/pull/8947 [MINOR] Upload coverage report to codecov. ### Change Logs Code coverage reports are uploaded to codecov after tests are finished. Coverage should be visible at https://app.codecov.i

[GitHub] [hudi] psy-47 closed pull request #8946: Ddp mrs 0.12.1

psy-47 closed pull request #8946: Ddp mrs 0.12.1 URL: https://github.com/apache/hudi/pull/8946 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-u

[GitHub] [hudi] psy-47 opened a new pull request, #8946: Ddp mrs 0.12.1

psy-47 opened a new pull request, #8946: URL: https://github.com/apache/hudi/pull/8946 ### Change Logs _Describe context and summary for this change. Highlight if any code was copied._ ### Impact _Describe any public API or user-facing feature change or any performance

[GitHub] [hudi] amrishlal commented on a diff in pull request #8879: [HUDI-6315] [WIP] Optimize UPSERT codepath to use meta fields instead of key generation and index lookup

amrishlal commented on code in PR #8879: URL: https://github.com/apache/hudi/pull/8879#discussion_r1227046893 ## hudi-spark-datasource/hudi-spark/src/main/java/org/apache/hudi/bootstrap/SparkFullBootstrapDataProviderBase.java: ## @@ -84,7 +84,7 @@ public JavaRDD generateInputRec

[GitHub] [hudi] parisni commented on pull request #8683: [HUDI-5533] Support spark columns comments

parisni commented on PR #8683: URL: https://github.com/apache/hudi/pull/8683#issuecomment-1587806101 while `spark.read.format("hudi").load("path")` and `spark.table("database.table")` returns the comments within the schema, `spark.sql("desc database.schema")` won't. So I have to investigat

[GitHub] [hudi] hudi-bot commented on pull request #8896: [HUDI-6326] Flink write supports consistent bucket index

hudi-bot commented on PR #8896: URL: https://github.com/apache/hudi/pull/8896#issuecomment-1587799354 ## CI report: * 280e58f06988708e9e364a4ff32e8c33c8b8a353 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1776

[GitHub] [hudi] abhisheksahani91 commented on issue #4839: Hudi upsert doesnt trigger compaction for MOR

abhisheksahani91 commented on issue #4839: URL: https://github.com/apache/hudi/issues/4839#issuecomment-1587782041 @Gatsby-Lee I tried Glue 4.0, I have used HoodieDeltaStreamer to read from Kafka and write it to the Hudi MoR table I can see *.compaction.requested file under the .

[GitHub] [hudi] hudi-bot commented on pull request #8896: [HUDI-6326] Flink write supports consistent bucket index

hudi-bot commented on PR #8896: URL: https://github.com/apache/hudi/pull/8896#issuecomment-1587780986 ## CI report: * 280e58f06988708e9e364a4ff32e8c33c8b8a353 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1776

[GitHub] [hudi] codope commented on a diff in pull request #8758: [HUDI-53] Implementation of record_index - a HUDI index based on the metadata table.

codope commented on code in PR #8758: URL: https://github.com/apache/hudi/pull/8758#discussion_r1227025649 ## hudi-common/src/main/java/org/apache/hudi/metadata/BaseTableMetadata.java: ## @@ -143,46 +126,33 @@ public List getAllPartitionPaths() throws IOException { * @param

[GitHub] [hudi] xccui closed issue #8120: [SUPPORT] Flink Job was stuck on `AbstractStreamWriteFunction.instantToWrite()` after recovering

xccui closed issue #8120: [SUPPORT] Flink Job was stuck on `AbstractStreamWriteFunction.instantToWrite()` after recovering URL: https://github.com/apache/hudi/issues/8120 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

[GitHub] [hudi] hudi-bot commented on pull request #8945: [HUDI-6360]spark-memory parmater should not be forced to be true

hudi-bot commented on PR #8945: URL: https://github.com/apache/hudi/pull/8945#issuecomment-1587698687 ## CI report: * 09a49b9e90654c3b1ae1f32172af623b50011034 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1777

[jira] [Updated] (HUDI-6360) spark-memory parmater should not be forced to be true

[ https://issues.apache.org/jira/browse/HUDI-6360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-6360: - Labels: pull-request-available (was: ) > spark-memory parmater should not be forced to be true >

[GitHub] [hudi] hudi-bot commented on pull request #8945: [HUDI-6360]spark-memory parmater should not be forced to be true

hudi-bot commented on PR #8945: URL: https://github.com/apache/hudi/pull/8945#issuecomment-1587687423 ## CI report: * 09a49b9e90654c3b1ae1f32172af623b50011034 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #8941: [HUDI-6363] Unify instant interface in HoodieActiveTimeline

hudi-bot commented on PR #8941: URL: https://github.com/apache/hudi/pull/8941#issuecomment-1587687290 ## CI report: * 2840b67b6d15e15dc91d330f7ce6a077d5a93664 UNKNOWN * b6df2c706182c5bb28df93a0e4fee95208170e9e Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-

[GitHub] [hudi] hudi-bot commented on pull request #8876: [HUDI-6312] Guard incremental query for multi-writer scenario

hudi-bot commented on PR #8876: URL: https://github.com/apache/hudi/pull/8876#issuecomment-1587673648 ## CI report: * 904e11c5a1d3e2d57f7ea8d9696415d517bf83b9 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1776

[GitHub] [hudi] hudi-bot commented on pull request #8941: [HUDI-6363] Unify instant interface in HoodieActiveTimeline

hudi-bot commented on PR #8941: URL: https://github.com/apache/hudi/pull/8941#issuecomment-1587674067 ## CI report: * 2840b67b6d15e15dc91d330f7ce6a077d5a93664 UNKNOWN * b6df2c706182c5bb28df93a0e4fee95208170e9e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

  1   2   3   >