[GitHub] [hudi] hudi-bot commented on pull request #9770: [MINOR] Fix the check for connector identity in HoodieHiveCatalog

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9770: URL: https://github.com/apache/hudi/pull/9770#issuecomment-1732235095 ## CI report: * f8f9306b26fd413c90d4b8cc30ce8ab5fa2edf60 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #9717: [HUDI-6806] Support Spark 3.5.0

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9717: URL: https://github.com/apache/hudi/pull/9717#issuecomment-1732235062 ## CI report: * 9b8fdd2d1b69da528069e364790b53af1d6150af UNKNOWN * 8bb2b9fc024e9b08e8dcde9f2ac2c28fceddfaed Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] geserdugarov commented on a diff in pull request #8062: [HUDI-5823][RFC-65] RFC for Partition TTL Management

2023-09-22 Thread via GitHub
geserdugarov commented on code in PR #8062: URL: https://github.com/apache/hudi/pull/8062#discussion_r1334927622 ## rfc/rfc-65/rfc-65.md: ## @@ -0,0 +1,209 @@ +## Proposers + +- @stream2000 +- @hujincalrin +- @huberylee +- @YuweiXiao + +## Approvers + +## Status + +JIRA: [HUDI-5

[GitHub] [hudi] geserdugarov commented on a diff in pull request #8062: [HUDI-5823][RFC-65] RFC for Partition TTL Management

2023-09-22 Thread via GitHub
geserdugarov commented on code in PR #8062: URL: https://github.com/apache/hudi/pull/8062#discussion_r1334928958 ## rfc/rfc-65/rfc-65.md: ## @@ -0,0 +1,209 @@ +## Proposers + +- @stream2000 +- @hujincalrin +- @huberylee +- @YuweiXiao + +## Approvers + +## Status + +JIRA: [HUDI-5

[GitHub] [hudi] geserdugarov commented on a diff in pull request #8062: [HUDI-5823][RFC-65] RFC for Partition TTL Management

2023-09-22 Thread via GitHub
geserdugarov commented on code in PR #8062: URL: https://github.com/apache/hudi/pull/8062#discussion_r1334923947 ## rfc/rfc-65/rfc-65.md: ## @@ -0,0 +1,209 @@ +## Proposers + +- @stream2000 +- @hujincalrin +- @huberylee +- @YuweiXiao + +## Approvers + +## Status + +JIRA: [HUDI-5

[GitHub] [hudi] yihua commented on pull request #9570: [DNM] Run UT for Spark 3.5.0 on 0.14.0

2023-09-22 Thread via GitHub
yihua commented on PR #9570: URL: https://github.com/apache/hudi/pull/9570#issuecomment-1732227600 @CTTY is this PR still needed given you've put up #9717? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hudi] boneanxs commented on pull request #9617: [HUDI-1623] Solid completion time on timeline

2023-09-22 Thread via GitHub
boneanxs commented on PR #9617: URL: https://github.com/apache/hudi/pull/9617#issuecomment-1732227136 @danny0405 The trino test failure is caused by trino image always use an old hudi-trino-bundle jar: we can see `/usr/local/trino/plugin/hive/hudi-trino-bundle.jar` ```bash root@

[GitHub] [hudi] yihua commented on pull request #9770: [MINOR] Fix the check for connector identity in HoodieHiveCatalog

2023-09-22 Thread via GitHub
yihua commented on PR #9770: URL: https://github.com/apache/hudi/pull/9770#issuecomment-1732227074 @danny0405 This should be ok, correct? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

[GitHub] [hudi] yihua commented on a diff in pull request #9770: [MINOR] Fix the check for connector identity in HoodieHiveCatalog

2023-09-22 Thread via GitHub
yihua commented on code in PR #9770: URL: https://github.com/apache/hudi/pull/9770#discussion_r1334929513 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/table/catalog/HoodieHiveCatalog.java: ## @@ -455,8 +456,9 @@ public void createTable(ObjectPath tablePath,

[hudi] branch master updated (4e0cad7c8d7 -> 11ae8b05fdd)

2023-09-22 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 4e0cad7c8d7 [MINOR] Mark a few new configs advanced and tag since version of 0.14.0 (#9771) add 11ae8b05fdd [HUDI-6

[GitHub] [hudi] geserdugarov commented on a diff in pull request #8062: [HUDI-5823][RFC-65] RFC for Partition TTL Management

2023-09-22 Thread via GitHub
geserdugarov commented on code in PR #8062: URL: https://github.com/apache/hudi/pull/8062#discussion_r1334248487 ## rfc/rfc-65/rfc-65.md: ## @@ -0,0 +1,209 @@ +## Proposers + +- @stream2000 +- @hujincalrin +- @huberylee +- @YuweiXiao + +## Approvers + +## Status + +JIRA: [HUDI-5

[GitHub] [hudi] yihua merged pull request #9754: [HUDI-6881] Hudi configured spark.scheduler.allocation.file should include scheme since Spark3.2

2023-09-22 Thread via GitHub
yihua merged PR #9754: URL: https://github.com/apache/hudi/pull/9754 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

[GitHub] [hudi] yihua commented on pull request #9760: [HUDI-6887] Add test for Record Index and MIT queries

2023-09-22 Thread via GitHub
yihua commented on PR #9760: URL: https://github.com/apache/hudi/pull/9760#issuecomment-1732226204 This test failed: `- Test MergeInto With Record Index and Data Skipping * FAILED *` -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [hudi] hudi-bot commented on pull request #9754: [HUDI-6881] Hudi configured spark.scheduler.allocation.file should include scheme since Spark3.2

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9754: URL: https://github.com/apache/hudi/pull/9754#issuecomment-1732223537 ## CI report: * cdf0c9aa3f8c71e6bd821e2743e317fff640697c Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2004

[GitHub] [hudi] hudi-bot commented on pull request #9585: [HUDI-6809] Optimizing the judgment of generating clustering plans

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9585: URL: https://github.com/apache/hudi/pull/9585#issuecomment-1732223474 ## CI report: * eee170ba57b85ed506b67dcb7a56bb85b7d24668 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2008

[GitHub] [hudi] Zouxxyy commented on a diff in pull request #9770: [MINOR] Fix the check for connector identity in HoodieHiveCatalog

2023-09-22 Thread via GitHub
Zouxxyy commented on code in PR #9770: URL: https://github.com/apache/hudi/pull/9770#discussion_r1334927198 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/table/catalog/HoodieHiveCatalog.java: ## @@ -455,8 +456,9 @@ public void createTable(ObjectPath tablePath

[GitHub] [hudi] hudi-bot commented on pull request #9717: [HUDI-6806] Support Spark 3.5.0

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9717: URL: https://github.com/apache/hudi/pull/9717#issuecomment-1732214874 ## CI report: * 9b8fdd2d1b69da528069e364790b53af1d6150af UNKNOWN * 8bb2b9fc024e9b08e8dcde9f2ac2c28fceddfaed Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #9717: [HUDI-6806] Support Spark 3.5.0

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9717: URL: https://github.com/apache/hudi/pull/9717#issuecomment-1732213484 ## CI report: * 9b8fdd2d1b69da528069e364790b53af1d6150af UNKNOWN * 8bb2b9fc024e9b08e8dcde9f2ac2c28fceddfaed Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #9760: [HUDI-6887] Add test for Record Index and MIT queries

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9760: URL: https://github.com/apache/hudi/pull/9760#issuecomment-1732212100 ## CI report: * 3e9cac70586871e20754da0bd33387bb48e70af7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2006

[GitHub] [hudi] hudi-bot commented on pull request #9585: [HUDI-6809] Optimizing the judgment of generating clustering plans

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9585: URL: https://github.com/apache/hudi/pull/9585#issuecomment-1732202763 ## CI report: * eee170ba57b85ed506b67dcb7a56bb85b7d24668 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2008

[GitHub] [hudi] hudi-bot commented on pull request #9754: [HUDI-6881] Hudi configured spark.scheduler.allocation.file should include scheme since Spark3.2

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9754: URL: https://github.com/apache/hudi/pull/9754#issuecomment-1732201385 ## CI report: * cdf0c9aa3f8c71e6bd821e2743e317fff640697c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2004

[GitHub] [hudi] hudi-bot commented on pull request #9585: [HUDI-6809] Optimizing the judgment of generating clustering plans

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9585: URL: https://github.com/apache/hudi/pull/9585#issuecomment-1732201298 ## CI report: * eee170ba57b85ed506b67dcb7a56bb85b7d24668 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #9754: [HUDI-6881] Hudi configured spark.scheduler.allocation.file should include scheme since Spark3.2

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9754: URL: https://github.com/apache/hudi/pull/9754#issuecomment-1732193498 ## CI report: * cdf0c9aa3f8c71e6bd821e2743e317fff640697c UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] yihua closed pull request #9718: [HUDI-6820] Disabling embedded timeline server for java tests

2023-09-22 Thread via GitHub
yihua closed pull request #9718: [HUDI-6820] Disabling embedded timeline server for java tests URL: https://github.com/apache/hudi/pull/9718 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

[GitHub] [hudi] yihua commented on pull request #9765: [HUDI-4756] Remove unused config "assume.date.partition"

2023-09-22 Thread via GitHub
yihua commented on PR #9765: URL: https://github.com/apache/hudi/pull/9765#issuecomment-1732179348 @linliu-code could you check the test failures in Azure CI? They look legit and not flakiness. -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hudi] hudi-bot commented on pull request #9760: [HUDI-6887] Add test for Record Index and MIT queries

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9760: URL: https://github.com/apache/hudi/pull/9760#issuecomment-1732179094 ## CI report: * 3e9cac70586871e20754da0bd33387bb48e70af7 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2006

[hudi] branch master updated (84a80e21b5f -> 4e0cad7c8d7)

2023-09-22 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 84a80e21b5f [MINOR] Set connection settings for maven to avoid build flakiness (#9772) add 4e0cad7c8d7 [MINOR] Mark

[GitHub] [hudi] yihua merged pull request #9771: [MINOR] Mark a few new configs advanced and tag since version of 0.14.0

2023-09-22 Thread via GitHub
yihua merged PR #9771: URL: https://github.com/apache/hudi/pull/9771 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

[GitHub] [hudi] yihua commented on pull request #9771: [MINOR] Mark a few new configs advanced and tag since version

2023-09-22 Thread via GitHub
yihua commented on PR #9771: URL: https://github.com/apache/hudi/pull/9771#issuecomment-1732178837 CI is green. https://github.com/apache/hudi/assets/2497195/44a899bd-caa6-40ad-bf7e-346f9f6d0edc";> As this does not change any core logic and only affects doc generation, will merge this

[GitHub] [hudi] hudi-bot commented on pull request #9771: [MINOR] Mark a few new configs advanced and tag since version

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9771: URL: https://github.com/apache/hudi/pull/9771#issuecomment-1732177037 ## CI report: * 5a77ba8e11641c5c9d7a04791e38963fe50328dc Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2009

[GitHub] [hudi] hudi-bot commented on pull request #9760: [HUDI-6887] Add test for Record Index and MIT queries

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9760: URL: https://github.com/apache/hudi/pull/9760#issuecomment-1732177016 ## CI report: * 3e9cac70586871e20754da0bd33387bb48e70af7 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #9571: Enabling comprehensive schema evolution in delta streamer code

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9571: URL: https://github.com/apache/hudi/pull/9571#issuecomment-1732176883 ## CI report: * a3145c33437cbccc8cac712880d354d6e8184d57 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2010

[GitHub] [hudi] hudi-bot commented on pull request #9774: [HUDI-6873] fix clustering mor

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9774: URL: https://github.com/apache/hudi/pull/9774#issuecomment-1732155112 ## CI report: * 25d900c216bdeb1e8bd55ce4533f0ce865c27999 UNKNOWN * b23c1a453cd23e15ec06476441cc9b088166a99a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #9571: Enabling comprehensive schema evolution in delta streamer code

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9571: URL: https://github.com/apache/hudi/pull/9571#issuecomment-1732154957 ## CI report: * 9e700558a21605022307150086a545547dcc44fa Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1961

[GitHub] [hudi] hudi-bot commented on pull request #9571: Enabling comprehensive schema evolution in delta streamer code

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9571: URL: https://github.com/apache/hudi/pull/9571#issuecomment-1732140436 ## CI report: * 9e700558a21605022307150086a545547dcc44fa Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1961

[GitHub] [hudi] hudi-bot commented on pull request #9771: [MINOR] Mark a few new configs advanced and tag since version

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9771: URL: https://github.com/apache/hudi/pull/9771#issuecomment-1732137047 ## CI report: * 5a77ba8e11641c5c9d7a04791e38963fe50328dc Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2009

[GitHub] [hudi] hudi-bot commented on pull request #9774: [HUDI-6873] fix clustering mor

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9774: URL: https://github.com/apache/hudi/pull/9774#issuecomment-1732134090 ## CI report: * 25d900c216bdeb1e8bd55ce4533f0ce865c27999 UNKNOWN * b23c1a453cd23e15ec06476441cc9b088166a99a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #9771: [MINOR] Mark a few new configs advanced and tag since version

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9771: URL: https://github.com/apache/hudi/pull/9771#issuecomment-1732134062 ## CI report: * 5a77ba8e11641c5c9d7a04791e38963fe50328dc UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] yihua commented on pull request #9554: [HUDI-6760] Add SelfDescribingInputFormatInterface for hive FileInput…

2023-09-22 Thread via GitHub
yihua commented on PR #9554: URL: https://github.com/apache/hudi/pull/9554#issuecomment-1732120345 @Zouxxyy have you figured out why integration tests failed in the GH actions? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

[GitHub] [hudi] hudi-bot commented on pull request #9774: [HUDI-6873] fix clustering mor

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9774: URL: https://github.com/apache/hudi/pull/9774#issuecomment-1732115418 ## CI report: * 25d900c216bdeb1e8bd55ce4533f0ce865c27999 UNKNOWN * b23c1a453cd23e15ec06476441cc9b088166a99a UNKNOWN Bot commands @hudi-bot supports the following

[GitHub] [hudi] hudi-bot commented on pull request #9765: [HUDI-4756] Remove unused config "assume.date.partition"

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9765: URL: https://github.com/apache/hudi/pull/9765#issuecomment-1732115372 ## CI report: * abb176af3da667801ea55343ccc3768e31830401 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2008

[GitHub] [hudi] hudi-bot commented on pull request #9774: [HUDI-6873] fix clustering mor

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9774: URL: https://github.com/apache/hudi/pull/9774#issuecomment-1732110911 ## CI report: * 25d900c216bdeb1e8bd55ce4533f0ce865c27999 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #9765: [HUDI-4756] Remove unused config "assume.date.partition"

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9765: URL: https://github.com/apache/hudi/pull/9765#issuecomment-1732110869 ## CI report: * abb176af3da667801ea55343ccc3768e31830401 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2008

[jira] [Updated] (HUDI-6873) Clustering MOR applies base files after log files

2023-09-22 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-6873: -- Status: In Progress (was: Open) > Clustering MOR applies base files after log files > -

[jira] [Updated] (HUDI-6873) Clustering MOR applies base files after log files

2023-09-22 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-6873: -- Status: Patch Available (was: In Progress) > Clustering MOR applies base files after log files

[GitHub] [hudi] hudi-bot commented on pull request #9765: [HUDI-4756] Remove unused config "assume.date.partition"

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9765: URL: https://github.com/apache/hudi/pull/9765#issuecomment-1732106598 ## CI report: * abb176af3da667801ea55343ccc3768e31830401 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[jira] [Updated] (HUDI-6873) Clustering MOR applies base files after log files

2023-09-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-6873: - Labels: pull-request-available (was: ) > Clustering MOR applies base files after log files >

[GitHub] [hudi] jonvex opened a new pull request, #9774: [HUDI-6873] fix clustering mor

2023-09-22 Thread via GitHub
jonvex opened a new pull request, #9774: URL: https://github.com/apache/hudi/pull/9774 ### Change Logs Base file is applied after log files which is an issue if they have the same precombine ### Impact clustering now works as expected ### Risk level (write none,

[GitHub] [hudi] yihua commented on pull request #9726: [MINOR] Build failed using master

2023-09-22 Thread via GitHub
yihua commented on PR #9726: URL: https://github.com/apache/hudi/pull/9726#issuecomment-1732064106 @danny0405 @codope are you good with the changes? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [hudi] yihua commented on pull request #9733: [WIP][DNM] test ci timeout

2023-09-22 Thread via GitHub
yihua commented on PR #9733: URL: https://github.com/apache/hudi/pull/9733#issuecomment-1732062880 Closing testing-only PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hudi] yihua closed pull request #9733: [WIP][DNM] test ci timeout

2023-09-22 Thread via GitHub
yihua closed pull request #9733: [WIP][DNM] test ci timeout URL: https://github.com/apache/hudi/pull/9733 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail

[GitHub] [hudi] yihua closed pull request #9697: [HUDI-6820] CI Timeout test disable TestHoodieCombineHiveInputFormat and TestSchemaEvolutionClient - 3

2023-09-22 Thread via GitHub
yihua closed pull request #9697: [HUDI-6820] CI Timeout test disable TestHoodieCombineHiveInputFormat and TestSchemaEvolutionClient - 3 URL: https://github.com/apache/hudi/pull/9697 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hudi] yihua commented on pull request #9697: [HUDI-6820] CI Timeout test disable TestHoodieCombineHiveInputFormat and TestSchemaEvolutionClient - 3

2023-09-22 Thread via GitHub
yihua commented on PR #9697: URL: https://github.com/apache/hudi/pull/9697#issuecomment-1732062665 Closing testing-only PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hudi] yihua closed pull request #9696: [HUDI-6820] CI Timeout test disable TestHoodieCombineHiveInputFormat and TestSchemaEvolutionClient - 2

2023-09-22 Thread via GitHub
yihua closed pull request #9696: [HUDI-6820] CI Timeout test disable TestHoodieCombineHiveInputFormat and TestSchemaEvolutionClient - 2 URL: https://github.com/apache/hudi/pull/9696 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hudi] yihua commented on pull request #9696: [HUDI-6820] CI Timeout test disable TestHoodieCombineHiveInputFormat and TestSchemaEvolutionClient - 2

2023-09-22 Thread via GitHub
yihua commented on PR #9696: URL: https://github.com/apache/hudi/pull/9696#issuecomment-1732062577 Closing testing-only PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hudi] yihua commented on pull request #9695: [HUDI-6820] CI Timeout test disable TestHoodieCombineHiveInputFormat and TestSchemaEvolutionClient - 1

2023-09-22 Thread via GitHub
yihua commented on PR #9695: URL: https://github.com/apache/hudi/pull/9695#issuecomment-1732062436 Closing testing-only PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hudi] yihua closed pull request #9695: [HUDI-6820] CI Timeout test disable TestHoodieCombineHiveInputFormat and TestSchemaEvolutionClient - 1

2023-09-22 Thread via GitHub
yihua closed pull request #9695: [HUDI-6820] CI Timeout test disable TestHoodieCombineHiveInputFormat and TestSchemaEvolutionClient - 1 URL: https://github.com/apache/hudi/pull/9695 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hudi] yihua commented on pull request #9718: [HUDI-6820] Disabling embedded timeline server for java tests

2023-09-22 Thread via GitHub
yihua commented on PR #9718: URL: https://github.com/apache/hudi/pull/9718#issuecomment-1732062150 Closing testing-only PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hudi] yihua closed pull request #9719: [HUDI-6820] Disabling embedded timeline server for java tests(2)

2023-09-22 Thread via GitHub
yihua closed pull request #9719: [HUDI-6820] Disabling embedded timeline server for java tests(2) URL: https://github.com/apache/hudi/pull/9719 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[GitHub] [hudi] yihua commented on pull request #9719: [HUDI-6820] Disabling embedded timeline server for java tests(2)

2023-09-22 Thread via GitHub
yihua commented on PR #9719: URL: https://github.com/apache/hudi/pull/9719#issuecomment-1732061803 Closing testing-only PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hudi] yihua closed pull request #9720: [HUDI-6820] Disabling embedded timeline server for java tests(3)

2023-09-22 Thread via GitHub
yihua closed pull request #9720: [HUDI-6820] Disabling embedded timeline server for java tests(3) URL: https://github.com/apache/hudi/pull/9720 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[GitHub] [hudi] yihua commented on pull request #9720: [HUDI-6820] Disabling embedded timeline server for java tests(3)

2023-09-22 Thread via GitHub
yihua commented on PR #9720: URL: https://github.com/apache/hudi/pull/9720#issuecomment-1732061649 Closing testing-only PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hudi] yihua merged pull request #9756: [DOCS] Update configurations page for 0.14.0

2023-09-22 Thread via GitHub
yihua merged PR #9756: URL: https://github.com/apache/hudi/pull/9756 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

[jira] [Updated] (HUDI-6873) Clustering MOR applies base files after log files

2023-09-22 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-6873: -- Description: If the payload is overwritewithlatestavropayload this matters because if the base f

[GitHub] [hudi] yihua commented on pull request #9767: [MINOR][DOC] Update index type desc

2023-09-22 Thread via GitHub
yihua commented on PR #9767: URL: https://github.com/apache/hudi/pull/9767#issuecomment-1732059680 @nfarah86 has been working on improving Indexing docs. @nfarah86 do you want to review this PR? cc @bhasudha -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hudi] yihua commented on pull request #9769: [MINOR][DOC] updated schema evolution code sample in public docs

2023-09-22 Thread via GitHub
yihua commented on PR #9769: URL: https://github.com/apache/hudi/pull/9769#issuecomment-1732057323 Hi @sagarlakshmipathy Thanks for the improvement on the docs! Files under `content/` are automatically changed and should not be in the PR. Also, could you update `website/docs/schema_evolut

[GitHub] [hudi] yihua commented on a diff in pull request #9770: [MINOR] Fix the check for connector identity in HoodieHiveCatalog

2023-09-22 Thread via GitHub
yihua commented on code in PR #9770: URL: https://github.com/apache/hudi/pull/9770#discussion_r1334828175 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/table/catalog/HoodieHiveCatalog.java: ## @@ -455,8 +456,9 @@ public void createTable(ObjectPath tablePath,

[hudi] branch master updated (03fdc63ac58 -> 84a80e21b5f)

2023-09-22 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 03fdc63ac58 [HUDI-6882] Differentiate between replacecommits in cluster planning (#9755) add 84a80e21b5f [MINOR] Se

[GitHub] [hudi] yihua merged pull request #9772: [MINOR] Set connection settings for maven to avoid build flakiness

2023-09-22 Thread via GitHub
yihua merged PR #9772: URL: https://github.com/apache/hudi/pull/9772 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

[GitHub] [hudi] yihua commented on pull request #9772: [MINOR] Set connection settings for maven to avoid build flakiness

2023-09-22 Thread via GitHub
yihua commented on PR #9772: URL: https://github.com/apache/hudi/pull/9772#issuecomment-1732036495 Maven builds pass in CI. Going to merge this PR now to improve CI stability. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

[GitHub] [hudi] hudi-bot commented on pull request #9771: [MINOR] Mark a few new configs advanced and tag since version

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9771: URL: https://github.com/apache/hudi/pull/9771#issuecomment-1732030698 ## CI report: * 79952023deac529add671ea09f5a28d1281cf600 UNKNOWN * 5a77ba8e11641c5c9d7a04791e38963fe50328dc Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #9771: [MINOR] Mark a few new configs advanced and tag since version

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9771: URL: https://github.com/apache/hudi/pull/9771#issuecomment-1732022937 ## CI report: * 79952023deac529add671ea09f5a28d1281cf600 UNKNOWN * 5a77ba8e11641c5c9d7a04791e38963fe50328dc Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #9717: [HUDI-6806] Support Spark 3.5.0

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9717: URL: https://github.com/apache/hudi/pull/9717#issuecomment-1732022682 ## CI report: * 9b8fdd2d1b69da528069e364790b53af1d6150af UNKNOWN * 8bb2b9fc024e9b08e8dcde9f2ac2c28fceddfaed Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #9593: [HUDI-6784] Support deletion logic in merger

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9593: URL: https://github.com/apache/hudi/pull/9593#issuecomment-1732022365 ## CI report: * d98bb35597dd653a6cdfa9210294159768fc66f8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2010

[GitHub] [hudi] hudi-bot commented on pull request #9772: [MINOR] Set connection settings for maven to avoid build flakiness

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9772: URL: https://github.com/apache/hudi/pull/9772#issuecomment-1731981265 ## CI report: * 11ef419ee4783c0e0e7092d7aa17cf8bdd48c0ac Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2009

[GitHub] [hudi] hudi-bot commented on pull request #9772: [MINOR] Set connection settings for maven to avoid build flakiness

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9772: URL: https://github.com/apache/hudi/pull/9772#issuecomment-1731972185 ## CI report: * 11ef419ee4783c0e0e7092d7aa17cf8bdd48c0ac Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2009

[GitHub] [hudi] hudi-bot commented on pull request #9772: [MINOR] Set connection settings for maven to avoid build flakiness

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9772: URL: https://github.com/apache/hudi/pull/9772#issuecomment-1731963318 ## CI report: * 11ef419ee4783c0e0e7092d7aa17cf8bdd48c0ac Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2009

[GitHub] [hudi] hudi-bot commented on pull request #9593: [HUDI-6784] Support deletion logic in merger

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9593: URL: https://github.com/apache/hudi/pull/9593#issuecomment-1731962735 ## CI report: * d98bb35597dd653a6cdfa9210294159768fc66f8 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2010

[GitHub] [hudi] the-other-tim-brown commented on a diff in pull request #9762: [HUDI-6888] [WIP] Optimize scanInternalV2 in AbstractHoodieLogRecordReader

2023-09-22 Thread via GitHub
the-other-tim-brown commented on code in PR #9762: URL: https://github.com/apache/hudi/pull/9762#discussion_r1334758176 ## hudi-common/src/main/java/org/apache/hudi/common/table/log/AbstractHoodieLogRecordReader.java: ## @@ -539,6 +542,121 @@ private void updateBlockSequenceTrac

[GitHub] [hudi] linliu-code commented on pull request #9593: [HUDI-6784] Support deletion logic in merger

2023-09-22 Thread via GitHub
linliu-code commented on PR #9593: URL: https://github.com/apache/hudi/pull/9593#issuecomment-1731938290 Ok, working on the comments now. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

[GitHub] [hudi] parisni commented on pull request #9245: Fix parquet bloom filters impl and tests

2023-09-22 Thread via GitHub
parisni commented on PR #9245: URL: https://github.com/apache/hudi/pull/9245#issuecomment-1731937879 Hi, the parquet bloom filter will be available in the 0.14.x release see https://github.com/apache/hudi/blob/release-0.14.0-rc3/hudi-common/src/main/java/org/apache/hudi/io/storage/Hood

[GitHub] [hudi] hudi-bot commented on pull request #9593: [HUDI-6784] Support deletion logic in merger

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9593: URL: https://github.com/apache/hudi/pull/9593#issuecomment-1731916235 ## CI report: * d98bb35597dd653a6cdfa9210294159768fc66f8 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2009

[GitHub] [hudi] yihua closed pull request #9773: [MINOR][DNM] Validate 0.14.0 RC3 bundles

2023-09-22 Thread via GitHub
yihua closed pull request #9773: [MINOR][DNM] Validate 0.14.0 RC3 bundles URL: https://github.com/apache/hudi/pull/9773 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

[GitHub] [hudi] yihua commented on pull request #9773: [MINOR][DNM] Validate 0.14.0 RC3 bundles

2023-09-22 Thread via GitHub
yihua commented on PR #9773: URL: https://github.com/apache/hudi/pull/9773#issuecomment-1731910080 Closing this testing-only PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

[GitHub] [hudi] yihua commented on pull request #9593: [HUDI-6784] Support deletion logic in merger

2023-09-22 Thread via GitHub
yihua commented on PR #9593: URL: https://github.com/apache/hudi/pull/9593#issuecomment-1731908929 To be fully compatible with before, the places where `HoodieRecordPayload` APIs (`#preCombine`, `#combineAndGetUpdateValue`, and `#getInsertValue`) are called should call merge API too.

[GitHub] [hudi] hudi-bot commented on pull request #9773: [MINOR][DNM] Validate 0.14.0 RC3 bundles

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9773: URL: https://github.com/apache/hudi/pull/9773#issuecomment-1731907384 ## CI report: * 4f30bb045f8068c2ac5173fa25f555fc7af62f6e Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=200

[GitHub] [hudi] hudi-bot commented on pull request #9617: [HUDI-1623] Solid completion time on timeline

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9617: URL: https://github.com/apache/hudi/pull/9617#issuecomment-1731906859 ## CI report: * 188bb6b68ea966e35a84a8a4162cb66d180069c5 UNKNOWN * 77c3a8430fe56befe408073e2f8aee568b91e9b9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #9593: [HUDI-6784] Support deletion logic in merger

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9593: URL: https://github.com/apache/hudi/pull/9593#issuecomment-1731906653 ## CI report: * d98bb35597dd653a6cdfa9210294159768fc66f8 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] yihua commented on pull request #9593: [HUDI-6784] Support deletion logic in merger

2023-09-22 Thread via GitHub
yihua commented on PR #9593: URL: https://github.com/apache/hudi/pull/9593#issuecomment-1731899702 Pasting my deep-diving of the code based on release 0.12.2 (pre-landing of RFC-46 PR #7345 ) here. Here is how different APIs, `#preCombine`, `#combineAndGetUpdateValue`, and `#getInsertValue

[GitHub] [hudi] hudi-bot commented on pull request #9773: [MINOR][DNM] Validate 0.14.0 RC3 bundles

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9773: URL: https://github.com/apache/hudi/pull/9773#issuecomment-1731897690 ## CI report: * 4f30bb045f8068c2ac5173fa25f555fc7af62f6e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2009

[GitHub] [hudi] hudi-bot commented on pull request #9771: [MINOR] Mark a few new configs advanced

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9771: URL: https://github.com/apache/hudi/pull/9771#issuecomment-1731897562 ## CI report: * 79952023deac529add671ea09f5a28d1281cf600 UNKNOWN * 7d5b6a8797daa876efbfca0e63f05eba336d7e48 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-

[GitHub] [hudi] yihua commented on a diff in pull request #9593: [HUDI-6784] Support deletion logic in merger

2023-09-22 Thread via GitHub
yihua commented on code in PR #9593: URL: https://github.com/apache/hudi/pull/9593#discussion_r1334697266 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieMergeHandle.java: ## @@ -270,14 +272,46 @@ protected boolean writeUpdateRecord(HoodieRecord newReco

[jira] [Created] (HUDI-6891) Read Optimized Queries should not use RLI

2023-09-22 Thread Amrish Lal (Jira)
Amrish Lal created HUDI-6891: Summary: Read Optimized Queries should not use RLI Key: HUDI-6891 URL: https://issues.apache.org/jira/browse/HUDI-6891 Project: Apache Hudi Issue Type: Bug

[GitHub] [hudi] yihua commented on pull request #9593: [HUDI-6784] Support deletion logic in merger

2023-09-22 Thread via GitHub
yihua commented on PR #9593: URL: https://github.com/apache/hudi/pull/9593#issuecomment-1731848381 @linliu-code there's conflict with master. Could you resolve it? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[GitHub] [hudi] yihua commented on pull request #9593: [HUDI-6784] Support deletion logic in merger

2023-09-22 Thread via GitHub
yihua commented on PR #9593: URL: https://github.com/apache/hudi/pull/9593#issuecomment-1731848089 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

[GitHub] [hudi] hudi-bot commented on pull request #9773: [MINOR][DNM] Validate 0.14.0 RC3 bundles

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9773: URL: https://github.com/apache/hudi/pull/9773#issuecomment-1731839669 ## CI report: * 4f30bb045f8068c2ac5173fa25f555fc7af62f6e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #9771: [MINOR] Mark a few new configs advanced

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9771: URL: https://github.com/apache/hudi/pull/9771#issuecomment-1731839584 ## CI report: * 79952023deac529add671ea09f5a28d1281cf600 UNKNOWN * 7d5b6a8797daa876efbfca0e63f05eba336d7e48 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #9771: [MINOR] Mark a few new configs advanced

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9771: URL: https://github.com/apache/hudi/pull/9771#issuecomment-1731825568 ## CI report: * 79952023deac529add671ea09f5a28d1281cf600 UNKNOWN * 7d5b6a8797daa876efbfca0e63f05eba336d7e48 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #9768: Medatawriter closing in tests, update log level in integration tests

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9768: URL: https://github.com/apache/hudi/pull/9768#issuecomment-1731825386 ## CI report: * 0149a66ddfea34f043e0bff5c20fe38e626903d9 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2009

[GitHub] [hudi] hudi-bot commented on pull request #9717: [HUDI-6806] Support Spark 3.5.0

2023-09-22 Thread via GitHub
hudi-bot commented on PR #9717: URL: https://github.com/apache/hudi/pull/9717#issuecomment-1731824910 ## CI report: * 9b8fdd2d1b69da528069e364790b53af1d6150af UNKNOWN * 8bb2b9fc024e9b08e8dcde9f2ac2c28fceddfaed Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

  1   2   >