[GitHub] [hudi] nsivabalan commented on a diff in pull request #9473: [HUDI-6724] - Defaulting previous Instant time to init time to enable full read of initial commit

2023-09-10 Thread via GitHub
nsivabalan commented on code in PR #9473: URL: https://github.com/apache/hudi/pull/9473#discussion_r1321070806 ## hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/IncrSourceHelper.java: ## @@ -130,7 +130,7 @@ public static QueryInfo generateQueryInfo(JavaSp

[GitHub] [hudi] hudi-bot commented on pull request #9671: [HUDI-6842] Fixing flaky tests for async clustering test

2023-09-10 Thread via GitHub
hudi-bot commented on PR #9671: URL: https://github.com/apache/hudi/pull/9671#issuecomment-1713260335 ## CI report: * 6f6c2e5864100bac6797c4645c8c0a35d98d31ef Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=197

[jira] [Assigned] (HUDI-6843) Fix flaky testUpsertsContinuousModeWithMultipleWritersForConflicts

2023-09-10 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-6843: - Assignee: Lokesh Jain > Fix flaky testUpsertsContinuousModeWithMultipleWritersFor

[GitHub] [hudi] danny0405 commented on pull request #9673: [DOCS] Fixed Spark guide typo

2023-09-10 Thread via GitHub
danny0405 commented on PR #9673: URL: https://github.com/apache/hudi/pull/9673#issuecomment-1713255722 No need to chagne the html related files, just the markdown files should be enough. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hudi] qidian99 opened a new pull request, #9673: [DOCS] Fixed Spark guide typo

2023-09-10 Thread via GitHub
qidian99 opened a new pull request, #9673: URL: https://github.com/apache/hudi/pull/9673 ### Change Logs Doc fixes: Spark guide typo ### Impact Doc change ### Risk level (write none, low medium or high below) Low ### Documentation Update quick-star

[GitHub] [hudi] hudi-bot commented on pull request #9651: [HUDI-6336] Support flink timeline-based ckp metadata

2023-09-10 Thread via GitHub
hudi-bot commented on PR #9651: URL: https://github.com/apache/hudi/pull/9651#issuecomment-1713249854 ## CI report: * 7d5ae2f19b99845990588ccfd74bba3b63bb75c0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1978

[GitHub] [hudi] nsivabalan commented on a diff in pull request #9671: [HUDI-6842] Fixing flaky tests for async clustering test

2023-09-10 Thread via GitHub
nsivabalan commented on code in PR #9671: URL: https://github.com/apache/hudi/pull/9671#discussion_r1321044635 ## hudi-utilities/src/test/java/org/apache/hudi/utilities/deltastreamer/TestHoodieDeltaStreamer.java: ## @@ -1377,34 +1399,39 @@ private void testAsyncClusteringServic

[GitHub] [hudi] danny0405 commented on a diff in pull request #9617: [HUDI-1623] Solid completion time on timeline

2023-09-10 Thread via GitHub
danny0405 commented on code in PR #9617: URL: https://github.com/apache/hudi/pull/9617#discussion_r1321005566 ## hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieInstantFormat.java: ## @@ -0,0 +1,240 @@ + +/* + * Licensed to the Apache Software Foundation (A

[GitHub] [hudi] lokeshj1703 commented on a diff in pull request #9538: [HUDI-6738] - Apply object filter before checkpoint batching in GcsEventsHoodieIncrSource

2023-09-10 Thread via GitHub
lokeshj1703 commented on code in PR #9538: URL: https://github.com/apache/hudi/pull/9538#discussion_r1321031155 ## hudi-utilities/src/test/java/org/apache/hudi/utilities/sources/TestGcsEventsHoodieIncrSource.java: ## @@ -135,10 +128,10 @@ public void shouldNotFindNewDataIfCommi

[GitHub] [hudi] codope commented on a diff in pull request #9671: [HUDI-6842] Fixing flaky tests for async clustering test

2023-09-10 Thread via GitHub
codope commented on code in PR #9671: URL: https://github.com/apache/hudi/pull/9671#discussion_r1321024336 ## hudi-utilities/src/test/java/org/apache/hudi/utilities/deltastreamer/TestHoodieDeltaStreamer.java: ## @@ -1377,34 +1399,39 @@ private void testAsyncClusteringService(Ho

[jira] [Closed] (HUDI-6833) Add field for tracking log files from failed commit in rollback metadata

2023-09-10 Thread Lokesh Jain (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain closed HUDI-6833. - Fix Version/s: 0.14.0 Resolution: Fixed > Add field for tracking log files from failed commit in ro

[GitHub] [hudi] lokeshj1703 commented on pull request #9618: [HUDI-6753] Fix parquet inline reading flaky test

2023-09-10 Thread via GitHub
lokeshj1703 commented on PR #9618: URL: https://github.com/apache/hudi/pull/9618#issuecomment-1713196338 @yihua No, this is a bug around configurations set in the test. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

[GitHub] [hudi] hudi-bot commented on pull request #9618: [HUDI-6753] Fix parquet inline reading flaky test

2023-09-10 Thread via GitHub
hudi-bot commented on PR #9618: URL: https://github.com/apache/hudi/pull/9618#issuecomment-1713192081 ## CI report: * 791754eabd61314e943668a34c88fadf3bf2d641 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1978

[GitHub] [hudi] hudi-bot commented on pull request #9671: [HUDI-6842] Fixing flaky tests for async clustering test

2023-09-10 Thread via GitHub
hudi-bot commented on PR #9671: URL: https://github.com/apache/hudi/pull/9671#issuecomment-1713154237 ## CI report: * 6f6c2e5864100bac6797c4645c8c0a35d98d31ef Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=197

[GitHub] [hudi] hudi-bot commented on pull request #9617: [HUDI-1623] Solid completion time on timeline

2023-09-10 Thread via GitHub
hudi-bot commented on PR #9617: URL: https://github.com/apache/hudi/pull/9617#issuecomment-1713153899 ## CI report: * 188bb6b68ea966e35a84a8a4162cb66d180069c5 UNKNOWN * 37a11b656ac4ff3df3134ae0e8df4cfc1afd03cc Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[jira] [Updated] (HUDI-1623) Solid completion time on timeline

2023-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-1623: - Labels: pull-request-available (was: ) > Solid completion time on timeline >

[GitHub] [hudi] hudi-bot commented on pull request #9671: [HUDI-6842] Fixing flaky tests for async clustering test

2023-09-10 Thread via GitHub
hudi-bot commented on PR #9671: URL: https://github.com/apache/hudi/pull/9671#issuecomment-1713147655 ## CI report: * 6f6c2e5864100bac6797c4645c8c0a35d98d31ef Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1978

[GitHub] [hudi] hudi-bot commented on pull request #9617: [HUDI-1623] Solid completion time on timeline

2023-09-10 Thread via GitHub
hudi-bot commented on PR #9617: URL: https://github.com/apache/hudi/pull/9617#issuecomment-1713147335 ## CI report: * 188bb6b68ea966e35a84a8a4162cb66d180069c5 UNKNOWN * fcb7c3c4aad6bd04e206d7d3f2d6be3ad949044f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #9671: [HUDI-6842] Fixing flaky tests for async clustering test

2023-09-10 Thread via GitHub
hudi-bot commented on PR #9671: URL: https://github.com/apache/hudi/pull/9671#issuecomment-1713141180 ## CI report: * 6f6c2e5864100bac6797c4645c8c0a35d98d31ef Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1978

[GitHub] [hudi] MorningGlow opened a new issue, #9672: Enable Hudi Metadata Table and Multi-Modal Index bug

2023-09-10 Thread via GitHub
MorningGlow opened a new issue, #9672: URL: https://github.com/apache/hudi/issues/9672 **use version:** flink 1.15.2 hudi 0.12.3 hive 3.1.2 hadoop 3.2.4 CREATE TABLE WF_UNITINFOTRAVEL_HUDI ( `ID` STRING ,`WORKORDER` STRING COMMENT '工单' ,`UNITID` STRING COMMENT '序号'

[GitHub] [hudi] hudi-bot commented on pull request #9671: [HUDI-6842] Fixing flaky tests for async clustering test

2023-09-10 Thread via GitHub
hudi-bot commented on PR #9671: URL: https://github.com/apache/hudi/pull/9671#issuecomment-1713109214 ## CI report: * 6f6c2e5864100bac6797c4645c8c0a35d98d31ef UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] nsivabalan closed pull request #9662: [HUDI-6820] Set timeout for TestHoodieDeltaStreamer continuous mode tests

2023-09-10 Thread via GitHub
nsivabalan closed pull request #9662: [HUDI-6820] Set timeout for TestHoodieDeltaStreamer continuous mode tests URL: https://github.com/apache/hudi/pull/9662 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [hudi] hudi-bot commented on pull request #9651: [HUDI-6336] Support flink timeline-based ckp metadata

2023-09-10 Thread via GitHub
hudi-bot commented on PR #9651: URL: https://github.com/apache/hudi/pull/9651#issuecomment-1713109095 ## CI report: * 2acae42a85a382a3c1b30d4aee7f2f70f35d7b10 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1972

[GitHub] [hudi] hudi-bot commented on pull request #9651: [HUDI-6336] Support flink timeline-based ckp metadata

2023-09-10 Thread via GitHub
hudi-bot commented on PR #9651: URL: https://github.com/apache/hudi/pull/9651#issuecomment-1713103723 ## CI report: * 2acae42a85a382a3c1b30d4aee7f2f70f35d7b10 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1972

[GitHub] [hudi] beyond1920 commented on a diff in pull request #9485: [HUDI-6730] Enable hoodie configuration using the --conf option with the "spark." prefix

2023-09-10 Thread via GitHub
beyond1920 commented on code in PR #9485: URL: https://github.com/apache/hudi/pull/9485#discussion_r1320954076 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/spark/sql/hudi/HoodieSqlCommonUtils.scala: ## @@ -223,6 +223,18 @@ object HoodieSqlCommonUtils exte

[jira] [Updated] (HUDI-6842) Fix flaky testHoodieAsyncClusteringJobWithScheduleAndExecute

2023-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-6842: - Labels: pull-request-available (was: ) > Fix flaky testHoodieAsyncClusteringJobWithScheduleAndExe

[GitHub] [hudi] nsivabalan opened a new pull request, #9671: [HUDI-6842] Fixing flaky tests for async clustering test

2023-09-10 Thread via GitHub
nsivabalan opened a new pull request, #9671: URL: https://github.com/apache/hudi/pull/9671 ### Change Logs Fixing flaky tests for async clustering test ### Impact Fixing flaky tests for async clustering test ### Risk level (write none, low medium or high below)

[GitHub] [hudi] danny0405 commented on a diff in pull request #9651: [HUDI-6336] Support flink timeline-based ckp metadata

2023-09-10 Thread via GitHub
danny0405 commented on code in PR #9651: URL: https://github.com/apache/hudi/pull/9651#discussion_r1320946482 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java: ## @@ -418,6 +418,12 @@ public class HoodieWriteConfig extends HoodieConfi

[GitHub] [hudi] danny0405 commented on a diff in pull request #9651: [HUDI-6336] Support flink timeline-based ckp metadata

2023-09-10 Thread via GitHub
danny0405 commented on code in PR #9651: URL: https://github.com/apache/hudi/pull/9651#discussion_r1320946482 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java: ## @@ -418,6 +418,12 @@ public class HoodieWriteConfig extends HoodieConfi

[GitHub] [hudi] danny0405 commented on a diff in pull request #9579: [HUDI-6776] Replace JSON with Avro bytes for commit metadata

2023-09-10 Thread via GitHub
danny0405 commented on code in PR #9579: URL: https://github.com/apache/hudi/pull/9579#discussion_r1320942427 ## hudi-cli/src/test/java/org/apache/hudi/cli/testutils/HoodieTestCommitMetadataGenerator.java: ## @@ -90,8 +91,7 @@ public static void createCommitFileWithMetadata(Stri

[GitHub] [hudi] hudi-bot commented on pull request #9618: [HUDI-6753] Fix parquet inline reading flaky test

2023-09-10 Thread via GitHub
hudi-bot commented on PR #9618: URL: https://github.com/apache/hudi/pull/9618#issuecomment-1713068950 ## CI report: * Unknown: [CANCELED](TBD) * 791754eabd61314e943668a34c88fadf3bf2d641 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039

[GitHub] [hudi] danny0405 commented on a diff in pull request #9590: [HUDI-6780] Introduce enums instead of classnames in table properties

2023-09-10 Thread via GitHub
danny0405 commented on code in PR #9590: URL: https://github.com/apache/hudi/pull/9590#discussion_r1320932463 ## hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableConfig.java: ## @@ -602,18 +635,26 @@ public String getPartitionFieldProp() { * Read the payload

[GitHub] [hudi] hudi-bot commented on pull request #9618: [HUDI-6753] Fix parquet inline reading flaky test

2023-09-10 Thread via GitHub
hudi-bot commented on PR #9618: URL: https://github.com/apache/hudi/pull/9618#issuecomment-1713063006 ## CI report: * Unknown: [CANCELED](TBD) * 791754eabd61314e943668a34c88fadf3bf2d641 UNKNOWN Bot commands @hudi-bot supports the following commands: - `

[GitHub] [hudi] danny0405 commented on a diff in pull request #9590: [HUDI-6780] Introduce enums instead of classnames in table properties

2023-09-10 Thread via GitHub
danny0405 commented on code in PR #9590: URL: https://github.com/apache/hudi/pull/9590#discussion_r1320930702 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java: ## @@ -151,6 +152,12 @@ public class HoodieWriteConfig extends HoodieConfi

[GitHub] [hudi] nsivabalan commented on pull request #9618: [HUDI-6753] Fix parquet inline reading flaky test

2023-09-10 Thread via GitHub
nsivabalan commented on PR #9618: URL: https://github.com/apache/hudi/pull/9618#issuecomment-1713060153 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hudi] danny0405 commented on a diff in pull request #9665: [HUDI-6478] Deduce op as upsert for INSERT INTO

2023-09-10 Thread via GitHub
danny0405 commented on code in PR #9665: URL: https://github.com/apache/hudi/pull/9665#discussion_r1320910435 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/AutoRecordKeyGenerationUtils.scala: ## @@ -54,7 +51,9 @@ object AutoRecordKeyGenerationUtils {

[GitHub] [hudi] danny0405 commented on pull request #9637: [HUDI-6823] initial writeTimer in StreamWriteOperatorCoordinator

2023-09-10 Thread via GitHub
danny0405 commented on PR #9637: URL: https://github.com/apache/hudi/pull/9637#issuecomment-1713014906 > OK,I'll try to do that. M Flink has its own metrics system, take a reference from `HoodieFlinkMetrics` and its sub-classes. -- This is an automated message from the Apache Git S

[jira] [Closed] (HUDI-6835) Adjust spark sql core flow test scenarios

2023-09-10 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-6835. Resolution: Fixed Fixed via master branch: 73c2167566730a76a0650d488511253ebc66156f > Adjust spark sql core

[hudi] branch master updated (e265105799e -> 73c21675667)

2023-09-10 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from e265105799e [HUDI-6831] Add back missing project_id to query statement in BigQuerySyncTool (#9650) add 73c21675

[GitHub] [hudi] danny0405 merged pull request #9664: [HUDI-6835] Adjust spark sql core flow test scenarios

2023-09-10 Thread via GitHub
danny0405 merged PR #9664: URL: https://github.com/apache/hudi/pull/9664 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache

[jira] [Closed] (HUDI-6831) Add back missing project_id to query statement in BigQuerySyncTool

2023-09-10 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-6831. Resolution: Fixed Fixed via master branch: e2651057990cd871e88e9e7d52eb1cfb90f2 > Add back missing proj

[hudi] branch master updated: [HUDI-6831] Add back missing project_id to query statement in BigQuerySyncTool (#9650)

2023-09-10 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new e265105799e [HUDI-6831] Add back missing projec

[GitHub] [hudi] danny0405 merged pull request #9650: [HUDI-6831] Add back missing project_id to query statement in BigQuerySyncTool

2023-09-10 Thread via GitHub
danny0405 merged PR #9650: URL: https://github.com/apache/hudi/pull/9650 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache

[jira] [Closed] (HUDI-6845) Upgrade org.apache.pulsar:pulsar-client to 2.10.2

2023-09-10 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-6845. Fix Version/s: 1.0.0 Resolution: Fixed Fixed via master branch: ce96d5da3e3e19429ee38f0c406bf05a8060d

[jira] [Updated] (HUDI-6845) Upgrade org.apache.pulsar:pulsar-client to 2.10.2

2023-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-6845: - Labels: pull-request-available (was: ) > Upgrade org.apache.pulsar:pulsar-client to 2.10.2 >

[hudi] branch master updated (dd4c404510b -> ce96d5da3e3)

2023-09-10 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from dd4c404510b [HUDI-6758] Fixing deducing spurious log blocks due to spark retries (#9611) add ce96d5da3e3 [HUDI-

[jira] [Created] (HUDI-6845) Upgrade org.apache.pulsar:pulsar-client to 2.10.2

2023-09-10 Thread Danny Chen (Jira)
Danny Chen created HUDI-6845: Summary: Upgrade org.apache.pulsar:pulsar-client to 2.10.2 Key: HUDI-6845 URL: https://issues.apache.org/jira/browse/HUDI-6845 Project: Apache Hudi Issue Type: Task

[GitHub] [hudi] danny0405 merged pull request #9670: [HUDI-6845] Upgrade org.apache.pulsar:pulsar-client to 2.10.2

2023-09-10 Thread via GitHub
danny0405 merged PR #9670: URL: https://github.com/apache/hudi/pull/9670 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache

[GitHub] [hudi] hudi-bot commented on pull request #9668: [HUDI-6839] Github actions improvements

2023-09-10 Thread via GitHub
hudi-bot commented on PR #9668: URL: https://github.com/apache/hudi/pull/9668#issuecomment-1712929278 ## CI report: * 5f609ebf9f541c0ab2d4b35468c6e6ac6018a11a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1978

[jira] [Created] (HUDI-6844) Fixing spurious log blocks in flink

2023-09-10 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-6844: - Summary: Fixing spurious log blocks in flink Key: HUDI-6844 URL: https://issues.apache.org/jira/browse/HUDI-6844 Project: Apache Hudi Issue Type: I

[hudi] branch master updated: [HUDI-6758] Fixing deducing spurious log blocks due to spark retries (#9611)

2023-09-10 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new dd4c404510b [HUDI-6758] Fixing deducing spuriou

[GitHub] [hudi] nsivabalan merged pull request #9611: [HUDI-6758] Fixing deducing spurious log blocks due to spark retries

2023-09-10 Thread via GitHub
nsivabalan merged PR #9611: URL: https://github.com/apache/hudi/pull/9611 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apach

[jira] [Created] (HUDI-6843) Fix flaky testUpsertsContinuousModeWithMultipleWritersForConflicts

2023-09-10 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-6843: - Summary: Fix flaky testUpsertsContinuousModeWithMultipleWritersForConflicts Key: HUDI-6843 URL: https://issues.apache.org/jira/browse/HUDI-6843 Project: Apa

[jira] [Created] (HUDI-6842) Fix flaky testHoodieAsyncClusteringJobWithScheduleAndExecute

2023-09-10 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-6842: - Summary: Fix flaky testHoodieAsyncClusteringJobWithScheduleAndExecute Key: HUDI-6842 URL: https://issues.apache.org/jira/browse/HUDI-6842 Project: Apache Hu

[jira] [Created] (HUDI-6841) Fix Flaky TestHoodieTimelineArchiver

2023-09-10 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-6841: - Summary: Fix Flaky TestHoodieTimelineArchiver Key: HUDI-6841 URL: https://issues.apache.org/jira/browse/HUDI-6841 Project: Apache Hudi Issue Type:

[jira] [Commented] (HUDI-6840) Fix Flaky testAsyncClusteringServiceWithConflicts

2023-09-10 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17763458#comment-17763458 ] sivabalan narayanan commented on HUDI-6840: --- {code:java} 2023-09-09T09:20:36.779

[jira] [Created] (HUDI-6840) Fix Flaky testAsyncClusteringServiceWithConflicts

2023-09-10 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-6840: - Summary: Fix Flaky testAsyncClusteringServiceWithConflicts Key: HUDI-6840 URL: https://issues.apache.org/jira/browse/HUDI-6840 Project: Apache Hudi

[jira] [Updated] (HUDI-6820) Fix Azure CI timeout for UT FT other modules

2023-09-10 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-6820: -- Epic Link: HUDI-4302 > Fix Azure CI timeout for UT FT other modules > --

[GitHub] [hudi] hudi-bot commented on pull request #9668: [HUDI-6839] Github actions improvements

2023-09-10 Thread via GitHub
hudi-bot commented on PR #9668: URL: https://github.com/apache/hudi/pull/9668#issuecomment-1712891988 ## CI report: * 165d95faa7c441443fd62adb4e57ae2b8a20fe80 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1977

[GitHub] [hudi] hudi-bot commented on pull request #9668: [HUDI-6839] Github actions improvements

2023-09-10 Thread via GitHub
hudi-bot commented on PR #9668: URL: https://github.com/apache/hudi/pull/9668#issuecomment-1712887139 ## CI report: * 165d95faa7c441443fd62adb4e57ae2b8a20fe80 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1977

[GitHub] [hudi] hudi-bot commented on pull request #9670: fix(sec): upgrade org.apache.pulsar:pulsar-client to 2.10.2

2023-09-10 Thread via GitHub
hudi-bot commented on PR #9670: URL: https://github.com/apache/hudi/pull/9670#issuecomment-1712842166 ## CI report: * 85898cad8b6a86a9145c0d1d969dca134809df5a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1978

[GitHub] [hudi] hudi-bot commented on pull request #9665: [HUDI-6478] Deduce op as upsert for INSERT INTO

2023-09-10 Thread via GitHub
hudi-bot commented on PR #9665: URL: https://github.com/apache/hudi/pull/9665#issuecomment-1712813576 ## CI report: * 867f25a6378b6e522a35e11f7e4e622efc6e360a UNKNOWN * b41052b9733e2f24aa17f743a5ddf98cc1b5e81c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #9670: fix(sec): upgrade org.apache.pulsar:pulsar-client to 2.10.2

2023-09-10 Thread via GitHub
hudi-bot commented on PR #9670: URL: https://github.com/apache/hudi/pull/9670#issuecomment-1712787921 ## CI report: * 85898cad8b6a86a9145c0d1d969dca134809df5a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1978

[GitHub] [hudi] hudi-bot commented on pull request #9670: fix(sec): upgrade org.apache.pulsar:pulsar-client to 2.10.2

2023-09-10 Thread via GitHub
hudi-bot commented on PR #9670: URL: https://github.com/apache/hudi/pull/9670#issuecomment-1712778257 ## CI report: * 85898cad8b6a86a9145c0d1d969dca134809df5a UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #9665: [HUDI-6478] Deduce op as upsert for INSERT INTO

2023-09-10 Thread via GitHub
hudi-bot commented on PR #9665: URL: https://github.com/apache/hudi/pull/9665#issuecomment-1712776443 ## CI report: * 867f25a6378b6e522a35e11f7e4e622efc6e360a UNKNOWN * 18d03141e69fc59e700e9abf9b14ba4028ce307d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #9665: [HUDI-6478] Deduce op as upsert for INSERT INTO

2023-09-10 Thread via GitHub
hudi-bot commented on PR #9665: URL: https://github.com/apache/hudi/pull/9665#issuecomment-1712767783 ## CI report: * 867f25a6378b6e522a35e11f7e4e622efc6e360a UNKNOWN * 18d03141e69fc59e700e9abf9b14ba4028ce307d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] xushiyan commented on a diff in pull request #9665: [HUDI-6478] Deduce op as upsert for INSERT INTO

2023-09-10 Thread via GitHub
xushiyan commented on code in PR #9665: URL: https://github.com/apache/hudi/pull/9665#discussion_r1320425108 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/AutoRecordKeyGenerationUtils.scala: ## @@ -32,29 +31,29 @@ object AutoRecordKeyGenerationUtils {

[GitHub] [hudi] hudi-bot commented on pull request #9538: [HUDI-6738] - Apply object filter before checkpoint batching in GcsEventsHoodieIncrSource

2023-09-10 Thread via GitHub
hudi-bot commented on PR #9538: URL: https://github.com/apache/hudi/pull/9538#issuecomment-1712751029 ## CI report: * fa560c36bc8fceadffe3a0eaa70b66eac090fc26 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1977

[GitHub] [hudi] LXin96 commented on pull request #9637: [HUDI-6823] initial writeTimer in StreamWriteOperatorCoordinator

2023-09-10 Thread via GitHub
LXin96 commented on PR #9637: URL: https://github.com/apache/hudi/pull/9637#issuecomment-1712744321 @danny0405 hello, finally I have passed the tests, could you please merge it -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

[GitHub] [hudi] hudi-bot commented on pull request #9668: [HUDI-6839] Github actions improvements

2023-09-10 Thread via GitHub
hudi-bot commented on PR #9668: URL: https://github.com/apache/hudi/pull/9668#issuecomment-1712738309 ## CI report: * 165d95faa7c441443fd62adb4e57ae2b8a20fe80 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1977