[jira] [Comment Edited] (HUDI-4057) Supports running command of show-partitions on non-hive-partitioning table

[ https://issues.apache.org/jira/browse/HUDI-4057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17533643#comment-17533643 ] Jin Xing edited comment on HUDI-4057 at 5/9/22 6:58 AM: Pending on

[GitHub] [hudi] jinxing64 commented on a diff in pull request #5534: [HUDI-4056] Refine partition matching in when drop / truncate partition.

jinxing64 commented on code in PR #5534: URL: https://github.com/apache/hudi/pull/5534#discussion_r867670047 ## hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/TestAlterTableDropPartition.scala: ## @@ -81,13 +81,13 @@ class TestAlterTableDropPartition e

[jira] [Updated] (HUDI-3952) Presto HadoopExtendedFileSystem now supports getScheme. Update presto version to 0.273 is docker setup and IT test

[ https://issues.apache.org/jira/browse/HUDI-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3952: -- Epic Link: HUDI-4015 (was: HUDI-2574) > Presto HadoopExtendedFileSystem now supports getScheme. Update

[jira] [Updated] (HUDI-3952) Presto HadoopExtendedFileSystem now supports getScheme. Update presto version to 0.273 is docker setup and IT test

[ https://issues.apache.org/jira/browse/HUDI-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3952: -- Summary: Presto HadoopExtendedFileSystem now supports getScheme. Update presto version to 0.273 is docke

[jira] [Assigned] (HUDI-4057) Supports running command of show-partitions on non-hive-partitioning table

[ https://issues.apache.org/jira/browse/HUDI-4057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jin Xing reassigned HUDI-4057: -- Assignee: Jin Xing > Supports running command of show-partitions on non-hive-partitioning table > -

[jira] [Commented] (HUDI-4057) Supports running command of show-partitions on non-hive-partitioning table

[ https://issues.apache.org/jira/browse/HUDI-4057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17533643#comment-17533643 ] Jin Xing commented on HUDI-4057: Pending on some utility functions from HUDI-4056 > Suppo

[jira] [Assigned] (HUDI-4056) Refine partition matching in when drop / truncate partition.

[ https://issues.apache.org/jira/browse/HUDI-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jin Xing reassigned HUDI-4056: -- Assignee: Jin Xing > Refine partition matching in when drop / truncate partition. > ---

[jira] [Created] (HUDI-4057) Supports running command of show-partitions on non-hive-partitioning table

Jin Xing created HUDI-4057: -- Summary: Supports running command of show-partitions on non-hive-partitioning table Key: HUDI-4057 URL: https://issues.apache.org/jira/browse/HUDI-4057 Project: Apache Hudi

[jira] [Closed] (HUDI-4050) Upgrade Hudi version to 0.11.0 in the connector

[ https://issues.apache.org/jira/browse/HUDI-4050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit closed HUDI-4050. - Resolution: Fixed Done as part of https://github.com/trinodb/trino/pull/10228 > Upgrade Hudi version to 0

[GitHub] [hudi] hudi-bot commented on pull request #5534: [HUDI-4056] Refine partition matching in when drop / truncate partition.

hudi-bot commented on PR #5534: URL: https://github.com/apache/hudi/pull/5534#issuecomment-1120707522 ## CI report: * 5deab6cb23cab172ce1e1940255e61ba3ab62e75 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8512

[GitHub] [hudi] hudi-bot commented on pull request #5516: HUDI-4044 When reading data from flink-hudi to external storage, the …

hudi-bot commented on PR #5516: URL: https://github.com/apache/hudi/pull/5516#issuecomment-1120707441 ## CI report: * 75ef37eb146b3be501729fa952777cf8439acdd0 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8465

[GitHub] [hudi] hudi-bot commented on pull request #5286: HUDI-3836 Improve the way of fetching metadata partitions from table

hudi-bot commented on PR #5286: URL: https://github.com/apache/hudi/pull/5286#issuecomment-1120707188 ## CI report: * bbb9a7fa35d006e310eb57f00b1d126ad39de384 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8505

[jira] [Closed] (HUDI-3960) Update HudiRealtimeSplitConverter to correctly instantiate HoodieRealtimeFileSplit

[ https://issues.apache.org/jira/browse/HUDI-3960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit closed HUDI-3960. - Resolution: Fixed > Update HudiRealtimeSplitConverter to correctly instantiate > HoodieRealtimeFileSplit

[GitHub] [hudi] hudi-bot commented on pull request #5534: [HUDI-4056] Refine partition matching in when drop / truncate partition.

hudi-bot commented on PR #5534: URL: https://github.com/apache/hudi/pull/5534#issuecomment-1120705233 ## CI report: * 5deab6cb23cab172ce1e1940255e61ba3ab62e75 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #5516: HUDI-4044 When reading data from flink-hudi to external storage, the …

hudi-bot commented on PR #5516: URL: https://github.com/apache/hudi/pull/5516#issuecomment-1120705156 ## CI report: * 75ef37eb146b3be501729fa952777cf8439acdd0 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8465

[GitHub] [hudi] hudi-bot commented on pull request #4480: [HUDI-3123] consistent hashing index: basic write path (upsert/insert)

hudi-bot commented on PR #4480: URL: https://github.com/apache/hudi/pull/4480#issuecomment-1120704403 ## CI report: * c4a2ace5e28fafb29394a1448e1a6c2a0645dda9 UNKNOWN * 9e11c164c758d0da2e0c08c0ef849be5030f5753 UNKNOWN * ef9932fc77f13db4b235a1c18c24c0f6b1539331 Azure: [SUCCES

[GitHub] [hudi] hudi-bot commented on pull request #5286: HUDI-3836 Improve the way of fetching metadata partitions from table

hudi-bot commented on PR #5286: URL: https://github.com/apache/hudi/pull/5286#issuecomment-1120704841 ## CI report: * bbb9a7fa35d006e310eb57f00b1d126ad39de384 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8505

[GitHub] [hudi] hudi-bot commented on pull request #5531: [MINOR] Fixing close for HoodieCatalog's test

hudi-bot commented on PR #5531: URL: https://github.com/apache/hudi/pull/5531#issuecomment-1120702937 ## CI report: * be1dec9a73d68ae8d2cc895ec57678257f44c653 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8506

[GitHub] [hudi] hudi-bot commented on pull request #5522: [WIP][HUDI-3378][HUDI-3379][HUDI-3381] Rebasing usages of HoodieRecordPayload and raw Avro payload to rely on HoodieRecord instead

hudi-bot commented on PR #5522: URL: https://github.com/apache/hudi/pull/5522#issuecomment-1120702885 ## CI report: * 986960516f86a1426725141cd7cb25e84d260020 UNKNOWN * 295d2cafe2b6ff72181c454f400a2ec3c6481a2f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] aliceyyan commented on pull request #5516: HUDI-4044 When reading data from flink-hudi to external storage, the …

aliceyyan commented on PR #5516: URL: https://github.com/apache/hudi/pull/5516#issuecomment-1120698051 @danny0405 hi danny,I updated the program，can you help me with the code review again? thank you very much ☺ -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [hudi] jinxing64 commented on pull request #5534: [HUDI-4056] Refine partition matching in when drop / truncate partition.

jinxing64 commented on PR #5534: URL: https://github.com/apache/hudi/pull/5534#issuecomment-1120697816 wip -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e

[GitHub] [hudi] jinxing64 closed pull request #5533: [HUDI-4056] Refine partition matching in when drop / truncate partition.

jinxing64 closed pull request #5533: [HUDI-4056] Refine partition matching in when drop / truncate partition. URL: https://github.com/apache/hudi/pull/5533 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hudi] jinxing64 commented on a diff in pull request #5534: [HUDI-4056] Refine partition matching in when drop / truncate partition.

jinxing64 commented on code in PR #5534: URL: https://github.com/apache/hudi/pull/5534#discussion_r867670047 ## hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/TestAlterTableDropPartition.scala: ## @@ -81,13 +81,13 @@ class TestAlterTableDropPartition e

[jira] [Resolved] (HUDI-3675) Add support to shutdown Deltastreamer gracefully on certain conditions w/ continuous mode

[ https://issues.apache.org/jira/browse/HUDI-3675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit resolved HUDI-3675. --- > Add support to shutdown Deltastreamer gracefully on certain conditions w/ > continuous mode > -

[jira] [Updated] (HUDI-1602) Corrupted Avro schema extracted from parquet file

[ https://issues.apache.org/jira/browse/HUDI-1602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-1602: -- Story Points: 1 (was: 0.5) > Corrupted Avro schema extracted from parquet file > --

[jira] [Updated] (HUDI-1602) Corrupted Avro schema extracted from parquet file

[ https://issues.apache.org/jira/browse/HUDI-1602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-1602: -- Status: In Progress (was: Open) > Corrupted Avro schema extracted from parquet file > -

[jira] [Closed] (HUDI-1602) Corrupted Avro schema extracted from parquet file

[ https://issues.apache.org/jira/browse/HUDI-1602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit closed HUDI-1602. - Resolution: Won't Fix > Corrupted Avro schema extracted from parquet file > --

[GitHub] [hudi] jinxing64 opened a new pull request, #5534: [HUDI-4056] Refine partition matching in when drop / truncate partition.

jinxing64 opened a new pull request, #5534: URL: https://github.com/apache/hudi/pull/5534 ## What is the purpose of the pull request In current code, AlterHoodieTableDropPartitionCommand and TruncateHoodieTableCommand require all partition fields should be specified when droping / tr

[jira] [Commented] (HUDI-1602) Corrupted Avro schema extracted from parquet file

[ https://issues.apache.org/jira/browse/HUDI-1602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17533636#comment-17533636 ] Sagar Sumit commented on HUDI-1602: --- Could reproduce with hudi-spark2 but not with hudi-

[GitHub] [hudi] YuweiXiao commented on a diff in pull request #4480: [HUDI-3123] consistent hashing index: basic write path (upsert/insert)

YuweiXiao commented on code in PR #4480: URL: https://github.com/apache/hudi/pull/4480#discussion_r867662419 ## hudi-common/src/main/java/org/apache/hudi/common/model/HoodieConsistentHashingMetadata.java: ## @@ -0,0 +1,164 @@ +/* + * Licensed to the Apache Software Foundation (A

[GitHub] [hudi] hudi-bot commented on pull request #5533: [HUDI-4056] Refine partition matching in when drop / truncate partition.

hudi-bot commented on PR #5533: URL: https://github.com/apache/hudi/pull/5533#issuecomment-1120679468 ## CI report: * 84db3307ea4641e12614ef9a00ee8998e5e63773 UNKNOWN * 551c71b61bbc29c2f22dc894ad4a97d82245099a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #4958: [HUDI-3558] [Stacked 3123] Consistent bucket index: bucket resizing (split&merge) & concurrent write during resizing

hudi-bot commented on PR #4958: URL: https://github.com/apache/hudi/pull/4958#issuecomment-1120676465 ## CI report: * 942be62d495e508a52b67d091c67a9b5fc9f7b29 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8503

[GitHub] [hudi] jinxing64 commented on a diff in pull request #5533: [HUDI-4056] Refine partition matching in when drop / truncate partition.

jinxing64 commented on code in PR #5533: URL: https://github.com/apache/hudi/pull/5533#discussion_r867653782 ## hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/TestAlterTableDropPartition.scala: ## @@ -81,13 +81,13 @@ class TestAlterTableDropPartition e

[GitHub] [hudi] hudi-bot commented on pull request #4958: [HUDI-3558] [Stacked 3123] Consistent bucket index: bucket resizing (split&merge) & concurrent write during resizing

hudi-bot commented on PR #4958: URL: https://github.com/apache/hudi/pull/4958#issuecomment-1120674399 ## CI report: * 942be62d495e508a52b67d091c67a9b5fc9f7b29 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8503

[GitHub] [hudi] YuweiXiao commented on pull request #4958: [HUDI-3558] [Stacked 3123] Consistent bucket index: bucket resizing (split&merge) & concurrent write during resizing

YuweiXiao commented on PR #4958: URL: https://github.com/apache/hudi/pull/4958#issuecomment-1120674301 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

[GitHub] [hudi] hudi-bot commented on pull request #5533: [HUDI-4056] Refine partition matching in when drop / truncate partition.

hudi-bot commented on PR #5533: URL: https://github.com/apache/hudi/pull/5533#issuecomment-1120670183 ## CI report: * 84db3307ea4641e12614ef9a00ee8998e5e63773 UNKNOWN * 551c71b61bbc29c2f22dc894ad4a97d82245099a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #5533: [HUDI-4056] Refine partition matching in when drop / truncate partition.

hudi-bot commented on PR #5533: URL: https://github.com/apache/hudi/pull/5533#issuecomment-1120668562 ## CI report: * 84db3307ea4641e12614ef9a00ee8998e5e63773 UNKNOWN * 551c71b61bbc29c2f22dc894ad4a97d82245099a UNKNOWN Bot commands @hudi-bot supports the following

[GitHub] [hudi] hudi-bot commented on pull request #5286: HUDI-3836 Improve the way of fetching metadata partitions from table

hudi-bot commented on PR #5286: URL: https://github.com/apache/hudi/pull/5286#issuecomment-1120668298 ## CI report: * bbb9a7fa35d006e310eb57f00b1d126ad39de384 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8505

[GitHub] [hudi] hudi-bot commented on pull request #4958: [HUDI-3558] [Stacked 3123] Consistent bucket index: bucket resizing (split&merge) & concurrent write during resizing

hudi-bot commented on PR #4958: URL: https://github.com/apache/hudi/pull/4958#issuecomment-1120668138 ## CI report: * 942be62d495e508a52b67d091c67a9b5fc9f7b29 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8503

[GitHub] [hudi] hudi-bot commented on pull request #5533: [HUDI-4056] Refine partition matching in when drop / truncate partition.

hudi-bot commented on PR #5533: URL: https://github.com/apache/hudi/pull/5533#issuecomment-1120666885 ## CI report: * 84db3307ea4641e12614ef9a00ee8998e5e63773 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #5532: [HUDI-3985] Refactor DLASyncTool to support read hoodie table as spark datasource table

hudi-bot commented on PR #5532: URL: https://github.com/apache/hudi/pull/5532#issuecomment-1120666864 ## CI report: * da3d55fd279e7b7f15385f84f59484869376eb7d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8507

[GitHub] [hudi] hudi-bot commented on pull request #4958: [HUDI-3558] [Stacked 3123] Consistent bucket index: bucket resizing (split&merge) & concurrent write during resizing

hudi-bot commented on PR #4958: URL: https://github.com/apache/hudi/pull/4958#issuecomment-1120645990 ## CI report: * 942be62d495e508a52b67d091c67a9b5fc9f7b29 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8503

[jira] (HUDI-4056) Refine partition matching in when drop / truncate partition.

[ https://issues.apache.org/jira/browse/HUDI-4056 ] Jin Xing deleted comment on HUDI-4056: was (Author: jinxing6...@126.com): https://github.com/apache/hudi/pull/5533 > Refine partition matching in when drop / truncate partition. >

[jira] [Updated] (HUDI-4056) Refine partition matching in when drop / truncate partition.

[ https://issues.apache.org/jira/browse/HUDI-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-4056: - Labels: pull-request-available (was: ) > Refine partition matching in when drop / truncate partit

[GitHub] [hudi] YuweiXiao commented on pull request #4958: [HUDI-3558] [Stacked 3123] Consistent bucket index: bucket resizing (split&merge) & concurrent write during resizing

YuweiXiao commented on PR #4958: URL: https://github.com/apache/hudi/pull/4958#issuecomment-1120645045 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

[GitHub] [hudi] jinxing64 commented on pull request #5533: [HUDI-4056] Refine partition matching in when drop / truncate partition.

jinxing64 commented on PR #5533: URL: https://github.com/apache/hudi/pull/5533#issuecomment-1120644720 wip -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e

[jira] [Commented] (HUDI-4056) Refine partition matching in when drop / truncate partition.

[ https://issues.apache.org/jira/browse/HUDI-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17533611#comment-17533611 ] Jin Xing commented on HUDI-4056: https://github.com/apache/hudi/pull/5533 > Refine partit

[jira] [Updated] (HUDI-4045) DynamoDB billing_mode property is incorrectly documented

[ https://issues.apache.org/jira/browse/HUDI-4045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-4045: - Labels: pull-request-available (was: ) > DynamoDB billing_mode property is incorrectly documented

[GitHub] [hudi] jinxing64 opened a new pull request, #5533: [HUDI-4045] Refine partition matching in when drop / truncate partition.

jinxing64 opened a new pull request, #5533: URL: https://github.com/apache/hudi/pull/5533 ## What is the purpose of the pull request In current code, AlterHoodieTableDropPartitionCommand and TruncateHoodieTableCommand require all partition fields should be specified when droping / tr

[jira] [Updated] (HUDI-4049) Upgrade Hudi version in the connector

[ https://issues.apache.org/jira/browse/HUDI-4049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-4049: -- Status: Patch Available (was: In Progress) > Upgrade Hudi version in the connector > --

[jira] [Updated] (HUDI-4050) Upgrade Hudi version to 0.11.0 in the connector

[ https://issues.apache.org/jira/browse/HUDI-4050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-4050: -- Status: In Progress (was: Open) > Upgrade Hudi version to 0.11.0 in the connector > ---

[jira] [Updated] (HUDI-4049) Upgrade Hudi version in the connector

[ https://issues.apache.org/jira/browse/HUDI-4049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-4049: -- Status: In Progress (was: Open) > Upgrade Hudi version in the connector > -

[jira] [Updated] (HUDI-4050) Upgrade Hudi version to 0.11.0 in the connector

[ https://issues.apache.org/jira/browse/HUDI-4050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-4050: -- Status: Patch Available (was: In Progress) > Upgrade Hudi version to 0.11.0 in the connector >

[GitHub] [hudi] hudi-bot commented on pull request #5531: [MINOR] Fixing close for HoodieCatalog's test

hudi-bot commented on PR #5531: URL: https://github.com/apache/hudi/pull/5531#issuecomment-1120635705 ## CI report: * 589619d27d1c23a66f3d5acb5605e13030496663 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8504

[jira] [Created] (HUDI-4056) Refine partition matching in when drop / truncate partition.

Jin Xing created HUDI-4056: -- Summary: Refine partition matching in when drop / truncate partition. Key: HUDI-4056 URL: https://issues.apache.org/jira/browse/HUDI-4056 Project: Apache Hudi Issue Typ

[GitHub] [hudi] aliceyyan commented on a diff in pull request #5516: HUDI-4044 When reading data from flink-hudi to external storage, the …

aliceyyan commented on code in PR #5516: URL: https://github.com/apache/hudi/pull/5516#discussion_r867615650 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/table/format/mor/MergeOnReadInputSplit.java: ## @@ -67,6 +67,34 @@ public MergeOnReadInputSplit( th

[GitHub] [hudi] hudi-bot commented on pull request #5522: [WIP][HUDI-3378][HUDI-3379][HUDI-3381] Rebasing usages of HoodieRecordPayload and raw Avro payload to rely on HoodieRecord instead

hudi-bot commented on PR #5522: URL: https://github.com/apache/hudi/pull/5522#issuecomment-1120614366 ## CI report: * 986960516f86a1426725141cd7cb25e84d260020 UNKNOWN * 42ffe967fe0c85dfc5ae78d33494f0adb223a95c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #5522: [WIP][HUDI-3378][HUDI-3379][HUDI-3381] Rebasing usages of HoodieRecordPayload and raw Avro payload to rely on HoodieRecord instead

hudi-bot commented on PR #5522: URL: https://github.com/apache/hudi/pull/5522#issuecomment-1120612959 ## CI report: * 986960516f86a1426725141cd7cb25e84d260020 UNKNOWN * 42ffe967fe0c85dfc5ae78d33494f0adb223a95c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] YannByron commented on pull request #5436: [RFC-51] [HUDI-3478] Change Data Capture RFC

YannByron commented on PR #5436: URL: https://github.com/apache/hudi/pull/5436#issuecomment-1120610841 @xushiyan I have one question about the design without CDF: If we don’t have CDF to record the changing, how can we get the changing info by joining of file slices after compaction or

[GitHub] [hudi] hudi-bot commented on pull request #5531: [MINOR] Fixing close for HoodieCatalog's test

hudi-bot commented on PR #5531: URL: https://github.com/apache/hudi/pull/5531#issuecomment-1120609391 ## CI report: * 589619d27d1c23a66f3d5acb5605e13030496663 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8504

[GitHub] [hudi] hudi-bot commented on pull request #5532: [HUDI-3985] Refactor DLASyncTool to support read hoodie table as spark datasource table

hudi-bot commented on PR #5532: URL: https://github.com/apache/hudi/pull/5532#issuecomment-1120609404 ## CI report: * da3d55fd279e7b7f15385f84f59484869376eb7d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8507

[GitHub] [hudi] hudi-bot commented on pull request #5286: HUDI-3836 Improve the way of fetching metadata partitions from table

hudi-bot commented on PR #5286: URL: https://github.com/apache/hudi/pull/5286#issuecomment-1120609199 ## CI report: * 806def99796cc09f4bd500fde2728f4493da8775 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8485

[GitHub] [hudi] hudi-bot commented on pull request #4958: [HUDI-3558] [Stacked 3123] Consistent bucket index: bucket resizing (split&merge) & concurrent write during resizing

hudi-bot commented on PR #4958: URL: https://github.com/apache/hudi/pull/4958#issuecomment-1120609045 ## CI report: * 942be62d495e508a52b67d091c67a9b5fc9f7b29 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8503

[GitHub] [hudi] danny0405 commented on a diff in pull request #5528: [HUDI-3336][HUDI-FLINK]Support custom hadoop config for flink

danny0405 commented on code in PR #5528: URL: https://github.com/apache/hudi/pull/5528#discussion_r867610262 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/configuration/FlinkOptions.java: ## @@ -746,16 +762,18 @@ public static Configuration flatOptions(Config

[GitHub] [hudi] hudi-bot commented on pull request #5532: [HUDI-3985] Refactor DLASyncTool to support read hoodie table as spark datasource table

hudi-bot commented on PR #5532: URL: https://github.com/apache/hudi/pull/5532#issuecomment-1120608020 ## CI report: * da3d55fd279e7b7f15385f84f59484869376eb7d UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #5286: HUDI-3836 Improve the way of fetching metadata partitions from table

hudi-bot commented on PR #5286: URL: https://github.com/apache/hudi/pull/5286#issuecomment-1120607803 ## CI report: * 806def99796cc09f4bd500fde2728f4493da8775 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8485

[GitHub] [hudi] hudi-bot commented on pull request #5531: [MINOR] Fixing close for HoodieCatalog's test

hudi-bot commented on PR #5531: URL: https://github.com/apache/hudi/pull/5531#issuecomment-1120606701 ## CI report: * 589619d27d1c23a66f3d5acb5605e13030496663 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8504

[GitHub] [hudi] xicm commented on a diff in pull request #5286: HUDI-3836 Improve the way of fetching metadata partitions from table

xicm commented on code in PR #5286: URL: https://github.com/apache/hudi/pull/5286#discussion_r867605721 ## hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableConfig.java: ## @@ -236,6 +237,8 @@ public class HoodieTableConfig extends HoodieConfig { private sta

[jira] [Updated] (HUDI-3985) Refactor DLASyncTool to support read hoodie table as datasource table

[ https://issues.apache.org/jira/browse/HUDI-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3985: - Labels: pull-request-available (was: ) > Refactor DLASyncTool to support read hoodie table as dat

[GitHub] [hudi] huberylee opened a new pull request, #5532: [HUDI-3985] Refactor DLASyncTool to support read hoodie table as spark datasource table

huberylee opened a new pull request, #5532: URL: https://github.com/apache/hudi/pull/5532 ## What is the purpose of the pull request Refactor DLASyncTool to support read hoodie table as spark datasource table, and rename related classes' name for product iteration. ## Brief cha

[GitHub] [hudi] danny0405 commented on a diff in pull request #5516: HUDI-4044 When reading data from flink-hudi to external storage, the …

danny0405 commented on code in PR #5516: URL: https://github.com/apache/hudi/pull/5516#discussion_r867601249 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/table/HoodieTableSource.java: ## @@ -181,7 +182,8 @@ public DataStream produceDataStream(StreamExecutio

[jira] [Updated] (HUDI-3985) Refactor DLASyncTool to support read hoodie table as datasource table

[ https://issues.apache.org/jira/browse/HUDI-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shibei updated HUDI-3985: - Status: In Progress (was: Open) > Refactor DLASyncTool to support read hoodie table as datasource table > ---

[GitHub] [hudi] danny0405 commented on issue #5020: [SUPPORT] The cleaning strategy breaks the reader view completeness

danny0405 commented on issue #5020: URL: https://github.com/apache/hudi/issues/5020#issuecomment-1120582884 > we have 3 files in requested, inflight and completed states. How about have a mechanism where after a certain threshold in terms of number of commits, we archive or simply delete on

[GitHub] [hudi] hudi-bot commented on pull request #5531: [MINOR] Fixing close for HoodieCatalog's test

hudi-bot commented on PR #5531: URL: https://github.com/apache/hudi/pull/5531#issuecomment-1120579603 ## CI report: * 589619d27d1c23a66f3d5acb5605e13030496663 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8504

[GitHub] [hudi] danny0405 commented on a diff in pull request #5531: [MINOR] Fixing close for HoodieCatalog's test

danny0405 commented on code in PR #5531: URL: https://github.com/apache/hudi/pull/5531#discussion_r867595366 ## hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/table/catalog/TestHoodieCatalog.java: ## @@ -138,6 +138,13 @@ void beforeEach() { catalog.open();

[GitHub] [hudi] hudi-bot commented on pull request #4958: [HUDI-3558] [Stacked 3123] Consistent bucket index: bucket resizing (split&merge) & concurrent write during resizing

hudi-bot commented on PR #4958: URL: https://github.com/apache/hudi/pull/4958#issuecomment-1120579147 ## CI report: * f5ce884f6ebeb611dce1a4afe05dc25da00ef908 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8468

[GitHub] [hudi] hudi-bot commented on pull request #5531: [MINOR] Fixing close for HoodieCatalog's test

hudi-bot commented on PR #5531: URL: https://github.com/apache/hudi/pull/5531#issuecomment-1120577932 ## CI report: * 589619d27d1c23a66f3d5acb5605e13030496663 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #4958: [HUDI-3558] [Stacked 3123] Consistent bucket index: bucket resizing (split&merge) & concurrent write during resizing

hudi-bot commented on PR #4958: URL: https://github.com/apache/hudi/pull/4958#issuecomment-1120577467 ## CI report: * f5ce884f6ebeb611dce1a4afe05dc25da00ef908 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8468

[GitHub] [hudi] blackburt342865189 commented on issue #5372: [SUPPORT] Compatible with multiple HBASE version or hbase: 2.1.0-cdh6.3.2

blackburt342865189 commented on issue #5372: URL: https://github.com/apache/hudi/issues/5372#issuecomment-1120573109 yes,hive on spark, put hudi-hadoop-mr-bundle-0.12.0-SNAPSHOT into auxlib/, after restart hiveserver2,encountered ,hiveserver2 donot Normal woking. -- This is an

[jira] [Updated] (HUDI-4055) use loop replace recursive call in ratelimiter

[ https://issues.apache.org/jira/browse/HUDI-4055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-4055: - Fix Version/s: 0.12.0 > use loop replace recursive call in ratelimiter > -

[jira] [Commented] (HUDI-4055) use loop replace recursive call in ratelimiter

[ https://issues.apache.org/jira/browse/HUDI-4055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17533582#comment-17533582 ] Danny Chen commented on HUDI-4055: -- Fixed via master branch: 75eaa0bffe86306c5df7a52c42ee

[jira] [Resolved] (HUDI-4055) use loop replace recursive call in ratelimiter

[ https://issues.apache.org/jira/browse/HUDI-4055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-4055. -- > use loop replace recursive call in ratelimiter > -- > >

[hudi] branch master updated: [HUDI-4055]refactor ratelimiter to avoid stack overflow (#5530)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 75eaa0bffe [HUDI-4055]refactor ratelimiter to a

[GitHub] [hudi] danny0405 merged pull request #5530: [HUDI-4055]refactor ratelimiter to avoid stack overflow

danny0405 merged PR #5530: URL: https://github.com/apache/hudi/pull/5530 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache

[GitHub] [hudi] XuQianJin-Stars opened a new pull request, #5531: [MINOR] Fixing close for HoodieCatalog's test

XuQianJin-Stars opened a new pull request, #5531: URL: https://github.com/apache/hudi/pull/5531 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the

[GitHub] [hudi] aliceyyan commented on pull request #5516: HUDI-4044 When reading data from flink-hudi to external storage, the …

aliceyyan commented on PR #5516: URL: https://github.com/apache/hudi/pull/5516#issuecomment-1120568745 @danny0405 can you help me with the code review? thank you -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[GitHub] [hudi] danny0405 commented on issue #5372: [SUPPORT] Compatible with multiple HBASE version or hbase: 2.1.0-cdh6.3.2

danny0405 commented on issue #5372: URL: https://github.com/apache/hudi/issues/5372#issuecomment-1120568568 > I also encountered this problem： > > 2022-05-08 09:04:30,885 WARN org.apache.hive.service.server.HiveServer2: [main]: Error starting HiveServer2 on attempt 1, will retry in 60

[jira] [Closed] (HUDI-3964) hudi-spark-bundle lack avro dependency

[ https://issues.apache.org/jira/browse/HUDI-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hanjie closed HUDI-3964. Resolution: Not A Problem > hudi-spark-bundle lack avro dependency > -- > >

[GitHub] [hudi] Baibaiwuguo closed pull request #5423: [HUDI-3964] hudi-spark-bundle miss avro dependency

Baibaiwuguo closed pull request #5423: [HUDI-3964] hudi-spark-bundle miss avro dependency URL: https://github.com/apache/hudi/pull/5423 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[GitHub] [hudi] Baibaiwuguo commented on pull request #5423: [HUDI-3964] hudi-spark-bundle miss avro dependency

Baibaiwuguo commented on PR #5423: URL: https://github.com/apache/hudi/pull/5423#issuecomment-1120562323 @alexeykudinkin you are right, Our test spark colony delete avro. I'll add it and hudi run fine. -- This is an automated message from the Apache Git Service. To respond to the messag

[GitHub] [hudi] liuzhuang2017 commented on pull request #5525: Update cli.md

liuzhuang2017 commented on PR #5525: URL: https://github.com/apache/hudi/pull/5525#issuecomment-1120547811 @huzk8 , Thanks your pr，I suggest that your title should be changed to "[MINOR] Update cli.md". -- This is an automated message from the Apache Git Service. To respond to the messag

[GitHub] [hudi] cuibo01 commented on pull request #5528: [HUDI-3336][HUDI-FLINK]Support custom hadoop config for flink

cuibo01 commented on PR #5528: URL: https://github.com/apache/hudi/pull/5528#issuecomment-1120544394 @XuQianJin-Stars hi, can u review the pr, thx -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] blackburt342865189 commented on issue #5372: [SUPPORT] Compatible with multiple HBASE version or hbase: 2.1.0-cdh6.3.2

blackburt342865189 commented on issue #5372: URL: https://github.com/apache/hudi/issues/5372#issuecomment-1120528509 I also encountered this problem： 2022-05-08 09:04:30,885 WARN org.apache.hive.service.server.HiveServer2: [main]: Error starting HiveServer2 on attempt 1, will retr

[GitHub] [hudi] hudi-bot commented on pull request #4913: [HUDI-1517] create marker file for every log file

hudi-bot commented on PR #4913: URL: https://github.com/apache/hudi/pull/4913#issuecomment-1120467448 ## CI report: * a39d9936ef7f0d5354b420f36d4bc6d26aa41755 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8501

[GitHub] [hudi] hudi-bot commented on pull request #5530: [HUDI-4055]refactor ratelimiter to avoid stack overflow

hudi-bot commented on PR #5530: URL: https://github.com/apache/hudi/pull/5530#issuecomment-1120452852 ## CI report: * becdeba10cc43fc7a136e5a3007dad079d23b367 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8498

[GitHub] [hudi] hudi-bot commented on pull request #4913: [HUDI-1517] create marker file for every log file

hudi-bot commented on PR #4913: URL: https://github.com/apache/hudi/pull/4913#issuecomment-1120451782 ## CI report: * 29e56b812b3b055d1c94ff7a803e19913e769694 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8499

[GitHub] [hudi] hudi-bot commented on pull request #5522: [WIP][HUDI-3378][HUDI-3379][HUDI-3381] Rebasing usages of HoodieRecordPayload and raw Avro payload to rely on HoodieRecord instead

hudi-bot commented on PR #5522: URL: https://github.com/apache/hudi/pull/5522#issuecomment-1120450948 ## CI report: * 986960516f86a1426725141cd7cb25e84d260020 UNKNOWN * 42ffe967fe0c85dfc5ae78d33494f0adb223a95c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #5522: [WIP][HUDI-3378][HUDI-3379][HUDI-3381] Rebasing usages of HoodieRecordPayload and raw Avro payload to rely on HoodieRecord instead

hudi-bot commented on PR #5522: URL: https://github.com/apache/hudi/pull/5522#issuecomment-1120450494 ## CI report: * 2c9ef83c34d724c41e87bb4e2ce573122a8afdc5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8481

[GitHub] [hudi] hudi-bot commented on pull request #4913: [HUDI-1517] create marker file for every log file

hudi-bot commented on PR #4913: URL: https://github.com/apache/hudi/pull/4913#issuecomment-1120450371 ## CI report: * 29e56b812b3b055d1c94ff7a803e19913e769694 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8499

[GitHub] [hudi] hudi-bot commented on pull request #5522: [WIP][HUDI-3378][HUDI-3379][HUDI-3381] Rebasing usages of HoodieRecordPayload and raw Avro payload to rely on HoodieRecord instead

hudi-bot commented on PR #5522: URL: https://github.com/apache/hudi/pull/5522#issuecomment-1120449991 ## CI report: * 2c9ef83c34d724c41e87bb4e2ce573122a8afdc5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8481

  1   2   >