[jira] [Updated] (HUDI-6295) Support schema evolution for the columns used in MERGE INTO update clause.

2023-06-29 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka updated HUDI-6295: Fix Version/s: 0.15.0 (was: 1.0.0) > Support schema evolution for the

[jira] [Updated] (HUDI-6295) Support schema evolution for the columns used in MERGE INTO update clause.

2023-06-29 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka updated HUDI-6295: Priority: Major (was: Minor) > Support schema evolution for the columns used in MERGE INTO update

[jira] [Updated] (HUDI-6441) Passing custom Headers with Hudi Callback URL

2023-06-29 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka updated HUDI-6441: Priority: Major (was: Minor) > Passing custom Headers with Hudi Callback URL >

[jira] [Updated] (HUDI-6059) Add JSON file reader support for Delta Streamer

2023-06-29 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka updated HUDI-6059: Priority: Major (was: Minor) > Add JSON file reader support for Delta Streamer >

[GitHub] [hudi] hudi-bot commented on pull request #9103: [MINOR]move hoodie hfile/orc reader/writer test cases from hudi-client-common to hudi-common

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9103: URL: https://github.com/apache/hudi/pull/9103#issuecomment-1614152292 ## CI report: * f26d06b7eb099e698fe7058f3ffba327d4ae5c7f Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9103: [MINOR]move hoodie hfile/orc reader/writer test cases from hudi-client-common to hudi-common

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9103: URL: https://github.com/apache/hudi/pull/9103#issuecomment-1614146955 ## CI report: * f26d06b7eb099e698fe7058f3ffba327d4ae5c7f UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[jira] [Updated] (HUDI-6346) Allow duplicates by default for insert operation type

2023-06-29 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka updated HUDI-6346: Priority: Blocker (was: Critical) > Allow duplicates by default for insert operation type >

[GitHub] [hudi] hudi-bot commented on pull request #9007: [HUDI-6405] Fix incremental file sync for clustering and logcompaction

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9007: URL: https://github.com/apache/hudi/pull/9007#issuecomment-1614141754 ## CI report: * f154ee335eb307e2bcffd895cfd95bfb1f417a1e Azure:

[GitHub] [hudi] Mulavar commented on pull request #9103: [MINOR]move hoodie hfile/orc reader/writer test cases from hudi-client-common to hudi-common

2023-06-29 Thread via GitHub
Mulavar commented on PR #9103: URL: https://github.com/apache/hudi/pull/9103#issuecomment-1614115757 Since hfile/orc reader/writer are written in the hudi-common module, it is better to write the test cases in the same module. -- This is an automated message from the Apache Git Service.

[GitHub] [hudi] Mulavar opened a new pull request, #9103: [MINOR]move hoodie hfile/orc reader/writer test cases from hudi-client-common to hudi-common

2023-06-29 Thread via GitHub
Mulavar opened a new pull request, #9103: URL: https://github.com/apache/hudi/pull/9103 ### Change Logs Move hoodie hfile/orc reader/writer test cases from hudi-client-common to hudi-common. ### Impact None ### Risk level (write none, low medium or high below)

[GitHub] [hudi] Mulavar closed issue #9102: [MINOR]Refactor hfile/orc reader/test cases

2023-06-29 Thread via GitHub
Mulavar closed issue #9102: [MINOR]Refactor hfile/orc reader/test cases URL: https://github.com/apache/hudi/issues/9102 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] Mulavar opened a new issue, #9102: [MINOR]Refactor hfile/orc reader/test cases

2023-06-29 Thread via GitHub
Mulavar opened a new issue, #9102: URL: https://github.com/apache/hudi/issues/9102 **_Tips before filing an issue_** - Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)? - Join the mailing list to engage in conversations and get faster support at

[jira] [Assigned] (HUDI-6444) Support delete and delete_partition with RLI

2023-06-29 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-6444: Assignee: Raymond Xu > Support delete and delete_partition with RLI >

[GitHub] [hudi] hudi-bot commented on pull request #9100: [MINOR]Adjust annotation in HoodieLogFormatReader

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9100: URL: https://github.com/apache/hudi/pull/9100#issuecomment-1614100501 ## CI report: * d04a1916d065e33d78bc1f874558db39333b113a Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9095: Test ci

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9095: URL: https://github.com/apache/hudi/pull/9095#issuecomment-1614096296 ## CI report: * 99475ffc62972ee49905fca98ea70f2096cfb135 UNKNOWN * ec568a0c309690a1b0931249aae1e4aab9eddc9b Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9100: [MINOR]Adjust annotation in HoodieLogFormatReader

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9100: URL: https://github.com/apache/hudi/pull/9100#issuecomment-1614096358 ## CI report: * d04a1916d065e33d78bc1f874558db39333b113a UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] KnightChess opened a new issue, #9101: [SUPPORT] Transaction and task state inconsistency

2023-06-29 Thread via GitHub
KnightChess opened a new issue, #9101: URL: https://github.com/apache/hudi/issues/9101 code in: https://github.com/apache/hudi/blob/master/hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/BaseHoodieWriteClient.java#L215-L272 In this picture, we have submit

[GitHub] [hudi] hudi-bot commented on pull request #9099: [HUDI-6457]Keep JavaSizeBasedClusteringPlanStrategy and SparkSizeBase…

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9099: URL: https://github.com/apache/hudi/pull/9099#issuecomment-1614067678 ## CI report: * c61be845ddfc82ffcc107f8db437fc75d334eb58 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9097: [HUDI-6458]Scheduling jobs should not fail when there is no completed commits

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9097: URL: https://github.com/apache/hudi/pull/9097#issuecomment-1614067654 ## CI report: * fc76b6cf3bfb61e27eb1e8130b58ce9b5649fb5e Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9063: [HUDI-6448] Improve upgrade/downgrade for table ver. 6

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9063: URL: https://github.com/apache/hudi/pull/9063#issuecomment-1614067541 ## CI report: * 2aafcc1737e74d9569531d5efc5faf8c5d1b33ec Azure:

[GitHub] [hudi] ksmou opened a new pull request, #9100: [MINOR]Adjust annotation in HoodieLogFormatReader

2023-06-29 Thread via GitHub
ksmou opened a new pull request, #9100: URL: https://github.com/apache/hudi/pull/9100 ### Change Logs _Describe context and summary for this change. Highlight if any code was copied._ ### Impact _Describe any public API or user-facing feature change or any performance

[GitHub] [hudi] danny0405 commented on a diff in pull request #9058: [HUDI-6376] Support for deletes in HUDI Indexes including metadata table record index.

2023-06-29 Thread via GitHub
danny0405 commented on code in PR #9058: URL: https://github.com/apache/hudi/pull/9058#discussion_r1247377008 ## hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java: ## @@ -283,6 +285,8 @@ public HoodieMetadataPayload(Option recordOpt) {

[GitHub] [hudi] hudi-bot commented on pull request #9099: [HUDI-6457]Keep JavaSizeBasedClusteringPlanStrategy and SparkSizeBase…

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9099: URL: https://github.com/apache/hudi/pull/9099#issuecomment-1614063613 ## CI report: * c61be845ddfc82ffcc107f8db437fc75d334eb58 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #9098: [MINOR] Reverting disabled tests for multiwriter archival

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9098: URL: https://github.com/apache/hudi/pull/9098#issuecomment-1614063595 ## CI report: * 120a4bcce84c866dfff254294f2a20a54a7d0b1e Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9097: [HUDI-6458]Scheduling jobs should not fail when there is no completed commits

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9097: URL: https://github.com/apache/hudi/pull/9097#issuecomment-1614063575 ## CI report: * fc76b6cf3bfb61e27eb1e8130b58ce9b5649fb5e Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9063: [HUDI-6448] Improve upgrade/downgrade for table ver. 6

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9063: URL: https://github.com/apache/hudi/pull/9063#issuecomment-1614063336 ## CI report: * 2aafcc1737e74d9569531d5efc5faf8c5d1b33ec Azure:

[GitHub] [hudi] danny0405 commented on a diff in pull request #9058: [HUDI-6376] Support for deletes in HUDI Indexes including metadata table record index.

2023-06-29 Thread via GitHub
danny0405 commented on code in PR #9058: URL: https://github.com/apache/hudi/pull/9058#discussion_r1246019736 ## hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java: ## @@ -283,6 +285,8 @@ public HoodieMetadataPayload(Option recordOpt) {

[GitHub] [hudi] hudi-bot commented on pull request #9097: [HUDI-6458]Scheduling jobs should not fail when there is no completed commits

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9097: URL: https://github.com/apache/hudi/pull/9097#issuecomment-1614058800 ## CI report: * fc76b6cf3bfb61e27eb1e8130b58ce9b5649fb5e Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9098: [MINOR] Reverting disabled tests for multiwriter archival

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9098: URL: https://github.com/apache/hudi/pull/9098#issuecomment-1614058835 ## CI report: * 120a4bcce84c866dfff254294f2a20a54a7d0b1e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #8683: [HUDI-5533] Support spark columns comments

2023-06-29 Thread via GitHub
hudi-bot commented on PR #8683: URL: https://github.com/apache/hudi/pull/8683#issuecomment-1614058101 ## CI report: * 8d6893fd9daf07c30524474cf9a4d39c66a37cba UNKNOWN * de250fbbcf1d16ba358dd08270eab5e11a5e3740 UNKNOWN * f41404ad3c5c399ee0243fe0ea9a5ee70b74f896 Azure:

[jira] [Updated] (HUDI-6457) Keep JavaSizeBasedClusteringPlanStrategy and SparkSizeBasedClusteringPlanStrategy aligned

2023-06-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-6457: - Labels: pull-request-available (was: ) > Keep JavaSizeBasedClusteringPlanStrategy and >

[GitHub] [hudi] ksmou opened a new pull request, #9099: [HUDI-6457]Keep JavaSizeBasedClusteringPlanStrategy and SparkSizeBase…

2023-06-29 Thread via GitHub
ksmou opened a new pull request, #9099: URL: https://github.com/apache/hudi/pull/9099 …dClusteringPlanStrategy aligned ### Change Logs _Describe context and summary for this change. Highlight if any code was copied._ ### Impact _Describe any public API or

[GitHub] [hudi] nsivabalan merged pull request #9041: [HUDI-6431] Support update partition path in record-level index

2023-06-29 Thread via GitHub
nsivabalan merged PR #9041: URL: https://github.com/apache/hudi/pull/9041 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[hudi] branch master updated: [HUDI-6431] Support update partition path in record-level index (#9041)

2023-06-29 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 0a3a58ee09c [HUDI-6431] Support update

[GitHub] [hudi] boneanxs commented on a diff in pull request #9053: [HUDI-6369] Fix spacial curve with sample strategy fails when 0 or 1 rows only is incoming

2023-06-29 Thread via GitHub
boneanxs commented on code in PR #9053: URL: https://github.com/apache/hudi/pull/9053#discussion_r1247346902 ## hudi-client/hudi-spark-client/src/main/scala/org/apache/spark/sql/hudi/execution/RangeSample.scala: ## @@ -316,6 +316,8 @@ object RangeSampleSort {

[GitHub] [hudi] hudi-bot commented on pull request #9097: [HUDI-6458]Scheduling jobs should not fail when there is no completed commits

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9097: URL: https://github.com/apache/hudi/pull/9097#issuecomment-1614030516 ## CI report: * fc76b6cf3bfb61e27eb1e8130b58ce9b5649fb5e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #9041: [HUDI-6431] Support update partition path in record-level index

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9041: URL: https://github.com/apache/hudi/pull/9041#issuecomment-1614030382 ## CI report: * 2f139383c54f93669342539af77dca9b3a352be3 UNKNOWN * a1458e17e5749a89948be8f60387eeecd4c0f87c Azure:

[GitHub] [hudi] nsivabalan opened a new pull request, #9098: [MINOR] Reverting disabled tests for multiwriter archival

2023-06-29 Thread via GitHub
nsivabalan opened a new pull request, #9098: URL: https://github.com/apache/hudi/pull/9098 ### Change Logs [MINOR] Reverting disabled tests for multiwriter archival ### Impact [MINOR] Reverting disabled tests for multiwriter archival ### Risk level (write none,

[GitHub] [hudi] gamblewin commented on issue #9093: [SUPPORT] Is it allowed using Flink Table API sqlQuery() to read data from hudi tables?

2023-06-29 Thread via GitHub
gamblewin commented on issue #9093: URL: https://github.com/apache/hudi/issues/9093#issuecomment-1614027795 One more question, does hudi have any flink api for bulk insert? ![image](https://github.com/apache/hudi/assets/39117591/29652adf-3196-4109-91ba-6f5d176a7d05) The example on

[jira] [Updated] (HUDI-6458) Scheduling jobs should not fail when there is no completed commits

2023-06-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-6458: - Labels: pull-request-available (was: ) > Scheduling jobs should not fail when there is no

[GitHub] [hudi] ksmou opened a new pull request, #9097: [HUDI-6458]Scheduling jobs should not fail when there is no completed commits

2023-06-29 Thread via GitHub
ksmou opened a new pull request, #9097: URL: https://github.com/apache/hudi/pull/9097 ### Change Logs remove unused commits num check before executing compactor/clustering. ### Impact _Describe any public API or user-facing feature change or any performance impact._

[GitHub] [hudi] hudi-bot commented on pull request #9083: PKLess Merge Into

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9083: URL: https://github.com/apache/hudi/pull/9083#issuecomment-1614021158 ## CI report: * 3a0bfb88049cf2c0f8afe5c925dbd76fa6f7cd89 UNKNOWN * ac4f2ce82babd0794dd73ec097ae79853978b5a5 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8978: [HUDI-6315] Optimize DELETE codepath to use meta fields instead of key generation and index lookup

2023-06-29 Thread via GitHub
hudi-bot commented on PR #8978: URL: https://github.com/apache/hudi/pull/8978#issuecomment-1614020967 ## CI report: * 85d6a980287b105a661025ed5aa45da319ad52a1 Azure:

[GitHub] [hudi] ad1happy2go commented on issue #8160: [SUPPORT] Schema evolution wrt to datatype promotion isnt working. org.apache.avro.AvroRuntimeException: cannot support rewrite value for schema t

2023-06-29 Thread via GitHub
ad1happy2go commented on issue #8160: URL: https://github.com/apache/hudi/issues/8160#issuecomment-1614001314 @aajisaka Gentle ping. Were you able to check it? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hudi] hudi-bot commented on pull request #8837: [HUDI-6153] Changed the rollback mechanism for MDT to actual rollbacks rather than appending revert blocks.

2023-06-29 Thread via GitHub
hudi-bot commented on PR #8837: URL: https://github.com/apache/hudi/pull/8837#issuecomment-1613992170 ## CI report: * 50a92342798b808ebe521d82b99e4622eeb77ce8 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8837: [HUDI-6153] Changed the rollback mechanism for MDT to actual rollbacks rather than appending revert blocks.

2023-06-29 Thread via GitHub
hudi-bot commented on PR #8837: URL: https://github.com/apache/hudi/pull/8837#issuecomment-1613987357 ## CI report: * 50a92342798b808ebe521d82b99e4622eeb77ce8 Azure:

[GitHub] [hudi] beyond1920 commented on issue #9090: [SUPPORT] FileNotFoundException would happen occasionally after cherrypick HUDI-1517

2023-06-29 Thread via GitHub
beyond1920 commented on issue #9090: URL: https://github.com/apache/hudi/issues/9090#issuecomment-1613971350 @ad1happy2go Thanks for response. I would try it on master later. However I believe it would exist in master branch too because the related code path does not change. I have

[GitHub] [hudi] CTTY commented on pull request #9071: [HUDI-6453] Cascade Glue schema changes to partitions

2023-06-29 Thread via GitHub
CTTY commented on PR #9071: URL: https://github.com/apache/hudi/pull/9071#issuecomment-1613955565 @danny0405 Hi Danny, thanks for taking a look We found when Hudi uses `AwsGlueCatalogSyncTool` to sync schema changes to Glue, it only changes table schema without cascading partition

[GitHub] [hudi] hudi-bot commented on pull request #9053: [HUDI-6369] Fix spacial curve with sample strategy fails when 0 or 1 rows only is incoming

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9053: URL: https://github.com/apache/hudi/pull/9053#issuecomment-1613948641 ## CI report: * 2521fcee784d790c505bbdb7b1cd73a2e83da95a Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9063: [HUDI-6448] Improve upgrade/downgrade for table ver. 6

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9063: URL: https://github.com/apache/hudi/pull/9063#issuecomment-1613943924 ## CI report: * 2aafcc1737e74d9569531d5efc5faf8c5d1b33ec Azure:

[GitHub] [hudi] parisni commented on pull request #8683: [HUDI-5533] Support spark columns comments

2023-06-29 Thread via GitHub
parisni commented on PR #8683: URL: https://github.com/apache/hudi/pull/8683#issuecomment-1613914438 I have investigated a bit, and here my current understanding: Reading hudi table w/ spark has two path: 1. if

[GitHub] [hudi] hudi-bot commented on pull request #8837: [HUDI-6153] Changed the rollback mechanism for MDT to actual rollbacks rather than appending revert blocks.

2023-06-29 Thread via GitHub
hudi-bot commented on PR #8837: URL: https://github.com/apache/hudi/pull/8837#issuecomment-1613909899 ## CI report: * 50a92342798b808ebe521d82b99e4622eeb77ce8 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9058: [HUDI-6376] Support for deletes in HUDI Indexes including metadata table record index.

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9058: URL: https://github.com/apache/hudi/pull/9058#issuecomment-1613881415 ## CI report: * 5c71da28dab6c40b1937c2995cec0e96c1a27fb7 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9058: [HUDI-6376] Support for deletes in HUDI Indexes including metadata table record index.

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9058: URL: https://github.com/apache/hudi/pull/9058#issuecomment-1613875595 ## CI report: * 1697d1bfa095ca16a9361e3728a77331d3a28037 Azure:

[GitHub] [hudi] suryaprasanna commented on pull request #9006: [HUDI-6404] Implement ParquetToolsExecutionStrategy for clustering

2023-06-29 Thread via GitHub
suryaprasanna commented on PR #9006: URL: https://github.com/apache/hudi/pull/9006#issuecomment-1613853964 > > If there is a use case of pruning some columns to save storage memory, current approach of clustering will iterate over every record and remove the unused column, this is so much

[GitHub] [hudi] hudi-bot commented on pull request #9095: Test ci

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9095: URL: https://github.com/apache/hudi/pull/9095#issuecomment-1613834591 ## CI report: * 99475ffc62972ee49905fca98ea70f2096cfb135 UNKNOWN * f31f13745ac4e3a32455a52a61e15082afec51e3 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9007: [HUDI-6405] Fix incremental file sync for clustering and logcompaction

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9007: URL: https://github.com/apache/hudi/pull/9007#issuecomment-1613834275 ## CI report: * 3b6d13a83efdae5e46eebe9ae168ba7e0d8e9f34 Azure:

[GitHub] [hudi] prashantwason commented on pull request #9074: [MINOR] Upload coverage report to codecov.

2023-06-29 Thread via GitHub
prashantwason commented on PR #9074: URL: https://github.com/apache/hudi/pull/9074#issuecomment-1613832280 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] hudi-bot commented on pull request #9095: Test ci

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9095: URL: https://github.com/apache/hudi/pull/9095#issuecomment-1613826837 ## CI report: * b157b76dc4a7aa862f264b975a12b6212aca7138 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9007: [HUDI-6405] Fix incremental file sync for clustering and logcompaction

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9007: URL: https://github.com/apache/hudi/pull/9007#issuecomment-1613826553 ## CI report: * 3b6d13a83efdae5e46eebe9ae168ba7e0d8e9f34 Azure:

[GitHub] [hudi] prashantwason commented on a diff in pull request #9058: [HUDI-6376] Support for deletes in HUDI Indexes including metadata table record index.

2023-06-29 Thread via GitHub
prashantwason commented on code in PR #9058: URL: https://github.com/apache/hudi/pull/9058#discussion_r1247188452 ## hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java: ## @@ -283,6 +285,8 @@ public HoodieMetadataPayload(Option recordOpt) {

[GitHub] [hudi] hudi-bot commented on pull request #9082: [HUDI-6445] Distribute spark ds func tests

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9082: URL: https://github.com/apache/hudi/pull/9082#issuecomment-1613819442 ## CI report: * 474ce7e9a78909fe90b0641f7be1b059084bb11a Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9058: [HUDI-6376] Support for deletes in HUDI Indexes including metadata table record index.

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9058: URL: https://github.com/apache/hudi/pull/9058#issuecomment-1613819259 ## CI report: * 1697d1bfa095ca16a9361e3728a77331d3a28037 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9095: Test ci

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9095: URL: https://github.com/apache/hudi/pull/9095#issuecomment-1613773319 ## CI report: * b157b76dc4a7aa862f264b975a12b6212aca7138 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9058: [HUDI-6376] Support for deletes in HUDI Indexes including metadata table record index.

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9058: URL: https://github.com/apache/hudi/pull/9058#issuecomment-1613773079 ## CI report: * 1697d1bfa095ca16a9361e3728a77331d3a28037 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8683: [HUDI-5533] Support spark columns comments

2023-06-29 Thread via GitHub
hudi-bot commented on PR #8683: URL: https://github.com/apache/hudi/pull/8683#issuecomment-1613772156 ## CI report: * 7bdb94998ee2853e15de0b4ce6c20735f43a0f5c Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9095: Test ci

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9095: URL: https://github.com/apache/hudi/pull/9095#issuecomment-1613763527 ## CI report: * b157b76dc4a7aa862f264b975a12b6212aca7138 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8683: [HUDI-5533] Support spark columns comments

2023-06-29 Thread via GitHub
hudi-bot commented on PR #8683: URL: https://github.com/apache/hudi/pull/8683#issuecomment-1613762346 ## CI report: * 7bdb94998ee2853e15de0b4ce6c20735f43a0f5c Azure:

[jira] [Created] (HUDI-6460) Fix Hbase Index for deletes

2023-06-29 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-6460: - Summary: Fix Hbase Index for deletes Key: HUDI-6460 URL: https://issues.apache.org/jira/browse/HUDI-6460 Project: Apache Hudi Issue Type:

[GitHub] [hudi] hudi-bot commented on pull request #9095: Test ci

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9095: URL: https://github.com/apache/hudi/pull/9095#issuecomment-1613754049 ## CI report: * 34835dfe0e6ff5d6145ffbccd4d52b55af0c3771 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8978: [HUDI-6315] Optimize DELETE codepath to use meta fields instead of key generation and index lookup

2023-06-29 Thread via GitHub
hudi-bot commented on PR #8978: URL: https://github.com/apache/hudi/pull/8978#issuecomment-1613753323 ## CI report: * 30f67aed744512323e0ee8a04423ebb85c00c728 Azure:

[GitHub] [hudi] NewtonXu closed issue #9018: [SUPPORT] AmazonDynamoDBLockClientOptions failing to instantiate for Hudi AWS DynamoDB concurrency control

2023-06-29 Thread via GitHub
NewtonXu closed issue #9018: [SUPPORT] AmazonDynamoDBLockClientOptions failing to instantiate for Hudi AWS DynamoDB concurrency control URL: https://github.com/apache/hudi/issues/9018 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hudi] NewtonXu commented on issue #9018: [SUPPORT] AmazonDynamoDBLockClientOptions failing to instantiate for Hudi AWS DynamoDB concurrency control

2023-06-29 Thread via GitHub
NewtonXu commented on issue #9018: URL: https://github.com/apache/hudi/issues/9018#issuecomment-1613740158 Yes, this worked for me. Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] ehurheap commented on issue #9079: [SUPPORT] Hudi delete not working when using UuidKeyGenerator

2023-06-29 Thread via GitHub
ehurheap commented on issue #9079: URL: https://github.com/apache/hudi/issues/9079#issuecomment-1613712994 Please post details how to workaround this problem as we discussed in office hours. I believe it was using the WriteClient, and empty RDD and some hoodie metadata fields? -- This

[GitHub] [hudi] parisni commented on a diff in pull request #9053: [HUDI-6369] Fix spacial curve with sample strategy fails when 0 or 1 rows only is incoming

2023-06-29 Thread via GitHub
parisni commented on code in PR #9053: URL: https://github.com/apache/hudi/pull/9053#discussion_r1247037719 ## hudi-client/hudi-spark-client/src/main/scala/org/apache/spark/sql/hudi/execution/RangeSample.scala: ## @@ -316,6 +316,8 @@ object RangeSampleSort {

[GitHub] [hudi] hudi-bot commented on pull request #9095: Test ci

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9095: URL: https://github.com/apache/hudi/pull/9095#issuecomment-1613687266 ## CI report: * 34835dfe0e6ff5d6145ffbccd4d52b55af0c3771 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9083: PKLess Merge Into

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9083: URL: https://github.com/apache/hudi/pull/9083#issuecomment-1613687172 ## CI report: * 3a0bfb88049cf2c0f8afe5c925dbd76fa6f7cd89 UNKNOWN * 767eb9cc26d98ed8e64632f98ab688aa4145e5aa Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8978: [HUDI-6315] Optimize DELETE codepath to use meta fields instead of key generation and index lookup

2023-06-29 Thread via GitHub
hudi-bot commented on PR #8978: URL: https://github.com/apache/hudi/pull/8978#issuecomment-1613686736 ## CI report: * 30f67aed744512323e0ee8a04423ebb85c00c728 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9053: [HUDI-6369] Fix spacial curve with sample strategy fails when 0 or 1 rows only is incoming

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9053: URL: https://github.com/apache/hudi/pull/9053#issuecomment-1613677129 ## CI report: * 074626f1eb9a809051016d8e4633f8487f477459 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9095: Test ci

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9095: URL: https://github.com/apache/hudi/pull/9095#issuecomment-1613677450 ## CI report: * 34835dfe0e6ff5d6145ffbccd4d52b55af0c3771 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9083: PKLess Merge Into

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9083: URL: https://github.com/apache/hudi/pull/9083#issuecomment-1613677353 ## CI report: * be6801e9ca41f00576a511c7d3ffe144e90717ee Azure:

[GitHub] [hudi] amrishlal commented on a diff in pull request #8978: [HUDI-6315] Optimize DELETE codepath to use meta fields instead of key generation and index lookup

2023-06-29 Thread via GitHub
amrishlal commented on code in PR #8978: URL: https://github.com/apache/hudi/pull/8978#discussion_r1247016425 ## hudi-spark-datasource/hudi-spark-common/src/main/java/org/apache/hudi/HoodieSparkRecordMerger.java: ## @@ -41,13 +42,30 @@ public Option> merge(HoodieRecord older,

[GitHub] [hudi] hudi-bot commented on pull request #9092: [MINOR] Enable log compaction by default for MDT

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9092: URL: https://github.com/apache/hudi/pull/9092#issuecomment-1613667062 ## CI report: * 408e9f946e0a0647b0fc9f8e220d55ad2fbde62d Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9064: [HUDI-6450] Fix null strings handling in convertRowToJsonString

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9064: URL: https://github.com/apache/hudi/pull/9064#issuecomment-1613666832 ## CI report: * b8418b74febf4551c0f79c7ebe71cf24916124e6 UNKNOWN * 9c6d2bf222b7247bc926302045123bad69157d39 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9053: [HUDI-6369] Fix spacial curve with sample strategy fails when 0 or 1 rows only is incoming

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9053: URL: https://github.com/apache/hudi/pull/9053#issuecomment-1613666713 ## CI report: * 074626f1eb9a809051016d8e4633f8487f477459 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9095: Test ci

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9095: URL: https://github.com/apache/hudi/pull/9095#issuecomment-1613611539 ## CI report: * 34835dfe0e6ff5d6145ffbccd4d52b55af0c3771 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9063: [HUDI-6448] Improve upgrade/downgrade for table ver. 6

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9063: URL: https://github.com/apache/hudi/pull/9063#issuecomment-1613611322 ## CI report: * af66542fd96990611c79e90c943a18341442 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9095: Test ci

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9095: URL: https://github.com/apache/hudi/pull/9095#issuecomment-1613601961 ## CI report: * 34835dfe0e6ff5d6145ffbccd4d52b55af0c3771 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #9063: [HUDI-6448] Improve upgrade/downgrade for table ver. 6

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9063: URL: https://github.com/apache/hudi/pull/9063#issuecomment-1613601746 ## CI report: * 4775dce07f2f3237b32f22b360f3423b1eafce85 Azure:

[GitHub] [hudi] MathurCodes1 opened a new issue, #9096: [SUPPORT] Unable to alter column name for a Hudi table.

2023-06-29 Thread via GitHub
MathurCodes1 opened a new issue, #9096: URL: https://github.com/apache/hudi/issues/9096 **Describe the problem you faced** I'm unable to alter the column name of Hudi table . spark.sql("ALTER TABLE customer_db.customer RENAME COLUMN subid TO subidentifier") unbable to change

[GitHub] [hudi] hudi-bot commented on pull request #8837: [HUDI-6153] Changed the rollback mechanism for MDT to actual rollbacks rather than appending revert blocks.

2023-06-29 Thread via GitHub
hudi-bot commented on PR #8837: URL: https://github.com/apache/hudi/pull/8837#issuecomment-1613593548 ## CI report: * 9751b6399ebf6b629f3940d612bdfe2e2005a25f Azure:

[GitHub] [hudi] nsivabalan commented on a diff in pull request #9058: [HUDI-6376] Support for deletes in HUDI Indexes including metadata table record index.

2023-06-29 Thread via GitHub
nsivabalan commented on code in PR #9058: URL: https://github.com/apache/hudi/pull/9058#discussion_r1246951472 ## hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java: ## @@ -209,9 +211,10 @@ public class HoodieMetadataPayload implements

[GitHub] [hudi] nsivabalan commented on a diff in pull request #9058: [HUDI-6376] Support for deletes in HUDI Indexes including metadata table record index.

2023-06-29 Thread via GitHub
nsivabalan commented on code in PR #9058: URL: https://github.com/apache/hudi/pull/9058#discussion_r1246951472 ## hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java: ## @@ -209,9 +211,10 @@ public class HoodieMetadataPayload implements

[GitHub] [hudi] nsivabalan commented on a diff in pull request #9058: [HUDI-6376] Support for deletes in HUDI Indexes including metadata table record index.

2023-06-29 Thread via GitHub
nsivabalan commented on code in PR #9058: URL: https://github.com/apache/hudi/pull/9058#discussion_r1246949788 ## hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java: ## @@ -283,6 +285,8 @@ public HoodieMetadataPayload(Option recordOpt) {

[jira] [Updated] (HUDI-6426) Upgrade Spark 3.4.1

2023-06-29 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-6426: Fix Version/s: 0.14.0 Priority: Blocker (was: Major) > Upgrade Spark 3.4.1 >

[GitHub] [hudi] hudi-bot commented on pull request #8837: [HUDI-6153] Changed the rollback mechanism for MDT to actual rollbacks rather than appending revert blocks.

2023-06-29 Thread via GitHub
hudi-bot commented on PR #8837: URL: https://github.com/apache/hudi/pull/8837#issuecomment-1613571050 ## CI report: * 9751b6399ebf6b629f3940d612bdfe2e2005a25f Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8609: [HUDI-6154] Introduced retry while reading hoodie.properties to deal with parallel updates.

2023-06-29 Thread via GitHub
hudi-bot commented on PR #8609: URL: https://github.com/apache/hudi/pull/8609#issuecomment-1613560816 ## CI report: * a64034d612fa64c99dd8d319ac00680924773f53 Azure:

[GitHub] [hudi] splate commented on pull request #3391: [HUDI-83] Fix Timestamp/Date type read by Hive3

2023-06-29 Thread via GitHub
splate commented on PR #3391: URL: https://github.com/apache/hudi/pull/3391#issuecomment-1613554365 Would this bug also exist in the spark hudi libraries used in AWS glue? My issue is I am trying to use Spark SQL to query a hudi table and put it into a spark dataframe. I am getting a

[GitHub] [hudi] hudi-bot commented on pull request #9066: [HUDI-6452] Add MOR snapshot reader to integrate with query engines without using Hadoop APIs

2023-06-29 Thread via GitHub
hudi-bot commented on PR #9066: URL: https://github.com/apache/hudi/pull/9066#issuecomment-1613551942 ## CI report: * 60c1b8c5885fdda28e07f3ba79290f01dc60a9c4 Azure:

[hudi] branch master updated (05435bb0344 -> dc3aa399ffc)

2023-06-29 Thread xushiyan
This is an automated email from the ASF dual-hosted git repository. xushiyan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 05435bb0344 [MINOR] Increase timeout for Azure CI: UT spark-datasource to 240 minutes (#9089) add dc3aa399ffc

  1   2   3   >