[GitHub] [hudi] hudi-bot removed a comment on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1061597787 ## CI report: * 869a752768dabc9e9cdb7df6b725fba50dd502af UNKNOWN * 59e0270ef6aba60d4a80f2482ec3fa605cd01e1f Azure: [FAILURE](https://dev.azure.com/apache-hud

[GitHub] [hudi] hudi-bot commented on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1061629300 ## CI report: * 869a752768dabc9e9cdb7df6b725fba50dd502af UNKNOWN * 59e0270ef6aba60d4a80f2482ec3fa605cd01e1f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] boneanxs closed pull request #4965: [MINOR] Make spark context transient to avoid serialization

2022-03-08 Thread GitBox
boneanxs closed pull request #4965: URL: https://github.com/apache/hudi/pull/4965 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr

[GitHub] [hudi] boneanxs commented on pull request #4965: [MINOR] Make spark context transient to avoid serialization

2022-03-08 Thread GitBox
boneanxs commented on pull request #4965: URL: https://github.com/apache/hudi/pull/4965#issuecomment-1061627920 Thanks for clearing me, I may run into the wrong code path when fixing one issue, I'll close this. -- This is an automated message from the Apache Git Service. To respond to th

[GitHub] [hudi] XuQianJin-Stars commented on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-03-08 Thread GitBox
XuQianJin-Stars commented on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1061627859 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[jira] [Updated] (HUDI-3583) MarkerBasedRollbackStrategy NoSuchElementException

2022-03-08 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-3583: Affects Version/s: (was: 0.11.0) > MarkerBasedRollbackStrategy NoSuchElementException > ---

[jira] [Updated] (HUDI-3583) MarkerBasedRollbackStrategy NoSuchElementException

2022-03-08 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-3583: Affects Version/s: 0.11.0 > MarkerBasedRollbackStrategy NoSuchElementException > --

[jira] [Updated] (HUDI-3583) MarkerBasedRollbackStrategy NoSuchElementException

2022-03-08 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-3583: Priority: Blocker (was: Major) > MarkerBasedRollbackStrategy NoSuchElementException >

[GitHub] [hudi] hudi-bot removed a comment on pull request #4984: [HUDI-3583] Fix MarkerBasedRollbackStrategy NoSuchElementException

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4984: URL: https://github.com/apache/hudi/pull/4984#issuecomment-1061613678 ## CI report: * 015f7f0e07d3f0efbd8d3a728f802fc5572a8f52 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4984: [HUDI-3583] Fix MarkerBasedRollbackStrategy NoSuchElementException

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4984: URL: https://github.com/apache/hudi/pull/4984#issuecomment-1061616431 ## CI report: * 015f7f0e07d3f0efbd8d3a728f802fc5572a8f52 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] xushiyan commented on pull request #4965: [MINOR] Make spark context transient to avoid serialization

2022-03-08 Thread GitBox
xushiyan commented on pull request #4965: URL: https://github.com/apache/hudi/pull/4965#issuecomment-1061616368 @boneanxs `HoodieEngineContext` itself is not serializable. In `HoodieTable` we also mark `HoodieEngineContext` transient. So I don't think the change is needed. Can you confirm

[GitHub] [hudi] hudi-bot commented on pull request #4984: [HUDI-3583] Fix MarkerBasedRollbackStrategy NoSuchElementException

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4984: URL: https://github.com/apache/hudi/pull/4984#issuecomment-1061613678 ## CI report: * 015f7f0e07d3f0efbd8d3a728f802fc5572a8f52 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[jira] [Updated] (HUDI-3583) MarkerBasedRollbackStrategy NoSuchElementException

2022-03-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3583: - Labels: pull-request-available (was: ) > MarkerBasedRollbackStrategy NoSuchElementException > --

[GitHub] [hudi] liujinhui1994 commented on pull request #4984: [HUDI-3583] Fix MarkerBasedRollbackStrategy NoSuchElementException

2022-03-08 Thread GitBox
liujinhui1994 commented on pull request #4984: URL: https://github.com/apache/hudi/pull/4984#issuecomment-1061611731 Caused by: java.util.NoSuchElementException: No value present in Option at org.apache.hudi.common.util.Option.get(Option.java:88) at org.apache.hudi.table.action.rollback.Ma

[GitHub] [hudi] liujinhui1994 opened a new pull request #4984: [HUDI-3583] Fix MarkerBasedRollbackStrategy NoSuchElementException

2022-03-08 Thread GitBox
liujinhui1994 opened a new pull request #4984: URL: https://github.com/apache/hudi/pull/4984 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the p

[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4982: URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061610766 ## CI report: * b93d81349a970391fe8baff27130a322a0af8516 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4982: URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061600652 ## CI report: * b93d81349a970391fe8baff27130a322a0af8516 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] huberylee commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable

2022-03-08 Thread GitBox
huberylee commented on pull request #4982: URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061608879 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Created] (HUDI-3583) MarkerBasedRollbackStrategy NoSuchElementException

2022-03-08 Thread liujinhui (Jira)
liujinhui created HUDI-3583: --- Summary: MarkerBasedRollbackStrategy NoSuchElementException Key: HUDI-3583 URL: https://issues.apache.org/jira/browse/HUDI-3583 Project: Apache Hudi Issue Type: Bug

[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4982: URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061530032 ## CI report: * b93d81349a970391fe8baff27130a322a0af8516 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4982: URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061600652 ## CI report: * b93d81349a970391fe8baff27130a322a0af8516 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4981: [HUDI-3559] fix flink Bucket Index with COW table type `NoSuchElementException` cause o…

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4981: URL: https://github.com/apache/hudi/pull/4981#issuecomment-1061600606 ## CI report: * de298d725f5ef3c9a37fb09f1881a816c0674847 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4981: [HUDI-3559] fix flink Bucket Index with COW table type `NoSuchElementException` cause o…

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4981: URL: https://github.com/apache/hudi/pull/4981#issuecomment-1061521177 ## CI report: * de298d725f5ef3c9a37fb09f1881a816c0674847 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1061593311 ## CI report: * 869a752768dabc9e9cdb7df6b725fba50dd502af UNKNOWN * 59e0270ef6aba60d4a80f2482ec3fa605cd01e1f Azure: [FAILURE](https://dev.azure.com/apache-hud

[GitHub] [hudi] hudi-bot commented on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1061597787 ## CI report: * 869a752768dabc9e9cdb7df6b725fba50dd502af UNKNOWN * 59e0270ef6aba60d4a80f2482ec3fa605cd01e1f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] hudi-bot commented on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1061593311 ## CI report: * 869a752768dabc9e9cdb7df6b725fba50dd502af UNKNOWN * 59e0270ef6aba60d4a80f2482ec3fa605cd01e1f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] hudi-bot removed a comment on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1061576317 ## CI report: * 869a752768dabc9e9cdb7df6b725fba50dd502af UNKNOWN * 59e0270ef6aba60d4a80f2482ec3fa605cd01e1f Azure: [FAILURE](https://dev.azure.com/apache-hud

[GitHub] [hudi] hudi-bot commented on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1061576317 ## CI report: * 869a752768dabc9e9cdb7df6b725fba50dd502af UNKNOWN * 59e0270ef6aba60d4a80f2482ec3fa605cd01e1f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] hudi-bot removed a comment on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1061573797 ## CI report: * 869a752768dabc9e9cdb7df6b725fba50dd502af UNKNOWN * 59e0270ef6aba60d4a80f2482ec3fa605cd01e1f Azure: [FAILURE](https://dev.azure.com/apache-hud

[GitHub] [hudi] hudi-bot commented on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1061573797 ## CI report: * 869a752768dabc9e9cdb7df6b725fba50dd502af UNKNOWN * 59e0270ef6aba60d4a80f2482ec3fa605cd01e1f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] hudi-bot removed a comment on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1060772423 ## CI report: * 869a752768dabc9e9cdb7df6b725fba50dd502af UNKNOWN * 59e0270ef6aba60d4a80f2482ec3fa605cd01e1f Azure: [FAILURE](https://dev.azure.com/apache-hud

[jira] [Updated] (HUDI-2439) Refactor table.action.commit package (CommitActionExecutors) in hudi-client module

2022-03-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2439: - Story Points: 0.5 (was: 3) > Refactor table.action.commit package (CommitActionExecutors) in hudi-client

[jira] [Updated] (HUDI-3582) Support record level index based on Apache Lucene to improve query/tagLocation performance

2022-03-08 Thread shibei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shibei updated HUDI-3582: - Description: Nowadays, record level index is mainly implemented for `tagLocation`, and queries do not benefit fro

[jira] [Updated] (HUDI-3582) Support record level index based on Apache Lucene to improve query/upsert performance

2022-03-08 Thread shibei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shibei updated HUDI-3582: - Description: Nowadays, record level index is mainly implemented for `tagLocation`, and queries do not benefit fro

[jira] [Updated] (HUDI-3582) Support record level index based on Apache Lucene to improve query/tagLocation performance

2022-03-08 Thread shibei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shibei updated HUDI-3582: - Summary: Support record level index based on Apache Lucene to improve query/tagLocation performance (was: Support

[hudi] branch master updated: [HUDI-3574] Improve maven module configs for different spark profiles (#4970)

2022-03-08 Thread xushiyan
This is an automated email from the ASF dual-hosted git repository. xushiyan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 2538580 [HUDI-3574] Improve maven module config

[GitHub] [hudi] xushiyan merged pull request #4970: [HUDI-3574] Improve maven module configs for different spark profiles

2022-03-08 Thread GitBox
xushiyan merged pull request #4970: URL: https://github.com/apache/hudi/pull/4970 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr

[GitHub] [hudi] xushiyan commented on a change in pull request #4970: [HUDI-3574] Improve maven module configs for different spark profiles

2022-03-08 Thread GitBox
xushiyan commented on a change in pull request #4970: URL: https://github.com/apache/hudi/pull/4970#discussion_r821453744 ## File path: pom.xml ## @@ -1581,10 +1581,23 @@ spark2 + +hudi-spark-datasource/hudi-spark2 +hudi-spark-datasource

[GitHub] [hudi] cuibo01 edited a comment on pull request #4699: [HUDI-3336][HUDI-FLINK] Support custom hadoop config options for flink

2022-03-08 Thread GitBox
cuibo01 edited a comment on pull request #4699: URL: https://github.com/apache/hudi/pull/4699#issuecomment-1046561212 > I think a little and we should hold for this patch, people usually do not pass hadoop config options through SQL options, can you describe again your use cases again, wha

[GitHub] [hudi] danny0405 commented on pull request #4874: [HUDI-3487] The global index is enabled regardless of changlog

2022-03-08 Thread GitBox
danny0405 commented on pull request #4874: URL: https://github.com/apache/hudi/pull/4874#issuecomment-1061545989 > > The changelog mode has retraction message itself, so no need to additional retraction for the deletions of different partition. > > The right solution for spark source is

[GitHub] [hudi] endgab commented on pull request #2485: [HUDI-1109] Support Spark Structured Streaming read from Hudi table

2022-03-08 Thread GitBox
endgab commented on pull request #2485: URL: https://github.com/apache/hudi/pull/2485#issuecomment-1061545712 Hello, I haven't found any official documentation about this feature. Is there any reason for that? Can you confirm that it is going to be maintained in the future? -- This is a

[jira] [Assigned] (HUDI-3582) Support record level index based on Apache Lucene to improve query/upsert performance

2022-03-08 Thread shibei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shibei reassigned HUDI-3582: Assignee: shibei > Support record level index based on Apache Lucene to improve query/upsert > performance

[jira] [Created] (HUDI-3582) Support record level index based on Apache Lucene to improve query/upsert performance

2022-03-08 Thread shibei (Jira)
shibei created HUDI-3582: Summary: Support record level index based on Apache Lucene to improve query/upsert performance Key: HUDI-3582 URL: https://issues.apache.org/jira/browse/HUDI-3582 Project: Apache Hud

[GitHub] [hudi] hudi-bot removed a comment on pull request #4972: [HUDI-3522] Introduce DropColumnSchemaPostProcessor to support drop columns from schema

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4972: URL: https://github.com/apache/hudi/pull/4972#issuecomment-1061419844 ## CI report: * 750e07438a19600c55d37e7107f88ba04416e218 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4983: [HUDI-3581] Reorganize some clazz for hudi flink

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4983: URL: https://github.com/apache/hudi/pull/4983#issuecomment-1061536791 ## CI report: * 8cfd58b8f1608326997ad5c07667837c39cbb9f2 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4983: [HUDI-3581] Reorganize some clazz for hudi flink

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4983: URL: https://github.com/apache/hudi/pull/4983#issuecomment-1061534575 ## CI report: * 8cfd58b8f1608326997ad5c07667837c39cbb9f2 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4972: [HUDI-3522] Introduce DropColumnSchemaPostProcessor to support drop columns from schema

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4972: URL: https://github.com/apache/hudi/pull/4972#issuecomment-1061536724 ## CI report: * 750e07438a19600c55d37e7107f88ba04416e218 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] parisni commented on pull request #4967: Fix default dynamodblock url default value

2022-03-08 Thread GitBox
parisni commented on pull request #4967: URL: https://github.com/apache/hudi/pull/4967#issuecomment-1061535592 @nsivabalan first ci run had an error on an unrelated test. the second run had a timeout. is that CI stable ? -- This is an automated message from the Apache Git Service. To re

[GitHub] [hudi] hudi-bot commented on pull request #4983: [HUDI-3581] Reorganize some clazz for hudi flink

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4983: URL: https://github.com/apache/hudi/pull/4983#issuecomment-1061534575 ## CI report: * 8cfd58b8f1608326997ad5c07667837c39cbb9f2 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[jira] (HUDI-3567) Refactor HoodieCommonUtils to make code more reasonable

2022-03-08 Thread shibei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3567 ] shibei deleted comment on HUDI-3567: -- was (Author: JIRAUSER279853): Resolved by https://issues.apache.org/jira/browse/HUDI-3538 > Refactor HoodieCommonUtils to make code more reasonable > ---

[jira] [Updated] (HUDI-3567) Refactor HoodieCommonUtils to make code more reasonable

2022-03-08 Thread shibei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shibei updated HUDI-3567: - Summary: Refactor HoodieCommonUtils to make code more reasonable (was: Refactor HoodieCommonUtils to group partit

[jira] [Updated] (HUDI-3355) Issue with out of order commits in the timeline when ingestion writers using SparkAllowUpdateStrategy

2022-03-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3355: - Status: In Progress (was: Open) > Issue with out of order commits in the timeline when ingestion writers

[jira] [Updated] (HUDI-3355) Issue with out of order commits in the timeline when ingestion writers using SparkAllowUpdateStrategy

2022-03-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3355: - Status: Patch Available (was: In Progress) > Issue with out of order commits in the timeline when ingesti

[jira] [Updated] (HUDI-3581) Reorganize some clazz for hudi flink

2022-03-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3581: - Labels: pull-request-available (was: ) > Reorganize some clazz for hudi flink > -

[GitHub] [hudi] danny0405 opened a new pull request #4983: [HUDI-3581] Reorganize some clazz for hudi flink

2022-03-08 Thread GitBox
danny0405 opened a new pull request #4983: URL: https://github.com/apache/hudi/pull/4983 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpo

[jira] [Created] (HUDI-3581) Reorganize some clazz for hudi flink

2022-03-08 Thread Danny Chen (Jira)
Danny Chen created HUDI-3581: Summary: Reorganize some clazz for hudi flink Key: HUDI-3581 URL: https://issues.apache.org/jira/browse/HUDI-3581 Project: Apache Hudi Issue Type: Task Com

[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4982: URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061527790 ## CI report: * b93d81349a970391fe8baff27130a322a0af8516 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] pratyakshsharma commented on pull request #2210: [HUDI-1348] Provide option to clean up DFS sources

2022-03-08 Thread GitBox
pratyakshsharma commented on pull request #2210: URL: https://github.com/apache/hudi/pull/2210#issuecomment-1061530216 @hotienvu still working on this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4982: URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061530032 ## CI report: * b93d81349a970391fe8baff27130a322a0af8516 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4982: URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061527790 ## CI report: * b93d81349a970391fe8baff27130a322a0af8516 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] huberylee commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable

2022-03-08 Thread GitBox
huberylee commented on pull request #4982: URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061526962 @alexeykudinkin Could you help me to review this pr? Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Updated] (HUDI-3567) Refactor HoodieCommonUtils to group partition pruning methods

2022-03-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3567: - Labels: pull-request-available (was: ) > Refactor HoodieCommonUtils to group partition pruning me

[GitHub] [hudi] huberylee opened a new pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable

2022-03-08 Thread GitBox
huberylee opened a new pull request #4982: URL: https://github.com/apache/hudi/pull/4982 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpo

[GitHub] [hudi] hudi-bot commented on pull request #4981: [HUDI-3559] fix Bucket Index with COW table type `NoSuchElementException` cause o…

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4981: URL: https://github.com/apache/hudi/pull/4981#issuecomment-1061521177 ## CI report: * de298d725f5ef3c9a37fb09f1881a816c0674847 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4981: [HUDI-3559] fix Bucket Index with COW table type `NoSuchElementException` cause o…

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4981: URL: https://github.com/apache/hudi/pull/4981#issuecomment-1061518987 ## CI report: * de298d725f5ef3c9a37fb09f1881a816c0674847 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4981: [HUDI-3559] fix Bucket Index with COW table type `NoSuchElementException` cause o…

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4981: URL: https://github.com/apache/hudi/pull/4981#issuecomment-1061518987 ## CI report: * de298d725f5ef3c9a37fb09f1881a816c0674847 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[jira] [Updated] (HUDI-3559) NoSuchElementException when use BUCKET index in flink cow table

2022-03-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3559: - Labels: pull-request-available (was: ) > NoSuchElementException when use BUCKET index in flink co

[GitHub] [hudi] wxplovecc opened a new pull request #4981: [HUDI-3559] fix Bucket Index with COW table type `NoSuchElementException` cause o…

2022-03-08 Thread GitBox
wxplovecc opened a new pull request #4981: URL: https://github.com/apache/hudi/pull/4981 …f deduplicateRecords method in FlinkWriteHelper out of order ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-co

[GitHub] [hudi] hudi-bot commented on pull request #4958: [HUDI-3558] [Stacked 3123/3085] Consistent bucket index: bucket resizing (split&merge) & concurrent write during resizing

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4958: URL: https://github.com/apache/hudi/pull/4958#issuecomment-1061506013 ## CI report: * 7bf1ce3392b26c8a8ea6b414a289acec2fccfa6e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4958: [HUDI-3558] [Stacked 3123/3085] Consistent bucket index: bucket resizing (split&merge) & concurrent write during resizing

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4958: URL: https://github.com/apache/hudi/pull/4958#issuecomment-1061410462 ## CI report: * 7bf1ce3392b26c8a8ea6b414a289acec2fccfa6e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

<    1   2   3   4   5