[GitHub] [hudi] hudi-bot commented on pull request #3700: [HUDI-2471] Add support ignoring case in merge into
hudi-bot commented on pull request #3700: URL: https://github.com/apache/hudi/pull/3700#issuecomment-961665321 ## CI report: * f4c30a0554777e8c871d1aeee0ede783e709c6ee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3041) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3098) * 4e731b26c908b5f16948e07ecbdf7c92a84abc5b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3157) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3700: [HUDI-2471] Add support ignoring case in merge into
hudi-bot removed a comment on pull request #3700: URL: https://github.com/apache/hudi/pull/3700#issuecomment-961664386 ## CI report: * f4c30a0554777e8c871d1aeee0ede783e709c6ee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3041) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3098) * 4e731b26c908b5f16948e07ecbdf7c92a84abc5b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3700: [HUDI-2471] Add support ignoring case in merge into
hudi-bot removed a comment on pull request #3700: URL: https://github.com/apache/hudi/pull/3700#issuecomment-961588453 ## CI report: * f4c30a0554777e8c871d1aeee0ede783e709c6ee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3041) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3098) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3926: [HUDI-2696] Remove the aborted checkpoint notification from coordinator
hudi-bot removed a comment on pull request #3926: URL: https://github.com/apache/hudi/pull/3926#issuecomment-961646086 ## CI report: * 0caf196337cef27a398dfcb284666d1d46464790 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3154) * 2d37665871e2af710a830aae6d7c933752c14bbe UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3926: [HUDI-2696] Remove the aborted checkpoint notification from coordinator
hudi-bot commented on pull request #3926: URL: https://github.com/apache/hudi/pull/3926#issuecomment-961664530 ## CI report: * 0caf196337cef27a398dfcb284666d1d46464790 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3154) * 2d37665871e2af710a830aae6d7c933752c14bbe Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3156) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3700: [HUDI-2471] Add support ignoring case in merge into
hudi-bot commented on pull request #3700: URL: https://github.com/apache/hudi/pull/3700#issuecomment-961664386 ## CI report: * f4c30a0554777e8c871d1aeee0ede783e709c6ee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3041) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3098) * 4e731b26c908b5f16948e07ecbdf7c92a84abc5b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (HUDI-2686) Proccess record after all bootstrap operator ready
[ https://issues.apache.org/jira/browse/HUDI-2686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-2686: - Component/s: Flink Integration Issue Type: Bug (was: New Feature) > Proccess record after all bootstrap operator ready > -- > > Key: HUDI-2686 > URL: https://issues.apache.org/jira/browse/HUDI-2686 > Project: Apache Hudi > Issue Type: Bug > Components: Flink Integration >Reporter: yuzhaojing >Assignee: yuzhaojing >Priority: Major > Labels: pull-request-available > Fix For: 0.10.0 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-2686) Proccess record after all bootstrap operator ready
[ https://issues.apache.org/jira/browse/HUDI-2686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-2686: - Affects Version/s: 0.9.0 > Proccess record after all bootstrap operator ready > -- > > Key: HUDI-2686 > URL: https://issues.apache.org/jira/browse/HUDI-2686 > Project: Apache Hudi > Issue Type: Bug > Components: Flink Integration >Affects Versions: 0.9.0 >Reporter: yuzhaojing >Assignee: yuzhaojing >Priority: Major > Labels: pull-request-available > Fix For: 0.10.0 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[hudi] branch master updated (2c1e259 -> f67da0c)
This is an automated email from the ASF dual-hosted git repository.
danny0405 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git.
from 2c1e259 [HUDI-2651] Sync all the missing sql options for
HoodieFlinkStreamer (#3903)
add f67da0c [HUDI-2686] Proccess record after all bootstrap operator
ready (#3925)
No new revisions were added by this update.
Summary of changes:
.../hudi/sink/bootstrap/BootstrapOperator.java | 29 -
.../aggregate/BootstrapAccumulator.java} | 35 ---
.../bootstrap/aggregate/BootstrapAggFunction.java | 50 ++
.../bootstrap/batch/BatchBootstrapOperator.java| 4 +-
4 files changed, 99 insertions(+), 19 deletions(-)
copy hudi-flink/src/main/java/org/apache/hudi/sink/{event/CommitAckEvent.java
=> bootstrap/aggregate/BootstrapAccumulator.java} (56%)
create mode 100644
hudi-flink/src/main/java/org/apache/hudi/sink/bootstrap/aggregate/BootstrapAggFunction.java
[jira] [Updated] (HUDI-2686) Proccess record after all bootstrap operator ready
[ https://issues.apache.org/jira/browse/HUDI-2686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-2686: - Fix Version/s: 0.10.0 > Proccess record after all bootstrap operator ready > -- > > Key: HUDI-2686 > URL: https://issues.apache.org/jira/browse/HUDI-2686 > Project: Apache Hudi > Issue Type: New Feature >Reporter: yuzhaojing >Assignee: yuzhaojing >Priority: Major > Labels: pull-request-available > Fix For: 0.10.0 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (HUDI-2686) Proccess record after all bootstrap operator ready
[ https://issues.apache.org/jira/browse/HUDI-2686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-2686. -- Resolution: Fixed Fixed via master branch: f67da0c7d0831db0b4eba7111c634eb50eaec760 > Proccess record after all bootstrap operator ready > -- > > Key: HUDI-2686 > URL: https://issues.apache.org/jira/browse/HUDI-2686 > Project: Apache Hudi > Issue Type: New Feature >Reporter: yuzhaojing >Assignee: yuzhaojing >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hudi] danny0405 merged pull request #3925: [HUDI-2686] Proccess record after all bootstrap operator ready
danny0405 merged pull request #3925: URL: https://github.com/apache/hudi/pull/3925 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3925: [HUDI-2686] Proccess record after all bootstrap operator ready
hudi-bot commented on pull request #3925: URL: https://github.com/apache/hudi/pull/3925#issuecomment-961656737 ## CI report: * 8855481c959a20fce97c65da178a0f4804022335 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3153) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3925: [HUDI-2686] Proccess record after all bootstrap operator ready
hudi-bot removed a comment on pull request #3925: URL: https://github.com/apache/hudi/pull/3925#issuecomment-961640904 ## CI report: * 9b4b2b092927491148cc32379694c83680e2343e Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3149) * 8855481c959a20fce97c65da178a0f4804022335 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3153) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Comment Edited] (HUDI-2687) [UMBRELLA] A new Trino connector for Hudi
[ https://issues.apache.org/jira/browse/HUDI-2687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17439052#comment-17439052 ] zhoukang edited comment on HUDI-2687 at 11/5/21, 6:18 AM: -- [Hudi Connector · Issue #9877 · trinodb/trino (github.com)|https://github.com/trinodb/trino/issues/9877] i am caneGuy of this issue. great [~codope] i would like to participate in this work was (Author: caneguy): great [~codope] i would like to participate in this work > [UMBRELLA] A new Trino connector for Hudi > - > > Key: HUDI-2687 > URL: https://issues.apache.org/jira/browse/HUDI-2687 > Project: Apache Hudi > Issue Type: New Feature > Components: trino >Reporter: Sagar Sumit >Assignee: Sagar Sumit >Priority: Major > Attachments: image-2021-11-05-14-16-57-324.png, > image-2021-11-05-14-17-03-211.png > > > This JIRA tracks all the tasks related to building a new Hudi connector in > Trino. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-2687) [UMBRELLA] A new Trino connector for Hudi
[ https://issues.apache.org/jira/browse/HUDI-2687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated HUDI-2687: --- Attachment: image-2021-11-05-14-17-03-211.png > [UMBRELLA] A new Trino connector for Hudi > - > > Key: HUDI-2687 > URL: https://issues.apache.org/jira/browse/HUDI-2687 > Project: Apache Hudi > Issue Type: New Feature > Components: trino >Reporter: Sagar Sumit >Assignee: Sagar Sumit >Priority: Major > Attachments: image-2021-11-05-14-16-57-324.png, > image-2021-11-05-14-17-03-211.png > > > This JIRA tracks all the tasks related to building a new Hudi connector in > Trino. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HUDI-2687) [UMBRELLA] A new Trino connector for Hudi
[ https://issues.apache.org/jira/browse/HUDI-2687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17439052#comment-17439052 ] zhoukang commented on HUDI-2687: great [~codope] i would like to participate in this work > [UMBRELLA] A new Trino connector for Hudi > - > > Key: HUDI-2687 > URL: https://issues.apache.org/jira/browse/HUDI-2687 > Project: Apache Hudi > Issue Type: New Feature > Components: trino >Reporter: Sagar Sumit >Assignee: Sagar Sumit >Priority: Major > Attachments: image-2021-11-05-14-16-57-324.png, > image-2021-11-05-14-17-03-211.png > > > This JIRA tracks all the tasks related to building a new Hudi connector in > Trino. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-2687) [UMBRELLA] A new Trino connector for Hudi
[ https://issues.apache.org/jira/browse/HUDI-2687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated HUDI-2687: --- Attachment: image-2021-11-05-14-16-57-324.png > [UMBRELLA] A new Trino connector for Hudi > - > > Key: HUDI-2687 > URL: https://issues.apache.org/jira/browse/HUDI-2687 > Project: Apache Hudi > Issue Type: New Feature > Components: trino >Reporter: Sagar Sumit >Assignee: Sagar Sumit >Priority: Major > Attachments: image-2021-11-05-14-16-57-324.png > > > This JIRA tracks all the tasks related to building a new Hudi connector in > Trino. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hudi] xushiyan commented on pull request #3359: [HUDI-2242] Add configuration inference logic for few options
xushiyan commented on pull request #3359: URL: https://github.com/apache/hudi/pull/3359#issuecomment-961651407 @zhedoubushishi please try also rebase to get the CI job re-ran. thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] xushiyan commented on a change in pull request #3359: [HUDI-2242] Add configuration inference logic for few options
xushiyan commented on a change in pull request #3359:
URL: https://github.com/apache/hudi/pull/3359#discussion_r743404551
##
File path:
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieLockConfig.java
##
@@ -160,9 +161,17 @@
public static final ConfigProperty ZK_LOCK_KEY = ConfigProperty
.key(ZK_LOCK_KEY_PROP_KEY)
.noDefaultValue()
+ .withInferFunction(p -> {
+if (p.contains(HoodieWriteConfig.TBL_NAME)) {
+ return Option.of(p.getString(HoodieWriteConfig.TBL_NAME));
+} else {
+ return Option.empty();
Review comment:
can do 1-liner here `Option.ofNullable(props.getStringOrDefault(, null)`
##
File path:
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala
##
@@ -273,8 +278,26 @@ object DataSourceWriteOptions {
*/
val HIVE_STYLE_PARTITIONING =
KeyGeneratorOptions.HIVE_STYLE_PARTITIONING_ENABLE
- val KEYGENERATOR_CLASS_NAME =
ConfigProperty.key("hoodie.datasource.write.keygenerator.class")
+ /**
+* Key generator class, that implements will extract the key out of
incoming record
+*
+*/
+ val keyGeneraterInferFunc =
DataSourceOptionsHelper.scalaFunctionToJavaFunction((p: HoodieConfig) => {
+if (!p.contains(PARTITIONPATH_FIELD)) {
+ Option.of(classOf[NonpartitionedKeyGenerator].getName)
+} else {
+ val numOfPartFields = p.getString(PARTITIONPATH_FIELD).split(",").length
+ if (numOfPartFields == 1) {
+Option.of(classOf[SimpleKeyGenerator].getName)
+ } else {
+Option.of(classOf[ComplexKeyGenerator].getName)
+ }
+}
+ })
+ val KEYGENERATOR_CLASS_NAME: ConfigProperty[String] = ConfigProperty
+.key("hoodie.datasource.write.keygenerator.class")
.defaultValue(classOf[SimpleKeyGenerator].getName)
+.withInferFunction(keyGeneraterInferFunc)
Review comment:
shall we overload `withInferFunction()` to take in scala func too? then
no need to convert every time
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3519: [DO NOT MERGE] 0.9.0 release patch for flink
hudi-bot removed a comment on pull request #3519: URL: https://github.com/apache/hudi/pull/3519#issuecomment-961644368 ## CI report: * d022aa7a5bd94492c7c3e96dc5b1288268520087 UNKNOWN * ba6a7000bdde9fa7a786a93912aa9cda05e00d21 UNKNOWN * f5c958e7e1977de5478ee8e2f0c7e6624ee6fcff Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3151) * 91bf1c886d6bf879072ee635b5d509407ce4a6af UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3519: [DO NOT MERGE] 0.9.0 release patch for flink
hudi-bot commented on pull request #3519: URL: https://github.com/apache/hudi/pull/3519#issuecomment-961647664 ## CI report: * d022aa7a5bd94492c7c3e96dc5b1288268520087 UNKNOWN * ba6a7000bdde9fa7a786a93912aa9cda05e00d21 UNKNOWN * 91bf1c886d6bf879072ee635b5d509407ce4a6af Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3155) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3926: [HUDI-2696] Remove the aborted checkpoint notification from coordinator
hudi-bot commented on pull request #3926: URL: https://github.com/apache/hudi/pull/3926#issuecomment-961646086 ## CI report: * 0caf196337cef27a398dfcb284666d1d46464790 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3154) * 2d37665871e2af710a830aae6d7c933752c14bbe UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3926: [HUDI-2696] Remove the aborted checkpoint notification from coordinator
hudi-bot removed a comment on pull request #3926: URL: https://github.com/apache/hudi/pull/3926#issuecomment-961645286 ## CI report: * 86326a094758f8ea3fa7e93c068f5e93f8689485 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3150) * 0caf196337cef27a398dfcb284666d1d46464790 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3154) * 2d37665871e2af710a830aae6d7c933752c14bbe UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3926: [HUDI-2696] Remove the aborted checkpoint notification from coordinator
hudi-bot removed a comment on pull request #3926: URL: https://github.com/apache/hudi/pull/3926#issuecomment-961643753 ## CI report: * 86326a094758f8ea3fa7e93c068f5e93f8689485 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3150) * 0caf196337cef27a398dfcb284666d1d46464790 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3154) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3926: [HUDI-2696] Remove the aborted checkpoint notification from coordinator
hudi-bot commented on pull request #3926: URL: https://github.com/apache/hudi/pull/3926#issuecomment-961645286 ## CI report: * 86326a094758f8ea3fa7e93c068f5e93f8689485 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3150) * 0caf196337cef27a398dfcb284666d1d46464790 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3154) * 2d37665871e2af710a830aae6d7c933752c14bbe UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3519: [DO NOT MERGE] 0.9.0 release patch for flink
hudi-bot commented on pull request #3519: URL: https://github.com/apache/hudi/pull/3519#issuecomment-961644368 ## CI report: * d022aa7a5bd94492c7c3e96dc5b1288268520087 UNKNOWN * ba6a7000bdde9fa7a786a93912aa9cda05e00d21 UNKNOWN * f5c958e7e1977de5478ee8e2f0c7e6624ee6fcff Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3151) * 91bf1c886d6bf879072ee635b5d509407ce4a6af UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3519: [DO NOT MERGE] 0.9.0 release patch for flink
hudi-bot removed a comment on pull request #3519: URL: https://github.com/apache/hudi/pull/3519#issuecomment-961628626 ## CI report: * d022aa7a5bd94492c7c3e96dc5b1288268520087 UNKNOWN * ba6a7000bdde9fa7a786a93912aa9cda05e00d21 UNKNOWN * f5c958e7e1977de5478ee8e2f0c7e6624ee6fcff Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3151) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3926: [HUDI-2696] Remove the aborted checkpoint notification from coordinator
hudi-bot removed a comment on pull request #3926: URL: https://github.com/apache/hudi/pull/3926#issuecomment-961643092 ## CI report: * 86326a094758f8ea3fa7e93c068f5e93f8689485 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3150) * 0caf196337cef27a398dfcb284666d1d46464790 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3926: [HUDI-2696] Remove the aborted checkpoint notification from coordinator
hudi-bot commented on pull request #3926: URL: https://github.com/apache/hudi/pull/3926#issuecomment-961643753 ## CI report: * 86326a094758f8ea3fa7e93c068f5e93f8689485 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3150) * 0caf196337cef27a398dfcb284666d1d46464790 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3154) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3926: [HUDI-2696] Remove the aborted checkpoint notification from coordinator
hudi-bot commented on pull request #3926: URL: https://github.com/apache/hudi/pull/3926#issuecomment-961643092 ## CI report: * 86326a094758f8ea3fa7e93c068f5e93f8689485 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3150) * 0caf196337cef27a398dfcb284666d1d46464790 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3926: [HUDI-2696] Remove the aborted checkpoint notification from coordinator
hudi-bot removed a comment on pull request #3926: URL: https://github.com/apache/hudi/pull/3926#issuecomment-961631125 ## CI report: * 86326a094758f8ea3fa7e93c068f5e93f8689485 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3150) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3925: [HUDI-2686] Proccess record after all bootstrap operator ready
hudi-bot removed a comment on pull request #3925: URL: https://github.com/apache/hudi/pull/3925#issuecomment-961640167 ## CI report: * 9b4b2b092927491148cc32379694c83680e2343e Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3149) * 8855481c959a20fce97c65da178a0f4804022335 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3925: [HUDI-2686] Proccess record after all bootstrap operator ready
hudi-bot commented on pull request #3925: URL: https://github.com/apache/hudi/pull/3925#issuecomment-961640904 ## CI report: * 9b4b2b092927491148cc32379694c83680e2343e Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3149) * 8855481c959a20fce97c65da178a0f4804022335 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3153) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3925: [HUDI-2686] Proccess record after all bootstrap operator ready
hudi-bot commented on pull request #3925: URL: https://github.com/apache/hudi/pull/3925#issuecomment-961640167 ## CI report: * 9b4b2b092927491148cc32379694c83680e2343e Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3149) * 8855481c959a20fce97c65da178a0f4804022335 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3925: [HUDI-2686] Proccess record after all bootstrap operator ready
hudi-bot removed a comment on pull request #3925: URL: https://github.com/apache/hudi/pull/3925#issuecomment-961624106 ## CI report: * 9b4b2b092927491148cc32379694c83680e2343e Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3149) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3926: [HUDI-2696] Remove the aborted checkpoint notification from coordinator
hudi-bot removed a comment on pull request #3926: URL: https://github.com/apache/hudi/pull/3926#issuecomment-961613057 ## CI report: * 86326a094758f8ea3fa7e93c068f5e93f8689485 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3150) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3926: [HUDI-2696] Remove the aborted checkpoint notification from coordinator
hudi-bot commented on pull request #3926: URL: https://github.com/apache/hudi/pull/3926#issuecomment-961631125 ## CI report: * 86326a094758f8ea3fa7e93c068f5e93f8689485 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3150) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3519: [DO NOT MERGE] 0.9.0 release patch for flink
hudi-bot commented on pull request #3519: URL: https://github.com/apache/hudi/pull/3519#issuecomment-961628626 ## CI report: * d022aa7a5bd94492c7c3e96dc5b1288268520087 UNKNOWN * ba6a7000bdde9fa7a786a93912aa9cda05e00d21 UNKNOWN * f5c958e7e1977de5478ee8e2f0c7e6624ee6fcff Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3151) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3519: [DO NOT MERGE] 0.9.0 release patch for flink
hudi-bot removed a comment on pull request #3519: URL: https://github.com/apache/hudi/pull/3519#issuecomment-961621243 ## CI report: * d022aa7a5bd94492c7c3e96dc5b1288268520087 UNKNOWN * a654fcd138e63ccd728ad5fa0237563742b392fe Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3096) * ba6a7000bdde9fa7a786a93912aa9cda05e00d21 UNKNOWN * f5c958e7e1977de5478ee8e2f0c7e6624ee6fcff UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] nsivabalan commented on issue #2802: Hive read issues when different partition have different schemas.
nsivabalan commented on issue #2802: URL: https://github.com/apache/hudi/issues/2802#issuecomment-961627203 @codope : related to schema evolution. I remember you tried a similar usecase, testing out updating few partitions w/ a new filed added. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] nsivabalan commented on issue #2934: [SUPPORT] Parquet file does not exist when trying to read hudi table incrementally
nsivabalan commented on issue #2934: URL: https://github.com/apache/hudi/issues/2934#issuecomment-961626438 @jsbali / @t0il3ts0ap : Did either of you folks got a chance to upstream your changes. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3925: [HUDI-2686] Proccess record after all bootstrap operator ready
hudi-bot removed a comment on pull request #3925: URL: https://github.com/apache/hudi/pull/3925#issuecomment-961608104 ## CI report: * 9b4b2b092927491148cc32379694c83680e2343e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3149) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3925: [HUDI-2686] Proccess record after all bootstrap operator ready
hudi-bot commented on pull request #3925: URL: https://github.com/apache/hudi/pull/3925#issuecomment-961624106 ## CI report: * 9b4b2b092927491148cc32379694c83680e2343e Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3149) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] nsivabalan commented on issue #3418: [SUPPORT] Hudi Upsert Very Slow/ Failed With No Space Left on Device
nsivabalan commented on issue #3418: URL: https://github.com/apache/hudi/issues/3418#issuecomment-961622944 @FeiZou : if you are still having the issue, can you provide us with reproducible steps. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3820: [HUDI-2579] Make deltastreamer checkpoint state merging more explicit
nsivabalan commented on pull request #3820: URL: https://github.com/apache/hudi/pull/3820#issuecomment-961621624 @n3nash : Is there any other purpose to the old way of copying commit metadata apart from copying over checkpoints? We can add the old config as an alternative to new one added. but old one is somewhat generic to copy any matching entries, where as with new config, we explicitly just copy over only the delta streamer checkpoint entry. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3519: [DO NOT MERGE] 0.9.0 release patch for flink
hudi-bot commented on pull request #3519: URL: https://github.com/apache/hudi/pull/3519#issuecomment-961621243 ## CI report: * d022aa7a5bd94492c7c3e96dc5b1288268520087 UNKNOWN * a654fcd138e63ccd728ad5fa0237563742b392fe Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3096) * ba6a7000bdde9fa7a786a93912aa9cda05e00d21 UNKNOWN * f5c958e7e1977de5478ee8e2f0c7e6624ee6fcff UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3519: [DO NOT MERGE] 0.9.0 release patch for flink
hudi-bot removed a comment on pull request #3519: URL: https://github.com/apache/hudi/pull/3519#issuecomment-961619765 ## CI report: * d022aa7a5bd94492c7c3e96dc5b1288268520087 UNKNOWN * a654fcd138e63ccd728ad5fa0237563742b392fe Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3096) * ba6a7000bdde9fa7a786a93912aa9cda05e00d21 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] nsivabalan commented on issue #3603: [SUPPORT] delta streamer Failed to archive commits
nsivabalan commented on issue #3603: URL: https://github.com/apache/hudi/issues/3603#issuecomment-961620056 @fengjian428 : hey, is there any updates for us. We can try to reproduce if you are stuck with the issue. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3519: [DO NOT MERGE] 0.9.0 release patch for flink
hudi-bot commented on pull request #3519: URL: https://github.com/apache/hudi/pull/3519#issuecomment-961619765 ## CI report: * d022aa7a5bd94492c7c3e96dc5b1288268520087 UNKNOWN * a654fcd138e63ccd728ad5fa0237563742b392fe Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3096) * ba6a7000bdde9fa7a786a93912aa9cda05e00d21 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3519: [DO NOT MERGE] 0.9.0 release patch for flink
hudi-bot removed a comment on pull request #3519: URL: https://github.com/apache/hudi/pull/3519#issuecomment-961589667 ## CI report: * d022aa7a5bd94492c7c3e96dc5b1288268520087 UNKNOWN * a654fcd138e63ccd728ad5fa0237563742b392fe Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3096) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] n3nash commented on pull request #3820: [HUDI-2579] Make deltastreamer checkpoint state merging more explicit
n3nash commented on pull request #3820: URL: https://github.com/apache/hudi/pull/3820#issuecomment-961618542 @jsbali This may affect use cases at Uber, FYI -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] nsivabalan commented on issue #3828: [SUPPORT]Add a fetch table and partition valid file and return List[FileStatus]
nsivabalan commented on issue #3828: URL: https://github.com/apache/hudi/issues/3828#issuecomment-961617614 yes, Metadata table does provide this. Curious to know whats the use-case here. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] nsivabalan commented on issue #3834: [SUPPORT] - AWS Athena snapshot query fails if there are two or more record array fields in a MoR table
nsivabalan commented on issue #3834: URL: https://github.com/apache/hudi/issues/3834#issuecomment-961617240 CC @codope -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Resolved] (HUDI-2651) Sync all the missing sql options for HoodieFlinkStreamer
[ https://issues.apache.org/jira/browse/HUDI-2651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-2651. -- Resolution: Fixed Fixed via master branch: 2c1e25932996cbf47c7cd56d944d1d9103f01c34 > Sync all the missing sql options for HoodieFlinkStreamer > > > Key: HUDI-2651 > URL: https://issues.apache.org/jira/browse/HUDI-2651 > Project: Apache Hudi > Issue Type: Task > Components: Flink Integration >Reporter: Danny Chen >Assignee: yuzhaojing >Priority: Major > Labels: pull-request-available > Fix For: 0.10.0 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[hudi] branch master updated (33436aa -> 2c1e259)
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 33436aa Revert "[HUDI-2677] Add DFS based message queue for flink writer (#3915)" (#3923) add 2c1e259 [HUDI-2651] Sync all the missing sql options for HoodieFlinkStreamer (#3903) No new revisions were added by this update. Summary of changes: .../apache/hudi/streamer/FlinkStreamerConfig.java | 43 +++--- 1 file changed, 38 insertions(+), 5 deletions(-)
[GitHub] [hudi] danny0405 merged pull request #3903: [HUDI-2651] Sync all the missing sql options for HoodieFlinkStreamer
danny0405 merged pull request #3903: URL: https://github.com/apache/hudi/pull/3903 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] danny0405 commented on pull request #3903: [HUDI-2651] Sync all the missing sql options for HoodieFlinkStreamer
danny0405 commented on pull request #3903: URL: https://github.com/apache/hudi/pull/3903#issuecomment-961615589 The failure has nothing to do with flink so i would just merge it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] nsivabalan commented on issue #3841: Schema evolution improvement in 0.9.0 brakes existing applications
nsivabalan commented on issue #3841: URL: https://github.com/apache/hudi/issues/3841#issuecomment-961615364 @xushiyan : looks like another ask for parquet upgrade -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] danny0405 commented on a change in pull request #3925: [HUDI-2686] Proccess record after all bootstrap operator ready
danny0405 commented on a change in pull request #3925:
URL: https://github.com/apache/hudi/pull/3925#discussion_r743379016
##
File path:
hudi-flink/src/main/java/org/apache/hudi/sink/bootstrap/aggregate/BootstrapAggFunction.java
##
@@ -0,0 +1,50 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.sink.bootstrap.aggregate;
+
+import org.apache.flink.api.common.functions.AggregateFunction;
+
+/**
+ * Aggregate Function that accumulates the loaded task number of
+ * function {@link org.apache.hudi.sink.bootstrap.BootstrapOperator}.
+ */
Review comment:
Aggregate function
##
File path:
hudi-flink/src/main/java/org/apache/hudi/sink/bootstrap/BootstrapOperator.java
##
@@ -135,6 +141,27 @@ protected void preLoadIndexRecords() throws Exception {
}
LOG.info("Finish sending index records, taskId = {}.",
getRuntimeContext().getIndexOfThisSubtask());
+
+// wait for others bootstrap task send bootstrap complete.
+waitForBootstrapReady(getRuntimeContext().getIndexOfThisSubtask());
Review comment:
wait for the other bootstrap tasks finish bootstrapping.
##
File path:
hudi-flink/src/main/java/org/apache/hudi/sink/bootstrap/BootstrapOperator.java
##
@@ -83,6 +86,8 @@
protected transient org.apache.hadoop.conf.Configuration hadoopConf;
protected transient HoodieWriteConfig writeConfig;
+ private GlobalAggregateManager aggregateManager;
+
Review comment:
transient
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3614: [HUDI-2370] Supports data encryption
hudi-bot removed a comment on pull request #3614: URL: https://github.com/apache/hudi/pull/3614#issuecomment-961598212 ## CI report: * c646ab982ea9137bc84c53c8195dabc1833a34ea Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3134) * f8efb1f54c2818f101db8ad90a4bc917a8035362 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3148) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3614: [HUDI-2370] Supports data encryption
hudi-bot commented on pull request #3614: URL: https://github.com/apache/hudi/pull/3614#issuecomment-961614619 ## CI report: * f8efb1f54c2818f101db8ad90a4bc917a8035362 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3148) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3926: [HUDI-2696] Remove the aborted checkpoint notification from coordinator
hudi-bot commented on pull request #3926: URL: https://github.com/apache/hudi/pull/3926#issuecomment-961613057 ## CI report: * 86326a094758f8ea3fa7e93c068f5e93f8689485 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3150) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3926: [HUDI-2696] Remove the aborted checkpoint notification from coordinator
hudi-bot removed a comment on pull request #3926: URL: https://github.com/apache/hudi/pull/3926#issuecomment-961612104 ## CI report: * 86326a094758f8ea3fa7e93c068f5e93f8689485 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3926: [HUDI-2696] Remove the aborted checkpoint notification from coordinator
hudi-bot commented on pull request #3926: URL: https://github.com/apache/hudi/pull/3926#issuecomment-961612104 ## CI report: * 86326a094758f8ea3fa7e93c068f5e93f8689485 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] nsivabalan commented on issue #3892: Insert produces 44764 files with ~50MB each
nsivabalan commented on issue #3892: URL: https://github.com/apache/hudi/issues/3892#issuecomment-961611978 Let me know if you are looking for more pointers. Or can we close out the issue. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (HUDI-2696) Remove the aborted checkpoint notification from coordinator
[ https://issues.apache.org/jira/browse/HUDI-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2696: - Labels: pull-request-available (was: ) > Remove the aborted checkpoint notification from coordinator > --- > > Key: HUDI-2696 > URL: https://issues.apache.org/jira/browse/HUDI-2696 > Project: Apache Hudi > Issue Type: Improvement > Components: Flink Integration >Reporter: Danny Chen >Assignee: Danny Chen >Priority: Major > Labels: pull-request-available > Fix For: 0.10.0 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hudi] danny0405 opened a new pull request #3926: [HUDI-2696] Remove the aborted checkpoint notification from coordinator
danny0405 opened a new pull request #3926: URL: https://github.com/apache/hudi/pull/3926 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpose of the pull request *(For example: This pull request adds quick-start document.)* ## Brief change log *(for example:)* - *Modify AnnotationLocation checkstyle rule in checkstyle.xml* ## Verify this pull request *(Please pick either of the following options)* This pull request is a trivial rework / code cleanup without any test coverage. *(or)* This pull request is already covered by existing tests, such as *(please describe tests)*. (or) This change added tests and can be verified as follows: *(example:)* - *Added integration tests for end-to-end.* - *Added HoodieClientWriteTest to verify the change.* - *Manually verified the change by running a job locally.* ## Committer checklist - [ ] Has a corresponding JIRA in PR title & commit - [ ] Commit message is descriptive of the change - [ ] CI is green - [ ] Necessary doc changes done or have another open PR - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] xushiyan commented on a change in pull request #3700: [HUDI-2471] Add support ignoring case in merge into
xushiyan commented on a change in pull request #3700:
URL: https://github.com/apache/hudi/pull/3700#discussion_r743377022
##
File path:
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/TestMergeIntoTable2.scala
##
@@ -444,4 +444,115 @@ class TestMergeIntoTable2 extends TestHoodieSqlBase {
}
}
+ test("Test ignoring case") {
+withTempDir { tmp =>
+ val tableName = generateTableName
+ // Create table
+ spark.sql(
+s"""
+ |create table $tableName (
+ | ID int,
+ | NAME string,
+ | PRICE double,
+ | TS long,
+ | DT string
+ |) using hudi
+ | location '${tmp.getCanonicalPath}/$tableName'
+ | options (
+ | primaryKey ='ID',
+ | preCombineField = 'TS'
+ | )
+ """.stripMargin)
+
+ // First merge with a extra input field 'flag' (insert a new record)
+ spark.sql(
+s"""
+ | merge into $tableName
+ | using (
+ | select 1 as id, 'a1' as name, 10 as price, 1000 as ts,
'2021-05-05' as dt, '1' as flag
+ | ) s0
+ | on s0.id = $tableName.id
+ | when matched and flag = '1' then update set
+ | id = s0.id, name = s0.name, price = s0.price, ts = s0.ts, dt =
s0.dt
+ | when not matched and flag = '1' then insert *
+ """.stripMargin)
+ checkAnswer(s"select id, name, price, ts, dt from $tableName")(
+Seq(1, "a1", 10.0, 1000, "2021-05-05")
+ )
+
+ // Second merge (update the record)
+ spark.sql(
+s"""
+ | merge into $tableName
+ | using (
+ | select 1 as id, 'a1' as name, 20 as price, '2021-05-05' as dt,
1001 as ts
+ | ) s0
+ | on s0.id = $tableName.id
+ | when matched then update set
+ | id = s0.id, name = s0.name, price = s0.price, ts = s0.ts, dt =
s0.dt
+ | when not matched then insert *
+ """.stripMargin)
+ checkAnswer(s"select id, name, price, ts, dt from $tableName")(
+Seq(1, "a1", 20.0, 1001, "2021-05-05")
+ )
+
+ // Test ignoring case when column name matches
+ spark.sql(
+s"""
+ | merge into $tableName as t0
+ | using (
+ | select 1 as id, 'a1' as name, as ts, '2021-05-05' as dt,
111 as price union all
+ | select 2 as id, 'a2' as name, 1112 as ts, '2021-05-05' as dt,
112 as price
+ | ) as s0
+ | on t0.id = s0.id
+ | when matched then update set *
+ | when not matched then insert *
+ |""".stripMargin)
+ checkAnswer(s"select id, name, price, ts, dt from $tableName")(
+Seq(1, "a1", 111.0, , "2021-05-05"),
+Seq(2, "a2", 112.0, 1112, "2021-05-05")
+ )
+}
+ }
+
+ test("Test ignoring case for MOR table") {
+withTempDir { tmp =>
+ val tableName = generateTableName
+ // Create a mor partitioned table.
+ spark.sql(
+s"""
+ | create table $tableName (
+ | id int,
+ | name string,
+ | price double,
+ | ts long,
+ | dt string
+ | ) using hudi
Review comment:
these are all lowercases. does not look like good for testing this
feature?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[jira] [Created] (HUDI-2696) Remove the aborted checkpoint notification from coordinator
Danny Chen created HUDI-2696: Summary: Remove the aborted checkpoint notification from coordinator Key: HUDI-2696 URL: https://issues.apache.org/jira/browse/HUDI-2696 Project: Apache Hudi Issue Type: Improvement Components: Flink Integration Reporter: Danny Chen Assignee: Danny Chen Fix For: 0.10.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hudi] hudi-bot commented on pull request #3925: [HUDI-2686] Proccess record after all bootstrap operator ready
hudi-bot commented on pull request #3925: URL: https://github.com/apache/hudi/pull/3925#issuecomment-961608104 ## CI report: * 9b4b2b092927491148cc32379694c83680e2343e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3149) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3925: [HUDI-2686] Proccess record after all bootstrap operator ready
hudi-bot removed a comment on pull request #3925: URL: https://github.com/apache/hudi/pull/3925#issuecomment-961607288 ## CI report: * 9b4b2b092927491148cc32379694c83680e2343e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3925: [HUDI-2686] Proccess record after all bootstrap operator ready
hudi-bot commented on pull request #3925: URL: https://github.com/apache/hudi/pull/3925#issuecomment-961607288 ## CI report: * 9b4b2b092927491148cc32379694c83680e2343e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (HUDI-2686) Proccess record after all bootstrap operator ready
[ https://issues.apache.org/jira/browse/HUDI-2686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2686: - Labels: pull-request-available (was: ) > Proccess record after all bootstrap operator ready > -- > > Key: HUDI-2686 > URL: https://issues.apache.org/jira/browse/HUDI-2686 > Project: Apache Hudi > Issue Type: New Feature >Reporter: yuzhaojing >Assignee: yuzhaojing >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hudi] yuzhaojing opened a new pull request #3925: [HUDI-2686] Proccess record after all bootstrap operator ready
yuzhaojing opened a new pull request #3925: URL: https://github.com/apache/hudi/pull/3925 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpose of the pull request *(For example: This pull request adds quick-start document.)* ## Brief change log *(for example:)* - *Modify AnnotationLocation checkstyle rule in checkstyle.xml* ## Verify this pull request *(Please pick either of the following options)* This pull request is a trivial rework / code cleanup without any test coverage. *(or)* This pull request is already covered by existing tests, such as *(please describe tests)*. (or) This change added tests and can be verified as follows: *(example:)* - *Added integration tests for end-to-end.* - *Added HoodieClientWriteTest to verify the change.* - *Manually verified the change by running a job locally.* ## Committer checklist - [ ] Has a corresponding JIRA in PR title & commit - [ ] Commit message is descriptive of the change - [ ] CI is green - [ ] Necessary doc changes done or have another open PR - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Created] (HUDI-2695) Documentation
Sagar Sumit created HUDI-2695: - Summary: Documentation Key: HUDI-2695 URL: https://issues.apache.org/jira/browse/HUDI-2695 Project: Apache Hudi Issue Type: Sub-task Reporter: Sagar Sumit -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HUDI-2694) Support for ORC format
Sagar Sumit created HUDI-2694: - Summary: Support for ORC format Key: HUDI-2694 URL: https://issues.apache.org/jira/browse/HUDI-2694 Project: Apache Hudi Issue Type: Sub-task Reporter: Sagar Sumit -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HUDI-2693) Support for incremental queries on MOR table
Sagar Sumit created HUDI-2693: - Summary: Support for incremental queries on MOR table Key: HUDI-2693 URL: https://issues.apache.org/jira/browse/HUDI-2693 Project: Apache Hudi Issue Type: Sub-task Reporter: Sagar Sumit -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-2689) Support for snapshot query on COW table
[ https://issues.apache.org/jira/browse/HUDI-2689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2689: -- Summary: Support for snapshot query on COW table (was: POC for snapshot query on COW table) > Support for snapshot query on COW table > --- > > Key: HUDI-2689 > URL: https://issues.apache.org/jira/browse/HUDI-2689 > Project: Apache Hudi > Issue Type: Sub-task >Reporter: Sagar Sumit >Assignee: Sagar Sumit >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-2690) Support for snapshot and read optimized queries on MOR table
[ https://issues.apache.org/jira/browse/HUDI-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2690: -- Summary: Support for snapshot and read optimized queries on MOR table (was: POC for snapshot and read optimized queries on MOR table) > Support for snapshot and read optimized queries on MOR table > > > Key: HUDI-2690 > URL: https://issues.apache.org/jira/browse/HUDI-2690 > Project: Apache Hudi > Issue Type: Sub-task >Reporter: Sagar Sumit >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HUDI-2691) Implement connector SPIs
Sagar Sumit created HUDI-2691: - Summary: Implement connector SPIs Key: HUDI-2691 URL: https://issues.apache.org/jira/browse/HUDI-2691 Project: Apache Hudi Issue Type: Sub-task Reporter: Sagar Sumit Connector metadata, record set provider, splits, split manager. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HUDI-2692) Support for incremental queries on COW table
Sagar Sumit created HUDI-2692: - Summary: Support for incremental queries on COW table Key: HUDI-2692 URL: https://issues.apache.org/jira/browse/HUDI-2692 Project: Apache Hudi Issue Type: Sub-task Reporter: Sagar Sumit -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HUDI-2690) POC for snapshot and read optimized queries on MOR table
Sagar Sumit created HUDI-2690: - Summary: POC for snapshot and read optimized queries on MOR table Key: HUDI-2690 URL: https://issues.apache.org/jira/browse/HUDI-2690 Project: Apache Hudi Issue Type: Sub-task Reporter: Sagar Sumit -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HUDI-2688) RFC
[ https://issues.apache.org/jira/browse/HUDI-2688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit reassigned HUDI-2688: - Assignee: Sagar Sumit > RFC > --- > > Key: HUDI-2688 > URL: https://issues.apache.org/jira/browse/HUDI-2688 > Project: Apache Hudi > Issue Type: Sub-task >Reporter: Sagar Sumit >Assignee: Sagar Sumit >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HUDI-2689) POC for snapshot query on COW table
Sagar Sumit created HUDI-2689: - Summary: POC for snapshot query on COW table Key: HUDI-2689 URL: https://issues.apache.org/jira/browse/HUDI-2689 Project: Apache Hudi Issue Type: Sub-task Reporter: Sagar Sumit Assignee: Sagar Sumit -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HUDI-2688) RFC
Sagar Sumit created HUDI-2688: - Summary: RFC Key: HUDI-2688 URL: https://issues.apache.org/jira/browse/HUDI-2688 Project: Apache Hudi Issue Type: Sub-task Reporter: Sagar Sumit -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HUDI-2687) [UMBRELLA] A new Trino connector for Hudi
Sagar Sumit created HUDI-2687: - Summary: [UMBRELLA] A new Trino connector for Hudi Key: HUDI-2687 URL: https://issues.apache.org/jira/browse/HUDI-2687 Project: Apache Hudi Issue Type: New Feature Components: trino Reporter: Sagar Sumit Assignee: Sagar Sumit This JIRA tracks all the tasks related to building a new Hudi connector in Trino. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hudi] hudi-bot commented on pull request #3614: [HUDI-2370] Supports data encryption
hudi-bot commented on pull request #3614: URL: https://github.com/apache/hudi/pull/3614#issuecomment-961598212 ## CI report: * c646ab982ea9137bc84c53c8195dabc1833a34ea Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3134) * f8efb1f54c2818f101db8ad90a4bc917a8035362 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3148) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3614: [HUDI-2370] Supports data encryption
hudi-bot removed a comment on pull request #3614: URL: https://github.com/apache/hudi/pull/3614#issuecomment-961597323 ## CI report: * c646ab982ea9137bc84c53c8195dabc1833a34ea Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3134) * f8efb1f54c2818f101db8ad90a4bc917a8035362 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3614: [HUDI-2370] Supports data encryption
hudi-bot removed a comment on pull request #3614: URL: https://github.com/apache/hudi/pull/3614#issuecomment-961588316 ## CI report: * c646ab982ea9137bc84c53c8195dabc1833a34ea Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3134) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3614: [HUDI-2370] Supports data encryption
hudi-bot commented on pull request #3614: URL: https://github.com/apache/hudi/pull/3614#issuecomment-961597323 ## CI report: * c646ab982ea9137bc84c53c8195dabc1833a34ea Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3134) * f8efb1f54c2818f101db8ad90a4bc917a8035362 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (HUDI-2686) Proccess record after all bootstrap operator ready
[ https://issues.apache.org/jira/browse/HUDI-2686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuzhaojing updated HUDI-2686: - Summary: Proccess record after all bootstrap operator ready (was: Add DFS based message queue for bootstrap operator) > Proccess record after all bootstrap operator ready > -- > > Key: HUDI-2686 > URL: https://issues.apache.org/jira/browse/HUDI-2686 > Project: Apache Hudi > Issue Type: New Feature >Reporter: yuzhaojing >Assignee: yuzhaojing >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hudi] xushiyan removed a comment on pull request #3866: [HUDI-1430] SparkDataFrameWriteClient
xushiyan removed a comment on pull request #3866: URL: https://github.com/apache/hudi/pull/3866#issuecomment-954195094 ## CI report: * 8144fcd5285a5f53f4a76c4327e0bb8c90b46c97 UNKNOWN * 01cb7594fc6b49dcdde255269d43f4b97d5193ce UNKNOWN * 306086e46b2053e51b6378b03de209a972d0a712 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2933) * 7d3e9053f159b07c3266e4eef1dc0c17bb850b59 UNKNOWN * a117fd9a1e14cfb3377d86f067592dba126fb09b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis` re-run the last Travis build - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3486: [HUDI-2314] Add support for DynamoDb based lock
hudi-bot removed a comment on pull request #3486: URL: https://github.com/apache/hudi/pull/3486#issuecomment-899911684 ## CI report: * d2b00796c9564088aa8533431c73251993f688d4 UNKNOWN * 99853468aec1becd1112c0ffba6ccf5f604e713d UNKNOWN * 210aa90b7cedc691b11d7e146a94ab199874ae50 UNKNOWN * 0876ffb9762eda7a914e0ac8978284726cc0b267 UNKNOWN * 248651db6b258d501cc0c5752a9b888137bff669 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3093) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis` re-run the last Travis build - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3519: [DO NOT MERGE] 0.9.0 release patch for flink
hudi-bot commented on pull request #3519: URL: https://github.com/apache/hudi/pull/3519#issuecomment-961589667 ## CI report: * d022aa7a5bd94492c7c3e96dc5b1288268520087 UNKNOWN * a654fcd138e63ccd728ad5fa0237563742b392fe Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3096) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3893: [WIP][HUDI-2656] Generalize HoodieIndex for flexible record data type
hudi-bot commented on pull request #3893: URL: https://github.com/apache/hudi/pull/3893#issuecomment-961589891 ## CI report: * 3c3560d52e3e3632294c4e30c6d67ad99730c8ec UNKNOWN * 47eaf38e01fb23599f2f1a8e5964177a2610121d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2977) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3203: [HUDI-2086] Refactor hive mor_incremental_view
hudi-bot commented on pull request #3203: URL: https://github.com/apache/hudi/pull/3203#issuecomment-961589519 ## CI report: * 0fa6297ce58eb877fd5c4eba59fef20ad9335d26 UNKNOWN * 2182f542acd4ae3d1fd239e6441e9761eb2d33a1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3069) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3162: [HUDI-1872] Move HoodieFlinkStreamer to hudi-utilities module
hudi-bot removed a comment on pull request #3162: URL: https://github.com/apache/hudi/pull/3162#issuecomment-869442711 ## CI report: * 4179b35afae295d3c3f6c33787b0de39309f9e79 UNKNOWN * 3013a1c59bf40ab2d8b3bbb63e2a7f3f4ab7a882 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1273) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis` re-run the last Travis build - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3920: [HUDI-2683] Parallelize deleting archived hoodie commits
hudi-bot commented on pull request #3920: URL: https://github.com/apache/hudi/pull/3920#issuecomment-961588864 ## CI report: * e06ec205c46923532cf9977e619c8bb72c2c17b3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3121) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3126) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3010: Improving Hudi CLI tool docs
hudi-bot removed a comment on pull request #3010: URL: https://github.com/apache/hudi/pull/3010#issuecomment-864597581 ## CI report: * 41b7708cff642483f9e1de9fba04f396151e2bdd UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis` re-run the last Travis build - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
