[jira] [Updated] (HUDI-4006) Fail on data loss semantics for deltastreamer Kafka sources

2022-04-30 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4006: Fix Version/s: 0.12.0 > Fail on data loss semantics for deltastreamer Kafka sources >

[jira] [Created] (HUDI-4006) Fail on data loss semantics for deltastreamer Kafka sources

2022-04-30 Thread Ji Qi (Jira)
Ji Qi created HUDI-4006: --- Summary: Fail on data loss semantics for deltastreamer Kafka sources Key: HUDI-4006 URL: https://issues.apache.org/jira/browse/HUDI-4006 Project: Apache Hudi Issue Type: New

[GitHub] [hudi] qjqqyy closed issue #5400: [SUPPORT] fail on data loss semantics for Deltastreamer Kafka sources

2022-04-30 Thread GitBox
qjqqyy closed issue #5400: [SUPPORT] fail on data loss semantics for Deltastreamer Kafka sources URL: https://github.com/apache/hudi/issues/5400 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] qjqqyy commented on issue #5400: [SUPPORT] fail on data loss semantics for Deltastreamer Kafka sources

2022-04-30 Thread GitBox
qjqqyy commented on issue #5400: URL: https://github.com/apache/hudi/issues/5400#issuecomment-1114033663 tracked by https://issues.apache.org/jira/browse/HUDI-4006 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hudi] hudi-bot commented on pull request #5478: [HUDI-3998] Fix getCommitsSinceLastCleaning failed when async cleaning

2022-04-30 Thread GitBox
hudi-bot commented on PR #5478: URL: https://github.com/apache/hudi/pull/5478#issuecomment-1114030052 ## CI report: * c8eed56eb96606d78a910389be8a286337ee6d4a Azure:

[hudi] branch master updated: [MINOR] Update DOAP for release 0.11.0 (#5467)

2022-04-30 Thread xushiyan
This is an automated email from the ASF dual-hosted git repository. xushiyan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 6af1ff7a66 [MINOR] Update DOAP for release

[GitHub] [hudi] xushiyan merged pull request #5467: [MINOR] Update DOAP for release 0.11.0

2022-04-30 Thread GitBox
xushiyan merged PR #5467: URL: https://github.com/apache/hudi/pull/5467 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] xushiyan merged pull request #5477: [HUDI-3997] Version docs for 0.11.0

2022-04-30 Thread GitBox
xushiyan merged PR #5477: URL: https://github.com/apache/hudi/pull/5477 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] hudi-bot commented on pull request #5479: [HUDI-4005] Update release scripts to help validation

2022-04-30 Thread GitBox
hudi-bot commented on PR #5479: URL: https://github.com/apache/hudi/pull/5479#issuecomment-1114021319 ## CI report: * d50f3320c4ae52b1388a6859a93b02a88109148b Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5479: [HUDI-4005] Update release scripts to help validation

2022-04-30 Thread GitBox
hudi-bot commented on PR #5479: URL: https://github.com/apache/hudi/pull/5479#issuecomment-1114015400 ## CI report: * d50f3320c4ae52b1388a6859a93b02a88109148b Azure:

[jira] [Updated] (HUDI-4005) Update release script to help validation

2022-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-4005: - Labels: pull-request-available (was: ) > Update release script to help validation >

[GitHub] [hudi] hudi-bot commented on pull request #5479: [HUDI-4005] Update release scripts to help validation

2022-04-30 Thread GitBox
hudi-bot commented on PR #5479: URL: https://github.com/apache/hudi/pull/5479#issuecomment-1114014967 ## CI report: * d50f3320c4ae52b1388a6859a93b02a88109148b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[jira] [Created] (HUDI-4005) Update release script to help validation

2022-04-30 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-4005: Summary: Update release script to help validation Key: HUDI-4005 URL: https://issues.apache.org/jira/browse/HUDI-4005 Project: Apache Hudi Issue Type: Task

[GitHub] [hudi] hudi-bot commented on pull request #5478: [HUDI-3998] Fix getCommitsSinceLastCleaning failed when async cleaning

2022-04-30 Thread GitBox
hudi-bot commented on PR #5478: URL: https://github.com/apache/hudi/pull/5478#issuecomment-1114013549 ## CI report: * c8eed56eb96606d78a910389be8a286337ee6d4a Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5478: [HUDI-3998] Fix getCommitsSinceLastCleaning failed when async cleaning

2022-04-30 Thread GitBox
hudi-bot commented on PR #5478: URL: https://github.com/apache/hudi/pull/5478#issuecomment-1114013015 ## CI report: * c8eed56eb96606d78a910389be8a286337ee6d4a UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[jira] [Updated] (HUDI-3998) getCommitsSinceLastCleaning failed when async cleaning

2022-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3998: - Labels: pull-request-available (was: ) > getCommitsSinceLastCleaning failed when async cleaning

[GitHub] [hudi] dongkelun opened a new pull request, #5478: [HUDI-3998] Fix getCommitsSinceLastCleaning failed when async cleaning

2022-04-30 Thread GitBox
dongkelun opened a new pull request, #5478: URL: https://github.com/apache/hudi/pull/5478 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the

[GitHub] [hudi] hudi-bot commented on pull request #5467: [MINOR] Update DOAP for release 0.11.0

2022-04-30 Thread GitBox
hudi-bot commented on PR #5467: URL: https://github.com/apache/hudi/pull/5467#issuecomment-1114004182 ## CI report: * 7cbede260468175e0f9f050db6cc165973be7d99 Azure:

[jira] [Updated] (HUDI-4003) Flink offline compaction may cause NPE when log file only contain delete opereation

2022-04-30 Thread lanyuanxiaoyao (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lanyuanxiaoyao updated HUDI-4003: - Priority: Critical (was: Major) > Flink offline compaction may cause NPE when log file only

[GitHub] [hudi] hudi-bot commented on pull request #5467: [MINOR] Update DOAP for release 0.11.0

2022-04-30 Thread GitBox
hudi-bot commented on PR #5467: URL: https://github.com/apache/hudi/pull/5467#issuecomment-1114003705 ## CI report: * 7cbede260468175e0f9f050db6cc165973be7d99 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[hudi] branch asf-site updated: [HUDI-3931][DOCS] Guide to setup async metadata indexing (#5476)

2022-04-30 Thread xushiyan
This is an automated email from the ASF dual-hosted git repository. xushiyan pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 2ad9817d66 [HUDI-3931][DOCS] Guide to setup

[GitHub] [hudi] xushiyan merged pull request #5476: [HUDI-3931][DOCS] Guide to setup async metadata indexing

2022-04-30 Thread GitBox
xushiyan merged PR #5476: URL: https://github.com/apache/hudi/pull/5476 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] xushiyan opened a new pull request, #5477: [HUDI-3997] Version docs for 0.11.0

2022-04-30 Thread GitBox
xushiyan opened a new pull request, #5477: URL: https://github.com/apache/hudi/pull/5477 ![Screen Shot 2022-04-30 at 7 03 35 PM](https://user-images.githubusercontent.com/2701446/166102841-3935f651-2fdd-429e-a642-be214802dbce.png) -- This is an automated message from the Apache Git

[GitHub] [hudi] codope commented on pull request #5476: [HUDI-3931][DOCS] Guide to setup async metadata indexing

2022-04-30 Thread GitBox
codope commented on PR #5476: URL: https://github.com/apache/hudi/pull/5476#issuecomment-1113977124 @nsivabalan @bhasudha @xushiyan Added this guide to go under `Services` tab. We can land this doc. I'll update the blog #5449 with more design elements. That can go after multi-modal index

[GitHub] [hudi] xushiyan merged pull request #5475: [HUDI-3997] Update 0.11.0 release notes

2022-04-30 Thread GitBox
xushiyan merged PR #5475: URL: https://github.com/apache/hudi/pull/5475 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[hudi] branch asf-site updated (aac09f2d7d -> 04c9d2aabf)

2022-04-30 Thread xushiyan
This is an automated email from the ASF dual-hosted git repository. xushiyan pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git from aac09f2d7d GitHub Actions build asf-site add 04c9d2aabf [HUDI-3997] Update 0.11.0 release notes (#5475) No

[GitHub] [hudi] codope commented on pull request #5449: [HUDI-3911][DOCS][WIP] Add async indexing doc

2022-04-30 Thread GitBox
codope commented on PR #5449: URL: https://github.com/apache/hudi/pull/5449#issuecomment-1113976714 > @codope I read through the blog. Thanks for the great writeup. I have a couple of thoughts/questions from an external perspective. > > * Should we name this blog to explicitly

[jira] [Updated] (HUDI-3931) Add guide for async indexer

2022-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3931: - Labels: pull-request-available (was: ) > Add guide for async indexer >

[GitHub] [hudi] codope opened a new pull request, #5476: [HUDI-3931][DOCS] Guide to setup async metadata indexing

2022-04-30 Thread GitBox
codope opened a new pull request, #5476: URL: https://github.com/apache/hudi/pull/5476 ![screencapture-localhost-3000-docs-next-async-meta-indexing-2022-04-30-17_24_05](https://user-images.githubusercontent.com/16440354/166104484-4f31dffe-6907-4b39-971c-e68d79cf0f11.png) -- This is

[GitHub] [hudi] xushiyan opened a new pull request, #5475: [HUDI-3997] Update release notes 0.11.0

2022-04-30 Thread GitBox
xushiyan opened a new pull request, #5475: URL: https://github.com/apache/hudi/pull/5475 Update links and add encryption highlight in the release notes. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hudi] hudi-bot commented on pull request #5473: [HUDI-4003] Try to read all the log file to parse schema

2022-04-30 Thread GitBox
hudi-bot commented on PR #5473: URL: https://github.com/apache/hudi/pull/5473#issuecomment-1113969200 ## CI report: * 8997ecfddab6ddf5b1b87a853fa5c871adabd86e Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5467: [MINOR] Update DOAP for release 0.11.0

2022-04-30 Thread GitBox
hudi-bot commented on PR #5467: URL: https://github.com/apache/hudi/pull/5467#issuecomment-1113969191 ## CI report: * 7cbede260468175e0f9f050db6cc165973be7d99 Azure:

[GitHub] [hudi] kazdy commented on pull request #5413: Document alter table unset tblproperties comand

2022-04-30 Thread GitBox
kazdy commented on PR #5413: URL: https://github.com/apache/hudi/pull/5413#issuecomment-1113969159 Let's merge this PR to 0.10.1 docs, should bring some value :) I can't merge it myself, could You please merge it? -- This is an automated message from the Apache Git Service. To respond

[hudi] branch asf-site updated (1f1776c378 -> 0c65fb8c44)

2022-04-30 Thread xushiyan
This is an automated email from the ASF dual-hosted git repository. xushiyan pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git from 1f1776c378 GitHub Actions build asf-site add 0c65fb8c44 [HUDI-3997] Update configs for 0.11.0 (#5474) No new

[GitHub] [hudi] xushiyan merged pull request #5474: [HUDI-3997] Update configs for 0.11.0

2022-04-30 Thread GitBox
xushiyan merged PR #5474: URL: https://github.com/apache/hudi/pull/5474 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Created] (HUDI-4004) Website config update utils to handle different bundle versions

2022-04-30 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-4004: Summary: Website config update utils to handle different bundle versions Key: HUDI-4004 URL: https://issues.apache.org/jira/browse/HUDI-4004 Project: Apache Hudi

[GitHub] [hudi] onlywangyh commented on pull request #5434: [HUDI-3978] Fix use of partition path field as hive partition field in flink

2022-04-30 Thread GitBox
onlywangyh commented on PR #5434: URL: https://github.com/apache/hudi/pull/5434#issuecomment-1113961647 Thanks a lot -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] hudi-bot commented on pull request #5467: [MINOR] Update DOAP for release 0.11.0

2022-04-30 Thread GitBox
hudi-bot commented on PR #5467: URL: https://github.com/apache/hudi/pull/5467#issuecomment-1113957026 ## CI report: * cdf17590bf9882b87f18586bf306c915cd6dcff6 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5467: [MINOR] Update DOAP for release 0.11.0

2022-04-30 Thread GitBox
hudi-bot commented on PR #5467: URL: https://github.com/apache/hudi/pull/5467#issuecomment-1113956589 ## CI report: * cdf17590bf9882b87f18586bf306c915cd6dcff6 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5473: [HUDI-4003] Try to read all the log file to parse schema

2022-04-30 Thread GitBox
hudi-bot commented on PR #5473: URL: https://github.com/apache/hudi/pull/5473#issuecomment-1113955287 ## CI report: * 8997ecfddab6ddf5b1b87a853fa5c871adabd86e Azure:

[hudi] branch asf-site updated: [HUDI-3997] Add 0.11.0 release notes (#5466)

2022-04-30 Thread xushiyan
This is an automated email from the ASF dual-hosted git repository. xushiyan pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 7cbcf92f48 [HUDI-3997] Add 0.11.0 release

[GitHub] [hudi] xushiyan merged pull request #5466: [HUDI-3997] Add 0.11.0 release notes

2022-04-30 Thread GitBox
xushiyan merged PR #5466: URL: https://github.com/apache/hudi/pull/5466 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] hudi-bot commented on pull request #5473: [HUDI-4003] Try to read all the log file to parse schema

2022-04-30 Thread GitBox
hudi-bot commented on PR #5473: URL: https://github.com/apache/hudi/pull/5473#issuecomment-1113954910 ## CI report: * 8997ecfddab6ddf5b1b87a853fa5c871adabd86e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[jira] [Updated] (HUDI-4003) Flink offline compaction may cause NPE when log file only contain delete opereation

2022-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-4003: - Labels: pull-request-available (was: ) > Flink offline compaction may cause NPE when log file

[GitHub] [hudi] lanyuanxiaoyao opened a new pull request, #5473: [HUDI-4003] Try to read all the log file to parse schema

2022-04-30 Thread GitBox
lanyuanxiaoyao opened a new pull request, #5473: URL: https://github.com/apache/hudi/pull/5473 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the

[jira] [Updated] (HUDI-4003) Flink offline compaction may cause NPE when log file only contain delete opereation

2022-04-30 Thread lanyuanxiaoyao (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lanyuanxiaoyao updated HUDI-4003: - Summary: Flink offline compaction may cause NPE when log file only contain delete opereation

[jira] [Updated] (HUDI-4003) Flink offline compaction may cause NPE when log file only contain delete opereation

2022-04-30 Thread lanyuanxiaoyao (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lanyuanxiaoyao updated HUDI-4003: - Summary: Flink offline compaction may cause NPE when log file only contain delete opereation

[jira] [Created] (HUDI-4003) Flink offline compaction cause NPE when log file is full of delete operation

2022-04-30 Thread lanyuanxiaoyao (Jira)
lanyuanxiaoyao created HUDI-4003: Summary: Flink offline compaction cause NPE when log file is full of delete operation Key: HUDI-4003 URL: https://issues.apache.org/jira/browse/HUDI-4003 Project:

[GitHub] [hudi] xushiyan commented on a diff in pull request #5466: [HUDI-3997] Add 0.11.0 release notes

2022-04-30 Thread GitBox
xushiyan commented on code in PR #5466: URL: https://github.com/apache/hudi/pull/5466#discussion_r862328962 ## website/releases/release-0.11.0.md: ## @@ -0,0 +1,206 @@ +--- +title: "Release 0.11.0" +sidebar_position: 2 +layout: releases +toc: true +last_modified_at:

[GitHub] [hudi] xushiyan commented on a diff in pull request #5466: [HUDI-3997] Add 0.11.0 release notes

2022-04-30 Thread GitBox
xushiyan commented on code in PR #5466: URL: https://github.com/apache/hudi/pull/5466#discussion_r862328929 ## website/releases/release-0.11.0.md: ## @@ -0,0 +1,206 @@ +--- +title: "Release 0.11.0" +sidebar_position: 2 +layout: releases +toc: true +last_modified_at:

[GitHub] [hudi] hudi-bot commented on pull request #5406: [HUDI-3954] Don't keep the last commit before the earliest commit to retain

2022-04-30 Thread GitBox
hudi-bot commented on PR #5406: URL: https://github.com/apache/hudi/pull/5406#issuecomment-1113945602 ## CI report: * 1d213ea8449e1fdc88267e29c7d8a5b667b8fdf2 Azure:

[GitHub] [hudi] xushiyan commented on a diff in pull request #5466: [HUDI-3997] Add 0.11.0 release notes

2022-04-30 Thread GitBox
xushiyan commented on code in PR #5466: URL: https://github.com/apache/hudi/pull/5466#discussion_r862319907 ## website/releases/release-0.11.0.md: ## @@ -0,0 +1,206 @@ +--- +title: "Release 0.11.0" +sidebar_position: 2 +layout: releases +toc: true +last_modified_at:

[GitHub] [hudi] hudi-bot commented on pull request #5470: [WIP][HUDI-3993][Perf] Replacing UDF in Bulk Insert w/ RDD transformation

2022-04-30 Thread GitBox
hudi-bot commented on PR #5470: URL: https://github.com/apache/hudi/pull/5470#issuecomment-1113936430 ## CI report: * 1489d3759dfe86f9625ee533ea4ea710b32b18c3 Azure:

[GitHub] [hudi] JerryYue-M commented on a diff in pull request #5445: [HUDI-3953]Flink Hudi module should support low-level source and sink…

2022-04-30 Thread GitBox
JerryYue-M commented on code in PR #5445: URL: https://github.com/apache/hudi/pull/5445#discussion_r862317786 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/util/HoodiePipeline.java: ## @@ -0,0 +1,263 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [hudi] JerryYue-M commented on a diff in pull request #5445: [HUDI-3953]Flink Hudi module should support low-level source and sink…

2022-04-30 Thread GitBox
JerryYue-M commented on code in PR #5445: URL: https://github.com/apache/hudi/pull/5445#discussion_r862311102 ## hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/sink/utils/ITTestHoodiePipeline.java: ## @@ -0,0 +1,220 @@ + +/* + * Licensed to the Apache Software

[GitHub] [hudi] hudi-bot commented on pull request #5406: [HUDI-3954] Don't keep the last commit before the earliest commit to retain

2022-04-30 Thread GitBox
hudi-bot commented on PR #5406: URL: https://github.com/apache/hudi/pull/5406#issuecomment-1113927475 ## CI report: * 1bf4a7b2aebc313e7e4130622ca1e66a335bb568 Azure:

[GitHub] [hudi] xushiyan commented on a diff in pull request #5466: [HUDI-3997] Add 0.11.0 release notes

2022-04-30 Thread GitBox
xushiyan commented on code in PR #5466: URL: https://github.com/apache/hudi/pull/5466#discussion_r862309500 ## website/releases/release-0.11.0.md: ## @@ -0,0 +1,206 @@ +--- +title: "Release 0.11.0" +sidebar_position: 2 +layout: releases +toc: true +last_modified_at:

[GitHub] [hudi] hudi-bot commented on pull request #5406: [HUDI-3954] Don't keep the last commit before the earliest commit to retain

2022-04-30 Thread GitBox
hudi-bot commented on PR #5406: URL: https://github.com/apache/hudi/pull/5406#issuecomment-1113927112 ## CI report: * 1bf4a7b2aebc313e7e4130622ca1e66a335bb568 Azure:

[GitHub] [hudi] xushiyan commented on a diff in pull request #5466: [HUDI-3997] Add 0.11.0 release notes

2022-04-30 Thread GitBox
xushiyan commented on code in PR #5466: URL: https://github.com/apache/hudi/pull/5466#discussion_r862309217 ## website/releases/release-0.11.0.md: ## @@ -0,0 +1,206 @@ +--- +title: "Release 0.11.0" +sidebar_position: 2 +layout: releases +toc: true +last_modified_at: