[GitHub] [hudi] danny0405 commented on a diff in pull request #6763: [HUDI-4906] Fix the local tests for hudi-flink

2022-09-22 Thread GitBox
danny0405 commented on code in PR #6763: URL: https://github.com/apache/hudi/pull/6763#discussion_r978317503 ## pom.xml: ## @@ -628,12 +628,6 @@ - -org.scala-lang -scala-library -${scala.version} - Review Comment: The sca

[jira] [Updated] (HUDI-4906) Fix the local tests for hudi-flink

2022-09-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-4906: - Labels: pull-request-available (was: ) > Fix the local tests for hudi-flink > ---

[GitHub] [hudi] danny0405 opened a new pull request, #6763: [HUDI-4906] Fix the local tests for hudi-flink

2022-09-22 Thread GitBox
danny0405 opened a new pull request, #6763: URL: https://github.com/apache/hudi/pull/6763 ### Change Logs _Describe context and summary for this change. Highlight if any code was copied._ ### Impact _Describe any public API or user-facing feature change or any performanc

[jira] [Created] (HUDI-4906) Fix the local tests for hudi-flink

2022-09-22 Thread Danny Chen (Jira)
Danny Chen created HUDI-4906: Summary: Fix the local tests for hudi-flink Key: HUDI-4906 URL: https://issues.apache.org/jira/browse/HUDI-4906 Project: Apache Hudi Issue Type: Bug Compon

[GitHub] [hudi] YuweiXiao closed pull request #6738: [HUDI-4895] Object store based lock provider

2022-09-22 Thread GitBox
YuweiXiao closed pull request #6738: [HUDI-4895] Object store based lock provider URL: https://github.com/apache/hudi/pull/6738 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hudi] hudi-bot commented on pull request #6762: [MINOR] Fix TestHoodieLogFormat`s minor typo

2022-09-22 Thread GitBox
hudi-bot commented on PR #6762: URL: https://github.com/apache/hudi/pull/6762#issuecomment-1255850979 ## CI report: * 7e2ed895749dc46a855b0f2b4f7b536061080c20 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1161

[GitHub] [hudi] hudi-bot commented on pull request #6652: [HUDI-4830] Fix testNoGlobalConfFileConfigured when add hudi-defaults.conf in default dir

2022-09-22 Thread GitBox
hudi-bot commented on PR #6652: URL: https://github.com/apache/hudi/pull/6652#issuecomment-1255850711 ## CI report: * 3b4a114aa334d11d59c5e348f47736084ebc4b57 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1129

[GitHub] [hudi] hudi-bot commented on pull request #6761: [HUDI-4904] add support for unraveling proto schemas in ProtoClassBasedSchemaProvider

2022-09-22 Thread GitBox
hudi-bot commented on PR #6761: URL: https://github.com/apache/hudi/pull/6761#issuecomment-1255847755 ## CI report: * 9c1fa14fd6b422201093b552f4995f98eee84fb9 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1161

[GitHub] [hudi] Zouxxyy commented on a diff in pull request #6652: [HUDI-4830] Fix testNoGlobalConfFileConfigured when add hudi-defaults.conf in default dir

2022-09-22 Thread GitBox
Zouxxyy commented on code in PR #6652: URL: https://github.com/apache/hudi/pull/6652#discussion_r978306628 ## hudi-common/src/test/java/org/apache/hudi/common/util/TestDFSPropertiesConfiguration.java: ## @@ -173,7 +173,9 @@ public void testNoGlobalConfFileConfigured() { EN

[GitHub] [hudi] hudi-bot commented on pull request #6762: [MINOR] Fix TestHoodieLogFormat`s minor typo

2022-09-22 Thread GitBox
hudi-bot commented on PR #6762: URL: https://github.com/apache/hudi/pull/6762#issuecomment-1255847782 ## CI report: * 7e2ed895749dc46a855b0f2b4f7b536061080c20 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #6652: [HUDI-4830] Fix testNoGlobalConfFileConfigured when add hudi-defaults.conf in default dir

2022-09-22 Thread GitBox
hudi-bot commented on PR #6652: URL: https://github.com/apache/hudi/pull/6652#issuecomment-1255847512 ## CI report: * 3b4a114aa334d11d59c5e348f47736084ebc4b57 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1129

[GitHub] [hudi] slachiewicz commented on issue #6724: [SUPPORT]: Build failing on latest master on M1 mac due to protobuf support

2022-09-22 Thread GitBox
slachiewicz commented on issue #6724: URL: https://github.com/apache/hudi/issues/6724#issuecomment-1255846881 i was able to run successful build locally without any customisations and with empty `setting.xml` and deleted previously cached protoc binary -- This is an automated message from

[GitHub] [hudi] hudi-bot commented on pull request #6761: [HUDI-4904] add support for unraveling proto schemas in ProtoClassBasedSchemaProvider

2022-09-22 Thread GitBox
hudi-bot commented on PR #6761: URL: https://github.com/apache/hudi/pull/6761#issuecomment-1255844738 ## CI report: * 9c1fa14fd6b422201093b552f4995f98eee84fb9 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1161

[GitHub] [hudi] hudi-bot commented on pull request #6668: [HUDI-4839] Upgrade rocksdbjni for compatibility with Apple Silicon

2022-09-22 Thread GitBox
hudi-bot commented on PR #6668: URL: https://github.com/apache/hudi/pull/6668#issuecomment-1255844519 ## CI report: * Unknown: [CANCELED](TBD) * 3aabfd1d8f959058bb21a2b165c3efbd5597a315 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039

[GitHub] [hudi] hudi-bot commented on pull request #6636: [HUDI-4824]Add new index RANGE_BUCKET , when primary key is auto-increment like most mysql table

2022-09-22 Thread GitBox
hudi-bot commented on PR #6636: URL: https://github.com/apache/hudi/pull/6636#issuecomment-1255844460 ## CI report: * 47864db3234b5dd7115006db07019481c91d65f8 UNKNOWN * 1ef2c6f59d7ce1616b4cf36494373007e2ad9450 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #6322: [HUDI-4559] Support hiveSync command based on Call Produce Command

2022-09-22 Thread GitBox
hudi-bot commented on PR #6322: URL: https://github.com/apache/hudi/pull/6322#issuecomment-1255844158 ## CI report: * a203be972420a40ee11ef7c5ce8c47f3e2651816 UNKNOWN * 1a79176081ca828e2ccab0b827326ec7aa780699 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] wulei0302 opened a new pull request, #6762: [MINOR] Fix TestHoodieLogFormat`s minor typo

2022-09-22 Thread GitBox
wulei0302 opened a new pull request, #6762: URL: https://github.com/apache/hudi/pull/6762 ### Change Logs Fix TestHoodieLogFormat`s minor typo for 'thee' -> 'the' ### Impact N/A **Risk level: none ### Contributor's checklist - [ ] Read through

[GitHub] [hudi] hudi-bot commented on pull request #6668: [HUDI-4839] Upgrade rocksdbjni for compatibility with Apple Silicon

2022-09-22 Thread GitBox
hudi-bot commented on PR #6668: URL: https://github.com/apache/hudi/pull/6668#issuecomment-1255841164 ## CI report: * Unknown: [CANCELED](TBD) * 3aabfd1d8f959058bb21a2b165c3efbd5597a315 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039

[jira] [Resolved] (HUDI-4901) Add avro version to Flink profiles

2022-09-22 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-4901. -- > Add avro version to Flink profiles > -- > > Key: HUDI-4901

[jira] [Commented] (HUDI-4901) Add avro version to Flink profiles

2022-09-22 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17608561#comment-17608561 ] Danny Chen commented on HUDI-4901: -- Fixed via master branch: 1380075a2d4d3f9696fdce4de69d

[jira] [Updated] (HUDI-4901) Add avro version to Flink profiles

2022-09-22 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-4901: - Fix Version/s: 0.12.1 > Add avro version to Flink profiles > -- > >

[hudi] branch master updated: [HUDI-4901] Add avro.version to Flink profiles (#6757)

2022-09-22 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 1380075a2d [HUDI-4901] Add avro.version to Flin

[GitHub] [hudi] danny0405 merged pull request #6757: [HUDI-4901] Add avro.version to Flink profiles

2022-09-22 Thread GitBox
danny0405 merged PR #6757: URL: https://github.com/apache/hudi/pull/6757 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache

[GitHub] [hudi] Zouxxyy commented on pull request #6668: [HUDI-4839] Upgrade rocksdbjni for compatibility with Apple Silicon

2022-09-22 Thread GitBox
Zouxxyy commented on PR #6668: URL: https://github.com/apache/hudi/pull/6668#issuecomment-1255819032 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] hudi-bot commented on pull request #6761: [HUDI-4904] add support for unraveling proto schemas in ProtoClassBasedSchemaProvider

2022-09-22 Thread GitBox
hudi-bot commented on PR #6761: URL: https://github.com/apache/hudi/pull/6761#issuecomment-1255815843 ## CI report: * 9c1fa14fd6b422201093b552f4995f98eee84fb9 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1161

[GitHub] [hudi] hudi-bot commented on pull request #6761: [HUDI-4904] add support for unraveling proto schemas in ProtoClassBasedSchemaProvider

2022-09-22 Thread GitBox
hudi-bot commented on PR #6761: URL: https://github.com/apache/hudi/pull/6761#issuecomment-1255813580 ## CI report: * 9c1fa14fd6b422201093b552f4995f98eee84fb9 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #6745: Fix comment in RFC46

2022-09-22 Thread GitBox
hudi-bot commented on PR #6745: URL: https://github.com/apache/hudi/pull/6745#issuecomment-1255813523 ## CI report: * a2febfbe1f9c172bc93da20ff5f7e511b74b4dcf Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1158

[jira] [Updated] (HUDI-4904) Handle Recursive Proto Schemas in ProtoClassBasedSchemaProvider

2022-09-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-4904: - Labels: pull-request-available (was: ) > Handle Recursive Proto Schemas in ProtoClassBasedSchemaP

[GitHub] [hudi] the-other-tim-brown opened a new pull request, #6761: [HUDI-4904] add support for unraveling proto schemas in ProtoClassBasedSchemaProvider

2022-09-22 Thread GitBox
the-other-tim-brown opened a new pull request, #6761: URL: https://github.com/apache/hudi/pull/6761 ### Change Logs If a user provides a recursive proto schema, it will fail when we write to parquet. We need to allow the user to specify how many levels of recursion they want before t

[GitHub] [hudi] hudi-bot commented on pull request #6745: Fix comment in RFC46

2022-09-22 Thread GitBox
hudi-bot commented on PR #6745: URL: https://github.com/apache/hudi/pull/6745#issuecomment-1255811235 ## CI report: * a2febfbe1f9c172bc93da20ff5f7e511b74b4dcf Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1158

[GitHub] [hudi] hudi-bot commented on pull request #6636: [HUDI-4824]Add new index RANGE_BUCKET , when primary key is auto-increment like most mysql table

2022-09-22 Thread GitBox
hudi-bot commented on PR #6636: URL: https://github.com/apache/hudi/pull/6636#issuecomment-1255811097 ## CI report: * 47864db3234b5dd7115006db07019481c91d65f8 UNKNOWN * 1ef2c6f59d7ce1616b4cf36494373007e2ad9450 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] wqwl611 commented on a diff in pull request #6636: [HUDI-4824]Add new index RANGE_BUCKET , when primary key is auto-increment like most mysql table

2022-09-22 Thread GitBox
wqwl611 commented on code in PR #6636: URL: https://github.com/apache/hudi/pull/6636#discussion_r978271511 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/index/bucket/HoodieBucketIndex.java: ## @@ -64,6 +69,29 @@ public HoodieData updateLocation(HoodieData writ

[jira] [Updated] (HUDI-4905) Protobuf type handling improvements

2022-09-22 Thread Timothy Brown (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timothy Brown updated HUDI-4905: Summary: Protobuf type handling improvements (was: Proto type handling improvements) > Protobuf ty

[jira] [Created] (HUDI-4905) Proto type handling improvements

2022-09-22 Thread Timothy Brown (Jira)
Timothy Brown created HUDI-4905: --- Summary: Proto type handling improvements Key: HUDI-4905 URL: https://issues.apache.org/jira/browse/HUDI-4905 Project: Apache Hudi Issue Type: Improvement

[jira] [Assigned] (HUDI-4905) Proto type handling improvements

2022-09-22 Thread Timothy Brown (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timothy Brown reassigned HUDI-4905: --- Assignee: Timothy Brown > Proto type handling improvements >

[jira] [Assigned] (HUDI-4904) Handle Recursive Proto Schemas

2022-09-22 Thread Timothy Brown (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timothy Brown reassigned HUDI-4904: --- Assignee: Timothy Brown > Handle Recursive Proto Schemas > -- > >

[jira] [Updated] (HUDI-4904) Handle Recursive Proto Schemas in ProtoClassBasedSchemaProvider

2022-09-22 Thread Timothy Brown (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timothy Brown updated HUDI-4904: Summary: Handle Recursive Proto Schemas in ProtoClassBasedSchemaProvider (was: Handle Recursive Pro

[jira] [Created] (HUDI-4904) Handle Recursive Proto Schemas

2022-09-22 Thread Timothy Brown (Jira)
Timothy Brown created HUDI-4904: --- Summary: Handle Recursive Proto Schemas Key: HUDI-4904 URL: https://issues.apache.org/jira/browse/HUDI-4904 Project: Apache Hudi Issue Type: Improvement

[GitHub] [hudi] hudi-bot commented on pull request #6760: [Minor] test for 0.12.1-rc1

2022-09-22 Thread GitBox
hudi-bot commented on PR #6760: URL: https://github.com/apache/hudi/pull/6760#issuecomment-1255785837 ## CI report: * ce676b792a5af23c7f4e219abf7fea97807456ec Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1160

[GitHub] [hudi] hudi-bot commented on pull request #6760: [Minor] test for 0.12.1-rc1

2022-09-22 Thread GitBox
hudi-bot commented on PR #6760: URL: https://github.com/apache/hudi/pull/6760#issuecomment-1255783063 ## CI report: * ce676b792a5af23c7f4e219abf7fea97807456ec UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #6759: [HUDI-4902] Set default partitioner for SIMPLE BUCKET index

2022-09-22 Thread GitBox
hudi-bot commented on PR #6759: URL: https://github.com/apache/hudi/pull/6759#issuecomment-1255780370 ## CI report: * f91c177cb72f63f4f3bc0ebffab95221d9df1bca Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1160

[GitHub] [hudi] hudi-bot commented on pull request #6757: [HUDI-4901] Add avro.version to Flink profiles

2022-09-22 Thread GitBox
hudi-bot commented on PR #6757: URL: https://github.com/apache/hudi/pull/6757#issuecomment-1255780342 ## CI report: * 741fa15085e5372373205a5c39a5f3ec7cb6ebf4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1159

[GitHub] [hudi] hudi-bot commented on pull request #6740: [HUDI-4897] Refactor the merge handle in CDC mode

2022-09-22 Thread GitBox
hudi-bot commented on PR #6740: URL: https://github.com/apache/hudi/pull/6740#issuecomment-1255780266 ## CI report: * e270b9cf24cefb1fef8bfb2e0c91b859242b2a13 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1157

[GitHub] [hudi] hudi-bot commented on pull request #6668: [HUDI-4839] Upgrade rocksdbjni for compatibility with Apple Silicon

2022-09-22 Thread GitBox
hudi-bot commented on PR #6668: URL: https://github.com/apache/hudi/pull/6668#issuecomment-1255780148 ## CI report: * Unknown: [CANCELED](TBD) * 3aabfd1d8f959058bb21a2b165c3efbd5597a315 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039

[GitHub] [hudi] yuzhaojing opened a new pull request, #6760: [Minor] test for 0.12.1-rc1

2022-09-22 Thread GitBox
yuzhaojing opened a new pull request, #6760: URL: https://github.com/apache/hudi/pull/6760 ### Change Logs _Describe context and summary for this change. Highlight if any code was copied._ ### Impact _Describe any public API or user-facing feature change or any performan

[GitHub] [hudi] hudi-bot commented on pull request #6759: [HUDI-4902] Set default partitioner for SIMPLE BUCKET index

2022-09-22 Thread GitBox
hudi-bot commented on PR #6759: URL: https://github.com/apache/hudi/pull/6759#issuecomment-1255777888 ## CI report: * f91c177cb72f63f4f3bc0ebffab95221d9df1bca UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #6757: [HUDI-4901] Add avro.version to Flink profiles

2022-09-22 Thread GitBox
hudi-bot commented on PR #6757: URL: https://github.com/apache/hudi/pull/6757#issuecomment-1255777859 ## CI report: * 741fa15085e5372373205a5c39a5f3ec7cb6ebf4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1159

[GitHub] [hudi] hudi-bot commented on pull request #6740: [HUDI-4897] Refactor the merge handle in CDC mode

2022-09-22 Thread GitBox
hudi-bot commented on PR #6740: URL: https://github.com/apache/hudi/pull/6740#issuecomment-1255777800 ## CI report: * e270b9cf24cefb1fef8bfb2e0c91b859242b2a13 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1157

[GitHub] [hudi] hudi-bot commented on pull request #6668: [HUDI-4839] Upgrade rocksdbjni for compatibility with Apple Silicon

2022-09-22 Thread GitBox
hudi-bot commented on PR #6668: URL: https://github.com/apache/hudi/pull/6668#issuecomment-125505 ## CI report: * Unknown: [CANCELED](TBD) * 3aabfd1d8f959058bb21a2b165c3efbd5597a315 UNKNOWN Bot commands @hudi-bot supports the following commands: - `

[GitHub] [hudi] hudi-bot commented on pull request #6757: [HUDI-4901] Add avro.version to Flink profiles

2022-09-22 Thread GitBox
hudi-bot commented on PR #6757: URL: https://github.com/apache/hudi/pull/6757#issuecomment-1255775382 ## CI report: * 741fa15085e5372373205a5c39a5f3ec7cb6ebf4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1159

[GitHub] [hudi] CTTY commented on pull request #6757: [HUDI-4901] Add avro.version to Flink profiles

2022-09-22 Thread GitBox
CTTY commented on PR #6757: URL: https://github.com/apache/hudi/pull/6757#issuecomment-1255773674 > Please validate the packaged jar version for hudi-flink and hudi-flink-bundle Tested with flink1.15 profile: hudi-flink ``` [INFO] org.apache.hudi:hudi-flink:jar:0.13.0-SNAPSHO

[jira] [Created] (HUDI-4903) TestHoodieLogFormat has a minor typo

2022-09-22 Thread wulei0302 (Jira)
wulei0302 created HUDI-4903: --- Summary: TestHoodieLogFormat has a minor typo Key: HUDI-4903 URL: https://issues.apache.org/jira/browse/HUDI-4903 Project: Apache Hudi Issue Type: Improvement

[hudi] branch release-0.12.1-rc1 created (now 2c1560c4e3)

2022-09-22 Thread yuzhaojing
This is an automated email from the ASF dual-hosted git repository. yuzhaojing pushed a change to branch release-0.12.1-rc1 in repository https://gitbox.apache.org/repos/asf/hudi.git at 2c1560c4e3 Create release branch for version 0.12.1. This branch includes the following new commits:

[GitHub] [hudi] flashJd commented on pull request #5830: [WIP][HUDI-3981] Flink engine support for comprehensive schema evolution(RFC-33)

2022-09-22 Thread GitBox
flashJd commented on PR #5830: URL: https://github.com/apache/hudi/pull/5830#issuecomment-1255766997 @trushev Good job, I've tested it and it works on the whole, but a little defects and I'll point out -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hudi] Zouxxyy commented on pull request #6668: [HUDI-4839] Upgrade rocksdbjni for compatibility with Apple Silicon

2022-09-22 Thread GitBox
Zouxxyy commented on PR #6668: URL: https://github.com/apache/hudi/pull/6668#issuecomment-1255764686 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] xicm commented on issue #6723: [SUPPORT]BUCKET INDEX UPSERT FAILED

2022-09-22 Thread GitBox
xicm commented on issue #6723: URL: https://github.com/apache/hudi/issues/6723#issuecomment-1255762742 Hi @xushiyan @yihua @15663671003, I created a pr to add default partitioner for SIMPLE BUCKET index, please have a look. -- This is an automated message from the Apache Git Service. To r

[GitHub] [hudi] danny0405 commented on pull request #6757: [HUDI-4901] Add avro.version to Flink profiles

2022-09-22 Thread GitBox
danny0405 commented on PR #6757: URL: https://github.com/apache/hudi/pull/6757#issuecomment-1255760441 Please validate the packaged jar version for hudi-flink and hudi-flink-bundle -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

[jira] [Updated] (HUDI-4902) Set default partitioner for SIMPLE BUCKET index

2022-09-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-4902: - Labels: pull-request-available (was: ) > Set default partitioner for SIMPLE BUCKET index > --

[GitHub] [hudi] xicm opened a new pull request, #6759: [HUDI-4902] Set default partitioner for SIMPLE BUCKET index

2022-09-22 Thread GitBox
xicm opened a new pull request, #6759: URL: https://github.com/apache/hudi/pull/6759 ### Change Logs _Describe context and summary for this change. Highlight if any code was copied._ ### Impact _Describe any public API or user-facing feature change or any performance im

[GitHub] [hudi] CTTY commented on a diff in pull request #6752: [HUDI-4010] Improve docs on DynamoDB-based lock provider

2022-09-22 Thread GitBox
CTTY commented on code in PR #6752: URL: https://github.com/apache/hudi/pull/6752#discussion_r978236529 ## website/docs/concurrency_control.md: ## @@ -71,16 +71,26 @@ hoodie.write.lock.hivemetastore.table **`Amazon DynamoDB`** based lock provider -Amazon DynamoDB based lock

[jira] [Updated] (HUDI-4902) Set default partitioner for SIMPLE BUCKET index

2022-09-22 Thread xi chaomin (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xi chaomin updated HUDI-4902: - Summary: Set default partitioner for SIMPLE BUCKET index (was: Add default partitioner for SIMPLE BUCKET

[jira] [Updated] (HUDI-4902) Add default partitioner for SIMPLE BUCKET index

2022-09-22 Thread xi chaomin (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xi chaomin updated HUDI-4902: - Description: https://github.com/apache/hudi/issues/6723 > Add default partitioner for SIMPLE BUCKET index

[jira] [Created] (HUDI-4902) Add default partitioner for SIMPLE BUCKET index

2022-09-22 Thread xi chaomin (Jira)
xi chaomin created HUDI-4902: Summary: Add default partitioner for SIMPLE BUCKET index Key: HUDI-4902 URL: https://issues.apache.org/jira/browse/HUDI-4902 Project: Apache Hudi Issue Type: Bug

[GitHub] [hudi] hudi-bot commented on pull request #4015: [HUDI-2780] Fix the issue of Mor log skipping complete blocks when reading data

2022-09-22 Thread GitBox
hudi-bot commented on PR #4015: URL: https://github.com/apache/hudi/pull/4015#issuecomment-1255754893 ## CI report: * e1cf530fbae41de33cb9cc76a16a2e6dc5425837 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1156

[GitHub] [hudi] hudi-bot commented on pull request #4015: [HUDI-2780] Fix the issue of Mor log skipping complete blocks when reading data

2022-09-22 Thread GitBox
hudi-bot commented on PR #4015: URL: https://github.com/apache/hudi/pull/4015#issuecomment-1255752139 ## CI report: * e1cf530fbae41de33cb9cc76a16a2e6dc5425837 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1156

[GitHub] [hudi] hudi-bot commented on pull request #6755: [HUDI-4899] Fixing compatibility w/ Spark 3.2.2

2022-09-22 Thread GitBox
hudi-bot commented on PR #6755: URL: https://github.com/apache/hudi/pull/6755#issuecomment-1255751119 ## CI report: * 1ce9bc21cc1c030dbb27db830eac936705dfbe8a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1159

[GitHub] [hudi] hudi-bot commented on pull request #6322: [HUDI-4559] Support hiveSync command based on Call Produce Command

2022-09-22 Thread GitBox
hudi-bot commented on PR #6322: URL: https://github.com/apache/hudi/pull/6322#issuecomment-1255750806 ## CI report: * a203be972420a40ee11ef7c5ce8c47f3e2651816 UNKNOWN * 4b652b9db0e26948b47e9e0d01838d18aa916a62 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #6322: [HUDI-4559] Support hiveSync command based on Call Produce Command

2022-09-22 Thread GitBox
hudi-bot commented on PR #6322: URL: https://github.com/apache/hudi/pull/6322#issuecomment-1255749011 ## CI report: * a203be972420a40ee11ef7c5ce8c47f3e2651816 UNKNOWN * 4b652b9db0e26948b47e9e0d01838d18aa916a62 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #6754: [MINOR] Fixing flaky test by drastically reducing concurrency level (to avoid CI flakiness)

2022-09-22 Thread GitBox
hudi-bot commented on PR #6754: URL: https://github.com/apache/hudi/pull/6754#issuecomment-1255747283 ## CI report: * 09ac01fd88b15fad1940c4b6c8753acf36ea1929 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1159

[GitHub] [hudi] hudi-bot commented on pull request #6744: [HUDI-4883] Supporting delete savepoint for MOR

2022-09-22 Thread GitBox
hudi-bot commented on PR #6744: URL: https://github.com/apache/hudi/pull/6744#issuecomment-1255747193 ## CI report: * dd05ac6ceec72a4639e301be790de528d6436242 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1159

[GitHub] [hudi] nsivabalan commented on pull request #6728: Update s3_hoodie.md

2022-09-22 Thread GitBox
nsivabalan commented on PR #6728: URL: https://github.com/apache/hudi/pull/6728#issuecomment-1255743421 CC @zhedoubushishi @rahil-c -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[hudi] branch master updated (a9e0823398 -> 4c0c1c7a6b)

2022-09-22 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from a9e0823398 [HUDI-3901] Correct the description of hoodie.index.type (#6749) add 4c0c1c7a6b [MINOR] Add .mvn dir

[GitHub] [hudi] nsivabalan merged pull request #6746: [MINOR] Add .mvn directory to gitignore

2022-09-22 Thread GitBox
nsivabalan merged PR #6746: URL: https://github.com/apache/hudi/pull/6746 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apach

[GitHub] [hudi] nsivabalan commented on a diff in pull request #6753: [HUDI-4734] Deltastreamer table config change validation

2022-09-22 Thread GitBox
nsivabalan commented on code in PR #6753: URL: https://github.com/apache/hudi/pull/6753#discussion_r978224183 ## hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/HoodieDeltaStreamer.java: ## @@ -435,92 +440,92 @@ public boolean equals(Object o) { }

[GitHub] [hudi] Zhangshunyu opened a new issue, #6758: [SUPPORT] Will metatable support partitions inside col_stat & files?

2022-09-22 Thread GitBox
Zhangshunyu opened a new issue, #6758: URL: https://github.com/apache/hudi/issues/6758 currenttly, the metatable of hudi stored in files dir and col_stat dir by some file groups, all the records together. however, with the size growth, the num of files and the size of col stat will incre

[GitHub] [hudi] eric9204 commented on pull request #6743: change avro version which is in the pom of hudi-flink-bundle to 1.10.0

2022-09-22 Thread GitBox
eric9204 commented on PR #6743: URL: https://github.com/apache/hudi/pull/6743#issuecomment-1255739525 Submitted some useless documents. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[GitHub] [hudi] nsivabalan commented on issue #5249: [SUPPORT] Deltastreamer job does not terminate on Kubernetes when hoodie.metrics.on=true

2022-09-22 Thread GitBox
nsivabalan commented on issue #5249: URL: https://github.com/apache/hudi/issues/5249#issuecomment-1255738253 going ahead and closing this for now. feel free to re-open or raise a new issue if you need any more assistance. thanks! -- This is an automated message from the Apache Git Service

[GitHub] [hudi] nsivabalan closed issue #5249: [SUPPORT] Deltastreamer job does not terminate on Kubernetes when hoodie.metrics.on=true

2022-09-22 Thread GitBox
nsivabalan closed issue #5249: [SUPPORT] Deltastreamer job does not terminate on Kubernetes when hoodie.metrics.on=true URL: https://github.com/apache/hudi/issues/5249 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[GitHub] [hudi] nsivabalan closed issue #6635: [SUPPORT] Failed to build hudi 0.12.0 with spark 3.2.2

2022-09-22 Thread GitBox
nsivabalan closed issue #6635: [SUPPORT] Failed to build hudi 0.12.0 with spark 3.2.2 URL: https://github.com/apache/hudi/issues/6635 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

[hudi] branch master updated: [HUDI-3901] Correct the description of hoodie.index.type (#6749)

2022-09-22 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new a9e0823398 [HUDI-3901] Correct the description

[GitHub] [hudi] nsivabalan merged pull request #6749: [HUDI-3901] Correct the description of hoodie.index.type

2022-09-22 Thread GitBox
nsivabalan merged PR #6749: URL: https://github.com/apache/hudi/pull/6749 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apach

[GitHub] [hudi] XuQianJin-Stars commented on pull request #6510: [HUDI-4724]Add function of skip the _rt suffix for read snapshot

2022-09-22 Thread GitBox
XuQianJin-Stars commented on PR #6510: URL: https://github.com/apache/hudi/pull/6510#issuecomment-1255723601 hi @linfey90 What is your WeChat ID? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [hudi] eric9204 closed pull request #6743: change avro version which is in the pom of hudi-flink-bundle to 1.10.0

2022-09-22 Thread GitBox
eric9204 closed pull request #6743: change avro version which is in the pom of hudi-flink-bundle to 1.10.0 URL: https://github.com/apache/hudi/pull/6743 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hudi] hudi-bot commented on pull request #6743: change avro version which is in the pom of hudi-flink-bundle to 1.10.0

2022-09-22 Thread GitBox
hudi-bot commented on PR #6743: URL: https://github.com/apache/hudi/pull/6743#issuecomment-1255722002 ## CI report: * c0c30b174eb3ab77340d1410fdfc4dd07019f45d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1157

[jira] [Updated] (HUDI-4805) Update docs for workaround to make HBase working with HDFS on Hadoop 3

2022-09-22 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4805: Status: Patch Available (was: In Progress) > Update docs for workaround to make HBase working with HDFS on

[GitHub] [hudi] XuQianJin-Stars commented on a diff in pull request #3888: [DO NOT MERGE][HUDI-2624] Implement Non Index type for HUDI

2022-09-22 Thread GitBox
XuQianJin-Stars commented on code in PR #3888: URL: https://github.com/apache/hudi/pull/3888#discussion_r978207406 ## hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/keygen/EmptyKeyGenerator.java: ## @@ -0,0 +1,80 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [hudi] hudi-bot commented on pull request #6757: [HUDI-4901] Add avro.version to Flink profiles

2022-09-22 Thread GitBox
hudi-bot commented on PR #6757: URL: https://github.com/apache/hudi/pull/6757#issuecomment-1255717217 ## CI report: * 741fa15085e5372373205a5c39a5f3ec7cb6ebf4 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1159

[GitHub] [hudi] hudi-bot commented on pull request #6736: [HUDI-4894] Fix ClassCastException when using fixed type defining dec…

2022-09-22 Thread GitBox
hudi-bot commented on PR #6736: URL: https://github.com/apache/hudi/pull/6736#issuecomment-1255717073 ## CI report: * e0dbecb1774312a529e22b072f2c01aa052ebafe Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1158

[GitHub] [hudi] XuQianJin-Stars commented on pull request #3888: [DO NOT MERGE][HUDI-2624] Implement Non Index type for HUDI

2022-09-22 Thread GitBox
XuQianJin-Stars commented on PR #3888: URL: https://github.com/apache/hudi/pull/3888#issuecomment-1255715604 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubsc

[GitHub] [hudi] hudi-bot commented on pull request #6736: [HUDI-4894] Fix ClassCastException when using fixed type defining dec…

2022-09-22 Thread GitBox
hudi-bot commented on PR #6736: URL: https://github.com/apache/hudi/pull/6736#issuecomment-1255714470 ## CI report: * e0dbecb1774312a529e22b072f2c01aa052ebafe Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1158

[GitHub] [hudi] hudi-bot commented on pull request #6757: [HUDI-4901] Add avro.version to Flink profiles

2022-09-22 Thread GitBox
hudi-bot commented on PR #6757: URL: https://github.com/apache/hudi/pull/6757#issuecomment-1255714539 ## CI report: * 741fa15085e5372373205a5c39a5f3ec7cb6ebf4 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #6719: [HUDI-4718] Add Kerberos kinit command support for cli.

2022-09-22 Thread GitBox
hudi-bot commented on PR #6719: URL: https://github.com/apache/hudi/pull/6719#issuecomment-1255714432 ## CI report: * 4b88f9a2c614e5002bdb029a267a6c351386357b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1151

[GitHub] [hudi] YuweiXiao commented on a diff in pull request #6636: [HUDI-4824]Add new index RANGE_BUCKET , when primary key is auto-increment like most mysql table

2022-09-22 Thread GitBox
YuweiXiao commented on code in PR #6636: URL: https://github.com/apache/hudi/pull/6636#discussion_r978203697 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/index/bucket/HoodieBucketIndex.java: ## @@ -64,6 +69,29 @@ public HoodieData updateLocation(HoodieData wr

[GitHub] [hudi] wangxianghu commented on pull request #6736: [HUDI-4894] Fix ClassCastException when using fixed type defining dec…

2022-09-22 Thread GitBox
wangxianghu commented on PR #6736: URL: https://github.com/apache/hudi/pull/6736#issuecomment-1255712449 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hudi] hudi-bot commented on pull request #6719: [HUDI-4718] Add Kerberos kinit command support for cli.

2022-09-22 Thread GitBox
hudi-bot commented on PR #6719: URL: https://github.com/apache/hudi/pull/6719#issuecomment-1255712355 ## CI report: * 4b88f9a2c614e5002bdb029a267a6c351386357b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1151

[GitHub] [hudi] hudi-bot commented on pull request #6561: [HUDI-4760] Fixing repeated trigger of data file creations w/ clustering

2022-09-22 Thread GitBox
hudi-bot commented on PR #6561: URL: https://github.com/apache/hudi/pull/6561#issuecomment-1255712057 ## CI report: * cad92079d20c6725f5e563ef7da0157e1491194a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1159

[GitHub] [hudi] paul8263 commented on pull request #6719: [HUDI-4718] Add Kerberos kinit command support for cli.

2022-09-22 Thread GitBox
paul8263 commented on PR #6719: URL: https://github.com/apache/hudi/pull/6719#issuecomment-1255705679 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] vamshigv commented on a diff in pull request #6752: [HUDI-4010] Improve docs on DynamoDB-based lock provider

2022-09-22 Thread GitBox
vamshigv commented on code in PR #6752: URL: https://github.com/apache/hudi/pull/6752#discussion_r978193381 ## website/docs/concurrency_control.md: ## @@ -71,16 +71,26 @@ hoodie.write.lock.hivemetastore.table **`Amazon DynamoDB`** based lock provider -Amazon DynamoDB based

[jira] [Updated] (HUDI-4901) Add avro version to Flink profiles

2022-09-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-4901: - Labels: pull-request-available (was: ) > Add avro version to Flink profiles > ---

[GitHub] [hudi] vamshigv commented on a diff in pull request #6752: [HUDI-4010] Improve docs on DynamoDB-based lock provider

2022-09-22 Thread GitBox
vamshigv commented on code in PR #6752: URL: https://github.com/apache/hudi/pull/6752#discussion_r978192289 ## website/docs/concurrency_control.md: ## @@ -71,16 +71,26 @@ hoodie.write.lock.hivemetastore.table **`Amazon DynamoDB`** based lock provider -Amazon DynamoDB based

  1   2   3   >