[GitHub] [hudi] vinothchandar commented on pull request #6111: [HUDI-4399][RFC-57] Protobuf support in DeltaStreamer

2022-07-14 Thread GitBox
vinothchandar commented on PR #6111: URL: https://github.com/apache/hudi/pull/6111#issuecomment-1185199244 cc @veenaypatil to review as well -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] vinothchandar commented on pull request #5370: [RFC-52][HUDI-3907] RFC for Introduce Secondary Index to Improve Hudi Query Performance

2022-07-14 Thread GitBox
vinothchandar commented on PR #5370: URL: https://github.com/apache/hudi/pull/5370#issuecomment-1185198919 @huberylee are you still actively driving this one -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hudi] hudi-bot commented on pull request #6110: [MINOR] Fix CI issue with TestHiveSyncTool

2022-07-14 Thread GitBox
hudi-bot commented on PR #6110: URL: https://github.com/apache/hudi/pull/6110#issuecomment-1185191531 ## CI report: * e8102bdaf85a2bf561aa54099f2c32ba493747c2 Azure:

[GitHub] [hudi] XuQianJin-Stars closed issue #6115: [SUPPORT] insert into supports writing by partition without specifying a partition field

2022-07-14 Thread GitBox
XuQianJin-Stars closed issue #6115: [SUPPORT] insert into supports writing by partition without specifying a partition field URL: https://github.com/apache/hudi/issues/6115 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [hudi] XuQianJin-Stars commented on issue #6115: [SUPPORT] insert into supports writing by partition without specifying a partition field

2022-07-14 Thread GitBox
XuQianJin-Stars commented on issue #6115: URL: https://github.com/apache/hudi/issues/6115#issuecomment-1185189223 Thank you @duxia , I have created a jira to track it [HUDI-4404](https://issues.apache.org/jira/browse/HUDI-4404) -- This is an automated message from the Apache Git Service.

[jira] [Created] (HUDI-4404) insert into supports writing by partition without specifying a partition field

2022-07-14 Thread Forward Xu (Jira)
Forward Xu created HUDI-4404: Summary: insert into supports writing by partition without specifying a partition field Key: HUDI-4404 URL: https://issues.apache.org/jira/browse/HUDI-4404 Project: Apache

[GitHub] [hudi] hudi-bot commented on pull request #6110: [MINOR] Fix CI issue with TestHiveSyncTool

2022-07-14 Thread GitBox
hudi-bot commented on PR #6110: URL: https://github.com/apache/hudi/pull/6110#issuecomment-1185185262 ## CI report: * 323203bc553a2fa043bf3cf08274d366aca4183b Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6110: [MINOR] Fix CI issue with TestHiveSyncTool

2022-07-14 Thread GitBox
hudi-bot commented on PR #6110: URL: https://github.com/apache/hudi/pull/6110#issuecomment-1185183221 ## CI report: * 323203bc553a2fa043bf3cf08274d366aca4183b Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6116: [HUDI-4403] Fix the end input metadata for bounded source

2022-07-14 Thread GitBox
hudi-bot commented on PR #6116: URL: https://github.com/apache/hudi/pull/6116#issuecomment-1185180567 ## CI report: * 0119cd9cd27e62acf3a331425161a9eecfee3c14 Azure:

[GitHub] [hudi] veenaypatil commented on a diff in pull request #6111: [HUDI-4399][RFC-57] Protobuf support in DeltaStreamer

2022-07-14 Thread GitBox
veenaypatil commented on code in PR #6111: URL: https://github.com/apache/hudi/pull/6111#discussion_r921799948 ## rfc/rfc-57/rfc-57.md: ## @@ -0,0 +1,76 @@ + +# RFC-56: DeltaStreamer Protobuf Support + + + +## Proposers + +- @the-other-tim-brown + +## Approvers +- @bhasudha +-

[GitHub] [hudi] hudi-bot commented on pull request #6116: [HUDI-4403] Fix the end input metadata for bounded source

2022-07-14 Thread GitBox
hudi-bot commented on PR #6116: URL: https://github.com/apache/hudi/pull/6116#issuecomment-1185160237 ## CI report: * 0119cd9cd27e62acf3a331425161a9eecfee3c14 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6110: [MINOR] Fix CI issue with TestHiveSyncTool

2022-07-14 Thread GitBox
hudi-bot commented on PR #6110: URL: https://github.com/apache/hudi/pull/6110#issuecomment-1185160219 ## CI report: * 323203bc553a2fa043bf3cf08274d366aca4183b Azure:

[jira] [Commented] (HUDI-4397) Flink Inline Cluster and Compact plan distribute strategy changed from rebalance to hash to avoid potential multiple threads accessing the same file

2022-07-14 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17567079#comment-17567079 ] Danny Chen commented on HUDI-4397: -- Fixed via master branch: b781b310452f117dd11c2cd5322b0cb4bea5c423 >

[jira] [Updated] (HUDI-4397) Flink Inline Cluster and Compact plan distribute strategy changed from rebalance to hash to avoid potential multiple threads accessing the same file

2022-07-14 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-4397: - Fix Version/s: 0.12.0 > Flink Inline Cluster and Compact plan distribute strategy changed from >

[jira] [Resolved] (HUDI-4397) Flink Inline Cluster and Compact plan distribute strategy changed from rebalance to hash to avoid potential multiple threads accessing the same file

2022-07-14 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-4397. -- > Flink Inline Cluster and Compact plan distribute strategy changed from > rebalance to hash to avoid

[hudi] branch master updated (4898ea52f7 -> b781b31045)

2022-07-14 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 4898ea52f7 [HUDI-4399][RFC-57] Claim RFC 57 for DeltaStreamer proto support (#6112) add b781b31045 [HUDI-4397]

[GitHub] [hudi] danny0405 merged pull request #6106: [HUDI-4397] Flink Inline Cluster and Compact plan distribute strategy…

2022-07-14 Thread GitBox
danny0405 merged PR #6106: URL: https://github.com/apache/hudi/pull/6106 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] danny0405 commented on pull request #6106: [HUDI-4397] Flink Inline Cluster and Compact plan distribute strategy…

2022-07-14 Thread GitBox
danny0405 commented on PR #6106: URL: https://github.com/apache/hudi/pull/6106#issuecomment-1185158566 Would just merge the PR because the failed cases has no relationship with this change. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [hudi] hudi-bot commented on pull request #6116: [HUDI-4403] Fix the end input metadata for bounded source

2022-07-14 Thread GitBox
hudi-bot commented on PR #6116: URL: https://github.com/apache/hudi/pull/6116#issuecomment-1185158416 ## CI report: * 0119cd9cd27e62acf3a331425161a9eecfee3c14 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #6110: [MINOR] Fix CI issue with TestHiveSyncTool

2022-07-14 Thread GitBox
hudi-bot commented on PR #6110: URL: https://github.com/apache/hudi/pull/6110#issuecomment-1185156076 ## CI report: * cac873afad599b437d2a7c51d443c165149743b5 Azure:

[jira] [Updated] (HUDI-4403) Fix the end input metadata for bounded source

2022-07-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-4403: - Labels: pull-request-available (was: ) > Fix the end input metadata for bounded source >

[GitHub] [hudi] danny0405 opened a new pull request, #6116: [HUDI-4403] Fix the end input metadata for bounded source

2022-07-14 Thread GitBox
danny0405 opened a new pull request, #6116: URL: https://github.com/apache/hudi/pull/6116 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the

[GitHub] [hudi] hudi-bot commented on pull request #6110: [MINOR] Fix CI issue with TestHiveSyncTool

2022-07-14 Thread GitBox
hudi-bot commented on PR #6110: URL: https://github.com/apache/hudi/pull/6110#issuecomment-1185154196 ## CI report: * cac873afad599b437d2a7c51d443c165149743b5 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6114: [HUDI-4401] Skip HBase version check

2022-07-14 Thread GitBox
hudi-bot commented on PR #6114: URL: https://github.com/apache/hudi/pull/6114#issuecomment-1185152205 ## CI report: * 43d3b020fb845e22aac0b7016e17f975d3839c8b Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6110: [MINOR] Fix CI issue with TestHiveSyncTool

2022-07-14 Thread GitBox
hudi-bot commented on PR #6110: URL: https://github.com/apache/hudi/pull/6110#issuecomment-1185152193 ## CI report: * cac873afad599b437d2a7c51d443c165149743b5 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5943: [HUDI-4186] Support Hudi with Spark 3.3.0

2022-07-14 Thread GitBox
hudi-bot commented on PR #5943: URL: https://github.com/apache/hudi/pull/5943#issuecomment-1185152050 ## CI report: * 11f86736fa2178953c766aa3c4dcb6aca9d96f6c Azure:

[GitHub] [hudi] duxia opened a new issue, #6115: [SUPPORT]支持分区路由

2022-07-14 Thread GitBox
duxia opened a new issue, #6115: URL: https://github.com/apache/hudi/issues/6115 当前只能使用insert into table xxx partition(a) 期望insert into table xxx时,支持自动分区路由功能 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Created] (HUDI-4403) Fix the end input metadata for bounded source

2022-07-14 Thread Danny Chen (Jira)
Danny Chen created HUDI-4403: Summary: Fix the end input metadata for bounded source Key: HUDI-4403 URL: https://issues.apache.org/jira/browse/HUDI-4403 Project: Apache Hudi Issue Type: Bug

[GitHub] [hudi] JerryYue-M commented on a diff in pull request #6100: [HUDI-4392]Flink MOR table compaction plan execution sequence should …

2022-07-14 Thread GitBox
JerryYue-M commented on code in PR #6100: URL: https://github.com/apache/hudi/pull/6100#discussion_r921787885 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/configuration/FlinkOptions.java: ## @@ -502,6 +503,14 @@ private FlinkOptions() {

[GitHub] [hudi] fengjian428 commented on issue #6058: [SUPPORT] Incremental and snapshot reads shows different results

2022-07-14 Thread GitBox
fengjian428 commented on issue #6058: URL: https://github.com/apache/hudi/issues/6058#issuecomment-1185133728 create a Jira ticket to track https://issues.apache.org/jira/browse/HUDI-4402 -- This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Created] (HUDI-4402) Incremental query should filter data out by "hoodie.datasource.read.begin.instanttime"

2022-07-14 Thread Jian Feng (Jira)
Jian Feng created HUDI-4402: --- Summary: Incremental query should filter data out by "hoodie.datasource.read.begin.instanttime" Key: HUDI-4402 URL: https://issues.apache.org/jira/browse/HUDI-4402 Project:

[GitHub] [hudi] hudi-bot commented on pull request #6110: [MINOR] Fix CI issue with TestHiveSyncTool

2022-07-14 Thread GitBox
hudi-bot commented on PR #6110: URL: https://github.com/apache/hudi/pull/6110#issuecomment-1185130208 ## CI report: * 34a60ce6d1f72830bfc64b5365d02ca5cd84b10a Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6110: [MINOR] Fix CI issue with TestHiveSyncTool

2022-07-14 Thread GitBox
hudi-bot commented on PR #6110: URL: https://github.com/apache/hudi/pull/6110#issuecomment-1185122501 ## CI report: * 34a60ce6d1f72830bfc64b5365d02ca5cd84b10a Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5943: [HUDI-4186] Support Hudi with Spark 3.3.0

2022-07-14 Thread GitBox
hudi-bot commented on PR #5943: URL: https://github.com/apache/hudi/pull/5943#issuecomment-1185121021 ## CI report: * 925cca43e07501a3c40d9f2225583826e5cbdd97 Azure:

[GitHub] [hudi] microbearz commented on a diff in pull request #5064: [HUDI-3654] Initialize hudi metastore module.

2022-07-14 Thread GitBox
microbearz commented on code in PR #5064: URL: https://github.com/apache/hudi/pull/5064#discussion_r919693379 ## hudi-metastore/src/main/java/org/apache/hudi/metastore/client/HoodieMetastoreClient.java: ## @@ -0,0 +1,56 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [hudi] hudi-bot commented on pull request #6110: [MINOR] Fix CI issue with TestHiveSyncTool

2022-07-14 Thread GitBox
hudi-bot commented on PR #6110: URL: https://github.com/apache/hudi/pull/6110#issuecomment-1185118899 ## CI report: * 34a60ce6d1f72830bfc64b5365d02ca5cd84b10a Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5943: [HUDI-4186] Support Hudi with Spark 3.3.0

2022-07-14 Thread GitBox
hudi-bot commented on PR #5943: URL: https://github.com/apache/hudi/pull/5943#issuecomment-1185118709 ## CI report: * 925cca43e07501a3c40d9f2225583826e5cbdd97 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5470: [HUDI-3993] Replacing UDF in Bulk Insert w/ RDD transformation

2022-07-14 Thread GitBox
hudi-bot commented on PR #5470: URL: https://github.com/apache/hudi/pull/5470#issuecomment-1185118380 ## CI report: * 52a72e09bb9724d845218eb5c408523706af5a78 Azure:

[GitHub] [hudi] boneanxs commented on pull request #6046: [HUDI-4363] Support Clustering row writer to improve performance

2022-07-14 Thread GitBox
boneanxs commented on PR #6046: URL: https://github.com/apache/hudi/pull/6046#issuecomment-1185103626 > @boneanxs my wechat 1037817390, let's disscuss this pr in wechat first. i think we can lanch this pr in 0.12 Sure -- This is an automated message from the Apache Git Service. To

[GitHub] [hudi] fengjian428 closed pull request #6109: [Hudi-4398] Allow retry in ZookeeperBasedLockProvider

2022-07-14 Thread GitBox
fengjian428 closed pull request #6109: [Hudi-4398] Allow retry in ZookeeperBasedLockProvider URL: https://github.com/apache/hudi/pull/6109 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] hudi-bot commented on pull request #6105: Make Spark3 the default profile

2022-07-14 Thread GitBox
hudi-bot commented on PR #6105: URL: https://github.com/apache/hudi/pull/6105#issuecomment-1185097887 ## CI report: * ec2ecf42597af2586cd3864b297f15b881cf204d UNKNOWN * 9cd547bc31a30d3b51330922586730615bdb7adb Azure:

[GitHub] [hudi] YuweiXiao commented on pull request #4958: [HUDI-3558] Consistent bucket index: bucket resizing (split) & concurrent write during resizing

2022-07-14 Thread GitBox
YuweiXiao commented on PR #4958: URL: https://github.com/apache/hudi/pull/4958#issuecomment-1185094581 @codope The IT failure is fixed. But there is a UT related to hive-sync-tool is broken because of CI env. Seems other PRs are also affected. -- This is an automated message from the

[GitHub] [hudi] hudi-bot commented on pull request #6114: [HUDI-4401] Skip HBase version check

2022-07-14 Thread GitBox
hudi-bot commented on PR #6114: URL: https://github.com/apache/hudi/pull/6114#issuecomment-1185093868 ## CI report: * 43d3b020fb845e22aac0b7016e17f975d3839c8b Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5470: [HUDI-3993] Replacing UDF in Bulk Insert w/ RDD transformation

2022-07-14 Thread GitBox
hudi-bot commented on PR #5470: URL: https://github.com/apache/hudi/pull/5470#issuecomment-1185093460 ## CI report: * dc912614b9f4217bac743897810774e172cf81ac Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6114: [HUDI-4401] Skip HBase version check

2022-07-14 Thread GitBox
hudi-bot commented on PR #6114: URL: https://github.com/apache/hudi/pull/6114#issuecomment-1185092010 ## CI report: * 43d3b020fb845e22aac0b7016e17f975d3839c8b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #6110: [MINOR] Fix CI issue with TestHiveSyncTool

2022-07-14 Thread GitBox
hudi-bot commented on PR #6110: URL: https://github.com/apache/hudi/pull/6110#issuecomment-1185091990 ## CI report: * 0e9e53345f1d5d7075c160330ce90a111dfb3d54 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6106: [HUDI-4397] Flink Inline Cluster and Compact plan distribute strategy…

2022-07-14 Thread GitBox
hudi-bot commented on PR #6106: URL: https://github.com/apache/hudi/pull/6106#issuecomment-1185091971 ## CI report: * 54df0acef9c32b435b53998350558673b02b083d Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5470: [HUDI-3993] Replacing UDF in Bulk Insert w/ RDD transformation

2022-07-14 Thread GitBox
hudi-bot commented on PR #5470: URL: https://github.com/apache/hudi/pull/5470#issuecomment-1185091578 ## CI report: * dc912614b9f4217bac743897810774e172cf81ac Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6110: [MINOR] Fix CI issue with TestHiveSyncTool

2022-07-14 Thread GitBox
hudi-bot commented on PR #6110: URL: https://github.com/apache/hudi/pull/6110#issuecomment-1185090289 ## CI report: * 0e9e53345f1d5d7075c160330ce90a111dfb3d54 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6113: [HUDI-4400] Fix missing bloom filters in metadata table in non-partitioned table

2022-07-14 Thread GitBox
hudi-bot commented on PR #6113: URL: https://github.com/apache/hudi/pull/6113#issuecomment-1185090301 ## CI report: * 445f9da3a360ea62ddd71e7669a9973e8a8bb2ff Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6106: [HUDI-4397] Flink Inline Cluster and Compact plan distribute strategy…

2022-07-14 Thread GitBox
hudi-bot commented on PR #6106: URL: https://github.com/apache/hudi/pull/6106#issuecomment-1185090259 ## CI report: * 54df0acef9c32b435b53998350558673b02b083d Azure:

[jira] [Updated] (HUDI-4401) Disable HBase version check in hbase-site.xml

2022-07-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-4401: - Labels: pull-request-available (was: ) > Disable HBase version check in hbase-site.xml >

[GitHub] [hudi] yihua opened a new pull request, #6114: [HUDI-4401] Skip HBase version check

2022-07-14 Thread GitBox
yihua opened a new pull request, #6114: URL: https://github.com/apache/hudi/pull/6114 ## What is the purpose of the pull request This PR changes the `hbase.defaults.for.version.skip` config to true instead of false as default in `hbase-site.xml` under `hudi-common/src/main/resources`

[jira] [Updated] (HUDI-4401) Disable HBase version check in hbase-site.xml

2022-07-14 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4401: Fix Version/s: 0.12.0 > Disable HBase version check in hbase-site.xml >

[jira] [Updated] (HUDI-4401) Disable HBase version check in hbase-site.xml

2022-07-14 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4401: Description: The HBase version check (hbase.defaults.for.version.skip), enabled by default, can cause

[jira] [Updated] (HUDI-4401) Disable HBase version check in hbase-site.xml

2022-07-14 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4401: Component/s: metadata > Disable HBase version check in hbase-site.xml >

[jira] [Created] (HUDI-4401) Disable HBase version check in hbase-site.xml

2022-07-14 Thread Ethan Guo (Jira)
Ethan Guo created HUDI-4401: --- Summary: Disable HBase version check in hbase-site.xml Key: HUDI-4401 URL: https://issues.apache.org/jira/browse/HUDI-4401 Project: Apache Hudi Issue Type:

[GitHub] [hudi] danny0405 commented on pull request #6106: [HUDI-4397] Flink Inline Cluster and Compact plan distribute strategy…

2022-07-14 Thread GitBox
danny0405 commented on PR #6106: URL: https://github.com/apache/hudi/pull/6106#issuecomment-1185074977 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[hudi] branch master updated (05606708fa -> 4898ea52f7)

2022-07-14 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 05606708fa [HUDI-4393] Add marker file for target file when flink merge handle rolls over (#6103) add 4898ea52f7

[GitHub] [hudi] yihua merged pull request #6112: [HUDI-4399][RFC-57] Claim RFC 57 for DeltaStreamer proto support

2022-07-14 Thread GitBox
yihua merged PR #6112: URL: https://github.com/apache/hudi/pull/6112 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] hudi-bot commented on pull request #6113: [HUDI-4400] Fix missing bloom filters in metadata table in non-partitioned table

2022-07-14 Thread GitBox
hudi-bot commented on PR #6113: URL: https://github.com/apache/hudi/pull/6113#issuecomment-1185070603 ## CI report: * 445f9da3a360ea62ddd71e7669a9973e8a8bb2ff Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6110: [MINOR] Fix CI issue with TestHiveSyncTool

2022-07-14 Thread GitBox
hudi-bot commented on PR #6110: URL: https://github.com/apache/hudi/pull/6110#issuecomment-1185070590 ## CI report: * 0e9e53345f1d5d7075c160330ce90a111dfb3d54 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6113: [HUDI-4400] Fix missing bloom filters in metadata table in non-partitioned table

2022-07-14 Thread GitBox
hudi-bot commented on PR #6113: URL: https://github.com/apache/hudi/pull/6113#issuecomment-1185068448 ## CI report: * 445f9da3a360ea62ddd71e7669a9973e8a8bb2ff UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[jira] [Updated] (HUDI-4400) Fix missing bloom filters in metadata table in non-partitioned table

2022-07-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-4400: - Labels: bloom-filter metadata pull-request-available (was: bloom-filter metadata) > Fix missing

[GitHub] [hudi] yihua opened a new pull request, #6113: [HUDI-4400] Fix missing bloom filters in metadata table in non-partitioned table

2022-07-14 Thread GitBox
yihua opened a new pull request, #6113: URL: https://github.com/apache/hudi/pull/6113 ## What is the purpose of the pull request This PR fixes the missing bloom filters in metadata table in the non-partitioned table due to incorrect record key generation. Before this PR, the file

[GitHub] [hudi] hudi-bot commented on pull request #6110: [MINOR] Fix CI issue with TestHiveSyncTool

2022-07-14 Thread GitBox
hudi-bot commented on PR #6110: URL: https://github.com/apache/hudi/pull/6110#issuecomment-1185064059 ## CI report: * b7c50188d25a95c918fb8cebb56d28916334ddaf Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6105: Make Spark3 the default profile

2022-07-14 Thread GitBox
hudi-bot commented on PR #6105: URL: https://github.com/apache/hudi/pull/6105#issuecomment-1185064026 ## CI report: * ec2ecf42597af2586cd3864b297f15b881cf204d UNKNOWN * 1a2a537e4753d673e4b040ac4b90580fcc8e71f2 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6110: [MINOR] Fix CI issue with TestHiveSyncTool

2022-07-14 Thread GitBox
hudi-bot commented on PR #6110: URL: https://github.com/apache/hudi/pull/6110#issuecomment-1185062101 ## CI report: * b7c50188d25a95c918fb8cebb56d28916334ddaf Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6105: Make Spark3 the default profile

2022-07-14 Thread GitBox
hudi-bot commented on PR #6105: URL: https://github.com/apache/hudi/pull/6105#issuecomment-1185062058 ## CI report: * ec2ecf42597af2586cd3864b297f15b881cf204d UNKNOWN * 1a2a537e4753d673e4b040ac4b90580fcc8e71f2 Azure:

[jira] [Updated] (HUDI-4400) Fix missing bloom filters in metadata table in non-partitioned table

2022-07-14 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4400: Description: When doing upserts with Bloom Index using metadata table for a non-partitioned table, the

[jira] [Updated] (HUDI-4400) Fix missing bloom filters in metadata table in non-partitioned table

2022-07-14 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4400: Epic Link: HUDI-3249 > Fix missing bloom filters in metadata table in non-partitioned table >

[jira] [Updated] (HUDI-4400) Fix missing bloom filters in metadata table in non-partitioned table

2022-07-14 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4400: Story Points: 3 > Fix missing bloom filters in metadata table in non-partitioned table >

[GitHub] [hudi] hudi-bot commented on pull request #6105: Make Spark3 the default profile

2022-07-14 Thread GitBox
hudi-bot commented on PR #6105: URL: https://github.com/apache/hudi/pull/6105#issuecomment-1185033312 ## CI report: * ec2ecf42597af2586cd3864b297f15b881cf204d UNKNOWN * Unknown: [CANCELED](TBD) * 1a2a537e4753d673e4b040ac4b90580fcc8e71f2 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6105: Make Spark3 the default profile

2022-07-14 Thread GitBox
hudi-bot commented on PR #6105: URL: https://github.com/apache/hudi/pull/6105#issuecomment-1185031538 ## CI report: * ec2ecf42597af2586cd3864b297f15b881cf204d UNKNOWN * Unknown: [CANCELED](TBD) * 7b7b087fb8adab2e3546c55397b9db2efc106a9b Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6105: Make Spark3 the default profile

2022-07-14 Thread GitBox
hudi-bot commented on PR #6105: URL: https://github.com/apache/hudi/pull/6105#issuecomment-1185029280 ## CI report: * ec2ecf42597af2586cd3864b297f15b881cf204d UNKNOWN * Unknown: [CANCELED](TBD) * 7b7b087fb8adab2e3546c55397b9db2efc106a9b Azure:

[jira] [Updated] (HUDI-4400) Fix missing bloom filters in metadata table in non-partitioned table

2022-07-14 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4400: Labels: bloom-filter metadata (was: ) > Fix missing bloom filters in metadata table in non-partitioned

[jira] [Updated] (HUDI-4400) Fix missing bloom filters in metadata table in non-partitioned table

2022-07-14 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4400: Component/s: metadata > Fix missing bloom filters in metadata table in non-partitioned table >

[jira] [Updated] (HUDI-4400) Fix missing bloom filters in metadata table in non-partitioned table

2022-07-14 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4400: Affects Version/s: 0.11.1 0.11.0 > Fix missing bloom filters in metadata table in

[jira] [Updated] (HUDI-4400) Fix missing bloom filters in metadata table in non-partitioned table

2022-07-14 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4400: Priority: Blocker (was: Major) > Fix missing bloom filters in metadata table in non-partitioned table >

[jira] [Updated] (HUDI-4400) Fix missing bloom filters in metadata table in non-partitioned table

2022-07-14 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4400: Issue Type: Bug (was: Improvement) > Fix missing bloom filters in metadata table in non-partitioned table

[jira] [Updated] (HUDI-4400) Fix missing bloom filters in metadata table in non-partitioned table

2022-07-14 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4400: Status: In Progress (was: Open) > Fix missing bloom filters in metadata table in non-partitioned table >

[jira] [Updated] (HUDI-4400) Fix missing bloom filters in metadata table in non-partitioned table

2022-07-14 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4400: Fix Version/s: 0.12.0 > Fix missing bloom filters in metadata table in non-partitioned table >

[jira] [Created] (HUDI-4400) Fix missing bloom filters in metadata table in non-partitioned table

2022-07-14 Thread Ethan Guo (Jira)
Ethan Guo created HUDI-4400: --- Summary: Fix missing bloom filters in metadata table in non-partitioned table Key: HUDI-4400 URL: https://issues.apache.org/jira/browse/HUDI-4400 Project: Apache Hudi

[jira] [Assigned] (HUDI-4400) Fix missing bloom filters in metadata table in non-partitioned table

2022-07-14 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo reassigned HUDI-4400: --- Assignee: Ethan Guo > Fix missing bloom filters in metadata table in non-partitioned table >

[GitHub] [hudi] rahil-c commented on pull request #6105: Make Spark3 the default profile

2022-07-14 Thread GitBox
rahil-c commented on PR #6105: URL: https://github.com/apache/hudi/pull/6105#issuecomment-1184975832 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hudi] yihua commented on issue #6089: [SUPPORT] Upgrading to 0.11.1 resulting use sparksql

2022-07-14 Thread GitBox
yihua commented on issue #6089: URL: https://github.com/apache/hudi/issues/6089#issuecomment-1184974827 > I try modify the \hudi\hudi-common\src\main\resources\hbase-site.xml ,setting hbase.defaults.for.version.skip to true It looks work well。 @jiangbiao910 Sounds good. I'll put

[GitHub] [hudi] hudi-bot commented on pull request #6110: [MINOR] Fix CI issue with TestHiveSyncTool

2022-07-14 Thread GitBox
hudi-bot commented on PR #6110: URL: https://github.com/apache/hudi/pull/6110#issuecomment-1184969409 ## CI report: * b7c50188d25a95c918fb8cebb56d28916334ddaf Azure:

[GitHub] [hudi] the-other-tim-brown opened a new pull request, #6112: [HUDI-4399][RFC-57] claim RFC 57 for DeltaStreamer proto support

2022-07-14 Thread GitBox
the-other-tim-brown opened a new pull request, #6112: URL: https://github.com/apache/hudi/pull/6112 ## What is the purpose of the pull request Add slot for RFC-57 ## Brief change log *(for example:)* - *Modify AnnotationLocation checkstyle rule in

[GitHub] [hudi] hudi-bot commented on pull request #6110: [MINOR] Fix CI issue with TestHiveSyncTool

2022-07-14 Thread GitBox
hudi-bot commented on PR #6110: URL: https://github.com/apache/hudi/pull/6110#issuecomment-1184964765 ## CI report: * cd6b09511e67b22202171e3416872fbc72b29741 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6105: Make Spark3 the default profile

2022-07-14 Thread GitBox
hudi-bot commented on PR #6105: URL: https://github.com/apache/hudi/pull/6105#issuecomment-1184964738 ## CI report: * ec2ecf42597af2586cd3864b297f15b881cf204d UNKNOWN * Unknown: [CANCELED](TBD) * 7b7b087fb8adab2e3546c55397b9db2efc106a9b Azure:

[GitHub] [hudi] rahil-c commented on pull request #6105: Make Spark3 the default profile

2022-07-14 Thread GitBox
rahil-c commented on PR #6105: URL: https://github.com/apache/hudi/pull/6105#issuecomment-1184963602 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hudi] hudi-bot commented on pull request #6105: Make Spark3 the default profile

2022-07-14 Thread GitBox
hudi-bot commented on PR #6105: URL: https://github.com/apache/hudi/pull/6105#issuecomment-1184959958 ## CI report: * ec2ecf42597af2586cd3864b297f15b881cf204d UNKNOWN * 94d3afef10aeb83f0d8885c288c523f59e71e064 Azure:

[GitHub] [hudi] rahil-c commented on pull request #6105: Make Spark3 the default profile

2022-07-14 Thread GitBox
rahil-c commented on PR #6105: URL: https://github.com/apache/hudi/pull/6105#issuecomment-1184957883 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[jira] [Updated] (HUDI-4399) [UMBRELLA] Add Protobuf source type for DeltaStreamer

2022-07-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-4399: - Labels: pull-request-available (was: ) > [UMBRELLA] Add Protobuf source type for DeltaStreamer >

[GitHub] [hudi] the-other-tim-brown opened a new pull request, #6111: [HUDI-4399][RFC-57] Protobuf support in DeltaStreamer

2022-07-14 Thread GitBox
the-other-tim-brown opened a new pull request, #6111: URL: https://github.com/apache/hudi/pull/6111 ## What is the purpose of the pull request RFC for adding support for Protobuf in the DeltaStreamer along with a Protobuf+kafka source for the delta streamer ## Brief change log

[GitHub] [hudi] suryaprasanna commented on a diff in pull request #5681: [HUDI-4148] Preparations and client for hudi table manager service

2022-07-14 Thread GitBox
suryaprasanna commented on code in PR #5681: URL: https://github.com/apache/hudi/pull/5681#discussion_r921413669 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/table/manager/HoodieTableManagerClient.java: ## @@ -0,0 +1,191 @@ +/* + * Licensed to the

[GitHub] [hudi] hudi-bot commented on pull request #6105: Make Spark3 the default profile

2022-07-14 Thread GitBox
hudi-bot commented on PR #6105: URL: https://github.com/apache/hudi/pull/6105#issuecomment-1184921057 ## CI report: * ec2ecf42597af2586cd3864b297f15b881cf204d UNKNOWN * 94d3afef10aeb83f0d8885c288c523f59e71e064 Azure:

[GitHub] [hudi] CTTY commented on pull request #5943: [HUDI-4186] Support Hudi with Spark 3.3.0

2022-07-14 Thread GitBox
CTTY commented on PR #5943: URL: https://github.com/apache/hudi/pull/5943#issuecomment-1184918189 Most hive sync CI tests are failing. I saw another PR working on this: https://github.com/apache/hudi/pull/6110 -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hudi] hudi-bot commented on pull request #6110: [MINOR] Fix CI issue with TestHiveSyncTool

2022-07-14 Thread GitBox
hudi-bot commented on PR #6110: URL: https://github.com/apache/hudi/pull/6110#issuecomment-1184915300 ## CI report: * cd6b09511e67b22202171e3416872fbc72b29741 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5943: [HUDI-4186] Support Hudi with Spark 3.3.0

2022-07-14 Thread GitBox
hudi-bot commented on PR #5943: URL: https://github.com/apache/hudi/pull/5943#issuecomment-1184914987 ## CI report: * 925cca43e07501a3c40d9f2225583826e5cbdd97 Azure:

  1   2   3   >