[GitHub] [hudi] hudi-bot commented on pull request #5529: add table info to jobStatus

2022-05-07 Thread GitBox
hudi-bot commented on PR #5529: URL: https://github.com/apache/hudi/pull/5529#issuecomment-1120355823 ## CI report: * d48a40df1c11135aac6676ae9efb99dffd35c0ef Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8497

[GitHub] [hudi] hudi-bot commented on pull request #5529: add table info to jobStatus

2022-05-07 Thread GitBox
hudi-bot commented on PR #5529: URL: https://github.com/apache/hudi/pull/5529#issuecomment-1120349567 ## CI report: * 752b3b64ce68e7878abfa4762e5f7d96e1ab8cc0 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8493

[GitHub] [hudi] hudi-bot commented on pull request #5529: add table info to jobStatus

2022-05-07 Thread GitBox
hudi-bot commented on PR #5529: URL: https://github.com/apache/hudi/pull/5529#issuecomment-1120349356 ## CI report: * 752b3b64ce68e7878abfa4762e5f7d96e1ab8cc0 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8493

[GitHub] [hudi] danny0405 commented on issue #5020: [SUPPORT] The cleaning strategy breaks the reader view completeness

2022-05-07 Thread GitBox
danny0405 commented on issue #5020: URL: https://github.com/apache/hudi/issues/5020#issuecomment-1120348627 Yes, we may need to work to find a solution in release 0.12.0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [hudi] xushiyan commented on pull request #5525: Update cli.md

2022-05-07 Thread GitBox
xushiyan commented on PR #5525: URL: https://github.com/apache/hudi/pull/5525#issuecomment-1120344095 @huzk8 can you also update the latest docs version pls? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [hudi] dongkelun commented on pull request #5406: [HUDI-3954] Don't keep the last commit before the earliest commit to retain

2022-05-07 Thread GitBox
dongkelun commented on PR #5406: URL: https://github.com/apache/hudi/pull/5406#issuecomment-1120339108 > @dongkelun I guess there is some confusion with respect to the documentation for the said config. I have added a review comment [#4927 (comment)](https://github.com/apache/hudi/pull/4927

[jira] [Assigned] (HUDI-2877) Support flink catalog to help user use flink table conveniently

2022-05-07 Thread Forward Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Forward Xu reassigned HUDI-2877: Assignee: Forward Xu > Support flink catalog to help user use flink table conveniently > --

[jira] [Assigned] (HUDI-2877) Support flink catalog to help user use flink table conveniently

2022-05-07 Thread Forward Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Forward Xu reassigned HUDI-2877: Assignee: dalongliu (was: Forward Xu) > Support flink catalog to help user use flink table conveni

[GitHub] [hudi] hudi-bot commented on pull request #5402: [WIP] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default

2022-05-07 Thread GitBox
hudi-bot commented on PR #5402: URL: https://github.com/apache/hudi/pull/5402#issuecomment-1120324840 ## CI report: * 8c6f6e19940ce7ac04dfcfce52da3ccdaf3a8b0f UNKNOWN * c4799803cff8adffef56e889a5cd4d52599fcf73 UNKNOWN * 009257835fa8b5e85aa423de62f7a0c542ab2dc4 Azure: [FAILUR

[GitHub] [hudi] hudi-bot commented on pull request #5402: [WIP] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default

2022-05-07 Thread GitBox
hudi-bot commented on PR #5402: URL: https://github.com/apache/hudi/pull/5402#issuecomment-1120324486 ## CI report: * 8c6f6e19940ce7ac04dfcfce52da3ccdaf3a8b0f UNKNOWN * 2d8f4554db396f996fd91bf6a6228a2fe18db753 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #5402: [WIP] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default

2022-05-07 Thread GitBox
hudi-bot commented on PR #5402: URL: https://github.com/apache/hudi/pull/5402#issuecomment-1120323911 ## CI report: * 8c6f6e19940ce7ac04dfcfce52da3ccdaf3a8b0f UNKNOWN * 2d8f4554db396f996fd91bf6a6228a2fe18db753 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #5402: [WIP] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default

2022-05-07 Thread GitBox
hudi-bot commented on PR #5402: URL: https://github.com/apache/hudi/pull/5402#issuecomment-1120323640 ## CI report: * 8c6f6e19940ce7ac04dfcfce52da3ccdaf3a8b0f UNKNOWN * 2d8f4554db396f996fd91bf6a6228a2fe18db753 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] rahil-c commented on pull request #5402: [WIP] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default

2022-05-07 Thread GitBox
rahil-c commented on PR #5402: URL: https://github.com/apache/hudi/pull/5402#issuecomment-1120322130 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] hudi-bot commented on pull request #5402: [WIP] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default

2022-05-07 Thread GitBox
hudi-bot commented on PR #5402: URL: https://github.com/apache/hudi/pull/5402#issuecomment-1120319108 ## CI report: * 8c6f6e19940ce7ac04dfcfce52da3ccdaf3a8b0f UNKNOWN * 2d8f4554db396f996fd91bf6a6228a2fe18db753 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] rahil-c commented on pull request #5402: [WIP] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default

2022-05-07 Thread GitBox
rahil-c commented on PR #5402: URL: https://github.com/apache/hudi/pull/5402#issuecomment-1120318849 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] hudi-bot commented on pull request #5402: [WIP] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default

2022-05-07 Thread GitBox
hudi-bot commented on PR #5402: URL: https://github.com/apache/hudi/pull/5402#issuecomment-1120318817 ## CI report: * 8c6f6e19940ce7ac04dfcfce52da3ccdaf3a8b0f UNKNOWN * 2d8f4554db396f996fd91bf6a6228a2fe18db753 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #5402: [WIP] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default

2022-05-07 Thread GitBox
hudi-bot commented on PR #5402: URL: https://github.com/apache/hudi/pull/5402#issuecomment-1120318201 ## CI report: * 8c6f6e19940ce7ac04dfcfce52da3ccdaf3a8b0f UNKNOWN * 2d8f4554db396f996fd91bf6a6228a2fe18db753 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #5402: [WIP] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default

2022-05-07 Thread GitBox
hudi-bot commented on PR #5402: URL: https://github.com/apache/hudi/pull/5402#issuecomment-1120317893 ## CI report: * 8c6f6e19940ce7ac04dfcfce52da3ccdaf3a8b0f UNKNOWN * f82fcab46576480fb96a39c32f1fda05403bdaf5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #5402: [WIP] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default

2022-05-07 Thread GitBox
hudi-bot commented on PR #5402: URL: https://github.com/apache/hudi/pull/5402#issuecomment-1120317365 ## CI report: * 8c6f6e19940ce7ac04dfcfce52da3ccdaf3a8b0f UNKNOWN * f82fcab46576480fb96a39c32f1fda05403bdaf5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[hudi] branch master updated: [MINOR] fixing flaky tests in deltastreamer tests (#5521)

2022-05-07 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 569a76a9a5 [MINOR] fixing flaky tests in deltas

[GitHub] [hudi] nsivabalan merged pull request #5521: [MINOR] fixing flaky parquet tests in deltastreamer tests

2022-05-07 Thread GitBox
nsivabalan merged PR #5521: URL: https://github.com/apache/hudi/pull/5521 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apach

[GitHub] [hudi] hudi-bot commented on pull request #5529: add table info to jobStatus

2022-05-07 Thread GitBox
hudi-bot commented on PR #5529: URL: https://github.com/apache/hudi/pull/5529#issuecomment-1120261568 ## CI report: * 752b3b64ce68e7878abfa4762e5f7d96e1ab8cc0 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8493

[GitHub] [hudi] hudi-bot commented on pull request #5520: HUDI-3922 parse record key + partition path config consistently between keygens and HiveSync

2022-05-07 Thread GitBox
hudi-bot commented on PR #5520: URL: https://github.com/apache/hudi/pull/5520#issuecomment-1120252411 ## CI report: * 32733bdaa9822bf44c251b7e0622c3dc065664bb Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8492

[GitHub] [hudi] hudi-bot commented on pull request #5529: add table info to jobStatus

2022-05-07 Thread GitBox
hudi-bot commented on PR #5529: URL: https://github.com/apache/hudi/pull/5529#issuecomment-1120238278 ## CI report: * 752b3b64ce68e7878abfa4762e5f7d96e1ab8cc0 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #5529: add table info to jobStatus

2022-05-07 Thread GitBox
hudi-bot commented on PR #5529: URL: https://github.com/apache/hudi/pull/5529#issuecomment-1120238753 ## CI report: * 752b3b64ce68e7878abfa4762e5f7d96e1ab8cc0 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8493

[GitHub] [hudi] hudi-bot commented on pull request #5520: HUDI-3922 parse record key + partition path config consistently between keygens and HiveSync

2022-05-07 Thread GitBox
hudi-bot commented on PR #5520: URL: https://github.com/apache/hudi/pull/5520#issuecomment-1120238737 ## CI report: * 3631a4c298bcb467da356253455c4b809038b837 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8477

[GitHub] [hudi] hudi-bot commented on pull request #5520: HUDI-3922 parse record key + partition path config consistently between keygens and HiveSync

2022-05-07 Thread GitBox
hudi-bot commented on PR #5520: URL: https://github.com/apache/hudi/pull/5520#issuecomment-1120238266 ## CI report: * 3631a4c298bcb467da356253455c4b809038b837 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8477

[GitHub] [hudi] wqwl611 opened a new pull request, #5529: add table info to jobStatus

2022-05-07 Thread GitBox
wqwl611 opened a new pull request, #5529: URL: https://github.com/apache/hudi/pull/5529 ## What is the purpose of the pull request add table info to sparkJobStatus and make it easy to see TableInfo in spark web console like that in following picture: it's very useful espaicially wh

[GitHub] [hudi] pratyakshsharma commented on issue #5021: [FEATURE REQUEST] Support for Presto/Athena to make updates to Hudi Tables

2022-05-07 Thread GitBox
pratyakshsharma commented on issue #5021: URL: https://github.com/apache/hudi/issues/5021#issuecomment-1120235462 Replying so as to be in loop. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[GitHub] [hudi] pratyakshsharma commented on issue #4946: [SUPPORT] TimestampBasedKeyGenerator failed to parse date_string column

2022-05-07 Thread GitBox
pratyakshsharma commented on issue #4946: URL: https://github.com/apache/hudi/issues/4946#issuecomment-1120235270 @chrischnweiss Any updates here? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] pratyakshsharma commented on issue #5020: [SUPPORT] The cleaning strategy breaks the reader view completeness

2022-05-07 Thread GitBox
pratyakshsharma commented on issue #5020: URL: https://github.com/apache/hudi/issues/5020#issuecomment-1120234833 Replying here so as to be in loop. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [hudi] pratyakshsharma commented on pull request #4925: [HUDI-3103] Enable MultiTableDeltaStreamer to update a single sink table from multiple source tables

2022-05-07 Thread GitBox
pratyakshsharma commented on PR #4925: URL: https://github.com/apache/hudi/pull/4925#issuecomment-1120231837 @watermelon12138 Still working on this? If you are facing any challenges or something is not clear, you can share with us and we can probably help. -- This is an automated message

[GitHub] [hudi] pratyakshsharma commented on pull request #5463: [HUDI-3994] - Added support for initializing DeltaStreamer without a defined Spark Master

2022-05-07 Thread GitBox
pratyakshsharma commented on PR #5463: URL: https://github.com/apache/hudi/pull/5463#issuecomment-1120230723 Will it be possible to add test cases for this change? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [hudi] pratyakshsharma commented on pull request #4481: [HUDI-3075] [WIP] - Docs for Debezium DeltaStreamer Source

2022-05-07 Thread GitBox
pratyakshsharma commented on PR #4481: URL: https://github.com/apache/hudi/pull/4481#issuecomment-1120230049 Will take a pass once this is ready for review @kywe665 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hudi] pratyakshsharma commented on pull request #5031: [HUDI-3523] Introduce AddColumnSchemaPostProcessor to support add column to a given schema

2022-05-07 Thread GitBox
pratyakshsharma commented on PR #5031: URL: https://github.com/apache/hudi/pull/5031#issuecomment-1120229889 @wangxianghu ping. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

[GitHub] [hudi] pratyakshsharma commented on pull request #5319: [WIP] Adjusting `DeltaStreamer` shutdown sequence to avoid awaiting for 24h

2022-05-07 Thread GitBox
pratyakshsharma commented on PR #5319: URL: https://github.com/apache/hudi/pull/5319#issuecomment-1120229680 Will take a pass once this is ready for review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hudi] pratyakshsharma commented on pull request #5359: [HUDI-3961] New Key Generator Option: NanoidKeyGenerator

2022-05-07 Thread GitBox
pratyakshsharma commented on PR #5359: URL: https://github.com/apache/hudi/pull/5359#issuecomment-1120229442 Will take pass once needful is taken care of. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [hudi] hudi-bot commented on pull request #5528: [HUDI-3336][HUDI-FLINK]Support custom hadoop config for flink

2022-05-07 Thread GitBox
hudi-bot commented on PR #5528: URL: https://github.com/apache/hudi/pull/5528#issuecomment-1120229387 ## CI report: * ac044d9c0b307b493597211c756dc8592d0a7ab6 UNKNOWN * 5dd23dc4d3d8fe082a24b0e18685d9158c0623c3 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #5526: [HUDI-4053] Flaky ITTestHoodieDataSource.testStreamWriteBatchReadOpti…

2022-05-07 Thread GitBox
hudi-bot commented on PR #5526: URL: https://github.com/apache/hudi/pull/5526#issuecomment-1120229380 ## CI report: * d5851284a56659bb22d30f63941d6b2d29a2b4a6 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8491

[GitHub] [hudi] pratyakshsharma commented on pull request #5406: [HUDI-3954] Don't keep the last commit before the earliest commit to retain

2022-05-07 Thread GitBox
pratyakshsharma commented on PR #5406: URL: https://github.com/apache/hudi/pull/5406#issuecomment-1120223144 @dongkelun I guess there is some confusion with respect to the documentation for the said config. I have added a review comment https://github.com/apache/hudi/pull/4927#discussion_r8

[GitHub] [hudi] hudi-bot commented on pull request #5526: [HUDI-4053] Flaky ITTestHoodieDataSource.testStreamWriteBatchReadOpti…

2022-05-07 Thread GitBox
hudi-bot commented on PR #5526: URL: https://github.com/apache/hudi/pull/5526#issuecomment-1120212058 ## CI report: * 7b9f94381649251917667868f66e1492557c6e13 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8484

[GitHub] [hudi] hudi-bot commented on pull request #5528: [HUDI-3336][HUDI-FLINK]Support custom hadoop config for flink

2022-05-07 Thread GitBox
hudi-bot commented on PR #5528: URL: https://github.com/apache/hudi/pull/5528#issuecomment-1120212066 ## CI report: * ac044d9c0b307b493597211c756dc8592d0a7ab6 UNKNOWN * 5dd23dc4d3d8fe082a24b0e18685d9158c0623c3 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #5526: [HUDI-4053] Flaky ITTestHoodieDataSource.testStreamWriteBatchReadOpti…

2022-05-07 Thread GitBox
hudi-bot commented on PR #5526: URL: https://github.com/apache/hudi/pull/5526#issuecomment-1120211526 ## CI report: * 7b9f94381649251917667868f66e1492557c6e13 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8484

[GitHub] [hudi] hudi-bot commented on pull request #5528: [HUDI-3336][HUDI-FLINK]Support custom hadoop config for flink

2022-05-07 Thread GitBox
hudi-bot commented on PR #5528: URL: https://github.com/apache/hudi/pull/5528#issuecomment-1120211530 ## CI report: * ac044d9c0b307b493597211c756dc8592d0a7ab6 UNKNOWN * 5dd23dc4d3d8fe082a24b0e18685d9158c0623c3 UNKNOWN Bot commands @hudi-bot supports the following

[GitHub] [hudi] hudi-bot commented on pull request #5528: [HUDI-3336][HUDI-FLINK]Support custom hadoop config for flink

2022-05-07 Thread GitBox
hudi-bot commented on PR #5528: URL: https://github.com/apache/hudi/pull/5528#issuecomment-1120211051 ## CI report: * ac044d9c0b307b493597211c756dc8592d0a7ab6 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] cuibo01 commented on pull request #4699: [HUDI-3336][HUDI-FLINK] Support custom hadoop config options for flink

2022-05-07 Thread GitBox
cuibo01 commented on PR #4699: URL: https://github.com/apache/hudi/pull/4699#issuecomment-1120205667 [v](https://github.com/apache/hudi/pull/5528) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] cuibo01 opened a new pull request, #5528: [HUDI-3336][HUDI-FLINK]Support custom hadoop config for flink

2022-05-07 Thread GitBox
cuibo01 opened a new pull request, #5528: URL: https://github.com/apache/hudi/pull/5528 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpose

[GitHub] [hudi] cuibo01 closed pull request #4699: [HUDI-3336][HUDI-FLINK] Support custom hadoop config options for flink

2022-05-07 Thread GitBox
cuibo01 closed pull request #4699: [HUDI-3336][HUDI-FLINK] Support custom hadoop config options for flink URL: https://github.com/apache/hudi/pull/4699 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[jira] [Assigned] (HUDI-3336) Configurations transferred through Flink SQL cannot take effect

2022-05-07 Thread Forward Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Forward Xu reassigned HUDI-3336: Assignee: Bo Cui > Configurations transferred through Flink SQL cannot take effect > --

[GitHub] [hudi] hudi-bot commented on pull request #4699: [HUDI-3336][HUDI-FLINK] Support custom hadoop config options for flink

2022-05-07 Thread GitBox
hudi-bot commented on PR #4699: URL: https://github.com/apache/hudi/pull/4699#issuecomment-1120202717 ## CI report: * ec269f1bd56a1a8eea3b7a4334cc90777ed82980 UNKNOWN * 5085945f32350c91f3c40b4fb72259be0717da49 UNKNOWN * ccfcae2112fc0713d47ebb69c6d909e22fdedb7b UNKNOWN * 64

[GitHub] [hudi] hudi-bot commented on pull request #4699: [HUDI-3336][HUDI-FLINK] Support custom hadoop config options for flink

2022-05-07 Thread GitBox
hudi-bot commented on PR #4699: URL: https://github.com/apache/hudi/pull/4699#issuecomment-1120202340 ## CI report: * ec269f1bd56a1a8eea3b7a4334cc90777ed82980 UNKNOWN * 5085945f32350c91f3c40b4fb72259be0717da49 UNKNOWN * ccfcae2112fc0713d47ebb69c6d909e22fdedb7b UNKNOWN * 64

[hudi] branch master updated (9625d16937 -> 80f99893a0)

2022-05-07 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 9625d16937 [HUDI-3849] AvroDeserializer supports AVRO_REBASE_MODE_IN_READ configuration (#5287) add 80f99893a0

[GitHub] [hudi] danny0405 merged pull request #5527: [MINOR] Fixing class not found when using flink and enable metadata t…

2022-05-07 Thread GitBox
danny0405 merged PR #5527: URL: https://github.com/apache/hudi/pull/5527 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache

[GitHub] [hudi] pratyakshsharma commented on a diff in pull request #4927: [HUDI-3524] - Docs for basic config page

2022-05-07 Thread GitBox
pratyakshsharma commented on code in PR #4927: URL: https://github.com/apache/hudi/pull/4927#discussion_r867344049 ## website/docs/basic_configurations.md: ## @@ -0,0 +1,750 @@ +--- +title: Basic Configurations +toc: true +--- + +This page covers the basic configurations you may

[GitHub] [hudi] pratyakshsharma commented on a diff in pull request #4927: [HUDI-3524] - Docs for basic config page

2022-05-07 Thread GitBox
pratyakshsharma commented on code in PR #4927: URL: https://github.com/apache/hudi/pull/4927#discussion_r867343657 ## website/docs/basic_configurations.md: ## @@ -0,0 +1,750 @@ +--- +title: Basic Configurations +toc: true +--- + +This page covers the basic configurations you may

[GitHub] [hudi] pratyakshsharma commented on a diff in pull request #4927: [HUDI-3524] - Docs for basic config page

2022-05-07 Thread GitBox
pratyakshsharma commented on code in PR #4927: URL: https://github.com/apache/hudi/pull/4927#discussion_r867343177 ## website/docs/basic_configurations.md: ## @@ -0,0 +1,750 @@ +--- +title: Basic Configurations +toc: true +--- + +This page covers the basic configurations you may

[GitHub] [hudi] pratyakshsharma commented on a diff in pull request #4927: [HUDI-3524] - Docs for basic config page

2022-05-07 Thread GitBox
pratyakshsharma commented on code in PR #4927: URL: https://github.com/apache/hudi/pull/4927#discussion_r867343137 ## website/docs/basic_configurations.md: ## @@ -0,0 +1,750 @@ +--- +title: Basic Configurations +toc: true +--- + +This page covers the basic configurations you may

[GitHub] [hudi] pratyakshsharma commented on a diff in pull request #4927: [HUDI-3524] - Docs for basic config page

2022-05-07 Thread GitBox
pratyakshsharma commented on code in PR #4927: URL: https://github.com/apache/hudi/pull/4927#discussion_r867343006 ## website/docs/basic_configurations.md: ## @@ -0,0 +1,750 @@ +--- +title: Basic Configurations +toc: true +--- + +This page covers the basic configurations you may

[GitHub] [hudi] pratyakshsharma commented on a diff in pull request #4927: [HUDI-3524] - Docs for basic config page

2022-05-07 Thread GitBox
pratyakshsharma commented on code in PR #4927: URL: https://github.com/apache/hudi/pull/4927#discussion_r867342945 ## website/docs/basic_configurations.md: ## @@ -0,0 +1,750 @@ +--- +title: Basic Configurations +toc: true +--- + +This page covers the basic configurations you may

[GitHub] [hudi] pratyakshsharma commented on a diff in pull request #4927: [HUDI-3524] - Docs for basic config page

2022-05-07 Thread GitBox
pratyakshsharma commented on code in PR #4927: URL: https://github.com/apache/hudi/pull/4927#discussion_r867342876 ## website/docs/basic_configurations.md: ## @@ -0,0 +1,750 @@ +--- +title: Basic Configurations +toc: true +--- + +This page covers the basic configurations you may

[GitHub] [hudi] pratyakshsharma commented on a diff in pull request #4927: [HUDI-3524] - Docs for basic config page

2022-05-07 Thread GitBox
pratyakshsharma commented on code in PR #4927: URL: https://github.com/apache/hudi/pull/4927#discussion_r867342853 ## website/docs/basic_configurations.md: ## @@ -0,0 +1,750 @@ +--- +title: Basic Configurations +toc: true +--- + +This page covers the basic configurations you may

[GitHub] [hudi] pratyakshsharma commented on a diff in pull request #4927: [HUDI-3524] - Docs for basic config page

2022-05-07 Thread GitBox
pratyakshsharma commented on code in PR #4927: URL: https://github.com/apache/hudi/pull/4927#discussion_r867342629 ## website/docs/basic_configurations.md: ## @@ -0,0 +1,750 @@ +--- +title: Basic Configurations +toc: true +--- + +This page covers the basic configurations you may

[GitHub] [hudi] pratyakshsharma commented on a diff in pull request #4927: [HUDI-3524] - Docs for basic config page

2022-05-07 Thread GitBox
pratyakshsharma commented on code in PR #4927: URL: https://github.com/apache/hudi/pull/4927#discussion_r867342264 ## website/docs/basic_configurations.md: ## @@ -0,0 +1,750 @@ +--- +title: Basic Configurations +toc: true +--- + +This page covers the basic configurations you may

[GitHub] [hudi] pratyakshsharma commented on a diff in pull request #4927: [HUDI-3524] - Docs for basic config page

2022-05-07 Thread GitBox
pratyakshsharma commented on code in PR #4927: URL: https://github.com/apache/hudi/pull/4927#discussion_r867341928 ## website/docs/basic_configurations.md: ## @@ -0,0 +1,750 @@ +--- +title: Basic Configurations +toc: true +--- + +This page covers the basic configurations you may

[GitHub] [hudi] pratyakshsharma commented on a diff in pull request #4927: [HUDI-3524] - Docs for basic config page

2022-05-07 Thread GitBox
pratyakshsharma commented on code in PR #4927: URL: https://github.com/apache/hudi/pull/4927#discussion_r867341754 ## website/docs/basic_configurations.md: ## @@ -0,0 +1,750 @@ +--- +title: Basic Configurations +toc: true +--- + +This page covers the basic configurations you may

[GitHub] [hudi] pratyakshsharma commented on a diff in pull request #4927: [HUDI-3524] - Docs for basic config page

2022-05-07 Thread GitBox
pratyakshsharma commented on code in PR #4927: URL: https://github.com/apache/hudi/pull/4927#discussion_r867341514 ## website/docs/basic_configurations.md: ## @@ -0,0 +1,750 @@ +--- +title: Basic Configurations +toc: true +--- + +This page covers the basic configurations you may

[GitHub] [hudi] pratyakshsharma commented on a diff in pull request #4927: [HUDI-3524] - Docs for basic config page

2022-05-07 Thread GitBox
pratyakshsharma commented on code in PR #4927: URL: https://github.com/apache/hudi/pull/4927#discussion_r867341454 ## website/docs/basic_configurations.md: ## @@ -0,0 +1,750 @@ +--- +title: Basic Configurations +toc: true +--- + +This page covers the basic configurations you may

[GitHub] [hudi] pratyakshsharma commented on a diff in pull request #4927: [HUDI-3524] - Docs for basic config page

2022-05-07 Thread GitBox
pratyakshsharma commented on code in PR #4927: URL: https://github.com/apache/hudi/pull/4927#discussion_r867341254 ## website/docs/basic_configurations.md: ## @@ -0,0 +1,750 @@ +--- +title: Basic Configurations +toc: true +--- + +This page covers the basic configurations you may

[GitHub] [hudi] pratyakshsharma commented on a diff in pull request #4927: [HUDI-3524] - Docs for basic config page

2022-05-07 Thread GitBox
pratyakshsharma commented on code in PR #4927: URL: https://github.com/apache/hudi/pull/4927#discussion_r867341089 ## website/docs/basic_configurations.md: ## @@ -0,0 +1,750 @@ +--- +title: Basic Configurations +toc: true +--- + +This page covers the basic configurations you may

[GitHub] [hudi] pratyakshsharma commented on a diff in pull request #4927: [HUDI-3524] - Docs for basic config page

2022-05-07 Thread GitBox
pratyakshsharma commented on code in PR #4927: URL: https://github.com/apache/hudi/pull/4927#discussion_r867340809 ## website/docs/basic_configurations.md: ## @@ -0,0 +1,750 @@ +--- +title: Basic Configurations +toc: true +--- + +This page covers the basic configurations you may

[GitHub] [hudi] pratyakshsharma commented on a diff in pull request #4927: [HUDI-3524] - Docs for basic config page

2022-05-07 Thread GitBox
pratyakshsharma commented on code in PR #4927: URL: https://github.com/apache/hudi/pull/4927#discussion_r867340759 ## website/docs/basic_configurations.md: ## @@ -0,0 +1,750 @@ +--- +title: Basic Configurations +toc: true +--- + +This page covers the basic configurations you may

[GitHub] [hudi] pratyakshsharma commented on a diff in pull request #4927: [HUDI-3524] - Docs for basic config page

2022-05-07 Thread GitBox
pratyakshsharma commented on code in PR #4927: URL: https://github.com/apache/hudi/pull/4927#discussion_r867340461 ## website/docs/basic_configurations.md: ## @@ -0,0 +1,750 @@ +--- +title: Basic Configurations +toc: true +--- + +This page covers the basic configurations you may

[GitHub] [hudi] pratyakshsharma commented on a diff in pull request #4927: [HUDI-3524] - Docs for basic config page

2022-05-07 Thread GitBox
pratyakshsharma commented on code in PR #4927: URL: https://github.com/apache/hudi/pull/4927#discussion_r867340424 ## website/docs/basic_configurations.md: ## @@ -0,0 +1,750 @@ +--- +title: Basic Configurations +toc: true +--- + +This page covers the basic configurations you may

[GitHub] [hudi] pratyakshsharma commented on a diff in pull request #4927: [HUDI-3524] - Docs for basic config page

2022-05-07 Thread GitBox
pratyakshsharma commented on code in PR #4927: URL: https://github.com/apache/hudi/pull/4927#discussion_r867339082 ## website/docs/basic_configurations.md: ## @@ -0,0 +1,750 @@ +--- +title: Basic Configurations +toc: true +--- + +This page covers the basic configurations you may

[GitHub] [hudi] pratyakshsharma commented on a diff in pull request #4927: [HUDI-3524] - Docs for basic config page

2022-05-07 Thread GitBox
pratyakshsharma commented on code in PR #4927: URL: https://github.com/apache/hudi/pull/4927#discussion_r867338577 ## website/docs/basic_configurations.md: ## @@ -0,0 +1,750 @@ +--- +title: Basic Configurations +toc: true +--- + +This page covers the basic configurations you may

[GitHub] [hudi] pratyakshsharma commented on a diff in pull request #4927: [HUDI-3524] - Docs for basic config page

2022-05-07 Thread GitBox
pratyakshsharma commented on code in PR #4927: URL: https://github.com/apache/hudi/pull/4927#discussion_r867338139 ## website/docs/basic_configurations.md: ## @@ -0,0 +1,750 @@ +--- +title: Basic Configurations +toc: true +--- + +This page covers the basic configurations you may

[GitHub] [hudi] pratyakshsharma commented on a diff in pull request #4927: [HUDI-3524] - Docs for basic config page

2022-05-07 Thread GitBox
pratyakshsharma commented on code in PR #4927: URL: https://github.com/apache/hudi/pull/4927#discussion_r867337722 ## website/docs/basic_configurations.md: ## @@ -0,0 +1,750 @@ +--- +title: Basic Configurations +toc: true +--- + +This page covers the basic configurations you may

[GitHub] [hudi] yuzhaojing commented on a diff in pull request #4309: [HUDI-3016][RFC-43] Proposal to implement Compaction/Clustering Servi…

2022-05-07 Thread GitBox
yuzhaojing commented on code in PR #4309: URL: https://github.com/apache/hudi/pull/4309#discussion_r867337630 ## rfc/rfc-43/rfc-43.md: ## @@ -0,0 +1,257 @@ + + +# RFC-43: Implement Table Management Service for Hudi + +## Proposers + +- @yuzhaojing + +## Approvers + +- @vinothcha

[GitHub] [hudi] Chosen123Wang commented on issue #5457: [SUPPORT] org.apache.hudi.common.fs.HoodieWrapperFileSystem cannot be cast to org.apache.hudi.common.fs.HoodieWrapperFileSystem

2022-05-07 Thread GitBox
Chosen123Wang commented on issue #5457: URL: https://github.com/apache/hudi/issues/5457#issuecomment-1120185360 > @Chosen123Wang Could you try this fix to see if it solves your issue: #5471? In my tests, some jobs can succeed and others can't. I would like to ask which class loader i

[GitHub] [hudi] hudi-bot commented on pull request #5527: [MINOR] Fixing class not found when using flink and enable metadata t…

2022-05-07 Thread GitBox
hudi-bot commented on PR #5527: URL: https://github.com/apache/hudi/pull/5527#issuecomment-1120184102 ## CI report: * bc6a9cc5a10206aec10c5c1c72087783b5d3f7aa Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8487

[GitHub] [hudi] yuzhaojing commented on a diff in pull request #4309: [HUDI-3016][RFC-43] Proposal to implement Compaction/Clustering Servi…

2022-05-07 Thread GitBox
yuzhaojing commented on code in PR #4309: URL: https://github.com/apache/hudi/pull/4309#discussion_r867336232 ## rfc/rfc-43/rfc-43.md: ## @@ -0,0 +1,257 @@ + + +# RFC-43: Implement Table Management Service for Hudi + +## Proposers + +- @yuzhaojing + +## Approvers + +- @vinothcha

[GitHub] [hudi] yuzhaojing commented on a diff in pull request #4309: [HUDI-3016][RFC-43] Proposal to implement Compaction/Clustering Servi…

2022-05-07 Thread GitBox
yuzhaojing commented on code in PR #4309: URL: https://github.com/apache/hudi/pull/4309#discussion_r867335877 ## rfc/rfc-43/rfc-43.md: ## @@ -0,0 +1,257 @@ + + +# RFC-43: Implement Table Management Service for Hudi + +## Proposers + +- @yuzhaojing + +## Approvers + +- @vinothcha

[GitHub] [hudi] yuzhaojing commented on pull request #4309: [HUDI-3016][RFC-43] Proposal to implement Compaction/Clustering Servi…

2022-05-07 Thread GitBox
yuzhaojing commented on PR #4309: URL: https://github.com/apache/hudi/pull/4309#issuecomment-1120182685 > Unless I am missing something here, can't the "storage" + "scheduler" + execute pieces, directly reuse what we have already. > > just writing down ideas in my head to see how we a

[GitHub] [hudi] danny0405 commented on pull request #5526: [HUDI-4053] Flaky ITTestHoodieDataSource.testStreamWriteBatchReadOpti…

2022-05-07 Thread GitBox
danny0405 commented on PR #5526: URL: https://github.com/apache/hudi/pull/5526#issuecomment-1120179717 You can update the PR with following commits and there is no need to close. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hudi] hudi-bot commented on pull request #5286: HUDI-3836 Improve the way of fetching metadata partitions from table

2022-05-07 Thread GitBox
hudi-bot commented on PR #5286: URL: https://github.com/apache/hudi/pull/5286#issuecomment-1120175487 ## CI report: * 806def99796cc09f4bd500fde2728f4493da8775 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8485

[GitHub] [hudi] xicm closed pull request #5526: [HUDI-4053] Flaky ITTestHoodieDataSource.testStreamWriteBatchReadOpti…

2022-05-07 Thread GitBox
xicm closed pull request #5526: [HUDI-4053] Flaky ITTestHoodieDataSource.testStreamWriteBatchReadOpti… URL: https://github.com/apache/hudi/pull/5526 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [hudi] XuQianJin-Stars commented on pull request #4699: [HUDI-3336][HUDI-FLINK] Support custom hadoop config options for flink

2022-05-07 Thread GitBox
XuQianJin-Stars commented on PR #4699: URL: https://github.com/apache/hudi/pull/4699#issuecomment-1120175121 hi @cuibo01 can rebase this pr? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[GitHub] [hudi] danny0405 commented on a diff in pull request #5286: HUDI-3836 Improve the way of fetching metadata partitions from table

2022-05-07 Thread GitBox
danny0405 commented on code in PR #5286: URL: https://github.com/apache/hudi/pull/5286#discussion_r867329929 ## hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableConfig.java: ## @@ -236,6 +237,8 @@ public class HoodieTableConfig extends HoodieConfig { privat

[GitHub] [hudi] zhilinli123 commented on issue #3999: [SUPPORT] errors while using flink on hudi mor table

2022-05-07 Thread GitBox
zhilinli123 commented on issue #3999: URL: https://github.com/apache/hudi/issues/3999#issuecomment-1120167274 @Coreixwumo When this happens, we update our operations when we anneal. Tasks. -- This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [hudi] hudi-bot commented on pull request #5527: [MINOR] Fixing class not found when using flink and enable metadata t…

2022-05-07 Thread GitBox
hudi-bot commented on PR #5527: URL: https://github.com/apache/hudi/pull/5527#issuecomment-1120166967 ## CI report: * bc6a9cc5a10206aec10c5c1c72087783b5d3f7aa Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8487

[GitHub] [hudi] hudi-bot commented on pull request #5527: [MINOR] Fixing class not found when using flink and enable metadata t…

2022-05-07 Thread GitBox
hudi-bot commented on PR #5527: URL: https://github.com/apache/hudi/pull/5527#issuecomment-1120166525 ## CI report: * bc6a9cc5a10206aec10c5c1c72087783b5d3f7aa UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] BruceKellan opened a new pull request, #5527: [MINOR] Fixing class not found when using flink and enable metadata t…

2022-05-07 Thread GitBox
BruceKellan opened a new pull request, #5527: URL: https://github.com/apache/hudi/pull/5527 …able ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## Wh

[GitHub] [hudi] hudi-bot commented on pull request #5286: HUDI-3836 Improve the way of fetching metadata partitions from table

2022-05-07 Thread GitBox
hudi-bot commented on PR #5286: URL: https://github.com/apache/hudi/pull/5286#issuecomment-1120157458 ## CI report: * 1acbc822bb1a3e8051539beabf640977f7d8fe6a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8427

[GitHub] [hudi] yanghua merged pull request #5287: [HUDI-3849] AvroDeserializer supports AVRO_REBASE_MODE_IN_READ configuration

2022-05-07 Thread GitBox
yanghua merged PR #5287: URL: https://github.com/apache/hudi/pull/5287 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.o

[hudi] branch master updated: [HUDI-3849] AvroDeserializer supports AVRO_REBASE_MODE_IN_READ configuration (#5287)

2022-05-07 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 9625d16937 [HUDI-3849] AvroDeserializer supports

[GitHub] [hudi] hudi-bot commented on pull request #5286: HUDI-3836 Improve the way of fetching metadata partitions from table

2022-05-07 Thread GitBox
hudi-bot commented on PR #5286: URL: https://github.com/apache/hudi/pull/5286#issuecomment-1120156953 ## CI report: * 1acbc822bb1a3e8051539beabf640977f7d8fe6a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8427

[GitHub] [hudi] hujincalrin commented on a diff in pull request #5370: [RFC-52][HUDI-3907] RFC for Introduce Secondary Index to Improve Hudi Query Performance

2022-05-07 Thread GitBox
hujincalrin commented on code in PR #5370: URL: https://github.com/apache/hudi/pull/5370#discussion_r867315947 ## rfc/rfc-52/rfc-52.md: ## @@ -0,0 +1,284 @@ + +# RFC-52: Introduce Secondary Index to Improve HUDI Query Performance + +## Proposers + +- @huberylee +- @hujincalrin +

[GitHub] [hudi] hujincalrin commented on a diff in pull request #5370: [RFC-52][HUDI-3907] RFC for Introduce Secondary Index to Improve Hudi Query Performance

2022-05-07 Thread GitBox
hujincalrin commented on code in PR #5370: URL: https://github.com/apache/hudi/pull/5370#discussion_r867315606 ## rfc/rfc-52/rfc-52.md: ## @@ -0,0 +1,284 @@ + +# RFC-52: Introduce Secondary Index to Improve HUDI Query Performance + +## Proposers + +- @huberylee +- @hujincalrin +