[GitHub] [hudi] hudi-bot removed a comment on pull request #4907: [WIP][CI Test Only][HUDI-1180] Upgrade HBase to 2.4.9

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4907: URL: https://github.com/apache/hudi/pull/4907#issuecomment-1062639238 ## CI report: * 0e125764bf81fba62e6bfc5df305070785b96e36 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot

[GitHub] [hudi] hudi-bot commented on pull request #4907: [WIP][CI Test Only][HUDI-1180] Upgrade HBase to 2.4.9

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4907: URL: https://github.com/apache/hudi/pull/4907#issuecomment-1062647238 ## CI report: * 0e125764bf81fba62e6bfc5df305070785b96e36 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4983: [HUDI-3581] Reorganize some clazz for hudi flink

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4983: URL: https://github.com/apache/hudi/pull/4983#issuecomment-1062641403 ## CI report: * 8cfd58b8f1608326997ad5c07667837c39cbb9f2 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4983: [HUDI-3581] Reorganize some clazz for hudi flink

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4983: URL: https://github.com/apache/hudi/pull/4983#issuecomment-1062639520 ## CI report: * 8cfd58b8f1608326997ad5c07667837c39cbb9f2 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4983: [HUDI-3581] Reorganize some clazz for hudi flink

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4983: URL: https://github.com/apache/hudi/pull/4983#issuecomment-1062639520 ## CI report: * 8cfd58b8f1608326997ad5c07667837c39cbb9f2 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4983: [HUDI-3581] Reorganize some clazz for hudi flink

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4983: URL: https://github.com/apache/hudi/pull/4983#issuecomment-1061629725 ## CI report: * 8cfd58b8f1608326997ad5c07667837c39cbb9f2 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4926: [HUDI-3566]add thread factory in BoundedInMemoryExecutor

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4926: URL: https://github.com/apache/hudi/pull/4926#issuecomment-1062599494 ## CI report: * 972b38ad26cb9f5f0dc73d2ea78e7ce3638fab87 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4907: [WIP][CI Test Only][HUDI-1180] Upgrade HBase to 2.4.9

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4907: URL: https://github.com/apache/hudi/pull/4907#issuecomment-1062637436 ## CI report: * 0e125764bf81fba62e6bfc5df305070785b96e36 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot

[GitHub] [hudi] hudi-bot commented on pull request #4907: [WIP][CI Test Only][HUDI-1180] Upgrade HBase to 2.4.9

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4907: URL: https://github.com/apache/hudi/pull/4907#issuecomment-1062639238 ## CI report: * 0e125764bf81fba62e6bfc5df305070785b96e36 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] hudi-bot commented on pull request #4926: [HUDI-3566]add thread factory in BoundedInMemoryExecutor

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4926: URL: https://github.com/apache/hudi/pull/4926#issuecomment-1062639312 ## CI report: * 972b38ad26cb9f5f0dc73d2ea78e7ce3638fab87 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4907: [WIP][CI Test Only][HUDI-1180] Upgrade HBase to 2.4.9

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4907: URL: https://github.com/apache/hudi/pull/4907#issuecomment-1062637436 ## CI report: * 0e125764bf81fba62e6bfc5df305070785b96e36 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] yihua commented on pull request #4907: [WIP][CI Test Only][HUDI-1180] Upgrade HBase to 2.4.9

2022-03-08 Thread GitBox
yihua commented on pull request #4907: URL: https://github.com/apache/hudi/pull/4907#issuecomment-1062636126 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] hudi-bot removed a comment on pull request #4907: [WIP][CI Test Only][HUDI-1180] Upgrade HBase to 2.4.9

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4907: URL: https://github.com/apache/hudi/pull/4907#issuecomment-1062634057 ## CI report: * 4cd46c8a580bd0e01d4a1bad28d5ad4a72181c3c UNKNOWN * 671d589463b6241bb6b1ffe971b366a621004737 UNKNOWN *

[GitHub] [hudi] hudi-bot removed a comment on pull request #4972: [HUDI-3522] Introduce DropColumnSchemaPostProcessor to support drop columns from schema

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4972: URL: https://github.com/apache/hudi/pull/4972#issuecomment-1062634216 ## CI report: * 750e07438a19600c55d37e7107f88ba04416e218 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4972: [HUDI-3522] Introduce DropColumnSchemaPostProcessor to support drop columns from schema

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4972: URL: https://github.com/apache/hudi/pull/4972#issuecomment-1062635880 ## CI report: * 750e07438a19600c55d37e7107f88ba04416e218 Azure:

[GitHub] [hudi] waywtdcc commented on issue #4979: [SUPPORT] After the changelog mode is enabled, the - U operation records long ago have not been deleted

2022-03-08 Thread GitBox
waywtdcc commented on issue #4979: URL: https://github.com/apache/hudi/issues/4979#issuecomment-1062634769 > Yes, the spark engine has not adapter to the `__hoodie_operation` metadata field yet. However, no -u record exists for the update data of the same partition. Only when the

[GitHub] [hudi] hudi-bot removed a comment on pull request #4972: [HUDI-3522] Introduce DropColumnSchemaPostProcessor to support drop columns from schema

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4972: URL: https://github.com/apache/hudi/pull/4972#issuecomment-1061536724 ## CI report: * 750e07438a19600c55d37e7107f88ba04416e218 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4972: [HUDI-3522] Introduce DropColumnSchemaPostProcessor to support drop columns from schema

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4972: URL: https://github.com/apache/hudi/pull/4972#issuecomment-1062634216 ## CI report: * 750e07438a19600c55d37e7107f88ba04416e218 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4907: [WIP][CI Test Only][HUDI-1180] Upgrade HBase to 2.4.9

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4907: URL: https://github.com/apache/hudi/pull/4907#issuecomment-1062630766 ## CI report: * 4cd46c8a580bd0e01d4a1bad28d5ad4a72181c3c UNKNOWN * 671d589463b6241bb6b1ffe971b366a621004737 UNKNOWN *

[GitHub] [hudi] hudi-bot commented on pull request #4907: [WIP][CI Test Only][HUDI-1180] Upgrade HBase to 2.4.9

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4907: URL: https://github.com/apache/hudi/pull/4907#issuecomment-1062634057 ## CI report: * 4cd46c8a580bd0e01d4a1bad28d5ad4a72181c3c UNKNOWN * 671d589463b6241bb6b1ffe971b366a621004737 UNKNOWN * 2a213efbf2894ff66599b8d1e09653e6811d1033

[GitHub] [hudi] yihua removed a comment on pull request #4907: [WIP][CI Test Only][HUDI-1180] Upgrade HBase to 2.4.9

2022-03-08 Thread GitBox
yihua removed a comment on pull request #4907: URL: https://github.com/apache/hudi/pull/4907#issuecomment-1062630565 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] hudi-bot removed a comment on pull request #4907: [WIP][CI Test Only][HUDI-1180] Upgrade HBase to 2.4.9

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4907: URL: https://github.com/apache/hudi/pull/4907#issuecomment-1062611898 ## CI report: * 4cd46c8a580bd0e01d4a1bad28d5ad4a72181c3c UNKNOWN * 671d589463b6241bb6b1ffe971b366a621004737 UNKNOWN *

[GitHub] [hudi] hudi-bot commented on pull request #4907: [WIP][CI Test Only][HUDI-1180] Upgrade HBase to 2.4.9

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4907: URL: https://github.com/apache/hudi/pull/4907#issuecomment-1062630766 ## CI report: * 4cd46c8a580bd0e01d4a1bad28d5ad4a72181c3c UNKNOWN * 671d589463b6241bb6b1ffe971b366a621004737 UNKNOWN * 2a213efbf2894ff66599b8d1e09653e6811d1033

[GitHub] [hudi] yihua commented on pull request #4907: [WIP][CI Test Only][HUDI-1180] Upgrade HBase to 2.4.9

2022-03-08 Thread GitBox
yihua commented on pull request #4907: URL: https://github.com/apache/hudi/pull/4907#issuecomment-1062630565 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] hudi-bot removed a comment on pull request #4995: [HUDI-3589] flink sync hive metadata supports table properties and serde properties

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4995: URL: https://github.com/apache/hudi/pull/4995#issuecomment-1062591212 ## CI report: * d904ea35f8a2760d1a34619cba8b17e7c4630720 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4995: [HUDI-3589] flink sync hive metadata supports table properties and serde properties

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4995: URL: https://github.com/apache/hudi/pull/4995#issuecomment-1062627497 ## CI report: * d904ea35f8a2760d1a34619cba8b17e7c4630720 Azure:

[GitHub] [hudi] XuQianJin-Stars commented on pull request #4566: [WIP][HUDI-3218] Upgrading avro to 1.10.2

2022-03-08 Thread GitBox
XuQianJin-Stars commented on pull request #4566: URL: https://github.com/apache/hudi/pull/4566#issuecomment-1062625206 > This is unfortunately blocked on [HUDI-3088](https://issues.apache.org/jira/browse/HUDI-3088) hi @alexeykudinkin Can I take your PR modification to

[jira] [Closed] (HUDI-3568) Introduce ChainedSchemaPostProcessor to support setting multi processors at once

2022-03-08 Thread Xianghu Wang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianghu Wang closed HUDI-3568. -- Resolution: Fixed Fixed via master : 548000b0d635067acf7574c4cf5122759e79b52b > Introduce

[hudi] branch master updated (4324e87 -> 548000b)

2022-03-08 Thread wangxianghu
This is an automated email from the ASF dual-hosted git repository. wangxianghu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 4324e87 [HUDI-3587] Making SupportsUpgradeDowngrade serializable (#4991) add 548000b [HUDI-3568]

[GitHub] [hudi] wangxianghu merged pull request #4968: [HUDI-3568] Introduce ChainedSchemaPostProcessor to support setting multi processors at once

2022-03-08 Thread GitBox
wangxianghu merged pull request #4968: URL: https://github.com/apache/hudi/pull/4968 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4994: [Hudi-3376] Add an option to skip under deletion files for HoodieMetadataTableValidator

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4994: URL: https://github.com/apache/hudi/pull/4994#issuecomment-1062587258 ## CI report: * 922548761a98dfd95cfc47b25f915d8a5506f99c Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4994: [Hudi-3376] Add an option to skip under deletion files for HoodieMetadataTableValidator

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4994: URL: https://github.com/apache/hudi/pull/4994#issuecomment-1062617258 ## CI report: * 922548761a98dfd95cfc47b25f915d8a5506f99c Azure:

[GitHub] [hudi] rmahindra123 commented on a change in pull request #4175: [HUDI-2883] Refactor hive sync tool / config to use reflection and standardize configs

2022-03-08 Thread GitBox
rmahindra123 commented on a change in pull request #4175: URL: https://github.com/apache/hudi/pull/4175#discussion_r820171767 ## File path: hudi-integ-test/src/main/java/org/apache/hudi/integ/testsuite/helpers/HiveServiceProvider.java ## @@ -46,12 +49,17 @@ public void

[GitHub] [hudi] rmahindra123 commented on pull request #4175: [HUDI-2883] Refactor hive sync tool / config to use reflection and standardize configs

2022-03-08 Thread GitBox
rmahindra123 commented on pull request #4175: URL: https://github.com/apache/hudi/pull/4175#issuecomment-1062614953 addressed reviewer comments -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] hudi-bot commented on pull request #4996: [HUDI-512][Stacked on 4948] Supporting Composite Expressions over Data Table Columns in Data Skipping flow

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4996: URL: https://github.com/apache/hudi/pull/4996#issuecomment-1062613771 ## CI report: * 430fd8434c4764425452de15df124cb428248e28 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4996: [HUDI-512][Stacked on 4948] Supporting Composite Expressions over Data Table Columns in Data Skipping flow

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4996: URL: https://github.com/apache/hudi/pull/4996#issuecomment-1062609008 ## CI report: * 430fd8434c4764425452de15df124cb428248e28 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4997: [HUDI-3588] Remove hudi-common and hudi-hadoop-mr jars in Presto Docker image

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4997: URL: https://github.com/apache/hudi/pull/4997#issuecomment-1062610566 ## CI report: * 5feb87b1f89732112cfd8073c1cc782c42b7504d UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot

[GitHub] [hudi] hudi-bot commented on pull request #4997: [HUDI-3588] Remove hudi-common and hudi-hadoop-mr jars in Presto Docker image

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4997: URL: https://github.com/apache/hudi/pull/4997#issuecomment-1062612133 ## CI report: * 5feb87b1f89732112cfd8073c1cc782c42b7504d Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4907: [WIP][CI Test Only][HUDI-1180] Upgrade HBase to 2.4.9

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4907: URL: https://github.com/apache/hudi/pull/4907#issuecomment-1057587149 ## CI report: * 4cd46c8a580bd0e01d4a1bad28d5ad4a72181c3c UNKNOWN * 671d589463b6241bb6b1ffe971b366a621004737 UNKNOWN *

[GitHub] [hudi] hudi-bot commented on pull request #4907: [WIP][CI Test Only][HUDI-1180] Upgrade HBase to 2.4.9

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4907: URL: https://github.com/apache/hudi/pull/4907#issuecomment-1062611898 ## CI report: * 4cd46c8a580bd0e01d4a1bad28d5ad4a72181c3c UNKNOWN * 671d589463b6241bb6b1ffe971b366a621004737 UNKNOWN * 2a213efbf2894ff66599b8d1e09653e6811d1033

[GitHub] [hudi] Gatsby-Lee commented on issue #4896: [SUPPORT] Metadata Table causes missing data.

2022-03-08 Thread GitBox
Gatsby-Lee commented on issue #4896: URL: https://github.com/apache/hudi/issues/4896#issuecomment-1062611610 @nsivabalan shared the requested content through slack channel. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hudi] hudi-bot commented on pull request #4997: [HUDI-3588] Remove hudi-common and hudi-hadoop-mr jars in Presto Docker image

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4997: URL: https://github.com/apache/hudi/pull/4997#issuecomment-1062610566 ## CI report: * 5feb87b1f89732112cfd8073c1cc782c42b7504d UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[jira] [Updated] (HUDI-3588) Remove hudi-common and hudi-hadoop-mr jars in Presto Docker image

2022-03-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3588: - Labels: pull-request-available (was: ) > Remove hudi-common and hudi-hadoop-mr jars in Presto

[GitHub] [hudi] hudi-bot removed a comment on pull request #4996: [HUDI-512][Stacked on 4948] Supporting Composite Expressions over Data Table Columns in Data Skipping flow

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4996: URL: https://github.com/apache/hudi/pull/4996#issuecomment-1062607535 ## CI report: * 430fd8434c4764425452de15df124cb428248e28 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot

[GitHub] [hudi] hudi-bot commented on pull request #4996: [HUDI-512][Stacked on 4948] Supporting Composite Expressions over Data Table Columns in Data Skipping flow

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4996: URL: https://github.com/apache/hudi/pull/4996#issuecomment-1062609008 ## CI report: * 430fd8434c4764425452de15df124cb428248e28 Azure:

[GitHub] [hudi] yihua opened a new pull request #4997: [HUDI-3588] Remove hudi-common and hudi-hadoop-mr jars in Presto Docker image

2022-03-08 Thread GitBox
yihua opened a new pull request #4997: URL: https://github.com/apache/hudi/pull/4997 ## What is the purpose of the pull request The latest master of Presto relies on hudi-presto-bundle, while current Presto releases rely on hudi-common and hudi-hadoop-mr 0.9.0, which are pulled in

[GitHub] [hudi] hudi-bot commented on pull request #4996: [HUDI-512][Stacked on 4948] Supporting Composite Expressions over Data Table Columns in Data Skipping flow

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4996: URL: https://github.com/apache/hudi/pull/4996#issuecomment-1062607535 ## CI report: * 430fd8434c4764425452de15df124cb428248e28 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] Gatsby-Lee commented on issue #4873: Processing time very Slow Updating records into Hudi Dataset(MOR) using AWS Glue

2022-03-08 Thread GitBox
Gatsby-Lee commented on issue #4873: URL: https://github.com/apache/hudi/issues/4873#issuecomment-1062606418 @pmgod8922 Hi, my config is pretty much like this with some change to use MoR https://github.com/apache/hudi/issues/4896 ``` 'hoodie.compact.inline':

[jira] [Updated] (HUDI-512) Support for Index functions on columns to generate logical or micro partitioning

2022-03-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-512: Labels: features pull-request-available (was: features) > Support for Index functions on columns to

[GitHub] [hudi] alexeykudinkin opened a new pull request #4996: [HUDI-512] Supporting Composite Expressions over Data Table Columns in Data Skipping flow

2022-03-08 Thread GitBox
alexeykudinkin opened a new pull request #4996: URL: https://github.com/apache/hudi/pull/4996 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the

[jira] [Updated] (HUDI-3588) Remove hudi-common and hudi-hadoop-mr jars in Presto Docker image

2022-03-08 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-3588: Summary: Remove hudi-common and hudi-hadoop-mr jars in Presto Docker image (was: Update Presto setup in

[jira] [Updated] (HUDI-3591) Upgrade Presto and remove temp logic in Docker Demo

2022-03-08 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-3591: Description: After Presto has a new release with hudi-presto-bundle 0.11, we should use that Presto release

[jira] [Updated] (HUDI-3588) Update Presto setup in Docker Demo

2022-03-08 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-3588: Description: The latest master of Presto relies on hudi-presto-bundle, while current Presto releases rely

[jira] [Updated] (HUDI-3590) Upgrade hudi-presto-bundle to 0.11 in Presto repo

2022-03-08 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-3590: Description: When Hudi 0.11.0 is released, update hudi-presto-bundle to 0.11 in Presto repo.  More context

[GitHub] [hudi] hudi-bot commented on pull request #4926: [HUDI-3566]add thread factory in BoundedInMemoryExecutor

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4926: URL: https://github.com/apache/hudi/pull/4926#issuecomment-1062599494 ## CI report: * 972b38ad26cb9f5f0dc73d2ea78e7ce3638fab87 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4926: [HUDI-3566]add thread factory in BoundedInMemoryExecutor

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4926: URL: https://github.com/apache/hudi/pull/4926#issuecomment-1062523606 ## CI report: * 972b38ad26cb9f5f0dc73d2ea78e7ce3638fab87 Azure:

[jira] [Created] (HUDI-3591) Upgrade Presto and remove temp logic in Docker Demo

2022-03-08 Thread Ethan Guo (Jira)
Ethan Guo created HUDI-3591: --- Summary: Upgrade Presto and remove temp logic in Docker Demo Key: HUDI-3591 URL: https://issues.apache.org/jira/browse/HUDI-3591 Project: Apache Hudi Issue Type: Task

[GitHub] [hudi] scxwhite commented on pull request #4926: [HUDI-3566]add thread factory in BoundedInMemoryExecutor

2022-03-08 Thread GitBox
scxwhite commented on pull request #4926: URL: https://github.com/apache/hudi/pull/4926#issuecomment-1062598901 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Created] (HUDI-3590) Upgrade hudi-presto-bundle to 0.11 in Presto repo

2022-03-08 Thread Ethan Guo (Jira)
Ethan Guo created HUDI-3590: --- Summary: Upgrade hudi-presto-bundle to 0.11 in Presto repo Key: HUDI-3590 URL: https://issues.apache.org/jira/browse/HUDI-3590 Project: Apache Hudi Issue Type: Task

[jira] [Assigned] (HUDI-3495) Reading keys in parallel from HoodieMetadataMergedLogRecordReader may lead to empty results even if key exists

2022-03-08 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo reassigned HUDI-3495: --- Assignee: Yue Zhang (was: Ethan Guo) > Reading keys in parallel from

[jira] [Assigned] (HUDI-3453) Metadata table throws NPE when scheduling compaction plan

2022-03-08 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo reassigned HUDI-3453: --- Assignee: Yue Zhang (was: Ethan Guo) > Metadata table throws NPE when scheduling compaction plan >

[GitHub] [hudi] hudi-bot removed a comment on pull request #4995: [HUDI-3589] flink sync hive metadata supports table properties and serde properties

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4995: URL: https://github.com/apache/hudi/pull/4995#issuecomment-1062589804 ## CI report: * d904ea35f8a2760d1a34619cba8b17e7c4630720 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot

[GitHub] [hudi] hudi-bot commented on pull request #4995: [HUDI-3589] flink sync hive metadata supports table properties and serde properties

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4995: URL: https://github.com/apache/hudi/pull/4995#issuecomment-1062591212 ## CI report: * d904ea35f8a2760d1a34619cba8b17e7c4630720 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4995: [HUDI-3589] flink sync hive metadata supports table properties and se…

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4995: URL: https://github.com/apache/hudi/pull/4995#issuecomment-1062589804 ## CI report: * d904ea35f8a2760d1a34619cba8b17e7c4630720 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[jira] [Updated] (HUDI-3589) flink sync hive metadata supports table properties and serde properties

2022-03-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3589: - Labels: pull-request-available (was: ) > flink sync hive metadata supports table properties and

[GitHub] [hudi] todd5167 opened a new pull request #4995: [HUDI-3589] flink sync hive metadata supports table properties and se…

2022-03-08 Thread GitBox
todd5167 opened a new pull request #4995: URL: https://github.com/apache/hudi/pull/4995 …rde properties ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.*

[jira] [Updated] (HUDI-3589) flink sync hive metadata supports table properties and serde properties

2022-03-08 Thread todd (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] todd updated HUDI-3589: --- Summary: flink sync hive metadata supports table properties and serde properties (was: flink sync hive metadata,

[jira] [Updated] (HUDI-3589) flink sync hive metadata, supports table properties and serde properties

2022-03-08 Thread todd (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] todd updated HUDI-3589: --- Priority: Minor (was: Major) > flink sync hive metadata, supports table properties and serde properties >

[jira] [Created] (HUDI-3589) flink sync hive metadata, supports table properties and serde properties

2022-03-08 Thread todd (Jira)
todd created HUDI-3589: -- Summary: flink sync hive metadata, supports table properties and serde properties Key: HUDI-3589 URL: https://issues.apache.org/jira/browse/HUDI-3589 Project: Apache Hudi

[GitHub] [hudi] hudi-bot removed a comment on pull request #4994: [Hudi-3376] Add an option to skip under deletion files for HoodieMetadataTableValidator

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4994: URL: https://github.com/apache/hudi/pull/4994#issuecomment-1062585804 ## CI report: * 922548761a98dfd95cfc47b25f915d8a5506f99c Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4994: [Hudi-3376] Add an option to skip under deletion files for HoodieMetadataTableValidator

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4994: URL: https://github.com/apache/hudi/pull/4994#issuecomment-1062587258 ## CI report: * 922548761a98dfd95cfc47b25f915d8a5506f99c Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4994: [Hudi-3376] Add an option to skip under deletion files for HoodieMetadataTableValidator

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4994: URL: https://github.com/apache/hudi/pull/4994#issuecomment-1062584363 ## CI report: * 922548761a98dfd95cfc47b25f915d8a5506f99c UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot

[GitHub] [hudi] hudi-bot commented on pull request #4994: [Hudi-3376] Add an option to skip under deletion files for HoodieMetadataTableValidator

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4994: URL: https://github.com/apache/hudi/pull/4994#issuecomment-1062585804 ## CI report: * 922548761a98dfd95cfc47b25f915d8a5506f99c Azure:

[jira] [Updated] (HUDI-3586) Add Trino IT tests following the docker demo

2022-03-08 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-3586: Status: In Progress (was: Open) > Add Trino IT tests following the docker demo >

[jira] [Assigned] (HUDI-3248) Improve Hudi table services

2022-03-08 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo reassigned HUDI-3248: --- Assignee: Raymond Xu (was: Ethan Guo) > Improve Hudi table services > --- >

[jira] [Updated] (HUDI-3586) Add Trino IT tests following the docker demo

2022-03-08 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-3586: Status: Patch Available (was: In Progress) > Add Trino IT tests following the docker demo >

[jira] [Created] (HUDI-3588) Update Presto setup in Docker Demo

2022-03-08 Thread Ethan Guo (Jira)
Ethan Guo created HUDI-3588: --- Summary: Update Presto setup in Docker Demo Key: HUDI-3588 URL: https://issues.apache.org/jira/browse/HUDI-3588 Project: Apache Hudi Issue Type: Task

[GitHub] [hudi] hudi-bot commented on pull request #4994: [Hudi-3376] Add an option to skip under deletion files for HoodieMetadataTableValidator

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4994: URL: https://github.com/apache/hudi/pull/4994#issuecomment-1062584363 ## CI report: * 922548761a98dfd95cfc47b25f915d8a5506f99c UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] hudi-bot commented on pull request #4640: [HUDI-3225] [RFC-45] for async metadata indexing

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4640: URL: https://github.com/apache/hudi/pull/4640#issuecomment-1062584118 ## CI report: * bd3b3541599ce16f91b73d4923ad7f875f4b3d2d Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4640: [HUDI-3225] [RFC-45] for async metadata indexing

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4640: URL: https://github.com/apache/hudi/pull/4640#issuecomment-1062555481 ## CI report: * 1cb4c545b9d25ab018770887fa619654a486b0c2 Azure:

[GitHub] [hudi] zhangyue19921010 opened a new pull request #4994: [Hudi-3376] Add an option to skip under deletion files for HoodieMetadataTableValidator

2022-03-08 Thread GitBox
zhangyue19921010 opened a new pull request #4994: URL: https://github.com/apache/hudi/pull/4994 https://issues.apache.org/jira/browse/HUDI-3376 ## What is the purpose of the pull request add an option named `--skip-under-deletion-data-files` which will skip to compare the data files

[GitHub] [hudi] wangxianghu edited a comment on pull request #4969: [HUDI-3569] Introduce ChainedJsonKafkaSourePostProcessor to support setting multi processors at one time

2022-03-08 Thread GitBox
wangxianghu edited a comment on pull request #4969: URL: https://github.com/apache/hudi/pull/4969#issuecomment-1062572923 > Do we really see a need for chained post processor just for jsonKafkaSource. Unless or otherwise required, don't want to add them. if you know of valid use-case, let

[GitHub] [hudi] wangxianghu edited a comment on pull request #4969: [HUDI-3569] Introduce ChainedJsonKafkaSourePostProcessor to support setting multi processors at one time

2022-03-08 Thread GitBox
wangxianghu edited a comment on pull request #4969: URL: https://github.com/apache/hudi/pull/4969#issuecomment-1062572923 > Do we really see a need for chained post processor just for jsonKafkaSource. Unless or otherwise required, don't want to add them. if you know of valid use-case, let

[GitHub] [hudi] wangxianghu edited a comment on pull request #4969: [HUDI-3569] Introduce ChainedJsonKafkaSourePostProcessor to support setting multi processors at one time

2022-03-08 Thread GitBox
wangxianghu edited a comment on pull request #4969: URL: https://github.com/apache/hudi/pull/4969#issuecomment-1062572923 > Do we really see a need for chained post processor just for jsonKafkaSource. Unless or otherwise required, don't want to add them. if you know of valid use-case, let

[GitHub] [hudi] wangxianghu edited a comment on pull request #4969: [HUDI-3569] Introduce ChainedJsonKafkaSourePostProcessor to support setting multi processors at one time

2022-03-08 Thread GitBox
wangxianghu edited a comment on pull request #4969: URL: https://github.com/apache/hudi/pull/4969#issuecomment-1062572923 > Do we really see a need for chained post processor just for jsonKafkaSource. Unless or otherwise required, don't want to add them. if you know of valid use-case, let

[GitHub] [hudi] wangxianghu commented on pull request #4969: [HUDI-3569] Introduce ChainedJsonKafkaSourePostProcessor to support setting multi processors at one time

2022-03-08 Thread GitBox
wangxianghu commented on pull request #4969: URL: https://github.com/apache/hudi/pull/4969#issuecomment-1062572923 > Do we really see a need for chained post processor just for jsonKafkaSource. Unless or otherwise required, don't want to add them. if you know of valid use-case, let me

[hudi] branch master updated (08fd80c -> 4324e87)

2022-03-08 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 08fd80c [HUDI-3221] Support querying a table as of a savepoint (#4720) add 4324e87 [HUDI-3587] Making

[GitHub] [hudi] nsivabalan merged pull request #4991: [HUDI-3587] Making SupportsUpgradeDowngrade serializable

2022-03-08 Thread GitBox
nsivabalan merged pull request #4991: URL: https://github.com/apache/hudi/pull/4991 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Closed] (HUDI-3221) Support querying a table as of a savepoint

2022-03-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-3221. Resolution: Done > Support querying a table as of a savepoint > --

[GitHub] [hudi] hudi-bot removed a comment on pull request #4640: [HUDI-3225] [RFC-45] for async metadata indexing

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4640: URL: https://github.com/apache/hudi/pull/4640#issuecomment-1062554441 ## CI report: * 1cb4c545b9d25ab018770887fa619654a486b0c2 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4640: [HUDI-3225] [RFC-45] for async metadata indexing

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4640: URL: https://github.com/apache/hudi/pull/4640#issuecomment-1062555481 ## CI report: * 1cb4c545b9d25ab018770887fa619654a486b0c2 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4991: [HUDI-3587] Making SupportsUpgradeDowngrade serializable

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4991: URL: https://github.com/apache/hudi/pull/4991#issuecomment-1062524960 ## CI report: * 0d5837fb98c6fc4c26b816910e3cbccab47353dd Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4991: [HUDI-3587] Making SupportsUpgradeDowngrade serializable

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4991: URL: https://github.com/apache/hudi/pull/4991#issuecomment-1062554647 ## CI report: * 0d5837fb98c6fc4c26b816910e3cbccab47353dd Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4640: [HUDI-3225] [RFC-45] for async metadata indexing

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4640: URL: https://github.com/apache/hudi/pull/4640#issuecomment-1062554441 ## CI report: * 1cb4c545b9d25ab018770887fa619654a486b0c2 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4640: [HUDI-3225] [RFC-45] for async metadata indexing

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4640: URL: https://github.com/apache/hudi/pull/4640#issuecomment-1016640957 ## CI report: * 1cb4c545b9d25ab018770887fa619654a486b0c2 Azure:

[GitHub] [hudi] BruceKellan opened a new issue #4993: [SUPPORT] Flink Streaming Read About Dynamic day Partition

2022-03-08 Thread GitBox
BruceKellan opened a new issue #4993: URL: https://github.com/apache/hudi/issues/4993 **To Reproduce** 1. create a streaming hudi table `ods_data`, streaming insert into it. `ods_data` partition by day. 2. streaming write into a hudi table `dwd_data` from `ods_data` 3.

[GitHub] [hudi] liuyaolin opened a new issue #4992: Hudi How to support HDFS kerberos permission verification

2022-03-08 Thread GitBox
liuyaolin opened a new issue #4992: URL: https://github.com/apache/hudi/issues/4992 Hello,I searched all the configuration files, but I didn't find the Kerberos permission verification configuration when Flink Hudi saved the data to HDFS. Can I provide Kerberos permission verification?

[GitHub] [hudi] hudi-bot removed a comment on pull request #4991: [HUDI-3587][WIP] making SupportsUpgradeDowngrade serializable

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4991: URL: https://github.com/apache/hudi/pull/4991#issuecomment-1062523716 ## CI report: * 0d5837fb98c6fc4c26b816910e3cbccab47353dd UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot

[GitHub] [hudi] hudi-bot commented on pull request #4991: [HUDI-3587][WIP] making SupportsUpgradeDowngrade serializable

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4991: URL: https://github.com/apache/hudi/pull/4991#issuecomment-1062524960 ## CI report: * 0d5837fb98c6fc4c26b816910e3cbccab47353dd Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4991: [HUDI-3587][WIP] making SupportsUpgradeDowngrade serializable

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4991: URL: https://github.com/apache/hudi/pull/4991#issuecomment-1062523716 ## CI report: * 0d5837fb98c6fc4c26b816910e3cbccab47353dd UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

  1   2   3   4   5   >