[GitHub] [hudi] hudi-bot commented on pull request #3926: [HUDI-2696] Remove the aborted checkpoint notification from coordinator

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3926: URL: https://github.com/apache/hudi/pull/3926#issuecomment-961646086 ## CI report: * 0caf196337cef27a398dfcb284666d1d46464790 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3926: [HUDI-2696] Remove the aborted checkpoint notification from coordinator

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3926: URL: https://github.com/apache/hudi/pull/3926#issuecomment-961645286 ## CI report: * 86326a094758f8ea3fa7e93c068f5e93f8689485 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3926: [HUDI-2696] Remove the aborted checkpoint notification from coordinator

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3926: URL: https://github.com/apache/hudi/pull/3926#issuecomment-961643753 ## CI report: * 86326a094758f8ea3fa7e93c068f5e93f8689485 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3926: [HUDI-2696] Remove the aborted checkpoint notification from coordinator

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3926: URL: https://github.com/apache/hudi/pull/3926#issuecomment-961645286 ## CI report: * 86326a094758f8ea3fa7e93c068f5e93f8689485 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3519: [DO NOT MERGE] 0.9.0 release patch for flink

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3519: URL: https://github.com/apache/hudi/pull/3519#issuecomment-961644368 ## CI report: * d022aa7a5bd94492c7c3e96dc5b1288268520087 UNKNOWN * ba6a7000bdde9fa7a786a93912aa9cda05e00d21 UNKNOWN * f5c958e7e1977de5478ee8e2f0c7e6624ee6fcff

[GitHub] [hudi] hudi-bot removed a comment on pull request #3519: [DO NOT MERGE] 0.9.0 release patch for flink

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3519: URL: https://github.com/apache/hudi/pull/3519#issuecomment-961628626 ## CI report: * d022aa7a5bd94492c7c3e96dc5b1288268520087 UNKNOWN * ba6a7000bdde9fa7a786a93912aa9cda05e00d21 UNKNOWN *

[GitHub] [hudi] hudi-bot removed a comment on pull request #3926: [HUDI-2696] Remove the aborted checkpoint notification from coordinator

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3926: URL: https://github.com/apache/hudi/pull/3926#issuecomment-961643092 ## CI report: * 86326a094758f8ea3fa7e93c068f5e93f8689485 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3926: [HUDI-2696] Remove the aborted checkpoint notification from coordinator

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3926: URL: https://github.com/apache/hudi/pull/3926#issuecomment-961643753 ## CI report: * 86326a094758f8ea3fa7e93c068f5e93f8689485 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3926: [HUDI-2696] Remove the aborted checkpoint notification from coordinator

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3926: URL: https://github.com/apache/hudi/pull/3926#issuecomment-961643092 ## CI report: * 86326a094758f8ea3fa7e93c068f5e93f8689485 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3926: [HUDI-2696] Remove the aborted checkpoint notification from coordinator

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3926: URL: https://github.com/apache/hudi/pull/3926#issuecomment-961631125 ## CI report: * 86326a094758f8ea3fa7e93c068f5e93f8689485 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3925: [HUDI-2686] Proccess record after all bootstrap operator ready

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3925: URL: https://github.com/apache/hudi/pull/3925#issuecomment-961640167 ## CI report: * 9b4b2b092927491148cc32379694c83680e2343e Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3925: [HUDI-2686] Proccess record after all bootstrap operator ready

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3925: URL: https://github.com/apache/hudi/pull/3925#issuecomment-961640904 ## CI report: * 9b4b2b092927491148cc32379694c83680e2343e Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3925: [HUDI-2686] Proccess record after all bootstrap operator ready

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3925: URL: https://github.com/apache/hudi/pull/3925#issuecomment-961640167 ## CI report: * 9b4b2b092927491148cc32379694c83680e2343e Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3925: [HUDI-2686] Proccess record after all bootstrap operator ready

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3925: URL: https://github.com/apache/hudi/pull/3925#issuecomment-961624106 ## CI report: * 9b4b2b092927491148cc32379694c83680e2343e Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3926: [HUDI-2696] Remove the aborted checkpoint notification from coordinator

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3926: URL: https://github.com/apache/hudi/pull/3926#issuecomment-961613057 ## CI report: * 86326a094758f8ea3fa7e93c068f5e93f8689485 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3926: [HUDI-2696] Remove the aborted checkpoint notification from coordinator

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3926: URL: https://github.com/apache/hudi/pull/3926#issuecomment-961631125 ## CI report: * 86326a094758f8ea3fa7e93c068f5e93f8689485 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3519: [DO NOT MERGE] 0.9.0 release patch for flink

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3519: URL: https://github.com/apache/hudi/pull/3519#issuecomment-961628626 ## CI report: * d022aa7a5bd94492c7c3e96dc5b1288268520087 UNKNOWN * ba6a7000bdde9fa7a786a93912aa9cda05e00d21 UNKNOWN * f5c958e7e1977de5478ee8e2f0c7e6624ee6fcff

[GitHub] [hudi] hudi-bot removed a comment on pull request #3519: [DO NOT MERGE] 0.9.0 release patch for flink

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3519: URL: https://github.com/apache/hudi/pull/3519#issuecomment-961621243 ## CI report: * d022aa7a5bd94492c7c3e96dc5b1288268520087 UNKNOWN * a654fcd138e63ccd728ad5fa0237563742b392fe Azure:

[GitHub] [hudi] nsivabalan commented on issue #2802: Hive read issues when different partition have different schemas.

2021-11-04 Thread GitBox
nsivabalan commented on issue #2802: URL: https://github.com/apache/hudi/issues/2802#issuecomment-961627203 @codope : related to schema evolution. I remember you tried a similar usecase, testing out updating few partitions w/ a new filed added. -- This is an automated message from the

[GitHub] [hudi] nsivabalan commented on issue #2934: [SUPPORT] Parquet file does not exist when trying to read hudi table incrementally

2021-11-04 Thread GitBox
nsivabalan commented on issue #2934: URL: https://github.com/apache/hudi/issues/2934#issuecomment-961626438 @jsbali / @t0il3ts0ap : Did either of you folks got a chance to upstream your changes. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hudi] hudi-bot removed a comment on pull request #3925: [HUDI-2686] Proccess record after all bootstrap operator ready

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3925: URL: https://github.com/apache/hudi/pull/3925#issuecomment-961608104 ## CI report: * 9b4b2b092927491148cc32379694c83680e2343e Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3925: [HUDI-2686] Proccess record after all bootstrap operator ready

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3925: URL: https://github.com/apache/hudi/pull/3925#issuecomment-961624106 ## CI report: * 9b4b2b092927491148cc32379694c83680e2343e Azure:

[GitHub] [hudi] nsivabalan commented on issue #3418: [SUPPORT] Hudi Upsert Very Slow/ Failed With No Space Left on Device

2021-11-04 Thread GitBox
nsivabalan commented on issue #3418: URL: https://github.com/apache/hudi/issues/3418#issuecomment-961622944 @FeiZou : if you are still having the issue, can you provide us with reproducible steps. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hudi] nsivabalan commented on pull request #3820: [HUDI-2579] Make deltastreamer checkpoint state merging more explicit

2021-11-04 Thread GitBox
nsivabalan commented on pull request #3820: URL: https://github.com/apache/hudi/pull/3820#issuecomment-961621624 @n3nash : Is there any other purpose to the old way of copying commit metadata apart from copying over checkpoints? We can add the old config as an alternative to new one

[GitHub] [hudi] hudi-bot commented on pull request #3519: [DO NOT MERGE] 0.9.0 release patch for flink

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3519: URL: https://github.com/apache/hudi/pull/3519#issuecomment-961621243 ## CI report: * d022aa7a5bd94492c7c3e96dc5b1288268520087 UNKNOWN * a654fcd138e63ccd728ad5fa0237563742b392fe Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3519: [DO NOT MERGE] 0.9.0 release patch for flink

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3519: URL: https://github.com/apache/hudi/pull/3519#issuecomment-961619765 ## CI report: * d022aa7a5bd94492c7c3e96dc5b1288268520087 UNKNOWN * a654fcd138e63ccd728ad5fa0237563742b392fe Azure:

[GitHub] [hudi] nsivabalan commented on issue #3603: [SUPPORT] delta streamer Failed to archive commits

2021-11-04 Thread GitBox
nsivabalan commented on issue #3603: URL: https://github.com/apache/hudi/issues/3603#issuecomment-961620056 @fengjian428 : hey, is there any updates for us. We can try to reproduce if you are stuck with the issue. -- This is an automated message from the Apache Git Service. To respond

[GitHub] [hudi] hudi-bot commented on pull request #3519: [DO NOT MERGE] 0.9.0 release patch for flink

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3519: URL: https://github.com/apache/hudi/pull/3519#issuecomment-961619765 ## CI report: * d022aa7a5bd94492c7c3e96dc5b1288268520087 UNKNOWN * a654fcd138e63ccd728ad5fa0237563742b392fe Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3519: [DO NOT MERGE] 0.9.0 release patch for flink

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3519: URL: https://github.com/apache/hudi/pull/3519#issuecomment-961589667 ## CI report: * d022aa7a5bd94492c7c3e96dc5b1288268520087 UNKNOWN * a654fcd138e63ccd728ad5fa0237563742b392fe Azure:

[GitHub] [hudi] n3nash commented on pull request #3820: [HUDI-2579] Make deltastreamer checkpoint state merging more explicit

2021-11-04 Thread GitBox
n3nash commented on pull request #3820: URL: https://github.com/apache/hudi/pull/3820#issuecomment-961618542 @jsbali This may affect use cases at Uber, FYI -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hudi] nsivabalan commented on issue #3828: [SUPPORT]Add a fetch table and partition valid file and return List[FileStatus]

2021-11-04 Thread GitBox
nsivabalan commented on issue #3828: URL: https://github.com/apache/hudi/issues/3828#issuecomment-961617614 yes, Metadata table does provide this. Curious to know whats the use-case here. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [hudi] nsivabalan commented on issue #3834: [SUPPORT] - AWS Athena snapshot query fails if there are two or more record array fields in a MoR table

2021-11-04 Thread GitBox
nsivabalan commented on issue #3834: URL: https://github.com/apache/hudi/issues/3834#issuecomment-961617240 CC @codope -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[jira] [Resolved] (HUDI-2651) Sync all the missing sql options for HoodieFlinkStreamer

2021-11-04 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-2651. -- Resolution: Fixed Fixed via master branch: 2c1e25932996cbf47c7cd56d944d1d9103f01c34 > Sync all the

[hudi] branch master updated (33436aa -> 2c1e259)

2021-11-04 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 33436aa Revert "[HUDI-2677] Add DFS based message queue for flink writer (#3915)" (#3923) add 2c1e259

[GitHub] [hudi] danny0405 merged pull request #3903: [HUDI-2651] Sync all the missing sql options for HoodieFlinkStreamer

2021-11-04 Thread GitBox
danny0405 merged pull request #3903: URL: https://github.com/apache/hudi/pull/3903 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] danny0405 commented on pull request #3903: [HUDI-2651] Sync all the missing sql options for HoodieFlinkStreamer

2021-11-04 Thread GitBox
danny0405 commented on pull request #3903: URL: https://github.com/apache/hudi/pull/3903#issuecomment-961615589 The failure has nothing to do with flink so i would just merge it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hudi] nsivabalan commented on issue #3841: Schema evolution improvement in 0.9.0 brakes existing applications

2021-11-04 Thread GitBox
nsivabalan commented on issue #3841: URL: https://github.com/apache/hudi/issues/3841#issuecomment-961615364 @xushiyan : looks like another ask for parquet upgrade -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hudi] danny0405 commented on a change in pull request #3925: [HUDI-2686] Proccess record after all bootstrap operator ready

2021-11-04 Thread GitBox
danny0405 commented on a change in pull request #3925: URL: https://github.com/apache/hudi/pull/3925#discussion_r743379016 ## File path: hudi-flink/src/main/java/org/apache/hudi/sink/bootstrap/aggregate/BootstrapAggFunction.java ## @@ -0,0 +1,50 @@ +/* + * Licensed to the

[GitHub] [hudi] hudi-bot removed a comment on pull request #3614: [HUDI-2370] Supports data encryption

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3614: URL: https://github.com/apache/hudi/pull/3614#issuecomment-961598212 ## CI report: * c646ab982ea9137bc84c53c8195dabc1833a34ea Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3614: [HUDI-2370] Supports data encryption

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3614: URL: https://github.com/apache/hudi/pull/3614#issuecomment-961614619 ## CI report: * f8efb1f54c2818f101db8ad90a4bc917a8035362 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3926: [HUDI-2696] Remove the aborted checkpoint notification from coordinator

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3926: URL: https://github.com/apache/hudi/pull/3926#issuecomment-961613057 ## CI report: * 86326a094758f8ea3fa7e93c068f5e93f8689485 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3926: [HUDI-2696] Remove the aborted checkpoint notification from coordinator

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3926: URL: https://github.com/apache/hudi/pull/3926#issuecomment-961612104 ## CI report: * 86326a094758f8ea3fa7e93c068f5e93f8689485 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #3926: [HUDI-2696] Remove the aborted checkpoint notification from coordinator

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3926: URL: https://github.com/apache/hudi/pull/3926#issuecomment-961612104 ## CI report: * 86326a094758f8ea3fa7e93c068f5e93f8689485 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] nsivabalan commented on issue #3892: Insert produces 44764 files with ~50MB each

2021-11-04 Thread GitBox
nsivabalan commented on issue #3892: URL: https://github.com/apache/hudi/issues/3892#issuecomment-961611978 Let me know if you are looking for more pointers. Or can we close out the issue. -- This is an automated message from the Apache Git Service. To respond to the message, please

[jira] [Updated] (HUDI-2696) Remove the aborted checkpoint notification from coordinator

2021-11-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2696: - Labels: pull-request-available (was: ) > Remove the aborted checkpoint notification from

[GitHub] [hudi] danny0405 opened a new pull request #3926: [HUDI-2696] Remove the aborted checkpoint notification from coordinator

2021-11-04 Thread GitBox
danny0405 opened a new pull request #3926: URL: https://github.com/apache/hudi/pull/3926 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the

[GitHub] [hudi] xushiyan commented on a change in pull request #3700: [HUDI-2471] Add support ignoring case in merge into

2021-11-04 Thread GitBox
xushiyan commented on a change in pull request #3700: URL: https://github.com/apache/hudi/pull/3700#discussion_r743377022 ## File path: hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/TestMergeIntoTable2.scala ## @@ -444,4 +444,115 @@ class

[jira] [Created] (HUDI-2696) Remove the aborted checkpoint notification from coordinator

2021-11-04 Thread Danny Chen (Jira)
Danny Chen created HUDI-2696: Summary: Remove the aborted checkpoint notification from coordinator Key: HUDI-2696 URL: https://issues.apache.org/jira/browse/HUDI-2696 Project: Apache Hudi Issue

[GitHub] [hudi] hudi-bot commented on pull request #3925: [HUDI-2686] Proccess record after all bootstrap operator ready

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3925: URL: https://github.com/apache/hudi/pull/3925#issuecomment-961608104 ## CI report: * 9b4b2b092927491148cc32379694c83680e2343e Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3925: [HUDI-2686] Proccess record after all bootstrap operator ready

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3925: URL: https://github.com/apache/hudi/pull/3925#issuecomment-961607288 ## CI report: * 9b4b2b092927491148cc32379694c83680e2343e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #3925: [HUDI-2686] Proccess record after all bootstrap operator ready

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3925: URL: https://github.com/apache/hudi/pull/3925#issuecomment-961607288 ## CI report: * 9b4b2b092927491148cc32379694c83680e2343e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[jira] [Updated] (HUDI-2686) Proccess record after all bootstrap operator ready

2021-11-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2686: - Labels: pull-request-available (was: ) > Proccess record after all bootstrap operator ready >

[GitHub] [hudi] yuzhaojing opened a new pull request #3925: [HUDI-2686] Proccess record after all bootstrap operator ready

2021-11-04 Thread GitBox
yuzhaojing opened a new pull request #3925: URL: https://github.com/apache/hudi/pull/3925 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the

[jira] [Created] (HUDI-2695) Documentation

2021-11-04 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-2695: - Summary: Documentation Key: HUDI-2695 URL: https://issues.apache.org/jira/browse/HUDI-2695 Project: Apache Hudi Issue Type: Sub-task Reporter: Sagar

[jira] [Created] (HUDI-2694) Support for ORC format

2021-11-04 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-2694: - Summary: Support for ORC format Key: HUDI-2694 URL: https://issues.apache.org/jira/browse/HUDI-2694 Project: Apache Hudi Issue Type: Sub-task

[jira] [Created] (HUDI-2693) Support for incremental queries on MOR table

2021-11-04 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-2693: - Summary: Support for incremental queries on MOR table Key: HUDI-2693 URL: https://issues.apache.org/jira/browse/HUDI-2693 Project: Apache Hudi Issue Type:

[jira] [Updated] (HUDI-2689) Support for snapshot query on COW table

2021-11-04 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2689: -- Summary: Support for snapshot query on COW table (was: POC for snapshot query on COW table) > Support

[jira] [Updated] (HUDI-2690) Support for snapshot and read optimized queries on MOR table

2021-11-04 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2690: -- Summary: Support for snapshot and read optimized queries on MOR table (was: POC for snapshot and read

[jira] [Created] (HUDI-2691) Implement connector SPIs

2021-11-04 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-2691: - Summary: Implement connector SPIs Key: HUDI-2691 URL: https://issues.apache.org/jira/browse/HUDI-2691 Project: Apache Hudi Issue Type: Sub-task

[jira] [Created] (HUDI-2692) Support for incremental queries on COW table

2021-11-04 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-2692: - Summary: Support for incremental queries on COW table Key: HUDI-2692 URL: https://issues.apache.org/jira/browse/HUDI-2692 Project: Apache Hudi Issue Type:

[jira] [Created] (HUDI-2690) POC for snapshot and read optimized queries on MOR table

2021-11-04 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-2690: - Summary: POC for snapshot and read optimized queries on MOR table Key: HUDI-2690 URL: https://issues.apache.org/jira/browse/HUDI-2690 Project: Apache Hudi Issue

[jira] [Assigned] (HUDI-2688) RFC

2021-11-04 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit reassigned HUDI-2688: - Assignee: Sagar Sumit > RFC > --- > > Key: HUDI-2688 > URL:

[jira] [Created] (HUDI-2689) POC for snapshot query on COW table

2021-11-04 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-2689: - Summary: POC for snapshot query on COW table Key: HUDI-2689 URL: https://issues.apache.org/jira/browse/HUDI-2689 Project: Apache Hudi Issue Type: Sub-task

[jira] [Created] (HUDI-2688) RFC

2021-11-04 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-2688: - Summary: RFC Key: HUDI-2688 URL: https://issues.apache.org/jira/browse/HUDI-2688 Project: Apache Hudi Issue Type: Sub-task Reporter: Sagar Sumit

[jira] [Created] (HUDI-2687) [UMBRELLA] A new Trino connector for Hudi

2021-11-04 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-2687: - Summary: [UMBRELLA] A new Trino connector for Hudi Key: HUDI-2687 URL: https://issues.apache.org/jira/browse/HUDI-2687 Project: Apache Hudi Issue Type: New

[GitHub] [hudi] hudi-bot commented on pull request #3614: [HUDI-2370] Supports data encryption

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3614: URL: https://github.com/apache/hudi/pull/3614#issuecomment-961598212 ## CI report: * c646ab982ea9137bc84c53c8195dabc1833a34ea Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3614: [HUDI-2370] Supports data encryption

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3614: URL: https://github.com/apache/hudi/pull/3614#issuecomment-961597323 ## CI report: * c646ab982ea9137bc84c53c8195dabc1833a34ea Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3614: [HUDI-2370] Supports data encryption

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3614: URL: https://github.com/apache/hudi/pull/3614#issuecomment-961588316 ## CI report: * c646ab982ea9137bc84c53c8195dabc1833a34ea Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3614: [HUDI-2370] Supports data encryption

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3614: URL: https://github.com/apache/hudi/pull/3614#issuecomment-961597323 ## CI report: * c646ab982ea9137bc84c53c8195dabc1833a34ea Azure:

[jira] [Updated] (HUDI-2686) Proccess record after all bootstrap operator ready

2021-11-04 Thread yuzhaojing (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuzhaojing updated HUDI-2686: - Summary: Proccess record after all bootstrap operator ready (was: Add DFS based message queue for

[GitHub] [hudi] xushiyan removed a comment on pull request #3866: [HUDI-1430] SparkDataFrameWriteClient

2021-11-04 Thread GitBox
xushiyan removed a comment on pull request #3866: URL: https://github.com/apache/hudi/pull/3866#issuecomment-954195094 ## CI report: * 8144fcd5285a5f53f4a76c4327e0bb8c90b46c97 UNKNOWN * 01cb7594fc6b49dcdde255269d43f4b97d5193ce UNKNOWN *

[GitHub] [hudi] hudi-bot removed a comment on pull request #3486: [HUDI-2314] Add support for DynamoDb based lock

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3486: URL: https://github.com/apache/hudi/pull/3486#issuecomment-899911684 ## CI report: * d2b00796c9564088aa8533431c73251993f688d4 UNKNOWN * 99853468aec1becd1112c0ffba6ccf5f604e713d UNKNOWN *

[GitHub] [hudi] hudi-bot commented on pull request #3519: [DO NOT MERGE] 0.9.0 release patch for flink

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3519: URL: https://github.com/apache/hudi/pull/3519#issuecomment-961589667 ## CI report: * d022aa7a5bd94492c7c3e96dc5b1288268520087 UNKNOWN * a654fcd138e63ccd728ad5fa0237563742b392fe Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3893: [WIP][HUDI-2656] Generalize HoodieIndex for flexible record data type

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3893: URL: https://github.com/apache/hudi/pull/3893#issuecomment-961589891 ## CI report: * 3c3560d52e3e3632294c4e30c6d67ad99730c8ec UNKNOWN * 47eaf38e01fb23599f2f1a8e5964177a2610121d Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3203: [HUDI-2086] Refactor hive mor_incremental_view

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3203: URL: https://github.com/apache/hudi/pull/3203#issuecomment-961589519 ## CI report: * 0fa6297ce58eb877fd5c4eba59fef20ad9335d26 UNKNOWN * 2182f542acd4ae3d1fd239e6441e9761eb2d33a1 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3162: [HUDI-1872] Move HoodieFlinkStreamer to hudi-utilities module

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3162: URL: https://github.com/apache/hudi/pull/3162#issuecomment-869442711 ## CI report: * 4179b35afae295d3c3f6c33787b0de39309f9e79 UNKNOWN * 3013a1c59bf40ab2d8b3bbb63e2a7f3f4ab7a882 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3920: [HUDI-2683] Parallelize deleting archived hoodie commits

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3920: URL: https://github.com/apache/hudi/pull/3920#issuecomment-961588864 ## CI report: * e06ec205c46923532cf9977e619c8bb72c2c17b3 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3010: Improving Hudi CLI tool docs

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3010: URL: https://github.com/apache/hudi/pull/3010#issuecomment-864597581 ## CI report: * 41b7708cff642483f9e1de9fba04f396151e2bdd UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot removed a comment on pull request #3921: Revert "[HUDI-2005] Fixing partition path creation in AbstractTableFileSystemView"

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3921: URL: https://github.com/apache/hudi/pull/3921#issuecomment-960477842 ## CI report: * 91e269c04954771eed8faf1b04553b581edbe76b Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3744: [HUDI-2108] Fix flakiness in TestHoodieBackedMetadata

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3744: URL: https://github.com/apache/hudi/pull/3744#issuecomment-961589758 ## CI report: * 5a724c6c859d67980473db571c9a90b8babcf710 UNKNOWN * 7e3a2869f3728226e24d8e999a95a1a9d1335a87 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3799: [HUDI-2491] hoodie.datasource.hive_sync.mode=hms mode is supported in…

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3799: URL: https://github.com/apache/hudi/pull/3799#issuecomment-961589802 ## CI report: * aa02b3508fee06bf0f3fd03b65d016eaeb9e4a65 UNKNOWN * e98d19ea99ead03b9360e04b1d006a67cf68a285 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3917: [HUDI-2526] Make spark.sql.parquet.writeLegacyFormat configurable

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3917: URL: https://github.com/apache/hudi/pull/3917#issuecomment-959056814 ## CI report: * 97e4d25248219adaf9ac40128cc345bd42f9eaf6 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3866: [HUDI-1430] SparkDataFrameWriteClient

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3866: URL: https://github.com/apache/hudi/pull/3866#issuecomment-952070379 ## CI report: * 8144fcd5285a5f53f4a76c4327e0bb8c90b46c97 UNKNOWN * 01cb7594fc6b49dcdde255269d43f4b97d5193ce UNKNOWN *

[GitHub] [hudi] hudi-bot commented on pull request #3921: Revert "[HUDI-2005] Fixing partition path creation in AbstractTableFileSystemView"

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3921: URL: https://github.com/apache/hudi/pull/3921#issuecomment-961588875 ## CI report: * 91e269c04954771eed8faf1b04553b581edbe76b Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3887: URL: https://github.com/apache/hudi/pull/3887#issuecomment-954363971 ## CI report: * 82ec7c1e3c40af686b9a4dcc5af99ebd3671913d UNKNOWN * b100a200602217c196c37e131a4768c5c8d97727 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3918: [HUDI-2679] Fix the TestMergeIntoLogOnlyTable typo.

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3918: URL: https://github.com/apache/hudi/pull/3918#issuecomment-961588850 ## CI report: * 6c7768462d04a7ab269fc906d5665456c1819526 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3359: [HUDI-2242] Add configuration inference logic for few options

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3359: URL: https://github.com/apache/hudi/pull/3359#issuecomment-888073098 ## CI report: * 906b2b8b0f830ffcb21cfcd749d22d7d91bc4b22 UNKNOWN * f208391d283d2dcf74d031f5ce87403f2b8da6c3 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3888: [HUDI-2624] Implement Non Index type for HUDI

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3888: URL: https://github.com/apache/hudi/pull/3888#issuecomment-961589881 ## CI report: * f20758076b7fd9355a6b3075fc03d93982b80cc9 UNKNOWN * 4efd2f4b2a47c7417aa6dc84ef40162637448fdf UNKNOWN * 49a813a067fccf3bad68648b7b0164d7d36a5947

[GitHub] [hudi] hudi-bot removed a comment on pull request #3912: [HUDI-2665] Fix overflow of huge log file in HoodieLogFormatWriter

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3912: URL: https://github.com/apache/hudi/pull/3912#issuecomment-958682811 ## CI report: * 690d8bc00690e815f5a165b002fcf2ab84fb4d79 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3918: [HUDI-2679] Fix the TestMergeIntoLogOnlyTable typo.

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3918: URL: https://github.com/apache/hudi/pull/3918#issuecomment-959085679 ## CI report: * 6c7768462d04a7ab269fc906d5665456c1819526 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3173: URL: https://github.com/apache/hudi/pull/3173#issuecomment-961589492 ## CI report: * ee973637958fb9c1496cfb45f78346e2f01ffa02 UNKNOWN * 98c47f1f2fe94f5626de3ee865db6ba6e679341d Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3203: [HUDI-2086] Refactor hive mor_incremental_view

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3203: URL: https://github.com/apache/hudi/pull/3203#issuecomment-872092745 ## CI report: * 0fa6297ce58eb877fd5c4eba59fef20ad9335d26 UNKNOWN * 2182f542acd4ae3d1fd239e6441e9761eb2d33a1 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3173: URL: https://github.com/apache/hudi/pull/3173#issuecomment-869653867 ## CI report: * ee973637958fb9c1496cfb45f78346e2f01ffa02 UNKNOWN * 98c47f1f2fe94f5626de3ee865db6ba6e679341d Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3887: URL: https://github.com/apache/hudi/pull/3887#issuecomment-961589864 ## CI report: * 82ec7c1e3c40af686b9a4dcc5af99ebd3671913d UNKNOWN * b100a200602217c196c37e131a4768c5c8d97727 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3744: [HUDI-2108] Fix flakiness in TestHoodieBackedMetadata

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3744: URL: https://github.com/apache/hudi/pull/3744#issuecomment-932845780 ## CI report: * 5a724c6c859d67980473db571c9a90b8babcf710 UNKNOWN * 7e3a2869f3728226e24d8e999a95a1a9d1335a87 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3888: [HUDI-2624] Implement Non Index type for HUDI

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3888: URL: https://github.com/apache/hudi/pull/3888#issuecomment-954503596 ## CI report: * f20758076b7fd9355a6b3075fc03d93982b80cc9 UNKNOWN * 4efd2f4b2a47c7417aa6dc84ef40162637448fdf UNKNOWN *

[GitHub] [hudi] hudi-bot commented on pull request #3912: [HUDI-2665] Fix overflow of huge log file in HoodieLogFormatWriter

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3912: URL: https://github.com/apache/hudi/pull/3912#issuecomment-961588822 ## CI report: * 690d8bc00690e815f5a165b002fcf2ab84fb4d79 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync

2021-11-04 Thread GitBox
hudi-bot commented on pull request #3771: URL: https://github.com/apache/hudi/pull/3771#issuecomment-961589777 ## CI report: * 9e64e88d819b6b6bf5ccc5811ea5f4714138fc9e UNKNOWN * e7e7f170612fcecc8b07839d296f2c06972f2f44 UNKNOWN * 86e65215ff5f069470d732f4dce80cd20426fb5c

[GitHub] [hudi] hudi-bot removed a comment on pull request #3599: [HUDI-2207] Support independent flink hudi clustering function

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3599: URL: https://github.com/apache/hudi/pull/3599#issuecomment-912967268 ## CI report: * 1bb7f93fe404c1b90eece4f7db56de50736a3a12 UNKNOWN * 51385678b3014c7533fd98a8a45165f4fd0858c8 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3622: [HUDI-2402]Hive Sync supports Kerberos authentication

2021-11-04 Thread GitBox
hudi-bot removed a comment on pull request #3622: URL: https://github.com/apache/hudi/pull/3622#issuecomment-914748618 ## CI report: * aae3c22b5ab176daf990c1fa03384702baa87a25 UNKNOWN * 28eea9f5aa03ce8e0c106f0ef6c87baff8b70f6c UNKNOWN *

  1   2   3   4   >