[GitHub] [hudi] hudi-bot commented on pull request #3912: [HUDI-2665] Fix overflow of huge log file in HoodieLogFormatWriter

2021-11-05 Thread GitBox
hudi-bot commented on pull request #3912: URL: https://github.com/apache/hudi/pull/3912#issuecomment-962399326 ## CI report: * 690d8bc00690e815f5a165b002fcf2ab84fb4d79 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3912: [HUDI-2665] Fix overflow of huge log file in HoodieLogFormatWriter

2021-11-05 Thread GitBox
hudi-bot removed a comment on pull request #3912: URL: https://github.com/apache/hudi/pull/3912#issuecomment-962399131 ## CI report: * 690d8bc00690e815f5a165b002fcf2ab84fb4d79 Azure:

[jira] [Assigned] (HUDI-1658) [UMBRELLA] Spark Sql Support For Hudi

2021-11-05 Thread Yann Byron (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yann Byron reassigned HUDI-1658: Assignee: Yann Byron (was: pengzhiwei) > [UMBRELLA] Spark Sql Support For Hudi >

[jira] [Assigned] (HUDI-1832) Support Hoodie CLI Command In Spark SQL

2021-11-05 Thread Yann Byron (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yann Byron reassigned HUDI-1832: Assignee: Yann Byron > Support Hoodie CLI Command In Spark SQL >

[GitHub] [hudi] hudi-bot commented on pull request #3912: [HUDI-2665] Fix overflow of huge log file in HoodieLogFormatWriter

2021-11-05 Thread GitBox
hudi-bot commented on pull request #3912: URL: https://github.com/apache/hudi/pull/3912#issuecomment-962399131 ## CI report: * 690d8bc00690e815f5a165b002fcf2ab84fb4d79 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3912: [HUDI-2665] Fix overflow of huge log file in HoodieLogFormatWriter

2021-11-05 Thread GitBox
hudi-bot removed a comment on pull request #3912: URL: https://github.com/apache/hudi/pull/3912#issuecomment-961588822 ## CI report: * 690d8bc00690e815f5a165b002fcf2ab84fb4d79 Azure:

[GitHub] [hudi] guanziyue commented on pull request #3912: [HUDI-2665] Fix overflow of huge log file in HoodieLogFormatWriter

2021-11-05 Thread GitBox
guanziyue commented on pull request #3912: URL: https://github.com/apache/hudi/pull/3912#issuecomment-962399151 Fix checkSytle problems -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Commented] (HUDI-1885) Support Delete/Update Non-Pk Table

2021-11-05 Thread Yann Byron (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439602#comment-17439602 ] Yann Byron commented on HUDI-1885: -- I'll let users force to provide `recordKey` or `primaryKey` to make

[GitHub] [hudi] hudi-bot removed a comment on pull request #3932: [HUDI-2704] Adding RFC-37 for Metadata based bloom index

2021-11-05 Thread GitBox
hudi-bot removed a comment on pull request #3932: URL: https://github.com/apache/hudi/pull/3932#issuecomment-962393214 ## CI report: * f584cff8c637e290c8e82464474d67f5508ea1de Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3932: [HUDI-2704] Adding RFC-37 for Metadata based bloom index

2021-11-05 Thread GitBox
hudi-bot commented on pull request #3932: URL: https://github.com/apache/hudi/pull/3932#issuecomment-962397869 ## CI report: * f584cff8c637e290c8e82464474d67f5508ea1de Azure:

[GitHub] [hudi] prashantwason commented on a change in pull request #3873: [HUDI-2634] Improved the metadata table bootstrap for very large tables.

2021-11-05 Thread GitBox
prashantwason commented on a change in pull request #3873: URL: https://github.com/apache/hudi/pull/3873#discussion_r744077361 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/metadata/SparkHoodieBackedTableMetadataWriter.java ## @@ -145,15 +152,39 @@

[jira] [Commented] (HUDI-310) DynamoDB/Kinesis Change Capture using Delta Streamer

2021-11-05 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439600#comment-17439600 ] Vinoth Chandar commented on HUDI-310: - This has changed hands quite a bit. We still want to take this

[GitHub] [hudi] hudi-bot removed a comment on pull request #3932: [HUDI-2704] Adding RFC-37 for Metadata based bloom index

2021-11-05 Thread GitBox
hudi-bot removed a comment on pull request #3932: URL: https://github.com/apache/hudi/pull/3932#issuecomment-962393028 ## CI report: * f584cff8c637e290c8e82464474d67f5508ea1de UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #3932: [HUDI-2704] Adding RFC-37 for Metadata based bloom index

2021-11-05 Thread GitBox
hudi-bot commented on pull request #3932: URL: https://github.com/apache/hudi/pull/3932#issuecomment-962393214 ## CI report: * f584cff8c637e290c8e82464474d67f5508ea1de Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3932: [HUDI-2704] Adding RFC-37 for Metadata based bloom index

2021-11-05 Thread GitBox
hudi-bot commented on pull request #3932: URL: https://github.com/apache/hudi/pull/3932#issuecomment-962393028 ## CI report: * f584cff8c637e290c8e82464474d67f5508ea1de UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] nsivabalan commented on pull request #3932: [HUDI-2704] Adding RFC-37 for Metadata based bloom index

2021-11-05 Thread GitBox
nsivabalan commented on pull request #3932: URL: https://github.com/apache/hudi/pull/3932#issuecomment-962392948 https://user-images.githubusercontent.com/513218/140597886-1a87a495-b358-4301-ac78-eb9aafc15433.png;>

[jira] [Updated] (HUDI-2704) Create and publish RFC for metadata based bloom index

2021-11-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2704: - Labels: pull-request-available (was: ) > Create and publish RFC for metadata based bloom index >

[jira] [Assigned] (HUDI-2704) Create and publish RFC for metadata based bloom index

2021-11-05 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-2704: - Assignee: sivabalan narayanan > Create and publish RFC for metadata based bloom

[GitHub] [hudi] nsivabalan opened a new pull request #3932: [HUDI-2704] Adding RFC-37 for Metadata based bloom index

2021-11-05 Thread GitBox
nsivabalan opened a new pull request #3932: URL: https://github.com/apache/hudi/pull/3932 ## What is the purpose of the pull request Adding an RFC for metadata based bloom index. ## Brief change log *(for example:)* - *Modify AnnotationLocation checkstyle rule in

[jira] [Updated] (HUDI-2704) Create and publish RFC for metadata based bloom index

2021-11-05 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2704: -- Fix Version/s: 0.10.0 > Create and publish RFC for metadata based bloom index >

[jira] [Created] (HUDI-2704) Create and publish RFC for metadata based bloom index

2021-11-05 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2704: - Summary: Create and publish RFC for metadata based bloom index Key: HUDI-2704 URL: https://issues.apache.org/jira/browse/HUDI-2704 Project: Apache Hudi

[jira] [Updated] (HUDI-2704) Create and publish RFC for metadata based bloom index

2021-11-05 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2704: -- Parent: HUDI-2703 Issue Type: Sub-task (was: Improvement) > Create and publish

[jira] [Updated] (HUDI-2475) Rolling Upgrade downgrade story for 0.10 & enabling metadata

2021-11-05 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-2475: - Summary: Rolling Upgrade downgrade story for 0.10 & enabling metadata (was: Upgrade downgrade

[jira] [Commented] (HUDI-2475) Upgrade downgrade infra for enabling metadata

2021-11-05 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439599#comment-17439599 ] Vinoth Chandar commented on HUDI-2475: -- I agree with your assessment above that for multi-writer

[jira] [Resolved] (HUDI-2702) Set up keygen class explicit for write config for flink table upgrade

2021-11-05 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-2702. -- Resolution: Fixed Fixed via master branch: 9a8963d05eb93849e84151a63eecf12afe1017ce > Set up keygen

[hudi] branch master updated (08c35a5 -> 9a8963d)

2021-11-05 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 08c35a5 [HUDI-2526] Make spark.sql.parquet.writeLegacyFormat configurable (#3917) add 9a8963d [HUDI-2702]

[GitHub] [hudi] danny0405 merged pull request #3931: [HUDI-2702] Set up keygen class explicit for write config for flink t…

2021-11-05 Thread GitBox
danny0405 merged pull request #3931: URL: https://github.com/apache/hudi/pull/3931 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] prashantwason commented on a change in pull request #3873: [HUDI-2634] Improved the metadata table bootstrap for very large tables.

2021-11-05 Thread GitBox
prashantwason commented on a change in pull request #3873: URL: https://github.com/apache/hudi/pull/3873#discussion_r744072970 ## File path: hudi-common/src/main/java/org/apache/hudi/common/model/HoodieFileFormat.java ## @@ -36,4 +49,9 @@ public String getFileExtension() {

[GitHub] [hudi] prashantwason commented on a change in pull request #3873: [HUDI-2634] Improved the metadata table bootstrap for very large tables.

2021-11-05 Thread GitBox
prashantwason commented on a change in pull request #3873: URL: https://github.com/apache/hudi/pull/3873#discussion_r744072865 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java ## @@ -419,52 +394,53 @@

[GitHub] [hudi] prashantwason commented on a change in pull request #3873: [HUDI-2634] Improved the metadata table bootstrap for very large tables.

2021-11-05 Thread GitBox
prashantwason commented on a change in pull request #3873: URL: https://github.com/apache/hudi/pull/3873#discussion_r744072738 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java ## @@ -419,52 +394,53 @@

[GitHub] [hudi] prashantwason commented on a change in pull request #3873: [HUDI-2634] Improved the metadata table bootstrap for very large tables.

2021-11-05 Thread GitBox
prashantwason commented on a change in pull request #3873: URL: https://github.com/apache/hudi/pull/3873#discussion_r744072765 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java ## @@ -419,52 +394,53 @@

[GitHub] [hudi] hudi-bot removed a comment on pull request #3931: [HUDI-2702] Set up keygen class explicit for write config for flink t…

2021-11-05 Thread GitBox
hudi-bot removed a comment on pull request #3931: URL: https://github.com/apache/hudi/pull/3931#issuecomment-962379179 ## CI report: * 1d00470d8bc57d799236a88a27b4a5b524904007 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3931: [HUDI-2702] Set up keygen class explicit for write config for flink t…

2021-11-05 Thread GitBox
hudi-bot commented on pull request #3931: URL: https://github.com/apache/hudi/pull/3931#issuecomment-962387547 ## CI report: * 1d00470d8bc57d799236a88a27b4a5b524904007 Azure:

[jira] [Created] (HUDI-2703) [RFC-37] Metadata based bloom index

2021-11-05 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2703: - Summary: [RFC-37] Metadata based bloom index Key: HUDI-2703 URL: https://issues.apache.org/jira/browse/HUDI-2703 Project: Apache Hudi Issue Type:

[jira] [Updated] (HUDI-2703) [RFC-37] Metadata based bloom index

2021-11-05 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2703: -- Labels: hudi-umbrellas (was: ) > [RFC-37] Metadata based bloom index >

[jira] [Assigned] (HUDI-2703) [RFC-37] Metadata based bloom index

2021-11-05 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-2703: - Assignee: sivabalan narayanan > [RFC-37] Metadata based bloom index >

[jira] [Updated] (HUDI-2471) Add support ignoring case in merge into

2021-11-05 Thread Jira
[ https://issues.apache.org/jira/browse/HUDI-2471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 董可伦 updated HUDI-2471: -- Summary: Add support ignoring case in merge into (was: Add support ignoring case when column name matches in merge

[GitHub] [hudi] hudi-bot commented on pull request #3904: [WIP][HUDI-1295] Metadata Index - Bloom filter metadata to speed up index lookups

2021-11-05 Thread GitBox
hudi-bot commented on pull request #3904: URL: https://github.com/apache/hudi/pull/3904#issuecomment-962379908 ## CI report: * bdb2fa68fc669152c8978774f72912c5ae52d54b Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3904: [WIP][HUDI-1295] Metadata Index - Bloom filter metadata to speed up index lookups

2021-11-05 Thread GitBox
hudi-bot removed a comment on pull request #3904: URL: https://github.com/apache/hudi/pull/3904#issuecomment-962369431 ## CI report: * f66b2f92c0ae8fa8af84ee4f91090aacc66c7f39 Azure:

[jira] [Commented] (HUDI-1492) Enhance DeltaWriteStat with block level metadata correctly for storage schemes that support appends

2021-11-05 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439581#comment-17439581 ] Vinoth Chandar commented on HUDI-1492: -- I am assigning this to [~manojg] to consider this during col

[jira] [Assigned] (HUDI-1492) Enhance DeltaWriteStat with block level metadata correctly for storage schemes that support appends

2021-11-05 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned HUDI-1492: Assignee: Manoj Govindassamy (was: Vinoth Chandar) > Enhance DeltaWriteStat with block

[jira] [Updated] (HUDI-1492) Enhance DeltaWriteStat with block level metadata correctly for storage schemes that support appends

2021-11-05 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1492: - Summary: Enhance DeltaWriteStat with block level metadata correctly for storage schemes that

[jira] [Commented] (HUDI-1492) Handle DeltaWriteStat correctly for storage schemes that support appends

2021-11-05 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439580#comment-17439580 ] Vinoth Chandar commented on HUDI-1492: -- I am curious about what we are doing going to do here for say

[GitHub] [hudi] hudi-bot removed a comment on pull request #3931: [HUDI-2702] Set up keygen class explicit for write config for flink t…

2021-11-05 Thread GitBox
hudi-bot removed a comment on pull request #3931: URL: https://github.com/apache/hudi/pull/3931#issuecomment-962378941 ## CI report: * 1d00470d8bc57d799236a88a27b4a5b524904007 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #3931: [HUDI-2702] Set up keygen class explicit for write config for flink t…

2021-11-05 Thread GitBox
hudi-bot commented on pull request #3931: URL: https://github.com/apache/hudi/pull/3931#issuecomment-962379179 ## CI report: * 1d00470d8bc57d799236a88a27b4a5b524904007 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3931: [HUDI-2702] Set up keygen class explicit for write config for flink t…

2021-11-05 Thread GitBox
hudi-bot commented on pull request #3931: URL: https://github.com/apache/hudi/pull/3931#issuecomment-962378941 ## CI report: * 1d00470d8bc57d799236a88a27b4a5b524904007 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[jira] [Updated] (HUDI-2702) Set up keygen class explicit for write config for flink table upgrade

2021-11-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2702: - Labels: pull-request-available (was: ) > Set up keygen class explicit for write config for flink

[GitHub] [hudi] danny0405 opened a new pull request #3931: [HUDI-2702] Set up keygen class explicit for write config for flink t…

2021-11-05 Thread GitBox
danny0405 opened a new pull request #3931: URL: https://github.com/apache/hudi/pull/3931 …able upgrade ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.*

[jira] [Created] (HUDI-2702) Set up keygen class explicit for write config for flink table upgrade

2021-11-05 Thread Danny Chen (Jira)
Danny Chen created HUDI-2702: Summary: Set up keygen class explicit for write config for flink table upgrade Key: HUDI-2702 URL: https://issues.apache.org/jira/browse/HUDI-2702 Project: Apache Hudi

[GitHub] [hudi] hudi-bot commented on pull request #3904: [WIP][HUDI-1295] Metadata Index - Bloom filter metadata to speed up index lookups

2021-11-05 Thread GitBox
hudi-bot commented on pull request #3904: URL: https://github.com/apache/hudi/pull/3904#issuecomment-962369431 ## CI report: * f66b2f92c0ae8fa8af84ee4f91090aacc66c7f39 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3904: [WIP][HUDI-1295] Metadata Index - Bloom filter metadata to speed up index lookups

2021-11-05 Thread GitBox
hudi-bot removed a comment on pull request #3904: URL: https://github.com/apache/hudi/pull/3904#issuecomment-962303344 ## CI report: * f66b2f92c0ae8fa8af84ee4f91090aacc66c7f39 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3457: HUDI-1827 : Add ORC support in Bootstrap Op

2021-11-05 Thread GitBox
hudi-bot commented on pull request #3457: URL: https://github.com/apache/hudi/pull/3457#issuecomment-962364201 ## CI report: * 9d3a77d8ffc223b9a01aa665a75f01d8c4ac8a6f Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3457: HUDI-1827 : Add ORC support in Bootstrap Op

2021-11-05 Thread GitBox
hudi-bot removed a comment on pull request #3457: URL: https://github.com/apache/hudi/pull/3457#issuecomment-962298432 ## CI report: * d8029ad9eb62c5e5b0480ef3135ce068ab51dc6d Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3904: [WIP][HUDI-1295] Metadata Index - Bloom filter metadata to speed up index lookups

2021-11-05 Thread GitBox
hudi-bot commented on pull request #3904: URL: https://github.com/apache/hudi/pull/3904#issuecomment-962303344 ## CI report: * f66b2f92c0ae8fa8af84ee4f91090aacc66c7f39 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3904: [WIP][HUDI-1295] Metadata Index - Bloom filter metadata to speed up index lookups

2021-11-05 Thread GitBox
hudi-bot removed a comment on pull request #3904: URL: https://github.com/apache/hudi/pull/3904#issuecomment-962299391 ## CI report: * 8f19898017c238eb1cc49c197670d5c233d81cfc Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3904: [WIP][HUDI-1295] Metadata Index - Bloom filter metadata to speed up index lookups

2021-11-05 Thread GitBox
hudi-bot removed a comment on pull request #3904: URL: https://github.com/apache/hudi/pull/3904#issuecomment-962297655 ## CI report: * 8f19898017c238eb1cc49c197670d5c233d81cfc Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3904: [WIP][HUDI-1295] Metadata Index - Bloom filter metadata to speed up index lookups

2021-11-05 Thread GitBox
hudi-bot commented on pull request #3904: URL: https://github.com/apache/hudi/pull/3904#issuecomment-962299391 ## CI report: * 8f19898017c238eb1cc49c197670d5c233d81cfc Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3457: HUDI-1827 : Add ORC support in Bootstrap Op

2021-11-05 Thread GitBox
hudi-bot commented on pull request #3457: URL: https://github.com/apache/hudi/pull/3457#issuecomment-962298432 ## CI report: * d8029ad9eb62c5e5b0480ef3135ce068ab51dc6d Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3457: HUDI-1827 : Add ORC support in Bootstrap Op

2021-11-05 Thread GitBox
hudi-bot removed a comment on pull request #3457: URL: https://github.com/apache/hudi/pull/3457#issuecomment-962297946 ## CI report: * d8029ad9eb62c5e5b0480ef3135ce068ab51dc6d Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3904: [WIP][HUDI-1295] Metadata Index - Bloom filter metadata to speed up index lookups

2021-11-05 Thread GitBox
hudi-bot commented on pull request #3904: URL: https://github.com/apache/hudi/pull/3904#issuecomment-962297352 ## CI report: * 8f19898017c238eb1cc49c197670d5c233d81cfc Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3904: [WIP][HUDI-1295] Metadata Index - Bloom filter metadata to speed up index lookups

2021-11-05 Thread GitBox
hudi-bot removed a comment on pull request #3904: URL: https://github.com/apache/hudi/pull/3904#issuecomment-962289158 ## CI report: * 8f19898017c238eb1cc49c197670d5c233d81cfc Azure:

[GitHub] [hudi] nsivabalan commented on a change in pull request #3836: [HUDI-2591] Bootstrap metadata table only if upgrade / downgrade is not required.

2021-11-05 Thread GitBox
nsivabalan commented on a change in pull request #3836: URL: https://github.com/apache/hudi/pull/3836#discussion_r744036617 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/SparkRDDWriteClient.java ## @@ -95,10 +95,19 @@ public

[GitHub] [hudi] hudi-bot commented on pull request #3904: [WIP][HUDI-1295] Metadata Index - Bloom filter metadata to speed up index lookups

2021-11-05 Thread GitBox
hudi-bot commented on pull request #3904: URL: https://github.com/apache/hudi/pull/3904#issuecomment-962289158 ## CI report: * 8f19898017c238eb1cc49c197670d5c233d81cfc Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3904: [WIP][HUDI-1295] Metadata Index - Bloom filter metadata to speed up index lookups

2021-11-05 Thread GitBox
hudi-bot removed a comment on pull request #3904: URL: https://github.com/apache/hudi/pull/3904#issuecomment-962276054 ## CI report: * 41ea70200b4e5fd5646a692d8a6110a67045b1d8 Azure:

[GitHub] [hudi] leesf commented on a change in pull request #3927: [HUDI-2697]Minor changes about hbase index config.

2021-11-05 Thread GitBox
leesf commented on a change in pull request #3927: URL: https://github.com/apache/hudi/pull/3927#discussion_r744027594 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java ## @@ -1300,7 +1300,7 @@ public int

[GitHub] [hudi] hudi-bot commented on pull request #3904: [WIP][HUDI-1295] Metadata Index - Bloom filter metadata to speed up index lookups

2021-11-05 Thread GitBox
hudi-bot commented on pull request #3904: URL: https://github.com/apache/hudi/pull/3904#issuecomment-962276054 ## CI report: * 41ea70200b4e5fd5646a692d8a6110a67045b1d8 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3904: [WIP][HUDI-1295] Metadata Index - Bloom filter metadata to speed up index lookups

2021-11-05 Thread GitBox
hudi-bot removed a comment on pull request #3904: URL: https://github.com/apache/hudi/pull/3904#issuecomment-962275302 ## CI report: * 41ea70200b4e5fd5646a692d8a6110a67045b1d8 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3904: [WIP][HUDI-1295] Metadata Index - Bloom filter metadata to speed up index lookups

2021-11-05 Thread GitBox
hudi-bot commented on pull request #3904: URL: https://github.com/apache/hudi/pull/3904#issuecomment-962275302 ## CI report: * 41ea70200b4e5fd5646a692d8a6110a67045b1d8 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3904: [WIP][HUDI-1295] Metadata Index - Bloom filter metadata to speed up index lookups

2021-11-05 Thread GitBox
hudi-bot removed a comment on pull request #3904: URL: https://github.com/apache/hudi/pull/3904#issuecomment-961588811 ## CI report: * 41ea70200b4e5fd5646a692d8a6110a67045b1d8 Azure:

[GitHub] [hudi] prashantwason commented on a change in pull request #3836: [HUDI-2591] Bootstrap metadata table only if upgrade / downgrade is not required.

2021-11-05 Thread GitBox
prashantwason commented on a change in pull request #3836: URL: https://github.com/apache/hudi/pull/3836#discussion_r744019234 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/SparkRDDWriteClient.java ## @@ -95,10 +95,19 @@ public

[GitHub] [hudi] nsivabalan commented on a change in pull request #3836: [HUDI-2591] Bootstrap metadata table only if upgrade / downgrade is not required.

2021-11-05 Thread GitBox
nsivabalan commented on a change in pull request #3836: URL: https://github.com/apache/hudi/pull/3836#discussion_r744011894 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/SparkRDDWriteClient.java ## @@ -95,10 +95,19 @@ public

[GitHub] [hudi] nsivabalan commented on a change in pull request #3836: [HUDI-2591] Bootstrap metadata table only if upgrade / downgrade is not required.

2021-11-05 Thread GitBox
nsivabalan commented on a change in pull request #3836: URL: https://github.com/apache/hudi/pull/3836#discussion_r744011894 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/SparkRDDWriteClient.java ## @@ -95,10 +95,19 @@ public

[GitHub] [hudi] hudi-bot removed a comment on pull request #3836: [HUDI-2591] Bootstrap metadata table only if upgrade / downgrade is not required.

2021-11-05 Thread GitBox
hudi-bot removed a comment on pull request #3836: URL: https://github.com/apache/hudi/pull/3836#issuecomment-962231751 ## CI report: * 2e3cb57760c2ba7769d9f9892fa73486c9c7ee74 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3836: [HUDI-2591] Bootstrap metadata table only if upgrade / downgrade is not required.

2021-11-05 Thread GitBox
hudi-bot commented on pull request #3836: URL: https://github.com/apache/hudi/pull/3836#issuecomment-962254215 ## CI report: * e916c158969b8b855cbde8bceac94e80b98d Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3457: HUDI-1827 : Add ORC support in Bootstrap Op

2021-11-05 Thread GitBox
hudi-bot commented on pull request #3457: URL: https://github.com/apache/hudi/pull/3457#issuecomment-962244237 ## CI report: * d8029ad9eb62c5e5b0480ef3135ce068ab51dc6d Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3457: HUDI-1827 : Add ORC support in Bootstrap Op

2021-11-05 Thread GitBox
hudi-bot removed a comment on pull request #3457: URL: https://github.com/apache/hudi/pull/3457#issuecomment-962243269 ## CI report: * bf770ecbfccbacddb86a74832213b959addbfda2 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3457: HUDI-1827 : Add ORC support in Bootstrap Op

2021-11-05 Thread GitBox
hudi-bot commented on pull request #3457: URL: https://github.com/apache/hudi/pull/3457#issuecomment-962243269 ## CI report: * bf770ecbfccbacddb86a74832213b959addbfda2 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3457: HUDI-1827 : Add ORC support in Bootstrap Op

2021-11-05 Thread GitBox
hudi-bot removed a comment on pull request #3457: URL: https://github.com/apache/hudi/pull/3457#issuecomment-961588152 ## CI report: * bf770ecbfccbacddb86a74832213b959addbfda2 Azure:

[GitHub] [hudi] vinothchandar commented on pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

2021-11-05 Thread GitBox
vinothchandar commented on pull request #3173: URL: https://github.com/apache/hudi/pull/3173#issuecomment-962238516 @minihippo sorry not mention here. @vingov is also going to try and test this as well for uber -- This is an automated message from the Apache Git Service. To respond

[GitHub] [hudi] vinothchandar commented on a change in pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadat

2021-11-05 Thread GitBox
vinothchandar commented on a change in pull request #3900: URL: https://github.com/apache/hudi/pull/3900#discussion_r743985200 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/BaseActionExecutor.java ## @@ -57,7 +57,7 @@ public

[GitHub] [hudi] hudi-bot commented on pull request #3836: [HUDI-2591] Bootstrap metadata table only if upgrade / downgrade is not required.

2021-11-05 Thread GitBox
hudi-bot commented on pull request #3836: URL: https://github.com/apache/hudi/pull/3836#issuecomment-962231751 ## CI report: * 2e3cb57760c2ba7769d9f9892fa73486c9c7ee74 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3836: [HUDI-2591] Bootstrap metadata table only if upgrade / downgrade is not required.

2021-11-05 Thread GitBox
hudi-bot removed a comment on pull request #3836: URL: https://github.com/apache/hudi/pull/3836#issuecomment-962230403 ## CI report: * 2e3cb57760c2ba7769d9f9892fa73486c9c7ee74 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3836: [HUDI-2591] Bootstrap metadata table only if upgrade / downgrade is not required.

2021-11-05 Thread GitBox
hudi-bot removed a comment on pull request #3836: URL: https://github.com/apache/hudi/pull/3836#issuecomment-961588627 ## CI report: * 2e3cb57760c2ba7769d9f9892fa73486c9c7ee74 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3836: [HUDI-2591] Bootstrap metadata table only if upgrade / downgrade is not required.

2021-11-05 Thread GitBox
hudi-bot commented on pull request #3836: URL: https://github.com/apache/hudi/pull/3836#issuecomment-962230403 ## CI report: * 2e3cb57760c2ba7769d9f9892fa73486c9c7ee74 Azure:

[GitHub] [hudi] prashantwason commented on a change in pull request #3836: [HUDI-2591] Bootstrap metadata table only if upgrade / downgrade is not required.

2021-11-05 Thread GitBox
prashantwason commented on a change in pull request #3836: URL: https://github.com/apache/hudi/pull/3836#discussion_r743981870 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/SparkRDDWriteClient.java ## @@ -95,10 +95,19 @@ public

[GitHub] [hudi] vinothchandar commented on a change in pull request #3880: [HUDI-2606] Enable metadata reader by default

2021-11-05 Thread GitBox
vinothchandar commented on a change in pull request #3880: URL: https://github.com/apache/hudi/pull/3880#discussion_r743977052 ## File path: hudi-common/src/main/java/org/apache/hudi/common/config/HoodieMetadataConfig.java ## @@ -45,7 +45,7 @@ .sinceVersion("0.7.0")

[GitHub] [hudi] vinothchandar commented on a change in pull request #3880: [HUDI-2606] Enable metadata reader by default

2021-11-05 Thread GitBox
vinothchandar commented on a change in pull request #3880: URL: https://github.com/apache/hudi/pull/3880#discussion_r743976266 ## File path: packaging/hudi-hive-sync-bundle/pom.xml ## @@ -69,12 +69,18 @@ org.apache.hudi:hudi-sync-common

[GitHub] [hudi] vinothchandar commented on a change in pull request #3889: [HUDI-2443] Hudi KVComparator for all HFile writer usages

2021-11-05 Thread GitBox
vinothchandar commented on a change in pull request #3889: URL: https://github.com/apache/hudi/pull/3889#discussion_r743971409 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/HoodieKVComparator.java ## @@ -0,0 +1,29 @@ +/* + * Licensed to the Apache

[GitHub] [hudi] nsivabalan commented on pull request #3824: [HUDI-2559] Millisecond granularity for instant timestamps

2021-11-05 Thread GitBox
nsivabalan commented on pull request #3824: URL: https://github.com/apache/hudi/pull/3824#issuecomment-962198691 @vinothchandar : writing a UT in TestHoodieActiveTimeline would suffice, just to compare old and new timestamp formats? or are you looking for tests at write client layer sort

[GitHub] [hudi] nsivabalan commented on pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

2021-11-05 Thread GitBox
nsivabalan commented on pull request #3173: URL: https://github.com/apache/hudi/pull/3173#issuecomment-962201291 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] vinothchandar commented on pull request #3930: [HUDI-431] [WIP] Adding parquet data block with inline read support

2021-11-05 Thread GitBox
vinothchandar commented on pull request #3930: URL: https://github.com/apache/hudi/pull/3930#issuecomment-962196824 @nsivabalan we should push this back a bit and may be even @codope can review this and take over? this is not directly related to metadata table right. -- This is an

[GitHub] [hudi] hudi-bot commented on pull request #3457: HUDI-1827 : Add ORC support in Bootstrap Op

2021-11-05 Thread GitBox
hudi-bot commented on pull request #3457: URL: https://github.com/apache/hudi/pull/3457#issuecomment-961588152 ## CI report: * bf770ecbfccbacddb86a74832213b959addbfda2 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3468: [HUDI-2306] Support setting whether drop duplicate based on table typ…

2021-11-05 Thread GitBox
hudi-bot removed a comment on pull request #3468: URL: https://github.com/apache/hudi/pull/3468#issuecomment-898270779 ## CI report: * abf61dd81ea40386a5f4f5f1d6bc5adc92df Azure:

[GitHub] [hudi] hudi-bot commented on pull request #2426: [HUDI-304] Configure spotless and java style

2021-11-05 Thread GitBox
hudi-bot commented on pull request #2426: URL: https://github.com/apache/hudi/pull/2426#issuecomment-961587546 ## CI report: * b7aa291685a1a350fff98607ebcdf0d19ce64f3f UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] hudi-bot commented on pull request #3744: [HUDI-2108] Fix flakiness in TestHoodieBackedMetadata

2021-11-05 Thread GitBox
hudi-bot commented on pull request #3744: URL: https://github.com/apache/hudi/pull/3744#issuecomment-961589758 ## CI report: * 5a724c6c859d67980473db571c9a90b8babcf710 UNKNOWN * 7e3a2869f3728226e24d8e999a95a1a9d1335a87 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #2982: [HUDI-1441] Fixing HoodieAvroUtils.rewriteRecord for nested record schema evolution

2021-11-05 Thread GitBox
hudi-bot commented on pull request #2982: URL: https://github.com/apache/hudi/pull/2982#issuecomment-961587749 ## CI report: * 92ca2e97f51fea8ef906eabcc83eb77facb27c5d Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #2426: [HUDI-304] Configure spotless and java style

2021-11-05 Thread GitBox
hudi-bot removed a comment on pull request #2426: URL: https://github.com/apache/hudi/pull/2426#issuecomment-910862643 ## CI report: * b7aa291685a1a350fff98607ebcdf0d19ce64f3f UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] prashantwason commented on a change in pull request #3873: [HUDI-2634] Improved the metadata table bootstrap for very large tables.

2021-11-05 Thread GitBox
prashantwason commented on a change in pull request #3873: URL: https://github.com/apache/hudi/pull/3873#discussion_r743232434 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java ## @@ -645,4 +612,83 @@

[GitHub] [hudi] nsivabalan commented on issue #3868: [SUPPORT] hive syncing with `--spark-datasource` (first title was: Querying hudi datasets from standalone metastore)

2021-11-05 Thread GitBox
nsivabalan commented on issue #3868: URL: https://github.com/apache/hudi/issues/3868#issuecomment-961860610 hey. Can you give us full set of configs you used to create/write to hudi table along with sync configs used. would help us triage the issue. -- This is an automated message from

[GitHub] [hudi] yuzhaojing commented on pull request #3903: [HUDI-2651] Sync all the missing sql options for HoodieFlinkStreamer

2021-11-05 Thread GitBox
yuzhaojing commented on pull request #3903: URL: https://github.com/apache/hudi/pull/3903#issuecomment-961582529 > +1, thanks for the contribution, there are also some configuration inference in `HoodieTableSink`, we can do that in following PR though. Ok, I will do that in a other

  1   2   3   4   5   6   7   8   >