[GitHub] [hudi] manojpec commented on pull request #3803: [HUDI-2472] Enabling Metadata table for TestCleaner unit tests

2021-10-27 Thread GitBox
manojpec commented on pull request #3803: URL: https://github.com/apache/hudi/pull/3803#issuecomment-953556367 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[jira] [Updated] (HUDI-1295) Design and Impl bloom filters as a part of metadata table

2021-10-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-1295: - Labels: pull-request-available (was: ) > Design and Impl bloom filters as a part of metadata tabl

[GitHub] [hudi] manojpec opened a new pull request #3884: [HUDI-1295] Hash ID generator util for Hudi table columns, partition and files

2021-10-27 Thread GitBox
manojpec opened a new pull request #3884: URL: https://github.com/apache/hudi/pull/3884 ## What is the purpose of the pull request Metadata Index feature needs to uniquely identify Hudi table column, partition and files from their names. Need an utility to generate unique hash ids

[GitHub] [hudi] hudi-bot edited a comment on pull request #3883: [HUDI-2624] Implement Non Index type for HUDI

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3883: URL: https://github.com/apache/hudi/pull/3883#issuecomment-953545730 ## CI report: * 0b490523e36aee73b4815a5fbadf5ebbb7fa84d4 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] nsivabalan commented on a change in pull request #3778: [HUDI-2502] Refactor index in hudi-client module

2021-10-27 Thread GitBox
nsivabalan commented on a change in pull request #3778: URL: https://github.com/apache/hudi/pull/3778#discussion_r738066628 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/index/SparkHoodieIndex.java ## @@ -0,0 +1,74 @@ +/* + * Licensed to the Apache

[GitHub] [hudi] nsivabalan commented on a change in pull request #3778: [HUDI-2502] Refactor index in hudi-client module

2021-10-27 Thread GitBox
nsivabalan commented on a change in pull request #3778: URL: https://github.com/apache/hudi/pull/3778#discussion_r738066216 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/index/hbase/SparkHoodieHBaseIndex.java ## @@ -85,7 +85,8 @@ /** * Hoodie Ind

[GitHub] [hudi] hudi-bot edited a comment on pull request #3883: [HUDI-2624] Implement Non Index type for HUDI

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3883: URL: https://github.com/apache/hudi/pull/3883#issuecomment-953545730 ## CI report: * 0b490523e36aee73b4815a5fbadf5ebbb7fa84d4 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] boneanxs commented on issue #3856: [SUPPORT] Maybe should cache baseDir in nonHoodiePathCache in HoodieROTablePathFilter?

2021-10-27 Thread GitBox
boneanxs commented on issue #3856: URL: https://github.com/apache/hudi/issues/3856#issuecomment-953547374 Thanks for noticing it. Sorry, I don't get your thought, we can check the baseDir is in nonHoodiePathCache or not here: [HoodieROTablePathFilter.java#L174](https://github.com/apache

[GitHub] [hudi] hudi-bot commented on pull request #3883: [HUDI-2624] Implement Non Index type for HUDI

2021-10-27 Thread GitBox
hudi-bot commented on pull request #3883: URL: https://github.com/apache/hudi/pull/3883#issuecomment-953545730 ## CI report: * 0b490523e36aee73b4815a5fbadf5ebbb7fa84d4 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[jira] [Updated] (HUDI-2624) Implement Non Index type for HUDI

2021-10-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2624: - Labels: pull-request-available (was: ) > Implement Non Index type for HUDI >

[GitHub] [hudi] yuzhaojing opened a new pull request #3883: [HUDI-2624] Implement Non Index type for HUDI

2021-10-27 Thread GitBox
yuzhaojing opened a new pull request #3883: URL: https://github.com/apache/hudi/pull/3883 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purp

[GitHub] [hudi] lamberken commented on a change in pull request #3881: [HUDI-2627]Fix unsupported query instant time format in quickstart page

2021-10-27 Thread GitBox
lamberken commented on a change in pull request #3881: URL: https://github.com/apache/hudi/pull/3881#discussion_r738056623 ## File path: website/docs/quick-start-guide.md ## @@ -491,7 +491,7 @@ spark.read. spark.read. format("hudi"). - option("as.of.instant", "2021-07-28

[GitHub] [hudi] hudi-bot edited a comment on pull request #3519: [DO NOT MERGE] 0.9.0 release patch for flink

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3519: URL: https://github.com/apache/hudi/pull/3519#issuecomment-903204631 ## CI report: * d022aa7a5bd94492c7c3e96dc5b1288268520087 UNKNOWN * 8c93763073c768e9d546c96f4f270cfce616fb35 Azure: [CANCELED](https://dev.azure.com/apache-hudi

[GitHub] [hudi] YannByron commented on a change in pull request #3700: [HUDI-2471] Add support ignoring case in merge into

2021-10-27 Thread GitBox
YannByron commented on a change in pull request #3700: URL: https://github.com/apache/hudi/pull/3700#discussion_r738053730 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/MergeIntoHoodieTableCommand.scala ## @@ -101,11 +103,11 @@

[GitHub] [hudi] hudi-bot edited a comment on pull request #3813: [HUDI-2563][hudi-client] Refactor CompactionTriggerStrategy.

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3813: URL: https://github.com/apache/hudi/pull/3813#issuecomment-944948402 ## CI report: * 4afb1a587e0809c4d6d3106aa33e6cf1eda47f0e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] hudi-bot edited a comment on pull request #3778: [HUDI-2502] Refactor index in hudi-client module

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3778: URL: https://github.com/apache/hudi/pull/3778#issuecomment-939762523 ## CI report: * e9a88dd7cb4959dbd23b064d20f9add722ebd29a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Resolved] (HUDI-2633) Make precombine field optional for flink

2021-10-27 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-2633. -- Fix Version/s: 0.10.0 Resolution: Fixed Fixed via master branch: e5b6b8602c242c89cdb45440df8d2996

[GitHub] [hudi] satishkotha commented on a change in pull request #3833: [HUDI-1877] Support records staying in same fileId after clustering

2021-10-27 Thread GitBox
satishkotha commented on a change in pull request #3833: URL: https://github.com/apache/hudi/pull/3833#discussion_r738038132 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/clustering/plan/strategy/SparkSingleFileSortPlanStrategy.java ## @@ -0,

[hudi] branch master updated (af3ffe5 -> e5b6b86)

2021-10-27 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from af3ffe5 [MINOR] Add links to all the existing RFCs in rfc/README.md (#3876) add e5b6b86 [HUDI-2633] Make pre

[GitHub] [hudi] danny0405 merged pull request #3874: [HUDI-2633] Make precombine field optional for flink

2021-10-27 Thread GitBox
danny0405 merged pull request #3874: URL: https://github.com/apache/hudi/pull/3874 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubsc

[GitHub] [hudi] satishkotha commented on a change in pull request #3869: [HUDI-1937] Rollback unfinished replace commit to allow updates

2021-10-27 Thread GitBox
satishkotha commented on a change in pull request #3869: URL: https://github.com/apache/hudi/pull/3869#discussion_r738026291 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/BaseSparkCommitActionExecutor.java ## @@ -117,7 +119,24 @@

[GitHub] [hudi] YannByron commented on a change in pull request #3700: [HUDI-2471] Add support ignoring case in merge into

2021-10-27 Thread GitBox
YannByron commented on a change in pull request #3700: URL: https://github.com/apache/hudi/pull/3700#discussion_r738029719 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/analysis/HoodieAnalysis.scala ## @@ -161,23 +162,20 @@ case class

[GitHub] [hudi] hudi-bot edited a comment on pull request #3882: [HUDI-2642] Add support ignoring case in update sql operation

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3882: URL: https://github.com/apache/hudi/pull/3882#issuecomment-953479741 ## CI report: * df86af3f27c7044cc0ea2a9a624ad1294dd3a054 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] hudi-bot edited a comment on pull request #3813: [HUDI-2563][hudi-client] Refactor CompactionTriggerStrategy.

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3813: URL: https://github.com/apache/hudi/pull/3813#issuecomment-944948402 ## CI report: * c7fe591872690c7c87881d5b470716260b93692c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] hudi-bot edited a comment on pull request #3813: [HUDI-2563][hudi-client] Refactor CompactionTriggerStrategy.

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3813: URL: https://github.com/apache/hudi/pull/3813#issuecomment-944948402 ## CI report: * c7fe591872690c7c87881d5b470716260b93692c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] RocMarshal commented on a change in pull request #3813: [HUDI-2563][hudi-client] Refactor CompactionTriggerStrategy.

2021-10-27 Thread GitBox
RocMarshal commented on a change in pull request #3813: URL: https://github.com/apache/hudi/pull/3813#discussion_r738024300 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/compact/CompactionTriggerStrategy.java ## @@ -18,13 +18,87 @@

[GitHub] [hudi] hudi-bot edited a comment on pull request #3866: [HUDI-1430] SparkDataFrameWriteClient

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3866: URL: https://github.com/apache/hudi/pull/3866#issuecomment-952070379 ## CI report: * 8144fcd5285a5f53f4a76c4327e0bb8c90b46c97 UNKNOWN * 6d196ec77ecb463082ee89cb16fd9a8c3fb2597d Azure: [SUCCESS](https://dev.azure.com/apache-hudi-

[GitHub] [hudi] hudi-bot edited a comment on pull request #3778: [HUDI-2502] Refactor index in hudi-client module

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3778: URL: https://github.com/apache/hudi/pull/3778#issuecomment-939762523 ## CI report: * 397883108f5b8ec76d533218097dda6cd9f667eb Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] RocMarshal commented on a change in pull request #3813: [HUDI-2563][hudi-client] Refactor CompactionTriggerStrategy.

2021-10-27 Thread GitBox
RocMarshal commented on a change in pull request #3813: URL: https://github.com/apache/hudi/pull/3813#discussion_r738023840 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/compact/CompactionTriggerStrategy.java ## @@ -18,13 +18,87 @@

[GitHub] [hudi] hudi-bot edited a comment on pull request #3874: [HUDI-2633] Make precombine field optional for flink

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3874: URL: https://github.com/apache/hudi/pull/3874#issuecomment-952775369 ## CI report: * 3558d79d982adff1e5debc9b5cb5ad77e39fa19e Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] hudi-bot edited a comment on pull request #3813: [HUDI-2563][hudi-client] Refactor CompactionTriggerStrategy.

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3813: URL: https://github.com/apache/hudi/pull/3813#issuecomment-944948402 ## CI report: * c7fe591872690c7c87881d5b470716260b93692c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] hudi-bot edited a comment on pull request #3778: [HUDI-2502] Refactor index in hudi-client module

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3778: URL: https://github.com/apache/hudi/pull/3778#issuecomment-939762523 ## CI report: * 397883108f5b8ec76d533218097dda6cd9f667eb Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] yihua commented on a change in pull request #3778: [HUDI-2502] Refactor index in hudi-client module

2021-10-27 Thread GitBox
yihua commented on a change in pull request #3778: URL: https://github.com/apache/hudi/pull/3778#discussion_r738016777 ## File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/testutils/SparkClientFunctionalTestHarness.java ## @@ -200,7 +200,7 @@ public static

[GitHub] [hudi] yihua commented on a change in pull request #3778: [HUDI-2502] Refactor index in hudi-client module

2021-10-27 Thread GitBox
yihua commented on a change in pull request #3778: URL: https://github.com/apache/hudi/pull/3778#discussion_r738016600 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/index/bloom/HoodieBloomIndexHelper.java ## @@ -20,41 +20,22 @@ package org.apache.

[GitHub] [hudi] yihua commented on a change in pull request #3778: [HUDI-2502] Refactor index in hudi-client module

2021-10-27 Thread GitBox
yihua commented on a change in pull request #3778: URL: https://github.com/apache/hudi/pull/3778#discussion_r738016333 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/index/hbase/SparkHoodieHBaseIndex.java ## @@ -85,7 +85,8 @@ /** * Hoodie Index im

[GitHub] [hudi] yihua commented on a change in pull request #3778: [HUDI-2502] Refactor index in hudi-client module

2021-10-27 Thread GitBox
yihua commented on a change in pull request #3778: URL: https://github.com/apache/hudi/pull/3778#discussion_r738015604 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/index/SparkHoodieIndex.java ## @@ -0,0 +1,74 @@ +/* + * Licensed to the Apache Softw

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #3203: [HUDI-2086] Refactor hive mor_incremental_view

2021-10-27 Thread GitBox
xiarixiaoyao commented on a change in pull request #3203: URL: https://github.com/apache/hudi/pull/3203#discussion_r738013103 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java ## @@ -161,6 +148,110 @@ return rtSpli

[GitHub] [hudi] hudi-bot edited a comment on pull request #3866: [HUDI-1430] SparkDataFrameWriteClient

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3866: URL: https://github.com/apache/hudi/pull/3866#issuecomment-952070379 ## CI report: * 8144fcd5285a5f53f4a76c4327e0bb8c90b46c97 UNKNOWN * cda906841f60a7f5f29f656f3d70e30811ca53e9 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-

[GitHub] [hudi] hudi-bot edited a comment on pull request #3882: [HUDI-2642] Add support ignoring case in update sql operation

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3882: URL: https://github.com/apache/hudi/pull/3882#issuecomment-953479741 ## CI report: * df86af3f27c7044cc0ea2a9a624ad1294dd3a054 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] danny0405 commented on a change in pull request #3813: [HUDI-2563][hudi-client] Refactor CompactionTriggerStrategy.

2021-10-27 Thread GitBox
danny0405 commented on a change in pull request #3813: URL: https://github.com/apache/hudi/pull/3813#discussion_r738002451 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/compact/CompactionTriggerStrategy.java ## @@ -18,13 +18,87 @@ p

[GitHub] [hudi] hudi-bot edited a comment on pull request #3813: [HUDI-2563][hudi-client] Refactor CompactionTriggerStrategy.

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3813: URL: https://github.com/apache/hudi/pull/3813#issuecomment-944948402 ## CI report: * 7a7ee072ae225fe015b73545ac8d50acc5746ea7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] hudi-bot commented on pull request #3882: [HUDI-2642] Add support ignoring case in update sql operation

2021-10-27 Thread GitBox
hudi-bot commented on pull request #3882: URL: https://github.com/apache/hudi/pull/3882#issuecomment-953479741 ## CI report: * df86af3f27c7044cc0ea2a9a624ad1294dd3a054 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[GitHub] [hudi] hudi-bot edited a comment on pull request #3874: [HUDI-2633] Make precombine field optional for flink

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3874: URL: https://github.com/apache/hudi/pull/3874#issuecomment-952775369 ## CI report: * efb6caf983888dd030570e1a7aad1c8e614fb5e4 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot edited a comment on pull request #3813: [HUDI-2563][hudi-client] Refactor CompactionTriggerStrategy.

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3813: URL: https://github.com/apache/hudi/pull/3813#issuecomment-944948402 ## CI report: * 7a7ee072ae225fe015b73545ac8d50acc5746ea7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] hudi-bot edited a comment on pull request #3671: [HUDI-2418] add HiveSchemaProvider

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3671: URL: https://github.com/apache/hudi/pull/3671#issuecomment-920215882 ## CI report: * f95bba83e08949ef6b3f986409768978752b08ad Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] danny0405 commented on a change in pull request #3203: [HUDI-2086] Refactor hive mor_incremental_view

2021-10-27 Thread GitBox
danny0405 commented on a change in pull request #3203: URL: https://github.com/apache/hudi/pull/3203#discussion_r737998861 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java ## @@ -161,6 +148,110 @@ return rtSplits.

[GitHub] [hudi] danny0405 commented on a change in pull request #3203: [HUDI-2086] Refactor hive mor_incremental_view

2021-10-27 Thread GitBox
danny0405 commented on a change in pull request #3203: URL: https://github.com/apache/hudi/pull/3203#discussion_r737998688 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java ## @@ -161,6 +148,110 @@ return rtSplits.

[jira] [Updated] (HUDI-2642) Add support ignoring case in update sql operation

2021-10-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2642: - Labels: pull-request-available (was: ) > Add support ignoring case in update sql operation >

[GitHub] [hudi] dongkelun opened a new pull request #3882: [HUDI-2642] Add support ignoring case in update sql operation

2021-10-27 Thread GitBox
dongkelun opened a new pull request #3882: URL: https://github.com/apache/hudi/pull/3882 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpo

[jira] [Created] (HUDI-2642) Add support ignoring case in update sql operation

2021-10-27 Thread Jira
董可伦 created HUDI-2642: - Summary: Add support ignoring case in update sql operation Key: HUDI-2642 URL: https://issues.apache.org/jira/browse/HUDI-2642 Project: Apache Hudi Issue Type: Improvement

[GitHub] [hudi] hudi-bot edited a comment on pull request #3874: [HUDI-2633] Make precombine field optional for flink

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3874: URL: https://github.com/apache/hudi/pull/3874#issuecomment-952775369 ## CI report: * efb6caf983888dd030570e1a7aad1c8e614fb5e4 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot edited a comment on pull request #3874: [HUDI-2633] Make precombine field optional for flink

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3874: URL: https://github.com/apache/hudi/pull/3874#issuecomment-952775369 ## CI report: * 49ed46d627a0cbfb33c7f7b99fb89750f43a7fb2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] hudi-bot edited a comment on pull request #3874: [HUDI-2633] Make precombine field optional for flink

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3874: URL: https://github.com/apache/hudi/pull/3874#issuecomment-952775369 ## CI report: * 49ed46d627a0cbfb33c7f7b99fb89750f43a7fb2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] hudi-bot edited a comment on pull request #3671: [HUDI-2418] add HiveSchemaProvider

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3671: URL: https://github.com/apache/hudi/pull/3671#issuecomment-920215882 ## CI report: * c76d2c290f10e235305a2b782519e20845e328cc Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] hudi-bot edited a comment on pull request #3671: [HUDI-2418] add HiveSchemaProvider

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3671: URL: https://github.com/apache/hudi/pull/3671#issuecomment-920215882 ## CI report: * c76d2c290f10e235305a2b782519e20845e328cc Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] hudi-bot edited a comment on pull request #3700: [HUDI-2471] Add support ignoring case in merge into

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3700: URL: https://github.com/apache/hudi/pull/3700#issuecomment-924523979 ## CI report: * c1c41f37477d2a778f3cfa0445b3fa65b605e000 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] tracehh opened a new pull request #3881: [HUDI-2627]Fix unsupported query instant time format in quickstart page

2021-10-27 Thread GitBox
tracehh opened a new pull request #3881: URL: https://github.com/apache/hudi/pull/3881 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpose

[GitHub] [hudi] RocMarshal commented on pull request #3813: [HUDI-2563][hudi-client] Refactor CompactionTriggerStrategy.

2021-10-27 Thread GitBox
RocMarshal commented on pull request #3813: URL: https://github.com/apache/hudi/pull/3813#issuecomment-953446456 > @RocMarshal Please check the Azure CI. Thanks @yanghua for the review. And Thanks @nsivabalan for looking into this. I'll check the Azure CI ASAP. -- This is an a

[GitHub] [hudi] hudi-bot edited a comment on pull request #3700: [HUDI-2471] Add support ignoring case in merge into

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3700: URL: https://github.com/apache/hudi/pull/3700#issuecomment-924523979 ## CI report: * 07e7efe7b118d1829278db3a34df66a33b9b4e77 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] hudi-bot edited a comment on pull request #3700: [HUDI-2471] Add support ignoring case in merge into

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3700: URL: https://github.com/apache/hudi/pull/3700#issuecomment-924523979 ## CI report: * 07e7efe7b118d1829278db3a34df66a33b9b4e77 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] hudi-bot edited a comment on pull request #3880: [HUDI-2606][WIP] Enable metadata reader by default

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3880: URL: https://github.com/apache/hudi/pull/3880#issuecomment-953404250 ## CI report: * bd90aabc79019127f0dbec591d3d3a9a7251dd5e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] yanghua commented on pull request #3813: [HUDI-2563][hudi-client] Refactor CompactionTriggerStrategy.

2021-10-27 Thread GitBox
yanghua commented on pull request #3813: URL: https://github.com/apache/hudi/pull/3813#issuecomment-953426529 @RocMarshal Please check the Azure CI. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hudi] umehrot2 commented on issue #3782: [SUPPORT] Hudi Concurrent write (OCC) with upsert tables random errors

2021-10-27 Thread GitBox
umehrot2 commented on issue #3782: URL: https://github.com/apache/hudi/issues/3782#issuecomment-953416009 The **Type 2** error mentioned in this thread is because of a bug which I have described in the Jira here https://issues.apache.org/jira/browse/HUDI-2641 . That is not because of commi

[jira] [Updated] (HUDI-2641) One inflight commit rolling back other concurrent inflight commits causing them to fail

2021-10-27 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2641: Description: The bug is easily reproducible when running 4-5 concurrent writers at once. Atleast a

[jira] [Updated] (HUDI-2641) One inflight commit rolling back other concurrent inflight commits causing them to fail

2021-10-27 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2641: Description: The bug is easily reproducible when running 4-5 concurrent writers at once. Atleast a

[jira] [Updated] (HUDI-2641) One inflight commit rolling back other concurrent inflight commits causing them to fail

2021-10-27 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2641: Description: The bug is easily reproducible when running 4-5 concurrent writers at once. Atleast a

[jira] [Updated] (HUDI-2641) One inflight commit rolling back other concurrent inflight commits causing them to fail

2021-10-27 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2641: Description: The bug is easily reproducible when running 4-5 concurrent writers at once. Atleast a

[jira] [Updated] (HUDI-2641) One inflight commit rolling back other concurrent inflight commits causing them to fail

2021-10-27 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2641: Description: The bug is easily reproducible when running 4-5 concurrent writers at once. Atleast a

[jira] [Updated] (HUDI-2641) One inflight commit rolling back other concurrent inflight commits causing them to fail

2021-10-27 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2641: Description: The bug is easily reproducible when running 4-5 concurrent writers at once. Atleast a

[GitHub] [hudi] hudi-bot edited a comment on pull request #3880: [HUDI-2606][WIP] Enable metadata reader by default

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3880: URL: https://github.com/apache/hudi/pull/3880#issuecomment-953404250 ## CI report: * bd90aabc79019127f0dbec591d3d3a9a7251dd5e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] hudi-bot commented on pull request #3880: [HUDI-2606][WIP] Enable metadata reader by default

2021-10-27 Thread GitBox
hudi-bot commented on pull request #3880: URL: https://github.com/apache/hudi/pull/3880#issuecomment-953404250 ## CI report: * bd90aabc79019127f0dbec591d3d3a9a7251dd5e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[GitHub] [hudi] hudi-bot edited a comment on pull request #3820: [HUDI-2579] Make deltastreamer checkpoint state merging more explicit

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3820: URL: https://github.com/apache/hudi/pull/3820#issuecomment-945958915 ## CI report: * 255b35f65537a3adaedb14b25bb53d98beadb371 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Updated] (HUDI-2641) One inflight commit rolling back other concurrent inflight commits causing them to fail

2021-10-27 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2641: Labels: release-blocker (was: ) > One inflight commit rolling back other concurrent inflight commit

[jira] [Created] (HUDI-2641) One inflight commit rolling back other concurrent inflight commits causing them to fail

2021-10-27 Thread Udit Mehrotra (Jira)
Udit Mehrotra created HUDI-2641: --- Summary: One inflight commit rolling back other concurrent inflight commits causing them to fail Key: HUDI-2641 URL: https://issues.apache.org/jira/browse/HUDI-2641 Pro

[jira] [Updated] (HUDI-2595) Guard all writes to metadata table for a single writer datatable and async operations

2021-10-27 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2595: -- Summary: Guard all writes to metadata table for a single writer datatable and async oper

[jira] [Updated] (HUDI-2595) Guard all writes to metadata table with single writer and async operations

2021-10-27 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2595: -- Summary: Guard all writes to metadata table with single writer and async operations (wa

[jira] [Updated] (HUDI-2640) Test bootstrap with metadata enabled

2021-10-27 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2640: -- Fix Version/s: 0.10.0 > Test bootstrap with metadata enabled > -

[jira] [Created] (HUDI-2640) Test bootstrap with metadata enabled

2021-10-27 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2640: - Summary: Test bootstrap with metadata enabled Key: HUDI-2640 URL: https://issues.apache.org/jira/browse/HUDI-2640 Project: Apache Hudi Issue Type:

[jira] [Updated] (HUDI-2640) Test bootstrap with metadata enabled

2021-10-27 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2640: -- Parent: HUDI-1292 Issue Type: Sub-task (was: Improvement) > Test bootstrap with

[jira] [Assigned] (HUDI-2640) Test bootstrap with metadata enabled

2021-10-27 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-2640: - Assignee: sivabalan narayanan > Test bootstrap with metadata enabled > --

[jira] [Assigned] (HUDI-2640) Test bootstrap with metadata enabled

2021-10-27 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-2640: - Assignee: Manoj Govindassamy (was: sivabalan narayanan) > Test bootstrap with me

[GitHub] [hudi] nsivabalan opened a new pull request #3880: [HUDI-2606][WIP] Enable metadata reader by default

2021-10-27 Thread GitBox
nsivabalan opened a new pull request #3880: URL: https://github.com/apache/hudi/pull/3880 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purp

[GitHub] [hudi] hudi-bot edited a comment on pull request #3803: [HUDI-2472] Enabling Metadata table for TestCleaner unit tests

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3803: URL: https://github.com/apache/hudi/pull/3803#issuecomment-943565382 ## CI report: * 155da1e91c4aae82abcada285d8a382e2b1c23fa Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] hudi-bot edited a comment on pull request #3820: [HUDI-2579] Make deltastreamer checkpoint state merging more explicit

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3820: URL: https://github.com/apache/hudi/pull/3820#issuecomment-945958915 ## CI report: * 4007755f0bb30705d3cc342f11ecfcebd3a108e9 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] hudi-bot edited a comment on pull request #3820: [HUDI-2579] Make deltastreamer checkpoint state merging more explicit

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3820: URL: https://github.com/apache/hudi/pull/3820#issuecomment-945958915 ## CI report: * 4007755f0bb30705d3cc342f11ecfcebd3a108e9 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] hudi-bot edited a comment on pull request #3824: [HUDI-1292] Millisecond granularity for instant timestamps

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3824: URL: https://github.com/apache/hudi/pull/3824#issuecomment-946872755 ## CI report: * 08536c3c278f6da07c5038f59d36f299e0556dc1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Updated] (HUDI-2595) Guard all writes to metadata table even for tables where locking is not enabled

2021-10-27 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2595: -- Parent: HUDI-1292 Issue Type: Sub-task (was: Improvement) > Guard all writes to

[GitHub] [hudi] hudi-bot edited a comment on pull request #3803: [HUDI-2472] Enabling Metadata table for TestCleaner unit tests

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3803: URL: https://github.com/apache/hudi/pull/3803#issuecomment-943565382 ## CI report: * 707850631bafe59547d41945e827f2afe0171743 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] hudi-bot edited a comment on pull request #3803: [HUDI-2472] Enabling Metadata table for TestCleaner unit tests

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3803: URL: https://github.com/apache/hudi/pull/3803#issuecomment-943565382 ## CI report: * 707850631bafe59547d41945e827f2afe0171743 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Assigned] (HUDI-2639) Test and certify bootstrapping with metadata table

2021-10-27 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-2639: - Assignee: Manoj Govindassamy > Test and certify bootstrapping with metadata table

[jira] [Updated] (HUDI-2639) Test and certify bootstrapping with metadata table

2021-10-27 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2639: -- Parent: HUDI-1292 Issue Type: Sub-task (was: Improvement) > Test and certify bo

[jira] [Created] (HUDI-2639) Test and certify bootstrapping with metadata table

2021-10-27 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2639: - Summary: Test and certify bootstrapping with metadata table Key: HUDI-2639 URL: https://issues.apache.org/jira/browse/HUDI-2639 Project: Apache Hudi

[jira] [Updated] (HUDI-2639) Test and certify bootstrapping with metadata table

2021-10-27 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2639: -- Priority: Blocker (was: Major) > Test and certify bootstrapping with metadata table > -

[jira] [Updated] (HUDI-2472) Tests failure follow up when metadata is enabled by default

2021-10-27 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2472: -- Description: We plan to enable metadata by default. but there are some tests that fail w

[GitHub] [hudi] hudi-bot edited a comment on pull request #3824: [HUDI-1292] Millisecond granularity for instant timestamps

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3824: URL: https://github.com/apache/hudi/pull/3824#issuecomment-946872755 ## CI report: * 52b7ea1f9d03d2a31dd88fc41a35e121827b Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] hudi-bot edited a comment on pull request #3824: [HUDI-1292] Millisecond granularity for instant timestamps

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3824: URL: https://github.com/apache/hudi/pull/3824#issuecomment-946872755 ## CI report: * 52b7ea1f9d03d2a31dd88fc41a35e121827b Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] nsivabalan commented on a change in pull request #3778: [HUDI-2502] Refactor index in hudi-client module

2021-10-27 Thread GitBox
nsivabalan commented on a change in pull request #3778: URL: https://github.com/apache/hudi/pull/3778#discussion_r737870394 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/index/bloom/HoodieBloomIndexHelper.java ## @@ -20,41 +20,22 @@ package org.ap

[GitHub] [hudi] manojpec commented on a change in pull request #3803: [HUDI-2472] Enabling Metadata table for TestCleaner unit tests

2021-10-27 Thread GitBox
manojpec commented on a change in pull request #3803: URL: https://github.com/apache/hudi/pull/3803#discussion_r737861196 ## File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/TestCleaner.java ## @@ -1319,15 +1319,15 @@ public void testCleanMarkerData

[GitHub] [hudi] hudi-bot edited a comment on pull request #3820: [HUDI-2579] Make deltastreamer checkpoint state merging more explicit

2021-10-27 Thread GitBox
hudi-bot edited a comment on pull request #3820: URL: https://github.com/apache/hudi/pull/3820#issuecomment-945958915 ## CI report: * 4007755f0bb30705d3cc342f11ecfcebd3a108e9 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] jardel-lima opened a new issue #3879: [SUPPORT] Incomplete Table Migration

2021-10-27 Thread GitBox
jardel-lima opened a new issue #3879: URL: https://github.com/apache/hudi/issues/3879 **Describe the problem you faced** I am trying to migrate some tables to hudi format, but I am facing some issues. We have a 7GB (snnapy compacted) table with 200M rows, 49 columns and just one

  1   2   3   >