[GitHub] [hudi] hudi-bot edited a comment on pull request #3393: [HUDI-1842] Spark Sql Support For The Exists Hoodie Table

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3393: URL: https://github.com/apache/hudi/pull/3393#issuecomment-891812944 ## CI report: * 3aec37c6f238f4ed40672d20f7b7c6e6314a9519 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] karan867 commented on issue #3077: [SUPPORT] Large latencies in hudi writes using upsert mode.

2021-08-03 Thread GitBox
karan867 commented on issue #3077: URL: https://github.com/apache/hudi/issues/3077#issuecomment-892413100 @nsivabalan Thank you for the reply. Please find the answers to the above questions 1. I am using the default file size. I tried decreasing it to 60 MB but that increased the

[jira] [Commented] (HUDI-2242) Add inference logic to few Hudi configs

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392778#comment-17392778 ] ASF GitHub Bot commented on HUDI-2242: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3359: [HUDI-2242] Add configuration inference logic for few options

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3359: URL: https://github.com/apache/hudi/pull/3359#issuecomment-888073098 ## CI report: * 307a60591e5e250215e4224558273dae412e53ae Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2242) Add inference logic to few Hudi configs

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392776#comment-17392776 ] ASF GitHub Bot commented on HUDI-2242: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3359: [HUDI-2242] Add configuration inference logic for few options

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3359: URL: https://github.com/apache/hudi/pull/3359#issuecomment-888073098 ## CI report: * 307a60591e5e250215e4224558273dae412e53ae Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2242) Add inference logic to few Hudi configs

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392774#comment-17392774 ] ASF GitHub Bot commented on HUDI-2242: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3359: [HUDI-2242] Add configuration inference logic for few options

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3359: URL: https://github.com/apache/hudi/pull/3359#issuecomment-888073098 ## CI report: * 307a60591e5e250215e4224558273dae412e53ae Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2042) Compare the field object directly in OverwriteWithLatestAvroPayload

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392773#comment-17392773 ] ASF GitHub Bot commented on HUDI-2042: -- minihippo commented on pull request #3108: UR

[GitHub] [hudi] minihippo commented on pull request #3108: [HUDI-2042] Compare the field object directly in OverwriteWithLatestA…

2021-08-03 Thread GitBox
minihippo commented on pull request #3108: URL: https://github.com/apache/hudi/pull/3108#issuecomment-892401926 Hi @nsivabalan , can we land this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392771#comment-17392771 ] ASF GitHub Bot commented on HUDI-2273: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * 0a32f4afcbf92b85e51b12de7af26b918d58a549 UNKNOWN * 805cfcf4e270703ccb03d0db17253308e66280c5 UNKNOWN * 0b8e6746bb437606078815a6d2f25b1fc16efa4

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392769#comment-17392769 ] ASF GitHub Bot commented on HUDI-2273: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * 0a32f4afcbf92b85e51b12de7af26b918d58a549 UNKNOWN * 805cfcf4e270703ccb03d0db17253308e66280c5 UNKNOWN * 0b8e6746bb437606078815a6d2f25b1fc16efa4

[jira] [Commented] (HUDI-2233) [SQL] Hive sync is not working

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392760#comment-17392760 ] ASF GitHub Bot commented on HUDI-2233: -- hudi-bot edited a comment on pull request #33

[jira] [Commented] (HUDI-2087) Support Append only in Flink stream

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392758#comment-17392758 ] ASF GitHub Bot commented on HUDI-2087: -- danny0405 commented on a change in pull reque

[GitHub] [hudi] hudi-bot edited a comment on pull request #3387: [HUDI-2233] Use HMS To Sync Hive Meta For Spark Sql

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3387: URL: https://github.com/apache/hudi/pull/3387#issuecomment-891570386 ## CI report: * cc9a650f2cda42a587ed969de0d8fd3c5f391df7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392759#comment-17392759 ] ASF GitHub Bot commented on HUDI-2273: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * 0a32f4afcbf92b85e51b12de7af26b918d58a549 UNKNOWN * 805cfcf4e270703ccb03d0db17253308e66280c5 UNKNOWN * 0b8e6746bb437606078815a6d2f25b1fc16efa4

[GitHub] [hudi] danny0405 commented on a change in pull request #3390: [HUDI-2087] Support Append only in Flink stream

2021-08-03 Thread GitBox
danny0405 commented on a change in pull request #3390: URL: https://github.com/apache/hudi/pull/3390#discussion_r682320425 ## File path: hudi-flink/src/main/java/org/apache/hudi/table/HoodieTableFactory.java ## @@ -128,6 +129,11 @@ private void validateRequiredFields(Configura

[jira] [Commented] (HUDI-2233) [SQL] Hive sync is not working

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392756#comment-17392756 ] ASF GitHub Bot commented on HUDI-2233: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3387: [HUDI-2233] Use HMS To Sync Hive Meta For Spark Sql

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3387: URL: https://github.com/apache/hudi/pull/3387#issuecomment-891570386 ## CI report: * cc9a650f2cda42a587ed969de0d8fd3c5f391df7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392755#comment-17392755 ] ASF GitHub Bot commented on HUDI-2273: -- nsivabalan edited a comment on pull request #

[GitHub] [hudi] nsivabalan edited a comment on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-03 Thread GitBox
nsivabalan edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892395243 > https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=1345&view=logs&j=49186a26-7c18-5ea7-a030-c991549c6bb6 seems to be working? but wondering

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392754#comment-17392754 ] ASF GitHub Bot commented on HUDI-2273: -- nsivabalan commented on pull request #3398: U

[jira] [Commented] (HUDI-2233) [SQL] Hive sync is not working

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392753#comment-17392753 ] ASF GitHub Bot commented on HUDI-2233: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] nsivabalan commented on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-03 Thread GitBox
nsivabalan commented on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892395243 > https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=1345&view=logs&j=49186a26-7c18-5ea7-a030-c991549c6bb6 seems to be working? but wondering if ther

[GitHub] [hudi] hudi-bot edited a comment on pull request #3387: [HUDI-2233] Use HMS To Sync Hive Meta For Spark Sql

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3387: URL: https://github.com/apache/hudi/pull/3387#issuecomment-891570386 ## CI report: * 656226de7302806a140efdec95c42e5961e85650 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392746#comment-17392746 ] ASF GitHub Bot commented on HUDI-2273: -- nsivabalan commented on a change in pull requ

[GitHub] [hudi] nsivabalan commented on a change in pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-03 Thread GitBox
nsivabalan commented on a change in pull request #3398: URL: https://github.com/apache/hudi/pull/3398#discussion_r682313186 ## File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/client/functional/SparkClientFunctionalTestSuite.java ## @@ -0,0 +1,32 @@ +/* +

[jira] [Commented] (HUDI-1842) [SQL] Spark Sql Support For The Exists Hoodie Table

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392740#comment-17392740 ] ASF GitHub Bot commented on HUDI-1842: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3393: [HUDI-1842] Spark Sql Support For The Exists Hoodie Table

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3393: URL: https://github.com/apache/hudi/pull/3393#issuecomment-891812944 ## CI report: * 53186a44289eb1740d15d0b35afc9d9f3c9f5904 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-1842) [SQL] Spark Sql Support For The Exists Hoodie Table

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392739#comment-17392739 ] ASF GitHub Bot commented on HUDI-1842: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3393: [HUDI-1842] Spark Sql Support For The Exists Hoodie Table

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3393: URL: https://github.com/apache/hudi/pull/3393#issuecomment-891812944 ## CI report: * 53186a44289eb1740d15d0b35afc9d9f3c9f5904 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392731#comment-17392731 ] ASF GitHub Bot commented on HUDI-2273: -- nsivabalan commented on a change in pull requ

[GitHub] [hudi] nsivabalan commented on a change in pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-03 Thread GitBox
nsivabalan commented on a change in pull request #3398: URL: https://github.com/apache/hudi/pull/3398#discussion_r682303297 ## File path: hudi-sync/hudi-hive-sync/src/test/java/org/apache/hudi/hive/functional/HiveSyncFunctionalTestSuite.java ## @@ -25,7 +25,7 @@ import org.ju

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392727#comment-17392727 ] ASF GitHub Bot commented on HUDI-2273: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * 0a32f4afcbf92b85e51b12de7af26b918d58a549 UNKNOWN * acbedb531fdbade17ba78c53cb23786f04ea8cb8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-

[jira] [Commented] (HUDI-922) [UMBRELLA] Transfer out of the Incubator

2021-08-03 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392725#comment-17392725 ] Vinoth Chandar commented on HUDI-922: - nah. we can close this. > [UMBRELLA] Transfer o

[jira] [Resolved] (HUDI-922) [UMBRELLA] Transfer out of the Incubator

2021-08-03 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar resolved HUDI-922. - Resolution: Fixed > [UMBRELLA] Transfer out of the Incubator >

[jira] [Resolved] (HUDI-937) Site content revamp ahead of graduation

2021-08-03 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar resolved HUDI-937. - Resolution: Fixed > Site content revamp ahead of graduation > -

[jira] [Resolved] (HUDI-929) Update the Incubator status records

2021-08-03 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar resolved HUDI-929. - Resolution: Fixed > Update the Incubator status records > --- > >

[jira] [Commented] (HUDI-2199) DynamoDB based external index implementation

2021-08-03 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392723#comment-17392723 ] Vinoth Chandar commented on HUDI-2199: -- > it creates a table for each table name inge

[GitHub] [hudi] garyli1019 commented on issue #3301: [SUPPORT] Deltastreamer cannot pattern match from AWS s3 files with wildcard

2021-08-03 Thread GitBox
garyli1019 commented on issue #3301: URL: https://github.com/apache/hudi/issues/3301#issuecomment-892370496 hello @chb77 , ParquetDFSSource doesn't support wildcard. You can define a root path and set up a sourceLimit to each run. Delta Streamer will load files based on their latest mo

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392722#comment-17392722 ] ASF GitHub Bot commented on HUDI-2273: -- hudi-bot edited a comment on pull request #33

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392721#comment-17392721 ] ASF GitHub Bot commented on HUDI-2273: -- vinothchandar commented on a change in pull r

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * 0a32f4afcbf92b85e51b12de7af26b918d58a549 UNKNOWN * acbedb531fdbade17ba78c53cb23786f04ea8cb8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-

[GitHub] [hudi] vinothchandar commented on a change in pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-03 Thread GitBox
vinothchandar commented on a change in pull request #3398: URL: https://github.com/apache/hudi/pull/3398#discussion_r682293294 ## File path: hudi-sync/hudi-hive-sync/src/test/java/org/apache/hudi/hive/functional/HiveSyncFunctionalTestSuite.java ## @@ -25,7 +25,7 @@ import org

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392720#comment-17392720 ] ASF GitHub Bot commented on HUDI-2273: -- vinothchandar commented on a change in pull r

[GitHub] [hudi] vinothchandar commented on a change in pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-03 Thread GitBox
vinothchandar commented on a change in pull request #3398: URL: https://github.com/apache/hudi/pull/3398#discussion_r682292940 ## File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/client/functional/SparkClientFunctionalTestSuite.java ## @@ -0,0 +1,32 @@ +/

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392719#comment-17392719 ] ASF GitHub Bot commented on HUDI-2273: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * 0a32f4afcbf92b85e51b12de7af26b918d58a549 UNKNOWN * acbedb531fdbade17ba78c53cb23786f04ea8cb8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392718#comment-17392718 ] ASF GitHub Bot commented on HUDI-2273: -- hudi-bot edited a comment on pull request #33

[jira] [Commented] (HUDI-2087) Support Append only in Flink stream

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392717#comment-17392717 ] ASF GitHub Bot commented on HUDI-2087: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * 0a32f4afcbf92b85e51b12de7af26b918d58a549 UNKNOWN * acbedb531fdbade17ba78c53cb23786f04ea8cb8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-

[GitHub] [hudi] hudi-bot edited a comment on pull request #3390: [HUDI-2087] Support Append only in Flink stream

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3390: URL: https://github.com/apache/hudi/pull/3390#issuecomment-891674857 ## CI report: * b7cb83fc91ebba1152070307fa4c926889a7da2a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392716#comment-17392716 ] ASF GitHub Bot commented on HUDI-2273: -- nsivabalan commented on pull request #3398: U

[GitHub] [hudi] nsivabalan commented on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-03 Thread GitBox
nsivabalan commented on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892367490 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Updated] (HUDI-2273) Bring down the total test run time with CI

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2273: - Labels: pull-request-available (was: ) > Bring down the total test run time with CI > ---

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392715#comment-17392715 ] ASF GitHub Bot commented on HUDI-2273: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * 0a32f4afcbf92b85e51b12de7af26b918d58a549 UNKNOWN * acbedb531fdbade17ba78c53cb23786f04ea8cb8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-

[jira] [Created] (HUDI-2273) Bring down the total test run time with CI

2021-08-03 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2273: - Summary: Bring down the total test run time with CI Key: HUDI-2273 URL: https://issues.apache.org/jira/browse/HUDI-2273 Project: Apache Hudi Issue

[jira] [Commented] (HUDI-1842) [SQL] Spark Sql Support For The Exists Hoodie Table

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392712#comment-17392712 ] ASF GitHub Bot commented on HUDI-1842: -- nsivabalan edited a comment on pull request #

[GitHub] [hudi] nsivabalan edited a comment on pull request #3393: [HUDI-1842] Spark Sql Support For The Exists Hoodie Table

2021-08-03 Thread GitBox
nsivabalan edited a comment on pull request #3393: URL: https://github.com/apache/hudi/pull/3393#issuecomment-892140145 Hey peng. I did a round of testing on this patch. Here are my findings. Insert into is till prefixing col name to meta fields. (3rd col and 4th col) ``` se

[jira] [Assigned] (HUDI-2268) Upgrade hoodie table to 0.9.0

2021-08-03 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-2268: - Assignee: sivabalan narayanan > Upgrade hoodie table to 0.9.0 > -

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [WIP] Moving some long running tests to functional

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * 0a32f4afcbf92b85e51b12de7af26b918d58a549 UNKNOWN * acbedb531fdbade17ba78c53cb23786f04ea8cb8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [WIP] Moving some long running tests to functional

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * 789fffca8ce157f80909735eff313b046c9e092c Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [WIP] Moving some long running tests to functional

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * 789fffca8ce157f80909735eff313b046c9e092c Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [WIP] Moving some long running tests to functional

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * 789fffca8ce157f80909735eff313b046c9e092c Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] Ambarish-Giri commented on issue #3395: [SUPPORT] Issues with read optimized query MOR table

2021-08-03 Thread GitBox
Ambarish-Giri commented on issue #3395: URL: https://github.com/apache/hudi/issues/3395#issuecomment-892350596 Hi @nsivabalan , I am not executing the spark job from spark-shell I am running the spark driver program from Intellij IDE. By spark-shell launch command I am l

[GitHub] [hudi] sannidhiteredesai opened a new issue #3399: [SUPPORT] How to purge older partitions in hudi partitioned tables ?

2021-08-03 Thread GitBox
sannidhiteredesai opened a new issue #3399: URL: https://github.com/apache/hudi/issues/3399 **Question:** How to purge older partitions in hudi partitioned tables ? **Scenario:** - I have a partitioned table that will be created on daily basis. - If everyday a new partition is c

[jira] [Commented] (HUDI-2087) Support Append only in Flink stream

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392705#comment-17392705 ] ASF GitHub Bot commented on HUDI-2087: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3390: [HUDI-2087] Support Append only in Flink stream

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3390: URL: https://github.com/apache/hudi/pull/3390#issuecomment-891674857 ## CI report: * e88db7d1056d593083d59b7987bee92f5a6b3ae6 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2087) Support Append only in Flink stream

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392704#comment-17392704 ] ASF GitHub Bot commented on HUDI-2087: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3390: [HUDI-2087] Support Append only in Flink stream

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3390: URL: https://github.com/apache/hudi/pull/3390#issuecomment-891674857 ## CI report: * e88db7d1056d593083d59b7987bee92f5a6b3ae6 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [WIP] Moving some long running tests to functional

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * 789fffca8ce157f80909735eff313b046c9e092c Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] nsivabalan commented on a change in pull request #3398: [WIP] Moving some long running tests to functional

2021-08-03 Thread GitBox
nsivabalan commented on a change in pull request #3398: URL: https://github.com/apache/hudi/pull/3398#discussion_r682271526 ## File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/functional/TestHoodieDeltaStreamer.java ## @@ -115,6 +116,7 @@ /** * Basic tests

[jira] [Commented] (HUDI-2263) Document checkstyle setup

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392697#comment-17392697 ] ASF GitHub Bot commented on HUDI-2263: -- vinothchandar commented on pull request #3385

[GitHub] [hudi] vinothchandar commented on pull request #3385: [HUDI-2263] add steps for checkstyle

2021-08-03 Thread GitBox
vinothchandar commented on pull request #3385: URL: https://github.com/apache/hudi/pull/3385#issuecomment-892342756 @satishmittal can we retarget this on the new site docs. We just moved to docusaurus -- This is an automated message from the Apache Git Service. To respond to the mess

[jira] [Commented] (HUDI-1985) Website re-design implementation

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392696#comment-17392696 ] ASF GitHub Bot commented on HUDI-1985: -- vinothchandar merged pull request #3396: URL:

[GitHub] [hudi] vinothchandar merged pull request #3396: [HUDI-1985] Cleaned up the jekyll files and fixed the title, readme and mobile css

2021-08-03 Thread GitBox
vinothchandar merged pull request #3396: URL: https://github.com/apache/hudi/pull/3396 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-uns

[jira] [Commented] (HUDI-2087) Support Append only in Flink stream

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392695#comment-17392695 ] ASF GitHub Bot commented on HUDI-2087: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] vinothchandar commented on a change in pull request #3398: [WIP] Moving some long running tests to functional

2021-08-03 Thread GitBox
vinothchandar commented on a change in pull request #3398: URL: https://github.com/apache/hudi/pull/3398#discussion_r682267498 ## File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/functional/TestHoodieDeltaStreamer.java ## @@ -115,6 +116,7 @@ /** * Basic tes

[GitHub] [hudi] hudi-bot edited a comment on pull request #3390: [HUDI-2087] Support Append only in Flink stream

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3390: URL: https://github.com/apache/hudi/pull/3390#issuecomment-891674857 ## CI report: * e88db7d1056d593083d59b7987bee92f5a6b3ae6 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] vinothchandar commented on pull request #3398: [WIP] Moving some long running tests to functional

2021-08-03 Thread GitBox
vinothchandar commented on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892341412 https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=1345&view=logs&j=49186a26-7c18-5ea7-a030-c991549c6bb6 seems to be working? but wondering if the

[jira] [Commented] (HUDI-2141) Integration flink metric in flink stream

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392687#comment-17392687 ] ASF GitHub Bot commented on HUDI-2141: -- yuzhaojing commented on pull request #3235: U

[GitHub] [hudi] yuzhaojing commented on pull request #3235: [HUDI-2141] Integration flink metric in flink stream

2021-08-03 Thread GitBox
yuzhaojing commented on pull request #3235: URL: https://github.com/apache/hudi/pull/3235#issuecomment-892331262 > The change is huge, let's move it to 0.10.0 Ok. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [WIP] Moving some long running tests to functional

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * f8bd430efadd3a37885a3e811c132ba1bf07073d Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[jira] [Commented] (HUDI-1842) [SQL] Spark Sql Support For The Exists Hoodie Table

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392685#comment-17392685 ] ASF GitHub Bot commented on HUDI-1842: -- nsivabalan commented on pull request #3393: U

[GitHub] [hudi] nsivabalan commented on pull request #3393: [HUDI-1842] Spark Sql Support For The Exists Hoodie Table

2021-08-03 Thread GitBox
nsivabalan commented on pull request #3393: URL: https://github.com/apache/hudi/pull/3393#issuecomment-892329397 > Hey peng. I did a round of testing on this patch. Here are my findings. > > Insert into is till prefixing col name to meta fields. (3rd col and 4th col) > > ```

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [WIP] Moving some long running tests to functional

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * f8bd430efadd3a37885a3e811c132ba1bf07073d Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[jira] [Commented] (HUDI-2243) Support Time Travel Query For Hoodie Table

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392679#comment-17392679 ] ASF GitHub Bot commented on HUDI-2243: -- codope commented on pull request #3360: URL:

[GitHub] [hudi] codope commented on pull request #3360: [HUDI-2243] Support Time Travel Query For Hoodie Table

2021-08-03 Thread GitBox
codope commented on pull request #3360: URL: https://github.com/apache/hudi/pull/3360#issuecomment-892324921 > > @pengzhiwei2018 Thanks for this. Maybe we could have couple of follow on tasks. > > > > 1. Allow user to specify `as.of.instant` in `-MM-DD` to `-MM-DD hh:mm:ss`

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [WIP] Moving some long running tests to functional

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * f8bd430efadd3a37885a3e811c132ba1bf07073d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2141) Integration flink metric in flink stream

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392678#comment-17392678 ] ASF GitHub Bot commented on HUDI-2141: -- danny0405 commented on pull request #3235: UR

[GitHub] [hudi] danny0405 commented on pull request #3235: [HUDI-2141] Integration flink metric in flink stream

2021-08-03 Thread GitBox
danny0405 commented on pull request #3235: URL: https://github.com/apache/hudi/pull/3235#issuecomment-892324047 The change is huge, let's move it to 0.10.0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Commented] (HUDI-2087) Support Append only in Flink stream

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392677#comment-17392677 ] ASF GitHub Bot commented on HUDI-2087: -- danny0405 commented on a change in pull reque

[GitHub] [hudi] danny0405 commented on a change in pull request #3390: [HUDI-2087] Support Append only in Flink stream

2021-08-03 Thread GitBox
danny0405 commented on a change in pull request #3390: URL: https://github.com/apache/hudi/pull/3390#discussion_r682250961 ## File path: hudi-flink/src/test/java/org/apache/hudi/utils/TestData.java ## @@ -394,6 +394,48 @@ public static void checkWrittenData( } } + /*

[jira] [Commented] (HUDI-2233) [SQL] Hive sync is not working

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392676#comment-17392676 ] ASF GitHub Bot commented on HUDI-2233: -- pengzhiwei2018 commented on a change in pull

[GitHub] [hudi] pengzhiwei2018 commented on a change in pull request #3387: [HUDI-2233] Use HMS To Sync Hive Meta For Spark Sql

2021-08-03 Thread GitBox
pengzhiwei2018 commented on a change in pull request #3387: URL: https://github.com/apache/hudi/pull/3387#discussion_r682249809 ## File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala ## @@ -399,6 +400,11 @@ object DataSourc

  1   2   3   4   >