[jira] [Commented] (HUDI-2357) MERGE INTO doesn't work for tables created using CTAS

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404966#comment-17404966 ] ASF GitHub Bot commented on HUDI-2357: -- pengzhiwei2018 commented on pull request #3534: URL:

[GitHub] [hudi] pengzhiwei2018 commented on a change in pull request #3534: [HUDI-2357] MERGE INTO doesn't work for tables created using CTAS

2021-08-25 Thread GitBox
pengzhiwei2018 commented on a change in pull request #3534: URL: https://github.com/apache/hudi/pull/3534#discussion_r696311825 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/InsertIntoHoodieTableCommand.scala ## @@ -193,15

[GitHub] [hudi] pengzhiwei2018 commented on a change in pull request #3534: [HUDI-2357] MERGE INTO doesn't work for tables created using CTAS

2021-08-25 Thread GitBox
pengzhiwei2018 commented on a change in pull request #3534: URL: https://github.com/apache/hudi/pull/3534#discussion_r696311825 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/InsertIntoHoodieTableCommand.scala ## @@ -193,15

[GitHub] [hudi] pengzhiwei2018 commented on pull request #3534: [HUDI-2357] MERGE INTO doesn't work for tables created using CTAS

2021-08-25 Thread GitBox
pengzhiwei2018 commented on pull request #3534: URL: https://github.com/apache/hudi/pull/3534#issuecomment-906117662 > @pengzhiwei2018 - Thanks for the quick fix, I have tested the fix and it works for tables created using CTAS, Can we include this fix as part of 0.9.0 release by any

[jira] [Commented] (HUDI-2365) Optimizing overwriteField method with Objects.equals

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404964#comment-17404964 ] ASF GitHub Bot commented on HUDI-2365: -- dongkelun removed a comment on pull request #3542: URL:

[GitHub] [hudi] dongkelun removed a comment on pull request #3542: [HUDI-2365]Optimizing overwriteField method with Objects.equals

2021-08-25 Thread GitBox
dongkelun removed a comment on pull request #3542: URL: https://github.com/apache/hudi/pull/3542#issuecomment-906056841 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[jira] [Commented] (HUDI-2357) MERGE INTO doesn't work for tables created using CTAS

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404961#comment-17404961 ] ASF GitHub Bot commented on HUDI-2357: -- pengzhiwei2018 commented on a change in pull request #3534:

[GitHub] [hudi] pengzhiwei2018 commented on a change in pull request #3534: [HUDI-2357] MERGE INTO doesn't work for tables created using CTAS

2021-08-25 Thread GitBox
pengzhiwei2018 commented on a change in pull request #3534: URL: https://github.com/apache/hudi/pull/3534#discussion_r696311825 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/InsertIntoHoodieTableCommand.scala ## @@ -193,15

[jira] [Commented] (HUDI-2341) Publish a blog on immutable data lakes

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404954#comment-17404954 ] ASF GitHub Bot commented on HUDI-2341: -- vingov commented on a change in pull request #3515: URL:

[jira] [Commented] (HUDI-2348) Publish a blog on schema evolution with KafkaAvroCustomDeserializer

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404955#comment-17404955 ] ASF GitHub Bot commented on HUDI-2348: -- sbernauer commented on pull request #3485: URL:

[GitHub] [hudi] sbernauer commented on pull request #3485: [HUDI-2348] Added blog on "Schema evolution with DeltaStreamer using KafkaSource"

2021-08-25 Thread GitBox
sbernauer commented on pull request #3485: URL: https://github.com/apache/hudi/pull/3485#issuecomment-906111077 Thanks a lot @nsivabalan! Sorry for not responding, i did not get the local website build to work... I applied you patch to the PR -- This is an automated message from

[GitHub] [hudi] vingov commented on a change in pull request #3515: [HUDI-2341] Adding blog on immutable data lakes

2021-08-25 Thread GitBox
vingov commented on a change in pull request #3515: URL: https://github.com/apache/hudi/pull/3515#discussion_r696306531 ## File path: website/blog/2021-08-20-immutable-data-lakes.md ## @@ -0,0 +1,73 @@ +--- +title: "Immutable data lakes using Apache Hudi" +excerpt: "How to

[jira] [Commented] (HUDI-2354) archive delete replacecommit, but stop timeline server meet file not found

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404939#comment-17404939 ] ASF GitHub Bot commented on HUDI-2354: -- hudi-bot edited a comment on pull request #3536: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3536: [HUDI-2354] Fix TimelineServer error because of replacecommit archive

2021-08-25 Thread GitBox
hudi-bot edited a comment on pull request #3536: URL: https://github.com/apache/hudi/pull/3536#issuecomment-905325754 ## CI report: * 92cdf3364c6c8f947f1a3bf5c5795a1b987ab83d Azure:

[jira] [Commented] (HUDI-2354) archive delete replacecommit, but stop timeline server meet file not found

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404937#comment-17404937 ] ASF GitHub Bot commented on HUDI-2354: -- hudi-bot edited a comment on pull request #3536: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3536: [HUDI-2354] Fix TimelineServer error because of replacecommit archive

2021-08-25 Thread GitBox
hudi-bot edited a comment on pull request #3536: URL: https://github.com/apache/hudi/pull/3536#issuecomment-905325754 ## CI report: * f8d71b7e83f8e9bc64ca0dfbe70e67a352fba82e Azure:

[jira] [Commented] (HUDI-2354) archive delete replacecommit, but stop timeline server meet file not found

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404932#comment-17404932 ] ASF GitHub Bot commented on HUDI-2354: -- hudi-bot edited a comment on pull request #3536: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3536: [HUDI-2354] Fix TimelineServer error because of replacecommit archive

2021-08-25 Thread GitBox
hudi-bot edited a comment on pull request #3536: URL: https://github.com/apache/hudi/pull/3536#issuecomment-905325754 ## CI report: * f8d71b7e83f8e9bc64ca0dfbe70e67a352fba82e Azure:

[jira] [Commented] (HUDI-2321) Use the caller classloader for ReflectionUtils

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404918#comment-17404918 ] ASF GitHub Bot commented on HUDI-2321: -- hudi-bot edited a comment on pull request #3535: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3535: [HUDI-2321] Use the caller classloader for ReflectionUtils

2021-08-25 Thread GitBox
hudi-bot edited a comment on pull request #3535: URL: https://github.com/apache/hudi/pull/3535#issuecomment-905240762 ## CI report: * 3349f0e888f939f1db9cb2b099a50a3bbd5e7362 Azure:

[jira] [Commented] (HUDI-52) Implement Savepoints for Merge On Read table #88

2021-08-25 Thread liyan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-52?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404912#comment-17404912 ] liyan commented on HUDI-52: --- Why is this not supported? What are the main problems and difficulties？ > Implement

[jira] [Created] (HUDI-2367) Handle deletes in S3 deltastreamer stouce

2021-08-25 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-2367: - Summary: Handle deletes in S3 deltastreamer stouce Key: HUDI-2367 URL: https://issues.apache.org/jira/browse/HUDI-2367 Project: Apache Hudi Issue Type: Sub-task

[jira] [Commented] (HUDI-2365) Optimizing overwriteField method with Objects.equals

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404911#comment-17404911 ] ASF GitHub Bot commented on HUDI-2365: -- dongkelun commented on pull request #3542: URL:

[GitHub] [hudi] dongkelun commented on pull request #3542: [HUDI-2365]Optimizing overwriteField method with Objects.equals

2021-08-25 Thread GitBox
dongkelun commented on pull request #3542: URL: https://github.com/apache/hudi/pull/3542#issuecomment-906088765 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Commented] (HUDI-2366) fix hudi generating too many logs

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404910#comment-17404910 ] ASF GitHub Bot commented on HUDI-2366: -- hudi-bot edited a comment on pull request #3543: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3543: [HUDI-2366] fix too many logs

2021-08-25 Thread GitBox
hudi-bot edited a comment on pull request #3543: URL: https://github.com/apache/hudi/pull/3543#issuecomment-906068990 ## CI report: * 95b6526c86d0428b80c9525b94f3bceb1d883bda Azure:

[jira] [Commented] (HUDI-2365) Optimizing overwriteField method with Objects.equals

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404909#comment-17404909 ] ASF GitHub Bot commented on HUDI-2365: -- dongkelun edited a comment on pull request #3542: URL:

[GitHub] [hudi] dongkelun edited a comment on pull request #3542: [HUDI-2365]Optimizing overwriteField method with Objects.equals

2021-08-25 Thread GitBox
dongkelun edited a comment on pull request #3542: URL: https://github.com/apache/hudi/pull/3542#issuecomment-906056841 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Commented] (HUDI-2354) archive delete replacecommit, but stop timeline server meet file not found

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404908#comment-17404908 ] ASF GitHub Bot commented on HUDI-2354: -- hudi-bot edited a comment on pull request #3536: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3536: [HUDI-2354] Fix TimelineServer error because of replacecommit archive

2021-08-25 Thread GitBox
hudi-bot edited a comment on pull request #3536: URL: https://github.com/apache/hudi/pull/3536#issuecomment-905325754 ## CI report: * f8d71b7e83f8e9bc64ca0dfbe70e67a352fba82e Azure:

[jira] [Commented] (HUDI-2354) archive delete replacecommit, but stop timeline server meet file not found

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404906#comment-17404906 ] ASF GitHub Bot commented on HUDI-2354: -- hudi-bot edited a comment on pull request #3536: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3536: [HUDI-2354] Fix TimelineServer error because of replacecommit archive

2021-08-25 Thread GitBox
hudi-bot edited a comment on pull request #3536: URL: https://github.com/apache/hudi/pull/3536#issuecomment-905325754 ## CI report: * 86aeb78e298b7bea6113fd3675f48fdc538bcbf9 Azure:

[jira] [Commented] (HUDI-2354) archive delete replacecommit, but stop timeline server meet file not found

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404904#comment-17404904 ] ASF GitHub Bot commented on HUDI-2354: -- zhangyue19921010 commented on a change in pull request #3536:

[GitHub] [hudi] zhangyue19921010 commented on a change in pull request #3536: [HUDI-2354] Fix TimelineServer error because of replacecommit archive

2021-08-25 Thread GitBox
zhangyue19921010 commented on a change in pull request #3536: URL: https://github.com/apache/hudi/pull/3536#discussion_r696258610 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/view/AbstractTableFileSystemView.java ## @@ -212,7 +212,15 @@ private void

[jira] [Commented] (HUDI-2354) archive delete replacecommit, but stop timeline server meet file not found

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404903#comment-17404903 ] ASF GitHub Bot commented on HUDI-2354: -- hudi-bot edited a comment on pull request #3536: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3536: [HUDI-2354] Fix TimelineServer error because of replacecommit archive

2021-08-25 Thread GitBox
hudi-bot edited a comment on pull request #3536: URL: https://github.com/apache/hudi/pull/3536#issuecomment-905325754 ## CI report: * 86aeb78e298b7bea6113fd3675f48fdc538bcbf9 Azure:

[jira] [Commented] (HUDI-2354) archive delete replacecommit, but stop timeline server meet file not found

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404901#comment-17404901 ] ASF GitHub Bot commented on HUDI-2354: -- hudi-bot edited a comment on pull request #3536: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3536: [HUDI-2354] Fix TimelineServer error because of replacecommit archive

2021-08-25 Thread GitBox
hudi-bot edited a comment on pull request #3536: URL: https://github.com/apache/hudi/pull/3536#issuecomment-905325754 ## CI report: * 86aeb78e298b7bea6113fd3675f48fdc538bcbf9 Azure:

[jira] [Commented] (HUDI-2354) archive delete replacecommit, but stop timeline server meet file not found

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404894#comment-17404894 ] ASF GitHub Bot commented on HUDI-2354: -- hudi-bot edited a comment on pull request #3536: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3536: [HUDI-2354] Fix TimelineServer error because of replacecommit archive

2021-08-25 Thread GitBox
hudi-bot edited a comment on pull request #3536: URL: https://github.com/apache/hudi/pull/3536#issuecomment-905325754 ## CI report: * 86aeb78e298b7bea6113fd3675f48fdc538bcbf9 Azure:

[jira] [Commented] (HUDI-2321) Use the caller classloader for ReflectionUtils

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404893#comment-17404893 ] ASF GitHub Bot commented on HUDI-2321: -- hudi-bot edited a comment on pull request #3535: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3535: [HUDI-2321] Use the caller classloader for ReflectionUtils

2021-08-25 Thread GitBox
hudi-bot edited a comment on pull request #3535: URL: https://github.com/apache/hudi/pull/3535#issuecomment-905240762 ## CI report: * 2552e618287c46065baa96d9c2972f192fde5266 Azure:

[jira] [Commented] (HUDI-2321) Use the caller classloader for ReflectionUtils

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404892#comment-17404892 ] ASF GitHub Bot commented on HUDI-2321: -- hudi-bot edited a comment on pull request #3535: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3535: [HUDI-2321] Use the caller classloader for ReflectionUtils

2021-08-25 Thread GitBox
hudi-bot edited a comment on pull request #3535: URL: https://github.com/apache/hudi/pull/3535#issuecomment-905240762 ## CI report: * 2552e618287c46065baa96d9c2972f192fde5266 Azure:

[jira] [Commented] (HUDI-2366) fix hudi generating too many logs

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404891#comment-17404891 ] ASF GitHub Bot commented on HUDI-2366: -- hudi-bot edited a comment on pull request #3543: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3543: [HUDI-2366] fix too many logs

2021-08-25 Thread GitBox
hudi-bot edited a comment on pull request #3543: URL: https://github.com/apache/hudi/pull/3543#issuecomment-906068990 ## CI report: * 95b6526c86d0428b80c9525b94f3bceb1d883bda Azure:

[jira] [Commented] (HUDI-2229) Refact hoodie stream creator in flink

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404887#comment-17404887 ] ASF GitHub Bot commented on HUDI-2229: -- hudi-bot edited a comment on pull request #3495: URL:

[jira] [Commented] (HUDI-2366) fix hudi generating too many logs

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404888#comment-17404888 ] ASF GitHub Bot commented on HUDI-2366: -- hudi-bot commented on pull request #3543: URL:

[GitHub] [hudi] hudi-bot commented on pull request #3543: [HUDI-2366] fix too many logs

2021-08-25 Thread GitBox
hudi-bot commented on pull request #3543: URL: https://github.com/apache/hudi/pull/3543#issuecomment-906068990 ## CI report: * 95b6526c86d0428b80c9525b94f3bceb1d883bda UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[GitHub] [hudi] hudi-bot edited a comment on pull request #3495: [HUDI-2229] Refact hoodie stream creator

2021-08-25 Thread GitBox
hudi-bot edited a comment on pull request #3495: URL: https://github.com/apache/hudi/pull/3495#issuecomment-901095902 ## CI report: * bbe7dd4a418b756da880733278eddd08558a551a Azure:

[jira] [Commented] (HUDI-2366) fix hudi generating too many logs

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404885#comment-17404885 ] ASF GitHub Bot commented on HUDI-2366: -- AyachiNene opened a new pull request #3543: URL:

[jira] [Updated] (HUDI-2366) fix hudi generating too many logs

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2366: - Labels: pull-request-available (was: ) > fix hudi generating too many logs >

[GitHub] [hudi] AyachiNene opened a new pull request #3543: [HUDI-2366] fix too many logs

2021-08-25 Thread GitBox
AyachiNene opened a new pull request #3543: URL: https://github.com/apache/hudi/pull/3543 ## What is the purpose of the pull request JIRA : https://issues.apache.org/jira/browse/HUDI-2366 Delete a meaningless log with too many log output ## Brief change log -

[jira] [Commented] (HUDI-2354) archive delete replacecommit, but stop timeline server meet file not found

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404870#comment-17404870 ] ASF GitHub Bot commented on HUDI-2354: -- zhangyue19921010 commented on a change in pull request #3536:

[GitHub] [hudi] zhangyue19921010 commented on a change in pull request #3536: [HUDI-2354] Fix TimelineServer error because of replacecommit archive

2021-08-25 Thread GitBox
zhangyue19921010 commented on a change in pull request #3536: URL: https://github.com/apache/hudi/pull/3536#discussion_r696258610 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/view/AbstractTableFileSystemView.java ## @@ -212,7 +212,15 @@ private void

[jira] [Commented] (HUDI-2354) archive delete replacecommit, but stop timeline server meet file not found

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404866#comment-17404866 ] ASF GitHub Bot commented on HUDI-2354: -- hudi-bot edited a comment on pull request #3536: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3536: [HUDI-2354] Fix TimelineServer error because of replacecommit archive

2021-08-25 Thread GitBox
hudi-bot edited a comment on pull request #3536: URL: https://github.com/apache/hudi/pull/3536#issuecomment-905325754 ## CI report: * 0e8abd694f93484a3e6accd9c18f5b538274ecd7 Azure:

[jira] [Commented] (HUDI-2365) Optimizing overwriteField method with Objects.equals

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404865#comment-17404865 ] ASF GitHub Bot commented on HUDI-2365: -- dongkelun commented on pull request #3542: URL:

[GitHub] [hudi] dongkelun commented on pull request #3542: [HUDI-2365]Optimizing overwriteField method with Objects.equals

2021-08-25 Thread GitBox
dongkelun commented on pull request #3542: URL: https://github.com/apache/hudi/pull/3542#issuecomment-906056841 @hudi-bot run travis -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Commented] (HUDI-2354) archive delete replacecommit, but stop timeline server meet file not found

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404863#comment-17404863 ] ASF GitHub Bot commented on HUDI-2354: -- hudi-bot edited a comment on pull request #3536: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3536: [HUDI-2354] Fix TimelineServer error because of replacecommit archive

2021-08-25 Thread GitBox
hudi-bot edited a comment on pull request #3536: URL: https://github.com/apache/hudi/pull/3536#issuecomment-905325754 ## CI report: * 0e8abd694f93484a3e6accd9c18f5b538274ecd7 Azure:

[jira] [Commented] (HUDI-2229) Refact hoodie stream creator in flink

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404859#comment-17404859 ] ASF GitHub Bot commented on HUDI-2229: -- hudi-bot edited a comment on pull request #3495: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3495: [HUDI-2229] Refact hoodie stream creator

2021-08-25 Thread GitBox
hudi-bot edited a comment on pull request #3495: URL: https://github.com/apache/hudi/pull/3495#issuecomment-901095902 ## CI report: * 9428c4d43d2983bd161b7a538da919ffc369ca89 Azure:

[jira] [Commented] (HUDI-2229) Refact hoodie stream creator in flink

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404857#comment-17404857 ] ASF GitHub Bot commented on HUDI-2229: -- hudi-bot edited a comment on pull request #3495: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3495: [HUDI-2229] Refact hoodie stream creator

2021-08-25 Thread GitBox
hudi-bot edited a comment on pull request #3495: URL: https://github.com/apache/hudi/pull/3495#issuecomment-901095902 ## CI report: * 9428c4d43d2983bd161b7a538da919ffc369ca89 Azure:

[jira] [Commented] (HUDI-2365) Optimizing overwriteField method with Objects.equals

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404848#comment-17404848 ] ASF GitHub Bot commented on HUDI-2365: -- hudi-bot edited a comment on pull request #3542: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3542: [HUDI-2365]Optimizing overwriteField method with Objects.equals

2021-08-25 Thread GitBox
hudi-bot edited a comment on pull request #3542: URL: https://github.com/apache/hudi/pull/3542#issuecomment-906008628 ## CI report: * 547b7c48a0866e10b6c0032d2e4948d71e208b42 Azure:

[GitHub] [hudi] liujinhui1994 commented on issue #3500: [SUPPORT]Order changed while using sanpshot query

2021-08-25 Thread GitBox
liujinhui1994 commented on issue #3500: URL: https://github.com/apache/hudi/issues/3500#issuecomment-906029508 Hudi guarantees the order. Generally, if you use spark to consume kafka to write to hudi, you need to ensure that kafka is in order in the same partition -- This is an

[GitHub] [hudi] liujinhui1994 commented on issue #3533: [SUPPORT]How to use MOR Table to Merge small file?

2021-08-25 Thread GitBox
liujinhui1994 commented on issue #3533: URL: https://github.com/apache/hudi/issues/3533#issuecomment-906028752 > PARQUET_SMALL_FILE_LIMIT_BYTES If it is an insert operation, you can try clustering -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hudi] liujinhui1994 commented on issue #3418: [SUPPORT] Hudi Upsert Very Slow/ Failed With No Space Left on Device

2021-08-25 Thread GitBox
liujinhui1994 commented on issue #3418: URL: https://github.com/apache/hudi/issues/3418#issuecomment-906027579 > 感谢@nsivabalan和@liujinhui1994，HiveSyncTool 确实有帮助！因此，根据您的建议，`bulk_insert`对迁移表有很大帮助。现在，在我们完成迁移后，我正在尝试使用`upsert`操作来增量加载数据。我观察到`upsert`一天的数据需要花费 3

[jira] [Created] (HUDI-2366) fix hudi generating too many logs

2021-08-25 Thread WangZhongze (Jira)
WangZhongze created HUDI-2366: - Summary: fix hudi generating too many logs Key: HUDI-2366 URL: https://issues.apache.org/jira/browse/HUDI-2366 Project: Apache Hudi Issue Type: Bug

[jira] [Commented] (HUDI-2348) Publish a blog on schema evolution with KafkaAvroCustomDeserializer

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404839#comment-17404839 ] ASF GitHub Bot commented on HUDI-2348: -- nsivabalan commented on pull request #3485: URL:

[GitHub] [hudi] nsivabalan commented on pull request #3485: [HUDI-2348] Added blog on "Schema evolution with DeltaStreamer using KafkaSource"

2021-08-25 Thread GitBox
nsivabalan commented on pull request #3485: URL: https://github.com/apache/hudi/pull/3485#issuecomment-906019219 I tried to update the patch myself, and looks like I couldn't after website redesign. Here are the changes. Can you apply and update the patch. ``` diff --git

[jira] [Commented] (HUDI-2364) Run compaction without user schema file provided

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404837#comment-17404837 ] ASF GitHub Bot commented on HUDI-2364: -- hudi-bot edited a comment on pull request #3540: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3540: [WIP][HUDI-2364] Run compaction without user schema file provided

2021-08-25 Thread GitBox
hudi-bot edited a comment on pull request #3540: URL: https://github.com/apache/hudi/pull/3540#issuecomment-905980036 ## CI report: * 01cf15ad7e1cfdca2b282236756e31e8338b5a09 Azure:

[jira] [Commented] (HUDI-2365) Optimizing overwriteField method with Objects.equals

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404834#comment-17404834 ] ASF GitHub Bot commented on HUDI-2365: -- hudi-bot edited a comment on pull request #3542: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3542: [HUDI-2365]Optimizing overwriteField method with Objects.equals

2021-08-25 Thread GitBox
hudi-bot edited a comment on pull request #3542: URL: https://github.com/apache/hudi/pull/3542#issuecomment-906008628 ## CI report: * 547b7c48a0866e10b6c0032d2e4948d71e208b42 Azure:

[jira] [Commented] (HUDI-2365) Optimizing overwriteField method with Objects.equals

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404832#comment-17404832 ] ASF GitHub Bot commented on HUDI-2365: -- hudi-bot commented on pull request #3542: URL:

[GitHub] [hudi] hudi-bot commented on pull request #3542: [HUDI-2365]Optimizing overwriteField method with Objects.equals

2021-08-25 Thread GitBox
hudi-bot commented on pull request #3542: URL: https://github.com/apache/hudi/pull/3542#issuecomment-906008628 ## CI report: * 547b7c48a0866e10b6c0032d2e4948d71e208b42 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[jira] [Updated] (HUDI-2365) Optimizing overwriteField method with Objects.equals

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2365: - Labels: pull-request-available (was: ) > Optimizing overwriteField method with Objects.equals >

[jira] [Commented] (HUDI-2365) Optimizing overwriteField method with Objects.equals

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404830#comment-17404830 ] ASF GitHub Bot commented on HUDI-2365: -- dongkelun opened a new pull request #3542: URL:

[GitHub] [hudi] dongkelun opened a new pull request #3542: [HUDI-2365]Optimizing overwriteField method with Objects.equals

2021-08-25 Thread GitBox
dongkelun opened a new pull request #3542: URL: https://github.com/apache/hudi/pull/3542 ## What is the purpose of the pull request Optimizing overwriteField method with Objects.equals ## Verify this pull request This pull request is already covered by existing tests,

[jira] [Updated] (HUDI-2365) Optimizing overwriteField method with Objects.equals

2021-08-25 Thread Jira
[ https://issues.apache.org/jira/browse/HUDI-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 董可伦 updated HUDI-2365: -- Summary: Optimizing overwriteField method with Objects.equals (was: Optimizing overwriteField method with

[jira] [Updated] (HUDI-2365) Optimizing overwriteField method with Objects.equals

2021-08-25 Thread Jira
[ https://issues.apache.org/jira/browse/HUDI-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 董可伦 updated HUDI-2365: -- Description: Optimizing overwriteField method with Objects.equals (was: Optimizing overwriteField method with

[jira] [Created] (HUDI-2365) Optimizing overwriteField method with objects.equals

2021-08-25 Thread Jira
董可伦 created HUDI-2365: - Summary: Optimizing overwriteField method with objects.equals Key: HUDI-2365 URL: https://issues.apache.org/jira/browse/HUDI-2365 Project: Apache Hudi Issue Type: Improvement

[jira] [Commented] (HUDI-2364) Run compaction without user schema file provided

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404820#comment-17404820 ] ASF GitHub Bot commented on HUDI-2364: -- hudi-bot edited a comment on pull request #3540: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3540: [WIP][HUDI-2364] Run compaction without user schema file provided

2021-08-25 Thread GitBox
hudi-bot edited a comment on pull request #3540: URL: https://github.com/apache/hudi/pull/3540#issuecomment-905980036 ## CI report: * 01cf15ad7e1cfdca2b282236756e31e8338b5a09 Azure:

[jira] [Commented] (HUDI-2364) Run compaction without user schema file provided

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404818#comment-17404818 ] ASF GitHub Bot commented on HUDI-2364: -- hudi-bot commented on pull request #3540: URL:

[GitHub] [hudi] hudi-bot commented on pull request #3540: [WIP][HUDI-2364] Run compaction without user schema file provided

2021-08-25 Thread GitBox
hudi-bot commented on pull request #3540: URL: https://github.com/apache/hudi/pull/3540#issuecomment-905980036 ## CI report: * 01cf15ad7e1cfdca2b282236756e31e8338b5a09 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[jira] [Commented] (HUDI-2364) Run compaction without user schema file provided

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404815#comment-17404815 ] ASF GitHub Bot commented on HUDI-2364: -- zhedoubushishi opened a new pull request #3540: URL:

[jira] [Commented] (HUDI-2359) Add tests for _hoodie_is_deleted functionality

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404808#comment-17404808 ] ASF GitHub Bot commented on HUDI-2359: -- hudi-bot edited a comment on pull request #3541: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3541: [HUDI-2359] Add basic "hoodie_is_deleted" unit tests to TestDataSource classes

2021-08-25 Thread GitBox
hudi-bot edited a comment on pull request #3541: URL: https://github.com/apache/hudi/pull/3541#issuecomment-905946589 ## CI report: * 694300477f61a9169c15cac1ddf67368dbf5dd1b Azure:

[jira] [Commented] (HUDI-2341) Publish a blog on immutable data lakes

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404806#comment-17404806 ] ASF GitHub Bot commented on HUDI-2341: -- nsivabalan commented on a change in pull request #3515: URL:

[GitHub] [hudi] nsivabalan commented on a change in pull request #3515: [HUDI-2341] Adding blog on immutable data lakes

2021-08-25 Thread GitBox
nsivabalan commented on a change in pull request #3515: URL: https://github.com/apache/hudi/pull/3515#discussion_r696199489 ## File path: website/blog/2021-08-20-immutable-data-lakes.md ## @@ -0,0 +1,73 @@ +--- +title: "Immutable data lakes using Apache Hudi" +excerpt: "How to

[jira] [Commented] (HUDI-2348) Publish a blog on schema evolution with KafkaAvroCustomDeserializer

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404796#comment-17404796 ] ASF GitHub Bot commented on HUDI-2348: -- nsivabalan commented on a change in pull request #3485: URL:

[jira] [Commented] (HUDI-2346) Publish blog on async clustering usage

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404795#comment-17404795 ] ASF GitHub Bot commented on HUDI-2346: -- nsivabalan commented on a change in pull request #3525: URL:

[GitHub] [hudi] nsivabalan commented on a change in pull request #3485: [HUDI-2348] Added blog on "Schema evolution with DeltaStreamer using KafkaSource"

2021-08-25 Thread GitBox
nsivabalan commented on a change in pull request #3485: URL: https://github.com/apache/hudi/pull/3485#discussion_r696192820 ## File path: website/blog/2021-08-16-schema-evolution.md ## @@ -0,0 +1,39 @@ +--- +title: "Schema evolution with DeltaStreamer using KafkaSource"

[GitHub] [hudi] nsivabalan commented on a change in pull request #3525: [HUDI-2346] Async clustering usage blog

2021-08-25 Thread GitBox
nsivabalan commented on a change in pull request #3525: URL: https://github.com/apache/hudi/pull/3525#discussion_r696192756 ## File path: website/blog/2021-08-23-async-clustering.md ## @@ -0,0 +1,153 @@ +--- +title: "Asynchronous Clustering using Hudi" +excerpt: "How to setup

[jira] [Commented] (HUDI-2309) Document deltastreamer source for AWS S3

2021-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404794#comment-17404794 ] ASF GitHub Bot commented on HUDI-2309: -- nsivabalan commented on a change in pull request #3526: URL:

[GitHub] [hudi] nsivabalan commented on a change in pull request #3526: [HUDI-2309] Blog post for new S3 deltastreamer source

2021-08-25 Thread GitBox
nsivabalan commented on a change in pull request #3526: URL: https://github.com/apache/hudi/pull/3526#discussion_r696192721 ## File path: website/blog/2021-08-23-s3-events-source.md ## @@ -0,0 +1,111 @@ +--- +title: "Reliable ingestion from AWS S3 using Hudi" +excerpt: "From

  1   2   3   4   5   >