[GitHub] [hudi] codope opened a new pull request #3250: [MINOR] Fix EXTERNAL_RECORD_AND_SCHEMA_TRANSFORMATION config

2021-07-09 Thread GitBox
codope opened a new pull request #3250: URL: https://github.com/apache/hudi/pull/3250 ## What is the purpose of the pull request `EXTERNAL_RECORD_AND_SCHEMA_TRANSFORMATION` config key depends on `AVRO_SCHEMA`, which is no longer a static string. This PR sets the key correctly for

[GitHub] [hudi] jazzyMin opened a new issue #3249: execute insert into ... error:Unexpected exception. This is a bug. Please consider filing an issue.

2021-07-09 Thread GitBox
jazzyMin opened a new issue #3249: URL: https://github.com/apache/hudi/issues/3249 **_Tips before filing an issue_** - Have you gone through our [FAQs](https://cwiki.apache.org/confluence/display/HUDI/FAQ)? - Join the mailing list to engage in conversations and get faster

[jira] [Commented] (HUDI-2141) Integration flink metric in flink stream

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17378018#comment-17378018 ] ASF GitHub Bot commented on HUDI-2141: -- hudi-bot edited a comment on pull request #3235: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3235: [HUDI-2141] Integration flink metric in flink stream

2021-07-09 Thread GitBox
hudi-bot edited a comment on pull request #3235: URL: https://github.com/apache/hudi/pull/3235#issuecomment-875512974 ## CI report: * fbf4eb53e9c96782796612e8bbdaed4aa22d8caf Azure:

[jira] [Commented] (HUDI-2141) Integration flink metric in flink stream

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17378016#comment-17378016 ] ASF GitHub Bot commented on HUDI-2141: -- hudi-bot edited a comment on pull request #3235: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3235: [HUDI-2141] Integration flink metric in flink stream

2021-07-09 Thread GitBox
hudi-bot edited a comment on pull request #3235: URL: https://github.com/apache/hudi/pull/3235#issuecomment-875512974 ## CI report: * fbf4eb53e9c96782796612e8bbdaed4aa22d8caf Azure:

[jira] [Commented] (HUDI-2107) Support Read Log Only MOR Table For Spark

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17378011#comment-17378011 ] ASF GitHub Bot commented on HUDI-2107: -- codecov-commenter edited a comment on pull request #3193:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3193: [HUDI-2107] Support Read Log Only MOR Table For Spark

2021-07-09 Thread GitBox
codecov-commenter edited a comment on pull request #3193: URL: https://github.com/apache/hudi/pull/3193#issuecomment-871511739 #

[jira] [Commented] (HUDI-1483) async clustering for deltastreamer

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17378009#comment-17378009 ] ASF GitHub Bot commented on HUDI-1483: -- hudi-bot edited a comment on pull request #3142: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3142: [HUDI-1483] Support async clustering for deltastreamer and Spark streaming

2021-07-09 Thread GitBox
hudi-bot edited a comment on pull request #3142: URL: https://github.com/apache/hudi/pull/3142#issuecomment-866996072 ## CI report: * 890e9822855fcd45c8387f83740975f43474cddc Azure:

[jira] [Commented] (HUDI-1483) async clustering for deltastreamer

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17378008#comment-17378008 ] ASF GitHub Bot commented on HUDI-1483: -- codope commented on pull request #3142: URL:

[GitHub] [hudi] codope commented on pull request #3142: [HUDI-1483] Support async clustering for deltastreamer and Spark streaming

2021-07-09 Thread GitBox
codope commented on pull request #3142: URL: https://github.com/apache/hudi/pull/3142#issuecomment-877110964 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Commented] (HUDI-2147) Remove unused class AvroConvertor in hudi-flink

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377991#comment-17377991 ] ASF GitHub Bot commented on HUDI-2147: -- wangxianghu commented on pull request #3243: URL:

[GitHub] [hudi] wangxianghu commented on pull request #3243: [HUDI-2147] Remove unused class AvroConvertor in hudi-flink

2021-07-09 Thread GitBox
wangxianghu commented on pull request #3243: URL: https://github.com/apache/hudi/pull/3243#issuecomment-877088985 hi @yanghua please take a look when free. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Commented] (HUDI-2143) Tweak the default compaction target IO to 500GB when flink async compaction is off

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377988#comment-17377988 ] ASF GitHub Bot commented on HUDI-2143: -- danny0405 commented on a change in pull request #3238: URL:

[GitHub] [hudi] danny0405 commented on a change in pull request #3238: [HUDI-2143] Tweak the default compaction target IO to 500GB when flin…

2021-07-09 Thread GitBox
danny0405 commented on a change in pull request #3238: URL: https://github.com/apache/hudi/pull/3238#discussion_r666847718 ## File path: hudi-flink/src/main/java/org/apache/hudi/table/HoodieTableFactory.java ## @@ -199,6 +199,12 @@ private static void

[GitHub] [hudi] hudi-bot edited a comment on pull request #3248: [MINOR] Fix some wrong assert reasons

2021-07-09 Thread GitBox
hudi-bot edited a comment on pull request #3248: URL: https://github.com/apache/hudi/pull/3248#issuecomment-877033209 ## CI report: * 64ad40af7f34ebdc4f3fac3331fbad8523051591 Azure:

[jira] [Commented] (HUDI-1468) incremental read support with clustering

2021-07-09 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377966#comment-17377966 ] liwei commented on HUDI-1468: - [~vinoth] hello , is [https://github.com/apache/hudi/pull/3139/files] land it ,

[GitHub] [hudi] hudi-bot edited a comment on pull request #3248: [MINOR] Fix some wrong assert reasons

2021-07-09 Thread GitBox
hudi-bot edited a comment on pull request #3248: URL: https://github.com/apache/hudi/pull/3248#issuecomment-877033209 ## CI report: * 64ad40af7f34ebdc4f3fac3331fbad8523051591 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3248: [MINOR] Fix some wrong assert reasons

2021-07-09 Thread GitBox
hudi-bot commented on pull request #3248: URL: https://github.com/apache/hudi/pull/3248#issuecomment-877033209 ## CI report: * 64ad40af7f34ebdc4f3fac3331fbad8523051591 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[GitHub] [hudi] yanghua opened a new pull request #3248: [MINOR] Fix some wrong assert reasons

2021-07-09 Thread GitBox
yanghua opened a new pull request #3248: URL: https://github.com/apache/hudi/pull/3248 ## What is the purpose of the pull request *Fix some wrong assert reasons* ## Brief change log - *Fix some wrong assert reasons* ## Verify this pull request This

[jira] [Commented] (HUDI-2143) Tweak the default compaction target IO to 500GB when flink async compaction is off

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377947#comment-17377947 ] ASF GitHub Bot commented on HUDI-2143: -- yanghua commented on a change in pull request #3238: URL:

[GitHub] [hudi] yanghua commented on a change in pull request #3238: [HUDI-2143] Tweak the default compaction target IO to 500GB when flin…

2021-07-09 Thread GitBox
yanghua commented on a change in pull request #3238: URL: https://github.com/apache/hudi/pull/3238#discussion_r666787064 ## File path: hudi-flink/src/main/java/org/apache/hudi/table/HoodieTableFactory.java ## @@ -199,6 +199,12 @@ private static void

[jira] [Commented] (HUDI-2107) Support Read Log Only MOR Table For Spark

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377940#comment-17377940 ] ASF GitHub Bot commented on HUDI-2107: -- hudi-bot edited a comment on pull request #3193: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3193: [HUDI-2107] Support Read Log Only MOR Table For Spark

2021-07-09 Thread GitBox
hudi-bot edited a comment on pull request #3193: URL: https://github.com/apache/hudi/pull/3193#issuecomment-871363205 ## CI report: * 864dff7a0cc4389905067abee96046d5f72b004f UNKNOWN * f8bac2f4e7133eb3f9cbe4c15a20da49e30dd6eb UNKNOWN *

[jira] [Created] (HUDI-2154) Add index key field into HoodieKey

2021-07-09 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-2154: Summary: Add index key field into HoodieKey Key: HUDI-2154 URL: https://issues.apache.org/jira/browse/HUDI-2154 Project: Apache Hudi Issue Type: New Feature

[jira] [Commented] (HUDI-2143) Tweak the default compaction target IO to 500GB when flink async compaction is off

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377930#comment-17377930 ] ASF GitHub Bot commented on HUDI-2143: -- danny0405 commented on a change in pull request #3238: URL:

[GitHub] [hudi] danny0405 commented on a change in pull request #3238: [HUDI-2143] Tweak the default compaction target IO to 500GB when flin…

2021-07-09 Thread GitBox
danny0405 commented on a change in pull request #3238: URL: https://github.com/apache/hudi/pull/3238#discussion_r666775074 ## File path: hudi-flink/src/main/java/org/apache/hudi/table/HoodieTableFactory.java ## @@ -199,6 +199,12 @@ private static void

[jira] [Commented] (HUDI-2143) Tweak the default compaction target IO to 500GB when flink async compaction is off

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377926#comment-17377926 ] ASF GitHub Bot commented on HUDI-2143: -- yanghua commented on a change in pull request #3238: URL:

[GitHub] [hudi] yanghua commented on a change in pull request #3238: [HUDI-2143] Tweak the default compaction target IO to 500GB when flin…

2021-07-09 Thread GitBox
yanghua commented on a change in pull request #3238: URL: https://github.com/apache/hudi/pull/3238#discussion_r666768715 ## File path: hudi-flink/src/main/java/org/apache/hudi/table/HoodieTableFactory.java ## @@ -199,6 +199,12 @@ private static void

[jira] [Commented] (HUDI-2045) Support Read Hoodie As DataSource Table For Flink And DeltaStreamer

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377918#comment-17377918 ] ASF GitHub Bot commented on HUDI-2045: -- yanghua commented on pull request #3120: URL:

[GitHub] [hudi] yanghua commented on pull request #3120: [HUDI-2045] Support Read Hoodie As DataSource Table For Flink And DeltaStreamer

2021-07-09 Thread GitBox
yanghua commented on pull request #3120: URL: https://github.com/apache/hudi/pull/3120#issuecomment-877001823 > Hi @yanghua , I have write a util to convert the parquet schema to spark schema json without the spark dependencies. Please take a look again~ OK, sounds good. Will review

[jira] [Closed] (HUDI-2087) Support Append only in Flink stream

2021-07-09 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-2087. -- Fix Version/s: 0.9.0 Resolution: Done 371526789d663dee85041eb31c27c52c81ef87ef > Support Append only in

[jira] [Commented] (HUDI-2087) Support Append only in Flink stream

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377914#comment-17377914 ] ASF GitHub Bot commented on HUDI-2087: -- yanghua merged pull request #3174: URL:

[jira] [Commented] (HUDI-2087) Support Append only in Flink stream

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377913#comment-17377913 ] ASF GitHub Bot commented on HUDI-2087: -- yanghua commented on pull request #3174: URL:

[hudi] branch master updated: [HUDI-2087] Support Append only in Flink stream (#3174)

2021-07-09 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 3715267 [HUDI-2087] Support Append only in

[GitHub] [hudi] yanghua merged pull request #3174: [HUDI-2087] Support Append only in Flink stream

2021-07-09 Thread GitBox
yanghua merged pull request #3174: URL: https://github.com/apache/hudi/pull/3174 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] yanghua commented on pull request #3174: [HUDI-2087] Support Append only in Flink stream

2021-07-09 Thread GitBox
yanghua commented on pull request #3174: URL: https://github.com/apache/hudi/pull/3174#issuecomment-876999303 The failed test cases ran successfully in the contributor's local env. So merge it now. -- This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Commented] (HUDI-2087) Support Append only in Flink stream

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377911#comment-17377911 ] ASF GitHub Bot commented on HUDI-2087: -- yanghua commented on pull request #3174: URL:

[GitHub] [hudi] yanghua commented on pull request #3174: [HUDI-2087] Support Append only in Flink stream

2021-07-09 Thread GitBox
yanghua commented on pull request #3174: URL: https://github.com/apache/hudi/pull/3174#issuecomment-876998662 > This CI failed doesn't seem to be due to me, I can run these test case success in my local. > ![181625816106_

[jira] [Commented] (HUDI-2107) Support Read Log Only MOR Table For Spark

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377902#comment-17377902 ] ASF GitHub Bot commented on HUDI-2107: -- hudi-bot edited a comment on pull request #3193: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3193: [HUDI-2107] Support Read Log Only MOR Table For Spark

2021-07-09 Thread GitBox
hudi-bot edited a comment on pull request #3193: URL: https://github.com/apache/hudi/pull/3193#issuecomment-871363205 ## CI report: * 864dff7a0cc4389905067abee96046d5f72b004f UNKNOWN * f8bac2f4e7133eb3f9cbe4c15a20da49e30dd6eb UNKNOWN *

[jira] [Commented] (HUDI-2087) Support Append only in Flink stream

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377887#comment-17377887 ] ASF GitHub Bot commented on HUDI-2087: -- yuzhaojing commented on pull request #3174: URL:

[GitHub] [hudi] yuzhaojing commented on pull request #3174: [HUDI-2087] Support Append only in Flink stream

2021-07-09 Thread GitBox
yuzhaojing commented on pull request #3174: URL: https://github.com/apache/hudi/pull/3174#issuecomment-876982342 This CI failed doesn't seem to be due to me, I can run these test case success in my local. ![181625816106_

[jira] [Commented] (HUDI-2147) Remove unused class AvroConvertor in hudi-flink

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377883#comment-17377883 ] ASF GitHub Bot commented on HUDI-2147: -- codecov-commenter edited a comment on pull request #3243:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3243: [HUDI-2147] Remove unused class AvroConvertor in hudi-flink

2021-07-09 Thread GitBox
codecov-commenter edited a comment on pull request #3243: URL: https://github.com/apache/hudi/pull/3243#issuecomment-876425618 #

[jira] [Commented] (HUDI-2045) Support Read Hoodie As DataSource Table For Flink And DeltaStreamer

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377882#comment-17377882 ] ASF GitHub Bot commented on HUDI-2045: -- pengzhiwei2018 commented on pull request #3120: URL:

[GitHub] [hudi] pengzhiwei2018 commented on pull request #3120: [HUDI-2045] Support Read Hoodie As DataSource Table For Flink And DeltaStreamer

2021-07-09 Thread GitBox
pengzhiwei2018 commented on pull request #3120: URL: https://github.com/apache/hudi/pull/3120#issuecomment-876979104 Hi @yanghua , I have write a util to convert the parquet schema to spark schema json without the spark dependencies. Please take a look again~ -- This is an automated

[jira] [Commented] (HUDI-1425) Performance loss with the additional hoodieRecords.isEmpty() in HoodieSparkSqlWriter#write

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377881#comment-17377881 ] ASF GitHub Bot commented on HUDI-1425: -- pengzhiwei2018 commented on pull request #2296: URL:

[GitHub] [hudi] pengzhiwei2018 commented on pull request #2296: [HUDI-1425] Performance loss with the additional hoodieRecords.isEmpty() in HoodieSparkSqlWriter#write

2021-07-09 Thread GitBox
pengzhiwei2018 commented on pull request #2296: URL: https://github.com/apache/hudi/pull/2296#issuecomment-876977979 > if you are still interested in pursuing this. or happy to take over Yes, it is a long time for this PR. I will spend some time to review this issue again and solve

[jira] [Commented] (HUDI-2107) Support Read Log Only MOR Table For Spark

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377877#comment-17377877 ] ASF GitHub Bot commented on HUDI-2107: -- hudi-bot edited a comment on pull request #3193: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3193: [HUDI-2107] Support Read Log Only MOR Table For Spark

2021-07-09 Thread GitBox
hudi-bot edited a comment on pull request #3193: URL: https://github.com/apache/hudi/pull/3193#issuecomment-871363205 ## CI report: * 864dff7a0cc4389905067abee96046d5f72b004f UNKNOWN * f8bac2f4e7133eb3f9cbe4c15a20da49e30dd6eb UNKNOWN *

[jira] [Commented] (HUDI-2147) Remove unused class AvroConvertor in hudi-flink

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377875#comment-17377875 ] ASF GitHub Bot commented on HUDI-2147: -- codecov-commenter edited a comment on pull request #3243:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3243: [HUDI-2147] Remove unused class AvroConvertor in hudi-flink

2021-07-09 Thread GitBox
codecov-commenter edited a comment on pull request #3243: URL: https://github.com/apache/hudi/pull/3243#issuecomment-876425618 #

[jira] [Commented] (HUDI-1483) async clustering for deltastreamer

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377874#comment-17377874 ] ASF GitHub Bot commented on HUDI-1483: -- hudi-bot edited a comment on pull request #3142: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3142: [HUDI-1483] Support async clustering for deltastreamer and Spark streaming

2021-07-09 Thread GitBox
hudi-bot edited a comment on pull request #3142: URL: https://github.com/apache/hudi/pull/3142#issuecomment-866996072 ## CI report: * 890e9822855fcd45c8387f83740975f43474cddc Azure:

[jira] [Commented] (HUDI-2107) Support Read Log Only MOR Table For Spark

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377871#comment-17377871 ] ASF GitHub Bot commented on HUDI-2107: -- pengzhiwei2018 commented on a change in pull request #3193:

[jira] [Commented] (HUDI-2107) Support Read Log Only MOR Table For Spark

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377872#comment-17377872 ] ASF GitHub Bot commented on HUDI-2107: -- pengzhiwei2018 commented on a change in pull request #3193:

[GitHub] [hudi] pengzhiwei2018 commented on a change in pull request #3193: [HUDI-2107] Support Read Log Only MOR Table For Spark

2021-07-09 Thread GitBox
pengzhiwei2018 commented on a change in pull request #3193: URL: https://github.com/apache/hudi/pull/3193#discussion_r666725674 ## File path: hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/TestMergeIntoTable2.scala ## @@ -0,0 +1,91 @@ +/* + *

[GitHub] [hudi] pengzhiwei2018 commented on a change in pull request #3193: [HUDI-2107] Support Read Log Only MOR Table For Spark

2021-07-09 Thread GitBox
pengzhiwei2018 commented on a change in pull request #3193: URL: https://github.com/apache/hudi/pull/3193#discussion_r666725447 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/MergeOnReadSnapshotRelation.scala ## @@ -137,11 +136,14 @@ class

[jira] [Commented] (HUDI-1483) async clustering for deltastreamer

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377870#comment-17377870 ] ASF GitHub Bot commented on HUDI-1483: -- codecov-commenter edited a comment on pull request #3142:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3142: [HUDI-1483] Support async clustering for deltastreamer and Spark streaming

2021-07-09 Thread GitBox
codecov-commenter edited a comment on pull request #3142: URL: https://github.com/apache/hudi/pull/3142#issuecomment-867078369 #

[jira] [Commented] (HUDI-2107) Support Read Log Only MOR Table For Spark

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377868#comment-17377868 ] ASF GitHub Bot commented on HUDI-2107: -- pengzhiwei2018 commented on a change in pull request #3193:

[GitHub] [hudi] pengzhiwei2018 commented on a change in pull request #3193: [HUDI-2107] Support Read Log Only MOR Table For Spark

2021-07-09 Thread GitBox
pengzhiwei2018 commented on a change in pull request #3193: URL: https://github.com/apache/hudi/pull/3193#discussion_r666723325 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java ## @@ -161,28 +162,18 @@

[jira] [Commented] (HUDI-2045) Support Read Hoodie As DataSource Table For Flink And DeltaStreamer

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377865#comment-17377865 ] ASF GitHub Bot commented on HUDI-2045: -- codecov-commenter edited a comment on pull request #3120:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3120: [HUDI-2045] Support Read Hoodie As DataSource Table For Flink And DeltaStreamer

2021-07-09 Thread GitBox
codecov-commenter edited a comment on pull request #3120: URL: https://github.com/apache/hudi/pull/3120#issuecomment-864770805 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Commented] (HUDI-1483) async clustering for deltastreamer

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377859#comment-17377859 ] ASF GitHub Bot commented on HUDI-1483: -- codecov-commenter edited a comment on pull request #3142:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3142: [HUDI-1483] Support async clustering for deltastreamer and Spark streaming

2021-07-09 Thread GitBox
codecov-commenter edited a comment on pull request #3142: URL: https://github.com/apache/hudi/pull/3142#issuecomment-867078369 #

[jira] [Commented] (HUDI-2147) Remove unused class AvroConvertor in hudi-flink

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377855#comment-17377855 ] ASF GitHub Bot commented on HUDI-2147: -- codecov-commenter edited a comment on pull request #3243:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3243: [HUDI-2147] Remove unused class AvroConvertor in hudi-flink

2021-07-09 Thread GitBox
codecov-commenter edited a comment on pull request #3243: URL: https://github.com/apache/hudi/pull/3243#issuecomment-876425618 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3120: [HUDI-2045] Support Read Hoodie As DataSource Table For Flink And DeltaStreamer

2021-07-09 Thread GitBox
codecov-commenter edited a comment on pull request #3120: URL: https://github.com/apache/hudi/pull/3120#issuecomment-864770805 #

[jira] [Commented] (HUDI-2045) Support Read Hoodie As DataSource Table For Flink And DeltaStreamer

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377851#comment-17377851 ] ASF GitHub Bot commented on HUDI-2045: -- codecov-commenter edited a comment on pull request #3120:

[jira] [Commented] (HUDI-2045) Support Read Hoodie As DataSource Table For Flink And DeltaStreamer

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377849#comment-17377849 ] ASF GitHub Bot commented on HUDI-2045: -- hudi-bot edited a comment on pull request #3120: URL:

[jira] [Commented] (HUDI-2107) Support Read Log Only MOR Table For Spark

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377850#comment-17377850 ] ASF GitHub Bot commented on HUDI-2107: -- garyli1019 commented on a change in pull request #3193: URL:

[GitHub] [hudi] garyli1019 commented on a change in pull request #3193: [HUDI-2107] Support Read Log Only MOR Table For Spark

2021-07-09 Thread GitBox
garyli1019 commented on a change in pull request #3193: URL: https://github.com/apache/hudi/pull/3193#discussion_r666700208 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/MergeOnReadSnapshotRelation.scala ## @@ -137,11 +136,14 @@ class

[GitHub] [hudi] hudi-bot edited a comment on pull request #3120: [HUDI-2045] Support Read Hoodie As DataSource Table For Flink And DeltaStreamer

2021-07-09 Thread GitBox
hudi-bot edited a comment on pull request #3120: URL: https://github.com/apache/hudi/pull/3120#issuecomment-864760893 ## CI report: * aaca30fffd1ea37f803f51ef3cf49c59ed79badc UNKNOWN * fcd06c8bccfc90b272b51d3511094e6617ec25bd UNKNOWN *

[jira] [Commented] (HUDI-1483) async clustering for deltastreamer

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377846#comment-17377846 ] ASF GitHub Bot commented on HUDI-1483: -- hudi-bot edited a comment on pull request #3142: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3142: [HUDI-1483] Support async clustering for deltastreamer and Spark streaming

2021-07-09 Thread GitBox
hudi-bot edited a comment on pull request #3142: URL: https://github.com/apache/hudi/pull/3142#issuecomment-866996072 ## CI report: * cea6548b53a242e93e861401564a5bb55d317f24 Azure:

[jira] [Commented] (HUDI-2045) Support Read Hoodie As DataSource Table For Flink And DeltaStreamer

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377838#comment-17377838 ] ASF GitHub Bot commented on HUDI-2045: -- codecov-commenter edited a comment on pull request #3120:

[jira] [Commented] (HUDI-1483) async clustering for deltastreamer

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377839#comment-17377839 ] ASF GitHub Bot commented on HUDI-1483: -- codope commented on pull request #3142: URL:

[GitHub] [hudi] codope commented on pull request #3142: [HUDI-1483] Support async clustering for deltastreamer and Spark streaming

2021-07-09 Thread GitBox
codope commented on pull request #3142: URL: https://github.com/apache/hudi/pull/3142#issuecomment-876943613 > Tests coverage: > > * Do we have tests where both compaction and clustering are async triggered? (both spark streaming and deltastreamer) ? Added such test in

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3120: [HUDI-2045] Support Read Hoodie As DataSource Table For Flink And DeltaStreamer

2021-07-09 Thread GitBox
codecov-commenter edited a comment on pull request #3120: URL: https://github.com/apache/hudi/pull/3120#issuecomment-864770805 #

[jira] [Commented] (HUDI-1077) Integration tests to validate clustering

2021-07-09 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377836#comment-17377836 ] Sagar Sumit commented on HUDI-1077: --- [~satishkotha] i'm workin on this. If you've already added some

[jira] [Commented] (HUDI-1077) Integration tests to validate clustering

2021-07-09 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377834#comment-17377834 ] Sagar Sumit commented on HUDI-1077: --- Try to simulate resource unavailability:

[jira] [Commented] (HUDI-1483) async clustering for deltastreamer

2021-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377833#comment-17377833 ] ASF GitHub Bot commented on HUDI-1483: -- codope commented on a change in pull request #3142: URL:

<    1   2   3