[jira] [Commented] (HUDI-2187) Hive integration Improvment

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384136#comment-17384136 ] ASF GitHub Bot commented on HUDI-2187: -- codecov-commenter edited a comment on pull request #3289:

[GitHub] [hudi] Samrat002 commented on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer

2021-07-20 Thread GitBox
Samrat002 commented on pull request #3184: URL: https://github.com/apache/hudi/pull/3184#issuecomment-882560612 > Hey, can you confirm you rebased it w/ upstream master correctly? I see lot of commit msgs while trying to squash and merge? @nsivabalan rebased it correctly there are

[GitHub] [hudi] hudi-bot commented on pull request #3307: [MINOR] Refactor hive realtime config to extend from HoodieConfig

2021-07-20 Thread GitBox
hudi-bot commented on pull request #3307: URL: https://github.com/apache/hudi/pull/3307#issuecomment-883153186 ## CI report: * 62db485137dda69754846ec82e99290513d00c0b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3289: [HUDI-2187] Add a shim layer to support multiple hive version

2021-07-20 Thread GitBox
codecov-commenter edited a comment on pull request #3289: URL: https://github.com/apache/hudi/pull/3289#issuecomment-881904382 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Commented] (HUDI-648) Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384134#comment-17384134 ] ASF GitHub Bot commented on HUDI-648: - lw309637554 commented on pull request #2710: URL:

[GitHub] [hudi] lw309637554 commented on pull request #2710: [HUDI-648][RFC-20] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

2021-07-20 Thread GitBox
lw309637554 commented on pull request #2710: URL: https://github.com/apache/hudi/pull/2710#issuecomment-883195678 @liujinhui1994 hello , does it ready to review? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hudi] nsivabalan commented on a change in pull request #3247: [HUDI-2161] Adding support to disable meta columns with bulk insert operation

2021-07-20 Thread GitBox
nsivabalan commented on a change in pull request #3247: URL: https://github.com/apache/hudi/pull/3247#discussion_r671900060 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala ## @@ -128,14 +128,35 @@ object

[jira] [Commented] (HUDI-2161) Add support to disable meta column to BulkInsert Row Writer path

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384131#comment-17384131 ] ASF GitHub Bot commented on HUDI-2161: -- codecov-commenter edited a comment on pull request #3247:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3247: [HUDI-2161] Adding support to disable meta columns with bulk insert operation

2021-07-20 Thread GitBox
codecov-commenter edited a comment on pull request #3247: URL: https://github.com/apache/hudi/pull/3247#issuecomment-881816086 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Commented] (HUDI-2161) Add support to disable meta column to BulkInsert Row Writer path

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384132#comment-17384132 ] ASF GitHub Bot commented on HUDI-2161: -- nsivabalan commented on a change in pull request #3247: URL:

[jira] [Commented] (HUDI-2176) Virutal keys support for COW all operations

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384130#comment-17384130 ] ASF GitHub Bot commented on HUDI-2176: -- nsivabalan closed pull request #3282: URL:

[GitHub] [hudi] nsivabalan closed pull request #3282: [HUDI-2176, 2178, 2179] Virtual keys support to COW table

2021-07-20 Thread GitBox
nsivabalan closed pull request #3282: URL: https://github.com/apache/hudi/pull/3282 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (HUDI-1241) Generate config docs automatically

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384126#comment-17384126 ] ASF GitHub Bot commented on HUDI-1241: -- hudi-bot edited a comment on pull request #3302: URL:

[jira] [Commented] (HUDI-1241) Generate config docs automatically

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384129#comment-17384129 ] ASF GitHub Bot commented on HUDI-1241: -- codecov-commenter edited a comment on pull request #3302:

[jira] [Commented] (HUDI-648) Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384128#comment-17384128 ] ASF GitHub Bot commented on HUDI-648: - liujinhui1994 closed pull request #3308: URL:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3302: [HUDI-1241] Automate the generation of configs webpage as configs are added to Hudi repo

2021-07-20 Thread GitBox
codecov-commenter edited a comment on pull request #3302: URL: https://github.com/apache/hudi/pull/3302#issuecomment-882944311 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Commented] (HUDI-2194) Skip the latest N partitions when creating ClusteringPlan

2021-07-20 Thread ASF GitHub Bot (Jira)
> ClusteringPlan. > For example, we have 6 partitions based on date, and users set  > `hoodie.clustering.plan.strategy.daybased.lookback.partitions` 2 > |20210718|20210719 |20210720 |20210721 |20210722 |20210723(latest)| >                                                          

[GitHub] [hudi] liujinhui1994 closed pull request #3308: [HUDI-648][RFC-20] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

2021-07-20 Thread GitBox
liujinhui1994 closed pull request #3308: URL: https://github.com/apache/hudi/pull/3308 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3302: [HUDI-1241] Automate the generation of configs webpage as configs are added to Hudi repo

2021-07-20 Thread GitBox
hudi-bot edited a comment on pull request #3302: URL: https://github.com/apache/hudi/pull/3302#issuecomment-882806783 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3300: [HUDI-2194] Skip the latest N partitions when choosing partitions to create ClusteringPlan

2021-07-20 Thread GitBox
codecov-commenter edited a comment on pull request #3300: URL: https://github.com/apache/hudi/pull/3300#issuecomment-882457453 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] vinothchandar merged pull request #3305: [MINOR] Adding more talk links and articles to site

2021-07-20 Thread GitBox
vinothchandar merged pull request #3305: URL: https://github.com/apache/hudi/pull/3305 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (HUDI-2192) Clean up Multiple versions of scala libraries detected Warning

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384124#comment-17384124 ] ASF GitHub Bot commented on HUDI-2192: -- nsivabalan commented on pull request #3292: URL:

[GitHub] [hudi] nsivabalan commented on pull request #3292: [HUDI-2192] Clean up Multiple versions of scala libraries detected Wa…

2021-07-20 Thread GitBox
nsivabalan commented on pull request #3292: URL: https://github.com/apache/hudi/pull/3292#issuecomment-883061895 LGTM. will let vinoth merge it in once he is ok. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Commented] (HUDI-2184) Support setting hive sync partition extractor class based on flink configuration

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384122#comment-17384122 ] ASF GitHub Bot commented on HUDI-2184: -- danny0405 commented on pull request #3284: URL:

[GitHub] [hudi] danny0405 commented on pull request #3284: [HUDI-2184] Support setting hive sync partition extractor class based on flink co…

2021-07-20 Thread GitBox
danny0405 commented on pull request #3284: URL: https://github.com/apache/hudi/pull/3284#issuecomment-883251708 Please add the test cases. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Commented] (HUDI-1771) Propagate CDC format for hoodie

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384120#comment-17384120 ] ASF GitHub Bot commented on HUDI-1771: -- swuferhong opened a new pull request #3285: URL:

[jira] [Commented] (HUDI-648) Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384119#comment-17384119 ] ASF GitHub Bot commented on HUDI-648: - liujinhui1994 closed pull request #2710: URL:

[jira] [Commented] (HUDI-2161) Add support to disable meta column to BulkInsert Row Writer path

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384118#comment-17384118 ] ASF GitHub Bot commented on HUDI-2161: -- nsivabalan merged pull request #3247: URL:

[GitHub] [hudi] liujinhui1994 closed pull request #2710: [HUDI-648][RFC-20] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

2021-07-20 Thread GitBox
liujinhui1994 closed pull request #2710: URL: https://github.com/apache/hudi/pull/2710 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] nsivabalan merged pull request #3247: [HUDI-2161] Adding support to disable meta columns with bulk insert operation

2021-07-20 Thread GitBox
nsivabalan merged pull request #3247: URL: https://github.com/apache/hudi/pull/3247 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (HUDI-2198) Clean and reset the bootstrap events for coordinator when task failover

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384116#comment-17384116 ] ASF GitHub Bot commented on HUDI-2198: -- hudi-bot commented on pull request #3304: URL:

[GitHub] [hudi] hudi-bot commented on pull request #3304: [HUDI-2198] Clean and reset the bootstrap events for coordinator when…

2021-07-20 Thread GitBox
hudi-bot commented on pull request #3304: URL: https://github.com/apache/hudi/pull/3304#issuecomment-883010382 ## CI report: * f61a73a0eb4d41a49bc17b461d5b9826715e9c28 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[jira] [Commented] (HUDI-2176) Virutal keys support for COW all operations

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384112#comment-17384112 ] ASF GitHub Bot commented on HUDI-2176: -- nsivabalan commented on pull request #3306: URL:

[GitHub] [hudi] nsivabalan commented on pull request #3306: [HUDI-2176, 2178, 2179] Adding virtual key support to COW table

2021-07-20 Thread GitBox
nsivabalan commented on pull request #3306: URL: https://github.com/apache/hudi/pull/3306#issuecomment-883059029 @vinothchandar : you are good to review this patch. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Commented] (HUDI-2176) Virutal keys support for COW all operations

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384109#comment-17384109 ] ASF GitHub Bot commented on HUDI-2176: -- codecov-commenter edited a comment on pull request #3306:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3306: [HUDI-2176, 2178, 2179] Adding virtual key support to COW table

2021-07-20 Thread GitBox
codecov-commenter edited a comment on pull request #3306: URL: https://github.com/apache/hudi/pull/3306#issuecomment-883054849 #

[jira] [Commented] (HUDI-2198) Clean and reset the bootstrap events for coordinator when task failover

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384107#comment-17384107 ] ASF GitHub Bot commented on HUDI-2198: -- codecov-commenter edited a comment on pull request #3304:

[jira] [Commented] (HUDI-2198) Clean and reset the bootstrap events for coordinator when task failover

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384106#comment-17384106 ] ASF GitHub Bot commented on HUDI-2198: -- danny0405 commented on a change in pull request #3304: URL:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3304: [HUDI-2198] Clean and reset the bootstrap events for coordinator when…

2021-07-20 Thread GitBox
codecov-commenter edited a comment on pull request #3304: URL: https://github.com/apache/hudi/pull/3304#issuecomment-883027246 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Commented] (HUDI-1241) Generate config docs automatically

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384105#comment-17384105 ] ASF GitHub Bot commented on HUDI-1241: -- rmahindra123 opened a new pull request #3303: URL:

[jira] [Commented] (HUDI-2192) Clean up Multiple versions of scala libraries detected Warning

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384104#comment-17384104 ] ASF GitHub Bot commented on HUDI-2192: -- veenaypatil commented on pull request #3292: URL:

[GitHub] [hudi] veenaypatil commented on pull request #3292: [HUDI-2192] Clean up Multiple versions of scala libraries detected Wa…

2021-07-20 Thread GitBox
veenaypatil commented on pull request #3292: URL: https://github.com/apache/hudi/pull/3292#issuecomment-883047014 @vinothchandar yes, and also in warnings it tells us to use specific scala versions for dependencies. This post https://groups.google.com/g/maven-and-scala/c/XSkXrSS8WuU

[GitHub] [hudi] danny0405 commented on a change in pull request #3304: [HUDI-2198] Clean and reset the bootstrap events for coordinator when…

2021-07-20 Thread GitBox
danny0405 commented on a change in pull request #3304: URL: https://github.com/apache/hudi/pull/3304#discussion_r672946328 ## File path: hudi-flink/src/main/java/org/apache/hudi/sink/StreamWriteFunction.java ## @@ -534,6 +544,12 @@ private void bufferRecord(HoodieRecord

[jira] [Commented] (HUDI-2187) Hive integration Improvment

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384103#comment-17384103 ] ASF GitHub Bot commented on HUDI-2187: -- hudi-bot edited a comment on pull request #3289: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3289: [HUDI-2187] Add a shim layer to support multiple hive version

2021-07-20 Thread GitBox
hudi-bot edited a comment on pull request #3289: URL: https://github.com/apache/hudi/pull/3289#issuecomment-881900670 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[jira] [Commented] (HUDI-648) Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384101#comment-17384101 ] ASF GitHub Bot commented on HUDI-648: - liujinhui1994 opened a new pull request #3308: URL:

[jira] [Commented] (HUDI-2182) Support Compaction Command For Spark Sql

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384097#comment-17384097 ] ASF GitHub Bot commented on HUDI-2182: -- hudi-bot edited a comment on pull request #3277: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3277: [HUDI-2182] Support Compaction Command For Spark Sql

2021-07-20 Thread GitBox
hudi-bot edited a comment on pull request #3277: URL: https://github.com/apache/hudi/pull/3277#issuecomment-880506300 ## CI report: * 3fef566a29eb76667c530519e02785ebb13cb28c Azure:

[jira] [Commented] (HUDI-2182) Support Compaction Command For Spark Sql

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384096#comment-17384096 ] ASF GitHub Bot commented on HUDI-2182: -- hudi-bot edited a comment on pull request #3277: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3277: [HUDI-2182] Support Compaction Command For Spark Sql

2021-07-20 Thread GitBox
hudi-bot edited a comment on pull request #3277: URL: https://github.com/apache/hudi/pull/3277#issuecomment-880506300 ## CI report: * 3fef566a29eb76667c530519e02785ebb13cb28c Azure:

[jira] [Commented] (HUDI-2198) Clean and reset the bootstrap events for coordinator when task failover

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384093#comment-17384093 ] ASF GitHub Bot commented on HUDI-2198: -- codecov-commenter edited a comment on pull request #3304:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3304: [HUDI-2198] Clean and reset the bootstrap events for coordinator when…

2021-07-20 Thread GitBox
codecov-commenter edited a comment on pull request #3304: URL: https://github.com/apache/hudi/pull/3304#issuecomment-883027246 #

[jira] [Commented] (HUDI-648) Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384091#comment-17384091 ] ASF GitHub Bot commented on HUDI-648: - hudi-bot commented on pull request #3312: URL:

[jira] [Commented] (HUDI-2184) Support setting hive sync partition extractor class based on flink configuration

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384090#comment-17384090 ] ASF GitHub Bot commented on HUDI-2184: -- hudi-bot edited a comment on pull request #3284: URL:

[GitHub] [hudi] hudi-bot commented on pull request #3312: [HUDI-648][RFC-20] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

2021-07-20 Thread GitBox
hudi-bot commented on pull request #3312: URL: https://github.com/apache/hudi/pull/3312#issuecomment-883316285 ## CI report: * 58a46294a5ae693281d543a86af4785e09decd8f UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[GitHub] [hudi] hudi-bot edited a comment on pull request #3284: [HUDI-2184] Support setting hive sync partition extractor class based on flink co…

2021-07-20 Thread GitBox
hudi-bot edited a comment on pull request #3284: URL: https://github.com/apache/hudi/pull/3284#issuecomment-881121030 ## CI report: * 7b2c4d80e892b1b33293c6f7a951485c0199a710 Azure:

[jira] [Commented] (HUDI-648) Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384088#comment-17384088 ] ASF GitHub Bot commented on HUDI-648: - liujinhui1994 opened a new pull request #3312: URL:

[GitHub] [hudi] liujinhui1994 opened a new pull request #3312: [HUDI-648][RFC-20] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

2021-07-20 Thread GitBox
liujinhui1994 opened a new pull request #3312: URL: https://github.com/apache/hudi/pull/3312 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of

[jira] [Commented] (HUDI-2164) Build cluster plan and execute this plan at once for HoodieClusteringJob

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384087#comment-17384087 ] ASF GitHub Bot commented on HUDI-2164: -- codecov-commenter edited a comment on pull request #3259:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3259: [HUDI-2164] Let users build cluster plan and execute this plan at once using HoodieClusteringJob for async clustering

2021-07-20 Thread GitBox
codecov-commenter edited a comment on pull request #3259: URL: https://github.com/apache/hudi/pull/3259#issuecomment-878091821 #

[jira] [Commented] (HUDI-2139) MergeInto MOR Table May Result InCorrect Result

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384086#comment-17384086 ] ASF GitHub Bot commented on HUDI-2139: -- hudi-bot edited a comment on pull request #3230: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3230: [HUDI-2139] MergeInto MOR Table May Result InCorrect Result

2021-07-20 Thread GitBox
hudi-bot edited a comment on pull request #3230: URL: https://github.com/apache/hudi/pull/3230#issuecomment-874605269 ## CI report: * 2568538186a80a3cea8470e01cafb654a825c75a UNKNOWN * b40560674be9aafd086e569e891db6d7c26eb78a Azure:

[jira] [Commented] (HUDI-2139) MergeInto MOR Table May Result InCorrect Result

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384085#comment-17384085 ] ASF GitHub Bot commented on HUDI-2139: -- pengzhiwei2018 commented on a change in pull request #3230:

[GitHub] [hudi] pengzhiwei2018 commented on a change in pull request #3230: [HUDI-2139] MergeInto MOR Table May Result InCorrect Result

2021-07-20 Thread GitBox
pengzhiwei2018 commented on a change in pull request #3230: URL: https://github.com/apache/hudi/pull/3230#discussion_r673022844 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieAppendHandle.java ## @@ -189,8 +191,14 @@ protected boolean

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384084#comment-17384084 ] ASF GitHub Bot commented on HUDI-1138: -- codecov-commenter edited a comment on pull request #3233:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3233: [WIP][HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-07-20 Thread GitBox
codecov-commenter edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-883297547 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3307: [MINOR] Refactor hive realtime config to extend from HoodieConfig

2021-07-20 Thread GitBox
hudi-bot edited a comment on pull request #3307: URL: https://github.com/apache/hudi/pull/3307#issuecomment-883153186 ## CI report: * a7c7c75f8348b4283ad8495e37e423530529a921 Azure:

[jira] [Commented] (HUDI-2164) Build cluster plan and execute this plan at once for HoodieClusteringJob

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384077#comment-17384077 ] ASF GitHub Bot commented on HUDI-2164: -- codecov-commenter edited a comment on pull request #3259:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3259: [HUDI-2164] Let users build cluster plan and execute this plan at once using HoodieClusteringJob for async clustering

2021-07-20 Thread GitBox
codecov-commenter edited a comment on pull request #3259: URL: https://github.com/apache/hudi/pull/3259#issuecomment-878091821 #

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384067#comment-17384067 ] ASF GitHub Bot commented on HUDI-1138: -- codecov-commenter commented on pull request #3233: URL:

[GitHub] [hudi] codecov-commenter commented on pull request #3233: [WIP][HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-07-20 Thread GitBox
codecov-commenter commented on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-883297547 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3233?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation)

[jira] [Commented] (HUDI-1518) Remove replaced files logic from archival

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384062#comment-17384062 ] ASF GitHub Bot commented on HUDI-1518: -- hudi-bot edited a comment on pull request #3310: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3310: [HUDI-1518] Remove the logic that delete replaced file when archive

2021-07-20 Thread GitBox
hudi-bot edited a comment on pull request #3310: URL: https://github.com/apache/hudi/pull/3310#issuecomment-883213429 ## CI report: * ac0eebe5101880e06b9cf3146bdab3c5d3ce32dc Azure:

[jira] [Commented] (HUDI-2184) Support setting hive sync partition extractor class based on flink configuration

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384059#comment-17384059 ] ASF GitHub Bot commented on HUDI-2184: -- hudi-bot edited a comment on pull request #3284: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3284: [HUDI-2184] Support setting hive sync partition extractor class based on flink co…

2021-07-20 Thread GitBox
hudi-bot edited a comment on pull request #3284: URL: https://github.com/apache/hudi/pull/3284#issuecomment-881121030 ## CI report: * 7b2c4d80e892b1b33293c6f7a951485c0199a710 Azure:

[jira] [Commented] (HUDI-2164) Build cluster plan and execute this plan at once for HoodieClusteringJob

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384057#comment-17384057 ] ASF GitHub Bot commented on HUDI-2164: -- codecov-commenter edited a comment on pull request #3259:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3259: [HUDI-2164] Let users build cluster plan and execute this plan at once using HoodieClusteringJob for async clustering

2021-07-20 Thread GitBox
codecov-commenter edited a comment on pull request #3259: URL: https://github.com/apache/hudi/pull/3259#issuecomment-878091821 #

[jira] [Commented] (HUDI-2184) Support setting hive sync partition extractor class based on flink configuration

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384053#comment-17384053 ] ASF GitHub Bot commented on HUDI-2184: -- hudi-bot edited a comment on pull request #3284: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3284: [HUDI-2184] Support setting hive sync partition extractor class based on flink co…

2021-07-20 Thread GitBox
hudi-bot edited a comment on pull request #3284: URL: https://github.com/apache/hudi/pull/3284#issuecomment-881121030 ## CI report: * 7b2c4d80e892b1b33293c6f7a951485c0199a710 Azure:

[jira] [Commented] (HUDI-2184) Support setting hive sync partition extractor class based on flink configuration

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384051#comment-17384051 ] ASF GitHub Bot commented on HUDI-2184: -- hudi-bot edited a comment on pull request #3284: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3284: [HUDI-2184] Support setting hive sync partition extractor class based on flink co…

2021-07-20 Thread GitBox
hudi-bot edited a comment on pull request #3284: URL: https://github.com/apache/hudi/pull/3284#issuecomment-881121030 ## CI report: * 66d9b957a7ecf646b90f5175c8e36d555c227d0e Azure:

[jira] [Commented] (HUDI-2184) Support setting hive sync partition extractor class based on flink configuration

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384050#comment-17384050 ] ASF GitHub Bot commented on HUDI-2184: -- hudi-bot edited a comment on pull request #3284: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3284: [HUDI-2184] Support setting hive sync partition extractor class based on flink co…

2021-07-20 Thread GitBox
hudi-bot edited a comment on pull request #3284: URL: https://github.com/apache/hudi/pull/3284#issuecomment-881121030 ## CI report: * 66d9b957a7ecf646b90f5175c8e36d555c227d0e Azure:

[jira] [Commented] (HUDI-2198) Clean and reset the bootstrap events for coordinator when task failover

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384047#comment-17384047 ] ASF GitHub Bot commented on HUDI-2198: -- hudi-bot edited a comment on pull request #3304: URL:

[GitHub] [hudi] danny0405 commented on pull request #3284: [HUDI-2184] Support setting hive sync partition extractor class based on flink co…

2021-07-20 Thread GitBox
danny0405 commented on pull request #3284: URL: https://github.com/apache/hudi/pull/3284#issuecomment-883251708 Please add the test cases. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] hudi-bot edited a comment on pull request #3304: [HUDI-2198] Clean and reset the bootstrap events for coordinator when…

2021-07-20 Thread GitBox
hudi-bot edited a comment on pull request #3304: URL: https://github.com/apache/hudi/pull/3304#issuecomment-883010382 ## CI report: * 8ad5cabe8c843c0baaa14751446f4cdfa349e058 Azure:

[jira] [Commented] (HUDI-2184) Support setting hive sync partition extractor class based on flink configuration

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384048#comment-17384048 ] ASF GitHub Bot commented on HUDI-2184: -- danny0405 commented on pull request #3284: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3310: [HUDI-1518] Remove the logic that delete replaced file when archive

2021-07-20 Thread GitBox
hudi-bot edited a comment on pull request #3310: URL: https://github.com/apache/hudi/pull/3310#issuecomment-883213429 ## CI report: * ac0eebe5101880e06b9cf3146bdab3c5d3ce32dc Azure:

[GitHub] [hudi] danny0405 merged pull request #3258: [HUDI-2145] Create new bucket when NewFileAssignState filled

2021-07-20 Thread GitBox
danny0405 merged pull request #3258: URL: https://github.com/apache/hudi/pull/3258 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3307: [MINOR] Refactor hive realtime config to extend from HoodieConfig

2021-07-20 Thread GitBox
hudi-bot edited a comment on pull request #3307: URL: https://github.com/apache/hudi/pull/3307#issuecomment-883153186 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[jira] [Commented] (HUDI-1518) Remove replaced files logic from archival

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384046#comment-17384046 ] ASF GitHub Bot commented on HUDI-1518: -- hudi-bot edited a comment on pull request #3310: URL:

[jira] [Commented] (HUDI-2145) Create new bucket when NewFileAssignState filled

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384045#comment-17384045 ] ASF GitHub Bot commented on HUDI-2145: -- danny0405 merged pull request #3258: URL:

[jira] [Commented] (HUDI-2191) Bump flink version to 1.13.1

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384044#comment-17384044 ] ASF GitHub Bot commented on HUDI-2191: -- danny0405 edited a comment on pull request #3291: URL:

[jira] [Commented] (HUDI-2182) Support Compaction Command For Spark Sql

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384042#comment-17384042 ] ASF GitHub Bot commented on HUDI-2182: -- hudi-bot edited a comment on pull request #3277: URL:

[GitHub] [hudi] danny0405 edited a comment on pull request #3291: [HUDI-2191] Bump flink version to 1.13.1

2021-07-20 Thread GitBox
danny0405 edited a comment on pull request #3291: URL: https://github.com/apache/hudi/pull/3291#issuecomment-882214196 The Amazon AWS EMR and Aliyun EMR next version all need this patch for the flink hudi integration. -- This is an automated message from the Apache Git Service. To

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384038#comment-17384038 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #3233: URL:

[GitHub] [hudi] danny0405 commented on a change in pull request #3285: [HUDI-1771] Propagate CDC format for hoodie

2021-07-20 Thread GitBox
danny0405 commented on a change in pull request #3285: URL: https://github.com/apache/hudi/pull/3285#discussion_r672172626 ## File path: hudi-flink/src/main/java/org/apache/hudi/table/format/mor/MergeOnReadInputFormat.java ## @@ -624,6 +634,14 @@ public boolean reachedEnd()

[jira] [Commented] (HUDI-1518) Remove replaced files logic from archival

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384037#comment-17384037 ] ASF GitHub Bot commented on HUDI-1518: -- hudi-bot commented on pull request #3310: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3277: [HUDI-2182] Support Compaction Command For Spark Sql

2021-07-20 Thread GitBox
hudi-bot edited a comment on pull request #3277: URL: https://github.com/apache/hudi/pull/3277#issuecomment-880506300 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[jira] [Commented] (HUDI-1771) Propagate CDC format for hoodie

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384039#comment-17384039 ] ASF GitHub Bot commented on HUDI-1771: -- danny0405 commented on a change in pull request #3285: URL:

<    1   2   3   4   5   6   7   >