[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #3808: [HUDI-2560] introduce id_based schema to support full schema evolution.

2021-11-09 Thread GitBox
xiarixiaoyao commented on a change in pull request #3808: URL: https://github.com/apache/hudi/pull/3808#discussion_r746325758 ## File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/utils/AvroSchemaUtil.java ## @@ -0,0 +1,276 @@ +/* + * Licensed to the Apache S

[GitHub] [hudi] hudi-bot commented on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964871330 ## CI report: * 5c71686aff049029f1080a624a7e235445635e30 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964845144 ## CI report: * 5c71686aff049029f1080a624a7e235445635e30 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[jira] [Assigned] (HUDI-2730) Move EventTimeAvroPayload into hudi-common module

2021-11-09 Thread yuzhaojing (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuzhaojing reassigned HUDI-2730: Assignee: yuzhaojing > Move EventTimeAvroPayload into hudi-common module >

[jira] [Created] (HUDI-2730) Move EventTimeAvroPayload into hudi-common module

2021-11-09 Thread Danny Chen (Jira)
Danny Chen created HUDI-2730: Summary: Move EventTimeAvroPayload into hudi-common module Key: HUDI-2730 URL: https://issues.apache.org/jira/browse/HUDI-2730 Project: Apache Hudi Issue Type: Task

[GitHub] [hudi] hudi-bot commented on pull request #3888: [HUDI-2624] Implement Non Index type for HUDI

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3888: URL: https://github.com/apache/hudi/pull/3888#issuecomment-964865467 ## CI report: * f20758076b7fd9355a6b3075fc03d93982b80cc9 UNKNOWN * 4efd2f4b2a47c7417aa6dc84ef40162637448fdf UNKNOWN * 73094907e1ed6ea6083736582a10f9f7910a5562 Azure

[GitHub] [hudi] hudi-bot removed a comment on pull request #3888: [HUDI-2624] Implement Non Index type for HUDI

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3888: URL: https://github.com/apache/hudi/pull/3888#issuecomment-964863983 ## CI report: * f20758076b7fd9355a6b3075fc03d93982b80cc9 UNKNOWN * 4efd2f4b2a47c7417aa6dc84ef40162637448fdf UNKNOWN * 73094907e1ed6ea6083736582a10f9f7910a55

[GitHub] [hudi] yuzhaojing commented on pull request #3888: [HUDI-2624] Implement Non Index type for HUDI

2021-11-09 Thread GitBox
yuzhaojing commented on pull request #3888: URL: https://github.com/apache/hudi/pull/3888#issuecomment-964864484 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] hudi-bot removed a comment on pull request #3888: [HUDI-2624] Implement Non Index type for HUDI

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3888: URL: https://github.com/apache/hudi/pull/3888#issuecomment-964862614 ## CI report: * f20758076b7fd9355a6b3075fc03d93982b80cc9 UNKNOWN * 4efd2f4b2a47c7417aa6dc84ef40162637448fdf UNKNOWN * 49a813a067fccf3bad68648b7b0164d7d36a59

[jira] [Commented] (HUDI-2729) Fix the options of flink quick start page

2021-11-09 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17441557#comment-17441557 ] Danny Chen commented on HUDI-2729: -- Fixed via master branch: e4d28aa366560ab68136821f3a12

[GitHub] [hudi] hudi-bot commented on pull request #3888: [HUDI-2624] Implement Non Index type for HUDI

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3888: URL: https://github.com/apache/hudi/pull/3888#issuecomment-964863983 ## CI report: * f20758076b7fd9355a6b3075fc03d93982b80cc9 UNKNOWN * 4efd2f4b2a47c7417aa6dc84ef40162637448fdf UNKNOWN * 73094907e1ed6ea6083736582a10f9f7910a5562 Azure

[jira] [Resolved] (HUDI-2729) Fix the options of flink quick start page

2021-11-09 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-2729. -- > Fix the options of flink quick start page > - > >

[hudi] branch asf-site updated: [HUDI-2729] Fix the options of flink quick start page (#3958)

2021-11-09 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new e4d28aa [HUDI-2729] Fix the options of fli

[GitHub] [hudi] danny0405 merged pull request #3958: [HUDI-2729] Fix the options of flink quick start page

2021-11-09 Thread GitBox
danny0405 merged pull request #3958: URL: https://github.com/apache/hudi/pull/3958 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubsc

[GitHub] [hudi] hudi-bot removed a comment on pull request #3888: [HUDI-2624] Implement Non Index type for HUDI

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3888: URL: https://github.com/apache/hudi/pull/3888#issuecomment-964851917 ## CI report: * f20758076b7fd9355a6b3075fc03d93982b80cc9 UNKNOWN * 4efd2f4b2a47c7417aa6dc84ef40162637448fdf UNKNOWN * 49a813a067fccf3bad68648b7b0164d7d36a59

[GitHub] [hudi] hudi-bot commented on pull request #3888: [HUDI-2624] Implement Non Index type for HUDI

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3888: URL: https://github.com/apache/hudi/pull/3888#issuecomment-964862614 ## CI report: * f20758076b7fd9355a6b3075fc03d93982b80cc9 UNKNOWN * 4efd2f4b2a47c7417aa6dc84ef40162637448fdf UNKNOWN * 49a813a067fccf3bad68648b7b0164d7d36a5947 Azure

[jira] [Commented] (HUDI-2086) redo the logical of mor_incremental_view for hive

2021-11-09 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17441555#comment-17441555 ] Danny Chen commented on HUDI-2086: -- Fixed via master branch: a40ac62e0ce7ec807a00803d23ed

[jira] [Updated] (HUDI-2086) redo the logical of mor_incremental_view for hive

2021-11-09 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-2086: - Fix Version/s: 0.10.0 > redo the logical of mor_incremental_view for hive > --

[jira] [Updated] (HUDI-2086) redo the logical of mor_incremental_view for hive

2021-11-09 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-2086: - Affects Version/s: 0.9.0 > redo the logical of mor_incremental_view for hive > ---

[jira] [Resolved] (HUDI-2086) redo the logical of mor_incremental_view for hive

2021-11-09 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-2086. -- > redo the logical of mor_incremental_view for hive > - > >

[hudi] branch master updated (fd0f5df -> a40ac62)

2021-11-09 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from fd0f5df [HUDI-2297] Estimate available memory size for spillable map accurately. (#3455) add a40ac62 [HUDI-2

[GitHub] [hudi] danny0405 merged pull request #3203: [HUDI-2086] Refactor hive mor_incremental_view

2021-11-09 Thread GitBox
danny0405 merged pull request #3203: URL: https://github.com/apache/hudi/pull/3203 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubsc

[jira] [Updated] (HUDI-2729) Fix the options of flink quick start page

2021-11-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2729: - Labels: pull-request-available (was: ) > Fix the options of flink quick start page >

[GitHub] [hudi] danny0405 opened a new pull request #3958: [HUDI-2729] Fix the options of flink quick start page

2021-11-09 Thread GitBox
danny0405 opened a new pull request #3958: URL: https://github.com/apache/hudi/pull/3958 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpo

[GitHub] [hudi] hudi-bot removed a comment on pull request #3888: [HUDI-2624] Implement Non Index type for HUDI

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3888: URL: https://github.com/apache/hudi/pull/3888#issuecomment-964841042 ## CI report: * f20758076b7fd9355a6b3075fc03d93982b80cc9 UNKNOWN * 4efd2f4b2a47c7417aa6dc84ef40162637448fdf UNKNOWN * 49a813a067fccf3bad68648b7b0164d7d36a59

[GitHub] [hudi] hudi-bot commented on pull request #3888: [HUDI-2624] Implement Non Index type for HUDI

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3888: URL: https://github.com/apache/hudi/pull/3888#issuecomment-964851917 ## CI report: * f20758076b7fd9355a6b3075fc03d93982b80cc9 UNKNOWN * 4efd2f4b2a47c7417aa6dc84ef40162637448fdf UNKNOWN * 49a813a067fccf3bad68648b7b0164d7d36a5947 Azure

[jira] [Created] (HUDI-2729) Fix the options of flink quick start page

2021-11-09 Thread Danny Chen (Jira)
Danny Chen created HUDI-2729: Summary: Fix the options of flink quick start page Key: HUDI-2729 URL: https://issues.apache.org/jira/browse/HUDI-2729 Project: Apache Hudi Issue Type: Task

[GitHub] [hudi] hudi-bot commented on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964845144 ## CI report: * 5c71686aff049029f1080a624a7e235445635e30 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964841135 ## CI report: * 5c71686aff049029f1080a624a7e235445635e30 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964841135 ## CI report: * 5c71686aff049029f1080a624a7e235445635e30 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964821274 ## CI report: * 5c71686aff049029f1080a624a7e235445635e30 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #3888: [HUDI-2624] Implement Non Index type for HUDI

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3888: URL: https://github.com/apache/hudi/pull/3888#issuecomment-961589881 ## CI report: * f20758076b7fd9355a6b3075fc03d93982b80cc9 UNKNOWN * 4efd2f4b2a47c7417aa6dc84ef40162637448fdf UNKNOWN * 49a813a067fccf3bad68648b7b0164d7d36a59

[GitHub] [hudi] hudi-bot commented on pull request #3888: [HUDI-2624] Implement Non Index type for HUDI

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3888: URL: https://github.com/apache/hudi/pull/3888#issuecomment-964841042 ## CI report: * f20758076b7fd9355a6b3075fc03d93982b80cc9 UNKNOWN * 4efd2f4b2a47c7417aa6dc84ef40162637448fdf UNKNOWN * 49a813a067fccf3bad68648b7b0164d7d36a5947 Azure

[GitHub] [hudi] yuzhaojing commented on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
yuzhaojing commented on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964840749 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] vinothchandar commented on pull request #3875: [HUDI-2442] Change default values for certain clustering configs

2021-11-09 Thread GitBox
vinothchandar commented on pull request #3875: URL: https://github.com/apache/hudi/pull/3875#issuecomment-964836911 Makes sense to me as well. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[GitHub] [hudi] vinothchandar commented on a change in pull request #3955: [HUDI-2718] ExternalSpillableMap payload size re-estimation throws ArithmeticException

2021-11-09 Thread GitBox
vinothchandar commented on a change in pull request #3955: URL: https://github.com/apache/hudi/pull/3955#discussion_r746288477 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/collection/ExternalSpillableMap.java ## @@ -204,19 +205,21 @@ public R get(Object

[GitHub] [hudi] hudi-bot commented on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964821274 ## CI report: * 5c71686aff049029f1080a624a7e235445635e30 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964820149 ## CI report: * fbfaf76c7484b975b915650e5a1aef02775850aa Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964820149 ## CI report: * fbfaf76c7484b975b915650e5a1aef02775850aa Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964817766 ## CI report: * fbfaf76c7484b975b915650e5a1aef02775850aa Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] caneGuy commented on pull request #3957: [HUDI-2688][RFC-37] A new Hudi connector for Trino

2021-11-09 Thread GitBox
caneGuy commented on pull request #3957: URL: https://github.com/apache/hudi/pull/3957#issuecomment-964819219 greate @codope thanks for this. i will take a look later this week! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hudi] hudi-bot commented on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964817766 ## CI report: * fbfaf76c7484b975b915650e5a1aef02775850aa Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964816532 ## CI report: * fbfaf76c7484b975b915650e5a1aef02775850aa Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot removed a comment on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964765984 ## CI report: * fbfaf76c7484b975b915650e5a1aef02775850aa Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964816532 ## CI report: * fbfaf76c7484b975b915650e5a1aef02775850aa Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] xiarixiaoyao commented on pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-11-09 Thread GitBox
xiarixiaoyao commented on pull request #3330: URL: https://github.com/apache/hudi/pull/3330#issuecomment-964815945 @vinothchandar Of course, let's finish this together -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[hudi] branch master updated (bb6a19e -> fd0f5df)

2021-11-09 Thread garyli
This is an automated email from the ASF dual-hosted git repository. garyli pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from bb6a19e [HUDI-1877] Support records staying in same fileId after clustering (#3833) add fd0f5df [HUDI-2297] Est

[GitHub] [hudi] garyli1019 merged pull request #3455: [HUDI-2297] Estimate available memory size accurately for spillable map.

2021-11-09 Thread GitBox
garyli1019 merged pull request #3455: URL: https://github.com/apache/hudi/pull/3455 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[GitHub] [hudi] bvaradar commented on a change in pull request #3808: [HUDI-2560] introduce id_based schema to support full schema evolution.

2021-11-09 Thread GitBox
bvaradar commented on a change in pull request #3808: URL: https://github.com/apache/hudi/pull/3808#discussion_r746264487 ## File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/io/FileBaseInternalSchemasManager.java ## @@ -0,0 +1,164 @@ +/* + * Licensed to the

[GitHub] [hudi] vinothchandar commented on a change in pull request #3955: [HUDI-2718] ExternalSpillableMap payload size re-estimation throws ArithmeticException

2021-11-09 Thread GitBox
vinothchandar commented on a change in pull request #3955: URL: https://github.com/apache/hudi/pull/3955#discussion_r746270073 ## File path: hudi-common/src/test/java/org/apache/hudi/common/util/collection/TestExternalSpillableMap.java ## @@ -339,7 +343,42 @@ public void test

[GitHub] [hudi] zhangyue19921010 commented on a change in pull request #3956: [HUDI-2641] Avoid deleting all inflight commits heartbeats while rolling back failed writes

2021-11-09 Thread GitBox
zhangyue19921010 commented on a change in pull request #3956: URL: https://github.com/apache/hudi/pull/3956#discussion_r746260110 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java ## @@ -856,13 +856,9 @@ protected

[GitHub] [hudi] zhangyue19921010 commented on a change in pull request #3956: [HUDI-2641] Avoid deleting all inflight commits heartbeats while rolling back failed writes

2021-11-09 Thread GitBox
zhangyue19921010 commented on a change in pull request #3956: URL: https://github.com/apache/hudi/pull/3956#discussion_r746260110 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java ## @@ -856,13 +856,9 @@ protected

[GitHub] [hudi] zhangyue19921010 commented on a change in pull request #3956: [HUDI-2641] Avoid deleting all inflight commits heartbeats while rolling back failed writes

2021-11-09 Thread GitBox
zhangyue19921010 commented on a change in pull request #3956: URL: https://github.com/apache/hudi/pull/3956#discussion_r746260110 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java ## @@ -856,13 +856,9 @@ protected

[jira] [Commented] (HUDI-2656) Generalize HoodieIndex for flexible record data type

2021-11-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17441499#comment-17441499 ] Ethan Guo commented on HUDI-2656: - The work to generalize HoodieIndex aims to unblock the

[jira] [Updated] (HUDI-2656) Generalize HoodieIndex for flexible record data type

2021-11-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-2656: Priority: Major (was: Blocker) > Generalize HoodieIndex for flexible record data type > ---

[jira] [Updated] (HUDI-2431) Reimplement BufferedWriter in streaming fashion

2021-11-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-2431: Priority: Major (was: Blocker) > Reimplement BufferedWriter in streaming fashion >

[jira] [Updated] (HUDI-2445) Implement time based bucketing of inserts

2021-11-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-2445: Priority: Major (was: Blocker) > Implement time based bucketing of inserts > -

[jira] [Commented] (HUDI-2431) Reimplement BufferedWriter in streaming fashion

2021-11-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17441497#comment-17441497 ] Ethan Guo commented on HUDI-2431: - As discussed offline, this won't be a release blocker f

[jira] [Commented] (HUDI-2445) Implement time based bucketing of inserts

2021-11-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17441498#comment-17441498 ] Ethan Guo commented on HUDI-2445: - As discussed offline, this won't be a release blocker f

[jira] [Reopened] (HUDI-1877) clustering support for external index

2021-11-09 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reopened HUDI-1877: -- > clustering support for external index > - > >

[jira] [Resolved] (HUDI-1877) clustering support for external index

2021-11-09 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar resolved HUDI-1877. -- > clustering support for external index > - > >

[jira] [Updated] (HUDI-1877) clustering support for external index

2021-11-09 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1877: - Status: Closed (was: Patch Available) > clustering support for external index > -

[hudi] branch master updated (dfe3b84 -> bb6a19e)

2021-11-09 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from dfe3b84 [HUDI-2579] Make deltastreamer checkpoint state merging more explicit (#3820) add bb6a19e [HUDI-1877] S

[GitHub] [hudi] vinothchandar merged pull request #3833: [HUDI-1877] Support records staying in same fileId after clustering

2021-11-09 Thread GitBox
vinothchandar merged pull request #3833: URL: https://github.com/apache/hudi/pull/3833 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-uns

[GitHub] [hudi] hudi-bot removed a comment on pull request #3957: [HUDI-2688][RFC-37] A new Hudi connector for Trino

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3957: URL: https://github.com/apache/hudi/pull/3957#issuecomment-964753986 ## CI report: * e1fa12b9a35058673bdefa9859dffa9c10c1535a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #3957: [HUDI-2688][RFC-37] A new Hudi connector for Trino

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3957: URL: https://github.com/apache/hudi/pull/3957#issuecomment-964769572 ## CI report: * e1fa12b9a35058673bdefa9859dffa9c10c1535a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] nsivabalan commented on pull request #2069: [WIP][HUDI-945] Cleanup Spillable map files eagerly for DiskBasedMap

2021-11-09 Thread GitBox
nsivabalan commented on pull request #2069: URL: https://github.com/apache/hudi/pull/2069#issuecomment-964767074 @bvaradar : Can you chime in here please. Can you check Rajesh's comment above. Can you help us understand if we need to fix the concurrency on spillable map as such or should w

[GitHub] [hudi] hudi-bot commented on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964765984 ## CI report: * fbfaf76c7484b975b915650e5a1aef02775850aa Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964748875 ## CI report: * bb54241f6f48e05192a289089d75dde77118ff29 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[jira] [Resolved] (HUDI-2579) Deltastreamer checkpoint metadata is not merged from previous commit instant

2021-11-09 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan resolved HUDI-2579. --- > Deltastreamer checkpoint metadata is not merged from previous commit instant > -

[GitHub] [hudi] codope commented on pull request #3957: [HUDI-2688][RFC-37] A new Hudi connector for Trino

2021-11-09 Thread GitBox
codope commented on pull request #3957: URL: https://github.com/apache/hudi/pull/3957#issuecomment-964758378 cc: @vinothchandar @bvaradar @caneGuy @yihua -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Updated] (HUDI-2516) Upgrade to Junit 5.8.1

2021-11-09 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2516: - Priority: Critical (was: Blocker) > Upgrade to Junit 5.8.1 > -- > > K

[GitHub] [hudi] hudi-bot commented on pull request #3957: [HUDI-2688][RFC-37] A new Hudi connector for Trino

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3957: URL: https://github.com/apache/hudi/pull/3957#issuecomment-964753986 ## CI report: * e1fa12b9a35058673bdefa9859dffa9c10c1535a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #3957: [HUDI-2688][RFC-37] A new Hudi connector for Trino

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3957: URL: https://github.com/apache/hudi/pull/3957#issuecomment-964753119 ## CI report: * e1fa12b9a35058673bdefa9859dffa9c10c1535a UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #3957: [HUDI-2688][RFC-37] A new Hudi connector for Trino

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3957: URL: https://github.com/apache/hudi/pull/3957#issuecomment-964753119 ## CI report: * e1fa12b9a35058673bdefa9859dffa9c10c1535a UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` r

[jira] [Updated] (HUDI-2688) RFC

2021-11-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2688: - Labels: pull-request-available (was: ) > RFC > --- > > Key: HUDI-2688 >

[GitHub] [hudi] codope opened a new pull request #3957: [HUDI-2688][RFC-37] A new Hudi connector for Trino

2021-11-09 Thread GitBox
codope opened a new pull request #3957: URL: https://github.com/apache/hudi/pull/3957 Add implementation details Update table with new rfc ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contrib

[GitHub] [hudi] nsivabalan commented on a change in pull request #3486: [HUDI-2314] Add support for DynamoDb based lock

2021-11-09 Thread GitBox
nsivabalan commented on a change in pull request #3486: URL: https://github.com/apache/hudi/pull/3486#discussion_r741536160 ## File path: hudi-client/hudi-client-common/pom.xml ## @@ -218,6 +222,27 @@ ${zk-curator.version} test + + com.amazonaws Re

[GitHub] [hudi] hudi-bot commented on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964748875 ## CI report: * bb54241f6f48e05192a289089d75dde77118ff29 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964747579 ## CI report: * bb54241f6f48e05192a289089d75dde77118ff29 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964747579 ## CI report: * bb54241f6f48e05192a289089d75dde77118ff29 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964171790 ## CI report: * bb54241f6f48e05192a289089d75dde77118ff29 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #3956: [HUDI-2641] Avoid deleting all inflight commits heartbeats while rolling back failed writes

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3956: URL: https://github.com/apache/hudi/pull/3956#issuecomment-964746409 ## CI report: * add8acecb367ee7b8506e5abda9137d203e34645 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #3956: [HUDI-2641] Avoid deleting all inflight commits heartbeats while rolling back failed writes

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3956: URL: https://github.com/apache/hudi/pull/3956#issuecomment-964724636 ## CI report: * add8acecb367ee7b8506e5abda9137d203e34645 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[jira] [Updated] (HUDI-2726) Document the different utilities (snapshotter, exporter, schemaprovider etc)

2021-11-09 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2726: -- Fix Version/s: 0.10.0 > Document the different utilities (snapshotter, exporter, schemaprovider etc) > -

[jira] [Updated] (HUDI-2727) Add prometheus reporter docs

2021-11-09 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2727: -- Fix Version/s: 0.10.0 > Add prometheus reporter docs > > >

[jira] [Updated] (HUDI-2725) Add precommit validators doc

2021-11-09 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2725: -- Fix Version/s: 0.10.0 > Add precommit validators doc > > >

[jira] [Updated] (HUDI-2728) Clean up concepts and consolidate from cwiki

2021-11-09 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2728: -- Fix Version/s: 0.10.0 > Clean up concepts and consolidate from cwiki > -

[jira] [Updated] (HUDI-2720) Add File Sizing doc

2021-11-09 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2720: -- Fix Version/s: 0.10.0 > Add File Sizing doc > --- > > Key: HUDI-2720 >

[jira] [Updated] (HUDI-2636) Make release notes discoverable

2021-11-09 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2636: -- Fix Version/s: 0.10.0 > Make release notes discoverable > --- > >

[jira] [Assigned] (HUDI-2728) Clean up concepts and consolidate from cwiki

2021-11-09 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller reassigned HUDI-2728: - Assignee: Kyle Weller > Clean up concepts and consolidate from cwiki > --

[jira] [Updated] (HUDI-2727) Add prometheus reporter docs

2021-11-09 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2727: -- Priority: Blocker (was: Major) > Add prometheus reporter docs > > >

[jira] [Updated] (HUDI-2728) Clean up concepts and consolidate from cwiki

2021-11-09 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2728: -- Priority: Blocker (was: Major) > Clean up concepts and consolidate from cwiki > ---

[jira] [Assigned] (HUDI-2727) Add prometheus reporter docs

2021-11-09 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller reassigned HUDI-2727: - Assignee: Kyle Weller > Add prometheus reporter docs > > >

[jira] [Assigned] (HUDI-2726) Document the different utilities (snapshotter, exporter, schemaprovider etc)

2021-11-09 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller reassigned HUDI-2726: - Assignee: Kyle Weller > Document the different utilities (snapshotter, exporter, schemaprovider e

[jira] [Updated] (HUDI-2725) Add precommit validators doc

2021-11-09 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2725: -- Priority: Blocker (was: Major) > Add precommit validators doc > > >

[jira] [Updated] (HUDI-2726) Document the different utilities (snapshotter, exporter, schemaprovider etc)

2021-11-09 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2726: -- Priority: Blocker (was: Major) > Document the different utilities (snapshotter, exporter, schemaprovide

[jira] [Assigned] (HUDI-2725) Add precommit validators doc

2021-11-09 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller reassigned HUDI-2725: - Assignee: Kyle Weller > Add precommit validators doc > > >

[jira] [Assigned] (HUDI-2720) Add File Sizing doc

2021-11-09 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller reassigned HUDI-2720: - Assignee: Kyle Weller > Add File Sizing doc > --- > > Key: HUDI-2

[jira] [Updated] (HUDI-2720) Add File Sizing doc

2021-11-09 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2720: -- Priority: Blocker (was: Major) > Add File Sizing doc > --- > > Key: HUD

  1   2   3   >