[jira] [Updated] (HUDI-2203) When the orderingVal is the same, take the latest one

2021-07-20 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-2203: Description: OverwriteWithLatestAvroPayload.   was: OverwriteWithLatestAvroPayload.   > When the or

[jira] [Updated] (HUDI-2203) When the orderingVal is the same, take the latest one

2021-07-20 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-2203: Description: OverwriteWithLatestAvroPayload.   > When the orderingVal is the same, take the latest one > -

[jira] [Created] (HUDI-2203) When the orderingVal is the same, take the latest one

2021-07-20 Thread liujinhui (Jira)
liujinhui created HUDI-2203: --- Summary: When the orderingVal is the same, take the latest one Key: HUDI-2203 URL: https://issues.apache.org/jira/browse/HUDI-2203 Project: Apache Hudi Issue Type: Imp

[GitHub] [hudi] leoluan2009 closed pull request #3307: [MINOR] Refactor hive realtime config to extend from HoodieConfig

2021-07-20 Thread GitBox
leoluan2009 closed pull request #3307: URL: https://github.com/apache/hudi/pull/3307 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsub

[jira] [Closed] (HUDI-1482) async clustering for spark streaming

2021-07-20 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit closed HUDI-1482. - Resolution: Fixed > async clustering for spark streaming > > >

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384665#comment-17384665 ] ASF GitHub Bot commented on HUDI-1138: -- codecov-commenter edited a comment on pull re

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3233: [WIP][HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-07-20 Thread GitBox
codecov-commenter edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-883297547 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3233?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384662#comment-17384662 ] ASF GitHub Bot commented on HUDI-1138: -- codecov-commenter edited a comment on pull re

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3233: [WIP][HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-07-20 Thread GitBox
codecov-commenter edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-883297547 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3233?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The

[jira] [Resolved] (HUDI-2146) Concurrent writes loss data

2021-07-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar resolved HUDI-2146. -- Resolution: Cannot Reproduce > Concurrent writes loss data > > >

[hudi] branch master updated (d58a834 -> 4f1350f)

2021-07-20 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from d58a834 [HUDI-2007] Fixing hudi_test_suite for spark nodes and adding spark bulk_insert node (#3074) add 4f1350f

[GitHub] [hudi] vinothchandar merged pull request #3314: [MINOR] Disable codecov

2021-07-20 Thread GitBox
vinothchandar merged pull request #3314: URL: https://github.com/apache/hudi/pull/3314 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-uns

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384652#comment-17384652 ] ASF GitHub Bot commented on HUDI-1138: -- codecov-commenter edited a comment on pull re

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3233: [WIP][HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-07-20 Thread GitBox
codecov-commenter edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-883297547 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3233?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The

[jira] [Commented] (HUDI-2139) MergeInto MOR Table May Result InCorrect Result

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384647#comment-17384647 ] ASF GitHub Bot commented on HUDI-2139: -- hudi-bot edited a comment on pull request #32

[GitHub] [hudi] hudi-bot edited a comment on pull request #3230: [HUDI-2139] MergeInto MOR Table May Result InCorrect Result

2021-07-20 Thread GitBox
hudi-bot edited a comment on pull request #3230: URL: https://github.com/apache/hudi/pull/3230#issuecomment-874605269 ## CI report: * 2568538186a80a3cea8470e01cafb654a825c75a UNKNOWN * 2b6219dd1b9a223dcff9e37548a14e5e1dad9813 Azure: [FAILURE](https://dev.azure.com/apache-hudi-

[jira] [Resolved] (HUDI-1563) Documentation on small file handling

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan resolved HUDI-1563. --- Fix Version/s: 0.8.0 Resolution: Fixed > Documentation on small file handling >

[jira] [Updated] (HUDI-1378) Add ENABLE_ROW_WRITER_OPT_KEY to Configurations (docs)

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1378: -- Status: In Progress (was: Open) > Add ENABLE_ROW_WRITER_OPT_KEY to Configurations (docs

[jira] [Resolved] (HUDI-1378) Add ENABLE_ROW_WRITER_OPT_KEY to Configurations (docs)

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan resolved HUDI-1378. --- Resolution: Fixed > Add ENABLE_ROW_WRITER_OPT_KEY to Configurations (docs) > -

[jira] [Updated] (HUDI-1563) Documentation on small file handling

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1563: -- Status: In Progress (was: Open) > Documentation on small file handling > --

[jira] [Updated] (HUDI-1378) Add ENABLE_ROW_WRITER_OPT_KEY to Configurations (docs)

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1378: -- Status: Open (was: New) > Add ENABLE_ROW_WRITER_OPT_KEY to Configurations (docs) >

[jira] [Closed] (HUDI-1838) Add documentation for using cleaning / archiving configs

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-1838. - Resolution: Duplicate > Add documentation for using cleaning / archiving configs > ---

[jira] [Closed] (HUDI-1106) Bulk insert dataset - Drop duplicates

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-1106. - Resolution: Duplicate > Bulk insert dataset - Drop duplicates > --

[jira] [Updated] (HUDI-1941) Fix callers of HoodieRecordPayload.preCombine() to use new api with props arg

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1941: -- Labels: sev:critical (was: sev:high) > Fix callers of HoodieRecordPayload.preCombine()

[jira] [Updated] (HUDI-1106) Bulk insert dataset - Drop duplicates

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1106: -- Status: Open (was: New) > Bulk insert dataset - Drop duplicates > -

[jira] [Updated] (HUDI-1991) Fix drop dups flow for bulk insert in row writer path

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1991: -- Status: In Progress (was: Open) > Fix drop dups flow for bulk insert in row writer path

[jira] [Resolved] (HUDI-1991) Fix drop dups flow for bulk insert in row writer path

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan resolved HUDI-1991. --- Fix Version/s: 0.9.0 Resolution: Fixed > Fix drop dups flow for bulk insert in

[jira] [Updated] (HUDI-2095) Scope out Append_only mode for hudi

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2095: -- Status: In Progress (was: Open) > Scope out Append_only mode for hudi > ---

[jira] [Updated] (HUDI-2006) Add more yamls to test suite

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2006: -- Status: In Progress (was: Open) > Add more yamls to test suite > -

[jira] [Resolved] (HUDI-2095) Scope out Append_only mode for hudi

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan resolved HUDI-2095. --- Fix Version/s: 0.9.0 Resolution: Fixed > Scope out Append_only mode for hudi >

[jira] [Updated] (HUDI-1104) Bulk insert Dataset - UserDefinedPartitioner

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1104: -- Status: In Progress (was: Open) > Bulk insert Dataset - UserDefinedPartitioner > --

[jira] [Resolved] (HUDI-1104) Bulk insert Dataset - UserDefinedPartitioner

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan resolved HUDI-1104. --- Resolution: Fixed > Bulk insert Dataset - UserDefinedPartitioner > ---

[jira] [Resolved] (HUDI-2006) Add more yamls to test suite

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan resolved HUDI-2006. --- Fix Version/s: 0.9.0 Resolution: Fixed > Add more yamls to test suite > --

[jira] [Updated] (HUDI-1104) Bulk insert Dataset - UserDefinedPartitioner

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1104: -- Status: Open (was: New) > Bulk insert Dataset - UserDefinedPartitioner > --

[jira] [Updated] (HUDI-1105) Bulk insert dataset - Dedup

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1105: -- Status: Open (was: New) > Bulk insert dataset - Dedup > --- > >

[jira] [Updated] (HUDI-1105) Bulk insert dataset - Dedup

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1105: -- Status: In Progress (was: Open) > Bulk insert dataset - Dedup > ---

[jira] [Resolved] (HUDI-1105) Bulk insert dataset - Dedup

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan resolved HUDI-1105. --- Resolution: Fixed > Bulk insert dataset - Dedup > --- > >

[jira] [Resolved] (HUDI-2009) Fix extra commit metadata in row writer path

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan resolved HUDI-2009. --- Fix Version/s: 0.9.0 Resolution: Fixed > Fix extra commit metadata in row write

[jira] [Updated] (HUDI-2009) Fix extra commit metadata in row writer path

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2009: -- Status: In Progress (was: Open) > Fix extra commit metadata in row writer path > --

[jira] [Updated] (HUDI-2007) Adding spark bulk insert node

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2007: -- Status: In Progress (was: Open) > Adding spark bulk insert node > -

[jira] [Resolved] (HUDI-2007) Adding spark bulk insert node

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan resolved HUDI-2007. --- Fix Version/s: 0.9.0 Resolution: Fixed > Adding spark bulk insert node > --

[jira] [Commented] (HUDI-2177) Virtual keys support for Compaction

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384645#comment-17384645 ] ASF GitHub Bot commented on HUDI-2177: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3315: [HUDI-2177][HUDI-2200] Adding virtual keys support for MOR

2021-07-20 Thread GitBox
hudi-bot edited a comment on pull request #3315: URL: https://github.com/apache/hudi/pull/3315#issuecomment-883851530 ## CI report: * b4b137968fc3ceed09408fdef934bba73764c5e5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Created] (HUDI-2202) Add Trino to Docker Demo

2021-07-20 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-2202: - Summary: Add Trino to Docker Demo Key: HUDI-2202 URL: https://issues.apache.org/jira/browse/HUDI-2202 Project: Apache Hudi Issue Type: Sub-task Reporte

[jira] [Assigned] (HUDI-1978) [UMBRELLA] Support for Trino

2021-07-20 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit reassigned HUDI-1978: - Assignee: Sagar Sumit (was: Vinoth Chandar) > [UMBRELLA] Support for Trino > ---

[jira] [Assigned] (HUDI-1856) Upstream changes made in PrestoDB to eliminate file listing to Trino

2021-07-20 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit reassigned HUDI-1856: - Assignee: Sagar Sumit > Upstream changes made in PrestoDB to eliminate file listing to Trino > --

[jira] [Assigned] (HUDI-2158) Upstream support for MOR tables.

2021-07-20 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit reassigned HUDI-2158: - Assignee: Sagar Sumit > Upstream support for MOR tables. > > >

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3307: [MINOR] Refactor hive realtime config to extend from HoodieConfig

2021-07-20 Thread GitBox
codecov-commenter edited a comment on pull request #3307: URL: https://github.com/apache/hudi/pull/3307#issuecomment-883347621 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384640#comment-17384640 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #32

[GitHub] [hudi] hudi-bot edited a comment on pull request #3233: [WIP][HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-07-20 Thread GitBox
hudi-bot edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-875280958 ## CI report: * 2d22335c215ed620ce20018b1c83be189b7c70c6 UNKNOWN * f1095198d43636de20b525d80341c32f84591d48 Azure: [FAILURE](https://dev.azure.com/apache-hudi-

[jira] [Commented] (HUDI-2007) Adding spark bulk insert node

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384638#comment-17384638 ] ASF GitHub Bot commented on HUDI-2007: -- nsivabalan merged pull request #3074: URL: ht

[hudi] branch master updated (858e84b -> d58a834)

2021-07-20 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 858e84b [HUDI-2198] Clean and reset the bootstrap events for coordinator when task failover (#3304) add d58a8

[GitHub] [hudi] nsivabalan merged pull request #3074: [HUDI-2007] Fixing hudi_test_suite for spark nodes and adding spark bulk_insert node

2021-07-20 Thread GitBox
nsivabalan merged pull request #3074: URL: https://github.com/apache/hudi/pull/3074 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[jira] [Commented] (HUDI-1518) Remove replaced files logic from archival

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384634#comment-17384634 ] ASF GitHub Bot commented on HUDI-1518: -- codecov-commenter edited a comment on pull re

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3307: [MINOR] Refactor hive realtime config to extend from HoodieConfig

2021-07-20 Thread GitBox
codecov-commenter edited a comment on pull request #3307: URL: https://github.com/apache/hudi/pull/3307#issuecomment-883347621 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3307?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3310: [HUDI-1518] Remove the logic that delete replaced file when archive

2021-07-20 Thread GitBox
codecov-commenter edited a comment on pull request #3310: URL: https://github.com/apache/hudi/pull/3310#issuecomment-883331907 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[jira] [Commented] (HUDI-2007) Adding spark bulk insert node

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384633#comment-17384633 ] ASF GitHub Bot commented on HUDI-2007: -- codecov-commenter edited a comment on pull re

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3074: [HUDI-2007] Fixing hudi_test_suite for spark nodes and adding spark bulk_insert node

2021-07-20 Thread GitBox
codecov-commenter edited a comment on pull request #3074: URL: https://github.com/apache/hudi/pull/3074#issuecomment-860337193 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [hudi] hudi-bot edited a comment on pull request #3307: [MINOR] Refactor hive realtime config to extend from HoodieConfig

2021-07-20 Thread GitBox
hudi-bot edited a comment on pull request #3307: URL: https://github.com/apache/hudi/pull/3307#issuecomment-883153186 ## CI report: * 5ad4271d6c2cf000bc195d3945cbe2dd0f6cbb4a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2007) Adding spark bulk insert node

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384629#comment-17384629 ] ASF GitHub Bot commented on HUDI-2007: -- codecov-commenter edited a comment on pull re

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3074: [HUDI-2007] Fixing hudi_test_suite for spark nodes and adding spark bulk_insert node

2021-07-20 Thread GitBox
codecov-commenter edited a comment on pull request #3074: URL: https://github.com/apache/hudi/pull/3074#issuecomment-860337193 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3074?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The

[jira] [Commented] (HUDI-1518) Remove replaced files logic from archival

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384628#comment-17384628 ] ASF GitHub Bot commented on HUDI-1518: -- codecov-commenter edited a comment on pull re

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3310: [HUDI-1518] Remove the logic that delete replaced file when archive

2021-07-20 Thread GitBox
codecov-commenter edited a comment on pull request #3310: URL: https://github.com/apache/hudi/pull/3310#issuecomment-883331907 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3310?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The

[jira] [Updated] (HUDI-2138) Implement Parquet Data blocks for file inlining

2021-07-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-2138: - Summary: Implement Parquet Data blocks for file inlining (was: Implement Parquest Data blocks for

[jira] [Commented] (HUDI-2007) Adding spark bulk insert node

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384625#comment-17384625 ] ASF GitHub Bot commented on HUDI-2007: -- hudi-bot edited a comment on pull request #30

[GitHub] [hudi] hudi-bot edited a comment on pull request #3074: [HUDI-2007] Fixing hudi_test_suite for spark nodes and adding spark bulk_insert node

2021-07-20 Thread GitBox
hudi-bot edited a comment on pull request #3074: URL: https://github.com/apache/hudi/pull/3074#issuecomment-861653947 ## CI report: * 9c622e581cf38a62828f734514cf6204d902ac76 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2007) Adding spark bulk insert node

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384624#comment-17384624 ] ASF GitHub Bot commented on HUDI-2007: -- codecov-commenter edited a comment on pull re

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3074: [HUDI-2007] Fixing hudi_test_suite for spark nodes and adding spark bulk_insert node

2021-07-20 Thread GitBox
codecov-commenter edited a comment on pull request #3074: URL: https://github.com/apache/hudi/pull/3074#issuecomment-860337193 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3074?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The

[jira] [Commented] (HUDI-1518) Remove replaced files logic from archival

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384622#comment-17384622 ] ASF GitHub Bot commented on HUDI-1518: -- codecov-commenter edited a comment on pull re

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3310: [HUDI-1518] Remove the logic that delete replaced file when archive

2021-07-20 Thread GitBox
codecov-commenter edited a comment on pull request #3310: URL: https://github.com/apache/hudi/pull/3310#issuecomment-883331907 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3310?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The

[jira] [Commented] (HUDI-2177) Virtual keys support for Compaction

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384621#comment-17384621 ] ASF GitHub Bot commented on HUDI-2177: -- codecov-commenter commented on pull request #

[GitHub] [hudi] codecov-commenter commented on pull request #3315: [HUDI-2177][HUDI-2200] Adding virtual keys support for MOR

2021-07-20 Thread GitBox
codecov-commenter commented on pull request #3315: URL: https://github.com/apache/hudi/pull/3315#issuecomment-883856272 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3315?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache

[jira] [Updated] (HUDI-2201) Audi all flink classes and route all FileSystem list and getStatus calls to metadata table

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2201: -- Description:   {code:java} grep -irl "fs.listStatus" hudi-*/* | grep -v Test hudi-flink/

[jira] [Comment Edited] (HUDI-1015) Audit all getAllPartitionPaths() calls and keep em out of fast path

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384613#comment-17384613 ] sivabalan narayanan edited comment on HUDI-1015 at 7/21/21, 3:21 AM: ---

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3307: [MINOR] Refactor hive realtime config to extend from HoodieConfig

2021-07-20 Thread GitBox
codecov-commenter edited a comment on pull request #3307: URL: https://github.com/apache/hudi/pull/3307#issuecomment-883347621 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3307?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The

[jira] [Created] (HUDI-2201) Audi all flink classes and route all FileSystem list and getStatus calls to metadata table

2021-07-20 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2201: - Summary: Audi all flink classes and route all FileSystem list and getStatus calls to metadata table Key: HUDI-2201 URL: https://issues.apache.org/jira/browse/HUDI-2201

[jira] [Commented] (HUDI-2139) MergeInto MOR Table May Result InCorrect Result

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384618#comment-17384618 ] ASF GitHub Bot commented on HUDI-2139: -- hudi-bot edited a comment on pull request #32

[jira] [Comment Edited] (HUDI-1015) Audit all getAllPartitionPaths() calls and keep em out of fast path

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384616#comment-17384616 ] sivabalan narayanan edited comment on HUDI-1015 at 7/21/21, 3:17 AM: ---

[GitHub] [hudi] hudi-bot edited a comment on pull request #3230: [HUDI-2139] MergeInto MOR Table May Result InCorrect Result

2021-07-20 Thread GitBox
hudi-bot edited a comment on pull request #3230: URL: https://github.com/apache/hudi/pull/3230#issuecomment-874605269 ## CI report: * 2568538186a80a3cea8470e01cafb654a825c75a UNKNOWN * be436c40648b2a167c637c1ed98376a9cb15b16d Azure: [SUCCESS](https://dev.azure.com/apache-hudi-

[jira] [Comment Edited] (HUDI-1015) Audit all getAllPartitionPaths() calls and keep em out of fast path

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384613#comment-17384613 ] sivabalan narayanan edited comment on HUDI-1015 at 7/21/21, 3:12 AM: ---

[jira] [Commented] (HUDI-2177) Virtual keys support for Compaction

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384617#comment-17384617 ] ASF GitHub Bot commented on HUDI-2177: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3315: [HUDI-2177][HUDI-2200] Adding virtual keys support for MOR

2021-07-20 Thread GitBox
hudi-bot edited a comment on pull request #3315: URL: https://github.com/apache/hudi/pull/3315#issuecomment-883851530 ## CI report: * b4b137968fc3ceed09408fdef934bba73764c5e5 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2177) Virtual keys support for Compaction

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384615#comment-17384615 ] ASF GitHub Bot commented on HUDI-2177: -- hudi-bot commented on pull request #3315: URL

[jira] [Commented] (HUDI-1015) Audit all getAllPartitionPaths() calls and keep em out of fast path

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384614#comment-17384614 ] sivabalan narayanan commented on HUDI-1015: --- {code:java} grep -irl "fs.listFiles

[jira] [Commented] (HUDI-1015) Audit all getAllPartitionPaths() calls and keep em out of fast path

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384616#comment-17384616 ] sivabalan narayanan commented on HUDI-1015: --- {code:java} grep -irl "fs.getFileSt

[jira] [Commented] (HUDI-1015) Audit all getAllPartitionPaths() calls and keep em out of fast path

2021-07-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384613#comment-17384613 ] sivabalan narayanan commented on HUDI-1015: --- {{}} {code:java} grep -irl "fs.list

[GitHub] [hudi] hudi-bot commented on pull request #3315: [HUDI-2177][HUDI-2200] Adding virtual keys support for MOR

2021-07-20 Thread GitBox
hudi-bot commented on pull request #3315: URL: https://github.com/apache/hudi/pull/3315#issuecomment-883851530 ## CI report: * b4b137968fc3ceed09408fdef934bba73764c5e5 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[jira] [Commented] (HUDI-1518) Remove replaced files logic from archival

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384612#comment-17384612 ] ASF GitHub Bot commented on HUDI-1518: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3310: [HUDI-1518] Remove the logic that delete replaced file when archive

2021-07-20 Thread GitBox
hudi-bot edited a comment on pull request #3310: URL: https://github.com/apache/hudi/pull/3310#issuecomment-883213429 ## CI report: * f0b369bdcadf55ee9bc58ad6bea618eee871b23f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2177) Virtual keys support for Compaction

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384611#comment-17384611 ] ASF GitHub Bot commented on HUDI-2177: -- nsivabalan opened a new pull request #3315: U

[jira] [Created] (HUDI-2200) Virtual keys support for MOR table: realtime read

2021-07-20 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2200: - Summary: Virtual keys support for MOR table: realtime read Key: HUDI-2200 URL: https://issues.apache.org/jira/browse/HUDI-2200 Project: Apache Hudi

[jira] [Updated] (HUDI-2177) Virtual keys support for Compaction

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2177: - Labels: pull-request-available (was: ) > Virtual keys support for Compaction > --

[GitHub] [hudi] nsivabalan opened a new pull request #3315: [HUDI-2177] Adding virtual keys support for MOR

2021-07-20 Thread GitBox
nsivabalan opened a new pull request #3315: URL: https://github.com/apache/hudi/pull/3315 ## What is the purpose of the pull request - Adding virtual keys support to MOR table - Compaction - Realtime read - Clustering Constraints: Only SimpleKeyGe

[jira] [Commented] (HUDI-2007) Adding spark bulk insert node

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384606#comment-17384606 ] ASF GitHub Bot commented on HUDI-2007: -- codecov-commenter edited a comment on pull re

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3074: [HUDI-2007] Fixing hudi_test_suite for spark nodes and adding spark bulk_insert node

2021-07-20 Thread GitBox
codecov-commenter edited a comment on pull request #3074: URL: https://github.com/apache/hudi/pull/3074#issuecomment-860337193 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3074?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The

[jira] [Commented] (HUDI-2194) Skip the latest N partitions when creating ClusteringPlan

2021-07-20 Thread ASF GitHub Bot (Jira)
; For example, we have 6 partitions based on date, and users set  > `hoodie.clustering.plan.strategy.daybased.lookback.partitions` 2 > |20210718|20210719 |20210720 |20210721 |20210722 |20210723(latest)| >                                                                               >   |<- choose to cluster >| > So

[GitHub] [hudi] hudi-bot edited a comment on pull request #3300: [HUDI-2194] Skip the latest N partitions when choosing partitions to create ClusteringPlan

2021-07-20 Thread GitBox
hudi-bot edited a comment on pull request #3300: URL: https://github.com/apache/hudi/pull/3300#issuecomment-882429208 ## CI report: * 350f4266dd6951cb64ba492553e1099978f23fcf Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-1518) Remove replaced files logic from archival

2021-07-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384602#comment-17384602 ] ASF GitHub Bot commented on HUDI-1518: -- codecov-commenter edited a comment on pull re

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3310: [HUDI-1518] Remove the logic that delete replaced file when archive

2021-07-20 Thread GitBox
codecov-commenter edited a comment on pull request #3310: URL: https://github.com/apache/hudi/pull/3310#issuecomment-883331907 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3310?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The

[GitHub] [hudi] hudi-bot edited a comment on pull request #3307: [MINOR] Refactor hive realtime config to extend from HoodieConfig

2021-07-20 Thread GitBox
hudi-bot edited a comment on pull request #3307: URL: https://github.com/apache/hudi/pull/3307#issuecomment-883153186 ## CI report: * 915dccba0a3cf0fcaaf290dfb7f839cb44696fef Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

  1   2   3   4   5   6   7   >