[jira] [Closed] (HUDI-1777) Add SparkDatasource support for delete_partition API

2021-08-10 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1777. - > Add SparkDatasource support for delete_partition API > > >

[jira] [Resolved] (HUDI-1777) Add SparkDatasource support for delete_partition API

2021-08-10 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li resolved HUDI-1777. --- Fix Version/s: 0.9.0 Assignee: sivabalan narayanan (was: Aditya Tiwari) Resolution: Fixed > A

[jira] [Created] (HUDI-2295) Add Flink Support for delete partition

2021-08-10 Thread Gary Li (Jira)
Gary Li created HUDI-2295: - Summary: Add Flink Support for delete partition Key: HUDI-2295 URL: https://issues.apache.org/jira/browse/HUDI-2295 Project: Apache Hudi Issue Type: New Feature

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397088#comment-17397088 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #32

[GitHub] [hudi] hudi-bot edited a comment on pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-08-10 Thread GitBox
hudi-bot edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-875280958 ## CI report: * 2d22335c215ed620ce20018b1c83be189b7c70c6 UNKNOWN * 230205edfab190cfaf687d0323ae8d704f425e1d UNKNOWN * 77d1886c7f6c612adbe4ef81adc07075cd99bdb

[GitHub] [hudi] hudi-bot edited a comment on pull request #3452: [DO_NOT_MERGE] Setting default for hoodie.bloom/simple.index.update.partition.path to true

2021-08-10 Thread GitBox
hudi-bot edited a comment on pull request #3452: URL: https://github.com/apache/hudi/pull/3452#issuecomment-896496147 ## CI report: * f6f3bf0ef9875bb41c458d3a2c3838d2aed0a8ca Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-1951) Hash Index for HUDI

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397077#comment-17397077 ] ASF GitHub Bot commented on HUDI-1951: -- SoldierZh commented on a change in pull reque

[GitHub] [hudi] SoldierZh commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

2021-08-10 Thread GitBox
SoldierZh commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r686503430 ## File path: hudi-common/src/main/java/org/apache/hudi/keygen/BaseKeyGenerator.java ## @@ -71,11 +75,28 @@ public final HoodieKey getKey(GenericRecord re

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397076#comment-17397076 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #32

[GitHub] [hudi] hudi-bot edited a comment on pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-08-10 Thread GitBox
hudi-bot edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-875280958 ## CI report: * 2d22335c215ed620ce20018b1c83be189b7c70c6 UNKNOWN * 230205edfab190cfaf687d0323ae8d704f425e1d UNKNOWN * 77d1886c7f6c612adbe4ef81adc07075cd99bdb

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397072#comment-17397072 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #32

[GitHub] [hudi] hudi-bot edited a comment on pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-08-10 Thread GitBox
hudi-bot edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-875280958 ## CI report: * 2d22335c215ed620ce20018b1c83be189b7c70c6 UNKNOWN * 230205edfab190cfaf687d0323ae8d704f425e1d UNKNOWN * 77d1886c7f6c612adbe4ef81adc07075cd99bdb

[jira] [Commented] (HUDI-2294) Add virtual key support to deltastreamer

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397070#comment-17397070 ] ASF GitHub Bot commented on HUDI-2294: -- nsivabalan commented on a change in pull requ

[GitHub] [hudi] nsivabalan commented on a change in pull request #3450: [HUDI-2294] Adding virtual keys props in deltastreamer path

2021-08-10 Thread GitBox
nsivabalan commented on a change in pull request #3450: URL: https://github.com/apache/hudi/pull/3450#discussion_r686494176 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/DeltaSync.java ## @@ -249,14 +251,20 @@ public void refreshTimeline()

[jira] [Commented] (HUDI-1774) Add support or delete_partition with spark ds

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397069#comment-17397069 ] ASF GitHub Bot commented on HUDI-1774: -- nsivabalan merged pull request #3437: URL: ht

[GitHub] [hudi] nsivabalan merged pull request #3437: [HUDI-1774] Adding support for delete_partitions to spark data source

2021-08-10 Thread GitBox
nsivabalan merged pull request #3437: URL: https://github.com/apache/hudi/pull/3437 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[hudi] branch master updated (a5e496f -> c9fa3cf)

2021-08-10 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from a5e496f [HUDI-2292] MOR should not predicate pushdown when reading with payload_combine type (#3443) add c9fa

[jira] [Commented] (HUDI-2294) Add virtual key support to deltastreamer

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397065#comment-17397065 ] ASF GitHub Bot commented on HUDI-2294: -- codope commented on a change in pull request

[GitHub] [hudi] codope commented on a change in pull request #3450: [HUDI-2294] Adding virtual keys props in deltastreamer path

2021-08-10 Thread GitBox
codope commented on a change in pull request #3450: URL: https://github.com/apache/hudi/pull/3450#discussion_r686489245 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/DeltaSync.java ## @@ -249,14 +251,20 @@ public void refreshTimeline() thro

[jira] [Commented] (HUDI-1951) Hash Index for HUDI

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397064#comment-17397064 ] ASF GitHub Bot commented on HUDI-1951: -- SoldierZh commented on a change in pull reque

[GitHub] [hudi] SoldierZh commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

2021-08-10 Thread GitBox
SoldierZh commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r686488735 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java ## @@ -933,6 +933,10 @@ public boolean getGlobalS

[jira] [Commented] (HUDI-1951) Hash Index for HUDI

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397062#comment-17397062 ] ASF GitHub Bot commented on HUDI-1951: -- vinothchandar commented on pull request #3173

[GitHub] [hudi] vinothchandar commented on pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

2021-08-10 Thread GitBox
vinothchandar commented on pull request #3173: URL: https://github.com/apache/hudi/pull/3173#issuecomment-896497364 @minihippo Will do. Apologize if I am slow in the next few days. trying to push out the 0.9.0 RC -- This is an automated message from the Apache Git Service. To respond to

[jira] [Commented] (HUDI-1951) Hash Index for HUDI

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397061#comment-17397061 ] ASF GitHub Bot commented on HUDI-1951: -- minihippo edited a comment on pull request #3

[GitHub] [hudi] hudi-bot edited a comment on pull request #3452: [DO_NOT_MERGE] Setting default for hoodie.bloom/simple.index.update.partition.path to true

2021-08-10 Thread GitBox
hudi-bot edited a comment on pull request #3452: URL: https://github.com/apache/hudi/pull/3452#issuecomment-896496147 ## CI report: * f6f3bf0ef9875bb41c458d3a2c3838d2aed0a8ca Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] minihippo edited a comment on pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

2021-08-10 Thread GitBox
minihippo edited a comment on pull request #3173: URL: https://github.com/apache/hudi/pull/3173#issuecomment-896477727 Hi @vinothchandar, comments added by @leesf have been resolved. Could you take another look? -- This is an automated message from the Apache Git Service. To respond to

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397060#comment-17397060 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #32

[GitHub] [hudi] hudi-bot edited a comment on pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-08-10 Thread GitBox
hudi-bot edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-875280958 ## CI report: * 2d22335c215ed620ce20018b1c83be189b7c70c6 UNKNOWN * 230205edfab190cfaf687d0323ae8d704f425e1d UNKNOWN * 77d1886c7f6c612adbe4ef81adc07075cd99bdb

[GitHub] [hudi] hudi-bot commented on pull request #3452: [DO_NOT_MERGE] Setting default for hoodie.bloom/simple.index.update.partition.path to true

2021-08-10 Thread GitBox
hudi-bot commented on pull request #3452: URL: https://github.com/apache/hudi/pull/3452#issuecomment-896496147 ## CI report: * f6f3bf0ef9875bb41c458d3a2c3838d2aed0a8ca UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[GitHub] [hudi] nsivabalan opened a new pull request #3452: [DO_NOT_MERGE] Setting default for hoodie.bloom/simple.index.update.partition.path to true

2021-08-10 Thread GitBox
nsivabalan opened a new pull request #3452: URL: https://github.com/apache/hudi/pull/3452 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purp

[GitHub] [hudi] hudi-bot edited a comment on pull request #3451: [MINOR] Correct TestKafkaSource class and comment

2021-08-10 Thread GitBox
hudi-bot edited a comment on pull request #3451: URL: https://github.com/apache/hudi/pull/3451#issuecomment-896473729 ## CI report: * b6d16db1459e8f60f9e4bc82a2365e2f0ccb00cb Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2292) MOR not support predicate pushdown when reading with payload_combine type

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397052#comment-17397052 ] ASF GitHub Bot commented on HUDI-2292: -- garyli1019 merged pull request #3443: URL: ht

[hudi] branch master updated: [HUDI-2292] MOR should not predicate pushdown when reading with payload_combine type (#3443)

2021-08-10 Thread garyli
This is an automated email from the ASF dual-hosted git repository. garyli pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new a5e496f [HUDI-2292] MOR should not predicate push

[GitHub] [hudi] garyli1019 merged pull request #3443: [HUDI-2292] MOR not support predicate pushdown when reading with payl…

2021-08-10 Thread GitBox
garyli1019 merged pull request #3443: URL: https://github.com/apache/hudi/pull/3443 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[jira] [Commented] (HUDI-1774) Add support or delete_partition with spark ds

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397045#comment-17397045 ] ASF GitHub Bot commented on HUDI-1774: -- hudi-bot edited a comment on pull request #34

[GitHub] [hudi] hudi-bot edited a comment on pull request #3437: [HUDI-1774] Adding support for delete_partitions to spark data source

2021-08-10 Thread GitBox
hudi-bot edited a comment on pull request #3437: URL: https://github.com/apache/hudi/pull/3437#issuecomment-895710798 ## CI report: * fde0b074d59f7fe89567295693f678e6981a6403 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397044#comment-17397044 ] ASF GitHub Bot commented on HUDI-1138: -- yihua commented on a change in pull request #

[GitHub] [hudi] yihua commented on a change in pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-08-10 Thread GitBox
yihua commented on a change in pull request #3233: URL: https://github.com/apache/hudi/pull/3233#discussion_r686474524 ## File path: hudi-timeline-service/src/main/java/org/apache/hudi/timeline/service/handlers/marker/MarkerDirState.java ## @@ -0,0 +1,393 @@ +/* + * Licensed t

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397041#comment-17397041 ] ASF GitHub Bot commented on HUDI-1138: -- yihua commented on a change in pull request #

[GitHub] [hudi] yihua commented on a change in pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-08-10 Thread GitBox
yihua commented on a change in pull request #3233: URL: https://github.com/apache/hudi/pull/3233#discussion_r686473475 ## File path: hudi-timeline-service/src/main/java/org/apache/hudi/timeline/service/handlers/marker/MarkerDirState.java ## @@ -0,0 +1,393 @@ +/* + * Licensed t

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397038#comment-17397038 ] ASF GitHub Bot commented on HUDI-1138: -- yihua commented on a change in pull request #

[GitHub] [hudi] yihua commented on a change in pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-08-10 Thread GitBox
yihua commented on a change in pull request #3233: URL: https://github.com/apache/hudi/pull/3233#discussion_r686471378 ## File path: hudi-timeline-service/src/main/java/org/apache/hudi/timeline/service/handlers/marker/MarkerDirRequestContext.java ## @@ -0,0 +1,57 @@ +/* + * Li

[jira] [Commented] (HUDI-1951) Hash Index for HUDI

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397036#comment-17397036 ] ASF GitHub Bot commented on HUDI-1951: -- minihippo commented on pull request #3173: UR

[GitHub] [hudi] minihippo commented on pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

2021-08-10 Thread GitBox
minihippo commented on pull request #3173: URL: https://github.com/apache/hudi/pull/3173#issuecomment-896477727 Hi @vinothchandar, can you take a look? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hudi] hudi-bot edited a comment on pull request #3451: [MINOR] Correct TestKafkaSource class and comment

2021-08-10 Thread GitBox
hudi-bot edited a comment on pull request #3451: URL: https://github.com/apache/hudi/pull/3451#issuecomment-896473729 ## CI report: * b6d16db1459e8f60f9e4bc82a2365e2f0ccb00cb Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] hudi-bot commented on pull request #3451: [MINOR] Correct TestKafkaSource class and comment

2021-08-10 Thread GitBox
hudi-bot commented on pull request #3451: URL: https://github.com/apache/hudi/pull/3451#issuecomment-896473729 ## CI report: * b6d16db1459e8f60f9e4bc82a2365e2f0ccb00cb UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[GitHub] [hudi] vinothchandar commented on pull request #3451: [MINOR] Correct TestKafkaSource class and comment

2021-08-10 Thread GitBox
vinothchandar commented on pull request #3451: URL: https://github.com/apache/hudi/pull/3451#issuecomment-896473164 Lgtm -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] yanghua opened a new pull request #3451: [MINOR] Correct TestKafkaSource class and comment

2021-08-10 Thread GitBox
yanghua opened a new pull request #3451: URL: https://github.com/apache/hudi/pull/3451 ## What is the purpose of the pull request *Correct TestKafkaSource class and comment* ## Brief change log - *Correct TestKafkaSource class and comment* ## Verify this

[jira] [Commented] (HUDI-1939) Replace joda-time api to new jdk8 time api

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397026#comment-17397026 ] ASF GitHub Bot commented on HUDI-1939: -- xushiyan merged pull request #3430: URL: http

[GitHub] [hudi] xushiyan merged pull request #3430: [HUDI-1939] remove joda time in hivesync module

2021-08-10 Thread GitBox
xushiyan merged pull request #3430: URL: https://github.com/apache/hudi/pull/3430 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr

[hudi] branch master updated: [HUDI-1939] remove joda time in hivesync module (#3430)

2021-08-10 Thread xushiyan
This is an automated email from the ASF dual-hosted git repository. xushiyan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 8255a86 [HUDI-1939] remove joda time in hivesyn

[jira] [Commented] (HUDI-1774) Add support or delete_partition with spark ds

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397016#comment-17397016 ] ASF GitHub Bot commented on HUDI-1774: -- hudi-bot edited a comment on pull request #34

[GitHub] [hudi] hudi-bot edited a comment on pull request #3437: [HUDI-1774] Adding support for delete_partitions to spark data source

2021-08-10 Thread GitBox
hudi-bot edited a comment on pull request #3437: URL: https://github.com/apache/hudi/pull/3437#issuecomment-895710798 ## CI report: * 29a3b2a5aac5b395e0705fe66dbabc959258e343 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-1774) Add support or delete_partition with spark ds

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397015#comment-17397015 ] ASF GitHub Bot commented on HUDI-1774: -- hudi-bot edited a comment on pull request #34

[GitHub] [hudi] hudi-bot edited a comment on pull request #3437: [HUDI-1774] Adding support for delete_partitions to spark data source

2021-08-10 Thread GitBox
hudi-bot edited a comment on pull request #3437: URL: https://github.com/apache/hudi/pull/3437#issuecomment-895710798 ## CI report: * 29a3b2a5aac5b395e0705fe66dbabc959258e343 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2259) [SQL]Support referencing subquery with column aliases by table alias in merge into

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397010#comment-17397010 ] ASF GitHub Bot commented on HUDI-2259: -- pengzhiwei2018 commented on pull request #338

[GitHub] [hudi] pengzhiwei2018 commented on pull request #3380: [HUDI-2259]Support referencing subquery with column aliases by table alias in me…

2021-08-10 Thread GitBox
pengzhiwei2018 commented on pull request #3380: URL: https://github.com/apache/hudi/pull/3380#issuecomment-89648 Good contribution! @dongkelun , can you run the test for spark3? Using the follow > mvn clean install -DskipTests -Pspark3 > mvn test -Punit-tests -Pspark3 -pl hud

[jira] [Commented] (HUDI-2279) Support column name matching for insert * and update set * in merge into when sourceTable's columns contains all targetTable's columns

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397009#comment-17397009 ] ASF GitHub Bot commented on HUDI-2279: -- pengzhiwei2018 commented on pull request #341

[GitHub] [hudi] pengzhiwei2018 commented on pull request #3415: [HUDI-2279]Support column name matching for insert * and update set *

2021-08-10 Thread GitBox
pengzhiwei2018 commented on pull request #3415: URL: https://github.com/apache/hudi/pull/3415#issuecomment-896454219 Hi @dongkelun , Thanks for the contribution for this. Overall LGTM except some minor optimize. And also you can run the test case in spark3 by the follow command: >

[jira] [Commented] (HUDI-2279) Support column name matching for insert * and update set * in merge into when sourceTable's columns contains all targetTable's columns

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397007#comment-17397007 ] ASF GitHub Bot commented on HUDI-2279: -- pengzhiwei2018 commented on a change in pull

[GitHub] [hudi] pengzhiwei2018 commented on a change in pull request #3415: [HUDI-2279]Support column name matching for insert * and update set *

2021-08-10 Thread GitBox
pengzhiwei2018 commented on a change in pull request #3415: URL: https://github.com/apache/hudi/pull/3415#discussion_r686447091 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/analysis/HoodieAnalysis.scala ## @@ -142,11 +142,24 @@ case c

[GitHub] [hudi] danny0405 commented on issue #3266: [SUPPORT] Upsert data with an identical record key and pre-combine field

2021-08-10 Thread GitBox
danny0405 commented on issue #3266: URL: https://github.com/apache/hudi/issues/3266#issuecomment-896450563 The PR is merged, please verify again if your issue is resolved. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[jira] [Updated] (HUDI-1763) DefaultHoodieRecordPayload does not honor ordering value when records within multiple log files are merged

2021-08-10 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-1763: - Fixed via master branch: 5448cdde7e45c39b8bf8275d9f3ee425c9bfa90e > DefaultHoodieRecordPayload does not honor

[jira] [Updated] (HUDI-1763) DefaultHoodieRecordPayload does not honor ordering value when records within multiple log files are merged

2021-08-10 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-1763: - Status: Closed (was: Patch Available) > DefaultHoodieRecordPayload does not honor ordering value when rec

[jira] [Resolved] (HUDI-2170) Always choose the latest record for HoodieRecordPayload

2021-08-10 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-2170. -- Resolution: Fixed Fixed via master branch: 5448cdde7e45c39b8bf8275d9f3ee425c9bfa90e > Always choose the

[jira] [Commented] (HUDI-2170) Always choose the latest record for HoodieRecordPayload

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17396993#comment-17396993 ] ASF GitHub Bot commented on HUDI-2170: -- danny0405 commented on pull request #3401: UR

[jira] [Commented] (HUDI-2170) Always choose the latest record for HoodieRecordPayload

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17396992#comment-17396992 ] ASF GitHub Bot commented on HUDI-2170: -- danny0405 merged pull request #3401: URL: htt

[GitHub] [hudi] danny0405 commented on pull request #3401: [HUDI-2170] [HUDI-1763] Always choose the latest record for HoodieRecordPayload

2021-08-10 Thread GitBox
danny0405 commented on pull request #3401: URL: https://github.com/apache/hudi/pull/3401#issuecomment-896449020 @vinothchandar merged. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[hudi] branch master updated (d1b4aa5 -> 5448cdd)

2021-08-10 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from d1b4aa5 [HUDI-2042] Compare the field object directly in OverwriteWithLatestAvroPayload (#3108) add 5448cdd

[GitHub] [hudi] danny0405 merged pull request #3401: [HUDI-2170] [HUDI-1763] Always choose the latest record for HoodieRecordPayload

2021-08-10 Thread GitBox
danny0405 merged pull request #3401: URL: https://github.com/apache/hudi/pull/3401 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubsc

[jira] [Commented] (HUDI-2270) Remove corrupted clean action

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17396988#comment-17396988 ] ASF GitHub Bot commented on HUDI-2270: -- yuzhaojing commented on a change in pull requ

[GitHub] [hudi] yuzhaojing commented on a change in pull request #3386: [HUDI-2270] Remove corrupted clean action

2021-08-10 Thread GitBox
yuzhaojing commented on a change in pull request #3386: URL: https://github.com/apache/hudi/pull/3386#discussion_r686440531 ## File path: hudi-flink/src/main/java/org/apache/hudi/sink/CleanFunction.java ## @@ -90,4 +100,28 @@ public void snapshotState(FunctionSnapshotContext co

[jira] [Commented] (HUDI-2270) Remove corrupted clean action

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17396986#comment-17396986 ] ASF GitHub Bot commented on HUDI-2270: -- danny0405 commented on a change in pull reque

[GitHub] [hudi] danny0405 commented on a change in pull request #3386: [HUDI-2270] Remove corrupted clean action

2021-08-10 Thread GitBox
danny0405 commented on a change in pull request #3386: URL: https://github.com/apache/hudi/pull/3386#discussion_r686438992 ## File path: hudi-flink/src/main/java/org/apache/hudi/sink/CleanFunction.java ## @@ -90,4 +100,28 @@ public void snapshotState(FunctionSnapshotContext con

[jira] [Commented] (HUDI-2167) HoodieCompactionConfig get HoodieCleaningPolicy NullPointerException

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17396985#comment-17396985 ] ASF GitHub Bot commented on HUDI-2167: -- danny0405 commented on pull request #3402: UR

[jira] [Commented] (HUDI-2167) HoodieCompactionConfig get HoodieCleaningPolicy NullPointerException

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17396984#comment-17396984 ] ASF GitHub Bot commented on HUDI-2167: -- danny0405 closed pull request #3402: URL: htt

[GitHub] [hudi] danny0405 closed pull request #3402: [HUDI-2167] HoodieCompactionConfig get HoodieCleaningPolicy NullPointerException

2021-08-10 Thread GitBox
danny0405 closed pull request #3402: URL: https://github.com/apache/hudi/pull/3402 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubsc

[GitHub] [hudi] danny0405 commented on pull request #3402: [HUDI-2167] HoodieCompactionConfig get HoodieCleaningPolicy NullPointerException

2021-08-10 Thread GitBox
danny0405 commented on pull request #3402: URL: https://github.com/apache/hudi/pull/3402#issuecomment-896441671 Not a valid fix, close it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[jira] [Commented] (HUDI-2181) Refine for FlinkCreateHandle

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17396983#comment-17396983 ] ASF GitHub Bot commented on HUDI-2181: -- danny0405 closed pull request #3281: URL: htt

[jira] [Commented] (HUDI-2181) Refine for FlinkCreateHandle

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17396982#comment-17396982 ] ASF GitHub Bot commented on HUDI-2181: -- danny0405 commented on pull request #3281: UR

[GitHub] [hudi] danny0405 closed pull request #3281: [HUDI-2181] Fix the incorrect doc descriptions for FlinkCreateHandle

2021-08-10 Thread GitBox
danny0405 closed pull request #3281: URL: https://github.com/apache/hudi/pull/3281 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubsc

[GitHub] [hudi] danny0405 commented on pull request #3281: [HUDI-2181] Fix the incorrect doc descriptions for FlinkCreateHandle

2021-08-10 Thread GitBox
danny0405 commented on pull request #3281: URL: https://github.com/apache/hudi/pull/3281#issuecomment-896440217 Sorry i don't think the fix is necessary, would close it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Commented] (HUDI-2289) add ks3 support doc for hudi

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17396980#comment-17396980 ] ASF GitHub Bot commented on HUDI-2289: -- yanghua commented on pull request #3436: URL:

[GitHub] [hudi] yanghua commented on pull request #3436: [HUDI-2289] add ks3 support doc for hudi

2021-08-10 Thread GitBox
yanghua commented on pull request #3436: URL: https://github.com/apache/hudi/pull/3436#issuecomment-896438183 > sorry for the newbie questions. whats ks3? :) It's a Chinese public cloud vendor. More details: https://www.ksyun.com/ -- This is an automated message from the Apache Git

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17396967#comment-17396967 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #32

[GitHub] [hudi] hudi-bot edited a comment on pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-08-10 Thread GitBox
hudi-bot edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-875280958 ## CI report: * 2d22335c215ed620ce20018b1c83be189b7c70c6 UNKNOWN * 230205edfab190cfaf687d0323ae8d704f425e1d UNKNOWN * 77d1886c7f6c612adbe4ef81adc07075cd99bdb

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17396966#comment-17396966 ] ASF GitHub Bot commented on HUDI-1138: -- yihua commented on a change in pull request #

[GitHub] [hudi] yihua commented on a change in pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-08-10 Thread GitBox
yihua commented on a change in pull request #3233: URL: https://github.com/apache/hudi/pull/3233#discussion_r686407495 ## File path: hudi-timeline-service/src/main/java/org/apache/hudi/timeline/service/handlers/MarkerHandler.java ## @@ -0,0 +1,193 @@ +/* + * Licensed to the Ap

[jira] [Commented] (HUDI-1774) Add support or delete_partition with spark ds

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17396965#comment-17396965 ] ASF GitHub Bot commented on HUDI-1774: -- hudi-bot edited a comment on pull request #34

[GitHub] [hudi] hudi-bot edited a comment on pull request #3437: [HUDI-1774] Adding support for delete_partitions to spark data source

2021-08-10 Thread GitBox
hudi-bot edited a comment on pull request #3437: URL: https://github.com/apache/hudi/pull/3437#issuecomment-895710798 ## CI report: * 29a3b2a5aac5b395e0705fe66dbabc959258e343 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17396962#comment-17396962 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #32

[GitHub] [hudi] hudi-bot edited a comment on pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-08-10 Thread GitBox
hudi-bot edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-875280958 ## CI report: * 2d22335c215ed620ce20018b1c83be189b7c70c6 UNKNOWN * 230205edfab190cfaf687d0323ae8d704f425e1d UNKNOWN * 77d1886c7f6c612adbe4ef81adc07075cd99bdb

[jira] [Commented] (HUDI-2285) Metadata Table Synchronous Design

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17396958#comment-17396958 ] ASF GitHub Bot commented on HUDI-2285: -- nbalajee commented on a change in pull reques

[GitHub] [hudi] nbalajee commented on a change in pull request #3426: [HUDI-2285] Metadata Table synchronous design

2021-08-10 Thread GitBox
nbalajee commented on a change in pull request #3426: URL: https://github.com/apache/hudi/pull/3426#discussion_r686405376 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java ## @@ -381,6 +387,57 @@ private bo

[jira] [Commented] (HUDI-1774) Add support or delete_partition with spark ds

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17396955#comment-17396955 ] ASF GitHub Bot commented on HUDI-1774: -- hudi-bot edited a comment on pull request #34

[GitHub] [hudi] hudi-bot edited a comment on pull request #3437: [HUDI-1774] Adding support for delete_partitions to spark data source

2021-08-10 Thread GitBox
hudi-bot edited a comment on pull request #3437: URL: https://github.com/apache/hudi/pull/3437#issuecomment-895710798 ## CI report: * 6b0461ba4e97c54ae8a07ee974ddc7d68a09fc64 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-1774) Add support or delete_partition with spark ds

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17396953#comment-17396953 ] ASF GitHub Bot commented on HUDI-1774: -- hudi-bot edited a comment on pull request #34

[GitHub] [hudi] hudi-bot edited a comment on pull request #3437: [HUDI-1774] Adding support for delete_partitions to spark data source

2021-08-10 Thread GitBox
hudi-bot edited a comment on pull request #3437: URL: https://github.com/apache/hudi/pull/3437#issuecomment-895710798 ## CI report: * 6b0461ba4e97c54ae8a07ee974ddc7d68a09fc64 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2285) Metadata Table Synchronous Design

2021-08-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17396950#comment-17396950 ] ASF GitHub Bot commented on HUDI-2285: -- nbalajee commented on a change in pull reques

[GitHub] [hudi] nbalajee commented on a change in pull request #3426: [HUDI-2285] Metadata Table synchronous design

2021-08-10 Thread GitBox
nbalajee commented on a change in pull request #3426: URL: https://github.com/apache/hudi/pull/3426#discussion_r686393903 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/metadata/SparkHoodieBackedTableMetadataWriter.java ## @@ -157,6 +147,37 @@ protec

  1   2   3   4   >