[jira] [Commented] (HUDI-1007) When earliestOffsets is greater than checkpoint, Hudi will not be able to successfully consume data

2020-06-08 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17128395#comment-17128395 ] liujinhui commented on HUDI-1007: - # This test case is really special and requires a production

svn commit: r39983 - in /dev/hudi/hudi-0.5.3-rc2: ./ hudi-0.5.3-rc2.src.tgz hudi-0.5.3-rc2.src.tgz.asc hudi-0.5.3-rc2.src.tgz.sha512

2020-06-08 Thread sivabalan
Author: sivabalan Date: Mon Jun 8 13:35:18 2020 New Revision: 39983 Log: Staging source releases for hudi release-0.5.3-rc2 Added: dev/hudi/hudi-0.5.3-rc2/ dev/hudi/hudi-0.5.3-rc2/hudi-0.5.3-rc2.src.tgz (with props) dev/hudi/hudi-0.5.3-rc2/hudi-0.5.3-rc2.src.tgz.asc

[jira] [Commented] (HUDI-875) Introduce a new pom module named hudi-common-sync

2020-06-08 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17128297#comment-17128297 ] liwei commented on HUDI-875: [https://github.com/apache/hudi/pull/1716] > Introduce a new pom module named

[hudi] annotated tag release-0.5.3-rc2 updated (41fb6c2 -> bca79c5)

2020-06-08 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to annotated tag release-0.5.3-rc2 in repository https://gitbox.apache.org/repos/asf/hudi.git. *** WARNING: tag release-0.5.3-rc2 was modified! *** from 41fb6c2 (commit) to bca79c5 (tag)

[hudi] 01/04: [HUDI-988] Fix Unit Test Flakiness : Ensure all instantiations of HoodieWriteClient is closed properly. Fix bug in TestRollbacks. Make CLI unit tests for Hudi CLI check skip redering str

2020-06-08 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.5.3 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 6dcd0a3524fe7be0bbbd3e673ed7e1d4b035e0cb Author: Balaji Varadarajan AuthorDate: Tue Jun 2 01:49:37 2020 -0700

[hudi] 03/04: Making few fixes after cherry picking

2020-06-08 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.5.3 in repository https://gitbox.apache.org/repos/asf/hudi.git commit d3afcbac3a6e5362d57570a2a5807abbf65c69d8 Author: Sivabalan Narayanan AuthorDate: Sun Jun 7 16:23:40 2020 -0400

[hudi] branch release-0.5.3 updated (5fcc461 -> 41fb6c2)

2020-06-08 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to branch release-0.5.3 in repository https://gitbox.apache.org/repos/asf/hudi.git. omit 5fcc461 Bumping release candidate number 1 new 6dcd0a3 [HUDI-988] Fix Unit Test Flakiness : Ensure

[hudi] 04/04: Bumping release candidate number 2

2020-06-08 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.5.3 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 41fb6c268c6e84949ee70f305df93680c431a9da Author: Sivabalan Narayanan AuthorDate: Mon Jun 8 08:41:25 2020 -0400

[hudi] 02/04: [HUDI-990] Timeline API : filterCompletedAndCompactionInstants needs to handle requested state correctly. Also ensure timeline gets reloaded after we revert committed transactions

2020-06-08 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.5.3 in repository https://gitbox.apache.org/repos/asf/hudi.git commit ae48ecbe232eb55267d1a138baeec13baa1fb249 Author: Balaji Varadarajan AuthorDate: Wed Jun 3 00:35:14 2020 -0700

[hudi] branch master updated: [HUDI-918] Fix kafkaOffsetGen can not read kafka data bug (#1652)

2020-06-08 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 97ab97b [HUDI-918] Fix kafkaOffsetGen can not

[jira] [Updated] (HUDI-1002) Ignore case when setting incremental mode in hive query

2020-06-08 Thread Hong Shen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Shen updated HUDI-1002: Status: Open (was: New) > Ignore case when setting incremental mode in hive query >

[jira] [Resolved] (HUDI-1002) Ignore case when setting incremental mode in hive query

2020-06-08 Thread Hong Shen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Shen resolved HUDI-1002. - Resolution: Fixed > Ignore case when setting incremental mode in hive query >

[jira] [Commented] (HUDI-1007) When earliestOffsets is greater than checkpoint, Hudi will not be able to successfully consume data

2020-06-08 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17128238#comment-17128238 ] Vinoth Chandar commented on HUDI-1007: -- [~liujinhui] My understanding is this must be handled already

[jira] [Commented] (HUDI-944) Support more complete concurrency control when writing data

2020-06-08 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17128222#comment-17128222 ] Vinoth Chandar commented on HUDI-944: - Hi [~309637554] please go ahead with HUDI-839 tests if that's a

[jira] [Commented] (HUDI-1007) When earliestOffsets is greater than checkpoint, Hudi will not be able to successfully consume data

2020-06-08 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17128220#comment-17128220 ] liujinhui commented on HUDI-1007: - *[~vinoth]  What is your idea?* > When earliestOffsets is greater than

[jira] [Updated] (HUDI-1007) When earliestOffsets is greater than checkpoint, Hudi will not be able to successfully consume data

2020-06-08 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-1007: Description: Use deltastreamer to consume kafka, When earliestOffsets is greater than checkpoint, Hudi

[jira] [Created] (HUDI-1007) When earliestOffsets is greater than checkpoint, Hudi will not be able to successfully consume data

2020-06-08 Thread liujinhui (Jira)
liujinhui created HUDI-1007: --- Summary: When earliestOffsets is greater than checkpoint, Hudi will not be able to successfully consume data Key: HUDI-1007 URL: https://issues.apache.org/jira/browse/HUDI-1007

[jira] [Assigned] (HUDI-1007) When earliestOffsets is greater than checkpoint, Hudi will not be able to successfully consume data

2020-06-08 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui reassigned HUDI-1007: --- Assignee: liujinhui > When earliestOffsets is greater than checkpoint, Hudi will not be able to >

[hudi] branch master updated: [HUDI-1002] Ignore case when setting incremental mode in hive query (#1715)

2020-06-08 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 2901f54 [HUDI-1002] Ignore case when setting

[jira] [Assigned] (HUDI-1006) deltastreamer set auto.offset.reset=latest can't consume data

2020-06-08 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui reassigned HUDI-1006: --- Assignee: Tianye Li (was: liujinhui) > deltastreamer set auto.offset.reset=latest can't consume

[jira] [Commented] (HUDI-1006) deltastreamer set auto.offset.reset=latest can't consume data

2020-06-08 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17128197#comment-17128197 ] liujinhui commented on HUDI-1006: - [~Litianye]  It's up to you to fix this problem > deltastreamer set

[GitHub] [hudi] bvaradar commented on pull request #1712: Cherry picking HUDI-988 and HUDI-990 to release-0.5.3

2020-06-08 Thread GitBox
bvaradar commented on pull request #1712: URL: https://github.com/apache/hudi/pull/1712#issuecomment-640265188 @nsivabalan : Lets wait for tests to pass before you can merge to 0.5.3 branch This is an automated message from

[GitHub] [hudi] codecov-commenter edited a comment on pull request #1664: HUDI-942 Increase default value number of delta commits for inline compaction

2020-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #1664: URL: https://github.com/apache/hudi/pull/1664#issuecomment-640292029 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1664?src=pr=h1) Report > Merging [#1664](https://codecov.io/gh/apache/hudi/pull/1664?src=pr=desc) into

[GitHub] [hudi] RocMarshal commented on issue #143: Tracking ticket for folks to be added to slack group

2020-06-08 Thread GitBox
RocMarshal commented on issue #143: URL: https://github.com/apache/hudi/issues/143#issuecomment-640085114 Could you add me to the slack channel? flin...@126.com Thank you. This is an automated message from the Apache Git

[GitHub] [hudi] vinothchandar commented on a change in pull request #1710: [MINOR] Fix delta streamer write config

2020-06-08 Thread GitBox
vinothchandar commented on a change in pull request #1710: URL: https://github.com/apache/hudi/pull/1710#discussion_r436611592 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/DeltaSync.java ## @@ -497,25 +499,30 @@ private void

[GitHub] [hudi] codecov-commenter edited a comment on pull request #1715: [HUDI-1002] Ignore case when setting incremental mode in hive query

2020-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #1715: URL: https://github.com/apache/hudi/pull/1715#issuecomment-640451170 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1715?src=pr=h1) Report > Merging [#1715](https://codecov.io/gh/apache/hudi/pull/1715?src=pr=desc) into

[GitHub] [hudi] codecov-commenter commented on pull request #1715: [HUDI-1002] Ignore case when setting incremental mode in hive query

2020-06-08 Thread GitBox
codecov-commenter commented on pull request #1715: URL: https://github.com/apache/hudi/pull/1715#issuecomment-640451170 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1715?src=pr=h1) Report > Merging [#1715](https://codecov.io/gh/apache/hudi/pull/1715?src=pr=desc) into

[jira] [Updated] (HUDI-1002) Ignore case when setting incremental mode in hive query

2020-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-1002: - Labels: newbie pull-request-available (was: newbie) > Ignore case when setting incremental mode

[GitHub] [hudi] shenh062326 opened a new pull request #1715: [HUDI-1002] Ignore case when setting incremental mode in hive query

2020-06-08 Thread GitBox
shenh062326 opened a new pull request #1715: URL: https://github.com/apache/hudi/pull/1715 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of

[GitHub] [hudi] Litianye commented on issue #143: Tracking ticket for folks to be added to slack group

2020-06-08 Thread GitBox
Litianye commented on issue #143: URL: https://github.com/apache/hudi/issues/143#issuecomment-640426343 please add litiany...@outlook.com This is an automated message from the Apache Git Service. To respond to the message,

[hudi] branch master updated: [HUDI-1000] Fix incremental query for COW non-partitioned table with no data (#1708)

2020-06-08 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new e0a5e0d [HUDI-1000] Fix incremental query for COW

[GitHub] [hudi] leesf merged pull request #1708: [HUDI-1000] Fix incremental query for COW non-partitioned table with no data

2020-06-08 Thread GitBox
leesf merged pull request #1708: URL: https://github.com/apache/hudi/pull/1708 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Updated] (HUDI-1006) deltastreamer set auto.offset.reset=latest can't consume data

2020-06-08 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-1006: Status: Open (was: New) > deltastreamer set auto.offset.reset=latest can't consume data >

[jira] [Created] (HUDI-1006) deltastreamer set auto.offset.reset=latest can't consume data

2020-06-08 Thread liujinhui (Jira)
liujinhui created HUDI-1006: --- Summary: deltastreamer set auto.offset.reset=latest can't consume data Key: HUDI-1006 URL: https://issues.apache.org/jira/browse/HUDI-1006 Project: Apache Hudi Issue

[GitHub] [hudi] codecov-commenter commented on pull request #1706: [HUDI-998] Introduce a robot to build testing website automatically

2020-06-08 Thread GitBox
codecov-commenter commented on pull request #1706: URL: https://github.com/apache/hudi/pull/1706#issuecomment-640409433 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1706?src=pr=h1) Report > Merging [#1706](https://codecov.io/gh/apache/hudi/pull/1706?src=pr=desc) into

[GitHub] [hudi] codecov-commenter commented on pull request #1714: [HUDI-1005] fix NPE in HoodieWriteClient.clean

2020-06-08 Thread GitBox
codecov-commenter commented on pull request #1714: URL: https://github.com/apache/hudi/pull/1714#issuecomment-640408285 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1714?src=pr=h1) Report > Merging [#1714](https://codecov.io/gh/apache/hudi/pull/1714?src=pr=desc) into

[GitHub] [hudi] codecov-commenter commented on pull request #1710: [MINOR] Fix delta streamer write config

2020-06-08 Thread GitBox
codecov-commenter commented on pull request #1710: URL: https://github.com/apache/hudi/pull/1710#issuecomment-640407664 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1710?src=pr=h1) Report > Merging [#1710](https://codecov.io/gh/apache/hudi/pull/1710?src=pr=desc) into

[jira] [Commented] (HUDI-1002) Ignore case when setting incremental mode in hive query

2020-06-08 Thread Hong Shen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127926#comment-17127926 ] Hong Shen commented on HUDI-1002: - [~xleesf] I'm going to work on this. :D > Ignore case when setting

[jira] [Assigned] (HUDI-1002) Ignore case when setting incremental mode in hive query

2020-06-08 Thread Hong Shen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Shen reassigned HUDI-1002: --- Assignee: Hong Shen > Ignore case when setting incremental mode in hive query >

[GitHub] [hudi] bvaradar commented on pull request #1650: [HUDI-541]: replaced dataFile/df with baseFile/bf throughout code base

2020-06-08 Thread GitBox
bvaradar commented on pull request #1650: URL: https://github.com/apache/hudi/pull/1650#issuecomment-640395176 @pratyakshsharma : Can you resolve conflicts and rebase when you get a chance ? This is an automated message

[GitHub] [hudi] bvaradar merged pull request #1707: [HUDI-988] fix more unit tests flakiness

2020-06-08 Thread GitBox
bvaradar merged pull request #1707: URL: https://github.com/apache/hudi/pull/1707 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[hudi] branch master updated: [HUDI-988] Fix More Unit Test Flakiness

2020-06-08 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new e9cab67 [HUDI-988] Fix More Unit Test Flakiness

[GitHub] [hudi] bvaradar commented on pull request #1707: [HUDI-988] fix more unit tests flakiness

2020-06-08 Thread GitBox
bvaradar commented on pull request #1707: URL: https://github.com/apache/hudi/pull/1707#issuecomment-640391981 Will merge this change and re-trigger other PRs This is an automated message from the Apache Git Service. To

[GitHub] [hudi] bvaradar commented on a change in pull request #1707: [HUDI-988] fix more unit tests flakiness

2020-06-08 Thread GitBox
bvaradar commented on a change in pull request #1707: URL: https://github.com/apache/hudi/pull/1707#discussion_r436475281 ## File path: hudi-client/src/test/java/org/apache/hudi/client/TestMultiFS.java ## @@ -63,9 +63,7 @@ public void setUp() throws Exception { @AfterEach

[GitHub] [hudi] codecov-commenter edited a comment on pull request #1707: [HUDI-988] fix more unit tests flakiness

2020-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #1707: URL: https://github.com/apache/hudi/pull/1707#issuecomment-639967452 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1707?src=pr=h1) Report > Merging [#1707](https://codecov.io/gh/apache/hudi/pull/1707?src=pr=desc) into

<    1   2