[GitHub] [hudi] hudi-bot edited a comment on pull request #2903: [HUDI-1850] Fixing read of a empty table but with failed write

2021-06-26 Thread GitBox
hudi-bot edited a comment on pull request #2903: URL: https://github.com/apache/hudi/pull/2903#issuecomment-864727710 ## CI report: * 0b48bd5b7dbf9fcd22d9e5730b1a660275ebcf54 Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2903: [HUDI-1850] Fixing read of a empty table but with failed write

2021-06-26 Thread GitBox
codecov-commenter edited a comment on pull request #2903: URL: https://github.com/apache/hudi/pull/2903#issuecomment-830002783 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2903: [HUDI-1850] Fixing read of a empty table but with failed write

2021-06-26 Thread GitBox
codecov-commenter edited a comment on pull request #2903: URL: https://github.com/apache/hudi/pull/2903#issuecomment-830002783 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3092: [HUDI-1910] Commit Offset to Kafka after successful Hudi commit

2021-06-26 Thread GitBox
hudi-bot edited a comment on pull request #3092: URL: https://github.com/apache/hudi/pull/3092#issuecomment-862136673 ## CI report: * 3b02a03a355c85723b69c9d8b4557c5983c8914f Azure:

[GitHub] [hudi] veenaypatil commented on pull request #3092: [HUDI-1910] Commit Offset to Kafka after successful Hudi commit

2021-06-26 Thread GitBox
veenaypatil commented on pull request #3092: URL: https://github.com/apache/hudi/pull/3092#issuecomment-869102385 @hudi-bot run travis -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[hudi] branch master updated (f73bedd -> e99a6b0)

2021-06-26 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from f73bedd [MINOR] Remove unused methods (#3152) add e99a6b0 [HUDI-2073] Fix the bug of hoodieClusteringJob never

[GitHub] [hudi] vinothchandar merged pull request #3157: [HUDI-2073] Fix the bug of hoodieClusteringJob never quit

2021-06-26 Thread GitBox
vinothchandar merged pull request #3157: URL: https://github.com/apache/hudi/pull/3157 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2903: [HUDI-1850] Fixing read of a empty table but with failed write

2021-06-26 Thread GitBox
codecov-commenter edited a comment on pull request #2903: URL: https://github.com/apache/hudi/pull/2903#issuecomment-830002783 #

[GitHub] [hudi] vinothchandar commented on pull request #2963: [HUDI-1904] Introduce SchemaProviderInterface to make SchemaProvider unified

2021-06-26 Thread GitBox
vinothchandar commented on pull request #2963: URL: https://github.com/apache/hudi/pull/2963#issuecomment-869100896 >Can we refactor all SchemaProviders without respecting compatibility? In general, I would love to not break compatibility esp for something like `SchemaProvider`,

[GitHub] [hudi] hudi-bot edited a comment on pull request #2903: [HUDI-1850] Fixing read of a empty table but with failed write

2021-06-26 Thread GitBox
hudi-bot edited a comment on pull request #2903: URL: https://github.com/apache/hudi/pull/2903#issuecomment-864727710 ## CI report: * f474fba1301a32298a4297f4a9dffc2bd99f518b Azure:

[GitHub] [hudi] veenaypatil closed pull request #3092: [HUDI-1910] Commit Offset to Kafka after successful Hudi commit

2021-06-26 Thread GitBox
veenaypatil closed pull request #3092: URL: https://github.com/apache/hudi/pull/3092 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] hudi-bot edited a comment on pull request #2903: [HUDI-1850] Fixing read of a empty table but with failed write

2021-06-26 Thread GitBox
hudi-bot edited a comment on pull request #2903: URL: https://github.com/apache/hudi/pull/2903#issuecomment-864727710 ## CI report: * f474fba1301a32298a4297f4a9dffc2bd99f518b Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3158: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer

2021-06-26 Thread GitBox
hudi-bot edited a comment on pull request #3158: URL: https://github.com/apache/hudi/pull/3158#issuecomment-868810948 ## CI report: * 3293dcf9b15091c3a5b41c6962a3cc8ca4ef90e2 UNKNOWN * 82ef082e92d7492a1055bfcfe2e8b5f230e7ef9e Azure:

[jira] [Assigned] (HUDI-2081) Move TestHiveSyncTool to functional

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-2081: Assignee: Raymond Xu > Move TestHiveSyncTool to functional > --- >

[jira] [Created] (HUDI-2081) Move TestHiveSyncTool to functional

2021-06-26 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-2081: Summary: Move TestHiveSyncTool to functional Key: HUDI-2081 URL: https://issues.apache.org/jira/browse/HUDI-2081 Project: Apache Hudi Issue Type: Sub-task

[GitHub] [hudi] hudi-bot edited a comment on pull request #3003: [HUDI-1939][WIP] Replace joda-time api with java8 new time api

2021-06-26 Thread GitBox
hudi-bot edited a comment on pull request #3003: URL: https://github.com/apache/hudi/pull/3003#issuecomment-862614384 ## CI report: * d526a0f36f8a33f9f6fb75631bc05133dfdfa3ac Azure:

[jira] [Created] (HUDI-2080) Migrate to ubuntu 20.04 for Azure pipeline builds

2021-06-26 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-2080: Summary: Migrate to ubuntu 20.04 for Azure pipeline builds Key: HUDI-2080 URL: https://issues.apache.org/jira/browse/HUDI-2080 Project: Apache Hudi Issue Type:

[jira] [Updated] (HUDI-1251) [UMBRELLA] Migrate CI to azure

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1251: - Status: In Progress (was: Open) > [UMBRELLA] Migrate CI to azure > --- > >

[jira] [Closed] (HUDI-1055) Ensure hardcoded storage type ".parquet" is removed from tests

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-1055. > Ensure hardcoded storage type ".parquet" is removed from tests >

[jira] [Resolved] (HUDI-1055) Ensure hardcoded storage type ".parquet" is removed from tests

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-1055. -- Resolution: Fixed > Ensure hardcoded storage type ".parquet" is removed from tests >

[jira] [Updated] (HUDI-1055) Ensure hardcoded storage type ".parquet" is removed from tests

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1055: - Status: In Progress (was: Open) > Ensure hardcoded storage type ".parquet" is removed from tests >

[jira] [Updated] (HUDI-1033) Remove redundant CLI tests

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1033: - Parent: HUDI-1248 Issue Type: Sub-task (was: Task) > Remove redundant CLI tests >

[jira] [Created] (HUDI-2079) Move CLI integ tests to functional

2021-06-26 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-2079: Summary: Move CLI integ tests to functional Key: HUDI-2079 URL: https://issues.apache.org/jira/browse/HUDI-2079 Project: Apache Hudi Issue Type: Sub-task

[GitHub] [hudi] hudi-bot edited a comment on pull request #2906: [HUDI-393] remove travis

2021-06-26 Thread GitBox
hudi-bot edited a comment on pull request #2906: URL: https://github.com/apache/hudi/pull/2906#issuecomment-830929050 ## CI report: * e96f2c03ab0f4fd6deb6803479fa6624eb21ed73 UNKNOWN * 0985b9b4a64b8015257eae8d85dfd899acf7a910 UNKNOWN *

[jira] [Assigned] (HUDI-1939) Replace joda-time api to new jdk8 time api

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-1939: Assignee: Xuedong Luan > Replace joda-time api to new jdk8 time api >

[jira] [Updated] (HUDI-1939) Replace joda-time api to new jdk8 time api

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1939: - Status: In Progress (was: Open) > Replace joda-time api to new jdk8 time api >

[jira] [Updated] (HUDI-1939) Replace joda-time api to new jdk8 time api

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1939: - Fix Version/s: 0.9.0 > Replace joda-time api to new jdk8 time api >

[GitHub] [hudi] hudi-bot edited a comment on pull request #3158: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer

2021-06-26 Thread GitBox
hudi-bot edited a comment on pull request #3158: URL: https://github.com/apache/hudi/pull/3158#issuecomment-868810948 ## CI report: * 3293dcf9b15091c3a5b41c6962a3cc8ca4ef90e2 UNKNOWN * 82ef082e92d7492a1055bfcfe2e8b5f230e7ef9e Azure:

[GitHub] [hudi] xushiyan commented on pull request #3158: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer

2021-06-26 Thread GitBox
xushiyan commented on pull request #3158: URL: https://github.com/apache/hudi/pull/3158#issuecomment-869092386 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] hudi-bot edited a comment on pull request #3003: [HUDI-1939][WIP] Replace joda-time api with java8 new time api

2021-06-26 Thread GitBox
hudi-bot edited a comment on pull request #3003: URL: https://github.com/apache/hudi/pull/3003#issuecomment-862614384 ## CI report: * 8d94a36500f3cf8b3a589e01817ecfa71ab149a6 Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3003: [HUDI-1939][WIP] Replace joda-time api with java8 new time api

2021-06-26 Thread GitBox
codecov-commenter edited a comment on pull request #3003: URL: https://github.com/apache/hudi/pull/3003#issuecomment-849682114 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3003: [HUDI-1939][WIP] Replace joda-time api with java8 new time api

2021-06-26 Thread GitBox
hudi-bot edited a comment on pull request #3003: URL: https://github.com/apache/hudi/pull/3003#issuecomment-862614384 ## CI report: * 8d94a36500f3cf8b3a589e01817ecfa71ab149a6 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #2906: [HUDI-393] remove travis

2021-06-26 Thread GitBox
hudi-bot edited a comment on pull request #2906: URL: https://github.com/apache/hudi/pull/2906#issuecomment-830929050 ## CI report: * e96f2c03ab0f4fd6deb6803479fa6624eb21ed73 UNKNOWN * 0985b9b4a64b8015257eae8d85dfd899acf7a910 UNKNOWN *

[GitHub] [hudi] hudi-bot edited a comment on pull request #3003: [HUDI-1939][WIP] Replace joda-time api with java8 new time api

2021-06-26 Thread GitBox
hudi-bot edited a comment on pull request #3003: URL: https://github.com/apache/hudi/pull/3003#issuecomment-862614384 ## CI report: * 8d94a36500f3cf8b3a589e01817ecfa71ab149a6 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #2906: [HUDI-393] remove travis

2021-06-26 Thread GitBox
hudi-bot edited a comment on pull request #2906: URL: https://github.com/apache/hudi/pull/2906#issuecomment-830929050 ## CI report: * e96f2c03ab0f4fd6deb6803479fa6624eb21ed73 UNKNOWN * 0985b9b4a64b8015257eae8d85dfd899acf7a910 UNKNOWN *

[GitHub] [hudi] hudi-bot edited a comment on pull request #3003: [HUDI-1939][WIP] Replace joda-time api with java8 new time api

2021-06-26 Thread GitBox
hudi-bot edited a comment on pull request #3003: URL: https://github.com/apache/hudi/pull/3003#issuecomment-862614384 ## CI report: * 8d94a36500f3cf8b3a589e01817ecfa71ab149a6 UNKNOWN * Unknown: [CANCELED](TBD) Bot commands @hudi-bot supports the following

[GitHub] [hudi] hudi-bot edited a comment on pull request #3003: [HUDI-1939][WIP] Replace joda-time api with java8 new time api

2021-06-26 Thread GitBox
hudi-bot edited a comment on pull request #3003: URL: https://github.com/apache/hudi/pull/3003#issuecomment-862614384 ## CI report: * 78c45ef09aabeef4de3e604408a820382dd6a419 Azure:

[GitHub] [hudi] xushiyan commented on pull request #3003: [HUDI-1939][WIP] Replace joda-time api with java8 new time api

2021-06-26 Thread GitBox
xushiyan commented on pull request #3003: URL: https://github.com/apache/hudi/pull/3003#issuecomment-869088072 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3003: [HUDI-1939][WIP] Replace joda-time api with java8 new time api

2021-06-26 Thread GitBox
codecov-commenter edited a comment on pull request #3003: URL: https://github.com/apache/hudi/pull/3003#issuecomment-849682114 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3003: [HUDI-1939][WIP] Replace joda-time api with java8 new time api

2021-06-26 Thread GitBox
codecov-commenter edited a comment on pull request #3003: URL: https://github.com/apache/hudi/pull/3003#issuecomment-849682114 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3003: [HUDI-1939][WIP] Replace joda-time api with java8 new time api

2021-06-26 Thread GitBox
hudi-bot edited a comment on pull request #3003: URL: https://github.com/apache/hudi/pull/3003#issuecomment-862614384 ## CI report: * 99a9812f0b93aed1fe87aa1c7c8d27b6f03b003b Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3003: [HUDI-1939][WIP] Replace joda-time api with java8 new time api

2021-06-26 Thread GitBox
hudi-bot edited a comment on pull request #3003: URL: https://github.com/apache/hudi/pull/3003#issuecomment-862614384 ## CI report: * 99a9812f0b93aed1fe87aa1c7c8d27b6f03b003b Azure:

[jira] [Updated] (HUDI-1985) Website re-design implementation

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1985: - Description: To provide better navigation and organization of Hudi website's info, we have done a

[jira] [Updated] (HUDI-1010) Fix the memory leak for hudi-client unit tests

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1010: - Description: hudi-client unit test has a memory leak, which could be some resources are not properly

[jira] [Closed] (HUDI-997) Debug possible memory leaks when running tests in hudi-client

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-997. --- Assignee: (was: lamber-ken) Resolution: Duplicate Duplicate. Referencing this from HUDI-1010 >

[jira] [Commented] (HUDI-2077) Flaky test: TestHoodieDeltaStreamer

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17370132#comment-17370132 ] Raymond Xu commented on HUDI-2077: -- [~codope] assigning to you since you made a PR to increase the

[jira] [Assigned] (HUDI-2077) Flaky test: TestHoodieDeltaStreamer

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-2077: Assignee: Sagar Sumit > Flaky test: TestHoodieDeltaStreamer > ---

[jira] [Created] (HUDI-2078) Flaky test: TestCleaner

2021-06-26 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-2078: Summary: Flaky test: TestCleaner Key: HUDI-2078 URL: https://issues.apache.org/jira/browse/HUDI-2078 Project: Apache Hudi Issue Type: Sub-task Components:

[jira] [Created] (HUDI-2077) Flaky test: TestHoodieDeltaStreamer

2021-06-26 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-2077: Summary: Flaky test: TestHoodieDeltaStreamer Key: HUDI-2077 URL: https://issues.apache.org/jira/browse/HUDI-2077 Project: Apache Hudi Issue Type: Sub-task

[jira] [Created] (HUDI-2076) Flaky test: TestHoodieMultiTableDeltaStreamer

2021-06-26 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-2076: Summary: Flaky test: TestHoodieMultiTableDeltaStreamer Key: HUDI-2076 URL: https://issues.apache.org/jira/browse/HUDI-2076 Project: Apache Hudi Issue Type: Sub-task

[jira] [Created] (HUDI-2075) Flaky test: TestRowDataToHoodieFunction

2021-06-26 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-2075: Summary: Flaky test: TestRowDataToHoodieFunction Key: HUDI-2075 URL: https://issues.apache.org/jira/browse/HUDI-2075 Project: Apache Hudi Issue Type: Sub-task

[jira] [Commented] (HUDI-1989) Flaky test : TestHoodieMergeOnReadTable

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17370131#comment-17370131 ] Raymond Xu commented on HUDI-1989: -- Consolidated failed cases *

[jira] [Updated] (HUDI-997) Debug possible memory leaks when running tests in hudi-client

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-997: Parent: HUDI-1248 Issue Type: Sub-task (was: Task) > Debug possible memory leaks when running tests

[jira] [Updated] (HUDI-1010) Fix the memory leak for hudi-client unit tests

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1010: - Parent: HUDI-1248 Issue Type: Sub-task (was: Bug) > Fix the memory leak for hudi-client unit

[jira] [Updated] (HUDI-1989) Flaky test : TestHoodieMergeOnReadTable

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1989: - Parent: HUDI-1248 Issue Type: Sub-task (was: Bug) > Flaky test : TestHoodieMergeOnReadTable >

[GitHub] [hudi] hudi-bot edited a comment on pull request #3092: [HUDI-1910] Commit Offset to Kafka after successful Hudi commit

2021-06-26 Thread GitBox
hudi-bot edited a comment on pull request #3092: URL: https://github.com/apache/hudi/pull/3092#issuecomment-862136673 ## CI report: * 3b02a03a355c85723b69c9d8b4557c5983c8914f Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3092: [HUDI-1910] Commit Offset to Kafka after successful Hudi commit

2021-06-26 Thread GitBox
codecov-commenter edited a comment on pull request #3092: URL: https://github.com/apache/hudi/pull/3092#issuecomment-864517429 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3092: [HUDI-1910] Commit Offset to Kafka after successful Hudi commit

2021-06-26 Thread GitBox
codecov-commenter edited a comment on pull request #3092: URL: https://github.com/apache/hudi/pull/3092#issuecomment-864517429 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3092: [HUDI-1910] Commit Offset to Kafka after successful Hudi commit

2021-06-26 Thread GitBox
codecov-commenter edited a comment on pull request #3092: URL: https://github.com/apache/hudi/pull/3092#issuecomment-864517429 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3092: [HUDI-1910] Commit Offset to Kafka after successful Hudi commit

2021-06-26 Thread GitBox
hudi-bot edited a comment on pull request #3092: URL: https://github.com/apache/hudi/pull/3092#issuecomment-862136673 ## CI report: * 2d5c2588f9088daef2800600558ebaa7d6d05212 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3092: [HUDI-1910] Commit Offset to Kafka after successful Hudi commit

2021-06-26 Thread GitBox
hudi-bot edited a comment on pull request #3092: URL: https://github.com/apache/hudi/pull/3092#issuecomment-862136673 ## CI report: * 2d5c2588f9088daef2800600558ebaa7d6d05212 Azure:

[GitHub] [hudi] cb149 opened a new issue #3161: [SUPPORT] Spark Structured Streaming from Kafka to HoodieStreamingSink missing messages

2021-06-26 Thread GitBox
cb149 opened a new issue #3161: URL: https://github.com/apache/hudi/issues/3161 **Describe the problem you faced** I have a Spark Structured Streaming application running on YARN which I trigger once at the start of every hour. Now I have discovered missing messages in my Hudi

[jira] [Updated] (HUDI-1628) Improve data locality during ingestion

2021-06-26 Thread Thirumalai Raj R (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thirumalai Raj R updated HUDI-1628: --- Status: In Progress (was: Open) > Improve data locality during ingestion >

[jira] [Assigned] (HUDI-1630) Add partitioner strategy for improving data locality

2021-06-26 Thread Thirumalai Raj R (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thirumalai Raj R reassigned HUDI-1630: -- Assignee: Thirumalai Raj R > Add partitioner strategy for improving data locality >

[jira] [Assigned] (HUDI-1631) Sort data when creating a new version of file

2021-06-26 Thread Thirumalai Raj R (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thirumalai Raj R reassigned HUDI-1631: -- Assignee: Thirumalai Raj R > Sort data when creating a new version of file >

[jira] [Assigned] (HUDI-1629) Change partitioner abstraction to implement multiple strategies

2021-06-26 Thread Thirumalai Raj R (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thirumalai Raj R reassigned HUDI-1629: -- Assignee: Thirumalai Raj R > Change partitioner abstraction to implement multiple

[jira] [Commented] (HUDI-1628) Improve data locality during ingestion

2021-06-26 Thread Thirumalai Raj R (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17369897#comment-17369897 ] Thirumalai Raj R commented on HUDI-1628: [~vinoth], I am interested in taking up this task, will

[jira] [Assigned] (HUDI-1628) Improve data locality during ingestion

2021-06-26 Thread Thirumalai Raj R (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thirumalai Raj R reassigned HUDI-1628: -- Assignee: Thirumalai Raj R > Improve data locality during ingestion >

[GitHub] [hudi] leesf commented on a change in pull request #3146: [HUDI-2057] CTAS Generate An External Table When Create Managed Table

2021-06-26 Thread GitBox
leesf commented on a change in pull request #3146: URL: https://github.com/apache/hudi/pull/3146#discussion_r659178041 ## File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala ## @@ -355,6 +355,8 @@ object

[GitHub] [hudi] leesf commented on a change in pull request #3154: [HUDI-1884] MergeInto Support Partial Update For COW

2021-06-26 Thread GitBox
leesf commented on a change in pull request #3154: URL: https://github.com/apache/hudi/pull/3154#discussion_r659177860 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/analysis/HoodieAnalysis.scala ## @@ -164,7 +165,47 @@ case class

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3159: [HUDI-2074] Use while loop instead of recursive call in MergeOnReadIn…

2021-06-26 Thread GitBox
codecov-commenter edited a comment on pull request #3159: URL: https://github.com/apache/hudi/pull/3159#issuecomment-868942332 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3159: [HUDI-2074] Use while loop instead of recursive call in MergeOnReadIn…

2021-06-26 Thread GitBox
codecov-commenter edited a comment on pull request #3159: URL: https://github.com/apache/hudi/pull/3159#issuecomment-868942332 #

[GitHub] [hudi] leesf commented on pull request #3145: [Docs] Improving Hudi Configurations docs

2021-06-26 Thread GitBox
leesf commented on pull request #3145: URL: https://github.com/apache/hudi/pull/3145#issuecomment-869003484 @zhangyue19921010 thanks for your contribution, would you please generate the site in your local and paste the pic? -- This is an automated message from the Apache Git Service. To

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3159: [HUDI-2074] Use while loop instead of recursive call in MergeOnReadIn…

2021-06-26 Thread GitBox
codecov-commenter edited a comment on pull request #3159: URL: https://github.com/apache/hudi/pull/3159#issuecomment-868942332 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3159: [HUDI-2074] Use while loop instead of recursive call in MergeOnReadIn…

2021-06-26 Thread GitBox
codecov-commenter edited a comment on pull request #3159: URL: https://github.com/apache/hudi/pull/3159#issuecomment-868942332 #

[GitHub] [hudi] danny0405 closed pull request #3159: [HUDI-2074] Use while loop instead of recursive call in MergeOnReadIn…

2021-06-26 Thread GitBox
danny0405 closed pull request #3159: URL: https://github.com/apache/hudi/pull/3159 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3158: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer

2021-06-26 Thread GitBox
hudi-bot edited a comment on pull request #3158: URL: https://github.com/apache/hudi/pull/3158#issuecomment-868810948 ## CI report: * 3293dcf9b15091c3a5b41c6962a3cc8ca4ef90e2 UNKNOWN * 82ef082e92d7492a1055bfcfe2e8b5f230e7ef9e Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3158: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer

2021-06-26 Thread GitBox
hudi-bot edited a comment on pull request #3158: URL: https://github.com/apache/hudi/pull/3158#issuecomment-868810948 ## CI report: * 3293dcf9b15091c3a5b41c6962a3cc8ca4ef90e2 UNKNOWN * 49e9bb35d22e4b4e7b2114733df056b55365cb0e Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3158: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer

2021-06-26 Thread GitBox
codecov-commenter edited a comment on pull request #3158: URL: https://github.com/apache/hudi/pull/3158#issuecomment-868866588 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3158: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer

2021-06-26 Thread GitBox
codecov-commenter edited a comment on pull request #3158: URL: https://github.com/apache/hudi/pull/3158#issuecomment-868866588 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3158: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer

2021-06-26 Thread GitBox
codecov-commenter edited a comment on pull request #3158: URL: https://github.com/apache/hudi/pull/3158#issuecomment-868866588 #

[GitHub] [hudi] codope commented on a change in pull request #3097: [HUDI-1996] Adding functionality to allow the providing of basic auth creds for confluent cloud schema registry

2021-06-26 Thread GitBox
codope commented on a change in pull request #3097: URL: https://github.com/apache/hudi/pull/3097#discussion_r659151072 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/schema/SchemaRegistryProvider.java ## @@ -48,19 +54,40 @@

[GitHub] [hudi] codope edited a comment on pull request #3097: [HUDI-1996] Adding functionality to allow the providing of basic auth creds for confluent cloud schema registry

2021-06-26 Thread GitBox
codope edited a comment on pull request #3097: URL: https://github.com/apache/hudi/pull/3097#issuecomment-868981651 > @codope : I remember you had a local confluent set up right. Do you think you can test this patch out. Also, feel free to review the patch. @nsivabalan I tested this

[GitHub] [hudi] codope commented on pull request #3097: [HUDI-1996] Adding functionality to allow the providing of basic auth creds for confluent cloud schema registry

2021-06-26 Thread GitBox
codope commented on pull request #3097: URL: https://github.com/apache/hudi/pull/3097#issuecomment-868981651 > @codope : I remember you had a local confluent set up right. Do you think you can test this patch out. Also, feel free to review the patch. I tested this patch. It works.

[GitHub] [hudi] hudi-bot edited a comment on pull request #3158: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer

2021-06-26 Thread GitBox
hudi-bot edited a comment on pull request #3158: URL: https://github.com/apache/hudi/pull/3158#issuecomment-868810948 ## CI report: * 3293dcf9b15091c3a5b41c6962a3cc8ca4ef90e2 UNKNOWN * 49e9bb35d22e4b4e7b2114733df056b55365cb0e Azure:

[jira] [Assigned] (HUDI-1042) [Umbrella] Support clustering on filegroups

2021-06-26 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei reassigned HUDI-1042: --- Assignee: liwei (was: leesf) > [Umbrella] Support clustering on filegroups >

[jira] [Assigned] (HUDI-1043) Support clustering in CoW mode

2021-06-26 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei reassigned HUDI-1043: --- Assignee: liwei (was: leesf) > Support clustering in CoW mode > -- > >

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3160: [HUDI-1975] Exclude metrics-core 3.1.2 from Dropwizard

2021-06-26 Thread GitBox
codecov-commenter edited a comment on pull request #3160: URL: https://github.com/apache/hudi/pull/3160#issuecomment-868959316 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3160: [HUDI-1975] Exclude metrics-core 3.1.2 from Dropwizard

2021-06-26 Thread GitBox
codecov-commenter edited a comment on pull request #3160: URL: https://github.com/apache/hudi/pull/3160#issuecomment-868959316 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3134: [HUDI-2052] Support load logFile in BootstrapFunction

2021-06-26 Thread GitBox
codecov-commenter edited a comment on pull request #3134: URL: https://github.com/apache/hudi/pull/3134#issuecomment-866110119 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3160: [HUDI-1975] Exclude metrics-core 3.1.2 from Dropwizard

2021-06-26 Thread GitBox
codecov-commenter edited a comment on pull request #3160: URL: https://github.com/apache/hudi/pull/3160#issuecomment-868959316 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3134: [HUDI-2052] Support load logFile in BootstrapFunction

2021-06-26 Thread GitBox
codecov-commenter edited a comment on pull request #3134: URL: https://github.com/apache/hudi/pull/3134#issuecomment-866110119 #

[GitHub] [hudi] codecov-commenter commented on pull request #3160: [HUDI-1975] Exclude metrics-core 3.1.2 from Dropwizard

2021-06-26 Thread GitBox
codecov-commenter commented on pull request #3160: URL: https://github.com/apache/hudi/pull/3160#issuecomment-868959316 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3160?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation)

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3134: [HUDI-2052] Support load logFile in BootstrapFunction

2021-06-26 Thread GitBox
codecov-commenter edited a comment on pull request #3134: URL: https://github.com/apache/hudi/pull/3134#issuecomment-866110119 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3134: [HUDI-2052] Support load logFile in BootstrapFunction

2021-06-26 Thread GitBox
codecov-commenter edited a comment on pull request #3134: URL: https://github.com/apache/hudi/pull/3134#issuecomment-866110119 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3160: [HUDI-1975] Exclude metrics-core 3.1.2 from Dropwizard

2021-06-26 Thread GitBox
hudi-bot edited a comment on pull request #3160: URL: https://github.com/apache/hudi/pull/3160#issuecomment-868951565 ## CI report: * 242d880172062a2cb1a8e81934f33495a1d6a219 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3134: [HUDI-2052] Support load logFile in BootstrapFunction

2021-06-26 Thread GitBox
hudi-bot edited a comment on pull request #3134: URL: https://github.com/apache/hudi/pull/3134#issuecomment-865885733 ## CI report: * 31d330315aaf63e3cf0829fb9397cffbcb5e8fc9 Azure: