[GitHub] [hudi] hudi-bot edited a comment on pull request #3880: [HUDI-2606][WIP] Enable metadata reader by default

2021-11-02 Thread GitBox
hudi-bot edited a comment on pull request #3880: URL: https://github.com/apache/hudi/pull/3880#issuecomment-953404250 ## CI report: * 855ea5ffb1cffa60f069242bf23aaafa26a70c49 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3909: Fixed RAT config for "hudi-utilities-bundle" to ignore transient build-bound artifiacts

2021-11-02 Thread GitBox
hudi-bot edited a comment on pull request #3909: URL: https://github.com/apache/hudi/pull/3909#issuecomment-958273836 ## CI report: * 3e1bd1c64cefc36544f52dc7cf577da3f7f5ac28 Azure:

[GitHub] [hudi] nsivabalan commented on a change in pull request #3880: [HUDI-2606][WIP] Enable metadata reader by default

2021-11-02 Thread GitBox
nsivabalan commented on a change in pull request #3880: URL: https://github.com/apache/hudi/pull/3880#discussion_r741526371 ## File path: packaging/hudi-hive-sync-bundle/pom.xml ## @@ -69,12 +69,18 @@ org.apache.hudi:hudi-sync-common

[jira] [Reopened] (HUDI-2593) Enable virtual keys for metadata table

2021-11-02 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reopened HUDI-2593: -- > Enable virtual keys for metadata table > -- > >

[GitHub] [hudi] hudi-bot edited a comment on pull request #3880: [HUDI-2606][WIP] Enable metadata reader by default

2021-11-02 Thread GitBox
hudi-bot edited a comment on pull request #3880: URL: https://github.com/apache/hudi/pull/3880#issuecomment-953404250 ## CI report: * 855ea5ffb1cffa60f069242bf23aaafa26a70c49 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3880: [HUDI-2606][WIP] Enable metadata reader by default

2021-11-02 Thread GitBox
hudi-bot edited a comment on pull request #3880: URL: https://github.com/apache/hudi/pull/3880#issuecomment-953404250 ## CI report: * 855ea5ffb1cffa60f069242bf23aaafa26a70c49 Azure:

[GitHub] [hudi] nsivabalan commented on pull request #3880: [HUDI-2606][WIP] Enable metadata reader by default

2021-11-02 Thread GitBox
nsivabalan commented on pull request #3880: URL: https://github.com/apache/hudi/pull/3880#issuecomment-958299746 @hudi-bot azure run -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] alexeykudinkin commented on a change in pull request #3909: Fixed RAT config for "hudi-utilities-bundle" to ignore transient build-bound artifiacts

2021-11-02 Thread GitBox
alexeykudinkin commented on a change in pull request #3909: URL: https://github.com/apache/hudi/pull/3909#discussion_r741506956 ## File path: packaging/hudi-utilities-bundle/pom.xml ## @@ -36,6 +36,28 @@ org.apache.rat apache-rat-plugin + +

[GitHub] [hudi] hudi-bot edited a comment on pull request #3909: Fixed RAT config for "hudi-utilities-bundle" to ignore transient build-bound artifiacts

2021-11-02 Thread GitBox
hudi-bot edited a comment on pull request #3909: URL: https://github.com/apache/hudi/pull/3909#issuecomment-958273836 ## CI report: * 3e1bd1c64cefc36544f52dc7cf577da3f7f5ac28 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3880: [HUDI-2606][WIP] Enable metadata reader by default

2021-11-02 Thread GitBox
hudi-bot edited a comment on pull request #3880: URL: https://github.com/apache/hudi/pull/3880#issuecomment-953404250 ## CI report: * 775110bceff39fda8bb9d325fed751ad66574cd9 Azure:

[jira] [Created] (HUDI-2673) Add integration/e2e test for kafka-connect functionality

2021-11-02 Thread Ethan Guo (Jira)
Ethan Guo created HUDI-2673: --- Summary: Add integration/e2e test for kafka-connect functionality Key: HUDI-2673 URL: https://issues.apache.org/jira/browse/HUDI-2673 Project: Apache Hudi Issue Type:

[jira] [Updated] (HUDI-2672) Avoid empty commits and rollbacks when there is no event from the topic

2021-11-02 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-2672: Description: {code:java} ls -l /tmp/hoodie/hudi-test-topic/.hoodie/ total 224 21174 Nov 1 20:58

[jira] [Updated] (HUDI-2672) Avoid empty commits and rollbacks when there is no event from the topic

2021-11-02 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-2672: Description: ``` ls -l /tmp/hoodie/hudi-test-topic/.hoodie/ total 224 21174 Nov 1 20:58

[jira] [Created] (HUDI-2672) Avoid empty commits and rollbacks when there is no event from the topic

2021-11-02 Thread Ethan Guo (Jira)
Ethan Guo created HUDI-2672: --- Summary: Avoid empty commits and rollbacks when there is no event from the topic Key: HUDI-2672 URL: https://issues.apache.org/jira/browse/HUDI-2672 Project: Apache Hudi

[GitHub] [hudi] nsivabalan commented on a change in pull request #3909: Fixed RAT config for "hudi-utilities-bundle" to ignore transient build-bound artifiacts

2021-11-02 Thread GitBox
nsivabalan commented on a change in pull request #3909: URL: https://github.com/apache/hudi/pull/3909#discussion_r741503390 ## File path: packaging/hudi-utilities-bundle/pom.xml ## @@ -36,6 +36,28 @@ org.apache.rat apache-rat-plugin + +

[GitHub] [hudi] nsivabalan commented on a change in pull request #3909: Fixed RAT config for "hudi-utilities-bundle" to ignore transient build-bound artifiacts

2021-11-02 Thread GitBox
nsivabalan commented on a change in pull request #3909: URL: https://github.com/apache/hudi/pull/3909#discussion_r741503036 ## File path: packaging/hudi-utilities-bundle/pom.xml ## @@ -36,6 +36,28 @@ org.apache.rat apache-rat-plugin + +

[GitHub] [hudi] hudi-bot commented on pull request #3909: Fixed RAT config for "hudi-utilities-bundle" to ignore transient build-bound artifiacts

2021-11-02 Thread GitBox
hudi-bot commented on pull request #3909: URL: https://github.com/apache/hudi/pull/3909#issuecomment-958273836 ## CI report: * 3e1bd1c64cefc36544f52dc7cf577da3f7f5ac28 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[GitHub] [hudi] hudi-bot edited a comment on pull request #3880: [HUDI-2606][WIP] Enable metadata reader by default

2021-11-02 Thread GitBox
hudi-bot edited a comment on pull request #3880: URL: https://github.com/apache/hudi/pull/3880#issuecomment-953404250 ## CI report: * 775110bceff39fda8bb9d325fed751ad66574cd9 Azure:

[jira] [Updated] (HUDI-2671) Fix record offset handling in Kafka connect transaction participant

2021-11-02 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-2671: Description: When there are two sink workers running, there can be a case where one participant joins after

[jira] [Assigned] (HUDI-2671) Fix record offset handling in Kafka connect transaction participant

2021-11-02 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo reassigned HUDI-2671: --- Assignee: Rajesh Mahindra > Fix record offset handling in Kafka connect transaction participant >

[GitHub] [hudi] nsivabalan commented on pull request #3880: [HUDI-2606][WIP] Enable metadata reader by default

2021-11-02 Thread GitBox
nsivabalan commented on pull request #3880: URL: https://github.com/apache/hudi/pull/3880#issuecomment-958265811 @hudi-bot azure run -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Updated] (HUDI-2671) Fix record offset handling in Kafka connect transaction participant

2021-11-02 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-2671: Parent: HUDI-2324 Issue Type: Sub-task (was: Bug) > Fix record offset handling in Kafka connect

[jira] [Created] (HUDI-2671) Fix record offset handling in Kafka connect transaction participant

2021-11-02 Thread Ethan Guo (Jira)
Ethan Guo created HUDI-2671: --- Summary: Fix record offset handling in Kafka connect transaction participant Key: HUDI-2671 URL: https://issues.apache.org/jira/browse/HUDI-2671 Project: Apache Hudi

[jira] [Updated] (HUDI-2671) Fix record offset handling in Kafka connect transaction participant

2021-11-02 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-2671: Priority: Blocker (was: Major) > Fix record offset handling in Kafka connect transaction participant >

[jira] [Updated] (HUDI-2671) Fix record offset handling in Kafka connect transaction participant

2021-11-02 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-2671: Fix Version/s: 0.10.0 > Fix record offset handling in Kafka connect transaction participant >

[GitHub] [hudi] alexeykudinkin opened a new pull request #3909: Fixed RAT config for "hudi-utilities-bundle" to ignore transient build-bound artifiacts

2021-11-02 Thread GitBox
alexeykudinkin opened a new pull request #3909: URL: https://github.com/apache/hudi/pull/3909 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the

[jira] [Commented] (HUDI-2670) Fix broken relative links

2021-11-02 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17437624#comment-17437624 ] Kyle Weller commented on HUDI-2670: --- PR 3907 resolves this: [https://github.com/apache/hudi/pull/3907]

[hudi] branch master updated (d194643 -> dee3a14)

2021-11-02 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from d194643 [HUDI-2101][RFC-28] support z-order for hudi (#3330) add dee3a14 [HUDI-2582] Support concurrent key

[GitHub] [hudi] nsivabalan merged pull request #3817: [HUDI-2582] Support concurrent key gen for different tables with row writer path

2021-11-02 Thread GitBox
nsivabalan merged pull request #3817: URL: https://github.com/apache/hudi/pull/3817 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Updated] (HUDI-2670) Fix broken relative links

2021-11-02 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2670: -- Status: Patch Available (was: In Progress) > Fix broken relative links > - > >

[jira] [Resolved] (HUDI-2101) support z-order for hudi

2021-11-02 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan resolved HUDI-2101. --- Resolution: Fixed > support z-order for hudi > > >

[jira] [Reopened] (HUDI-2101) support z-order for hudi

2021-11-02 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reopened HUDI-2101: --- > support z-order for hudi > > > Key: HUDI-2101

[jira] [Updated] (HUDI-2101) support z-order for hudi

2021-11-02 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2101: -- Status: Closed (was: Patch Available) > support z-order for hudi >

[jira] [Updated] (HUDI-2362) Hudi external configuration file support

2021-11-02 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2362: -- Status: In Progress (was: Open) > Hudi external configuration file support >

[jira] [Updated] (HUDI-2101) support z-order for hudi

2021-11-02 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2101: -- Status: Patch Available (was: In Progress) > support z-order for hudi >

[jira] [Updated] (HUDI-2101) support z-order for hudi

2021-11-02 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2101: -- Status: In Progress (was: Open) > support z-order for hudi >

[jira] [Updated] (HUDI-270) [UMBRELLA] Improve Hudi website UI and documentation

2021-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-270: Labels: hudi-umbrellas pull-request-available (was: hudi-umbrellas) > [UMBRELLA] Improve Hudi

[GitHub] [hudi] kywe665 opened a new pull request #3907: [HUDI-270] - relative links broken in docs

2021-11-02 Thread GitBox
kywe665 opened a new pull request #3907: URL: https://github.com/apache/hudi/pull/3907 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the

[GitHub] [hudi] nsivabalan commented on pull request #3761: [HUDI-2509] OverwriteNonDefaultsWithLatestAvroPayload doesn`t work when upsert data with some null value column

2021-11-02 Thread GitBox
nsivabalan commented on pull request #3761: URL: https://github.com/apache/hudi/pull/3761#issuecomment-957061563 @peanut-chenzhong : I see even without the fix, the added test succeeds. Objects.equals(value, defaultValue) returns true even for null, null. Can you check if the fix is

[GitHub] [hudi] peanut-chenzhong edited a comment on pull request #3761: [HUDI-2509] OverwriteNonDefaultsWithLatestAvroPayload doesn`t work when upsert data with some null value column

2021-11-02 Thread GitBox
peanut-chenzhong edited a comment on pull request #3761: URL: https://github.com/apache/hudi/pull/3761#issuecomment-95720 > @peanut-chenzhong : I see even without the fix, the added test succeeds. Objects.equals(value, defaultValue) returns true even for null, null. Can you check if

[GitHub] [hudi] jadireddi edited a comment on issue #3558: [SUPPORT] Schema evolution error: promoted data type from integer to double

2021-11-02 Thread GitBox
jadireddi edited a comment on issue #3558: URL: https://github.com/apache/hudi/issues/3558#issuecomment-957726431 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] xiarixiaoyao commented on pull request #3808: [HUDI-2560] introduce id_based schema to support full schema evolution.

2021-11-02 Thread GitBox
xiarixiaoyao commented on pull request #3808: URL: https://github.com/apache/hudi/pull/3808#issuecomment-957066897 @bvaradar Thank you for your review, will update the code today。 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hudi] JB-data commented on issue #3905: [SUPPORT] Transform from kafka complains about table not found when using transformer.sql

2021-11-02 Thread GitBox
JB-data commented on issue #3905: URL: https://github.com/apache/hudi/issues/3905#issuecomment-957953303 I have seen by coincidence @nsivabalan respond to similar questions.. maybe he is so kind to take a look? Thanks! -- This is an automated message from the Apache Git Service. To

[GitHub] [hudi] zhedoubushishi commented on a change in pull request #3486: [HUDI-2314] Add support for DynamoDb based lock

2021-11-02 Thread GitBox
zhedoubushishi commented on a change in pull request #3486: URL: https://github.com/apache/hudi/pull/3486#discussion_r740755755 ## File path: hudi-client/hudi-client-common/pom.xml ## @@ -275,6 +300,45 @@ false + +io.fabric8 +

[GitHub] [hudi] hudi-bot edited a comment on pull request #3761: [HUDI-2509] OverwriteNonDefaultsWithLatestAvroPayload doesn`t work when upsert data with some null value column

2021-11-02 Thread GitBox
hudi-bot edited a comment on pull request #3761: URL: https://github.com/apache/hudi/pull/3761#issuecomment-938264265 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] hudi-bot edited a comment on pull request #3486: [HUDI-2314] Add support for DynamoDb based lock

2021-11-02 Thread GitBox
hudi-bot edited a comment on pull request #3486: URL: https://github.com/apache/hudi/pull/3486#issuecomment-899911684 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] nsivabalan commented on pull request #3799: [HUDI-2491] hoodie.datasource.hive_sync.mode=hms mode is supported in…

2021-11-02 Thread GitBox
nsivabalan commented on pull request #3799: URL: https://github.com/apache/hudi/pull/3799#issuecomment-957063566 @fuyun2024 : looks like there are some conflicts with master. Can you rebase with latest. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hudi] hudi-bot edited a comment on pull request #3823: [HUDI-2538] persist some configs to hoodie.properties when the first write

2021-11-02 Thread GitBox
hudi-bot edited a comment on pull request #3823: URL: https://github.com/apache/hudi/pull/3823#issuecomment-946850790 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] hudi-bot edited a comment on pull request #3880: [HUDI-2606][WIP] Enable metadata reader by default

2021-11-02 Thread GitBox
hudi-bot edited a comment on pull request #3880: URL: https://github.com/apache/hudi/pull/3880#issuecomment-953404250 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] nsivabalan merged pull request #3803: [HUDI-2472] Enabling Metadata table for TestCleaner unit tests

2021-11-02 Thread GitBox
nsivabalan merged pull request #3803: URL: https://github.com/apache/hudi/pull/3803 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] codope commented on a change in pull request #3865: [HUDI-2005][WIP] Removing direct fs call in HoodieLogFileReader

2021-11-02 Thread GitBox
codope commented on a change in pull request #3865: URL: https://github.com/apache/hudi/pull/3865#discussion_r740731116 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/realtime/HoodieRealtimeFileSplit.java ## @@ -58,6 +62,10 @@ public

[GitHub] [hudi] hudi-bot edited a comment on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table

2021-11-02 Thread GitBox
hudi-bot edited a comment on pull request #3900: URL: https://github.com/apache/hudi/pull/3900#issuecomment-956209542 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] novakov-alexey edited a comment on issue #3558: [SUPPORT] Schema evolution error: promoted data type from integer to double

2021-11-02 Thread GitBox
novakov-alexey edited a comment on issue #3558: URL: https://github.com/apache/hudi/issues/3558#issuecomment-957466015 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] hudi-bot edited a comment on pull request #3865: [HUDI-2005][WIP] Removing direct fs call in HoodieLogFileReader

2021-11-02 Thread GitBox
hudi-bot edited a comment on pull request #3865: URL: https://github.com/apache/hudi/pull/3865#issuecomment-951550415 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] hudi-bot edited a comment on pull request #3700: [HUDI-2471] Add support ignoring case in merge into

2021-11-02 Thread GitBox
hudi-bot edited a comment on pull request #3700: URL: https://github.com/apache/hudi/pull/3700#issuecomment-924523979 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] hudi-bot edited a comment on pull request #3817: [HUDI-2582] Support concurrent key gen for different tables with row writer path

2021-11-02 Thread GitBox
hudi-bot edited a comment on pull request #3817: URL: https://github.com/apache/hudi/pull/3817#issuecomment-945545601 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] hudi-bot edited a comment on pull request #3904: [WIP][HUDI-1295] Metadata Index - Bloom filter metadata to speed up index lookups

2021-11-02 Thread GitBox
hudi-bot edited a comment on pull request #3904: URL: https://github.com/apache/hudi/pull/3904#issuecomment-957238023 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] hudi-bot commented on pull request #3904: [WIP][HUDI-1295] Metadata Index - Bloom filter metadata to speed up index lookups

2021-11-02 Thread GitBox
hudi-bot commented on pull request #3904: URL: https://github.com/apache/hudi/pull/3904#issuecomment-957238023 ## CI report: * b44ebe5eb1da433b6ddf86b4839e280ea9cc6f9f UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[GitHub] [hudi] codope commented on a change in pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync

2021-11-02 Thread GitBox
codope commented on a change in pull request #3771: URL: https://github.com/apache/hudi/pull/3771#discussion_r740865098 ## File path: hudi-sync/hudi-hive-sync/src/test/java/org/apache/hudi/hive/TestHiveSyncTool.java ## @@ -1017,4 +1019,36 @@ public void

[GitHub] [hudi] nsivabalan merged pull request #3881: [HUDI-2627]Fix unsupported query instant time format in quickstart page

2021-11-02 Thread GitBox
nsivabalan merged pull request #3881: URL: https://github.com/apache/hudi/pull/3881 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] vinothchandar commented on pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-11-02 Thread GitBox
vinothchandar commented on pull request #3330: URL: https://github.com/apache/hudi/pull/3330#issuecomment-957382195 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] hudi-bot edited a comment on pull request #3889: [HUDI-2443] Hudi KVComparator for all HFile writer usages

2021-11-02 Thread GitBox
hudi-bot edited a comment on pull request #3889: URL: https://github.com/apache/hudi/pull/3889#issuecomment-954508326 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] liujinhui1994 commented on pull request #3614: [HUDI-2370] Supports data encryption

2021-11-02 Thread GitBox
liujinhui1994 commented on pull request #3614: URL: https://github.com/apache/hudi/pull/3614#issuecomment-957025580 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] hudi-bot edited a comment on pull request #3888: [HUDI-2624] Implement Non Index type for HUDI

2021-11-02 Thread GitBox
hudi-bot edited a comment on pull request #3888: URL: https://github.com/apache/hudi/pull/3888#issuecomment-954503596 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] danny0405 commented on pull request #3899: [HUDI-2660] Delete the view storage properties first before creation

2021-11-02 Thread GitBox
danny0405 commented on pull request #3899: URL: https://github.com/apache/hudi/pull/3899#issuecomment-957059969 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] kenny291 commented on issue #3558: [SUPPORT] Schema evolution error: promoted data type from integer to double

2021-11-02 Thread GitBox
kenny291 commented on issue #3558: URL: https://github.com/apache/hudi/issues/3558#issuecomment-957484205 @novakov-alexey, double to int is not compatibility in Avro schema revolution http://avro.apache.org/docs/current/spec#Schema+Resolution -- This is an automated message from the

[GitHub] [hudi] hudi-bot commented on pull request #3903: [HUDI-2651] Sync all the missing sql options for HoodieFlinkStreamer

2021-11-02 Thread GitBox
hudi-bot commented on pull request #3903: URL: https://github.com/apache/hudi/pull/3903#issuecomment-957173931 ## CI report: * 9754611552f4db38f7679f54dfe86a3191bb7473 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[GitHub] [hudi] nsivabalan merged pull request #3902: [MINOR] Adding a deprecated constructor to AbstractSyncHoodieClient so that old callers does not break

2021-11-02 Thread GitBox
nsivabalan merged pull request #3902: URL: https://github.com/apache/hudi/pull/3902 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3903: [HUDI-2651] Sync all the missing sql options for HoodieFlinkStreamer

2021-11-02 Thread GitBox
hudi-bot edited a comment on pull request #3903: URL: https://github.com/apache/hudi/pull/3903#issuecomment-957173931 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] hudi-bot edited a comment on pull request #3899: [HUDI-2660] Delete the view storage properties first before creation

2021-11-02 Thread GitBox
hudi-bot edited a comment on pull request #3899: URL: https://github.com/apache/hudi/pull/3899#issuecomment-956165515 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] YannByron commented on pull request #3844: [HUDI-1869] Upgrading Spark3 To 3.1

2021-11-02 Thread GitBox
YannByron commented on pull request #3844: URL: https://github.com/apache/hudi/pull/3844#issuecomment-957133846 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] hudi-bot edited a comment on pull request #3203: [HUDI-2086] Refactor hive mor_incremental_view

2021-11-02 Thread GitBox
hudi-bot edited a comment on pull request #3203: URL: https://github.com/apache/hudi/pull/3203#issuecomment-872092745 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] hudi-bot edited a comment on pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-11-02 Thread GitBox
hudi-bot edited a comment on pull request #3330: URL: https://github.com/apache/hudi/pull/3330#issuecomment-885350571 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] zhangyue19921010 removed a comment on pull request #3765: [HUDI-2533] New option for hoodieClusteringJob to check, rollback and re-execute the last failed clustering job

2021-11-02 Thread GitBox
zhangyue19921010 removed a comment on pull request #3765: URL: https://github.com/apache/hudi/pull/3765#issuecomment-957144474 @hudi-bot run azure re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hudi] hudi-bot edited a comment on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync

2021-11-02 Thread GitBox
hudi-bot edited a comment on pull request #3771: URL: https://github.com/apache/hudi/pull/3771#issuecomment-939200284 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] test-wangxiaoyu commented on pull request #3771: [HUDI-2402] Add Kerberos configuration options to Hive Sync

2021-11-02 Thread GitBox
test-wangxiaoyu commented on pull request #3771: URL: https://github.com/apache/hudi/pull/3771#issuecomment-957242076 > @test-wangxiaoyu Can you rebase with master? There was an issue which was causing CI failure which has now been fixed. Okay, I've done what you said -- This is

[GitHub] [hudi] zhangyue19921010 removed a comment on pull request #3897: [HUDI-2658] When disable auto clean, do not check if MIN_COMMITS_TO_KEEP was larger CLEANER_COMMITS_RETAINED or not.

2021-11-02 Thread GitBox
zhangyue19921010 removed a comment on pull request #3897: URL: https://github.com/apache/hudi/pull/3897#issuecomment-956043709 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] codope commented on a change in pull request #3761: [HUDI-2509] OverwriteNonDefaultsWithLatestAvroPayload doesn`t work when upsert data with some null value column

2021-11-02 Thread GitBox
codope commented on a change in pull request #3761: URL: https://github.com/apache/hudi/pull/3761#discussion_r741051384 ## File path: hudi-common/src/test/java/org/apache/hudi/common/model/TestOverwriteNonDefaultsWithLatestAvroPayload.java ## @@ -126,4 +127,33 @@ public void

[GitHub] [hudi] xiarixiaoyao commented on pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-11-02 Thread GitBox
xiarixiaoyao commented on pull request #3330: URL: https://github.com/apache/hudi/pull/3330#issuecomment-957446790 @vinothchandar yes, hilbert curve is ready, i think time is enough to add hilbert curve. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hudi] fuyun2024 commented on pull request #3799: [HUDI-2491] hoodie.datasource.hive_sync.mode=hms mode is supported in…

2021-11-02 Thread GitBox
fuyun2024 commented on pull request #3799: URL: https://github.com/apache/hudi/pull/3799#issuecomment-957029458 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] YannByron commented on a change in pull request #3844: [HUDI-1869] Upgrading Spark3 To 3.1

2021-11-02 Thread GitBox
YannByron commented on a change in pull request #3844: URL: https://github.com/apache/hudi/pull/3844#discussion_r740646803 ## File path: hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/TestHoodieSqlBase.scala ## @@ -92,6 +96,19 @@ class

[GitHub] [hudi] nsivabalan merged pull request #3746: [HUDI-2515] Add close when producing records failed

2021-11-02 Thread GitBox
nsivabalan merged pull request #3746: URL: https://github.com/apache/hudi/pull/3746 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] nsivabalan commented on pull request #3700: [HUDI-2471] Add support ignoring case in merge into

2021-11-02 Thread GitBox
nsivabalan commented on pull request #3700: URL: https://github.com/apache/hudi/pull/3700#issuecomment-957074628 @hudi-bot azure run -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] zhangyue19921010 commented on pull request #3765: [HUDI-2533] New option for hoodieClusteringJob to check, rollback and re-execute the last failed clustering job

2021-11-02 Thread GitBox
zhangyue19921010 commented on pull request #3765: URL: https://github.com/apache/hudi/pull/3765#issuecomment-957144474 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] codope commented on pull request #3830: [HUDI-2077] Set schema validation from main write config

2021-11-02 Thread GitBox
codope commented on pull request #3830: URL: https://github.com/apache/hudi/pull/3830#issuecomment-957121442 > in general, I agree with your intention. but not for schema validation. Metadata is an impl detail. User does not even know whats the schema for metadata table. so, atleast for

[GitHub] [hudi] hudi-bot edited a comment on pull request #3803: [HUDI-2472] Enabling Metadata table for TestCleaner unit tests

2021-11-02 Thread GitBox
hudi-bot edited a comment on pull request #3803: URL: https://github.com/apache/hudi/pull/3803#issuecomment-943565382 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] haoliang7 closed issue #3898: [SUPPORT] Hudi vs Hoodie

2021-11-02 Thread GitBox
haoliang7 closed issue #3898: URL: https://github.com/apache/hudi/issues/3898 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3824: [HUDI-1292] Millisecond granularity for instant timestamps

2021-11-02 Thread GitBox
hudi-bot edited a comment on pull request #3824: URL: https://github.com/apache/hudi/pull/3824#issuecomment-946872755 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] hudi-bot edited a comment on pull request #3844: [HUDI-1869] Upgrading Spark3 To 3.1

2021-11-02 Thread GitBox
hudi-bot edited a comment on pull request #3844: URL: https://github.com/apache/hudi/pull/3844#issuecomment-949285568 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] codope closed pull request #3830: [HUDI-2077] Set schema validation from main write config

2021-11-02 Thread GitBox
codope closed pull request #3830: URL: https://github.com/apache/hudi/pull/3830 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] jadireddi commented on issue #3558: [SUPPORT] Schema evolution error: promoted data type from integer to double

2021-11-02 Thread GitBox
jadireddi commented on issue #3558: URL: https://github.com/apache/hudi/issues/3558#issuecomment-957726431 @nsivabalan , Hudi uses `parquet-avro`. So there is a slight variation for the primitive typesconversion between avro and parquet-avro. AFAIK, int is promoted to int

[GitHub] [hudi] peanut-chenzhong commented on pull request #3761: [HUDI-2509] OverwriteNonDefaultsWithLatestAvroPayload doesn`t work when upsert data with some null value column

2021-11-02 Thread GitBox
peanut-chenzhong commented on pull request #3761: URL: https://github.com/apache/hudi/pull/3761#issuecomment-95720 > @peanut-chenzhong : I see even without the fix, the added test succeeds. Objects.equals(value, defaultValue) returns true even for null, null. Can you check if the fix

[GitHub] [hudi] haoliang7 commented on issue #3898: [SUPPORT] Hudi vs Hoodie

2021-11-02 Thread GitBox
haoliang7 commented on issue #3898: URL: https://github.com/apache/hudi/issues/3898#issuecomment-957010738 @nsivabalan Got it. Thank you for explanation. IMHO, it's better to unify the names. -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hudi] vinothchandar commented on pull request #3855: [HUDI-2607] Reorganize Hudi Docs

2021-11-02 Thread GitBox
vinothchandar commented on pull request #3855: URL: https://github.com/apache/hudi/pull/3855#issuecomment-957017446 LGTM overall. Can we avoid the absolute links and use relative paths for linking? that's the only comment I had. This is a great foundation to build on. Can land once

[GitHub] [hudi] nsivabalan merged pull request #3769: [HUDI-2005] Fixing partition path creation in AbstractTableFileSystemView

2021-11-02 Thread GitBox
nsivabalan merged pull request #3769: URL: https://github.com/apache/hudi/pull/3769 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3769: [HUDI-2005][WIP] Fixing partition path creation in AbstractTableFileSystemView

2021-11-02 Thread GitBox
hudi-bot edited a comment on pull request #3769: URL: https://github.com/apache/hudi/pull/3769#issuecomment-939013386 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] xiarixiaoyao commented on pull request #3203: [HUDI-2086] Refactor hive mor_incremental_view

2021-11-02 Thread GitBox
xiarixiaoyao commented on pull request #3203: URL: https://github.com/apache/hudi/pull/3203#issuecomment-957530371 @codope thanks for your review. Adressed all comments。 Add test case for compaction to verify that incremental reads do NOT show inserts after compaction timestamp,

[GitHub] [hudi] hudi-bot edited a comment on pull request #3614: [HUDI-2370] Supports data encryption

2021-11-02 Thread GitBox
hudi-bot edited a comment on pull request #3614: URL: https://github.com/apache/hudi/pull/3614#issuecomment-914114290 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] nsivabalan commented on pull request #2790: [HUDI-1779] Fail to bootstrap/upsert a table which contains timestamp column

2021-11-02 Thread GitBox
nsivabalan commented on pull request #2790: URL: https://github.com/apache/hudi/pull/2790#issuecomment-957073766 @li36909 : also would be good to put up a separate patch for upgrading parquet version. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hudi] manojpec commented on pull request #3889: [HUDI-2443] Hudi KVComparator for all HFile writer usages

2021-11-02 Thread GitBox
manojpec commented on pull request #3889: URL: https://github.com/apache/hudi/pull/3889#issuecomment-957096349 @hudi-bot azure run -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

<    1   2   3   4   5   6   7   >