[GitHub] [hudi] hudi-bot edited a comment on pull request #3186: [HUDI-2099]hive lock which state is WATING should be released, otherw…

2021-06-29 Thread GitBox
hudi-bot edited a comment on pull request #3186: URL: https://github.com/apache/hudi/pull/3186#issuecomment-871061118 ## CI report: * cf37ed3b99d63b48d06b7b14b8b6b200e52c6500 Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3122: [HUDI-2048] HoodieRealtimeInputFormatUtils#groupLogsByBaseFile throws…

2021-06-29 Thread GitBox
codecov-commenter edited a comment on pull request #3122: URL: https://github.com/apache/hudi/pull/3122#issuecomment-864855800 #

[jira] [Assigned] (HUDI-1860) Add INSERT_OVERWRITE support to DeltaStreamer

2021-06-29 Thread Samrat Deb (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Samrat Deb reassigned HUDI-1860: Assignee: Samrat Deb (was: Sagar Sumit) > Add INSERT_OVERWRITE support to DeltaStreamer >

[GitHub] [hudi] hudi-bot edited a comment on pull request #3122: [HUDI-2048] HoodieRealtimeInputFormatUtils#groupLogsByBaseFile throws…

2021-06-29 Thread GitBox
hudi-bot edited a comment on pull request #3122: URL: https://github.com/apache/hudi/pull/3122#issuecomment-864851929 ## CI report: * 530787e9a14f8ac180399f4641a58e5eff6ada11 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3122: [HUDI-2048] HoodieRealtimeInputFormatUtils#groupLogsByBaseFile throws…

2021-06-29 Thread GitBox
hudi-bot edited a comment on pull request #3122: URL: https://github.com/apache/hudi/pull/3122#issuecomment-864851929 ## CI report: * 530787e9a14f8ac180399f4641a58e5eff6ada11 Azure:

[GitHub] [hudi] danny0405 commented on pull request #3122: [HUDI-2048] HoodieRealtimeInputFormatUtils#groupLogsByBaseFile throws…

2021-06-29 Thread GitBox
danny0405 commented on pull request #3122: URL: https://github.com/apache/hudi/pull/3122#issuecomment-871114694 @vinothchandar I have modified to support pure logs file group reading, can you take a look again, thanks ~ -- This is an automated message from the Apache Git Service. To

[jira] [Commented] (HUDI-1468) incremental read support with clustering

2021-06-29 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17371819#comment-17371819 ] Vinoth Chandar commented on HUDI-1468: -- [~309637554] do you plan to work on this? It would be good to

[GitHub] [hudi] wangxianghu commented on a change in pull request #3170: [HUDI-1930] Bootstrap support configure KeyGenerator by type

2021-06-29 Thread GitBox
wangxianghu commented on a change in pull request #3170: URL: https://github.com/apache/hudi/pull/3170#discussion_r661144248 ## File path: hudi-cli/src/main/java/org/apache/hudi/cli/commands/SparkMain.java ## @@ -353,14 +353,20 @@ private static int

[jira] [Created] (HUDI-2104) Add Builder for bootstrap cli args

2021-06-29 Thread Xianghu Wang (Jira)
Xianghu Wang created HUDI-2104: -- Summary: Add Builder for bootstrap cli args Key: HUDI-2104 URL: https://issues.apache.org/jira/browse/HUDI-2104 Project: Apache Hudi Issue Type: Task

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3186: [HUDI-2099]hive lock which state is WATING should be released, otherw…

2021-06-29 Thread GitBox
codecov-commenter edited a comment on pull request #3186: URL: https://github.com/apache/hudi/pull/3186#issuecomment-871069429 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3186: [HUDI-2099]hive lock which state is WATING should be released, otherw…

2021-06-29 Thread GitBox
codecov-commenter edited a comment on pull request #3186: URL: https://github.com/apache/hudi/pull/3186#issuecomment-871069429 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3186: [HUDI-2099]hive lock which state is WATING should be released, otherw…

2021-06-29 Thread GitBox
codecov-commenter edited a comment on pull request #3186: URL: https://github.com/apache/hudi/pull/3186#issuecomment-871069429 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3186: [HUDI-2099]hive lock which state is WATING should be released, otherw…

2021-06-29 Thread GitBox
hudi-bot edited a comment on pull request #3186: URL: https://github.com/apache/hudi/pull/3186#issuecomment-871061118 ## CI report: * cf3420f154c8f13fefe4ff4ea589322ac50249b0 Azure:

[hudi] branch asf-site updated (d544e97 -> c18712c)

2021-06-29 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git. from d544e97 [MINOR] [HUDI-1577] Add caveat for multiwriter usage (#3165) add c18712c Travis CI build asf-site No

[GitHub] [hudi] vinothchandar merged pull request #3165: [MINOR] Add caveat for multiwriter usage

2021-06-29 Thread GitBox
vinothchandar merged pull request #3165: URL: https://github.com/apache/hudi/pull/3165 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[hudi] branch asf-site updated: [MINOR] [HUDI-1577] Add caveat for multiwriter usage (#3165)

2021-06-29 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new d544e97 [MINOR] [HUDI-1577] Add caveat for

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3186: [HUDI-2099]hive lock which state is WATING should be released, otherw…

2021-06-29 Thread GitBox
codecov-commenter edited a comment on pull request #3186: URL: https://github.com/apache/hudi/pull/3186#issuecomment-871069429 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3186: [HUDI-2099]hive lock which state is WATING should be released, otherw…

2021-06-29 Thread GitBox
hudi-bot edited a comment on pull request #3186: URL: https://github.com/apache/hudi/pull/3186#issuecomment-871061118 ## CI report: * cf3420f154c8f13fefe4ff4ea589322ac50249b0 Azure:

[GitHub] [hudi] n3nash edited a comment on pull request #3183: [HUDI-2090]when hudi metadata is enabled, use different users to quer…

2021-06-29 Thread GitBox
n3nash edited a comment on pull request #3183: URL: https://github.com/apache/hudi/pull/3183#issuecomment-871080919 @nsivabalan I ran into this today while testing :) @xiarixiaoyao The question is why is the base path "/tmp/view_map". It should ideally be just "/tmp". I see that this is

[GitHub] [hudi] n3nash commented on pull request #3165: [MINOR] Add caveat for multiwriter usage

2021-06-29 Thread GitBox
n3nash commented on pull request #3165: URL: https://github.com/apache/hudi/pull/3165#issuecomment-871081550 @nsivabalan Can you review this ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] hudi-bot edited a comment on pull request #3186: [HUDI-2099]hive lock which state is WATING should be released, otherw…

2021-06-29 Thread GitBox
hudi-bot edited a comment on pull request #3186: URL: https://github.com/apache/hudi/pull/3186#issuecomment-871061118 ## CI report: * cf3420f154c8f13fefe4ff4ea589322ac50249b0 Azure:

[GitHub] [hudi] n3nash commented on pull request #3183: [HUDI-2090]when hudi metadata is enabled, use different users to quer…

2021-06-29 Thread GitBox
n3nash commented on pull request #3183: URL: https://github.com/apache/hudi/pull/3183#issuecomment-871080919 @nsivabalan I ran into this today while testing :) @xiarixiaoyao The question is why is the base path "/tmp/view_map". It should ideally be just "/tmp". Can you look into this ?

[GitHub] [hudi] hudi-bot edited a comment on pull request #3186: [HUDI-2099]hive lock which state is WATING should be released, otherw…

2021-06-29 Thread GitBox
hudi-bot edited a comment on pull request #3186: URL: https://github.com/apache/hudi/pull/3186#issuecomment-871061118 ## CI report: * 4fa699a875133e4838700320cce2bc2fe6f738a2 Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3186: [HUDI-2099]hive lock which state is WATING should be released, otherw…

2021-06-29 Thread GitBox
codecov-commenter edited a comment on pull request #3186: URL: https://github.com/apache/hudi/pull/3186#issuecomment-871069429 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3186: [HUDI-2099]hive lock which state is WATING should be released, otherw…

2021-06-29 Thread GitBox
codecov-commenter edited a comment on pull request #3186: URL: https://github.com/apache/hudi/pull/3186#issuecomment-871069429 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3186: [HUDI-2099]hive lock which state is WATING should be released, otherw…

2021-06-29 Thread GitBox
codecov-commenter edited a comment on pull request #3186: URL: https://github.com/apache/hudi/pull/3186#issuecomment-871069429 #

[GitHub] [hudi] yanghua commented on a change in pull request #3170: [HUDI-1930] Bootstrap support configure KeyGenerator by type

2021-06-29 Thread GitBox
yanghua commented on a change in pull request #3170: URL: https://github.com/apache/hudi/pull/3170#discussion_r661106077 ## File path: hudi-cli/src/main/java/org/apache/hudi/cli/commands/SparkMain.java ## @@ -353,14 +353,20 @@ private static int

[GitHub] [hudi] codecov-commenter commented on pull request #3186: [HUDI-2099]hive lock which state is WATING should be released, otherw…

2021-06-29 Thread GitBox
codecov-commenter commented on pull request #3186: URL: https://github.com/apache/hudi/pull/3186#issuecomment-871069429 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3186?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation)

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3182: [HUDI-2089]fix the bug that metatable cannot support non_partition table

2021-06-29 Thread GitBox
codecov-commenter edited a comment on pull request #3182: URL: https://github.com/apache/hudi/pull/3182#issuecomment-870529394 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] hudi-bot edited a comment on pull request #3186: [HUDI-2099]hive lock which state is WATING should be released, otherw…

2021-06-29 Thread GitBox
hudi-bot edited a comment on pull request #3186: URL: https://github.com/apache/hudi/pull/3186#issuecomment-871061118 ## CI report: * 4fa699a875133e4838700320cce2bc2fe6f738a2 Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3182: [HUDI-2089]fix the bug that metatable cannot support non_partition table

2021-06-29 Thread GitBox
codecov-commenter edited a comment on pull request #3182: URL: https://github.com/apache/hudi/pull/3182#issuecomment-870529394 #

[GitHub] [hudi] liijiankang opened a new issue #3187: [SUPPORT]Unable to shutdown local metastore client

2021-06-29 Thread GitBox
liijiankang opened a new issue #3187: URL: https://github.com/apache/hudi/issues/3187 **Describe the problem you faced** I used the code on the hudi master branch to write data into hudi and synced it to hive, and encountered this exception :"ERROR hive.metastore: Unable to

[GitHub] [hudi] hudi-bot edited a comment on pull request #3186: [HUDI-2099]hive lock which state is WATING should be released, otherw…

2021-06-29 Thread GitBox
hudi-bot edited a comment on pull request #3186: URL: https://github.com/apache/hudi/pull/3186#issuecomment-871061118 ## CI report: * 4fa699a875133e4838700320cce2bc2fe6f738a2 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3182: [HUDI-2089]fix the bug that metatable cannot support non_partition table

2021-06-29 Thread GitBox
hudi-bot edited a comment on pull request #3182: URL: https://github.com/apache/hudi/pull/3182#issuecomment-870381931 ## CI report: * 9582f7dcde72e98c09fc12e0f69f5beef28dbaea Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3186: [HUDI-2099]hive lock which state is WATING should be released, otherw…

2021-06-29 Thread GitBox
hudi-bot edited a comment on pull request #3186: URL: https://github.com/apache/hudi/pull/3186#issuecomment-871061118 ## CI report: * 4fa699a875133e4838700320cce2bc2fe6f738a2 Azure:

[GitHub] [hudi] nsivabalan merged pull request #3073: [HUDI-2006] Adding more yaml templates to test suite

2021-06-29 Thread GitBox
nsivabalan merged pull request #3073: URL: https://github.com/apache/hudi/pull/3073 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[hudi] branch master updated (202887b -> 5564c7e)

2021-06-29 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 202887b [HUDI-2092] Fix NPE caused by FlinkStreamerConfig#writePartitionUrlEncode null value (#3176) add

[GitHub] [hudi] hudi-bot commented on pull request #3186: [HUDI-2099]hive lock which state is WATING should be released, otherw…

2021-06-29 Thread GitBox
hudi-bot commented on pull request #3186: URL: https://github.com/apache/hudi/pull/3186#issuecomment-871061118 ## CI report: * 4fa699a875133e4838700320cce2bc2fe6f738a2 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[jira] [Updated] (HUDI-2099) hive lock which state is WATING should be released, otherwise this hive lock will be locked forever

2021-06-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2099: - Labels: pull-request-available (was: ) > hive lock which state is WATING should be released,

[GitHub] [hudi] xiarixiaoyao opened a new pull request #3186: [HUDI-2099]hive lock which state is WATING should be released, otherw…

2021-06-29 Thread GitBox
xiarixiaoyao opened a new pull request #3186: URL: https://github.com/apache/hudi/pull/3186 …ise this hive lock will be locked forever ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3182: [HUDI-2089]fix the bug that metatable cannot support non_partition table

2021-06-29 Thread GitBox
codecov-commenter edited a comment on pull request #3182: URL: https://github.com/apache/hudi/pull/3182#issuecomment-870529394 #

[GitHub] [hudi] garyli1019 closed pull request #2378: [HUDI-1491] Support partition pruning for MOR snapshot query

2021-06-29 Thread GitBox
garyli1019 closed pull request #2378: URL: https://github.com/apache/hudi/pull/2378 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] garyli1019 commented on pull request #2378: [HUDI-1491] Support partition pruning for MOR snapshot query

2021-06-29 Thread GitBox
garyli1019 commented on pull request #2378: URL: https://github.com/apache/hudi/pull/2378#issuecomment-871055741 @yui2010 thanks for your contribution, I think appending the partition column to the data source table should be the ultimate way. closing this pr for now. -- This is an

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3182: [HUDI-2089]fix the bug that metatable cannot support non_partition table

2021-06-29 Thread GitBox
codecov-commenter edited a comment on pull request #3182: URL: https://github.com/apache/hudi/pull/3182#issuecomment-870529394 #

[GitHub] [hudi] yanghua commented on a change in pull request #3177: [HUDI-2093] Fix empty avro schema path caused by duplicate parameters

2021-06-29 Thread GitBox
yanghua commented on a change in pull request #3177: URL: https://github.com/apache/hudi/pull/3177#discussion_r661085373 ## File path: hudi-flink/src/main/java/org/apache/hudi/streamer/FlinkStreamerConfig.java ## @@ -287,7 +283,6 @@

[GitHub] [hudi] hudi-bot edited a comment on pull request #3182: [HUDI-2089]fix the bug that metatable cannot support non_partition table

2021-06-29 Thread GitBox
hudi-bot edited a comment on pull request #3182: URL: https://github.com/apache/hudi/pull/3182#issuecomment-870381931 ## CI report: * d59d9848553983cedbad7e2a08d4ac33b725a68a Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3182: [HUDI-2089]fix the bug that metatable cannot support non_partition table

2021-06-29 Thread GitBox
hudi-bot edited a comment on pull request #3182: URL: https://github.com/apache/hudi/pull/3182#issuecomment-870381931 ## CI report: * d59d9848553983cedbad7e2a08d4ac33b725a68a Azure:

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #3183: [HUDI-2090]when hudi metadata is enabled, use different users to quer…

2021-06-29 Thread GitBox
xiarixiaoyao commented on a change in pull request #3183: URL: https://github.com/apache/hudi/pull/3183#discussion_r661075620 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/collection/DiskBasedMap.java ## @@ -111,8 +111,14 @@ private void initFile(File

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #3183: [HUDI-2090]when hudi metadata is enabled, use different users to quer…

2021-06-29 Thread GitBox
xiarixiaoyao commented on a change in pull request #3183: URL: https://github.com/apache/hudi/pull/3183#discussion_r661075620 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/collection/DiskBasedMap.java ## @@ -111,8 +111,14 @@ private void initFile(File

[GitHub] [hudi] xiarixiaoyao edited a comment on pull request #3139: [HUDI-2058]support incremental query for insert_overwrite_table/insert_overwrite operation on cow table

2021-06-29 Thread GitBox
xiarixiaoyao edited a comment on pull request #3139: URL: https://github.com/apache/hudi/pull/3139#issuecomment-868180580 @leesf @nsivabalan @garyli1019 could you help me review this pr, thanks -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #3181: [HUDI-2059] When log exists in mor table, clustering is triggered. The query result shows that the update record in log is los

2021-06-29 Thread GitBox
xiarixiaoyao commented on a change in pull request #3181: URL: https://github.com/apache/hudi/pull/3181#discussion_r661072382 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/log/HoodieFileSliceReader.java ## @@ -41,11 +43,26 @@ while

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3117: [HUDI-2028] Implement RockDbBasedMap as an alternate to DiskBasedMap in ExternalSpillableMap

2021-06-29 Thread GitBox
codecov-commenter edited a comment on pull request #3117: URL: https://github.com/apache/hudi/pull/3117#issuecomment-864499795 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3117: [HUDI-2028] Implement RockDbBasedMap as an alternate to DiskBasedMap in ExternalSpillableMap

2021-06-29 Thread GitBox
codecov-commenter edited a comment on pull request #3117: URL: https://github.com/apache/hudi/pull/3117#issuecomment-864499795 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3117: [HUDI-2028] Implement RockDbBasedMap as an alternate to DiskBasedMap in ExternalSpillableMap

2021-06-29 Thread GitBox
hudi-bot edited a comment on pull request #3117: URL: https://github.com/apache/hudi/pull/3117#issuecomment-864499549 ## CI report: * 72a359459c780ae3d5f0e6b598aa363513ca28ca Azure:

[GitHub] [hudi] xiarixiaoyao edited a comment on pull request #3183: [HUDI-2090]when hudi metadata is enabled, use different users to quer…

2021-06-29 Thread GitBox
xiarixiaoyao edited a comment on pull request #3183: URL: https://github.com/apache/hudi/pull/3183#issuecomment-871031204 @garyli1019 thanks for you review。 not two users query the same DiskBasedMap。all users share the same directory /tmp/view_map for query. think that, using

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #3183: [HUDI-2090]when hudi metadata is enabled, use different users to quer…

2021-06-29 Thread GitBox
xiarixiaoyao commented on a change in pull request #3183: URL: https://github.com/apache/hudi/pull/3183#discussion_r661064156 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/collection/DiskBasedMap.java ## @@ -111,8 +111,14 @@ private void initFile(File

[GitHub] [hudi] xiarixiaoyao commented on pull request #3183: [HUDI-2090]when hudi metadata is enabled, use different users to quer…

2021-06-29 Thread GitBox
xiarixiaoyao commented on pull request #3183: URL: https://github.com/apache/hudi/pull/3183#issuecomment-871031204 @garyli1019 thanks for you review。 not two users query the same DiskBasedMap。 think that, using user1 to query hudi_table with sparksql, then a diskBasedMap instance

[GitHub] [hudi] xiarixiaoyao commented on pull request #3183: [HUDI-2090]when hudi metadata is enabled, use different users to quer…

2021-06-29 Thread GitBox
xiarixiaoyao commented on pull request #3183: URL: https://github.com/apache/hudi/pull/3183#issuecomment-871026878 @nsivabalan It's easy to reproduce, pls try it thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Updated] (HUDI-2092) Fix NPE caused by FlinkStreamerConfig#writePartitionUrlEncode null value

2021-06-29 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-2092: --- Fix Version/s: 0.9.0 > Fix NPE caused by FlinkStreamerConfig#writePartitionUrlEncode null value >

[jira] [Closed] (HUDI-2092) Fix NPE caused by FlinkStreamerConfig#writePartitionUrlEncode null value

2021-06-29 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-2092. -- Resolution: Fixed 202887b8ca27eb6de808ba7a2e737b13ae9eb8c0 > Fix NPE caused by

[hudi] branch master updated (f665db0 -> 202887b)

2021-06-29 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from f665db0 [HUDI-2085] Support specify compaction paralleism and compaction target io for flink batch compaction

[GitHub] [hudi] yanghua merged pull request #3176: [HUDI-2092] Fix NPE caused by FlinkStreamerConfig#writePartitionUrlEn…

2021-06-29 Thread GitBox
yanghua merged pull request #3176: URL: https://github.com/apache/hudi/pull/3176 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Resolved] (HUDI-1983) Add key gen type config to Configurations page in hudi website

2021-06-29 Thread Xianghu Wang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianghu Wang resolved HUDI-1983. Resolution: Resolved Resolved via asf-site branch : 0507aef156c6aada4ccfa3d760da1a0b58c5a160 > Add

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3117: [HUDI-2028] Implement RockDbBasedMap as an alternate to DiskBasedMap in ExternalSpillableMap

2021-06-29 Thread GitBox
codecov-commenter edited a comment on pull request #3117: URL: https://github.com/apache/hudi/pull/3117#issuecomment-864499795 #

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #3183: [HUDI-2090]when hudi metadata is enabled, use different users to quer…

2021-06-29 Thread GitBox
xiarixiaoyao commented on a change in pull request #3183: URL: https://github.com/apache/hudi/pull/3183#discussion_r661064156 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/collection/DiskBasedMap.java ## @@ -111,8 +111,14 @@ private void initFile(File

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #3182: [HUDI-2089]fix the bug that metatable cannot support non_partition table

2021-06-29 Thread GitBox
xiarixiaoyao commented on a change in pull request #3182: URL: https://github.com/apache/hudi/pull/3182#discussion_r661062340 ## File path: hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/functional/TestMORDataSource.scala ## @@ -677,4 +677,40 @@ class

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #3182: [HUDI-2089]fix the bug that metatable cannot support non_partition table

2021-06-29 Thread GitBox
xiarixiaoyao commented on a change in pull request #3182: URL: https://github.com/apache/hudi/pull/3182#discussion_r661062254 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java ## @@ -376,7 +381,9 @@

[GitHub] [hudi] xiarixiaoyao commented on pull request #3182: [HUDI-2089]fix the bug that metatable cannot support non_partition table

2021-06-29 Thread GitBox
xiarixiaoyao commented on pull request #3182: URL: https://github.com/apache/hudi/pull/3182#issuecomment-871024198 @nsivabalan thanks, i will do it。 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3073: [HUDI-2006] Adding more yaml templates to test suite

2021-06-29 Thread GitBox
codecov-commenter edited a comment on pull request #3073: URL: https://github.com/apache/hudi/pull/3073#issuecomment-860281795 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3074: [HUDI-2007] Fixing hudi_test_suite for spark nodes and adding spark bulk_insert node

2021-06-29 Thread GitBox
codecov-commenter edited a comment on pull request #3074: URL: https://github.com/apache/hudi/pull/3074#issuecomment-860337193 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3073: [HUDI-2006] Adding more yaml templates to test suite

2021-06-29 Thread GitBox
codecov-commenter edited a comment on pull request #3073: URL: https://github.com/apache/hudi/pull/3073#issuecomment-860281795 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3117: [HUDI-2028] Implement RockDbBasedMap as an alternate to DiskBasedMap in ExternalSpillableMap

2021-06-29 Thread GitBox
codecov-commenter edited a comment on pull request #3117: URL: https://github.com/apache/hudi/pull/3117#issuecomment-864499795 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3117: [HUDI-2028] Implement RockDbBasedMap as an alternate to DiskBasedMap in ExternalSpillableMap

2021-06-29 Thread GitBox
hudi-bot edited a comment on pull request #3117: URL: https://github.com/apache/hudi/pull/3117#issuecomment-864499549 ## CI report: * 6d4b556a0c3cf88b7d097a9b036ad36eb0e7820b Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3117: [HUDI-2028] Implement RockDbBasedMap as an alternate to DiskBasedMap in ExternalSpillableMap

2021-06-29 Thread GitBox
hudi-bot edited a comment on pull request #3117: URL: https://github.com/apache/hudi/pull/3117#issuecomment-864499549 ## CI report: * 6d4b556a0c3cf88b7d097a9b036ad36eb0e7820b Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3074: [HUDI-2007] Fixing hudi_test_suite for spark nodes and adding spark bulk_insert node

2021-06-29 Thread GitBox
codecov-commenter edited a comment on pull request #3074: URL: https://github.com/apache/hudi/pull/3074#issuecomment-860337193 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3073: [HUDI-2006] Adding more yaml templates to test suite

2021-06-29 Thread GitBox
codecov-commenter edited a comment on pull request #3073: URL: https://github.com/apache/hudi/pull/3073#issuecomment-860281795 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3074: [HUDI-2007] Fixing hudi_test_suite for spark nodes and adding spark bulk_insert node

2021-06-29 Thread GitBox
hudi-bot edited a comment on pull request #3074: URL: https://github.com/apache/hudi/pull/3074#issuecomment-861653947 ## CI report: * c6c523b32beca10c5797c9a3374ac1c387184744 Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3117: [HUDI-2028] Implement RockDbBasedMap as an alternate to DiskBasedMap in ExternalSpillableMap

2021-06-29 Thread GitBox
codecov-commenter edited a comment on pull request #3117: URL: https://github.com/apache/hudi/pull/3117#issuecomment-864499795 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3073: [HUDI-2006] Adding more yaml templates to test suite

2021-06-29 Thread GitBox
hudi-bot edited a comment on pull request #3073: URL: https://github.com/apache/hudi/pull/3073#issuecomment-861653904 ## CI report: * 6d4ffe00b540244e50d742ec845897b95a9b64a7 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3074: [HUDI-2007] Fixing hudi_test_suite for spark nodes and adding spark bulk_insert node

2021-06-29 Thread GitBox
hudi-bot edited a comment on pull request #3074: URL: https://github.com/apache/hudi/pull/3074#issuecomment-861653947 ## CI report: * 37197b78a1a8ead38d37a760df920cb53ec451de Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3074: [HUDI-2007] Fixing hudi_test_suite for spark nodes and adding spark bulk_insert node

2021-06-29 Thread GitBox
hudi-bot edited a comment on pull request #3074: URL: https://github.com/apache/hudi/pull/3074#issuecomment-861653947 ## CI report: * 37197b78a1a8ead38d37a760df920cb53ec451de Azure:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3172: [HUDI-2069] Enable custom avro deserializer by default and refactored String constants

2021-06-29 Thread GitBox
codecov-commenter edited a comment on pull request #3172: URL: https://github.com/apache/hudi/pull/3172#issuecomment-870958818 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] hudi-bot edited a comment on pull request #3073: [HUDI-2006] Adding more yaml templates to test suite

2021-06-29 Thread GitBox
hudi-bot edited a comment on pull request #3073: URL: https://github.com/apache/hudi/pull/3073#issuecomment-861653904 ## CI report: * e039f490bf755cc7b29a1446aa8156dfd3adc9c4 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3073: [HUDI-2006] Adding more yaml templates to test suite

2021-06-29 Thread GitBox
hudi-bot edited a comment on pull request #3073: URL: https://github.com/apache/hudi/pull/3073#issuecomment-861653904 ## CI report: * e039f490bf755cc7b29a1446aa8156dfd3adc9c4 Azure:

[GitHub] [hudi] nsivabalan commented on pull request #3073: [HUDI-2006] Adding more yaml templates to test suite

2021-06-29 Thread GitBox
nsivabalan commented on pull request #3073: URL: https://github.com/apache/hudi/pull/3073#issuecomment-870973213 I have tested all the yamls. I have updated more into to README. will merge once CI succeeds. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3172: [HUDI-2069] Enable custom avro deserializer by default and refactored String constants

2021-06-29 Thread GitBox
codecov-commenter edited a comment on pull request #3172: URL: https://github.com/apache/hudi/pull/3172#issuecomment-870958818 #

[GitHub] [hudi] codecov-commenter commented on pull request #3172: [HUDI-2069] Enable custom avro deserializer by default and refactored String constants

2021-06-29 Thread GitBox
codecov-commenter commented on pull request #3172: URL: https://github.com/apache/hudi/pull/3172#issuecomment-870958818 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3172?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation)

[GitHub] [hudi] hudi-bot edited a comment on pull request #3172: [HUDI-2069] Enable custom avro deserializer by default and refactored String constants

2021-06-29 Thread GitBox
hudi-bot edited a comment on pull request #3172: URL: https://github.com/apache/hudi/pull/3172#issuecomment-869593797 ## CI report: * 3adabdab2a50423966fc3c94edf29ba7fefe31c1 Azure:

[hudi] branch asf-site updated: Travis CI build asf-site

2021-06-29 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 61ff78d Travis CI build asf-site 61ff78d is

[GitHub] [hudi] hudi-bot edited a comment on pull request #3117: [HUDI-2028] Implement RockDbBasedMap as an alternate to DiskBasedMap in ExternalSpillableMap

2021-06-29 Thread GitBox
hudi-bot edited a comment on pull request #3117: URL: https://github.com/apache/hudi/pull/3117#issuecomment-864499549 ## CI report: * 6d4b556a0c3cf88b7d097a9b036ad36eb0e7820b Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3117: [HUDI-2028] Implement RockDbBasedMap as an alternate to DiskBasedMap in ExternalSpillableMap

2021-06-29 Thread GitBox
hudi-bot edited a comment on pull request #3117: URL: https://github.com/apache/hudi/pull/3117#issuecomment-864499549 ## CI report: * dd248a3ab08bd58980bf731e24d8e403b6f64c17 Azure:

[GitHub] [hudi] sbernauer commented on a change in pull request #3172: [HUDI-2069] Enable custom avro deserializer by default and refactored String constants

2021-06-29 Thread GitBox
sbernauer commented on a change in pull request #3172: URL: https://github.com/apache/hudi/pull/3172#discussion_r660951463 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/AvroKafkaSource.java ## @@ -60,7 +66,7 @@ public

[GitHub] [hudi] hudi-bot edited a comment on pull request #3172: [HUDI-2069] Enable custom avro deserializer by default and refactored String constants

2021-06-29 Thread GitBox
hudi-bot edited a comment on pull request #3172: URL: https://github.com/apache/hudi/pull/3172#issuecomment-869593797 ## CI report: * 72a2badac20bc0a42b1ca5975bfc342f0f43bc90 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3172: [HUDI-2069] Enable custom avro deserializer by default and refactored String constants

2021-06-29 Thread GitBox
hudi-bot edited a comment on pull request #3172: URL: https://github.com/apache/hudi/pull/3172#issuecomment-869593797 ## CI report: * 72a2badac20bc0a42b1ca5975bfc342f0f43bc90 Azure:

[GitHub] [hudi] sbernauer commented on a change in pull request #3172: [HUDI-2069] Enable custom avro deserializer by default and refactored String constants

2021-06-29 Thread GitBox
sbernauer commented on a change in pull request #3172: URL: https://github.com/apache/hudi/pull/3172#discussion_r660949292 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/AvroKafkaSource.java ## @@ -52,6 +54,10 @@ // these are native kafka's

[GitHub] [hudi] sbernauer commented on a change in pull request #3172: [HUDI-2069] Enable custom avro deserializer by default and refactored String constants

2021-06-29 Thread GitBox
sbernauer commented on a change in pull request #3172: URL: https://github.com/apache/hudi/pull/3172#discussion_r660948842 ## File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala ## @@ -381,7 +381,6 @@ object

[GitHub] [hudi] rmahindra123 commented on a change in pull request #3117: [HUDI-2028] Implement RockDbBasedMap as an alternate to DiskBasedMap in ExternalSpillableMap

2021-06-29 Thread GitBox
rmahindra123 commented on a change in pull request #3117: URL: https://github.com/apache/hudi/pull/3117#discussion_r660933216 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/collection/SpillableRocksDBBasedMap.java ## @@ -0,0 +1,169 @@ +/* + * Licensed to

[GitHub] [hudi] nsivabalan commented on pull request #3183: [HUDI-2090]when hudi metadata is enabled, use different users to quer…

2021-06-29 Thread GitBox
nsivabalan commented on pull request #3183: URL: https://github.com/apache/hudi/pull/3183#issuecomment-870859594 @n3nash @bvaradar : how come we did not encounter this until now. any thoughts. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hudi] nsivabalan commented on a change in pull request #3172: [HUDI-2069] Enable custom avro deserializer by default and refactored String constants

2021-06-29 Thread GitBox
nsivabalan commented on a change in pull request #3172: URL: https://github.com/apache/hudi/pull/3172#discussion_r660903610 ## File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala ## @@ -381,7 +381,6 @@ object

[GitHub] [hudi] rmahindra123 edited a comment on pull request #3117: [HUDI-2028] Implement RockDbBasedMap as an alternate to DiskBasedMap in ExternalSpillableMap

2021-06-29 Thread GitBox
rmahindra123 edited a comment on pull request #3117: URL: https://github.com/apache/hudi/pull/3117#issuecomment-870852282 > I see we have more test coverage in TestExternalSpillableMap. Can we parametrize the tests that are applicable and run those for both type of spillable maps.

  1   2   3   4   >