[hudi] branch master updated: [MINOR] Remove boxing (#3062)

2021-06-09 Thread wangxianghu
This is an automated email from the ASF dual-hosted git repository. wangxianghu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new a8b10e9 [MINOR] Remove boxing (#3062)

[jira] [Commented] (HUDI-1628) Improve data locality during ingestion

2021-06-09 Thread Thirumalai Raj R (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17360549#comment-17360549 ] Thirumalai Raj R commented on HUDI-1628: Hi [~vinoth] / [~satishkotha] , is anyone working on this

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3062: [MINOR] Remove boxing

2021-06-09 Thread GitBox
codecov-commenter edited a comment on pull request #3062: URL: https://github.com/apache/hudi/pull/3062#issuecomment-858241196 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3061: [HUDI-1993] Add Baidu BOS storage support for hudi

2021-06-09 Thread GitBox
codecov-commenter edited a comment on pull request #3061: URL: https://github.com/apache/hudi/pull/3061#issuecomment-858230756 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] codecov-commenter commented on pull request #3062: [MINOR] Remove boxing

2021-06-09 Thread GitBox
codecov-commenter commented on pull request #3062: URL: https://github.com/apache/hudi/pull/3062#issuecomment-858241196 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3062?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation)

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3061: [HUDI-1993] Add Baidu BOS storage support for hudi

2021-06-09 Thread GitBox
codecov-commenter edited a comment on pull request #3061: URL: https://github.com/apache/hudi/pull/3061#issuecomment-858230756 #

[hudi] branch asf-site updated: Travis CI build asf-site

2021-06-09 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 0f65425 Travis CI build asf-site 0f65425 is

[hudi] branch asf-site updated: [MINOR] fix typo (#3060)

2021-06-09 Thread garyli
This is an automated email from the ASF dual-hosted git repository. garyli pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 4a2ab0d [MINOR] fix typo (#3060) 4a2ab0d is

[GitHub] [hudi] garyli1019 merged pull request #3060: [HUDI-1995] FIx typo in oss cn docs

2021-06-09 Thread GitBox
garyli1019 merged pull request #3060: URL: https://github.com/apache/hudi/pull/3060 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [hudi] codecov-commenter commented on pull request #3061: [HUDI-1993] Add Baidu BOS storage support for hudi

2021-06-09 Thread GitBox
codecov-commenter commented on pull request #3061: URL: https://github.com/apache/hudi/pull/3061#issuecomment-858230756 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3061?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation)

[GitHub] [hudi] chaplinthink opened a new pull request #3062: [MINOR] Remove boxing

2021-06-09 Thread GitBox
chaplinthink opened a new pull request #3062: URL: https://github.com/apache/hudi/pull/3062 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of

[jira] [Updated] (HUDI-1995) FIx typo in oss cn docs

2021-06-09 Thread Jun Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Zhang updated HUDI-1995: Summary: FIx typo in oss cn docs (was: FIx type in oss cn docs) > FIx typo in oss cn docs >

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3058: [HUDI-1994] Release the new records iterator for append handle #close

2021-06-09 Thread GitBox
codecov-commenter edited a comment on pull request #3058: URL: https://github.com/apache/hudi/pull/3058#issuecomment-858187618 #

[GitHub] [hudi] zhangjun0x01 opened a new pull request #3061: [HUDI-1993] Add Baidu BOS storage support for hudi

2021-06-09 Thread GitBox
zhangjun0x01 opened a new pull request #3061: URL: https://github.com/apache/hudi/pull/3061 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of

[jira] [Updated] (HUDI-1995) FIx type in oss cn docs

2021-06-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-1995: - Labels: pull-request-available (was: ) > FIx type in oss cn docs > --- > >

[jira] [Created] (HUDI-1995) FIx type in oss cn docs

2021-06-09 Thread Jun Zhang (Jira)
Jun Zhang created HUDI-1995: --- Summary: FIx type in oss cn docs Key: HUDI-1995 URL: https://issues.apache.org/jira/browse/HUDI-1995 Project: Apache Hudi Issue Type: Bug Components:

[GitHub] [hudi] zhangjun0x01 opened a new pull request #3060: [HUDI-1995] FIx type in oss cn docs

2021-06-09 Thread GitBox
zhangjun0x01 opened a new pull request #3060: URL: https://github.com/apache/hudi/pull/3060 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3058: [HUDI-1994] Release the new records iterator for append handle #close

2021-06-09 Thread GitBox
codecov-commenter edited a comment on pull request #3058: URL: https://github.com/apache/hudi/pull/3058#issuecomment-858187618 #

[GitHub] [hudi] lppsuixn opened a new issue #3059: when java client api support MERGE_ON_READ ?

2021-06-09 Thread GitBox
lppsuixn opened a new issue #3059: URL: https://github.com/apache/hudi/issues/3059 Currently, only support COPY_ON_WRITE,when will support MERGE_ON_READ ? Thanks! ```java switch (metaClient.getTableType()) { case COPY_ON_WRITE: return new

[GitHub] [hudi] danny0405 closed pull request #3058: [HUDI-1994] Release the new records iterator for append handle #close

2021-06-09 Thread GitBox
danny0405 closed pull request #3058: URL: https://github.com/apache/hudi/pull/3058 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3058: [HUDI-1994] Release the new records iterator for append handle #close

2021-06-09 Thread GitBox
codecov-commenter edited a comment on pull request #3058: URL: https://github.com/apache/hudi/pull/3058#issuecomment-858187618 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3058: [HUDI-1994] Release the new records iterator for append handle #close

2021-06-09 Thread GitBox
codecov-commenter edited a comment on pull request #3058: URL: https://github.com/apache/hudi/pull/3058#issuecomment-858187618 #

[GitHub] [hudi] codecov-commenter commented on pull request #3058: [HUDI-1994] Release the new records iterator for append handle #close

2021-06-09 Thread GitBox
codecov-commenter commented on pull request #3058: URL: https://github.com/apache/hudi/pull/3058#issuecomment-858187618 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3058?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation)

[GitHub] [hudi] vingov commented on pull request #2896: [HUDI-1790] Added SqlSource to fetch data from any partitions for backfill use case

2021-06-09 Thread GitBox
vingov commented on pull request #2896: URL: https://github.com/apache/hudi/pull/2896#issuecomment-858187192 The test failures are not related to this change, its on hudi-client/hudi-spark-client modules. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2999: [HUDI-764] [HUDI-765] Orc reader writer Implementation

2021-06-09 Thread GitBox
codecov-commenter edited a comment on pull request #2999: URL: https://github.com/apache/hudi/pull/2999#issuecomment-849318661 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2999: [HUDI-764] [HUDI-765] Orc reader writer Implementation

2021-06-09 Thread GitBox
codecov-commenter edited a comment on pull request #2999: URL: https://github.com/apache/hudi/pull/2999#issuecomment-849318661 #

[jira] [Updated] (HUDI-1994) Release the new records iterator for append handle #close

2021-06-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-1994: - Labels: pull-request-available (was: ) > Release the new records iterator for append handle

[GitHub] [hudi] danny0405 opened a new pull request #3058: [HUDI-1994] Release the new records iterator for append handle #close

2021-06-09 Thread GitBox
danny0405 opened a new pull request #3058: URL: https://github.com/apache/hudi/pull/3058 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of the

[jira] [Updated] (HUDI-1994) Release the new records iterator for append handle #close

2021-06-09 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-1994: - Summary: Release the new records iterator for append handle #close (was: [HUDI-1992] Release the new

[jira] [Created] (HUDI-1994) [HUDI-1992] Release the new records iterator for append handle #close

2021-06-09 Thread Danny Chen (Jira)
Danny Chen created HUDI-1994: Summary: [HUDI-1992] Release the new records iterator for append handle #close Key: HUDI-1994 URL: https://issues.apache.org/jira/browse/HUDI-1994 Project: Apache Hudi

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2999: [HUDI-764] [HUDI-765] Orc reader writer Implementation

2021-06-09 Thread GitBox
codecov-commenter edited a comment on pull request #2999: URL: https://github.com/apache/hudi/pull/2999#issuecomment-849318661 #

[jira] [Resolved] (HUDI-1993) Add Baidu BOS storage support for hudi

2021-06-09 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar resolved HUDI-1993. -- Resolution: Fixed > Add Baidu BOS storage support for hudi >

[jira] [Updated] (HUDI-1743) Add support for Spark SQL File based transformer for deltastreamer

2021-06-09 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-1743: -- Status: Closed (was: Patch Available) > Add support for Spark SQL File based

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2896: [HUDI-1790] Added SqlSource to fetch data from any partitions for backfill use case

2021-06-09 Thread GitBox
codecov-commenter edited a comment on pull request #2896: URL: https://github.com/apache/hudi/pull/2896#issuecomment-828971694 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2999: [HUDI-764] [HUDI-765] Orc reader writer Implementation

2021-06-09 Thread GitBox
codecov-commenter edited a comment on pull request #2999: URL: https://github.com/apache/hudi/pull/2999#issuecomment-849318661 #

[GitHub] [hudi] jintaoguan commented on a change in pull request #2999: [HUDI-764] [HUDI-765] Orc reader writer Implementation

2021-06-09 Thread GitBox
jintaoguan commented on a change in pull request #2999: URL: https://github.com/apache/hudi/pull/2999#discussion_r648715398 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/AvroOrcUtils.java ## @@ -0,0 +1,798 @@ +/* + * Licensed to the Apache Software

[jira] [Assigned] (HUDI-1294) Implement inlining of HFile Data Blocks in metadata table log

2021-06-09 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned HUDI-1294: Assignee: Rajesh Mahindra (was: Vinoth Chandar) > Implement inlining of HFile Data Blocks

[jira] [Updated] (HUDI-1294) Implement inlining of HFile Data Blocks in metadata table log

2021-06-09 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1294: - Component/s: Performance > Implement inlining of HFile Data Blocks in metadata table log >

[jira] [Assigned] (HUDI-686) Implement BloomIndexV2 that does not depend on memory caching

2021-06-09 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned HUDI-686: --- Assignee: Rajesh Mahindra (was: sivabalan narayanan) > Implement BloomIndexV2 that does not

[jira] [Assigned] (HUDI-818) Optimize the default value of hoodie.memory.merge.max.size option

2021-06-09 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned HUDI-818: --- Assignee: Rajesh Mahindra (was: sivabalan narayanan) > Optimize the default value of

[GitHub] [hudi] nsivabalan commented on pull request #2925: [HUDI-1879] Fix RO Tables Returning Snapshot Result

2021-06-09 Thread GitBox
nsivabalan commented on pull request #2925: URL: https://github.com/apache/hudi/pull/2925#issuecomment-858074068 I have approved it. @vinothchandar @umehrot2 : Feel free to review and land this in. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hudi] nsivabalan commented on a change in pull request #2925: [HUDI-1879] Fix RO Tables Returning Snapshot Result

2021-06-09 Thread GitBox
nsivabalan commented on a change in pull request #2925: URL: https://github.com/apache/hudi/pull/2925#discussion_r648656347 ## File path: hudi-sync/hudi-hive-sync/src/main/java/org/apache/hudi/hive/HiveSyncTool.java ## @@ -106,13 +106,13 @@ public void syncHoodieTable() {

[GitHub] [hudi] dkapupara-te commented on issue #2856: [SUPPORT] Metrics Prometheus pushgateway

2021-06-09 Thread GitBox
dkapupara-te commented on issue #2856: URL: https://github.com/apache/hudi/issues/2856#issuecomment-858026721 I am experiencing the same issue using simpleclient with Spring boot for one of our cron jobs. ```Caused by: java.net.UnknownHostException: https``` -- This is an

[GitHub] [hudi] yui2010 commented on pull request #2378: [HUDI-1491] Support partition pruning for MOR snapshot query

2021-06-09 Thread GitBox
yui2010 commented on pull request #2378: URL: https://github.com/apache/hudi/pull/2378#issuecomment-857898365 > #2926 overlaps with this? @yui2010 , @pengzhiwei2018 any thoughts? yes. I noted pengzhiwei2018's good implements, there is still may have the problem about result

[GitHub] [hudi] jtmzheng commented on issue #2995: [SUPPORT] Upserts creating duplicates after enabling metadata table in Hudi 0.7 indexing pipeline

2021-06-09 Thread GitBox
jtmzheng commented on issue #2995: URL: https://github.com/apache/hudi/issues/2995#issuecomment-857903531 Interesting, @prashantwason so the timeline of how I ran the shadow pipeline was: 1. Stopped ingestion pipeline (0.6 without metadata table) 2. Ran s3-dist-cp job to

[GitHub] [hudi] yui2010 commented on pull request #2663: [HUDI-1680] Add getPreferredLocations for RDD

2021-06-09 Thread GitBox
yui2010 commented on pull request #2663: URL: https://github.com/apache/hudi/pull/2663#issuecomment-857881932 Hi vinoth and nsivabalan. I'm very sorry, because I'm too busy recently. and I'll reply later -- This is an automated message from the Apache Git Service. To respond to the

[jira] [Updated] (HUDI-1932) Hive Sync should not always update last_commit_time_sync

2021-06-09 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1932: - Status: In Progress (was: Open) > Hive Sync should not always update last_commit_time_sync >

[jira] [Assigned] (HUDI-1932) Hive Sync should not always update last_commit_time_sync

2021-06-09 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-1932: Assignee: nate radtke > Hive Sync should not always update last_commit_time_sync >

[GitHub] [hudi] tmacedo commented on issue #1925: [SUPPORT] Support for Confluent Cloud SchemaRegistryProvider

2021-06-09 Thread GitBox
tmacedo commented on issue #1925: URL: https://github.com/apache/hudi/issues/1925#issuecomment-857782881 I'm surprised this worked for you both as I was trying this and stumbled upon https://bugs.openjdk.java.net/browse/JDK-5043482 This is also on EMR, so I assume you're not using

[jira] [Resolved] (HUDI-1892) NullPointerException when using OverwriteNonDefaultsWithLatestAvroPayload at hudi 0.9.0

2021-06-09 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay resolved HUDI-1892. - Resolution: Fixed > NullPointerException when using OverwriteNonDefaultsWithLatestAvroPayload at > hudi 0.9.0 >

[jira] [Commented] (HUDI-1892) NullPointerException when using OverwriteNonDefaultsWithLatestAvroPayload at hudi 0.9.0

2021-06-09 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17360060#comment-17360060 ] Vinay commented on HUDI-1892: - Fixed - 11360f707e969747e1a30791acb23857cc376589 > NullPointerException when

[jira] [Closed] (HUDI-1992) Release the new records map for merge handle #close

2021-06-09 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1992. -- Resolution: Done afbafe70469c40ae6c23eec59848ca92b2f07fc7 > Release the new records map for merge handle

[hudi] branch master updated: [HUDI-1992] Release the new records map for merge handle #close (#3056)

2021-06-09 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new afbafe7 [HUDI-1992] Release the new records

[GitHub] [hudi] yanghua merged pull request #3056: [HUDI-1992] Release the new records map for merge handle #close

2021-06-09 Thread GitBox
yanghua merged pull request #3056: URL: https://github.com/apache/hudi/pull/3056 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[hudi] branch asf-site updated: Travis CI build asf-site

2021-06-09 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 142e34d Travis CI build asf-site 142e34d is

[hudi] branch asf-site updated: Add Baidu BOS storage support for hudi (#3057)

2021-06-09 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new f8e5445 Add Baidu BOS storage support for

[GitHub] [hudi] leesf merged pull request #3057: [HUDI-1993]Add Baidu BOS storage support for hudi

2021-06-09 Thread GitBox
leesf merged pull request #3057: URL: https://github.com/apache/hudi/pull/3057 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[jira] [Updated] (HUDI-1993) Add Baidu BOS storage support for hudi

2021-06-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-1993: - Labels: pull-request-available (was: ) > Add Baidu BOS storage support for hudi >

[GitHub] [hudi] zhangjun0x01 opened a new pull request #3057: [HUDI-1993]Add Baidu BOS storage support for hudi

2021-06-09 Thread GitBox
zhangjun0x01 opened a new pull request #3057: URL: https://github.com/apache/hudi/pull/3057 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of

[jira] [Created] (HUDI-1993) Add Baidu BOS storage support for hudi

2021-06-09 Thread Jun Zhang (Jira)
Jun Zhang created HUDI-1993: --- Summary: Add Baidu BOS storage support for hudi Key: HUDI-1993 URL: https://issues.apache.org/jira/browse/HUDI-1993 Project: Apache Hudi Issue Type: Improvement

[jira] [Resolved] (HUDI-1990) Delete duplicate BootstrapFunction

2021-06-09 Thread Xianghu Wang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianghu Wang resolved HUDI-1990. Resolution: Fixed Fixed via master : 728089a88827c3f4e9813f2d2e4d3d4a4a872605 > Delete duplicate

[GitHub] [hudi] wangxianghu merged pull request #3052: [HUDI-1990] Delete duplicate BootstrapFunction

2021-06-09 Thread GitBox
wangxianghu merged pull request #3052: URL: https://github.com/apache/hudi/pull/3052 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[hudi] branch master updated: delete duplicate bootstrap function (#3052)

2021-06-09 Thread wangxianghu
This is an automated email from the ASF dual-hosted git repository. wangxianghu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 728089a delete duplicate bootstrap function

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3052: [HUDI-1990] Delete duplicate BootstrapFunction

2021-06-09 Thread GitBox
codecov-commenter edited a comment on pull request #3052: URL: https://github.com/apache/hudi/pull/3052#issuecomment-856817842 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3046: [HUDI-1984] Support independent flink hudi compaction function

2021-06-09 Thread GitBox
codecov-commenter edited a comment on pull request #3046: URL: https://github.com/apache/hudi/pull/3046#issuecomment-855935024 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2896: [HUDI-1790] Added SqlSource to fetch data from any partitions for backfill use case

2021-06-09 Thread GitBox
codecov-commenter edited a comment on pull request #2896: URL: https://github.com/apache/hudi/pull/2896#issuecomment-828971694 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3056: [HUDI-1992] Release the new records map for merge handle #close

2021-06-09 Thread GitBox
codecov-commenter edited a comment on pull request #3056: URL: https://github.com/apache/hudi/pull/3056#issuecomment-857536141 #

[GitHub] [hudi] codecov-commenter commented on pull request #3056: [HUDI-1992] Release the new records map for merge handle #close

2021-06-09 Thread GitBox
codecov-commenter commented on pull request #3056: URL: https://github.com/apache/hudi/pull/3056#issuecomment-857536141 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3056?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation)

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2896: [HUDI-1790] Added SqlSource to fetch data from any partitions for backfill use case

2021-06-09 Thread GitBox
codecov-commenter edited a comment on pull request #2896: URL: https://github.com/apache/hudi/pull/2896#issuecomment-828971694 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3052: [HUDI-1990] Delete duplicate BootstrapFunction

2021-06-09 Thread GitBox
codecov-commenter edited a comment on pull request #3052: URL: https://github.com/apache/hudi/pull/3052#issuecomment-856817842 #

[GitHub] [hudi] wangxianghu commented on pull request #2963: [HUDI-1904] Introduce SchemaProviderInterface to make SchemaProvider unified

2021-06-09 Thread GitBox
wangxianghu commented on pull request #2963: URL: https://github.com/apache/hudi/pull/2963#issuecomment-857455729 > Looks good. but guess, you haven't answered my question yet. Whats the rational behind this unification in general. Is it just to avoid duplicate code in

[GitHub] [hudi] danny0405 commented on a change in pull request #3046: [HUDI-1984] Support independent flink hudi compaction function

2021-06-09 Thread GitBox
danny0405 commented on a change in pull request #3046: URL: https://github.com/apache/hudi/pull/3046#discussion_r648033744 ## File path: hudi-flink/src/main/java/org/apache/hudi/util/CompactionUtil.java ## @@ -0,0 +1,88 @@ +/* + * Licensed to the Apache Software Foundation

[jira] [Updated] (HUDI-1992) Release the new records map for merge handle #close

2021-06-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-1992: - Labels: pull-request-available (was: ) > Release the new records map for merge handle #close >

[GitHub] [hudi] danny0405 opened a new pull request #3056: [HUDI-1992] Release the new records map for merge handle #close

2021-06-09 Thread GitBox
danny0405 opened a new pull request #3056: URL: https://github.com/apache/hudi/pull/3056 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of the

[GitHub] [hudi] vingov commented on pull request #2896: [HUDI-1790] Added SqlSource to fetch data from any partitions for backfill use case

2021-06-09 Thread GitBox
vingov commented on pull request #2896: URL: https://github.com/apache/hudi/pull/2896#issuecomment-857440636 @nsivabalan - I've addressed all the review comments, please review it again, thanks! -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hudi] vingov commented on a change in pull request #2896: [HUDI-1790] Added SqlSource to fetch data from any partitions for backfill use case

2021-06-09 Thread GitBox
vingov commented on a change in pull request #2896: URL: https://github.com/apache/hudi/pull/2896#discussion_r648020965 ## File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/sources/TestSqlSource.java ## @@ -0,0 +1,121 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] vingov commented on a change in pull request #2896: [HUDI-1790] Added SqlSource to fetch data from any partitions for backfill use case

2021-06-09 Thread GitBox
vingov commented on a change in pull request #2896: URL: https://github.com/apache/hudi/pull/2896#discussion_r648020771 ## File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/sources/TestSqlSource.java ## @@ -0,0 +1,121 @@ +/* + * Licensed to the Apache Software

[jira] [Created] (HUDI-1992) Release the new records map for merge handle #close

2021-06-09 Thread Danny Chen (Jira)
Danny Chen created HUDI-1992: Summary: Release the new records map for merge handle #close Key: HUDI-1992 URL: https://issues.apache.org/jira/browse/HUDI-1992 Project: Apache Hudi Issue Type:

[GitHub] [hudi] vingov commented on a change in pull request #2896: [HUDI-1790] Added SqlSource to fetch data from any partitions for backfill use case

2021-06-09 Thread GitBox
vingov commented on a change in pull request #2896: URL: https://github.com/apache/hudi/pull/2896#discussion_r648015740 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/SqlSource.java ## @@ -0,0 +1,79 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] vingov commented on a change in pull request #2896: [HUDI-1790] Added SqlSource to fetch data from any partitions for backfill use case

2021-06-09 Thread GitBox
vingov commented on a change in pull request #2896: URL: https://github.com/apache/hudi/pull/2896#discussion_r648015475 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/SqlSource.java ## @@ -0,0 +1,79 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] vingov commented on a change in pull request #2896: [HUDI-1790] Added SqlSource to fetch data from any partitions for backfill use case

2021-06-09 Thread GitBox
vingov commented on a change in pull request #2896: URL: https://github.com/apache/hudi/pull/2896#discussion_r648014788 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/SqlSource.java ## @@ -0,0 +1,79 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] vingov commented on a change in pull request #2896: [HUDI-1790] Added SqlSource to fetch data from any partitions for backfill use case

2021-06-09 Thread GitBox
vingov commented on a change in pull request #2896: URL: https://github.com/apache/hudi/pull/2896#discussion_r648014435 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/SqlSource.java ## @@ -0,0 +1,79 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] vingov commented on a change in pull request #2896: [HUDI-1790] Added SqlSource to fetch data from any partitions for backfill use case

2021-06-09 Thread GitBox
vingov commented on a change in pull request #2896: URL: https://github.com/apache/hudi/pull/2896#discussion_r648014332 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/SqlSource.java ## @@ -0,0 +1,79 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] pengzhiwei2018 commented on a change in pull request #2925: [HUDI-1879] Fix RO Tables Returning Snapshot Result

2021-06-09 Thread GitBox
pengzhiwei2018 commented on a change in pull request #2925: URL: https://github.com/apache/hudi/pull/2925#discussion_r648003005 ## File path: hudi-sync/hudi-hive-sync/src/main/java/org/apache/hudi/hive/HiveSyncTool.java ## @@ -106,13 +106,13 @@ public void syncHoodieTable() {

[GitHub] [hudi] pengzhiwei2018 commented on a change in pull request #2925: [HUDI-1879] Fix RO Tables Returning Snapshot Result

2021-06-09 Thread GitBox
pengzhiwei2018 commented on a change in pull request #2925: URL: https://github.com/apache/hudi/pull/2925#discussion_r648003005 ## File path: hudi-sync/hudi-hive-sync/src/main/java/org/apache/hudi/hive/HiveSyncTool.java ## @@ -106,13 +106,13 @@ public void syncHoodieTable() {

[GitHub] [hudi] nsivabalan commented on a change in pull request #2925: [HUDI-1879] Fix RO Tables Returning Snapshot Result

2021-06-09 Thread GitBox
nsivabalan commented on a change in pull request #2925: URL: https://github.com/apache/hudi/pull/2925#discussion_r647993040 ## File path: hudi-sync/hudi-hive-sync/src/main/java/org/apache/hudi/hive/HiveSyncTool.java ## @@ -106,13 +106,13 @@ public void syncHoodieTable() {

[GitHub] [hudi] garyli1019 merged pull request #3049: [HUDI-1987] Fix non partition table hive meta sync for flink writer

2021-06-09 Thread GitBox
garyli1019 merged pull request #3049: URL: https://github.com/apache/hudi/pull/3049 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[hudi] branch master updated (a6f5fc5 -> e8fcf04)

2021-06-09 Thread garyli
This is an automated email from the ASF dual-hosted git repository. garyli pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from a6f5fc5 [HUDI-1986] Skip creating marker files for flink merge handle (#3047) add e8fcf04 [HUDI-1987] Fix non

[GitHub] [hudi] garyli1019 merged pull request #3047: [HUDI-1986] Skip creating marker files for flink merge handle

2021-06-09 Thread GitBox
garyli1019 merged pull request #3047: URL: https://github.com/apache/hudi/pull/3047 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[hudi] branch master updated (11360f7 -> a6f5fc5)

2021-06-09 Thread garyli
This is an automated email from the ASF dual-hosted git repository. garyli pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 11360f7 [HUDI-1892] Fix NPE when avro field value is null (#3051) add a6f5fc5 [HUDI-1986] Skip creating marker

[GitHub] [hudi] danny0405 commented on pull request #3033: [HUDI-1969] Support reading logs for MOR Hive rt table

2021-06-09 Thread GitBox
danny0405 commented on pull request #3033: URL: https://github.com/apache/hudi/pull/3033#issuecomment-857412845 Hi @vinothchandar , can you take a look for this, i found that there was a TODO here, and HUDI has global index now and we can remove the TODO and support reading logs. --

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3055: [HUDI-1991] Fixing drop dups exception in bulk insert row writer path

2021-06-09 Thread GitBox
codecov-commenter edited a comment on pull request #3055: URL: https://github.com/apache/hudi/pull/3055#issuecomment-857384377 #