[GitHub] [incubator-hudi] codecov-io commented on issue #1452: [HUDI-740]Fix can not specify the sparkMaster of cleans run command

2020-03-26 Thread GitBox
codecov-io commented on issue #1452: [HUDI-740]Fix can not specify the sparkMaster of cleans run command URL: https://github.com/apache/incubator-hudi/pull/1452#issuecomment-604806506 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1452?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] yanghua commented on issue #1449: [HUDI-698]Add unit test for CleansCommand

2020-03-26 Thread GitBox
yanghua commented on issue #1449: [HUDI-698]Add unit test for CleansCommand URL: https://github.com/apache/incubator-hudi/pull/1449#issuecomment-604802503 @hddong The Travis is red. Please recheck it. This is an automated

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #229

2020-03-26 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.36 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/conf: logging settings.xml toolchains.xml

[jira] [Updated] (HUDI-740) Fix can not specify the sparkMaster of cleans run command

2020-03-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-740: Labels: pull-request-available (was: ) > Fix can not specify the sparkMaster of cleans run command

[GitHub] [incubator-hudi] hddong opened a new pull request #1452: [HUDI-740]Fix can not specify the sparkMaster of cleans run command

2020-03-26 Thread GitBox
hddong opened a new pull request #1452: [HUDI-740]Fix can not specify the sparkMaster of cleans run command URL: https://github.com/apache/incubator-hudi/pull/1452 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review

[jira] [Created] (HUDI-740) Fix can not specify the sparkMaster of cleans run command

2020-03-26 Thread hong dongdong (Jira)
hong dongdong created HUDI-740: -- Summary: Fix can not specify the sparkMaster of cleans run command Key: HUDI-740 URL: https://issues.apache.org/jira/browse/HUDI-740 Project: Apache Hudi (incubating)

[GitHub] [incubator-hudi] xiangtao commented on issue #143: Tracking ticket for folks to be added to slack group

2020-03-26 Thread GitBox
xiangtao commented on issue #143: Tracking ticket for folks to be added to slack group URL: https://github.com/apache/incubator-hudi/issues/143#issuecomment-604786981 Please add: 490548...@qq.com Thanks! This is an

[GitHub] [incubator-hudi] leesf merged pull request #1451: [MINOR] Add error message when check arguments

2020-03-26 Thread GitBox
leesf merged pull request #1451: [MINOR] Add error message when check arguments URL: https://github.com/apache/incubator-hudi/pull/1451 This is an automated message from the Apache Git Service. To respond to the message,

[incubator-hudi] branch master updated: [MINOR] Add error message when check arguments (#1451)

2020-03-26 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 1713f68 [MINOR] Add error message when

[GitHub] [incubator-hudi] xushiyan opened a new pull request #1451: [MINOR] Add error message when check arguments

2020-03-26 Thread GitBox
xushiyan opened a new pull request #1451: [MINOR] Add error message when check arguments URL: https://github.com/apache/incubator-hudi/pull/1451 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before

[GitHub] [incubator-hudi] umehrot2 commented on issue #1421: [HUDI-724] Parallelize getSmallFiles for partitions

2020-03-26 Thread GitBox
umehrot2 commented on issue #1421: [HUDI-724] Parallelize getSmallFiles for partitions URL: https://github.com/apache/incubator-hudi/pull/1421#issuecomment-604748097 @vinothchandar @bvaradar does this look good to be merged ?

[GitHub] [incubator-hudi] prashantwason opened a new pull request #1450: [MINOR] Adding .codecov.yml to set exclusions for code coverage reports.

2020-03-26 Thread GitBox
prashantwason opened a new pull request #1450: [MINOR] Adding .codecov.yml to set exclusions for code coverage reports. URL: https://github.com/apache/incubator-hudi/pull/1450 ## What is the purpose of the pull request Adding the configuration file for codecov which allows us to

[GitHub] [incubator-hudi] smarthi commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-26 Thread GitBox
smarthi commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r398910413 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/CollectionUtils.java

[jira] [Commented] (HUDI-677) Abstract/Refactor all transaction management logic into a set of classes from HoodieWriteClient

2020-03-26 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068035#comment-17068035 ] Vinoth Chandar commented on HUDI-677: - [~hongdongdong] We cannot break any existing APIs on the

[jira] [Updated] (HUDI-739) HoodieIOException: Could not delete in-flight instant

2020-03-26 Thread Catalin Alexandru Zamfir (Jira)
[ https://issues.apache.org/jira/browse/HUDI-739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Catalin Alexandru Zamfir updated HUDI-739: -- Description: We are evaluating Hudi to use for our near real-time ingestion

[jira] [Updated] (HUDI-739) HoodieIOException: Could not delete in-flight instant

2020-03-26 Thread Catalin Alexandru Zamfir (Jira)
[ https://issues.apache.org/jira/browse/HUDI-739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Catalin Alexandru Zamfir updated HUDI-739: -- Description: We are evaluating Hudi to use for our near real-time ingestion

[jira] [Updated] (HUDI-739) HoodieIOException: Could not delete in-flight instant

2020-03-26 Thread Catalin Alexandru Zamfir (Jira)
[ https://issues.apache.org/jira/browse/HUDI-739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Catalin Alexandru Zamfir updated HUDI-739: -- Description: Using Livy we're triggering Spark jobs writing Hudi tables over S3,

[jira] [Created] (HUDI-739) HoodieIOException: Could not delete in-flight instant

2020-03-26 Thread Catalin Alexandru Zamfir (Jira)
Catalin Alexandru Zamfir created HUDI-739: - Summary: HoodieIOException: Could not delete in-flight instant Key: HUDI-739 URL: https://issues.apache.org/jira/browse/HUDI-739 Project: Apache

[GitHub] [incubator-hudi] smarthi commented on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-26 Thread GitBox
smarthi commented on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#issuecomment-604547864 > @smarthi The CollectionUtils IMO does not seem to reuse any code from guava actually.. it just wraps Java

[jira] [Assigned] (HUDI-737) Simplify/Eliminate need for CollectionUtils#Maps/MapsBuilder

2020-03-26 Thread Suneel Marthi (Jira)
[ https://issues.apache.org/jira/browse/HUDI-737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suneel Marthi reassigned HUDI-737: -- Assignee: Suneel Marthi > Simplify/Eliminate need for CollectionUtils#Maps/MapsBuilder >

[jira] [Created] (HUDI-738) Add error msg in DeltaStreamer if `filterDupes=true` is enabled for `operation=UPSERT`.

2020-03-26 Thread Bhavani Sudha (Jira)
Bhavani Sudha created HUDI-738: -- Summary: Add error msg in DeltaStreamer if `filterDupes=true` is enabled for `operation=UPSERT`. Key: HUDI-738 URL: https://issues.apache.org/jira/browse/HUDI-738

[GitHub] [incubator-hudi] vinothchandar commented on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-26 Thread GitBox
vinothchandar commented on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#issuecomment-604532141 @smarthi The CollectionUtils IMO does not seem to reuse any code from guava actually.. it just wraps Java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-26 Thread GitBox
vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r398713100 ## File path:

[jira] [Created] (HUDI-737) Simplify/Eliminate need for CollectionUtils#Maps/MapsBuilder

2020-03-26 Thread Vinoth Chandar (Jira)
Vinoth Chandar created HUDI-737: --- Summary: Simplify/Eliminate need for CollectionUtils#Maps/MapsBuilder Key: HUDI-737 URL: https://issues.apache.org/jira/browse/HUDI-737 Project: Apache Hudi

[jira] [Created] (HUDI-736) Simplify ReflectionUtils#getTopLevelClasses

2020-03-26 Thread Vinoth Chandar (Jira)
Vinoth Chandar created HUDI-736: --- Summary: Simplify ReflectionUtils#getTopLevelClasses Key: HUDI-736 URL: https://issues.apache.org/jira/browse/HUDI-736 Project: Apache Hudi (incubating)

[incubator-hudi] branch master updated: [HUDI-678] Make config package spark free (#1418)

2020-03-26 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 8b0a400 [HUDI-678] Make config package

[GitHub] [incubator-hudi] vinothchandar merged pull request #1418: [HUDI-678] Make config package spark free

2020-03-26 Thread GitBox
vinothchandar merged pull request #1418: [HUDI-678] Make config package spark free URL: https://github.com/apache/incubator-hudi/pull/1418 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1418: [HUDI-678] Make config package spark free

2020-03-26 Thread GitBox
leesf commented on a change in pull request #1418: [HUDI-678] Make config package spark free URL: https://github.com/apache/incubator-hudi/pull/1418#discussion_r398467934 ## File path: hudi-client/src/main/java/org/apache/hudi/config/HoodieMemoryConfig.java ## @@ -113,52

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1418: [HUDI-678] Make config package spark free

2020-03-26 Thread GitBox
leesf commented on a change in pull request #1418: [HUDI-678] Make config package spark free URL: https://github.com/apache/incubator-hudi/pull/1418#discussion_r398467190 ## File path: hudi-client/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java ## @@ -503,22

[jira] [Commented] (HUDI-677) Abstract/Refactor all transaction management logic into a set of classes from HoodieWriteClient

2020-03-26 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17067538#comment-17067538 ] hong dongdong commented on HUDI-677: [~vinoth] As summary said, all transaction need move out of

[GitHub] [incubator-hudi] loagosad commented on issue #1438: How to get the file name corresponding to HoodieKey through the GlobalBloomIndex

2020-03-26 Thread GitBox
loagosad commented on issue #1438: How to get the file name corresponding to HoodieKey through the GlobalBloomIndex URL: https://github.com/apache/incubator-hudi/issues/1438#issuecomment-604288934 The Hudi version I test is 0.5.1

[GitHub] [incubator-hudi] hddong opened a new pull request #1449: [HUDI-698]Add unit test for CleansCommand

2020-03-26 Thread GitBox
hddong opened a new pull request #1449: [HUDI-698]Add unit test for CleansCommand URL: https://github.com/apache/incubator-hudi/pull/1449 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a

[jira] [Updated] (HUDI-698) Add unit test for CleansCommand

2020-03-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-698: Labels: pull-request-available (was: ) > Add unit test for CleansCommand >

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1418: [HUDI-678] Make config package spark free

2020-03-26 Thread GitBox
yanghua commented on a change in pull request #1418: [HUDI-678] Make config package spark free URL: https://github.com/apache/incubator-hudi/pull/1418#discussion_r398345709 ## File path: hudi-client/src/main/java/org/apache/hudi/config/HoodieMemoryConfig.java ## @@

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1448: [MINOR] Update DOAP with 0.5.2 Release

2020-03-26 Thread GitBox
yanghua commented on a change in pull request #1448: [MINOR] Update DOAP with 0.5.2 Release URL: https://github.com/apache/incubator-hudi/pull/1448#discussion_r398342379 ## File path: doap_HUDI.rdf ## @@ -46,6 +46,11 @@ 2020-01-31 0.5.1 +

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1448: [MINOR] Update DOAP with 0.5.2 Release

2020-03-26 Thread GitBox
yanghua commented on a change in pull request #1448: [MINOR] Update DOAP with 0.5.2 Release URL: https://github.com/apache/incubator-hudi/pull/1448#discussion_r398339368 ## File path: doap_HUDI.rdf ## @@ -46,6 +46,11 @@ 2020-01-31 0.5.1 +

[jira] [Updated] (HUDI-731) Implement a chained transformer for deltastreamer that can chain other transformer implementations

2020-03-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-731: Fix Version/s: 0.6.0 > Implement a chained transformer for deltastreamer that can chain other > transformer