[GitHub] [incubator-hudi] yihua commented on a change in pull request #1165: [HUDI-76] Add CSV Source support for Hudi Delta Streamer

2020-02-25 Thread GitBox
yihua commented on a change in pull request #1165: [HUDI-76] Add CSV Source support for Hudi Delta Streamer URL: https://github.com/apache/incubator-hudi/pull/1165#discussion_r384313736 ## File path: hudi-client/src/test/java/org/apache/hudi/common/HoodieTestDataGenerator.java ###

[GitHub] [incubator-hudi] smarthi commented on a change in pull request #1350: [HUDI-629]: Replace Guava's Hashing with an equivalent in NumericUtils.java

2020-02-25 Thread GitBox
smarthi commented on a change in pull request #1350: [HUDI-629]: Replace Guava's Hashing with an equivalent in NumericUtils.java URL: https://github.com/apache/incubator-hudi/pull/1350#discussion_r384312049 ## File path: hudi-client/src/main/java/org/apache/hudi/io/compact/HoodieMe

[GitHub] [incubator-hudi] yanghua commented on issue #1350: [HUDI-629]: Replace Guava's Hashing with an equivalent in NumericUtils.java

2020-02-25 Thread GitBox
yanghua commented on issue #1350: [HUDI-629]: Replace Guava's Hashing with an equivalent in NumericUtils.java URL: https://github.com/apache/incubator-hudi/pull/1350#issuecomment-591268945 @leesf Would you please check it again? -

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1350: [HUDI-629]: Replace Guava's Hashing with an equivalent in NumericUtils.java

2020-02-25 Thread GitBox
yanghua commented on a change in pull request #1350: [HUDI-629]: Replace Guava's Hashing with an equivalent in NumericUtils.java URL: https://github.com/apache/incubator-hudi/pull/1350#discussion_r384297013 ## File path: hudi-client/src/main/java/org/apache/hudi/io/compact/HoodieMe

[GitHub] [incubator-hudi] vinothchandar merged pull request #1353: [HUDI-632] Update documentation (docker_demo) to mention both commit and deltacommit files

2020-02-25 Thread GitBox
vinothchandar merged pull request #1353: [HUDI-632] Update documentation (docker_demo) to mention both commit and deltacommit files URL: https://github.com/apache/incubator-hudi/pull/1353 This is an automated message from th

[incubator-hudi] branch asf-site updated: [HUDI-632] Update documentation (docker_demo) to mention both commit and deltacommit files (#1353)

2020-02-25 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new ab25eed [HUDI-632] Update documenta

[GitHub] [incubator-hudi] vinothchandar commented on issue #1351: [WIP] [HUDI-625] Fixing performance issues around DiskBasedMap & kryo

2020-02-25 Thread GitBox
vinothchandar commented on issue #1351: [WIP] [HUDI-625] Fixing performance issues around DiskBasedMap & kryo URL: https://github.com/apache/incubator-hudi/pull/1351#issuecomment-591243675 Clo This is an automated message fro

[GitHub] [incubator-hudi] vinothchandar closed pull request #1351: [WIP] [HUDI-625] Fixing performance issues around DiskBasedMap & kryo

2020-02-25 Thread GitBox
vinothchandar closed pull request #1351: [WIP] [HUDI-625] Fixing performance issues around DiskBasedMap & kryo URL: https://github.com/apache/incubator-hudi/pull/1351 This is an automated message from the Apache Git Service.

[jira] [Updated] (HUDI-581) NOTICE need more work as it missing content form included 3rd party ALv2 licensed NOTICE files

2020-02-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-581: Component/s: Release & Administrative > NOTICE need more work as it missing content form included 3rd

[jira] [Updated] (HUDI-634) Document breaking changes for 0.5.2 release

2020-02-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-634: Priority: Blocker (was: Major) > Document breaking changes for 0.5.2 release > -

[jira] [Updated] (HUDI-589) Fix references to Views in some of the pages. Replace with Query instead

2020-02-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-589: Priority: Blocker (was: Minor) > Fix references to Views in some of the pages. Replace with Query in

[jira] [Updated] (HUDI-599) Update release guide & release scripts due to the change of scala 2.12 build

2020-02-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-599: Priority: Blocker (was: Major) > Update release guide & release scripts due to the change of scala 2

[jira] [Updated] (HUDI-635) MergeHandle's DiskBasedMap entries can be thinner

2020-02-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-635: Component/s: Performance > MergeHandle's DiskBasedMap entries can be thinner > --

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #199

2020-02-25 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.27 KB...] plexus-classworlds-2.5.2.jar /home/jenkins/tools/maven/apache-maven-3.5.4/conf: logging settings.xml toolchains.xml /home/jenkins

[GitHub] [incubator-hudi] satishkotha edited a comment on issue #1355: [HUDI-633] limit archive file block size by number of bytes

2020-02-25 Thread GitBox
satishkotha edited a comment on issue #1355: [HUDI-633] limit archive file block size by number of bytes URL: https://github.com/apache/incubator-hudi/pull/1355#issuecomment-591204425 > @satishkotha left some comments, I'm also assuming you will address the sizeToRead in a later PR ? ye

[GitHub] [incubator-hudi] satishkotha commented on issue #1355: [HUDI-633] limit archive file block size by number of bytes

2020-02-25 Thread GitBox
satishkotha commented on issue #1355: [HUDI-633] limit archive file block size by number of bytes URL: https://github.com/apache/incubator-hudi/pull/1355#issuecomment-591204425 > @satishkotha left some comments, I'm also assuming you will address the sizeToRead in a later PR ? yes, that

[GitHub] [incubator-hudi] satishkotha commented on a change in pull request #1355: [HUDI-633] limit archive file block size by number of bytes

2020-02-25 Thread GitBox
satishkotha commented on a change in pull request #1355: [HUDI-633] limit archive file block size by number of bytes URL: https://github.com/apache/incubator-hudi/pull/1355#discussion_r384242337 ## File path: hudi-client/src/main/java/org/apache/hudi/config/HoodieCompactionConfig.j

[GitHub] [incubator-hudi] satishkotha commented on a change in pull request #1355: [HUDI-633] limit archive file block size by number of bytes

2020-02-25 Thread GitBox
satishkotha commented on a change in pull request #1355: [HUDI-633] limit archive file block size by number of bytes URL: https://github.com/apache/incubator-hudi/pull/1355#discussion_r384242297 ## File path: hudi-client/src/main/java/org/apache/hudi/config/HoodieCompactionConfig.j

[GitHub] [incubator-hudi] satishkotha commented on a change in pull request #1355: [HUDI-633] limit archive file block size by number of bytes

2020-02-25 Thread GitBox
satishkotha commented on a change in pull request #1355: [HUDI-633] limit archive file block size by number of bytes URL: https://github.com/apache/incubator-hudi/pull/1355#discussion_r384241881 ## File path: hudi-client/src/main/java/org/apache/hudi/io/HoodieCommitArchiveLog.java

[jira] [Resolved] (HUDI-580) Fix incorrect license header in files

2020-02-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang resolved HUDI-580. --- Resolution: Fixed Fixed via master branch: 159cb060f0502bb01ec4cefaa743d3678b711254 > Fix incorrect license he

[jira] [Updated] (HUDI-629) Replace Guava's Hashing with an equivalent in NumericUtils.java

2020-02-25 Thread Suneel Marthi (Jira)
[ https://issues.apache.org/jira/browse/HUDI-629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suneel Marthi updated HUDI-629: --- Fix Version/s: (was: 0.5.2) 0.6.0 > Replace Guava's Hashing with an equivalent i

[jira] [Updated] (HUDI-479) Eliminate use of guava if possible

2020-02-25 Thread Suneel Marthi (Jira)
[ https://issues.apache.org/jira/browse/HUDI-479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suneel Marthi updated HUDI-479: --- Fix Version/s: (was: 0.5.2) 0.6.0 > Eliminate use of guava if possible > ---

[GitHub] [incubator-hudi] hddong commented on issue #1242: [HUDI-544] Archived commits command code cleanup

2020-02-25 Thread GitBox
hddong commented on issue #1242: [HUDI-544] Archived commits command code cleanup URL: https://github.com/apache/incubator-hudi/pull/1242#issuecomment-591183992 @n3nash @vinothchandar please rereivew this agian. This is an au

[GitHub] [incubator-hudi] hddong edited a comment on issue #1242: [HUDI-544] Archived commits command code cleanup

2020-02-25 Thread GitBox
hddong edited a comment on issue #1242: [HUDI-544] Archived commits command code cleanup URL: https://github.com/apache/incubator-hudi/pull/1242#issuecomment-591183992 @n3nash @vinothchandar please review this agian. This is

[GitHub] [incubator-hudi] satishkotha commented on issue #1341: [HUDI-626] Add exportToTable option to CLI

2020-02-25 Thread GitBox
satishkotha commented on issue #1341: [HUDI-626] Add exportToTable option to CLI URL: https://github.com/apache/incubator-hudi/pull/1341#issuecomment-591175742 @smarthi could you review this when you get a chance? This

[jira] [Updated] (HUDI-614) EMR Presto cannot read Hudi tables saved to S3

2020-02-25 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong updated HUDI-614: - Description: Original issue: [https://github.com/apache/incubator-hudi/issues/1329] Code I tried: [https:

[jira] [Updated] (HUDI-614) EMR Presto cannot read Hudi tables saved to S3

2020-02-25 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong updated HUDI-614: - Summary: EMR Presto cannot read Hudi tables saved to S3 (was: EMR Presto cannot read Hudi tables) > EMR P

[jira] [Updated] (HUDI-614) EMR Presto cannot read Hudi tables

2020-02-25 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong updated HUDI-614: - Description: Original issue: [https://github.com/apache/incubator-hudi/issues/1329] Code I tried: [https:

[jira] [Updated] (HUDI-614) EMR Presto cannot read Hudi tables

2020-02-25 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong updated HUDI-614: - Description: Original issue: [https://github.com/apache/incubator-hudi/issues/1329] Code I tried: [https:

[jira] [Updated] (HUDI-614) EMR Presto cannot read Hudi tables

2020-02-25 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong updated HUDI-614: - Summary: EMR Presto cannot read Hudi tables (was: .hoodie_partition_metadata created for non-partitioned t

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1355: [HUDI-633] limit archive file block size by number of bytes

2020-02-25 Thread GitBox
n3nash commented on a change in pull request #1355: [HUDI-633] limit archive file block size by number of bytes URL: https://github.com/apache/incubator-hudi/pull/1355#discussion_r384113186 ## File path: hudi-client/src/main/java/org/apache/hudi/config/HoodieCompactionConfig.java

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1355: [HUDI-633] limit archive file block size by number of bytes

2020-02-25 Thread GitBox
n3nash commented on a change in pull request #1355: [HUDI-633] limit archive file block size by number of bytes URL: https://github.com/apache/incubator-hudi/pull/1355#discussion_r384113038 ## File path: hudi-client/src/main/java/org/apache/hudi/config/HoodieCompactionConfig.java

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1355: [HUDI-633] limit archive file block size by number of bytes

2020-02-25 Thread GitBox
n3nash commented on a change in pull request #1355: [HUDI-633] limit archive file block size by number of bytes URL: https://github.com/apache/incubator-hudi/pull/1355#discussion_r384112616 ## File path: hudi-client/src/main/java/org/apache/hudi/io/HoodieCommitArchiveLog.java

[jira] [Closed] (HUDI-625) Address performance concerns on DiskBasedMap.get() during upsert of thin records

2020-02-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-625. --- Resolution: Fixed > Address performance concerns on DiskBasedMap.get() during upsert of thin > records

[jira] [Updated] (HUDI-625) Address performance concerns on DiskBasedMap.get() during upsert of thin records

2020-02-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-625: Status: Open (was: New) > Address performance concerns on DiskBasedMap.get() during upsert of thin

[GitHub] [incubator-hudi] ramachandranms commented on issue #1347: [HUDI-627] Aggregate code coverage and publish to codecov.io during CI

2020-02-25 Thread GitBox
ramachandranms commented on issue #1347: [HUDI-627] Aggregate code coverage and publish to codecov.io during CI URL: https://github.com/apache/incubator-hudi/pull/1347#issuecomment-591009814 @vinothchandar codecov lets us just upload reports without ownership. here is a screenshot of the a

[GitHub] [incubator-hudi] ramachandranms commented on a change in pull request #1347: [HUDI-627] Aggregate code coverage and publish to codecov.io during CI

2020-02-25 Thread GitBox
ramachandranms commented on a change in pull request #1347: [HUDI-627] Aggregate code coverage and publish to codecov.io during CI URL: https://github.com/apache/incubator-hudi/pull/1347#discussion_r384053060 ## File path: pom.xml ## @@ -51,6 +51,7 @@ packaging/hudi-t

[GitHub] [incubator-hudi] vikrantgoel commented on a change in pull request #1353: [HUDI-632] Update documentation (docker_demo) to mention both commit and deltacommit files

2020-02-25 Thread GitBox
vikrantgoel commented on a change in pull request #1353: [HUDI-632] Update documentation (docker_demo) to mention both commit and deltacommit files URL: https://github.com/apache/incubator-hudi/pull/1353#discussion_r384043681 ## File path: content/docs/docker_demo.html ##

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1357: [HUDI-636] Fix could not get sources warnings while compiling

2020-02-25 Thread GitBox
bvaradar commented on a change in pull request #1357: [HUDI-636] Fix could not get sources warnings while compiling URL: https://github.com/apache/incubator-hudi/pull/1357#discussion_r384002451 ## File path: packaging/hudi-hadoop-mr-bundle/pom.xml ## @@ -48,7 +48,7 @@

[GitHub] [incubator-hudi] bvaradar merged pull request #1356: [HUDI-580] Fix incorrect license header in files

2020-02-25 Thread GitBox
bvaradar merged pull request #1356: [HUDI-580] Fix incorrect license header in files URL: https://github.com/apache/incubator-hudi/pull/1356 This is an automated message from the Apache Git Service. To respond to the message

[incubator-hudi] branch master updated (83c8ad5 -> 11fb2c2)

2020-02-25 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from 83c8ad5 [HUDI-625] Fixing performance issues around DiskBasedMap & kryo (#1352) add 11fb2c2 [HUDI-58

[GitHub] [incubator-hudi] lamber-ken opened a new pull request #1357: [HUDI-636] Fix could not get sources warnings while compiling

2020-02-25 Thread GitBox
lamber-ken opened a new pull request #1357: [HUDI-636] Fix could not get sources warnings while compiling URL: https://github.com/apache/incubator-hudi/pull/1357 ## What is the purpose of the pull request During the voting process on rc1 0.5.1-incubating release[1], Justin pointed o

[jira] [Updated] (HUDI-636) Fix could not get sources warnings while compiling

2020-02-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-636: Labels: pull-request-available (was: ) > Fix could not get sources warnings while compiling > -

[jira] [Updated] (HUDI-636) Fix could not get sources warnings while compiling

2020-02-25 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-636: Status: Open (was: New) > Fix could not get sources warnings while compiling >

[jira] [Updated] (HUDI-636) Fix could not get sources warnings while compiling

2020-02-25 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-636: Description: During the voting process on rc1 0.5.1-incubating release, Justin pointed out that mvn log disp

[jira] [Assigned] (HUDI-636) Fix could not get sources warnings while compiling

2020-02-25 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken reassigned HUDI-636: --- Assignee: lamber-ken > Fix could not get sources warnings while compiling > -

[jira] [Updated] (HUDI-636) Fix could not get sources warnings while compiling

2020-02-25 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-636: Description: During the voting process on rc1 0.5.1-incubating release, Justin pointed out There are other s

[jira] [Created] (HUDI-636) Fix could not get sources warnings while compiling

2020-02-25 Thread lamber-ken (Jira)
lamber-ken created HUDI-636: --- Summary: Fix could not get sources warnings while compiling Key: HUDI-636 URL: https://issues.apache.org/jira/browse/HUDI-636 Project: Apache Hudi (incubating) Issue

[jira] [Created] (HUDI-635) MergeHandle's DiskBasedMap entries can be thinner

2020-02-25 Thread Vinoth Chandar (Jira)
Vinoth Chandar created HUDI-635: --- Summary: MergeHandle's DiskBasedMap entries can be thinner Key: HUDI-635 URL: https://issues.apache.org/jira/browse/HUDI-635 Project: Apache Hudi (incubating)

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1351: [WIP] [HUDI-625] Fixing performance issues around DiskBasedMap & kryo

2020-02-25 Thread GitBox
vinothchandar commented on a change in pull request #1351: [WIP] [HUDI-625] Fixing performance issues around DiskBasedMap & kryo URL: https://github.com/apache/incubator-hudi/pull/1351#discussion_r383703512 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/Seriali

[jira] [Updated] (HUDI-625) Address performance concerns on DiskBasedMap.get() during upsert of thin records

2020-02-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-625: Fix Version/s: (was: 0.6.0) 0.5.2 > Address performance concerns on DiskBasedM

[jira] [Updated] (HUDI-580) Fix incorrect license header in files

2020-02-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-580: Labels: compliance pull-request-available (was: compliance) > Fix incorrect license header in files

[GitHub] [incubator-hudi] lamber-ken opened a new pull request #1356: [HUDI-580] Fix incorrect license header in files

2020-02-25 Thread GitBox
lamber-ken opened a new pull request #1356: [HUDI-580] Fix incorrect license header in files URL: https://github.com/apache/incubator-hudi/pull/1356 ## What is the purpose of the pull request During the voting process on rc1 0.5.1-incubating release, Justin pointed out docker/ho

[jira] [Updated] (HUDI-580) Fix incorrect license header in files

2020-02-25 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-580: Summary: Fix incorrect license header in files (was: Incorrect license header in docker/hoodie/hadoop/base/e