svn commit: r37710 - in /dev/incubator/hudi/hudi-0.5.1-incubating-rc1: ./ hudi-0.5.1-incubating-rc1.src.tgz hudi-0.5.1-incubating-rc1.src.tgz.asc hudi-0.5.1-incubating-rc1.src.tgz.sha512

2020-01-21 Thread leesf
Author: leesf Date: Wed Jan 22 07:15:50 2020 New Revision: 37710 Log: (empty) Added: dev/incubator/hudi/hudi-0.5.1-incubating-rc1/ dev/incubator/hudi/hudi-0.5.1-incubating-rc1/hudi-0.5.1-incubating-rc1.src.tgz (with props) dev/incubator/hudi/hudi-0.5.1-incubating-rc1/hudi-0.5.1-i

[incubator-hudi] branch release-0.5.1 updated: [MINOR] Change deploy_staging_jars script to take in scala version (#1270)

2020-01-21 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch release-0.5.1 in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/release-0.5.1 by this push: new 9129edb [MINOR] Change dep

[incubator-hudi] branch master updated: [MINOR] Change deploy_staging_jars script to take in scala version (#1270)

2020-01-21 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 8e3d81c [MINOR] Change deploy_staging_ja

[GitHub] [incubator-hudi] leesf merged pull request #1270: [MINOR] Change deploy_staging_jars script to take in scala version

2020-01-21 Thread GitBox
leesf merged pull request #1270: [MINOR] Change deploy_staging_jars script to take in scala version URL: https://github.com/apache/incubator-hudi/pull/1270 This is an automated message from the Apache Git Service. To respond

[GitHub] [incubator-hudi] bvaradar opened a new pull request #1270: [MINOR] Change deploy_staging_jars script to take in scala version

2020-01-21 Thread GitBox
bvaradar opened a new pull request #1270: [MINOR] Change deploy_staging_jars script to take in scala version URL: https://github.com/apache/incubator-hudi/pull/1270 Revert an accidental change which commented out mvn package release step. ---

[incubator-hudi] branch release-0.5.1 updated: [MINOR] Change deploy_staging_jars script to take in scala version (#1269)

2020-01-21 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch release-0.5.1 in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/release-0.5.1 by this push: new 76d9561 [MINOR] Change dep

[incubator-hudi] branch master updated: [MINOR] Change deploy_staging_jars script to take in scala version (#1269)

2020-01-21 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new a46fea9 [MINOR] Change deploy_staging_ja

[GitHub] [incubator-hudi] leesf merged pull request #1269: [MINOR] Change deploy_staging_jars script to take in scala version

2020-01-21 Thread GitBox
leesf merged pull request #1269: [MINOR] Change deploy_staging_jars script to take in scala version URL: https://github.com/apache/incubator-hudi/pull/1269 This is an automated message from the Apache Git Service. To respond

[GitHub] [incubator-hudi] bvaradar opened a new pull request #1269: [MINOR] Change deploy_staging_jars script to take in scala version

2020-01-21 Thread GitBox
bvaradar opened a new pull request #1269: [MINOR] Change deploy_staging_jars script to take in scala version URL: https://github.com/apache/incubator-hudi/pull/1269 Needed for release process. This is an automated message fro

[GitHub] [incubator-hudi] lamber-ken commented on issue #1268: [HUDI-569] Fix java.lang. NoClassDefFoundError in quickstart example

2020-01-21 Thread GitBox
lamber-ken commented on issue #1268: [HUDI-569] Fix java.lang. NoClassDefFoundError in quickstart example URL: https://github.com/apache/incubator-hudi/pull/1268#issuecomment-577018734 > @lamber-ken this is already tracked as a part of work @bhasudha is doing .. Thanks for reminding

[jira] [Closed] (HUDI-569) Fix java.lang. NoClassDefFoundError in quickstart example

2020-01-21 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken closed HUDI-569. --- Resolution: Fixed > Fix java.lang. NoClassDefFoundError in quickstart example > ---

[jira] [Assigned] (HUDI-504) Restructuring and auto-generation of docs

2020-01-21 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken reassigned HUDI-504: --- Assignee: lamber-ken > Restructuring and auto-generation of docs > ---

[GitHub] [incubator-hudi] lamber-ken closed pull request #1268: [HUDI-569] Fix java.lang. NoClassDefFoundError in quickstart example

2020-01-21 Thread GitBox
lamber-ken closed pull request #1268: [HUDI-569] Fix java.lang. NoClassDefFoundError in quickstart example URL: https://github.com/apache/incubator-hudi/pull/1268 This is an automated message from the Apache Git Service. To

[GitHub] [incubator-hudi] lamber-ken commented on issue #1268: [HUDI-569] Fix java.lang. NoClassDefFoundError in quickstart example

2020-01-21 Thread GitBox
lamber-ken commented on issue #1268: [HUDI-569] Fix java.lang. NoClassDefFoundError in quickstart example URL: https://github.com/apache/incubator-hudi/pull/1268#issuecomment-577014164 > ``` > --packages org.apache.hudi:hudi-spark-bundle:0.5.0-incubating \ > --packages org.apach

[GitHub] [incubator-hudi] vinothchandar commented on issue #1253: [HUDI-558] Introduce ability to compress bloom filters while storing in parquet

2020-01-21 Thread GitBox
vinothchandar commented on issue #1253: [HUDI-558] Introduce ability to compress bloom filters while storing in parquet URL: https://github.com/apache/incubator-hudi/pull/1253#issuecomment-577011630 @nsivabalan can you also please review this. -

[jira] [Updated] (HUDI-407) Implement a join-based index

2020-01-21 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-407: Fix Version/s: (was: 0.5.1) 0.6.0 > Implement a join-based index > ---

[jira] [Updated] (HUDI-304) Bring back spotless plugin

2020-01-21 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-304: Fix Version/s: (was: 0.5.1) 0.6.0 > Bring back spotless plugin >

[jira] [Resolved] (HUDI-334) Clean up terminologies in code/docs

2020-01-21 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar resolved HUDI-334. - Resolution: Fixed > Clean up terminologies in code/docs > --- > >

[jira] [Updated] (HUDI-558) Introduce ability to compress bloom filters while storing in parquet

2020-01-21 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-558: Component/s: (was: Common Core) Performance Index > Introduce a

[jira] [Updated] (HUDI-558) Introduce ability to compress bloom filters while storing in parquet

2020-01-21 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-558: Fix Version/s: (was: 0.5.1) 0.6.0 > Introduce ability to compress bloom filter

[jira] [Updated] (HUDI-561) hudi partition path config

2020-01-21 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-561: Fix Version/s: (was: 0.5.1) 0.6.0 > hudi partition path config > -

[GitHub] [incubator-hudi] vinothchandar commented on issue #1268: [HUDI-569] Fix java.lang. NoClassDefFoundError in quickstart example

2020-01-21 Thread GitBox
vinothchandar commented on issue #1268: [HUDI-569] Fix java.lang. NoClassDefFoundError in quickstart example URL: https://github.com/apache/incubator-hudi/pull/1268#issuecomment-577008058 ``` --packages org.apache.hudi:hudi-spark-bundle:0.5.0-incubating \ --packages org.apache.s

[GitHub] [incubator-hudi] vinothchandar commented on issue #1268: [HUDI-569] Fix java.lang. NoClassDefFoundError in quickstart example

2020-01-21 Thread GitBox
vinothchandar commented on issue #1268: [HUDI-569] Fix java.lang. NoClassDefFoundError in quickstart example URL: https://github.com/apache/incubator-hudi/pull/1268#issuecomment-577007640 @lamber-ken this is already tracked as a part of work @bhasudha is doing .. -

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #166

2020-01-21 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.02 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4: bin boot conf lib LICENSE NOTICE README.txt /home/jenkins/tools/maven/apache-maven-3

[jira] [Updated] (HUDI-569) Fix java.lang. NoClassDefFoundError in quickstart example

2020-01-21 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-569: Summary: Fix java.lang. NoClassDefFoundError in quickstart example (was: Fix java.lang.ClassNotFoundExceptio

[jira] [Updated] (HUDI-569) Fix java.lang.ClassNotFoundException in quickstart example

2020-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-569: Labels: pull-request-available (was: ) > Fix java.lang.ClassNotFoundException in quickstart example

[GitHub] [incubator-hudi] lamber-ken opened a new pull request #1268: [HUDI-569] Fix java.lang.ClassNotFoundException in quickstart example

2020-01-21 Thread GitBox
lamber-ken opened a new pull request #1268: [HUDI-569] Fix java.lang.ClassNotFoundException in quickstart example URL: https://github.com/apache/incubator-hudi/pull/1268 ## What is the purpose of the pull request Spark-2.4.4 avro data source guide says "The spark-avro module is exter

[jira] [Updated] (HUDI-569) Fix java.lang.ClassNotFoundException in quickstart example

2020-01-21 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-569: Status: Open (was: New) > Fix java.lang.ClassNotFoundException in quickstart example > -

[jira] [Assigned] (HUDI-569) Fix java.lang.ClassNotFoundException in quickstart example

2020-01-21 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken reassigned HUDI-569: --- Assignee: lamber-ken > Fix java.lang.ClassNotFoundException in quickstart example > --

[jira] [Commented] (HUDI-561) hudi partition path config

2020-01-21 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020719#comment-17020719 ] liujinhui commented on HUDI-561: If it is time format data, we can create a time string for

[jira] [Created] (HUDI-569) Fix java.lang.ClassNotFoundException in quickstart example

2020-01-21 Thread lamber-ken (Jira)
lamber-ken created HUDI-569: --- Summary: Fix java.lang.ClassNotFoundException in quickstart example Key: HUDI-569 URL: https://issues.apache.org/jira/browse/HUDI-569 Project: Apache Hudi (incubating)

[jira] [Updated] (HUDI-568) Improve unit test coverage for org.apache.hudi.common.table.HoodieTableMetaClient

2020-01-21 Thread Prashant Wason (Jira)
[ https://issues.apache.org/jira/browse/HUDI-568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Wason updated HUDI-568: Status: In Progress (was: Open) > Improve unit test coverage for > org.apache.hudi.common.table.Hoo

[jira] [Updated] (HUDI-567) Improve unit test coverage for org.apache.hudi.common.table.HoodieActiveTimeline

2020-01-21 Thread Prashant Wason (Jira)
[ https://issues.apache.org/jira/browse/HUDI-567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Wason updated HUDI-567: Status: In Progress (was: Open) > Improve unit test coverage for > org.apache.hudi.common.table.Hoo

[jira] [Updated] (HUDI-566) Improve unit test coverage for org.apache.hudi.common.table.HoodieTimeline

2020-01-21 Thread Prashant Wason (Jira)
[ https://issues.apache.org/jira/browse/HUDI-566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Wason updated HUDI-566: Status: In Progress (was: Open) > Improve unit test coverage for org.apache.hudi.common.table.Hoodie

[jira] [Updated] (HUDI-565) Improve unit test coverage for org.apache.hudi.WriteStatus

2020-01-21 Thread Prashant Wason (Jira)
[ https://issues.apache.org/jira/browse/HUDI-565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Wason updated HUDI-565: Status: In Progress (was: Open) > Improve unit test coverage for org.apache.hudi.WriteStatus > -

[jira] [Updated] (HUDI-564) Improve unit test coverage for org.apache.hudi.common.table.log.HoodieLogFormatVersion

2020-01-21 Thread Prashant Wason (Jira)
[ https://issues.apache.org/jira/browse/HUDI-564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Wason updated HUDI-564: Status: In Progress (was: Open) > Improve unit test coverage for > org.apache.hudi.common.table.log

[jira] [Updated] (HUDI-567) Improve unit test coverage for org.apache.hudi.common.table.HoodieActiveTimeline

2020-01-21 Thread Prashant Wason (Jira)
[ https://issues.apache.org/jira/browse/HUDI-567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Wason updated HUDI-567: Status: Open (was: New) > Improve unit test coverage for > org.apache.hudi.common.table.HoodieActiv

[jira] [Updated] (HUDI-564) Improve unit test coverage for org.apache.hudi.common.table.log.HoodieLogFormatVersion

2020-01-21 Thread Prashant Wason (Jira)
[ https://issues.apache.org/jira/browse/HUDI-564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Wason updated HUDI-564: Status: Open (was: New) > Improve unit test coverage for > org.apache.hudi.common.table.log.HoodieL

[jira] [Created] (HUDI-568) Improve unit test coverage for org.apache.hudi.common.table.HoodieTableMetaClient

2020-01-21 Thread Prashant Wason (Jira)
Prashant Wason created HUDI-568: --- Summary: Improve unit test coverage for org.apache.hudi.common.table.HoodieTableMetaClient Key: HUDI-568 URL: https://issues.apache.org/jira/browse/HUDI-568 Project: Ap

[jira] [Updated] (HUDI-568) Improve unit test coverage for org.apache.hudi.common.table.HoodieTableMetaClient

2020-01-21 Thread Prashant Wason (Jira)
[ https://issues.apache.org/jira/browse/HUDI-568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Wason updated HUDI-568: Status: Open (was: New) > Improve unit test coverage for > org.apache.hudi.common.table.HoodieTable

[jira] [Updated] (HUDI-566) Improve unit test coverage for org.apache.hudi.common.table.HoodieTimeline

2020-01-21 Thread Prashant Wason (Jira)
[ https://issues.apache.org/jira/browse/HUDI-566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Wason updated HUDI-566: Status: Open (was: New) > Improve unit test coverage for org.apache.hudi.common.table.HoodieTimeline

[jira] [Updated] (HUDI-565) Improve unit test coverage for org.apache.hudi.WriteStatus

2020-01-21 Thread Prashant Wason (Jira)
[ https://issues.apache.org/jira/browse/HUDI-565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Wason updated HUDI-565: Status: Open (was: New) > Improve unit test coverage for org.apache.hudi.WriteStatus > -

[jira] [Created] (HUDI-567) Improve unit test coverage for org.apache.hudi.common.table.HoodieActiveTimeline

2020-01-21 Thread Prashant Wason (Jira)
Prashant Wason created HUDI-567: --- Summary: Improve unit test coverage for org.apache.hudi.common.table.HoodieActiveTimeline Key: HUDI-567 URL: https://issues.apache.org/jira/browse/HUDI-567 Project: Apa

[jira] [Created] (HUDI-566) Improve unit test coverage for org.apache.hudi.common.table.HoodieTimeline

2020-01-21 Thread Prashant Wason (Jira)
Prashant Wason created HUDI-566: --- Summary: Improve unit test coverage for org.apache.hudi.common.table.HoodieTimeline Key: HUDI-566 URL: https://issues.apache.org/jira/browse/HUDI-566 Project: Apache Hu

[jira] [Created] (HUDI-565) Improve unit test coverage for org.apache.hudi.WriteStatus

2020-01-21 Thread Prashant Wason (Jira)
Prashant Wason created HUDI-565: --- Summary: Improve unit test coverage for org.apache.hudi.WriteStatus Key: HUDI-565 URL: https://issues.apache.org/jira/browse/HUDI-565 Project: Apache Hudi (incubating)

[jira] [Updated] (HUDI-564) Improve unit test coverage for org.apache.hudi.common.table.log.HoodieLogFormatVersion

2020-01-21 Thread Prashant Wason (Jira)
[ https://issues.apache.org/jira/browse/HUDI-564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Wason updated HUDI-564: Priority: Minor (was: Major) > Improve unit test coverage for > org.apache.hudi.common.table.log.Ho

[jira] [Created] (HUDI-564) Improve unit test coverage for org.apache.hudi.common.table.log.HoodieLogFormatVersion

2020-01-21 Thread Prashant Wason (Jira)
Prashant Wason created HUDI-564: --- Summary: Improve unit test coverage for org.apache.hudi.common.table.log.HoodieLogFormatVersion Key: HUDI-564 URL: https://issues.apache.org/jira/browse/HUDI-564 Projec

[jira] [Updated] (HUDI-563) Improve unit test coverage for org.apache.hudi.common.table.log.block.HoodieAvroDataBlock

2020-01-21 Thread Prashant Wason (Jira)
[ https://issues.apache.org/jira/browse/HUDI-563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Wason updated HUDI-563: Status: In Progress (was: Open) > Improve unit test coverage for > org.apache.hudi.common.table.log

[jira] [Updated] (HUDI-563) Improve unit test coverage for org.apache.hudi.common.table.log.block.HoodieAvroDataBlock

2020-01-21 Thread Prashant Wason (Jira)
[ https://issues.apache.org/jira/browse/HUDI-563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Wason updated HUDI-563: Status: Open (was: New) > Improve unit test coverage for > org.apache.hudi.common.table.log.block.H

[jira] [Created] (HUDI-563) Improve unit test coverage for org.apache.hudi.common.table.log.block.HoodieAvroDataBlock

2020-01-21 Thread Prashant Wason (Jira)
Prashant Wason created HUDI-563: --- Summary: Improve unit test coverage for org.apache.hudi.common.table.log.block.HoodieAvroDataBlock Key: HUDI-563 URL: https://issues.apache.org/jira/browse/HUDI-563 Pro

[jira] [Commented] (HUDI-562) Improve unit test coverage of HUDI

2020-01-21 Thread Prashant Wason (Jira)
[ https://issues.apache.org/jira/browse/HUDI-562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020702#comment-17020702 ] Prashant Wason commented on HUDI-562: - A jacoco coverage report is generated at the end

[jira] [Created] (HUDI-562) Improve unit test coverage of HUDI

2020-01-21 Thread Prashant Wason (Jira)
Prashant Wason created HUDI-562: --- Summary: Improve unit test coverage of HUDI Key: HUDI-562 URL: https://issues.apache.org/jira/browse/HUDI-562 Project: Apache Hudi (incubating) Issue Type: Tes

[GitHub] [incubator-hudi] bvaradar edited a comment on issue #1267: [HUDI-403] Publish deployment guide for writing to Hudi using HoodieDeltaStreamer and Spark Data Source

2020-01-21 Thread GitBox
bvaradar edited a comment on issue #1267: [HUDI-403] Publish deployment guide for writing to Hudi using HoodieDeltaStreamer and Spark Data Source URL: https://github.com/apache/incubator-hudi/pull/1267#issuecomment-576940505 @vinothchandar @bhasudha @lamber-ken : Please take a look when yo

[GitHub] [incubator-hudi] bvaradar commented on issue #1267: [HUDI-403] Publish deployment guide for writing to Hudi using HoodieDeltaStreamer and Spark Data Source

2020-01-21 Thread GitBox
bvaradar commented on issue #1267: [HUDI-403] Publish deployment guide for writing to Hudi using HoodieDeltaStreamer and Spark Data Source URL: https://github.com/apache/incubator-hudi/pull/1267#issuecomment-576940505 @vinothchandar @bhasudha : Please take a look when you get a chance. ---

[GitHub] [incubator-hudi] bvaradar opened a new pull request #1267: [HUDI-403] Publish deployment guide for writing to Hudi using HoodieDeltaStreamer and Spark Data Source

2020-01-21 Thread GitBox
bvaradar opened a new pull request #1267: [HUDI-403] Publish deployment guide for writing to Hudi using HoodieDeltaStreamer and Spark Data Source URL: https://github.com/apache/incubator-hudi/pull/1267 ## What is the purpose of the pull request Update documentation to add deployment

[jira] [Assigned] (HUDI-132) Automate doc update/deploy process

2020-01-21 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo reassigned HUDI-132: -- Assignee: lamber-ken (was: Ethan Guo) > Automate doc update/deploy process > --

[jira] [Updated] (HUDI-549) Update documentation to reflect changes in package names due to scala cross compiling support

2020-01-21 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha updated HUDI-549: --- Status: Open (was: New) > Update documentation to reflect changes in package names due to scala cross

[jira] [Updated] (HUDI-549) Update documentation to reflect changes in package names due to scala cross compiling support

2020-01-21 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha updated HUDI-549: --- Status: In Progress (was: Open) > Update documentation to reflect changes in package names due to scal

[jira] [Resolved] (HUDI-510) Update site documentation in sync with cWiki

2020-01-21 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha resolved HUDI-510. Resolution: Fixed > Update site documentation in sync with cWiki > --

[GitHub] [incubator-hudi] bhasudha merged pull request #1260: [HUDI-510] Update site documentation in sync with cWiki

2020-01-21 Thread GitBox
bhasudha merged pull request #1260: [HUDI-510] Update site documentation in sync with cWiki URL: https://github.com/apache/incubator-hudi/pull/1260 This is an automated message from the Apache Git Service. To respond to the

[incubator-hudi] branch asf-site updated: [HUDI-510] Update site documentation in sync with cWiki

2020-01-21 Thread bhavanisudha
This is an automated email from the ASF dual-hosted git repository. bhavanisudha pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new a3135e7 [HUDI-510] Update sit

[GitHub] [incubator-hudi] bhasudha commented on issue #1260: [HUDI-510] Update site documentation in sync with cWiki

2020-01-21 Thread GitBox
bhasudha commented on issue #1260: [HUDI-510] Update site documentation in sync with cWiki URL: https://github.com/apache/incubator-hudi/pull/1260#issuecomment-576859029 Merging this. Will send a separate PR for other doc related changes. ---

[GitHub] [incubator-hudi] RonBarabash commented on issue #1202: [SUPPORT] com.uber.hoodie.exception.HoodieIOException: IOException when reading log file + Corrupted Log File

2020-01-21 Thread GitBox
RonBarabash commented on issue #1202: [SUPPORT] com.uber.hoodie.exception.HoodieIOException: IOException when reading log file + Corrupted Log File URL: https://github.com/apache/incubator-hudi/issues/1202#issuecomment-576832495 not relevant anymore ---

[GitHub] [incubator-hudi] RonBarabash closed issue #1202: [SUPPORT] com.uber.hoodie.exception.HoodieIOException: IOException when reading log file + Corrupted Log File

2020-01-21 Thread GitBox
RonBarabash closed issue #1202: [SUPPORT] com.uber.hoodie.exception.HoodieIOException: IOException when reading log file + Corrupted Log File URL: https://github.com/apache/incubator-hudi/issues/1202 This is an automated me

[GitHub] [incubator-hudi] bhasudha commented on a change in pull request #1260: [WIP] [HUDI-510] Update site documentation in sync with cWiki

2020-01-21 Thread GitBox
bhasudha commented on a change in pull request #1260: [WIP] [HUDI-510] Update site documentation in sync with cWiki URL: https://github.com/apache/incubator-hudi/pull/1260#discussion_r369187185 ## File path: docs/_docs/2_2_writing_data.md ## @@ -156,41 +157,31 @@ inputDF.w

[GitHub] [incubator-hudi] bhasudha commented on issue #1248: [Minor] Adding delete docs to QuickStart

2020-01-21 Thread GitBox
bhasudha commented on issue #1248: [Minor] Adding delete docs to QuickStart URL: https://github.com/apache/incubator-hudi/pull/1248#issuecomment-576830791 @nsivabalan can you fix the conflict and update the PR again? I think it should be good to merge then. ---

[GitHub] [incubator-hudi] bhasudha commented on a change in pull request #1260: [WIP] [HUDI-510] Update site documentation in sync with cWiki

2020-01-21 Thread GitBox
bhasudha commented on a change in pull request #1260: [WIP] [HUDI-510] Update site documentation in sync with cWiki URL: https://github.com/apache/incubator-hudi/pull/1260#discussion_r369171951 ## File path: docs/_docs/1_3_use_cases.md ## @@ -20,7 +20,7 @@ or [complicated

[GitHub] [incubator-hudi] bhasudha commented on a change in pull request #1260: [WIP] [HUDI-510] Update site documentation in sync with cWiki

2020-01-21 Thread GitBox
bhasudha commented on a change in pull request #1260: [WIP] [HUDI-510] Update site documentation in sync with cWiki URL: https://github.com/apache/incubator-hudi/pull/1260#discussion_r369171577 ## File path: docs/_docs/2_3_querying_data.md ## @@ -1,47 +1,52 @@ --- -title:

[GitHub] [incubator-hudi] bhasudha commented on a change in pull request #1260: [WIP] [HUDI-510] Update site documentation in sync with cWiki

2020-01-21 Thread GitBox
bhasudha commented on a change in pull request #1260: [WIP] [HUDI-510] Update site documentation in sync with cWiki URL: https://github.com/apache/incubator-hudi/pull/1260#discussion_r369171184 ## File path: docs/_docs/2_1_concepts.md ## @@ -53,69 +53,70 @@ With the help o

[GitHub] [incubator-hudi] bhasudha commented on a change in pull request #1260: [WIP] [HUDI-510] Update site documentation in sync with cWiki

2020-01-21 Thread GitBox
bhasudha commented on a change in pull request #1260: [WIP] [HUDI-510] Update site documentation in sync with cWiki URL: https://github.com/apache/incubator-hudi/pull/1260#discussion_r369170965 ## File path: docs/_docs/2_1_concepts.md ## @@ -1,37 +1,37 @@ --- title: "Con

[GitHub] [incubator-hudi] bhasudha commented on a change in pull request #1260: [WIP] [HUDI-510] Update site documentation in sync with cWiki

2020-01-21 Thread GitBox
bhasudha commented on a change in pull request #1260: [WIP] [HUDI-510] Update site documentation in sync with cWiki URL: https://github.com/apache/incubator-hudi/pull/1260#discussion_r369170642 ## File path: docs/_docs/1_2_structure.md ## @@ -6,16 +6,16 @@ summary: "Hudi b

[GitHub] [incubator-hudi] vinothchandar commented on issue #1261: [HUDI-403] Adds guidelines on deployment/upgrading

2020-01-21 Thread GitBox
vinothchandar commented on issue #1261: [HUDI-403] Adds guidelines on deployment/upgrading URL: https://github.com/apache/incubator-hudi/pull/1261#issuecomment-576809103 >I synced changes to https://lamber-ken.github.io/docs/deployment.html , it's helpful for reviewing. @lamber-ken

[GitHub] [incubator-hudi] vinothchandar commented on issue #1266: BlockAlignedAvroParquetWriter does not support scheme s3n

2020-01-21 Thread GitBox
vinothchandar commented on issue #1266: BlockAlignedAvroParquetWriter does not support scheme s3n URL: https://github.com/apache/incubator-hudi/issues/1266#issuecomment-576808426 Might be because we only whitelist `s3` and `s3a`. are you able to use those? I think s3a is ,more performant a

[GitHub] [incubator-hudi] goldfix opened a new issue #1266: BlockAlignedAvroParquetWriter does not support scheme s3n

2020-01-21 Thread GitBox
goldfix opened a new issue #1266: BlockAlignedAvroParquetWriter does not support scheme s3n URL: https://github.com/apache/incubator-hudi/issues/1266 Hello, When try to upload data to S3 return an exception. **To Reproduce** ``` spark-shell --packages com.amazonaws:

[jira] [Commented] (HUDI-309) General Redesign of Archived Timeline for efficient scan and management

2020-01-21 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020347#comment-17020347 ] Raymond Xu commented on HUDI-309: - Made a design diagram for ease of discussion > General

[jira] [Resolved] (HUDI-557) Additional job for supporting multiple version docs

2020-01-21 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken resolved HUDI-557. - Resolution: Resolved Fixed at asf-siteĀ 4c3cf71bf57aa0523bc06239904d9cc5fd9786fd > Additional job for suppo

[jira] [Commented] (HUDI-538) Restructuring hudi client module for multi engine support

2020-01-21 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020274#comment-17020274 ] vinoyang commented on HUDI-538: --- [~vinoth] Yes, agree. I have not started coding atm. Will st

[jira] [Updated] (HUDI-499) Allow partition path to be updated with GLOBAL_BLOOM index

2020-01-21 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-499: Fix Version/s: 0.5.2 > Allow partition path to be updated with GLOBAL_BLOOM index > -

[GitHub] [incubator-hudi] lamber-ken commented on issue #1265: [MINOR] Fix invalid maven repo address

2020-01-21 Thread GitBox
lamber-ken commented on issue #1265: [MINOR] Fix invalid maven repo address URL: https://github.com/apache/incubator-hudi/pull/1265#issuecomment-576698545 > LGTM! thanks @lamber-ken You're welcome. This is an automated

[jira] [Commented] (HUDI-538) Restructuring hudi client module for multi engine support

2020-01-21 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020250#comment-17020250 ] Vinoth Chandar commented on HUDI-538: - [~yanghua] I feel we should decide on the approa

[jira] [Commented] (HUDI-561) hudi partition path config

2020-01-21 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020249#comment-17020249 ] Vinoth Chandar commented on HUDI-561: - I am not following. We can plugin a key generato

[incubator-hudi] branch master updated: [MINOR] Fix invalid maven repo address (#1265)

2020-01-21 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new a54535e [MINOR] Fix invalid maven repo

[GitHub] [incubator-hudi] vinothchandar merged pull request #1265: [MINOR] Fix invalid maven repo address

2020-01-21 Thread GitBox
vinothchandar merged pull request #1265: [MINOR] Fix invalid maven repo address URL: https://github.com/apache/incubator-hudi/pull/1265 This is an automated message from the Apache Git Service. To respond to the message, plea

[GitHub] [incubator-hudi] vinothchandar commented on issue #1265: [MINOR] Fix invalid maven repo address

2020-01-21 Thread GitBox
vinothchandar commented on issue #1265: [MINOR] Fix invalid maven repo address URL: https://github.com/apache/incubator-hudi/pull/1265#issuecomment-576663878 LGTM! thanks @lamber-ken This is an automated message from the Apac

[GitHub] [incubator-hudi] dengziming commented on a change in pull request #1151: [WIP] [HUDI-476] Add hudi-examples module

2020-01-21 Thread GitBox
dengziming commented on a change in pull request #1151: [WIP] [HUDI-476] Add hudi-examples module URL: https://github.com/apache/incubator-hudi/pull/1151#discussion_r368929527 ## File path: hudi-examples/src/main/java/org/apache/hudi/examples/common/HoodieExampleDataGenerator.java

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1226: [HUDI-238] Make Hudi support Scala 2.12

2020-01-21 Thread GitBox
leesf commented on a change in pull request #1226: [HUDI-238] Make Hudi support Scala 2.12 URL: https://github.com/apache/incubator-hudi/pull/1226#discussion_r368926125 ## File path: packaging/hudi-spark-bundle/pom.xml ## @@ -23,7 +23,7 @@ ../../pom.xml 4.0.0 -

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1226: [HUDI-238] Make Hudi support Scala 2.12

2020-01-21 Thread GitBox
leesf commented on a change in pull request #1226: [HUDI-238] Make Hudi support Scala 2.12 URL: https://github.com/apache/incubator-hudi/pull/1226#discussion_r368926048 ## File path: packaging/hudi-utilities-bundle/pom.xml ## @@ -24,7 +24,7 @@ ../../pom.xml 4.0

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1226: [HUDI-238] Make Hudi support Scala 2.12

2020-01-21 Thread GitBox
leesf commented on a change in pull request #1226: [HUDI-238] Make Hudi support Scala 2.12 URL: https://github.com/apache/incubator-hudi/pull/1226#discussion_r368925697 ## File path: hudi-spark/pom.xml ## @@ -23,7 +23,7 @@ 4.0.0 - hudi-spark + hudi-spark_2.11

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1226: [HUDI-238] Make Hudi support Scala 2.12

2020-01-21 Thread GitBox
leesf commented on a change in pull request #1226: [HUDI-238] Make Hudi support Scala 2.12 URL: https://github.com/apache/incubator-hudi/pull/1226#discussion_r368925801 ## File path: hudi-utilities/pom.xml ## @@ -23,7 +23,7 @@ 4.0.0 - hudi-utilities + hudi-utili

[GitHub] [incubator-hudi] leesf removed a comment on issue #1226: [HUDI-238] Make Hudi support Scala 2.12

2020-01-21 Thread GitBox
leesf removed a comment on issue #1226: [HUDI-238] Make Hudi support Scala 2.12 URL: https://github.com/apache/incubator-hudi/pull/1226#issuecomment-576623890 Could we remove _2.11 in the artifactId in hudi-spark, hudi-utilities, packing/hudi-spark-bundle ,packing/hudi-utilities-bundle? cc

[GitHub] [incubator-hudi] leesf commented on issue #1226: [HUDI-238] Make Hudi support Scala 2.12

2020-01-21 Thread GitBox
leesf commented on issue #1226: [HUDI-238] Make Hudi support Scala 2.12 URL: https://github.com/apache/incubator-hudi/pull/1226#issuecomment-576623890 Could we remove _2.11 in the artifactId in hudi-spark, hudi-utilities, packing/hudi-spark-bundle ,packing/hudi-utilities-bundle? cc @bvarada

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1226: [HUDI-238] Make Hudi support Scala 2.12

2020-01-21 Thread GitBox
leesf commented on a change in pull request #1226: [HUDI-238] Make Hudi support Scala 2.12 URL: https://github.com/apache/incubator-hudi/pull/1226#discussion_r368925801 ## File path: hudi-utilities/pom.xml ## @@ -23,7 +23,7 @@ 4.0.0 - hudi-utilities + hudi-utili

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1226: [HUDI-238] Make Hudi support Scala 2.12

2020-01-21 Thread GitBox
leesf commented on a change in pull request #1226: [HUDI-238] Make Hudi support Scala 2.12 URL: https://github.com/apache/incubator-hudi/pull/1226#discussion_r368926048 ## File path: packaging/hudi-utilities-bundle/pom.xml ## @@ -24,7 +24,7 @@ ../../pom.xml 4.0

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1226: [HUDI-238] Make Hudi support Scala 2.12

2020-01-21 Thread GitBox
leesf commented on a change in pull request #1226: [HUDI-238] Make Hudi support Scala 2.12 URL: https://github.com/apache/incubator-hudi/pull/1226#discussion_r368926125 ## File path: packaging/hudi-spark-bundle/pom.xml ## @@ -23,7 +23,7 @@ ../../pom.xml 4.0.0 -

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1226: [HUDI-238] Make Hudi support Scala 2.12

2020-01-21 Thread GitBox
leesf commented on a change in pull request #1226: [HUDI-238] Make Hudi support Scala 2.12 URL: https://github.com/apache/incubator-hudi/pull/1226#discussion_r368925697 ## File path: hudi-spark/pom.xml ## @@ -23,7 +23,7 @@ 4.0.0 - hudi-spark + hudi-spark_2.11

[GitHub] [incubator-hudi] lamber-ken opened a new pull request #1265: [MINOR] Fix invalid maven repo address

2020-01-21 Thread GitBox
lamber-ken opened a new pull request #1265: [MINOR] Fix invalid maven repo address URL: https://github.com/apache/incubator-hudi/pull/1265 ## What is the purpose of the pull request Effective January 15, 2020, The Central Repository no longer supports insecure communication over pla

[GitHub] [incubator-hudi] wangxianghu commented on issue #1264: [HUDI-560] Remove legacy IdentityTransformer

2020-01-21 Thread GitBox
wangxianghu commented on issue #1264: [HUDI-560] Remove legacy IdentityTransformer URL: https://github.com/apache/incubator-hudi/pull/1264#issuecomment-576564623 @yanghua OK, I'll give a try. This is an automated message from

[GitHub] [incubator-hudi] yanghua commented on issue #1264: [HUDI-560] Remove legacy IdentityTransformer

2020-01-21 Thread GitBox
yanghua commented on issue #1264: [HUDI-560] Remove legacy IdentityTransformer URL: https://github.com/apache/incubator-hudi/pull/1264#issuecomment-576562616 @wangxianghu In general, we should not see the automatic commit that like your second commit. You can try this: ``` git pul