[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1289: [HUDI-92] Provide reasonable names for Spark DAG stages in Hudi.

2020-02-05 Thread GitBox
vinothchandar commented on a change in pull request #1289: [HUDI-92] Provide reasonable names for Spark DAG stages in Hudi. URL: https://github.com/apache/incubator-hudi/pull/1289#discussion_r375667569 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1289: [HUDI-92] Provide reasonable names for Spark DAG stages in Hudi.

2020-02-05 Thread GitBox
vinothchandar commented on a change in pull request #1289: [HUDI-92] Provide reasonable names for Spark DAG stages in Hudi. URL: https://github.com/apache/incubator-hudi/pull/1289#discussion_r375668377 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1289: [HUDI-92] Provide reasonable names for Spark DAG stages in Hudi.

2020-02-05 Thread GitBox
vinothchandar commented on a change in pull request #1289: [HUDI-92] Provide reasonable names for Spark DAG stages in Hudi. URL: https://github.com/apache/incubator-hudi/pull/1289#discussion_r375667688 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1289: [HUDI-92] Provide reasonable names for Spark DAG stages in Hudi.

2020-02-05 Thread GitBox
vinothchandar commented on a change in pull request #1289: [HUDI-92] Provide reasonable names for Spark DAG stages in Hudi. URL: https://github.com/apache/incubator-hudi/pull/1289#discussion_r375665978 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1289: [HUDI-92] Provide reasonable names for Spark DAG stages in Hudi.

2020-02-05 Thread GitBox
vinothchandar commented on a change in pull request #1289: [HUDI-92] Provide reasonable names for Spark DAG stages in Hudi. URL: https://github.com/apache/incubator-hudi/pull/1289#discussion_r375667190 ## File path: hudi-client/src/main/java/org/apache/hudi/HoodieWriteClient.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1289: [HUDI-92] Provide reasonable names for Spark DAG stages in Hudi.

2020-02-05 Thread GitBox
vinothchandar commented on a change in pull request #1289: [HUDI-92] Provide reasonable names for Spark DAG stages in Hudi. URL: https://github.com/apache/incubator-hudi/pull/1289#discussion_r375668006 ## File path:

[GitHub] [incubator-hudi] UZi5136225 commented on issue #1308: [Hudi-561] partition path config

2020-02-05 Thread GitBox
UZi5136225 commented on issue #1308: [Hudi-561] partition path config URL: https://github.com/apache/incubator-hudi/pull/1308#issuecomment-582763965 Currently the Hudi partition field is configured using hoodie.datasource.write.partitionpath.field. If the content of the partition field

[GitHub] [incubator-hudi] vinothchandar edited a comment on issue #1289: [HUDI-92] Provide reasonable names for Spark DAG stages in Hudi.

2020-02-05 Thread GitBox
vinothchandar edited a comment on issue #1289: [HUDI-92] Provide reasonable names for Spark DAG stages in Hudi. URL: https://github.com/apache/incubator-hudi/pull/1289#issuecomment-582759343 >The unit tests need to be run as follows: > mvn test

[GitHub] [incubator-hudi] vinothchandar commented on issue #1289: [HUDI-92] Provide reasonable names for Spark DAG stages in Hudi.

2020-02-05 Thread GitBox
vinothchandar commented on issue #1289: [HUDI-92] Provide reasonable names for Spark DAG stages in Hudi. URL: https://github.com/apache/incubator-hudi/pull/1289#issuecomment-582759343 >The unit tests need to be run as follows: > mvn test -DSPARK_EVLOG_DIR=/path/for/spark/event/log

[GitHub] [incubator-hudi] vinothchandar commented on issue #1289: [HUDI-92] Provide reasonable names for Spark DAG stages in Hudi.

2020-02-05 Thread GitBox
vinothchandar commented on issue #1289: [HUDI-92] Provide reasonable names for Spark DAG stages in Hudi. URL: https://github.com/apache/incubator-hudi/pull/1289#issuecomment-582758667 @prashantwason this is so awesome! Started reviewing this ..

[jira] [Commented] (HUDI-553) Building/Running Hudi on higher java versions

2020-02-05 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031304#comment-17031304 ] Vinoth Chandar commented on HUDI-553: - yes.. we would like hudi to run on jdk 9, 11 without issues if

[GitHub] [incubator-hudi] vinothchandar commented on issue #1232: [HUDI-529] Added cobertura coverage reporting support.

2020-02-05 Thread GitBox
vinothchandar commented on issue #1232: [HUDI-529] Added cobertura coverage reporting support. URL: https://github.com/apache/incubator-hudi/pull/1232#issuecomment-582756949 I see you want gradle mostly because of jacobo? Lets hash out the need for bringing in gradle, which seems like an

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1151: [WIP] [HUDI-476] Add hudi-examples module

2020-02-05 Thread GitBox
vinothchandar commented on a change in pull request #1151: [WIP] [HUDI-476] Add hudi-examples module URL: https://github.com/apache/incubator-hudi/pull/1151#discussion_r375657392 ## File path: hudi-examples/src/main/java/org/apache/hudi/examples/spark/HoodieWriteClientExample.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1151: [WIP] [HUDI-476] Add hudi-examples module

2020-02-05 Thread GitBox
vinothchandar commented on a change in pull request #1151: [WIP] [HUDI-476] Add hudi-examples module URL: https://github.com/apache/incubator-hudi/pull/1151#discussion_r375654298 ## File path: hudi-examples/pom.xml ## @@ -0,0 +1,206 @@ + +

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1151: [WIP] [HUDI-476] Add hudi-examples module

2020-02-05 Thread GitBox
vinothchandar commented on a change in pull request #1151: [WIP] [HUDI-476] Add hudi-examples module URL: https://github.com/apache/incubator-hudi/pull/1151#discussion_r375654859 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1151: [WIP] [HUDI-476] Add hudi-examples module

2020-02-05 Thread GitBox
vinothchandar commented on a change in pull request #1151: [WIP] [HUDI-476] Add hudi-examples module URL: https://github.com/apache/incubator-hudi/pull/1151#discussion_r375656925 ## File path:

[GitHub] [incubator-hudi] hmatu commented on a change in pull request #1242: [HUDI-544] Adjust the read and write path of archive

2020-02-05 Thread GitBox
hmatu commented on a change in pull request #1242: [HUDI-544] Adjust the read and write path of archive URL: https://github.com/apache/incubator-hudi/pull/1242#discussion_r375657909 ## File path: hudi-cli/src/main/java/org/apache/hudi/cli/commands/ArchivedCommitsCommand.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1151: [WIP] [HUDI-476] Add hudi-examples module

2020-02-05 Thread GitBox
vinothchandar commented on a change in pull request #1151: [WIP] [HUDI-476] Add hudi-examples module URL: https://github.com/apache/incubator-hudi/pull/1151#discussion_r375656811 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1151: [WIP] [HUDI-476] Add hudi-examples module

2020-02-05 Thread GitBox
vinothchandar commented on a change in pull request #1151: [WIP] [HUDI-476] Add hudi-examples module URL: https://github.com/apache/incubator-hudi/pull/1151#discussion_r375656391 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1151: [WIP] [HUDI-476] Add hudi-examples module

2020-02-05 Thread GitBox
vinothchandar commented on a change in pull request #1151: [WIP] [HUDI-476] Add hudi-examples module URL: https://github.com/apache/incubator-hudi/pull/1151#discussion_r375653917 ## File path: hudi-examples/pom.xml ## @@ -0,0 +1,206 @@ + +

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1151: [WIP] [HUDI-476] Add hudi-examples module

2020-02-05 Thread GitBox
vinothchandar commented on a change in pull request #1151: [WIP] [HUDI-476] Add hudi-examples module URL: https://github.com/apache/incubator-hudi/pull/1151#discussion_r375655701 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1151: [WIP] [HUDI-476] Add hudi-examples module

2020-02-05 Thread GitBox
vinothchandar commented on a change in pull request #1151: [WIP] [HUDI-476] Add hudi-examples module URL: https://github.com/apache/incubator-hudi/pull/1151#discussion_r375657650 ## File path: pom.xml ## @@ -408,6 +418,13 @@ ${log4j.version} +

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1151: [WIP] [HUDI-476] Add hudi-examples module

2020-02-05 Thread GitBox
vinothchandar commented on a change in pull request #1151: [WIP] [HUDI-476] Add hudi-examples module URL: https://github.com/apache/incubator-hudi/pull/1151#discussion_r375657083 ## File path:

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #181

2020-02-05 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.28 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/boot: plexus-classworlds-2.5.2.jar

[jira] [Created] (HUDI-602) Add some guidance about how to judge the scope of MINOR to the contribution guidance

2020-02-05 Thread vinoyang (Jira)
vinoyang created HUDI-602: - Summary: Add some guidance about how to judge the scope of MINOR to the contribution guidance Key: HUDI-602 URL: https://issues.apache.org/jira/browse/HUDI-602 Project: Apache

[GitHub] [incubator-hudi] hddong commented on a change in pull request #1242: [HUDI-544] Adjust the read and write path of archive

2020-02-05 Thread GitBox
hddong commented on a change in pull request #1242: [HUDI-544] Adjust the read and write path of archive URL: https://github.com/apache/incubator-hudi/pull/1242#discussion_r375606750 ## File path: hudi-cli/src/main/java/org/apache/hudi/cli/commands/ArchivedCommitsCommand.java

[GitHub] [incubator-hudi] hddong commented on a change in pull request #1242: [HUDI-544] Adjust the read and write path of archive

2020-02-05 Thread GitBox
hddong commented on a change in pull request #1242: [HUDI-544] Adjust the read and write path of archive URL: https://github.com/apache/incubator-hudi/pull/1242#discussion_r375606750 ## File path: hudi-cli/src/main/java/org/apache/hudi/cli/commands/ArchivedCommitsCommand.java

[GitHub] [incubator-hudi] yanghua commented on issue #1305: [MINOR] Remove the declaration of thrown RuntimeException

2020-02-05 Thread GitBox
yanghua commented on issue #1305: [MINOR] Remove the declaration of thrown RuntimeException URL: https://github.com/apache/incubator-hudi/pull/1305#issuecomment-582695979 > cc @yanghua I actually thought of assigning this to you..to get your take on whether this qualifies as MINOR.. I

[GitHub] [incubator-hudi] lamber-ken closed pull request #1304: [MINOR] Replace Thread.sleep with TimeUnit*

2020-02-05 Thread GitBox
lamber-ken closed pull request #1304: [MINOR] Replace Thread.sleep with TimeUnit* URL: https://github.com/apache/incubator-hudi/pull/1304 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Updated] (HUDI-601) Improve unit test coverage for HoodieAvroWriteSupport, HoodieRealtimeRecordReader, RealtimeCompactedRecordReader

2020-02-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-601: Labels: pull-request-available (was: ) > Improve unit test coverage for HoodieAvroWriteSupport, >

[GitHub] [incubator-hudi] modi95 opened a new pull request #1310: [HUDI-601] Improve unit test coverage for HoodieAvroWriteSupport, HoodieRealtimeRecordReader, RealtimeCompactedRecordReader

2020-02-05 Thread GitBox
modi95 opened a new pull request #1310: [HUDI-601] Improve unit test coverage for HoodieAvroWriteSupport, HoodieRealtimeRecordReader, RealtimeCompactedRecordReader URL: https://github.com/apache/incubator-hudi/pull/1310 Raises unit test coverage for the following classes: -

[jira] [Created] (HUDI-601) Improve unit test coverage for HoodieAvroWriteSupport, HoodieRealtimeRecordReader, RealtimeCompactedRecordReader

2020-02-05 Thread Abhishek Modi (Jira)
Abhishek Modi created HUDI-601: -- Summary: Improve unit test coverage for HoodieAvroWriteSupport, HoodieRealtimeRecordReader, RealtimeCompactedRecordReader Key: HUDI-601 URL:

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1290: [HUDI-584] Relocate spark-avro dependency by maven-shade-plugin

2020-02-05 Thread GitBox
lamber-ken edited a comment on issue #1290: [HUDI-584] Relocate spark-avro dependency by maven-shade-plugin URL: https://github.com/apache/incubator-hudi/pull/1290#issuecomment-582669261 Hi @vinothchandar, sorry, I didn't know you and @umehrot2 had talked about this before. 

[jira] [Updated] (HUDI-571) Modify Hudi CLI to show archived commits

2020-02-05 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-571: --- Status: Closed (was: Patch Available) > Modify Hudi CLI to show archived commits >

[jira] [Updated] (HUDI-571) Modify Hudi CLI to show archived commits

2020-02-05 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-571: --- Fix Version/s: 0.5.2 > Modify Hudi CLI to show archived commits > > >

[GitHub] [incubator-hudi] lamber-ken commented on issue #1290: [HUDI-584] Relocate spark-avro dependency by maven-shade-plugin

2020-02-05 Thread GitBox
lamber-ken commented on issue #1290: [HUDI-584] Relocate spark-avro dependency by maven-shade-plugin URL: https://github.com/apache/incubator-hudi/pull/1290#issuecomment-582669261 Hi @vinothchandar, I didn't know you and @umehrot2 had talked about this 

[jira] [Resolved] (HUDI-570) Improve unit test coverage FSUtils.java

2020-02-05 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-570. Fix Version/s: 0.5.2 Resolution: Fixed Fixed via master: 1fb0b001a38ddc940995e45f5cd53701d0110c3b > Improve

[jira] [Updated] (HUDI-570) Improve unit test coverage FSUtils.java

2020-02-05 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-570: --- Status: Open (was: New) > Improve unit test coverage FSUtils.java > --- > >

[jira] [Resolved] (HUDI-587) Jacoco coverage report is not generated

2020-02-05 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-587. Fix Version/s: 0.5.2 Resolution: Fixed Fixed via master: d26dc0b229043afa5aefca239e72f40d80446917 > Jacoco

[GitHub] [incubator-hudi] lamber-ken commented on issue #1290: [HUDI-584] Relocate spark-avro dependency by maven-shade-plugin

2020-02-05 Thread GitBox
lamber-ken commented on issue #1290: [HUDI-584] Relocate spark-avro dependency by maven-shade-plugin URL: https://github.com/apache/incubator-hudi/pull/1290#issuecomment-582663093 Hi @vinothchandar @bhasudha @umehrot2, thanks you all talk about this here, I thinks it's a meaningful

[GitHub] [incubator-hudi] lamber-ken commented on issue #1290: [HUDI-584] Relocate spark-avro dependency by maven-shade-plugin

2020-02-05 Thread GitBox
lamber-ken commented on issue #1290: [HUDI-584] Relocate spark-avro dependency by maven-shade-plugin URL: https://github.com/apache/incubator-hudi/pull/1290#issuecomment-582661108 hi @bhasudha, `Spark 3.0.0-preview2` is pre-built with Scala 2.12, user need to build hudi with scala-2.12

[GitHub] [incubator-hudi] umehrot2 commented on issue #1290: [HUDI-584] Relocate spark-avro dependency by maven-shade-plugin

2020-02-05 Thread GitBox
umehrot2 commented on issue #1290: [HUDI-584] Relocate spark-avro dependency by maven-shade-plugin URL: https://github.com/apache/incubator-hudi/pull/1290#issuecomment-582655960 Also another thing to consider here, is `spark-avro` module is only used for converting between spark's struct

[GitHub] [incubator-hudi] bhasudha commented on issue #1290: [HUDI-584] Relocate spark-avro dependency by maven-shade-plugin

2020-02-05 Thread GitBox
bhasudha commented on issue #1290: [HUDI-584] Relocate spark-avro dependency by maven-shade-plugin URL: https://github.com/apache/incubator-hudi/pull/1290#issuecomment-582654435 > > If the user wants some changes in spark-avro:3.0-preview2, the right way is modify spark-version to

[GitHub] [incubator-hudi] umehrot2 edited a comment on issue #1290: [HUDI-584] Relocate spark-avro dependency by maven-shade-plugin

2020-02-05 Thread GitBox
umehrot2 edited a comment on issue #1290: [HUDI-584] Relocate spark-avro dependency by maven-shade-plugin URL: https://github.com/apache/incubator-hudi/pull/1290#issuecomment-582650497 As @vinothchandar mentioned we did discuss the possibility of doing this, but were thrown back because

[GitHub] [incubator-hudi] umehrot2 commented on issue #1290: [HUDI-584] Relocate spark-avro dependency by maven-shade-plugin

2020-02-05 Thread GitBox
umehrot2 commented on issue #1290: [HUDI-584] Relocate spark-avro dependency by maven-shade-plugin URL: https://github.com/apache/incubator-hudi/pull/1290#issuecomment-582650497 As @vinothchandar mentioned we did discuss the possibility of doing this, but were thrown back because of the

[GitHub] [incubator-hudi] n3nash merged pull request #1298: [HUDI-587] Fixed generation of jacoco coverage reports.

2020-02-05 Thread GitBox
n3nash merged pull request #1298: [HUDI-587] Fixed generation of jacoco coverage reports. URL: https://github.com/apache/incubator-hudi/pull/1298 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1298: [HUDI-587] Fixed generation of jacoco coverage reports.

2020-02-05 Thread GitBox
n3nash commented on a change in pull request #1298: [HUDI-587] Fixed generation of jacoco coverage reports. URL: https://github.com/apache/incubator-hudi/pull/1298#discussion_r375543391 ## File path: pom.xml ## @@ -113,6 +113,7 @@ provided +-Xmx1024m

[incubator-hudi] branch master updated (1fb0b00 -> d26dc0b)

2020-02-05 Thread nagarwal
This is an automated email from the ASF dual-hosted git repository. nagarwal pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from 1fb0b00 [HUDI-570] - Improve test coverage for FSUtils.java add d26dc0b [HUDI-587] Fixed generation

[incubator-hudi] branch master updated (462fd02 -> 1fb0b00)

2020-02-05 Thread nagarwal
This is an automated email from the ASF dual-hosted git repository. nagarwal pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from 462fd02 [HUDI-571] Add 'commits show archived' command to CLI add 1fb0b00 [HUDI-570] - Improve test

[GitHub] [incubator-hudi] n3nash merged pull request #1307: [HUDI-570] Improve test coverage for FSUtils.java

2020-02-05 Thread GitBox
n3nash merged pull request #1307: [HUDI-570] Improve test coverage for FSUtils.java URL: https://github.com/apache/incubator-hudi/pull/1307 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [incubator-hudi] n3nash commented on issue #1309: [HUDI-592] Remove duplicated dependencies in the pom file of test suite module

2020-02-05 Thread GitBox
n3nash commented on issue #1309: [HUDI-592] Remove duplicated dependencies in the pom file of test suite module URL: https://github.com/apache/incubator-hudi/pull/1309#issuecomment-582642492 @yanghua Could you take a look at the failed build please ?

[jira] [Created] (HUDI-600) Cleaner fails with AVRO exception when upgrading from 0.5.0 to master

2020-02-05 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-600: Summary: Cleaner fails with AVRO exception when upgrading from 0.5.0 to master Key: HUDI-600 URL: https://issues.apache.org/jira/browse/HUDI-600 Project: Apache Hudi

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1290: [HUDI-584] Relocate spark-avro dependency by maven-shade-plugin

2020-02-05 Thread GitBox
lamber-ken edited a comment on issue #1290: [HUDI-584] Relocate spark-avro dependency by maven-shade-plugin URL: https://github.com/apache/incubator-hudi/pull/1290#issuecomment-582628959 > > If the user wants some changes in spark-avro:3.0-preview2, the right way is modify spark-version

[GitHub] [incubator-hudi] lamber-ken commented on issue #1290: [HUDI-584] Relocate spark-avro dependency by maven-shade-plugin

2020-02-05 Thread GitBox
lamber-ken commented on issue #1290: [HUDI-584] Relocate spark-avro dependency by maven-shade-plugin URL: https://github.com/apache/incubator-hudi/pull/1290#issuecomment-582628959 > > If the user wants some changes in spark-avro:3.0-preview2, the right way is modify spark-version to

[GitHub] [incubator-hudi] lamber-ken commented on issue #1304: [MINOR] Replace Thread.sleep with TimeUnit*

2020-02-05 Thread GitBox
lamber-ken commented on issue #1304: [MINOR] Replace Thread.sleep with TimeUnit* URL: https://github.com/apache/incubator-hudi/pull/1304#issuecomment-582627717 > IMO anything that needs some kind of subjective debate, cannot be MINOR.. > > @lamber-ken For these kinds of PRs, can we

[GitHub] [incubator-hudi] nbalajee commented on a change in pull request #1307: [HUDI-570] Improve test coverage for FSUtils.java

2020-02-05 Thread GitBox
nbalajee commented on a change in pull request #1307: [HUDI-570] Improve test coverage for FSUtils.java URL: https://github.com/apache/incubator-hudi/pull/1307#discussion_r375520095 ## File path: hudi-common/src/test/java/org/apache/hudi/common/util/TestFSUtils.java ##

[GitHub] [incubator-hudi] nbalajee commented on a change in pull request #1307: [HUDI-570] Improve test coverage for FSUtils.java

2020-02-05 Thread GitBox
nbalajee commented on a change in pull request #1307: [HUDI-570] Improve test coverage for FSUtils.java URL: https://github.com/apache/incubator-hudi/pull/1307#discussion_r375520024 ## File path: hudi-common/src/test/java/org/apache/hudi/common/util/TestFSUtils.java ##

[jira] [Resolved] (HUDI-499) Allow partition path to be updated with GLOBAL_BLOOM index

2020-02-05 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-499. - Resolution: Implemented Configuration docs will be published later. > Allow partition path to be updated

[jira] [Updated] (HUDI-499) Allow partition path to be updated with GLOBAL_BLOOM index

2020-02-05 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-499: Description: h3. Context When a record is to be updated with a new partition path, and when set to

[GitHub] [incubator-hudi] vinothchandar commented on issue #1290: [HUDI-584] Relocate spark-avro dependency by maven-shade-plugin

2020-02-05 Thread GitBox
vinothchandar commented on issue #1290: [HUDI-584] Relocate spark-avro dependency by maven-shade-plugin URL: https://github.com/apache/incubator-hudi/pull/1290#issuecomment-582609037 >If the user wants some changes in spark-avro:3.0-preview2, the right way is modify spark-version to

[GitHub] [incubator-hudi] vinothchandar commented on issue #1304: [MINOR] Replace Thread.sleep with TimeUnit*

2020-02-05 Thread GitBox
vinothchandar commented on issue #1304: [MINOR] Replace Thread.sleep with TimeUnit* URL: https://github.com/apache/incubator-hudi/pull/1304#issuecomment-582605546 @yanghua Same here... This PR IMO is making a subjective argument.. I personally feel `Thread.sleep` is more universally known

[GitHub] [incubator-hudi] vinothchandar commented on issue #1305: [MINOR] Remove the declaration of thrown RuntimeException

2020-02-05 Thread GitBox
vinothchandar commented on issue #1305: [MINOR] Remove the declaration of thrown RuntimeException URL: https://github.com/apache/incubator-hudi/pull/1305#issuecomment-582605003 cc @yanghua I actually thought of assigning this to you..to get your take on whether this qualifies as MINOR..

[GitHub] [incubator-hudi] prashantwason commented on issue #1289: [HUDI-92] Provide reasonable names for Spark DAG stages in Hudi.

2020-02-05 Thread GitBox
prashantwason commented on issue #1289: [HUDI-92] Provide reasonable names for Spark DAG stages in Hudi. URL: https://github.com/apache/incubator-hudi/pull/1289#issuecomment-582587735 Spark History Server Screenshots ![List of

[incubator-hudi] branch master updated: [HUDI-571] Add 'commits show archived' command to CLI

2020-02-05 Thread nagarwal
This is an automated email from the ASF dual-hosted git repository. nagarwal pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 462fd02 [HUDI-571] Add 'commits show

[GitHub] [incubator-hudi] n3nash merged pull request #1274: [HUDI-571] Add 'commits show archived' command to CLI

2020-02-05 Thread GitBox
n3nash merged pull request #1274: [HUDI-571] Add 'commits show archived' command to CLI URL: https://github.com/apache/incubator-hudi/pull/1274 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [incubator-hudi] vinothchandar commented on issue #1187: [HUDI-499] Allow update partition path with GLOBAL_BLOOM

2020-02-05 Thread GitBox
vinothchandar commented on issue #1187: [HUDI-499] Allow update partition path with GLOBAL_BLOOM URL: https://github.com/apache/incubator-hudi/pull/1187#issuecomment-582522731 Thanks and Congrats! :) landed! This is an

[incubator-hudi] branch master updated: [HUDI-499] Allow update partition path with GLOBAL_BLOOM (#1187)

2020-02-05 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new c1516df [HUDI-499] Allow update

[GitHub] [incubator-hudi] vinothchandar merged pull request #1187: [HUDI-499] Allow update partition path with GLOBAL_BLOOM

2020-02-05 Thread GitBox
vinothchandar merged pull request #1187: [HUDI-499] Allow update partition path with GLOBAL_BLOOM URL: https://github.com/apache/incubator-hudi/pull/1187 This is an automated message from the Apache Git Service. To respond

[jira] [Updated] (HUDI-321) Support bulkinsert in HDFSParquetImporter

2020-02-05 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-321: Priority: Minor (was: Trivial) > Support bulkinsert in HDFSParquetImporter >

[jira] [Commented] (HUDI-553) Building/Running Hudi on higher java versions

2020-02-05 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030821#comment-17030821 ] Raymond Xu commented on HUDI-553: - [~vinoth] really great to see this is planned! Wondering if the target

[GitHub] [incubator-hudi] xushiyan edited a comment on issue #1190: [HUDI-499] Add configuration docs

2020-02-05 Thread GitBox
xushiyan edited a comment on issue #1190: [HUDI-499] Add configuration docs URL: https://github.com/apache/incubator-hudi/pull/1190#issuecomment-582500892 @leesf As we discussed, this is blocked until `_docs/0.5.1` is created

[GitHub] [incubator-hudi] xushiyan commented on issue #1190: [HUDI-499] Add configuration docs

2020-02-05 Thread GitBox
xushiyan commented on issue #1190: [HUDI-499] Add configuration docs URL: https://github.com/apache/incubator-hudi/pull/1190#issuecomment-582500892 blocked for now until `_docs/0.5.1` is created This is an automated message

[GitHub] [incubator-hudi] xushiyan edited a comment on issue #1187: [HUDI-499] Allow update partition path with GLOBAL_BLOOM

2020-02-05 Thread GitBox
xushiyan edited a comment on issue #1187: [HUDI-499] Allow update partition path with GLOBAL_BLOOM URL: https://github.com/apache/incubator-hudi/pull/1187#issuecomment-582498755 > @xushiyan I think there is a checkstyle error. can you please take a look @vinothchandar Fixed!

[GitHub] [incubator-hudi] xushiyan commented on issue #1187: [HUDI-499] Allow update partition path with GLOBAL_BLOOM

2020-02-05 Thread GitBox
xushiyan commented on issue #1187: [HUDI-499] Allow update partition path with GLOBAL_BLOOM URL: https://github.com/apache/incubator-hudi/pull/1187#issuecomment-582498755 > @xushiyan I think there is a checkstyle error. can you please take a look Fixed!

[incubator-hudi] branch master updated: [MINOR] Remove the declaration of thrown RuntimeException (#1305)

2020-02-05 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 46842f4 [MINOR] Remove the declaration

[GitHub] [incubator-hudi] leesf merged pull request #1305: [MINOR] Remove the declaration of thrown RuntimeException

2020-02-05 Thread GitBox
leesf merged pull request #1305: [MINOR] Remove the declaration of thrown RuntimeException URL: https://github.com/apache/incubator-hudi/pull/1305 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [incubator-hudi] yanghua opened a new pull request #1309: [HUDI-592] Remove duplicated dependencies in the pom file of test suite module

2020-02-05 Thread GitBox
yanghua opened a new pull request #1309: [HUDI-592] Remove duplicated dependencies in the pom file of test suite module URL: https://github.com/apache/incubator-hudi/pull/1309 ## What is the purpose of the pull request *This pull request removes duplicated dependencies in

[jira] [Updated] (HUDI-592) Remove duplicated dependencies in the pom file of test suite module

2020-02-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-592: Labels: pull-request-available (was: ) > Remove duplicated dependencies in the pom file of test

[GitHub] [incubator-hudi] lamber-ken commented on issue #1293: [HUDI-585] Optimize the steps of building with scala-2.12

2020-02-05 Thread GitBox
lamber-ken commented on issue #1293: [HUDI-585] Optimize the steps of building with scala-2.12 URL: https://github.com/apache/incubator-hudi/pull/1293#issuecomment-582456190 > +1 LGTM, also tested in window, except for hudi-integ-test(not install docker), other modules works fine. Thanks

[incubator-hudi] branch master updated: [HUDI-585] Optimize the steps of building with scala-2.12 (#1293)

2020-02-05 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 425e3e6 [HUDI-585] Optimize the steps

[GitHub] [incubator-hudi] leesf merged pull request #1293: [HUDI-585] Optimize the steps of building with scala-2.12

2020-02-05 Thread GitBox
leesf merged pull request #1293: [HUDI-585] Optimize the steps of building with scala-2.12 URL: https://github.com/apache/incubator-hudi/pull/1293 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [incubator-hudi] lamber-ken commented on a change in pull request #1293: [HUDI-585] Optimize the steps of building with scala-2.12

2020-02-05 Thread GitBox
lamber-ken commented on a change in pull request #1293: [HUDI-585] Optimize the steps of building with scala-2.12 URL: https://github.com/apache/incubator-hudi/pull/1293#discussion_r375271334 ## File path: pom.xml ## @@ -1052,6 +1052,10 @@ Review comment:

[GitHub] [incubator-hudi] lamber-ken commented on a change in pull request #1293: [HUDI-585] Optimize the steps of building with scala-2.12

2020-02-05 Thread GitBox
lamber-ken commented on a change in pull request #1293: [HUDI-585] Optimize the steps of building with scala-2.12 URL: https://github.com/apache/incubator-hudi/pull/1293#discussion_r375269481 ## File path: pom.xml ## @@ -1052,6 +1052,10 @@ Review comment: Not

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1293: [HUDI-585] Optimize the steps of building with scala-2.12

2020-02-05 Thread GitBox
leesf commented on a change in pull request #1293: [HUDI-585] Optimize the steps of building with scala-2.12 URL: https://github.com/apache/incubator-hudi/pull/1293#discussion_r375265150 ## File path: pom.xml ## @@ -1052,6 +1052,10 @@ Review comment: So this

[jira] [Updated] (HUDI-599) Update release guide & release scripts due to the change of scala 2.12 build

2020-02-05 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-599: --- Summary: Update release guide & release scripts due to the change of scala 2.12 build (was: Update release

[jira] [Updated] (HUDI-599) Update release guide/release scripts due to the change of scala 2.12 build

2020-02-05 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-599: --- Summary: Update release guide/release scripts due to the change of scala 2.12 build (was: Update Release guide due to

[jira] [Created] (HUDI-599) Update Release guide due to the change of scala 2.12 build

2020-02-05 Thread leesf (Jira)
leesf created HUDI-599: -- Summary: Update Release guide due to the change of scala 2.12 build Key: HUDI-599 URL: https://issues.apache.org/jira/browse/HUDI-599 Project: Apache Hudi (incubating) Issue

[GitHub] [incubator-hudi] lamber-ken commented on issue #1293: [HUDI-585] Optimize the steps of building with scala-2.12

2020-02-05 Thread GitBox
lamber-ken commented on issue #1293: [HUDI-585] Optimize the steps of building with scala-2.12 URL: https://github.com/apache/incubator-hudi/pull/1293#issuecomment-582415582 > @lamber-ken Sorry for late update, tested and worked fine in Linux, let's go forward. Welcome :)

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1293: [HUDI-585] Optimize the steps of building with scala-2.12

2020-02-05 Thread GitBox
lamber-ken edited a comment on issue #1293: [HUDI-585] Optimize the steps of building with scala-2.12 URL: https://github.com/apache/incubator-hudi/pull/1293#issuecomment-582415582 > @lamber-ken Sorry for late update, tested and worked fine in Linux, let's go forward. No problem :)

[jira] [Closed] (HUDI-595) code cleanup

2020-02-05 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-595. -- > code cleanup > - > > Key: HUDI-595 > URL:

[jira] [Assigned] (HUDI-586) Revisit the release guide

2020-02-05 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf reassigned HUDI-586: -- Assignee: leesf > Revisit the release guide > - > > Key: HUDI-586 >

[jira] [Commented] (HUDI-590) Cut a new Doc version 0.5.1 explicitly

2020-02-05 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030656#comment-17030656 ] leesf commented on HUDI-590: [~bhavanisudha] It would be better to create the 0.5.1 version faster since there

[jira] [Updated] (HUDI-595) code cleanup

2020-02-05 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-595: --- Status: Open (was: New) > code cleanup > - > > Key: HUDI-595 > URL:

[jira] [Resolved] (HUDI-595) code cleanup

2020-02-05 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-595. Resolution: Fixed Fixed via master: 594da28fbf64fb20432e718a409577fd10516c4a > code cleanup > - > >

[GitHub] [incubator-hudi] leesf commented on issue #1293: [HUDI-585] Optimize the steps of building with scala-2.12

2020-02-05 Thread GitBox
leesf commented on issue #1293: [HUDI-585] Optimize the steps of building with scala-2.12 URL: https://github.com/apache/incubator-hudi/pull/1293#issuecomment-582405982 @lamber-ken Sorry for late update, tested and worked fine in Linux, let's go forward.

[GitHub] [incubator-hudi] pratyakshsharma commented on issue #765: [WIP] Fix KafkaAvroSource to use the latest schema

2020-02-05 Thread GitBox
pratyakshsharma commented on issue #765: [WIP] Fix KafkaAvroSource to use the latest schema URL: https://github.com/apache/incubator-hudi/pull/765#issuecomment-582404722 ack. Will take a pass. This is an automated message

[GitHub] [incubator-hudi] pratyakshsharma commented on issue #1165: [HUDI-76] Add CSV Source support for Hudi Delta Streamer

2020-02-05 Thread GitBox
pratyakshsharma commented on issue #1165: [HUDI-76] Add CSV Source support for Hudi Delta Streamer URL: https://github.com/apache/incubator-hudi/pull/1165#issuecomment-582404480 @vinothchandar ack. This is an automated