[jira] [Commented] (HUDI-226) Hudi Website - Provide links to documentation corresponding to older release versions

[ https://issues.apache.org/jira/browse/HUDI-226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16967364#comment-16967364 ] vinoyang commented on HUDI-226: --- [~guoyihua] Got it. Can we chat on WeChat so that we can com

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #991: Hudi Test Suite (Refactor)

yanghua commented on a change in pull request #991: Hudi Test Suite (Refactor) URL: https://github.com/apache/incubator-hudi/pull/991#discussion_r342516577 ## File path: hudi-bench/src/main/java/org/apache/hudi/bench/helpers/HiveServerWrapper.java ## @@ -0,0 +1,67 @@ +/*

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #991: Hudi Test Suite (Refactor)

yanghua commented on a change in pull request #991: Hudi Test Suite (Refactor) URL: https://github.com/apache/incubator-hudi/pull/991#discussion_r342404473 ## File path: hudi-bench/src/main/java/org/apache/hudi/bench/reader/DFSParquetDeltaInputReader.java ## @@ -0,0 +1,92

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #991: Hudi Test Suite (Refactor)

yanghua commented on a change in pull request #991: Hudi Test Suite (Refactor) URL: https://github.com/apache/incubator-hudi/pull/991#discussion_r342443764 ## File path: hudi-bench/src/main/java/org/apache/hudi/bench/dag/WorkflowDagGenerator.java ## @@ -0,0 +1,70 @@ +/* +

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #991: Hudi Test Suite (Refactor)

yanghua commented on a change in pull request #991: Hudi Test Suite (Refactor) URL: https://github.com/apache/incubator-hudi/pull/991#discussion_r342404062 ## File path: hudi-bench/src/main/java/org/apache/hudi/bench/reader/SparkBasedReader.java ## @@ -0,0 +1,68 @@ +/* +

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #991: Hudi Test Suite (Refactor)

yanghua commented on a change in pull request #991: Hudi Test Suite (Refactor) URL: https://github.com/apache/incubator-hudi/pull/991#discussion_r342517208 ## File path: hudi-bench/src/main/java/org/apache/hudi/bench/helpers/DFSTestSuitePathSelector.java ## @@ -0,0 +1,92

[GitHub] [incubator-hudi] vinothchandar merged pull request #993: [HUDI-324] TimestampKeyGenerator should support milliseconds

vinothchandar merged pull request #993: [HUDI-324] TimestampKeyGenerator should support milliseconds URL: https://github.com/apache/incubator-hudi/pull/993 This is an automated message from the Apache Git Service. To respond

[GitHub] [incubator-hudi] vinothchandar commented on issue #993: [HUDI-324] TimestampKeyGenerator should support milliseconds

vinothchandar commented on issue #993: [HUDI-324] TimestampKeyGenerator should support milliseconds URL: https://github.com/apache/incubator-hudi/pull/993#issuecomment-549800627 @yanghua is this the same situation for you? afaik adding to roster should give you these perms. lets deal wi

[incubator-hudi] branch master updated: [HUDI-324] TimestampKeyGenerator should support milliseconds (#993)

This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 71ac2c0 [HUDI-324] TimestampKeyGenerato

[GitHub] [incubator-hudi] yanghua commented on issue #993: [HUDI-324] TimestampKeyGenerator should support milliseconds

yanghua commented on issue #993: [HUDI-324] TimestampKeyGenerator should support milliseconds URL: https://github.com/apache/incubator-hudi/pull/993#issuecomment-549804280 @vinothchandar I have not tried the merge action. I work as a cooperator to help to deal with #991 now. -

[GitHub] [incubator-hudi] yanghua commented on issue #991: Hudi Test Suite (Refactor)

yanghua commented on issue #991: Hudi Test Suite (Refactor) URL: https://github.com/apache/incubator-hudi/pull/991#issuecomment-549811801 @n3nash Now, there is a conflict file. This is an automated message from the Apache Git

[GitHub] [incubator-hudi] bhasudha commented on issue #986: [HUDI-317] change quickstart page spark-shell command

bhasudha commented on issue #986: [HUDI-317] change quickstart page spark-shell command URL: https://github.com/apache/incubator-hudi/pull/986#issuecomment-549830968 @vinothchandar PTAL when you can. @leesf / @yanghua can one of you update the quickstart.cn.md per these changes? Following

[GitHub] [incubator-hudi] yanghua edited a comment on issue #993: [HUDI-324] TimestampKeyGenerator should support milliseconds

yanghua edited a comment on issue #993: [HUDI-324] TimestampKeyGenerator should support milliseconds URL: https://github.com/apache/incubator-hudi/pull/993#issuecomment-549804280 @vinothchandar It seems I also do not have merge permission. --

[jira] [Updated] (HUDI-253) DeltaStreamer should report nicer error messages for misconfigs

[ https://issues.apache.org/jira/browse/HUDI-253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-253: Labels: pull-request-available (was: ) > DeltaStreamer should report nicer error messages for miscon

[GitHub] [incubator-hudi] pratyakshsharma opened a new pull request #995: [HUDI-253]: added validations for schema provider class

pratyakshsharma opened a new pull request #995: [HUDI-253]: added validations for schema provider class URL: https://github.com/apache/incubator-hudi/pull/995 This is an automated message from the Apache Git Service. To resp

[incubator-hudi] branch asf-site updated: [HUDI-317] change quickstart page spark-shell command to use --packages option referring to Hudi maven artifact (#986)

This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 0d530ee [HUDI-317] change quickstar

[GitHub] [incubator-hudi] vinothchandar merged pull request #986: [HUDI-317] change quickstart page spark-shell command

vinothchandar merged pull request #986: [HUDI-317] change quickstart page spark-shell command URL: https://github.com/apache/incubator-hudi/pull/986 This is an automated message from the Apache Git Service. To respond to th

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #942: [HUDI-137] Fix state transitions for Hudi cleaning action

bvaradar commented on a change in pull request #942: [HUDI-137] Fix state transitions for Hudi cleaning action URL: https://github.com/apache/incubator-hudi/pull/942#discussion_r342680405 ## File path: hudi-client/src/main/java/org/apache/hudi/HoodieWriteClient.java ## @@

[GitHub] [incubator-hudi] bvaradar commented on issue #942: [HUDI-137] Fix state transitions for Hudi cleaning action

bvaradar commented on issue #942: [HUDI-137] Fix state transitions for Hudi cleaning action URL: https://github.com/apache/incubator-hudi/pull/942#issuecomment-549916901 @vinothchandar: Updated PR. Please review when you get a chance

[jira] [Commented] (HUDI-80) Incrementalize cleaning based on timeline metadata

[ https://issues.apache.org/jira/browse/HUDI-80?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16967698#comment-16967698 ] Balaji Varadarajan commented on HUDI-80: The proposed solution is to   (a) Retain

[GitHub] [incubator-hudi] n3nash commented on issue #994: Enable HiveOnSpark queries for RT tables

n3nash commented on issue #994: Enable HiveOnSpark queries for RT tables URL: https://github.com/apache/incubator-hudi/pull/994#issuecomment-549927498 @vinothchandar Addressed your comment, also added change to another class - this was pushed as part of a different PR earlier and then rever

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #995: [HUDI-253]: added validations for schema provider class

vinothchandar commented on a change in pull request #995: [HUDI-253]: added validations for schema provider class URL: https://github.com/apache/incubator-hudi/pull/995#discussion_r342717049 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/SourceFo

[GitHub] [incubator-hudi] vinothchandar commented on issue #961: [HUDI-306] Support Glue catalog and other hive metastore implementations

vinothchandar commented on issue #961: [HUDI-306] Support Glue catalog and other hive metastore implementations URL: https://github.com/apache/incubator-hudi/pull/961#issuecomment-549967608 utilities-bundle is very similar to its spark-bundle.. For now, we could do a similar fix (control v

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #995: [HUDI-253]: added validations for schema provider class

pratyakshsharma commented on a change in pull request #995: [HUDI-253]: added validations for schema provider class URL: https://github.com/apache/incubator-hudi/pull/995#discussion_r342747471 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/Source

[GitHub] [incubator-hudi] n3nash opened a new pull request #996: Fixes to ensure MOR incr pull provides consistent results

n3nash opened a new pull request #996: Fixes to ensure MOR incr pull provides consistent results URL: https://github.com/apache/incubator-hudi/pull/996 Ensure that rollback instant is always created before the next commit instant. This especially affects IncrementalPull for MOR ta

[jira] [Closed] (HUDI-324) TimestampKeyGenerator should support milliseconds

[ https://issues.apache.org/jira/browse/HUDI-324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-324. -- Fix Version/s: 0.5.1 Resolution: Fixed Fixed via master: 71ac2c0d5e8bffdbb11f7789a7805575736049c1 > TimestampKeyG

[jira] [Commented] (HUDI-146) Impala Support

[ https://issues.apache.org/jira/browse/HUDI-146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16968043#comment-16968043 ] Yanjia Gary Li commented on HUDI-146: - Hello [~vinoth], Yuanbin finished his internship

[jira] [Assigned] (HUDI-146) Impala Support

[ https://issues.apache.org/jira/browse/HUDI-146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned HUDI-146: --- Assignee: Yanjia Gary Li (was: Yuanbin Cheng) > Impala Support > -- > >

[jira] [Commented] (HUDI-146) Impala Support

[ https://issues.apache.org/jira/browse/HUDI-146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16968046#comment-16968046 ] Vinoth Chandar commented on HUDI-146: - Done. Its actually great timing too since we hav

[GitHub] [incubator-hudi] leesf commented on issue #986: [HUDI-317] change quickstart page spark-shell command

leesf commented on issue #986: [HUDI-317] change quickstart page spark-shell command URL: https://github.com/apache/incubator-hudi/pull/986#issuecomment-550127724 > @vinothchandar PTAL when you can. @leesf / @yanghua can one of you update the quickstart.cn.md per these changes? Following

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #90

See Changes: -- [...truncated 2.19 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/bin: m2.conf mvn mvn.cmd mvnDebug mvnDebug.cmd mvnyjp /home/jenkins/tools/maven/apache

[jira] [Commented] (HUDI-129) How to release cWiki page

[ https://issues.apache.org/jira/browse/HUDI-129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16968077#comment-16968077 ] Balaji Varadarajan commented on HUDI-129: - [https://cwiki.apache.org/confluence/dis

[jira] [Assigned] (HUDI-208) Publish new Hudi Docker images which uses new package names

[ https://issues.apache.org/jira/browse/HUDI-208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Varadarajan reassigned HUDI-208: --- Assignee: Balaji Varadarajan > Publish new Hudi Docker images which uses new package n

[jira] [Closed] (HUDI-208) Publish new Hudi Docker images which uses new package names

[ https://issues.apache.org/jira/browse/HUDI-208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Varadarajan closed HUDI-208. --- > Publish new Hudi Docker images which uses new package names > ---

[jira] [Resolved] (HUDI-208) Publish new Hudi Docker images which uses new package names

[ https://issues.apache.org/jira/browse/HUDI-208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Varadarajan resolved HUDI-208. - Resolution: Fixed > Publish new Hudi Docker images which uses new package names > -

[jira] [Closed] (HUDI-88) Support for deletes via OverwriteWithLatestPayload

[ https://issues.apache.org/jira/browse/HUDI-88?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-88. -- Resolution: Duplicate > Support for deletes via OverwriteWithLatestPayload >

[jira] [Commented] (HUDI-88) Support for deletes via OverwriteWithLatestPayload

[ https://issues.apache.org/jira/browse/HUDI-88?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16968086#comment-16968086 ] Vinoth Chandar commented on HUDI-88: invalidated due to the delete () api tcket  > Supp

[jira] [Updated] (HUDI-253) DeltaStreamer should report nicer error messages for misconfigs

[ https://issues.apache.org/jira/browse/HUDI-253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-253: Status: Patch Available (was: In Progress) > DeltaStreamer should report nicer error messages for mi

[jira] [Updated] (HUDI-251) JDBC incremental load to HUDI with DeltaStreamer

[ https://issues.apache.org/jira/browse/HUDI-251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-251: Status: Patch Available (was: In Progress) > JDBC incremental load to HUDI with DeltaStreamer >

[jira] [Closed] (HUDI-173) Commit archival fails with "not an avro file at"

[ https://issues.apache.org/jira/browse/HUDI-173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-173. --- Resolution: Cannot Reproduce > Commit archival fails with "not an avro file at" > -

[jira] [Updated] (HUDI-137) Hudi cleaning state changes should be consistent with commit actions

[ https://issues.apache.org/jira/browse/HUDI-137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-137: Status: Patch Available (was: In Progress) > Hudi cleaning state changes should be consistent with c

[jira] [Closed] (HUDI-317) Edit Quickstart page to point to Hudi maven artifact in spark shell command

[ https://issues.apache.org/jira/browse/HUDI-317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-317. --- Resolution: Fixed > Edit Quickstart page to point to Hudi maven artifact in spark shell command > -

[GitHub] [incubator-hudi] bvaradar commented on issue #862: Add support for composite key

bvaradar commented on issue #862: Add support for composite key URL: https://github.com/apache/incubator-hudi/pull/862#issuecomment-550156029 Closing this for now due to inactivity. @afilipchik, please open it if you think otherwise.

[GitHub] [incubator-hudi] bvaradar closed pull request #862: Add support for composite key

bvaradar closed pull request #862: Add support for composite key URL: https://github.com/apache/incubator-hudi/pull/862 This is an automated message from the Apache Git Service. To respond to the message, please log on to Git