[jira] [Updated] (HUDI-302) Simplify count operation in HoodieDefaultTimeline::countInstants

2019-11-06 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratyaksh Sharma updated HUDI-302: -- Status: Patch Available (was: In Progress) > Simplify count operation in

[jira] [Updated] (HUDI-302) Simplify count operation in HoodieDefaultTimeline::countInstants

2019-11-06 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratyaksh Sharma updated HUDI-302: -- Status: Closed (was: Patch Available) > Simplify count operation in

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #995: [HUDI-253]: added validations for schema provider class

2019-11-06 Thread GitBox
pratyakshsharma commented on a change in pull request #995: [HUDI-253]: added validations for schema provider class URL: https://github.com/apache/incubator-hudi/pull/995#discussion_r343499221 ## File path:

[jira] [Commented] (HUDI-146) Impala Support

2019-11-06 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968914#comment-16968914 ] Vinoth Chandar commented on HUDI-146: - [~garyli1019] no. It works because InputFormat is the right

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #91

2019-11-06 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.20 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/bin: m2.conf mvn mvn.cmd mvnDebug mvnDebug.cmd mvnyjp

[GitHub] [incubator-hudi] bhasudha commented on issue #998: Incremental view not implemented yet, for merge-on-read datasets

2019-11-06 Thread GitBox
bhasudha commented on issue #998: Incremental view not implemented yet, for merge-on-read datasets URL: https://github.com/apache/incubator-hudi/issues/998#issuecomment-550524198 @HariprasadAllaka1612 Looks like spark sql for incremental queries work on a Hive table. The Docker demo that

[GitHub] [incubator-hudi] vinothchandar merged pull request #997: [HUDI-302]: simplified countInstants() method in HoodieDefaultTimeline

2019-11-06 Thread GitBox
vinothchandar merged pull request #997: [HUDI-302]: simplified countInstants() method in HoodieDefaultTimeline URL: https://github.com/apache/incubator-hudi/pull/997 This is an automated message from the Apache Git Service.

[incubator-hudi] branch master updated: [HUDI-302]: simplified countInstants() method in HoodieDefaultTimeline (#997)

2019-11-06 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 20871a1 [HUDI-302]: simplified

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #997: [HUDI-302]: simplified countInstants() method in HoodieDefaultTimeline

2019-11-06 Thread GitBox
vinothchandar commented on a change in pull request #997: [HUDI-302]: simplified countInstants() method in HoodieDefaultTimeline URL: https://github.com/apache/incubator-hudi/pull/997#discussion_r343322703 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on issue #993: [HUDI-324] TimestampKeyGenerator should support milliseconds

2019-11-06 Thread GitBox
vinothchandar commented on issue #993: [HUDI-324] TimestampKeyGenerator should support milliseconds URL: https://github.com/apache/incubator-hudi/pull/993#issuecomment-550496055 @yanghua @leesf can you both start an email thread for private@ . we can discuss there

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #999: Update to align with original Uber whitepaper

2019-11-06 Thread GitBox
vinothchandar commented on a change in pull request #999: Update to align with original Uber whitepaper URL: https://github.com/apache/incubator-hudi/pull/999#discussion_r343318776 ## File path: README.md ## @@ -16,7 +16,7 @@ --> # Hudi -Apache Hudi (Incubating)

[jira] [Resolved] (HUDI-313) Unable to SELECT COUNT(*) from a MOR realtime table

2019-11-06 Thread Wenning Ding (Jira)
[ https://issues.apache.org/jira/browse/HUDI-313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenning Ding resolved HUDI-313. --- Resolution: Fixed > Unable to SELECT COUNT(*) from a MOR realtime table >

[jira] [Resolved] (HUDI-314) Unable to query a multi-partitions MOR realtime table

2019-11-06 Thread Wenning Ding (Jira)
[ https://issues.apache.org/jira/browse/HUDI-314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenning Ding resolved HUDI-314. --- Resolution: Fixed > Unable to query a multi-partitions MOR realtime table >

[GitHub] [incubator-hudi] bhasudha commented on issue #998: Incremental view not implemented yet, for merge-on-read datasets

2019-11-06 Thread GitBox
bhasudha commented on issue #998: Incremental view not implemented yet, for merge-on-read datasets URL: https://github.com/apache/incubator-hudi/issues/998#issuecomment-550480330 @HariprasadAllaka1612 I need to dig into this issue more. But I am quite sure you can incrementally query MOR

[jira] [Commented] (HUDI-146) Impala Support

2019-11-06 Thread Yanjia Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968638#comment-16968638 ] Yanjia Gary Li commented on HUDI-146: - [~vinoth] is there any hudi related code in the Hive code base? 

[GitHub] [incubator-hudi] Pahtoe opened a new pull request #999: Update to align with original Uber whitepaper

2019-11-06 Thread GitBox
Pahtoe opened a new pull request #999: Update to align with original Uber whitepaper URL: https://github.com/apache/incubator-hudi/pull/999 https://eng.uber.com/hoodie/ This is an automated message from the Apache Git

[jira] [Commented] (HUDI-114) Allow for clients to overwrite the payload implementation in hoodie.properties

2019-11-06 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968525#comment-16968525 ] Nishith Agarwal commented on HUDI-114: -- [~Pratyaksh] Glad to have you pick this up! Let me know if you

[jira] [Assigned] (HUDI-114) Allow for clients to overwrite the payload implementation in hoodie.properties

2019-11-06 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal reassigned HUDI-114: Assignee: Pratyaksh Sharma (was: Nishith Agarwal) > Allow for clients to overwrite the

[GitHub] [incubator-hudi] HariprasadAllaka1612 opened a new issue #998: Incremental view not implemented yet, for merge-on-read datasets

2019-11-06 Thread GitBox
HariprasadAllaka1612 opened a new issue #998: Incremental view not implemented yet, for merge-on-read datasets URL: https://github.com/apache/incubator-hudi/issues/998 I am having this exception when i am trying to read a dataset which is stored in MOR format val df =sc.read.

[jira] [Commented] (HUDI-245) Refactor code references that call HoodieTimeline.getInstants() and reverse to directly use method HoodieTimeline.getReverseOrderedInstants

2019-11-06 Thread Bhavani Sudha Saktheeswaran (Jira)
[ https://issues.apache.org/jira/browse/HUDI-245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968328#comment-16968328 ] Bhavani Sudha Saktheeswaran commented on HUDI-245: -- Absolutely. All yours now :) >

[jira] [Assigned] (HUDI-245) Refactor code references that call HoodieTimeline.getInstants() and reverse to directly use method HoodieTimeline.getReverseOrderedInstants

2019-11-06 Thread Bhavani Sudha Saktheeswaran (Jira)
[ https://issues.apache.org/jira/browse/HUDI-245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha Saktheeswaran reassigned HUDI-245: Assignee: Pratyaksh Sharma (was: Bhavani Sudha Saktheeswaran) >

[GitHub] [incubator-hudi] leesf commented on a change in pull request #995: [HUDI-253]: added validations for schema provider class

2019-11-06 Thread GitBox
leesf commented on a change in pull request #995: [HUDI-253]: added validations for schema provider class URL: https://github.com/apache/incubator-hudi/pull/995#discussion_r343033196 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/InputBatch.java

[jira] [Commented] (HUDI-245) Refactor code references that call HoodieTimeline.getInstants() and reverse to directly use method HoodieTimeline.getReverseOrderedInstants

2019-11-06 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968243#comment-16968243 ] Pratyaksh Sharma commented on HUDI-245: --- [~bhasudha] I would like to take it up. Will be sending the

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #991: Hudi Test Suite (Refactor)

2019-11-06 Thread GitBox
yanghua commented on a change in pull request #991: Hudi Test Suite (Refactor) URL: https://github.com/apache/incubator-hudi/pull/991#discussion_r343002991 ## File path: hudi-bench/src/main/java/org/apache/hudi/bench/dag/DagUtils.java ## @@ -0,0 +1,247 @@ +/* + * Licensed

[jira] [Commented] (HUDI-114) Allow for clients to overwrite the payload implementation in hoodie.properties

2019-11-06 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968225#comment-16968225 ] Pratyaksh Sharma commented on HUDI-114: --- [~nishith29] I would like to take it up.  > Allow for

[jira] [Updated] (HUDI-302) Simplify count operation in HoodieDefaultTimeline::countInstants

2019-11-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-302: Labels: newbie pull-request-available (was: newbie) > Simplify count operation in

[GitHub] [incubator-hudi] pratyakshsharma opened a new pull request #997: [HUDI-302]: simplified countInstants() method in HoodieDefaultTimeline

2019-11-06 Thread GitBox
pratyakshsharma opened a new pull request #997: [HUDI-302]: simplified countInstants() method in HoodieDefaultTimeline URL: https://github.com/apache/incubator-hudi/pull/997 countInstants() method was having unnecessary casting. We can directly use Collections.size() method.

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #991: Hudi Test Suite (Refactor)

2019-11-06 Thread GitBox
yanghua commented on a change in pull request #991: Hudi Test Suite (Refactor) URL: https://github.com/apache/incubator-hudi/pull/991#discussion_r342983113 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/converter/Converter.java ## @@ -0,0 +1,33 @@

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #991: Hudi Test Suite (Refactor)

2019-11-06 Thread GitBox
yanghua commented on a change in pull request #991: Hudi Test Suite (Refactor) URL: https://github.com/apache/incubator-hudi/pull/991#discussion_r342982493 ## File path: hudi-bench/src/main/java/org/apache/hudi/bench/DeltaSinkType.java ## @@ -0,0 +1,26 @@ +/* + * Licensed

[jira] [Assigned] (HUDI-302) Simplify count operation in HoodieDefaultTimeline::countInstants

2019-11-06 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratyaksh Sharma reassigned HUDI-302: - Assignee: Pratyaksh Sharma > Simplify count operation in

[jira] [Commented] (HUDI-302) Simplify count operation in HoodieDefaultTimeline::countInstants

2019-11-06 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968210#comment-16968210 ] Pratyaksh Sharma commented on HUDI-302: --- [~jghoman] I would like to take it up. Will be sending the