[GitHub] [incubator-hudi] bhasudha commented on issue #998: Incremental view not implemented yet, for merge-on-read datasets
bhasudha commented on issue #998: Incremental view not implemented yet, for merge-on-read datasets URL: https://github.com/apache/incubator-hudi/issues/998#issuecomment-596005967 closing this in favor of https://issues.apache.org/jira/browse/HUDI-58 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-hudi] bhasudha commented on issue #998: Incremental view not implemented yet, for merge-on-read datasets
bhasudha commented on issue #998: Incremental view not implemented yet, for merge-on-read datasets URL: https://github.com/apache/incubator-hudi/issues/998#issuecomment-550524198 @HariprasadAllaka1612 Looks like spark sql for incremental queries work on a Hive table. The Docker demo that I pasted also refers to a Hive table. For spark datasource this not supported natively. I ll create a tracking Jira issue for this and update docs. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-hudi] bhasudha commented on issue #998: Incremental view not implemented yet, for merge-on-read datasets
bhasudha commented on issue #998: Incremental view not implemented yet, for merge-on-read datasets URL: https://github.com/apache/incubator-hudi/issues/998#issuecomment-550480330 @HariprasadAllaka1612 I need to dig into this issue more. But I am quite sure you can incrementally query MOR datasets. Here is an example from the Docker demo page which does this for reference - https://hudi.apache.org/docker_demo.html#incremental-query-with-spark-sql This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services