[
https://issues.apache.org/jira/browse/MRQL-79?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14994467#comment-14994467
]
Hudson commented on MRQL-79:
----------------------------
SUCCESS: Integrated in mrql-master-snapshot #22 (See
[https://builds.apache.org/job/mrql-master-snapshot/22/])
[MRQL-79] Add support for incremental query processing (fegaras:
[https://git-wip-us.apache.org/repos/asf?p=incubator-mrql.git&a=commit&h=1cf73e2c8aa332a536548221aacc878e93174189])
* queries/RMAT.mrql
* core/src/main/java/org/apache/mrql/TypeInference.gen
* mapreduce/src/main/java/org/apache/mrql/GroupByJoinPlan.java
* core/src/main/java/org/apache/mrql/mrql.cgen
* queries/incremental-kmeans.mrql
* core/src/main/java/org/apache/mrql/Materialization.gen
* pom.xml
* queries/streaming2.mrql
* mapreduce/src/main/java/org/apache/mrql/MapReduceOperation.java
* conf/mrql-env.sh
* core/src/main/java/org/apache/mrql/Printer.gen
* core/src/main/java/org/apache/mrql/TopLevel.gen
* core/src/main/java/org/apache/mrql/Plan.java
* core/src/main/java/org/apache/mrql/mrql.lex
* core/src/main/java/org/apache/mrql/Evaluator.java
* core/src/main/java/org/apache/mrql/Translator.gen
* core/src/main/java/org/apache/mrql/Streaming.gen
* core/src/main/java/org/apache/mrql/SystemFunctions.java
* core/src/main/java/org/apache/mrql/MapReduceAlgebra.java
* core/src/main/java/org/apache/mrql/Config.java
* core/src/main/java/org/apache/mrql/Environment.java
* flink/src/main/java/org/apache/mrql/FlinkEvaluator.gen
* queries/incremental-pagerank.mrql
* flink/src/main/java/org/apache/mrql/FlinkStreaming.gen
* core/src/main/java/org/apache/mrql/PlanGeneration.gen
* core/src/main/java/org/apache/mrql/Compiler.gen
* spark/src/main/java/org/apache/mrql/SparkEvaluator.gen
* spark/src/main/java/org/apache/mrql/SparkStreaming.gen
* queries/incremental-streaming.mrql
* core/src/main/java/org/apache/mrql/Interpreter.gen
> Add support for incremental query processing
> --------------------------------------------
>
> Key: MRQL-79
> URL: https://issues.apache.org/jira/browse/MRQL-79
> Project: MRQL
> Issue Type: New Feature
> Components: Run-Time/Spark, Streaming
> Affects Versions: 0.9.6
> Reporter: Leonidas Fegaras
> Assignee: Leonidas Fegaras
>
> This is a new feature for MRQL streaming: its task is to convert any
> stream-based MRQL query to an incremental query that merges the previous
> query results with the results of applying the query to the new data batches
> only. For example, it will be able to convert the MRQL PageRank query to an
> incremental PageRank query automatically. The basic idea was presented at
> ApacheCon'15 (page 28 in http://lambda.uta.edu/mrql-apachecon15.pdf ) as a
> future plan for MRQL. It will work on Spark Streaming mode for now, but later
> it will support Flink Streaming too.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
