[
https://issues.apache.org/jira/browse/MRQL-90?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15720026#comment-15720026
]
Hudson commented on MRQL-90:
----------------------------
ABORTED: Integrated in Jenkins build mrql-master-snapshot #45 (See
[https://builds.apache.org/job/mrql-master-snapshot/45/])
[MRQL-90] Add support for Storm streaming (fegaras:
[https://git-wip-us.apache.org/repos/asf?p=incubator-mrql.git&a=commit&h=3158b9083abca53a4212a51b9db80421e480cf49])
* (edit) core/src/main/java/org/apache/mrql/Main.java
* (add) storm/src/main/java/org/apache/mrql/utils/PrintUtil.java
* (add) storm/src/main/java/org/apache/mrql/StormStreaming.gen
* (add) storm/src/main/java/org/apache/mrql/StormEvaluator.gen
* (edit) core/src/main/java/org/apache/mrql/Plan.java
* (edit) core/src/test/java/org/apache/mrql/QueryTest.java
* (add) storm/src/main/java/org/apache/mrql/SData.java
* (edit) core/src/main/java/org/apache/mrql/Config.java
* (add) bin/mrql.storm
* (add) storm/src/main/java/org/apache/mrql/StormMRQLFileInputFormat.java
* (add) storm/src/main/java/org/apache/mrql/StormBinaryInputFormat.java
* (add) storm/src/main/java/org/apache/mrql/HDFSFileInputStream.java
* (add) storm/src/main/java/org/apache/mrql/StormParsedInputFormat.java
* (add) storm/src/test/java/org/apache/mrql/StormEvaluatorLocalModeTest.java
* (add) storm/src/test/java/org/apache/mrql/StormQueryLocalModeTest.java
* (edit) conf/mrql-env.sh
* (add) storm/pom.xml
* (add) queries/groupby_stream_storm.mrql
* (add) storm/src/main/java/org/apache/mrql/StormFileInputStream.java
* (edit) pom.xml
* (add) storm/src/main/java/org/apache/mrql/StreamDataSource.java
* (add) storm/src/main/java/org/apache/mrql/MR_stream.java
* (add) queries/data/customers.tbl
> Add support for Storm streaming
> -------------------------------
>
> Key: MRQL-90
> URL: https://issues.apache.org/jira/browse/MRQL-90
> Project: MRQL
> Issue Type: New Feature
> Components: Streaming
> Affects Versions: 0.9.8
> Reporter: Leonidas Fegaras
> Assignee: Leonidas Fegaras
>
> This task is assigned to Achyut Paudel achyut.paud...@mavs.uta.edu as part of
> his MS thesis at UTA. This extension will allow MRQL queries to run on Apache
> Storm DSPE (distributed stream processing engine). The stream unit is a Tuple
> with just one component: a Bag<MRData>, which is a buffer of MRData used for
> batch streaming. Each MRQL physical operator will correspond to 1-3 Storm
> bolts, while a source operator will correspond to a spout. For example, the
> MapReduce(m,r,X) operation will consist of 2 bolts: a bolt with a map
> function m (a Bolt subclass with an attribute m) that applies m to the input
> data, and another similar bolt with the reduce function r. These two bolts
> will be connected in the Storm topology with a Storm group-by operation. The
> query evaluator will first generate a Storm topology from a physical plan and
> then will use the Storm evaluator to evaluate the topology. The only new
> components needed for these extensions are: 1) Bolt and Spout subclasses to
> capture MRQL operators 2) a Storm topology generator from MRQL plans.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
