FYI, Apache Spark 0.9.0 is now available, and it's just a two-line diff to
get MRQL to build using that version:
diff --git i/Spark/pom.xml w/Spark/pom.xml
index 06882a09a5..8a8efa415d 100644
--- i/Spark/pom.xml
+++ w/Spark/pom.xml
@@ -45,7 +45,7 @@
</dependency>
<dependency>
<groupId>org.apache.spark</groupId>
- <artifactId>spark-core_2.9.3</artifactId>
+ <artifactId>spark-core_2.10</artifactId>
<version>${spark.version}</version>
</dependency>
</dependencies>
diff --git i/pom.xml w/pom.xml
index 20b8de1df9..ef41abd8d7 100644
--- i/pom.xml
+++ w/pom.xml
@@ -46,7 +46,7 @@
<properties>
<hadoop.version>1.0.3</hadoop.version>
<hama.version>0.6.3</hama.version>
- <spark.version>0.8.1-incubating</spark.version>
+ <spark.version>0.9.0-incubating</spark.version>
</properties>
On Sun, Jan 26, 2014 at 4:12 PM, Leonidas Fegaras (JIRA) <[email protected]>wrote:
>
> [
> https://issues.apache.org/jira/browse/MRQL-26?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel]
>
> Leonidas Fegaras resolved MRQL-26.
> ----------------------------------
>
> Resolution: Fixed
>
> MRQL-26.patch applied
>
> > Support for Spark 0.8.1
> > -----------------------
> >
> > Key: MRQL-26
> > URL: https://issues.apache.org/jira/browse/MRQL-26
> > Project: MRQL
> > Issue Type: Improvement
> > Components: Run-Time/Spark
> > Reporter: Leonidas Fegaras
> > Assignee: Leonidas Fegaras
> > Priority: Minor
> > Attachments: MRQL-26.patch
> >
> >
> > Changed the MRQL run-time engine to support Spark 0.8.1. (The
> TaskContext constructor in Spark 0.8.1 has changed.) This is incompatible
> with Spark 0.8.0. I am attaching MRQL-26.patch for approval.
>
>
>
> --
> This message was sent by Atlassian JIRA
> (v6.1.5#6160)
>