Thanks Mark,
I will post your patch on JIRA.
Leonidas
On 02/02/2014 04:30 PM, Mark Hamstra wrote:
FYI, Apache Spark 0.9.0 is now available, and it's just a two-line diff to
get MRQL to build using that version:
diff --git i/Spark/pom.xml w/Spark/pom.xml
index 06882a09a5..8a8efa415d 100644
--- i/Spark/pom.xml
+++ w/Spark/pom.xml
@@ -45,7 +45,7 @@
</dependency>
<dependency>
<groupId>org.apache.spark</groupId>
- <artifactId>spark-core_2.9.3</artifactId>
+ <artifactId>spark-core_2.10</artifactId>
<version>${spark.version}</version>
</dependency>
</dependencies>
diff --git i/pom.xml w/pom.xml
index 20b8de1df9..ef41abd8d7 100644
--- i/pom.xml
+++ w/pom.xml
@@ -46,7 +46,7 @@
<properties>
<hadoop.version>1.0.3</hadoop.version>
<hama.version>0.6.3</hama.version>
- <spark.version>0.8.1-incubating</spark.version>
+ <spark.version>0.9.0-incubating</spark.version>
</properties>
On Sun, Jan 26, 2014 at 4:12 PM, Leonidas Fegaras (JIRA) <[email protected]>wrote:
[
https://issues.apache.org/jira/browse/MRQL-26?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel]
Leonidas Fegaras resolved MRQL-26.
----------------------------------
Resolution: Fixed
MRQL-26.patch applied
Support for Spark 0.8.1
-----------------------
Key: MRQL-26
URL: https://issues.apache.org/jira/browse/MRQL-26
Project: MRQL
Issue Type: Improvement
Components: Run-Time/Spark
Reporter: Leonidas Fegaras
Assignee: Leonidas Fegaras
Priority: Minor
Attachments: MRQL-26.patch
Changed the MRQL run-time engine to support Spark 0.8.1. (The
TaskContext constructor in Spark 0.8.1 has changed.) This is incompatible
with Spark 0.8.0. I am attaching MRQL-26.patch for approval.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
.
