[
https://issues.apache.org/jira/browse/DATAFU-151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018876#comment-17018876
]
Eyal Allweil commented on DATAFU-151:
-------------------------------------
I was able to check that our pure Scala code runs well on a cluster with Spark
2.3.0 despite being built with Spark 2.4.3. But I didn't get a chance to check
the Python-Scala compatibility.
> datafu-spark release preparation
> --------------------------------
>
> Key: DATAFU-151
> URL: https://issues.apache.org/jira/browse/DATAFU-151
> Project: DataFu
> Issue Type: Task
> Reporter: Matthew Hayes
> Assignee: Matthew Hayes
> Priority: Major
> Fix For: 1.6.0
>
> Attachments: DATAFU-151.patch
>
>
> There are some updates we need to make to the build scripts to support
> releasing datafu-spark. For example, only the major and minor version of
> Spark (e.g. 2.4, not 2.4.4) should be included in the package name.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
