[
https://issues.apache.org/jira/browse/DATAFU-169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eyal Allweil updated DATAFU-169:
--------------------------------
Description:
This is our umbrella-JIRA-issue for covering the changes we'll need to make to
support Spark 3.
There are some linked issues for tasks that need to be done to get this to
work. It doesn't look like there are that many actual code changes to our
actual production code.
To begin with, let's aim to support Spark 3.0.x and work our way to newer
versions.
Here is the guide to doing this upgrade:
[https://spark.apache.org/docs/latest/sql-migration-guide.html#upgrading-from-spark-sql-24-to-30]
was:
This is our umbrella-JIRA-issue for covering the changes we'll need to make to
support Spark 3.
Here is the guide to doing this upgrade:
https://spark.apache.org/docs/latest/sql-migration-guide.html#upgrading-from-spark-sql-24-to-30
> Support Spark 3.x
> -----------------
>
> Key: DATAFU-169
> URL: https://issues.apache.org/jira/browse/DATAFU-169
> Project: DataFu
> Issue Type: Improvement
> Reporter: Eyal Allweil
> Assignee: Eyal Allweil
> Priority: Major
> Fix For: 2.0.0
>
>
> This is our umbrella-JIRA-issue for covering the changes we'll need to make
> to support Spark 3.
>
> There are some linked issues for tasks that need to be done to get this to
> work. It doesn't look like there are that many actual code changes to our
> actual production code.
>
> To begin with, let's aim to support Spark 3.0.x and work our way to newer
> versions.
>
> Here is the guide to doing this upgrade:
> [https://spark.apache.org/docs/latest/sql-migration-guide.html#upgrading-from-spark-sql-24-to-30]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
