[ https://issues.apache.org/jira/browse/DATAFU-169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eyal Allweil closed DATAFU-169. ------------------------------- > Support Spark 3.x > ----------------- > > Key: DATAFU-169 > URL: https://issues.apache.org/jira/browse/DATAFU-169 > Project: DataFu > Issue Type: Improvement > Reporter: Eyal Allweil > Assignee: Eyal Allweil > Priority: Major > Fix For: 2.0.0 > > Time Spent: 10m > Remaining Estimate: 0h > > This is our umbrella-JIRA-issue for covering the changes we'll need to make > to support Spark 3. > > There are some linked issues for tasks that need to be done to get this to > work. It doesn't look like there are that many actual code changes to our > actual production code. > > To begin with, let's aim to support Spark 3.0.x and 3.1.x and work our way to > newer versions. > > Here is the guide to doing this upgrade: > [https://spark.apache.org/docs/latest/sql-migration-guide.html#upgrading-from-spark-sql-24-to-30] -- This message was sent by Atlassian Jira (v8.20.10#820010)