[
https://issues.apache.org/jira/browse/SPARK-34507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17299160#comment-17299160
]
Sean R. Owen commented on SPARK-34507:
--------------------------------------
I opened https://github.com/apache/spark/pull/31801 with a possible fix. This
manually sets scala.version when changing the build for cross-building against
other Scala versions, just like scala.binary.version already is.
As far as I can tell it's just always been wrong. Why didn't it turn up earlier?
Well, it only affects the 'alternate' build (e.g. 2.12 when 2.11 was the
default, and 2.13 now that 2.12 is). Maybe that's used less.
I also imagine that, because everything else is right and Scala dependencies
pull in (here) 2.13 versions, that dependency resolution ends up replacing the
incorrect older version of Scala library dependencies with some 2.13 version
anyway, so it kind of works out? Not sure.
> Spark artefacts built against Scala 2.13 incorrectly depend on Scala 2.12
> -------------------------------------------------------------------------
>
> Key: SPARK-34507
> URL: https://issues.apache.org/jira/browse/SPARK-34507
> Project: Spark
> Issue Type: Sub-task
> Components: Build
> Affects Versions: 3.2.0
> Reporter: Guillaume Martres
> Priority: Major
>
> Snapshots of Spark 3.2 built against Scala 2.13 are available at
> [https://repository.apache.org/content/repositories/snapshots/org/apache/spark/,]
> but they seem to depend on Scala 2.12. Specifically if I look atÂ
> [https://repository.apache.org/content/repositories/snapshots/org/apache/spark/spark-parent_2.13/3.2.0-SNAPSHOT/spark-parent_2.13-3.2.0-20210223.010629-29.pom]
> I see:
> {code:java}
> <scala.version>2.12.10</scala.version>
> <scala.binary.version>2.13</scala.binary.version{code}
> It looks like
> [https://github.com/apache/spark/blob/8f994cbb4a18558c2e81516ef1e339d9c8fa0d41/dev/change-scala-version.sh#L65]
> needs to be updated to also change the `scala.version` and not just the
> `scala.binary.version`.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
