[
https://issues.apache.org/jira/browse/SPARK-34507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17299003#comment-17299003
]
Guillaume Martres commented on SPARK-34507:
-------------------------------------------
> In this release, which also has 2.11 vs 2.12 versions, the 2.12 version has
> the same issue. I can't figure out whether a) that actually should work for
> some reason or b) that actually doesn't work!
I think it's always been wrong but sbt has some logic to align the version of
the scala-library/reflect/compiler dependencies which can mask the problem in
most situations (see
https://github.com/sbt/librarymanagement/blob/develop/ivy/src/main/scala/sbt/internal/librarymanagement/IvyScalaUtil.scala),
but this logic doesn't kick in when using sbt-dotty as
[https://github.com/vincenzobaz/spark-scala3] does. I don't know what happens
in other build tools.
> Spark artefacts built against Scala 2.13 incorrectly depend on Scala 2.12
> -------------------------------------------------------------------------
>
> Key: SPARK-34507
> URL: https://issues.apache.org/jira/browse/SPARK-34507
> Project: Spark
> Issue Type: Sub-task
> Components: Build
> Affects Versions: 3.2.0
> Reporter: Guillaume Martres
> Priority: Major
>
> Snapshots of Spark 3.2 built against Scala 2.13 are available at
> [https://repository.apache.org/content/repositories/snapshots/org/apache/spark/,]
> but they seem to depend on Scala 2.12. Specifically if I look atÂ
> [https://repository.apache.org/content/repositories/snapshots/org/apache/spark/spark-parent_2.13/3.2.0-SNAPSHOT/spark-parent_2.13-3.2.0-20210223.010629-29.pom]
> I see:
> {code:java}
> <scala.version>2.12.10</scala.version>
> <scala.binary.version>2.13</scala.binary.version{code}
> It looks like
> [https://github.com/apache/spark/blob/8f994cbb4a18558c2e81516ef1e339d9c8fa0d41/dev/change-scala-version.sh#L65]
> needs to be updated to also change the `scala.version` and not just the
> `scala.binary.version`.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
