[
https://issues.apache.org/jira/browse/SPARK-34507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17298999#comment-17298999
]
Sean R. Owen commented on SPARK-34507:
--------------------------------------
Ah, right we are publishing 2.13 snapshots now. Yeah the POM looks wrong. The
-Pscala-2.13 profile appears to be enabled correctly in the script that
publishes that, which should make the effective POM contain 2.13 dependencies.
scala.binary.version is updated, but scala.version is not. That makes me think
that the 'change version' script does its part, but not the profile activation,
when it comes to defining what the final effective POM is.
I'm now even more puzzled because look at:
https://search.maven.org/artifact/org.apache.spark/spark-parent_2.12/2.4.5/pom
In this release, which also has 2.11 vs 2.12 versions, the 2.12 version has the
same issue. I can't figure out whether a) that actually should work for some
reason or b) that actually doesn't work!
So yes I think that's a real issue that makes it pull in the wrong version of
Scala. I don't know how to fix it immediately but will try to look into why the
profile doesn't affect the final POM as intended.
> Spark artefacts built against Scala 2.13 incorrectly depend on Scala 2.12
> -------------------------------------------------------------------------
>
> Key: SPARK-34507
> URL: https://issues.apache.org/jira/browse/SPARK-34507
> Project: Spark
> Issue Type: Sub-task
> Components: Build
> Affects Versions: 3.2.0
> Reporter: Guillaume Martres
> Priority: Major
>
> Snapshots of Spark 3.2 built against Scala 2.13 are available at
> [https://repository.apache.org/content/repositories/snapshots/org/apache/spark/,]
> but they seem to depend on Scala 2.12. Specifically if I look atÂ
> [https://repository.apache.org/content/repositories/snapshots/org/apache/spark/spark-parent_2.13/3.2.0-SNAPSHOT/spark-parent_2.13-3.2.0-20210223.010629-29.pom]
> I see:
> {code:java}
> <scala.version>2.12.10</scala.version>
> <scala.binary.version>2.13</scala.binary.version{code}
> It looks like
> [https://github.com/apache/spark/blob/8f994cbb4a18558c2e81516ef1e339d9c8fa0d41/dev/change-scala-version.sh#L65]
> needs to be updated to also change the `scala.version` and not just the
> `scala.binary.version`.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
