See the pom.xml file
https://github.com/apache/spark/blob/master/pom.xml#L3590
2.13.8 at the moment; IIRC there was some Scala issue that prevented
updating to 2.13.9. Search issues/PRs.
On Tue, Oct 11, 2022 at 6:11 PM Henrik Park wrote:
> scala 2.13.9 was released. do you know which spark
scala 2.13.9 was released. do you know which spark version would have it
built-in?
thanks
Sean Owen wrote:
I would imagine that Scala 2.12 support goes away, and Scala 3 support
is added, for maybe Spark 4.0, and maybe that happens in a year or so.
--
Simple Mail
https://simplemail.co.in/
For Spark, the issue is maintaining simultaneous support for multiple Scala
versions, which has historically been mutually incompatible across minor
versions.
Until Scala 2.12 support is reasonable to remove, it's hard to also support
Scala 3, as it would mean maintaining three versions of code.
I
No one knows for sure except Apache, but I’d learn Scala 2 if I were you. Even
if Spark one day migrates to Scala 3 (which is not given), it’ll take a while
for the industry to adjust. It even takes a while to move from Spark 2 to Spark
3 (Scala 2.11 to Scala 2.12). I don’t think your
Hello,
I was lucky and will be joining a project where Spark is being used in
conjunction with Python. Scala will not be used at all. Everything will
be Python. This means that I have free choice whether to start diving
into Scala 2 or Scala 3. For future Spark jobs knowledge of Scala will
