For Spark, the issue is maintaining simultaneous support for multiple Scala versions, which has historically been mutually incompatible across minor versions. Until Scala 2.12 support is reasonable to remove, it's hard to also support Scala 3, as it would mean maintaining three versions of code. I would imagine that Scala 2.12 support goes away, and Scala 3 support is added, for maybe Spark 4.0, and maybe that happens in a year or so.
For end users, I don't think there are big differences, so I don't think learning one or the other matters a lot. Scala 3 is a lot like 2.13. But I don't think you'll be able to write Scala 3 Spark apps anytime soon. On Tue, Oct 11, 2022 at 7:57 AM Никита Романов <nime...@mail.ru.invalid> wrote: > No one knows for sure except Apache, but I’d learn Scala 2 if I were you. > Even if Spark one day migrates to Scala 3 (which is not given), it’ll take > a while for the industry to adjust. It even takes a while to move from > Spark 2 to Spark 3 (Scala 2.11 to Scala 2.12). I don’t think your knowledge > of Scala 2 will be outdated any time soon. > > You can also compare it with Python 2 vs 3: although Python 3 dominates > these days (almost 15 years after the release!), Python 2 is still used. > > > Понедельник, 10 октября 2022, 10:24 +03:00 от Oliver Plohmann < > oli...@objectscape.org <http:///compose?To=oli...@objectscape.org>>: > > Hello, > > I was lucky and will be joining a project where Spark is being used in > conjunction with Python. Scala will not be used at all. Everything will > be Python. This means that I have free choice whether to start diving > into Scala 2 or Scala 3. For future Spark jobs knowledge of Scala will > be very precious (the job ads here for Spark always mention Java, Python > and Scala. > > I was always interested in Scala and because it is a plus when applying > for Spark jobs I will start learning and develop some spare time project > with it. Question is now whether first to learn Scala 2 or start right > away with learning Scala 3. That also boils down to the question whether > Spark will ever be migrated to Scala 3. I have way too little > understanding of Spark and Scala to be able to make some reasonable > guess here. > > So that's why I'm asking here: Does anyone have some idea whether Spark > will ever be migrated toScala 3 or have some idea how long it will take > till any migration work might be started? > > Thank you. > > > --------------------------------------------------------------------- > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > > > > > > > ------------------------------ > > -- > Никита Романов > Отправлено из Почты Mail.ru <https://trk.mail.ru/c/zzm979> >
