Re: Make Scala 2.12 as default Scala version in Spark 3.0

be e-mail: dev-unsubscr...@spark.apache.org > > > > > -- > Marcelo > > - > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org > > -- Justin Miller Senior Data Engineer *GoSpotCheck* Direct: 720-517-3979 <+17205173979> Email: jus...@gospotcheck.com September 24-26, 2018 Denver, Colorado Learn More and Register <https://www.gospotcheck.com/field-days/>

Re: [VOTE] Spark 2.3.1 (RC1)

Did SPARK-24067 not make it in? I don’t see it in https://s.apache.org/Q3Uo . Thanks, Justin > On May 15, 2018, at 3:00 PM, Marcelo Vanzin wrote: > > Please vote on releasing the following candidate as Apache Spark version > 2.3.1. > > The

Re: [VOTE] Spark 2.3.0 (RC4)

Ah gotcha thanks for letting me know. We’ve been using the patch in production for a couple weeks now and it’s been working great. If anyone else runs into the issue (non-compacted topics have “gaps” in offsets) feel free to have them e-mail me and I can try to help them get going with patching

Re: [VOTE] Spark 2.3.0 (RC4)

Greetings, I would also like to ask if the following ticket could make it in to 2.3.0. I’m currently testing the code in production as we were running into issues on non-compacted topics (very occasionally) running into non-consecutive offsets. I imagine other people will encounter similar

Re: Spark 3

Would that mean supporting both 2.12 and 2.11? Could be a while before some of our libraries are off of 2.11. Thanks, Justin > On Jan 19, 2018, at 10:53 AM, Koert Kuipers wrote: > > i was expecting to be able to move to scala 2.12 sometime this year > > if this cannot be

Re: Timeline for Spark 2.3

That sounds fine to me. I’m hoping that this ticket can make it into Spark 2.3: https://issues.apache.org/jira/browse/SPARK-18016 It’s causing some pretty considerable problems when we alter the columns to be nullable, but we are OK for now