Calling attention to the question of Scala 2.12 again for moment. I'd like to make a modest step towards support. Have a look again, if you would, at SPARK-14280:
https://github.com/apache/spark/pull/18645 This is a lot of the change for 2.12 that doesn't break 2.11, and really doesn't add any complexity. It's mostly dependency updates and clarifying some code. Other items like dealing with Kafka 0.8 support, the 2.12 REPL, etc, are not here. So, this still doesn't result in a working 2.12 build but it's most of the miscellany that will be required. I'd like to merge it but wanted to flag it for feedback as it's not trivial.