RE: Anyone knows how to build and spark on jdk9?

Thanks your suggestion, seems that scala 2.12.4 support jdk9 Scala 2.12.4 is now available. Our benchmarks show a further

Re: Anyone knows how to build and spark on jdk9?

It probably depends on the Scala version we use in Spark supporting Java 9 first. On Thu, Oct 26, 2017 at 7:22 PM Zhang, Liyun wrote: > Hi all: > > 1. I want to build spark on jdk9 and test it with Hadoop on jdk9 > env. I search for jiras related to JDK9. I only

Anyone knows how to build and spark on jdk9?

Hi all: 1. I want to build spark on jdk9 and test it with Hadoop on jdk9 env. I search for jiras related to JDK9. I only found SPARK-13278. This means now spark can build or run successfully on JDK9 ? Best Regards Kelly

Re: Spark-XML maintenance

Adding Hyukjin who has been maintaining it. The easiest is probably to leave comments in the repo. On Thu, Oct 26, 2017 at 9:44 AM Jörn Franke wrote: > I would address databricks with this issue - it is their repository > > > On 26. Oct 2017, at 18:43, comtef

Re: Kicking off the process around Spark 2.2.1

Yes! I can take on RM for 2.2.1. We are still working out what to do with temp files created by Hive and Java that cause the policy issue with CRAN and will report back shortly, hopefully. From: Sean Owen Sent: Wednesday, October 25, 2017

Re: Spark-XML maintenance

I would address databricks with this issue - it is their repository > On 26. Oct 2017, at 18:43, comtef wrote: > > I've used spark for a couple of years and I found a way to contribute to the > cause :). > I've found a blocker in Spark XML extension >

Spark-XML maintenance

I've used spark for a couple of years and I found a way to contribute to the cause :). I've found a blocker in Spark XML extension (https://github.com/databricks/spark-xml). I'd like to know if this is the right place to discuss issues about this extension? I've opened a PR to adress this problem

Re: Structured Stream equivalent of reduceByKey

- dev I think you should be able to write an Aggregator . You probably want to run in update mode if you are looking for it to output any group that has changed in the batch. On Wed, Oct 25,