Spark 2.2 Code-freeze - 3/20

2017-03-15 Thread Michael Armbrust
Hey Everyone, Just a quick announcement that I'm planning to cut the branch for Spark 2.2 this coming Monday (3/20). Please try and get things merged before then and also please begin retargeting of any issues that you don't think will make the release. Michael

Re: Should we consider a Spark 2.1.1 release?

2017-03-15 Thread Michael Armbrust
Hey Holden, Thanks for bringing this up! I think we usually cut patch releases when there are enough fixes to justify it. Sometimes just a few weeks after the release. I guess if we are at 3 months Spark 2.1.0 was a pretty good release :) That said, it is probably time. I was about to start

Re: Question on Spark's graph libraries roadmap

2017-03-15 Thread Joseph Bradley
I'll try to answer some questions which I do not see answered above. > GraphFrame is just a Graph Analytics/Query Engine, not a Graph Engine which GraphX used to be. GraphFrames supports all of the algorithms which GraphX supports. We've also taken first steps towards providing primitives for