Time for 2.2.2 release

2018-06-06 Thread Tom Graves
Hello all, I think its time for another 2.2 release.  I took a look at Jira and I don't see anything explicitly targeted for 2.2.2 that is not yet complete. So I'd like to propose to release 2.2.2 soon. If there are important fixes that should go into the release, please let those be known (by re

Review notification bot

2018-06-06 Thread Holden Karau
Hi friends, Was chatting with some folks at the summit and I was wondering how people would feel about adding a review bot to ping folks. We already have the review dashboard but I was thinking we could ping folks who were the original authors of the code being changed whom might not be in the hab

Re: Review notification bot

2018-06-06 Thread Sean Owen
Certainly I will frequently dig through 'git blame' to figure out who might be the right reviewer. Maybe that's automatable -- ping the person who last touched the most lines touched by the PR? There might be some false positives there. And I suppose the downside is being pinged forever for some ch

Re: Scala 2.12 support

2018-06-06 Thread Holden Karau
Just chatted with Dean @ the summit and it sounds like from Adriaan there is a fix in 2.13 for the API change issue that could be back ported to 2.12 so how about we try and get this ball rolling? It sounds like it would also need a closure cleaner change, which could be backwards compatible but s

FINAL REMINDER: Apache EU Roadshow 2018 in Berlin next week!

2018-06-06 Thread sharan
Hello Apache Supporters and Enthusiasts This is a final reminder that our Apache EU Roadshow will be held in Berlin next week on 13th and 14th June 2018. We will have 28 different sessions running over 2 days that cover some great topics. So if you are interested in Microservices, Internet of

Re: Scala 2.12 support

2018-06-06 Thread DW @ Gmail
I feel good ;) I know there is a lot of interest among Spark users. Since the compiler change won’t force a Spark API change, can we target Spark 2.4? Sent from my rotary phone. > On Jun 6, 2018, at 11:33 AM, Holden Karau wrote: > > Just chatted with Dean @ the summit and it sounds like fro

Re: Scala 2.12 support

2018-06-06 Thread Sean Owen
If it means no change to 2.11 support, seems OK to me for Spark 2.4.0. The 2.12 support is separate and has never been mutually compatible with 2.11 builds anyway. (I also hope, suspect that the changes are minimal; tests are already almost entirely passing with no change to the closure cleaner whe

Re: Review notification bot

2018-06-06 Thread Holden Karau
So there are a few bots along this line in OSS. If no one objects I’ll take a look and find one which matches our use case and try it out. On Wed, Jun 6, 2018 at 10:33 AM Sean Owen wrote: > Certainly I will frequently dig through 'git blame' to figure out who > might be the right reviewer. Maybe

Hive Bucketing Support

2018-06-06 Thread Chris Martin
Hi All, first off apologies if this is not the correct place to ask this! I've been following SPARK-19256 (Hive Bucketing Support) with interest for some time now as we do a relatively large amount of our data processing in Spark but use Hive f

Re: Revisiting Online serving of Spark models?

2018-06-06 Thread Maximiliano Felice
Hi! Do we meet at the entrance? See you El mar., 5 de jun. de 2018 3:07 PM, Nick Pentreath escribió: > I will aim to join up at 4pm tomorrow (Wed) too. Look forward to it. > > On Sun, 3 Jun 2018 at 00:24 Holden Karau wrote: > >> On Sat, Jun 2, 2018 at 8:39 PM, Maximiliano Felice < >> maximili

Re: Revisiting Online serving of Spark models?

2018-06-06 Thread Holden Karau
We’re by the registration sign going to start walking over at 4:05 On Wed, Jun 6, 2018 at 2:43 PM Maximiliano Felice < maximilianofel...@gmail.com> wrote: > Hi! > > Do we meet at the entrance? > > See you > > > El mar., 5 de jun. de 2018 3:07 PM, Nick Pentreath < > nick.pentre...@gmail.com> escri

Re: Hive Bucketing Support

2018-06-06 Thread Abhijeet Kumar
I would ask my queries here . Thanks, Abhijeet Kumar > On 07-Jun-2018, at 1:03 AM, Chris Martin wrote: > > Hi All, > > > first off apologies if this is not the correct place to ask this! > > I've been following SPARK-19256 >

Re: [build system] meet your build engineer @ spark ai summit SF 2018

2018-06-06 Thread Hyukjin Kwon
I regret that I couldn't make it to Spark Summit :(. 2018년 6월 6일 (수) 오전 3:25, Holden Karau 님이 작성: > That's awesome! > > On Tue, Jun 5, 2018 at 12:23 PM, shane knapp wrote: > >> just a reminder to come meet your build engineer! >> >> we'll also be having a couple of demos of current projects in t