Re: Multiple streaming aggregations in structured streaming

Doing this generally is pretty hard. We will likely support algebraic aggregate eventually, but this is not currently slotted for 2.2. Instead I think we will add something like mapWithState that lets users compute arbitrary stateful things. What is your use case? On Wed, Nov 16, 2016 at 6:58

Re: [build system] massive jenkins infrastructure changes forthcoming

On Thu, Nov 17, 2016 at 4:52 PM, Reynold Xin wrote: > Thanks for the headsup, Shane. > no problem! i'm really looking forward to starting w/a much cleaner slate that what we have now. not only are we locked in a jenkins/plugin version dependency hell that keeps us from

Re: Failed to run spark jobs on mesos due to "hadoop" not found.

Hi, Add HADOOP_HOME=/path/to/hadoop/folder in /etc/default/mesos-slave in all mesos agents and restart mesos Regards, Meethu Mathew On Thu, Nov 10, 2016 at 4:57 PM, Yu Wei wrote: > Hi Guys, > > I failed to launch spark jobs on mesos. Actually I submitted the job to >

Re: issues with github pull request notification emails missing

I have seen the same issue from time to time where I couldn't see a person's alias in the popup. Happened yesterday for me with @joshrosen. No idea why. I was also missing emails for a while to spam, but it seemed like a Gmail problem. It said I had marked messages from about 6 different people