When will multiple aggregations be supported in Structured Streaming?

2016-12-15 Thread ljwagerfield
The current version of Spark (2.0.2) only supports one aggregation per structured stream (and will throw an exception if multiple aggregations are applied). Roughly when will Spark support multiple aggregations? -- View this message in context:

Re: When will Structured Streaming support stream-to-stream joins?

2016-12-09 Thread ljwagerfield
Michael Armbrust's reply: I would guess Spark 2.3, but maybe sooner maybe later depending on demand.  I created https://issues.apache.org/jira/browse/SPARK-18791 so people can describe their requirements / stay informed. --- Lawrence's reply: Please vote on the issue, people! Would be awesome

When will Structured Streaming support stream-to-stream joins?

2016-12-08 Thread ljwagerfield
Hi there, Structured Streaming currently only supports stream-to-batch joins. Is there an ETA for stream-to-stream joins? Kindest regards (and keep up the awesome work!), Lawrence (p.s. I've traversed the JIRA roadmaps but couldn't see anything) -- View this message in context: