When will multiple aggregations be supported in Structured Streaming?

2016-12-15 Thread ljwagerfield
The current version of Spark (2.0.2) only supports one aggregation per
structured stream (and will throw an exception if multiple aggregations are
applied).

Roughly when will Spark support multiple aggregations?



--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/When-will-multiple-aggregations-be-supported-in-Structured-Streaming-tp28219.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org



Re: When will Structured Streaming support stream-to-stream joins?

2016-12-09 Thread ljwagerfield
Michael Armbrust's reply:

I would guess Spark 2.3, but maybe sooner maybe later depending on demand. 
I created https://issues.apache.org/jira/browse/SPARK-18791 so people can
describe their requirements / stay informed.

---

Lawrence's reply:

Please vote on the issue, people! Would be awesome to have this in :D



--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/When-will-Structured-Streaming-support-stream-to-stream-joins-tp28185p28189.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org



When will Structured Streaming support stream-to-stream joins?

2016-12-08 Thread ljwagerfield
Hi there,

Structured Streaming currently only supports stream-to-batch joins. 

Is there an ETA for stream-to-stream joins?

Kindest regards (and keep up the awesome work!),
Lawrence

(p.s. I've traversed the JIRA roadmaps but couldn't see anything)



--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/When-will-Structured-Streaming-support-stream-to-stream-joins-tp28185.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org