When will multiple aggregations be supported in Structured Streaming?
The current version of Spark (2.0.2) only supports one aggregation per structured stream (and will throw an exception if multiple aggregations are applied). Roughly when will Spark support multiple aggregations? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/When-will-multiple-aggregations-be-supported-in-Structured-Streaming-tp28219.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe e-mail: user-unsubscr...@spark.apache.org
Re: When will Structured Streaming support stream-to-stream joins?
Michael Armbrust's reply: I would guess Spark 2.3, but maybe sooner maybe later depending on demand. I created https://issues.apache.org/jira/browse/SPARK-18791 so people can describe their requirements / stay informed. --- Lawrence's reply: Please vote on the issue, people! Would be awesome to have this in :D -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/When-will-Structured-Streaming-support-stream-to-stream-joins-tp28185p28189.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe e-mail: user-unsubscr...@spark.apache.org
When will Structured Streaming support stream-to-stream joins?
Hi there, Structured Streaming currently only supports stream-to-batch joins. Is there an ETA for stream-to-stream joins? Kindest regards (and keep up the awesome work!), Lawrence (p.s. I've traversed the JIRA roadmaps but couldn't see anything) -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/When-will-Structured-Streaming-support-stream-to-stream-joins-tp28185.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe e-mail: user-unsubscr...@spark.apache.org