[
https://issues.apache.org/jira/browse/SPARK-24630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16566782#comment-16566782
]
Jackey Lee edited comment on SPARK-24630 at 8/2/18 1:47 PM:
------------------------------------------------------------
SQLStreaming is actually based on StructStreaming, thus, most of the syntax
that are supported by StructStreaming can also be supported in SQLStreaming.
Similarly, those queries, that are not supported in StructStreaming, are also
not supported in SQLStreaming.
Which means these queries are not supported in SQLStreaming:
1. StructStreaming supports and SQLStreaming not supports
* Foreach Sink
* mapGroupsWithState
* flatMapGroupsWithState
2. StructStreaming not supports
* Multiple streaming aggregations
* LIMIT/DISTINCT/SORT
* Stream join Hive
* others that are not supported in StructStreaming
was (Author: jackey lee):
SQLStreaming is actually based on StructStreaming, thus, most of the syntax
that are supported by StructStreaming can also be supported in
SQLStreaming. Similarly, those queries, that are not supported in
StructStreaming, are also not supported in SQLStreaming.
Which means these queries are not supported in SQLStreaming:
> SPIP: Support SQLStreaming in Spark
> -----------------------------------
>
> Key: SPARK-24630
> URL: https://issues.apache.org/jira/browse/SPARK-24630
> Project: Spark
> Issue Type: Improvement
> Components: Structured Streaming
> Affects Versions: 2.2.0, 2.2.1
> Reporter: Jackey Lee
> Priority: Minor
> Labels: SQLStreaming
> Attachments: SQLStreaming SPIP.pdf
>
>
> At present, KafkaSQL, Flink SQL(which is actually based on Calcite),
> SQLStream, StormSQL all provide a stream type SQL interface, with which users
> with little knowledge about streaming, can easily develop a flow system
> processing model. In Spark, we can also support SQL API based on
> StructStreamig.
> To support for SQL Streaming, there are two key points:
> 1, Analysis should be able to parse streaming type SQL.
> 2, Analyzer should be able to map metadata information to the corresponding
> Relation.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
