Boyang Jerry Peng created SPARK-54699:
-----------------------------------------
Summary: Adding RTM support for stateful queries and Pyspark
Key: SPARK-54699
URL: https://issues.apache.org/jira/browse/SPARK-54699
Project: Spark
Issue Type: Epic
Components: Structured Streaming
Affects Versions: 4.2.0
Reporter: Boyang Jerry Peng
Real-time mode for Apache Spark Structured Streaming is a new execution model
designed to significantly lower end-to-end data processing latency to the order
of 100 milliseconds.
More details can be found in the SPIP
[https://docs.google.com/document/d/1CvJvtlTGP6TwQIT4kW6GFT1JbdziAYOBvt60ybb7Dw8/edit?usp=sharing]
SPIP approved by the community:
[https://lists.apache.org/thread/k93gj0ko54kcslzkjwp95nqvjnkwcb63]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]