Jungtaek Lim created SPARK-55973:
------------------------------------
Summary: Optimization around state in stream-stream join with
LeftSemi join type
Key: SPARK-55973
URL: https://issues.apache.org/jira/browse/SPARK-55973
Project: Spark
Issue Type: Improvement
Components: Structured Streaming
Affects Versions: 4.2.0
Reporter: Jungtaek Lim
We figured out there are still a couple paths of potential optimizations which
could either bypass buffering rows or evict the state rows much earlier than
now.
This ticket tracks the effort to introduce the optimizations.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
