Jungtaek Lim created SPARK-54684:
------------------------------------
Summary: Introduce stream-stream join operations microbenchmark
Key: SPARK-54684
URL: https://issues.apache.org/jira/browse/SPARK-54684
Project: Spark
Issue Type: Task
Components: Structured Streaming
Affects Versions: 4.2.0
Reporter: Jungtaek Lim
As of now, we are providing three state format versions for stream-stream join,
and the version 2 and 3 are valid one. Ideally we would be better to have e2e
benchmarks, but understanding the performance for state store operations under
stream-stream join would be very useful to improve it further.
To achieve this, we propose to introduce a new microbenchmark for this.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
