Nicholas Chew created SPARK-55987:
-------------------------------------
Summary: Fix time window join in stream-stream join state format V4
Key: SPARK-55987
URL: https://issues.apache.org/jira/browse/SPARK-55987
Project: Spark
Issue Type: Bug
Components: Structured Streaming
Affects Versions: 4.2.0
Reporter: Nicholas Chew
Stream-stream join V4 state manager was deducing the event time column ordinal
in join keys independently per side which didn't work for window structs.
Instead, use findJoinKeyOrdinalForWatermark from
StreamingSymmetricHashJoinHelper which correctly resolves this for both sides.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
