Rui Fan created FLINK-33317:
-------------------------------
Summary: Add cleaning mechanism for StreamConfig#SERIALIZEDUDF
Key: FLINK-33317
URL: https://issues.apache.org/jira/browse/FLINK-33317
Project: Flink
Issue Type: Sub-task
Components: Runtime / Configuration
Affects Versions: 1.17.0, 1.18.0
Reporter: Rui Fan
Assignee: Rui Fan
See FLINK-33315 for details.
This Jira focus on avoid unnecessary memory usage, it can optimize the memory
cost of Replica_3 in FLINK-33315.
Solution:
* Define a threshold for cleaning mechanism of StreamConfig#SERIALIZEDUDF
* After getStreamOperatorFactory, the StreamConfig#SERIALIZEDUDF can be
cleaned if the value size is great than threshold
* If it still needed later, we can flush it to disk, and load it from disk if
needed(And clean it in memory immediately after using).
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
