aglinxinyuan opened a new issue, #4489: URL: https://github.com/apache/texera/issues/4489
### Task Summary Currently, state can be passed between operators in the network, but it is not materialized when execution crosses region boundaries. This makes it impossible to pass the state when operators are in different regions. This design adds state materialization as a general mechanism for passing state between regions. State is stored separately from normal result data, and uses a cross-language serialized format so both Python and Scala/Java can read it. The design is simple: - materialize state as a separate storage object alongside result storage - store one serialized state per row - use the same format on Python and Scala/Java sides - let downstream regions read back both data and state when needed This makes state passing across regions explicit and reusable for different features. ### Priority P2 – Medium ### Task Type - [x] Code Implementation - [ ] Documentation - [ ] Refactor / Cleanup - [ ] Testing / QA - [ ] DevOps / Deployment -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
