minni31 opened a new pull request, #11859: URL: https://github.com/apache/gluten/pull/11859
## Summary Fixes streaming-related test suite failures for Spark 4.0 and 4.1 by preserving plan node tags when `EnsureLocalSortRequirements` wraps a child with `SortExec`. ## Problem When `EnsureLocalSortRequirements` creates a new `SortExec` to satisfy required child ordering, the new node was missing tags from the original child plan. This caused failures in streaming test suites because stateful operators (e.g., `StateStoreWriter`, `TransformWithState`) rely on tags to propagate streaming execution metadata such as `isStatefulOperatorStreamingRestore`. Affected test suites include: - `FlatMapGroupsWithStateSuite` - `TransformWithListStateSuite` / `TransformWithListStateTTLSuite` - `TransformWithMapStateTTLSuite` - `TransformWithStateChainingSuite` / `TransformWithStateInitialStateSuite` - `TransformWithValueStateTTLSuite` - `OperatorStateMetadataSuite` - `StateDataSource` read suites - `RocksDBStateStoreCheckpointFormatV2Suite` ## Fix One-line fix: call `newChild.copyTagsFrom(originalChild)` after creating the `SortExec` to preserve tags from the original child plan. ## Testing Streaming test suites that were previously failing now pass with this fix. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
