AnishMahto opened a new pull request, #58915: URL: https://github.com/apache/spark/pull/58915
### What changes were proposed in this pull request? Default SCD1 reconciliation accepts or rejects an event wholesale, so all columns share one row-level version. Ignore-null permits different events to author different leaves, requiring fundamentally different deduplication and tombstone reconciliation. Refactor `Scd1BatchProcessor` to delegate to a reconciliation strategy and move existing behavior into the default `Scd1RowLevelReconciliation`. This preserves current behavior while establishing the boundary for future leaf-level reconciliation. ### Why are the changes needed? Preparing `Scd1BatchProcessor` to support an alternative leaf-level reconciliation strategy, required for ignore-null support. ### Does this PR introduce _any_ user-facing change? No. This is a pure refactoring change. ### How was this patch tested? Existing tests. No new tests added as this is a pure refactoring change. ### Was this patch authored or co-authored using generative AI tooling? Co-authored with GPT 5.6 Sol. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
