anew commented on PR #57192: URL: https://github.com/apache/spark/pull/57192#issuecomment-4976689378
Tracked history columns are resolved after columnSelection because SCD2 intervals only encode changes visible in the target table. Columns excluded from the target cannot produce observable target history, so they are not valid tracking columns. Added tests covering the default behavior and the error raised when trackHistorySelection explicitly includes an excluded column. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
