naveenp2708 commented on PR #57644: URL: https://github.com/apache/spark/pull/57644#issuecomment-5269329590
The prefix handling already covers SCD-2. __START_AT and __END_AT don't carry the __spark_autocdc_ prefix so they stay user-visible, and only the metadata column is stripped. I added a test that declares an SCD-2 schema omitting just the metadata column to lock it in, so no code change was needed. Small note, the metadata column is __spark_autocdc_metadata, not __spark_cdc_metadata. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
