anew opened a new pull request, #55589:
URL: https://github.com/apache/spark/pull/55589
### What changes were proposed in this pull request?
Add the spark-connect protos to support AutoCDC flows. This is mainly two
new protos:
`AutoCdcFlowDetails`: similar to the existing `WriteRelationFlowDetails`,
describes an AutoCDC flow.
`SCDType` an enum to specify the type of SCD (slow changing dimension)
storage type.
For now, throw "not implemented" for the new flow type.
### Why are the changes needed?
This new API is needed to specify an AutoCDC flow in a declarative pipeline.
### Does this PR introduce _any_ user-facing change?
It introduces a new Spark Connect API, however, no implementation yet, and
also no language wrappers (e.g. Python), yet.
### How was this patch tested?
No tests, as this API is unimplemented for now.
### Was this patch authored or co-authored using generative AI tooling?
Generated-by: Claude Sonnet 4.6
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
