[
https://issues.apache.org/jira/browse/SPARK-52937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sandy Ryza updated SPARK-52937:
-------------------------------
Description: As proposed in the
[SPIP|https://docs.google.com/document/d/1PsSTngFuRVEOvUGzp_25CQL1yfzFHFr02XdMfQ7jOM4/edit?tab=t.0]
An external sink is a generic target for a flow to send data that is external
to the pipeline. Because sinks are external to the pipeline, we can’t always
provide the idempotency semantics that we can with streaming tables and
materialized views.
> Add support for pipeline sinks
> ------------------------------
>
> Key: SPARK-52937
> URL: https://issues.apache.org/jira/browse/SPARK-52937
> Project: Spark
> Issue Type: Improvement
> Components: Declarative Pipelines
> Affects Versions: 4.1.0
> Reporter: Sandy Ryza
> Assignee: Sandy Ryza
> Priority: Major
>
> As proposed in the
> [SPIP|https://docs.google.com/document/d/1PsSTngFuRVEOvUGzp_25CQL1yfzFHFr02XdMfQ7jOM4/edit?tab=t.0]
> An external sink is a generic target for a flow to send data that is
> external to the pipeline. Because sinks are external to the pipeline, we
> can’t always provide the idempotency semantics that we can with streaming
> tables and materialized views.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
