[
https://issues.apache.org/jira/browse/SPARK-52937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sandy Ryza updated SPARK-52937:
-------------------------------
Description: As proposed in the
[SPIP|https://docs.google.com/document/d/1PsSTngFuRVEOvUGzp_25CQL1yfzFHFr02XdMfQ7jOM4/edit?tab=t.0],
a sink is a generic target for a flow to send data that is external to the
pipeline. Add support for defining them and executing flows that target them.
(was: As proposed in the
[SPIP|https://docs.google.com/document/d/1PsSTngFuRVEOvUGzp_25CQL1yfzFHFr02XdMfQ7jOM4/edit?tab=t.0]
An external sink is a generic target for a flow to send data that is external
to the pipeline. Because sinks are external to the pipeline, we can’t always
provide the idempotency semantics that we can with streaming tables and
materialized views.)
> Add support for pipeline sinks
> ------------------------------
>
> Key: SPARK-52937
> URL: https://issues.apache.org/jira/browse/SPARK-52937
> Project: Spark
> Issue Type: Improvement
> Components: Declarative Pipelines
> Affects Versions: 4.1.0
> Reporter: Sandy Ryza
> Assignee: Sandy Ryza
> Priority: Major
>
> As proposed in the
> [SPIP|https://docs.google.com/document/d/1PsSTngFuRVEOvUGzp_25CQL1yfzFHFr02XdMfQ7jOM4/edit?tab=t.0],
> a sink is a generic target for a flow to send data that is external to the
> pipeline. Add support for defining them and executing flows that target them.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
