Sandy Ryza created SPARK-52851:
----------------------------------
Summary: Remove public APIs for append once flows
Key: SPARK-52851
URL: https://issues.apache.org/jira/browse/SPARK-52851
Project: Spark
Issue Type: Improvement
Components: Declarative Pipelines
Affects Versions: 4.1.0
Reporter: Sandy Ryza
The Declarative Pipelines `append_flow` decorator includes a `once` argument,
which, if True, indicates the flow should run only once. (It will be rerun upon
a full refresh operation.)
I believe there's also SQL syntax for this.
However, the server does not currently implement this behavior yet. To avoid
accidentally releasing APIs that don't actually work, we should take these
arguments out for now. And add them back in when we actually support this
functionality.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
