[
https://issues.apache.org/jira/browse/SPARK-57358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andreas Neumann resolved SPARK-57358.
-------------------------------------
Fix Version/s: 4.3.0
Resolution: Fixed
Implemented in PR #56419
> SCD1 SQL API without ignore nulls
> ---------------------------------
>
> Key: SPARK-57358
> URL: https://issues.apache.org/jira/browse/SPARK-57358
> Project: Spark
> Issue Type: Sub-task
> Components: Declarative Pipelines
> Affects Versions: 4.3.0
> Reporter: Andreas Neumann
> Priority: Major
> Fix For: 4.3.0
>
>
> Implement the SQL parser for AUTO CDC with SCD TYPE 1:
> *Form* *1:* *CREATE* *FLOW* *...* *AS* *AUTO* *CDC* {*}INTO{*}{*}{*}
> {{CREATE FLOW <flow_name> [COMMENT '<comment>'] AS}}{{
> AUTO CDC INTO <target_table>}}{{
> FROM <source>}}{{ K
> EYS (<key1>, <key2>, ...)}}{{
> SEQUENCE BY <expr>}}{{
> [APPLY AS DELETE WHEN <condition>]}}{{
> [COLUMNS <col1>, <col2>, ...]}}{{{}
> [COLUMNS * EXCEPT (<col1>, <col2>, ...)]{}}}{{{}{}}}
> *Form* *2:* *CREATE* *STREAMING* *TABLE* *...* *FLOW* *AUTO* {*}CDC{*}{*}{*}
> {{CREATE [OR REFRESH] STREAMING TABLE <table_name>}}{{
> }}{{[IF NOT EXISTS]}}{{
> [(column_definitions)] [USING provider]}}{{
> [table_clauses]}}{{
> FLOW AUTO CDC}}{{
> FROM <source>}}{{
> KEYS (<key1>, <key2>, ...)}}{{
> SEQUENCE BY <expr>}}{{
> [APPLY AS DELETE WHEN <condition>]}}{{
> [COLUMNS <col1>, <col2>, ...]}}{{{}
> [COLUMNS * EXCEPT (<col1>, <col2>, ...)]{}}}{{{}{}}}
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
