Andreas Chatzistergiou created SPARK-56994:
----------------------------------------------
Summary: Allow dataframe caching in the DSv2 Transaction API
Key: SPARK-56994
URL: https://issues.apache.org/jira/browse/SPARK-56994
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 4.2.0
Reporter: Andreas Chatzistergiou
Currently, the DSv2 Transaction API skips dataframe caching. This can cause
significant performance regression to existing workloads. Dataframes cached
prior to the transaction should be allowed to be reused within the transaction.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
