sandugood opened a new pull request, #1993:
URL: https://github.com/apache/datafusion-ballista/pull/1993
# Which issue does this PR close?
Closes #1937 .
# Rationale for this change
Before this change, there was no `checkpoint()` method for the DataFrame in
Ballista (where we break lineage of the plan and store intermediate results to
specified location)
# What changes are included in this PR?
Introducing new `DataFrameExt` trait in the client, also introducing
`checkpoint()` there.
A new entry to the `BallistaConfig` was added as well. When trying to call
`checkpoint() `without the config entry set user will get an error.
# Are there any user-facing changes?
<!--
If there are user-facing changes then we may require documentation to be
updated before approving the PR.
-->
New `checkpoint()` method introduced.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
