Remzi Yang created SPARK-52244:
----------------------------------
Summary: Preserve the driver log after deleting the sparkApp
Key: SPARK-52244
URL: https://issues.apache.org/jira/browse/SPARK-52244
Project: Spark
Issue Type: New Feature
Components: Connect
Affects Versions: kubernetes-operator-0.1.0
Reporter: Remzi Yang
spark-kubernetes-operator now deletes the driver pod directly after calling
`kubectl delete sparkApp xxx`. There is no way to check the driver log after
the deletion. We'd like to preserve the driver log for checking later, which is
especially usefully for a long-running spark app, like spark-connect. I am sure
if the driver pod can be turned in Completed status after deleting for instance?
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
