Chufeng Gao created SPARK-54085:
-----------------------------------
Summary: Get NoSuchFileException for stderr when submitting jobs
to standalone cluster
Key: SPARK-54085
URL: https://issues.apache.org/jira/browse/SPARK-54085
Project: Spark
Issue Type: Bug
Components: Deploy
Affects Versions: 4.1.0
Reporter: Chufeng Gao
When submitting jobs to standalone cluster using restful api, we get errors
like:
```
25/10/30 16:02:59 INFO DriverRunner: Killing driver process!
25/10/30 16:02:59 INFO CommandUtils: Redirection to
/Users/ericgao/workspace/open_source/spark/work/driver-20251030160259-0020/stdout
closed: Stream closed
25/10/30 16:02:59 WARN Worker: Driver driver-20251030160259-0020 failed with
unrecoverable exception: java.nio.file.NoSuchFileException:
/Users/ericgao/workspace/open_source/spark/work/driver-20251030160259-0020/stderr
```
We need to fix the usage of `Files.writeString` in DriverRunner
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
