Dongjoon Hyun created SPARK-32443:
-------------------------------------
Summary: Fix testCommandAvailable to use POSIX compatible `command
-v`
Key: SPARK-32443
URL: https://issues.apache.org/jira/browse/SPARK-32443
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 3.0.0, 2.4.6, 2.3.4, 2.2.3, 2.1.3
Reporter: Dongjoon Hyun
Currently, we run the command to check the existence. This is dangerous and
doesn't work sometimes.
{code}
scala> sys.process.Process("cat").run().exitValue()
res0: Int = 0
scala> sys.process.Process("ls").run().exitValue()
LICENSE
NOTICE
bin
doc
lib
man
res1: Int = 0
scala> sys.process.Process("rm").run().exitValue()
usage: rm [-f | -i] [-dPRrvW] file ...
unlink file
res4: Int = 64
{code}
{code}
scala> sys.process.Process("command -v rm").run().exitValue()
/bin/rm
res5: Int = 0
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
