[jira] [Assigned] (SPARK-19117) script transformation does not work on Windows due to fixed bash executable location
[
https://issues.apache.org/jira/browse/SPARK-19117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-19117:
Assignee: (was: Apache Spark)
> script transformation does not work on Windows due to fixed bash executable
> location
>
>
> Key: SPARK-19117
> URL: https://issues.apache.org/jira/browse/SPARK-19117
> Project: Spark
> Issue Type: Bug
> Components: SQL
>Reporter: Hyukjin Kwon
>
> There are some tests failed on Windows via AppVeyor as below due to this
> problem :
> {code}
> - script *** FAILED *** (553 milliseconds)
>org.apache.spark.SparkException: Job aborted due to stage failure: Task 0
> in stage 56.0 failed 1 times, most recent failure: Lost task 0.0 in stage
> 56.0 (TID 54, localhost, executor driver): java.io.IOException: Cannot run
> program "/bin/bash": CreateProcess error=2, The system cannot find the file
> specified
> - Star Expansion - script transform *** FAILED *** (2 seconds, 375
> milliseconds)
>org.apache.spark.SparkException: Job aborted due to stage failure: Task 0
> in stage 389.0 failed 1 times, most recent failure: Lost task 0.0 in stage
> 389.0 (TID 725, localhost, executor driver): java.io.IOException: Cannot run
> program "/bin/bash": CreateProcess error=2, The system cannot find the file
> specified
> - test script transform for stdout *** FAILED *** (2 seconds, 813
> milliseconds)
>org.apache.spark.SparkException: Job aborted due to stage failure: Task 0
> in stage 391.0 failed 1 times, most recent failure: Lost task 0.0 in stage
> 391.0 (TID 726, localhost, executor driver): java.io.IOException: Cannot run
> program "/bin/bash": CreateProcess error=2, The system cannot find the file
> specified
> - test script transform for stderr *** FAILED *** (2 seconds, 407
> milliseconds)
>org.apache.spark.SparkException: Job aborted due to stage failure: Task 0
> in stage 393.0 failed 1 times, most recent failure: Lost task 0.0 in stage
> 393.0 (TID 727, localhost, executor driver): java.io.IOException: Cannot run
> program "/bin/bash": CreateProcess error=2, The system cannot find the file
> specified
> - test script transform data type *** FAILED *** (171 milliseconds)
>org.apache.spark.SparkException: Job aborted due to stage failure: Task 0
> in stage 395.0 failed 1 times, most recent failure: Lost task 0.0 in stage
> 395.0 (TID 728, localhost, executor driver): java.io.IOException: Cannot run
> program "/bin/bash": CreateProcess error=2, The system cannot find the file
> specified
> - transform *** FAILED *** (359 milliseconds)
>Failed to execute query using catalyst:
>Error: Job aborted due to stage failure: Task 0 in stage 1347.0 failed 1
> times, most recent failure: Lost task 0.0 in stage 1347.0 (TID 2395,
> localhost, executor driver): java.io.IOException: Cannot run program
> "/bin/bash": CreateProcess error=2, The system cannot find the file specified
>
> - schema-less transform *** FAILED *** (344 milliseconds)
>Failed to execute query using catalyst:
>Error: Job aborted due to stage failure: Task 0 in stage 1348.0 failed 1
> times, most recent failure: Lost task 0.0 in stage 1348.0 (TID 2396,
> localhost, executor driver): java.io.IOException: Cannot run program
> "/bin/bash": CreateProcess error=2, The system cannot find the file specified
> - transform with custom field delimiter *** FAILED *** (296 milliseconds)
>Failed to execute query using catalyst:
>Error: Job aborted due to stage failure: Task 0 in stage 1349.0 failed 1
> times, most recent failure: Lost task 0.0 in stage 1349.0 (TID 2397,
> localhost, executor driver): java.io.IOException: Cannot run program
> "/bin/bash": CreateProcess error=2, The system cannot find the file specified
> - transform with custom field delimiter2 *** FAILED *** (297 milliseconds)
>Failed to execute query using catalyst:
>Error: Job aborted due to stage failure: Task 0 in stage 1350.0 failed 1
> times, most recent failure: Lost task 0.0 in stage 1350.0 (TID 2398,
> localhost, executor driver): java.io.IOException: Cannot run program
> "/bin/bash": CreateProcess error=2, The system cannot find the file specified
> - transform with custom field delimiter3 *** FAILED *** (312 milliseconds)
>Failed to execute query using catalyst:
>Error: Job aborted due to stage failure: Task 0 in stage 1351.0 failed 1
> times, most recent failure: Lost task 0.0 in stage 1351.0 (TID 2399,
> localhost, executor driver): java.io.IOException: Cannot run program
> "/bin/bash": CreateProcess error=2, The system cannot find the file specified
> - transform with SerDe2 *** FAILED *** (437 milliseconds)
>org.apache.spark.SparkException: Job aborted due to stage failure: Task 0
>
[jira] [Assigned] (SPARK-19117) script transformation does not work on Windows due to fixed bash executable location
[
https://issues.apache.org/jira/browse/SPARK-19117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-19117:
Assignee: Apache Spark
> script transformation does not work on Windows due to fixed bash executable
> location
>
>
> Key: SPARK-19117
> URL: https://issues.apache.org/jira/browse/SPARK-19117
> Project: Spark
> Issue Type: Bug
> Components: SQL
>Reporter: Hyukjin Kwon
>Assignee: Apache Spark
>
> There are some tests failed on Windows via AppVeyor as below due to this
> problem :
> {code}
> - script *** FAILED *** (553 milliseconds)
>org.apache.spark.SparkException: Job aborted due to stage failure: Task 0
> in stage 56.0 failed 1 times, most recent failure: Lost task 0.0 in stage
> 56.0 (TID 54, localhost, executor driver): java.io.IOException: Cannot run
> program "/bin/bash": CreateProcess error=2, The system cannot find the file
> specified
> - Star Expansion - script transform *** FAILED *** (2 seconds, 375
> milliseconds)
>org.apache.spark.SparkException: Job aborted due to stage failure: Task 0
> in stage 389.0 failed 1 times, most recent failure: Lost task 0.0 in stage
> 389.0 (TID 725, localhost, executor driver): java.io.IOException: Cannot run
> program "/bin/bash": CreateProcess error=2, The system cannot find the file
> specified
> - test script transform for stdout *** FAILED *** (2 seconds, 813
> milliseconds)
>org.apache.spark.SparkException: Job aborted due to stage failure: Task 0
> in stage 391.0 failed 1 times, most recent failure: Lost task 0.0 in stage
> 391.0 (TID 726, localhost, executor driver): java.io.IOException: Cannot run
> program "/bin/bash": CreateProcess error=2, The system cannot find the file
> specified
> - test script transform for stderr *** FAILED *** (2 seconds, 407
> milliseconds)
>org.apache.spark.SparkException: Job aborted due to stage failure: Task 0
> in stage 393.0 failed 1 times, most recent failure: Lost task 0.0 in stage
> 393.0 (TID 727, localhost, executor driver): java.io.IOException: Cannot run
> program "/bin/bash": CreateProcess error=2, The system cannot find the file
> specified
> - test script transform data type *** FAILED *** (171 milliseconds)
>org.apache.spark.SparkException: Job aborted due to stage failure: Task 0
> in stage 395.0 failed 1 times, most recent failure: Lost task 0.0 in stage
> 395.0 (TID 728, localhost, executor driver): java.io.IOException: Cannot run
> program "/bin/bash": CreateProcess error=2, The system cannot find the file
> specified
> - transform *** FAILED *** (359 milliseconds)
>Failed to execute query using catalyst:
>Error: Job aborted due to stage failure: Task 0 in stage 1347.0 failed 1
> times, most recent failure: Lost task 0.0 in stage 1347.0 (TID 2395,
> localhost, executor driver): java.io.IOException: Cannot run program
> "/bin/bash": CreateProcess error=2, The system cannot find the file specified
>
> - schema-less transform *** FAILED *** (344 milliseconds)
>Failed to execute query using catalyst:
>Error: Job aborted due to stage failure: Task 0 in stage 1348.0 failed 1
> times, most recent failure: Lost task 0.0 in stage 1348.0 (TID 2396,
> localhost, executor driver): java.io.IOException: Cannot run program
> "/bin/bash": CreateProcess error=2, The system cannot find the file specified
> - transform with custom field delimiter *** FAILED *** (296 milliseconds)
>Failed to execute query using catalyst:
>Error: Job aborted due to stage failure: Task 0 in stage 1349.0 failed 1
> times, most recent failure: Lost task 0.0 in stage 1349.0 (TID 2397,
> localhost, executor driver): java.io.IOException: Cannot run program
> "/bin/bash": CreateProcess error=2, The system cannot find the file specified
> - transform with custom field delimiter2 *** FAILED *** (297 milliseconds)
>Failed to execute query using catalyst:
>Error: Job aborted due to stage failure: Task 0 in stage 1350.0 failed 1
> times, most recent failure: Lost task 0.0 in stage 1350.0 (TID 2398,
> localhost, executor driver): java.io.IOException: Cannot run program
> "/bin/bash": CreateProcess error=2, The system cannot find the file specified
> - transform with custom field delimiter3 *** FAILED *** (312 milliseconds)
>Failed to execute query using catalyst:
>Error: Job aborted due to stage failure: Task 0 in stage 1351.0 failed 1
> times, most recent failure: Lost task 0.0 in stage 1351.0 (TID 2399,
> localhost, executor driver): java.io.IOException: Cannot run program
> "/bin/bash": CreateProcess error=2, The system cannot find the file specified
> - transform with SerDe2 *** FAILED *** (437 milliseconds)
>org.apache.spark.SparkException: Job aborted due to
