[jira] [Commented] (SPARK-20546) spark-class gets syntax error in posix mode
[ https://issues.apache.org/jira/browse/SPARK-20546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15995999#comment-15995999 ] Apache Spark commented on SPARK-20546: -- User 'jyu00' has created a pull request for this issue: https://github.com/apache/spark/pull/17852 > spark-class gets syntax error in posix mode > --- > > Key: SPARK-20546 > URL: https://issues.apache.org/jira/browse/SPARK-20546 > Project: Spark > Issue Type: Bug > Components: Deploy >Affects Versions: 2.0.2 >Reporter: Jessie Yu >Priority: Minor > > spark-class gets the following error when running in posix mode: > {code} > spark-class: line 78: syntax error near unexpected token `<' > spark-class: line 78: `done < <(build_command "$@")' > {code} > \\ > It appears to be complaining about the process substitution: > {code} > CMD=() > while IFS= read -d '' -r ARG; do > CMD+=("$ARG") > done < <(build_command "$@") > {code} > \\ > This can be reproduced by first turning on allexport then posix mode: > {code}set -a -o posix {code} > then run something like spark-shell which calls spark-class. > \\ > The simplest fix is probably to always turn off posix mode in spark-class > before the while loop. > \\ > This was previously reported in > [SPARK-8417|https://issues.apache.org/jira/browse/SPARK-8417] which closed > with cannot reproduce. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-20546) spark-class gets syntax error in posix mode
[ https://issues.apache.org/jira/browse/SPARK-20546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994464#comment-15994464 ] Sean Owen commented on SPARK-20546: --- Ok, seems fine to confine it to just this script with a comment about the reason. > spark-class gets syntax error in posix mode > --- > > Key: SPARK-20546 > URL: https://issues.apache.org/jira/browse/SPARK-20546 > Project: Spark > Issue Type: Bug > Components: Deploy >Affects Versions: 2.0.2 >Reporter: Jessie Yu >Priority: Minor > > spark-class gets the following error when running in posix mode: > {code} > spark-class: line 78: syntax error near unexpected token `<' > spark-class: line 78: `done < <(build_command "$@")' > {code} > \\ > It appears to be complaining about the process substitution: > {code} > CMD=() > while IFS= read -d '' -r ARG; do > CMD+=("$ARG") > done < <(build_command "$@") > {code} > \\ > This can be reproduced by first turning on allexport then posix mode: > {code}set -a -o posix {code} > then run something like spark-shell which calls spark-class. > \\ > The simplest fix is probably to always turn off posix mode in spark-class > before the while loop. > \\ > This was previously reported in > [SPARK-8417|https://issues.apache.org/jira/browse/SPARK-8417] which closed > with cannot reproduce. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-20546) spark-class gets syntax error in posix mode
[ https://issues.apache.org/jira/browse/SPARK-20546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992886#comment-15992886 ] Jessie Yu commented on SPARK-20546: --- Given the current code relies on posix mode being off, turning it off explicitly shouldn't affect other behavior, especially since the change is confined to just the spark-class subshell. > spark-class gets syntax error in posix mode > --- > > Key: SPARK-20546 > URL: https://issues.apache.org/jira/browse/SPARK-20546 > Project: Spark > Issue Type: Bug > Components: Deploy >Affects Versions: 2.0.2 >Reporter: Jessie Yu >Priority: Minor > > spark-class gets the following error when running in posix mode: > {code} > spark-class: line 78: syntax error near unexpected token `<' > spark-class: line 78: `done < <(build_command "$@")' > {code} > \\ > It appears to be complaining about the process substitution: > {code} > CMD=() > while IFS= read -d '' -r ARG; do > CMD+=("$ARG") > done < <(build_command "$@") > {code} > \\ > This can be reproduced by first turning on allexport then posix mode: > {code}set -a -o posix {code} > then run something like spark-shell which calls spark-class. > \\ > The simplest fix is probably to always turn off posix mode in spark-class > before the while loop. > \\ > This was previously reported in > [SPARK-8417|https://issues.apache.org/jira/browse/SPARK-8417] which closed > with cannot reproduce. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-20546) spark-class gets syntax error in posix mode
[ https://issues.apache.org/jira/browse/SPARK-20546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15991678#comment-15991678 ] Sean Owen commented on SPARK-20546: --- Are there downsides to turning off posix mode? It seems reasonable if it makes this case work and doesn't affect other behavior. > spark-class gets syntax error in posix mode > --- > > Key: SPARK-20546 > URL: https://issues.apache.org/jira/browse/SPARK-20546 > Project: Spark > Issue Type: Bug > Components: Deploy >Affects Versions: 2.0.2 >Reporter: Jessie Yu >Priority: Minor > > spark-class gets the following error when running in posix mode: > {code} > spark-class: line 78: syntax error near unexpected token `<' > spark-class: line 78: `done < <(build_command "$@")' > {code} > \\ > It appears to be complaining about the process substitution: > {code} > CMD=() > while IFS= read -d '' -r ARG; do > CMD+=("$ARG") > done < <(build_command "$@") > {code} > \\ > This can be reproduced by first turning on allexport then posix mode: > {code}set -a -o posix {code} > then run something like spark-shell which calls spark-class. > \\ > The simplest fix is probably to always turn off posix mode in spark-class > before the while loop. > \\ > This was previously reported in > [SPARK-8417|https://issues.apache.org/jira/browse/SPARK-8417] which closed > with cannot reproduce. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org