[ https://issues.apache.org/jira/browse/AIRFLOW-4494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16882163#comment-16882163 ]
ASF subversion and git services commented on AIRFLOW-4494: ---------------------------------------------------------- Commit 78ad24261813d293e7670c98c6d63e1cdb5b8e96 in airflow's branch refs/heads/v1-10-test from MisLink [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=78ad242 ] [AIRFLOW-4494] Remove `shell=True` in DaskExecutor (#5273) Signed-off-by: MisLink <gjq.uo...@outlook.com> (cherry picked from commit 42033d2fececee427cb3e6ed07664d7036098eab) > Unwanted kwarg shell=True in DaskExecutor > ----------------------------------------- > > Key: AIRFLOW-4494 > URL: https://issues.apache.org/jira/browse/AIRFLOW-4494 > Project: Apache Airflow > Issue Type: Bug > Components: executors > Affects Versions: 1.10.3 > Reporter: GuoJiaqi > Priority: Major > Fix For: 1.10.4 > > > This line: > [https://github.com/apache/airflow/blob/master/airflow/executors/dask_executor.py#L68] > If {{Popen}} is with {{shell=True}} and args is a list, the first item of > list specifies the command string, the other items are the arguments of > /bin/sh on POSIX. > So the command {{airflow run ...}} will raise an error from dask-worker: > {code:java} > usage: airflow [-h] > {backfill,list_dag_runs,list_tasks,clear,pause,unpause,trigger_dag,delete_dag,pool,variables,kerberos,render,run,initdb,list_dags,dag_state,task_failed_deps,task_state,serve_logs,test,webserver,resetdb,upgradedb,scheduler,worker,flower,version,connections,create_user,delete_user,list_users,sync_perm,next_execution,rotate_fernet_key} > ... > airflow: error: the following arguments are required: subcommand > distributed.worker - WARNING - Compute Failed > Function: airflow_run > args: () > kwargs: {} > Exception: CalledProcessError(2, ['airflow', 'run', 'tutorial', 'print_date', > '2019-05-08T00:00:00+00:00', '--local', '-sd', > '/Users/<me>/projects/dask_airflow/.venv/lib/python3.6/site-packages/airflow/example_dags/tutorial.py']){code} > -- This message was sent by Atlassian JIRA (v7.6.3#76005)