ithangzhou opened a new issue, #17093: URL: https://github.com/apache/dolphinscheduler/issues/17093
### Search before asking - [x] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues. ### What happened datax task executed with error: [INFO] 2025-03-28 15:59:26.008 +0800 - ********************************* Execute task instance ************************************* [INFO] 2025-03-28 15:59:26.008 +0800 - *********************************************************************************************** [INFO] 2025-03-28 15:59:26.022 +0800 - Final Shell file is: [INFO] 2025-03-28 15:59:26.022 +0800 - ****************************** Script Content ***************************************************************** [INFO] 2025-03-28 15:59:26.023 +0800 - #!/bin/bash BASEDIR=$(cd `dirname $0`; pwd) cd $BASEDIR ${PYTHON_LAUNCHER} ${DATAX_LAUNCHER} --jvm="-Xms1G -Xmx1G" -p "-Dsystem.task.definition.name='datax-test' -Dsystem.project.name='null' -Dsystem.project.code='136905320416704' -Dsystem.workflow.instance.id='3581' -Dsystem.biz.curdate='20250328' -Dsystem.biz.date='20250327' -Dsystem.task.instance.id='35856' -Dsystem.workflow.definition.name='datax-demo' -Dsystem.task.definition.code='136905631756736' -Dsystem.workflow.definition.code='136905684814272' -Dsystem.datetime='20250328155925'" /tmp/dolphinscheduler/exec/process/dolphinexe/136905320416704/136905684814272_12/3581/35856/3581_35856_job.json [INFO] 2025-03-28 15:59:26.023 +0800 - ****************************** Script Content ***************************************************************** [INFO] 2025-03-28 15:59:26.023 +0800 - Executing shell command : sudo -u dolphinexe -i /tmp/dolphinscheduler/exec/process/dolphinexe/136905320416704/136905684814272_12/3581/35856/3581_35856.sh [INFO] 2025-03-28 15:59:26.035 +0800 - process start, process id is: 47844 [INFO] 2025-03-28 15:59:27.035 +0800 - -> unknown option --jvm=-Xms1G -Xmx1G usage: /bin/python3 [option] ... [-c cmd | -m mod | file | -] [arg] ... Try `python -h' for more information. [INFO] 2025-03-28 15:59:27.036 +0800 - process has exited. execute path:/tmp/dolphinscheduler/exec/process/dolphinexe/136905320416704/136905684814272_12/3581/35856, processId:47844 ,exitStatusCode:2 ,processWaitForStatus:true ,processExitValue:2 [INFO] 2025-03-28 15:59:27.036 +0800 - *********************************************************************************************** [INFO] 2025-03-28 15:59:27.037 +0800 - ********************************* Finalize task instance ************************************ ### What you expected to happen datax task should be executed successfully ### How to reproduce accroding to docs described,we have datax settings as below: # show env-setting cat /opt/dolphinscheduler/worker-server/conf/dolphinscheduler_env.sh ============ export DATAX_HOME=${DATAX_HOME:-/opt/soft/datax/bin/datax.py} export SEATUNNEL_HOME=${SEATUNNEL_HOME:-/opt/soft/seatunnel} export CHUNJUN_HOME=${CHUNJUN_HOME:-/opt/soft/chunjun} export PATH=$HADOOP_HOME/bin:$SPARK_HOME1/bin:$SPARK_HOME2/bin:$PYTHON_HOME/bin:$JAVA_HOME/bin:$HIVE_HOME/bin:$FLINK_HOME/bin:$DATAX_HOME/bin:$SEATUNNEL_HOME/bin:$CHUNJUN_HOME/bin:$PATH ====================== now we will find that ${DATAX_HOME} is [/opt/soft/datax/bin/datax.py],it is a file path but not a directory! and last line we see another extend path is [$DATAX_HOME/bin],this is unnormal! and in production,datax task cannot be execeuted successfully,an error occured like this: ======= [INFO] 2025-03-28 15:59:26.023 +0800 - Executing shell command : sudo -u dolphinexe -i /tmp/dolphinscheduler/exec/process/dolphinexe/136905320416704/136905684814272_12/3581/35856/3581_35856.sh [INFO] 2025-03-28 15:59:26.035 +0800 - process start, process id is: 47844 [INFO] 2025-03-28 15:59:27.035 +0800 - -> unknown option --jvm=-Xms1G -Xmx1G usage: /bin/python3 [option] ... [-c cmd | -m mod | file | -] [arg] ... Try `python -h' for more information. [INFO] 2025-03-28 15:59:27.036 +0800 - process has exited. execute path:/tmp/dolphinscheduler/exec/process/dolphinexe/136905320416704/136905684814272_12/3581/35856, processId:47844 ,exitStatusCode:2 ,processWaitForStatus:true ,processExitValue:2 [INFO] 2025-03-28 15:59:27.036 +0800 - *********************************************************************************************** ======================= ### Anything else environment os: Linux version 5.15.0-133-generic (buildd@lcy02-amd64-040) (gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #144-Ubuntu SMP Fri Feb 7 20:47:38 UTC 202 dolphinscheduler：3.2.2 python:3.10 at last,show my solution to resolve this: ============= # add to /etc/profile # and execute "source /etc/profile " command to activated export PYTHON_LAUNCHER=/bin/python3 export DATAX_LAUNCHER=/opt/soft/datax/bin/datax.py =========== # show env-setting cat /opt/dolphinscheduler/worker-server/conf/dolphinscheduler_env.sh ============ export DATAX_HOME=${DATAX_HOME:-/opt/soft/datax} ================= ### Version 3.2.x ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
