;giaosu...@gmail.com>
> 抄送人:罗辉 <luohui20...@sina.com>, focus <focushe...@qq.com>, user <
> user@spark.apache.org>
> 主题:Re: run spark apps in linux crontab
> 日期:2016年07月21日 12点01分
>
> you should source the environment file before or in the file. for exampl
goes to the log file and STDOUT at the same time.
>
>
>
> ThanksBest regards!
> San.Luo
>
> - 原始邮件 -
> 发件人:Chanh Le <giaosu...@gmail.com>
> 收件人:luohui20...@sina.com
> 抄送人:focus <focushe...@qq.com>, user <user@spark.apache.org>
> 主题:R
:luohui20...@sina.com
抄送人:focus <focushe...@qq.com>, user <user@spark.apache.org>
主题:Re: run spark apps in linux crontab
日期:2016年07月21日 11点38分
you should you use command.sh | tee file.log
On Jul 21, 2016, at 10:36 AM, <luohui20...@sina.com> <luohui20...@sina.com>
wrote:
thank you f
bmit $MYSCRIPTS/fix_fh_yesterday.py
>
> then, in crontab -e
>
> 0 8 * * * /home/user/daily_job.sh
>
> hope this helps~
>
>
>
>
> -- Original --
> *From:* "luohui20001"<luohui20...@sina.com>;
> *Date:* 2016年7月20日(
/daily_job.sh
>
> hope this helps~
>
>
>
>
> ------ Original --
> From: "luohui20001"<luohui20...@sina.com>;
> Date: 2016年7月20日(星期三) 晚上6:00
> To: "user@spark.apache.org"<user@spark.apache.org>;
> Subject: r
;<luohui20...@sina.com>;
> *Date:* 2016年7月20日(星期三) 晚上6:00
> *To:* "user@spark.apache.org"<user@spark.apache.org>;
> *Subject:* run spark apps in linux crontab
>
> hi guys:
> I add a spark-submit job into my Linux crontab list by the means
> below ,howev
Remember that the you need to souce your .bashrc
For your PATH to be set up.
From: luohui20...@sina.com [mailto:luohui20...@sina.com]
Sent: 20 July 2016 11:01
To: user <user@spark.apache.org>
Subject: run spark apps in linux crontab
hi guys:
I add a spark-submit job into my Linux c
hi guys: I add a spark-submit job into my Linux crontab list by the means
below ,however none of them works. If I change it to a normal shell script, it
is ok. I don't quite understand why. I checked the 8080 web ui of my spark
cluster, no job submitted, and there is not messages in