Re: Re: run spark apps in linux crontab

2016-07-21 Thread Mich Talebzadeh
;giaosu...@gmail.com> > 抄送人:罗辉 <luohui20...@sina.com>, focus <focushe...@qq.com>, user < > user@spark.apache.org> > 主题:Re: run spark apps in linux crontab > 日期:2016年07月21日 12点01分 > > you should source the environment file before or in the file. for exampl

Re: run spark apps in linux crontab

2016-07-21 Thread Chanh Le
goes to the log file and STDOUT at the same time. > > > > ThanksBest regards! > San.Luo > > - 原始邮件 - > 发件人:Chanh Le <giaosu...@gmail.com> > 收件人:luohui20...@sina.com > 抄送人:focus <focushe...@qq.com>, user <user@spark.apache.org> > 主题:R

回复:Re: run spark apps in linux crontab

2016-07-21 Thread luohui20001
:luohui20...@sina.com 抄送人:focus <focushe...@qq.com>, user <user@spark.apache.org> 主题:Re: run spark apps in linux crontab 日期:2016年07月21日 11点38分 you should you use command.sh | tee file.log On Jul 21, 2016, at 10:36 AM, <luohui20...@sina.com> <luohui20...@sina.com> wrote: thank you f

Re: run spark apps in linux crontab

2016-07-20 Thread Mich Talebzadeh
bmit $MYSCRIPTS/fix_fh_yesterday.py > > then, in crontab -e > > 0 8 * * * /home/user/daily_job.sh > > hope this helps~ > > > > > -- Original -- > *From:* "luohui20001"<luohui20...@sina.com>; > *Date:* 2016年7月20日(

Re: run spark apps in linux crontab

2016-07-20 Thread Chanh Le
/daily_job.sh > > hope this helps~ > > > > > ------ Original -- > From: "luohui20001"<luohui20...@sina.com>; > Date: 2016年7月20日(星期三) 晚上6:00 > To: "user@spark.apache.org"<user@spark.apache.org>; > Subject: r

Re: run spark apps in linux crontab

2016-07-20 Thread Rabin Banerjee
;<luohui20...@sina.com>; > *Date:* 2016年7月20日(星期三) 晚上6:00 > *To:* "user@spark.apache.org"<user@spark.apache.org>; > *Subject:* run spark apps in linux crontab > > hi guys: > I add a spark-submit job into my Linux crontab list by the means > below ,howev

RE: run spark apps in linux crontab

2016-07-20 Thread Joaquin Alzola
Remember that the you need to souce your .bashrc For your PATH to be set up. From: luohui20...@sina.com [mailto:luohui20...@sina.com] Sent: 20 July 2016 11:01 To: user <user@spark.apache.org> Subject: run spark apps in linux crontab hi guys: I add a spark-submit job into my Linux c

run spark apps in linux crontab

2016-07-20 Thread luohui20001
hi guys: I add a spark-submit job into my Linux crontab list by the means below ,however none of them works. If I change it to a normal shell script, it is ok. I don't quite understand why. I checked the 8080 web ui of my spark cluster, no job submitted, and there is not messages in