t 07:53, wrote:
> got it, I've added it into my notes.
> thank you
>
>
>
>
> Thanks&Best regards!
> San.Luo
>
> - 原始邮件 -
> 发件人：Mich Talebzadeh
> 收件人：Chanh Le
> 抄送人：罗辉 , focus , user <
> user@spark
>
> Thanks&Best regards!
> San.Luo
>
> - 原始邮件 -
> 发件人：Chanh Le
> 收件人：luohui20...@sina.com
> 抄送人：focus , user
> 主题：Re: run spark apps in linux crontab
> 日期：2016年07月21日 11点38分
>
> you should you use command.sh | tee file.log
>
, user
主题：Re: run spark apps in linux crontab
日期：2016年07月21日 11点38分
you should you use command.sh | tee file.log
On Jul 21, 2016, at 10:36 AM,
wrote:
thank you focus, and all.this problem solved by adding a line ". /etc/profile"
in my shell.
Th
you should source the environment file before or in the file. for example
this one is ksh type
0,5,10,15,20,25,30,35,40,45,50,55 * * * *
(/home/hduser/dba/bin/send_messages_to_Kafka.ksh >
/var/tmp/send_messages_to_Kafka.err 2>&1)
in that shell it sources the environment file
#
# Main Section
#
E
you should you use command.sh | tee file.log
> On Jul 21, 2016, at 10:36 AM,
> wrote:
>
>
> thank you focus, and all.
> this problem solved by adding a line ". /etc/profile" in my shell.
>
>
>
>
> Thanks&Best regards!
> San.Luo
>
> - 原始邮件 -
> 发件人：
HI ,
Please check your deploy mode and master , For example if you want to
deploy in yarn cluster you should use --master yarn-cluster , if you want
to do it on yarn client mode you should use --master yarn-client .
Please note for your case deploying yarn-cluster will be better as cluster
mode
Remember that the you need to souce your .bashrc
For your PATH to be set up.
From: luohui20...@sina.com [mailto:luohui20...@sina.com]
Sent: 20 July 2016 11:01
To: user
Subject: run spark apps in linux crontab
hi guys:
I add a spark-submit job into my Linux crontab list by the means below
