Re: Can I control the execution of Spark jobs?

2016-06-18 Thread Jacek Laskowski
dependency. Any suggestions/comments are appreciated. > > -Original Message- > From: Jacek Laskowski [mailto:ja...@japila.pl] > Sent: 2016年6月16日 19:09 > To: user > Subject: Re: Can I control the execution of Spark jobs? > > Hi, > > When you say "several ETL t

RE: Can I control the execution of Spark jobs?

2016-06-16 Thread Haopu Wang
. -Original Message- From: Jacek Laskowski [mailto:ja...@japila.pl] Sent: 2016年6月16日 19:09 To: user Subject: Re: Can I control the execution of Spark jobs? Hi, When you say "several ETL types of things", what is this exactly? What would an example of "dependency between these jobs&q

Re: Can I control the execution of Spark jobs?

2016-06-16 Thread Alonso Isidoro Roman
Hi Wang, maybe you can consider to use an integration framework like Apache Camel in order to run differents jobs... Alonso Isidoro Roman [image: https://]about.me/alonso.isidoro.roman

Re: Can I control the execution of Spark jobs?

2016-06-16 Thread Jacek Laskowski
Hi, When you say "several ETL types of things", what is this exactly? What would an example of "dependency between these jobs" be? Pozdrawiam, Jacek Laskowski https://medium.com/@jaceklaskowski/ Mastering Apache Spark http://bit.ly/mastering-apache-spark Follow me at

Can I control the execution of Spark jobs?

2016-06-16 Thread Haopu Wang
Hi, Suppose I have a spark application which is doing several ETL types of things. I understand Spark can analyze and generate several jobs to execute. The question is: is it possible to control the dependency between these jobs? Thanks!