Use Apex client to start application or use REST API to start
application if you have DataTorrent RTS license from you cron job.
Thank you,
Vlad
On 6/13/17 15:30, Guilherme Hott wrote:
I was thinking about to use a cron sending a kafka message and in my
DAG I'll have a kafka input operator to consume this message and start
the process. I think this work but I would like to know if have
something more appropriate.
On Tue, Jun 13, 2017 at 3:25 PM, Pramod Immaneni
<pra...@datatorrent.com <mailto:pra...@datatorrent.com>> wrote:
There is no built scheduler to schedule the DAGs at a prescribed
time, you would need to use some external mechanisms. Because it
is a daily one-time activity, would something like cron work for you?
On Tue, Jun 13, 2017 at 3:22 PM, Guilherme Hott
<guilhermeh...@gmail.com <mailto:guilhermeh...@gmail.com>> wrote:
Because I am syncing my data from a table in a database to
HDFS and I want to do this just once a day to save processing use.
On Tue, Jun 13, 2017 at 2:45 PM, Ganelin, Ilya
<ilya.gane...@capitalone.com
<mailto:ilya.gane...@capitalone.com>> wrote:
Why don’t you want your dag to continue running? Are there
resources you wish to release?
- Ilya Ganelin
id:image001.png@01D1F7A4.F3D42980
*From: *Guilherme Hott <guilhermeh...@gmail.com
<mailto:guilhermeh...@gmail.com>>
*Reply-To: *"users@apex.apache.org
<mailto:users@apex.apache.org>" <users@apex.apache.org
<mailto:users@apex.apache.org>>
*Date: *Tuesday, June 13, 2017 at 2:29 PM
*To: *"users@apex.apache.org
<mailto:users@apex.apache.org>" <users@apex.apache.org
<mailto:users@apex.apache.org>>
*Subject: *Is there a way to schedule an operator?
Hi guys,
Is there a way to schedule an operator? I need an
operator start the DAG once a day at 00am.
Best
--
*Guilherme Hott*
/Software Engineer/
Skype: guilhermehott
@guilhermehott
https://www.linkedin.com/in/guilhermehott
<https://www.linkedin.com/in/guilhermehott>
------------------------------------------------------------------------
The information contained in this e-mail is confidential
and/or proprietary to Capital One and/or its affiliates
and may only be used solely in performance of work or
services for Capital One. The information transmitted
herewith is intended only for use by the individual or
entity to which it is addressed. If the reader of this
message is not the intended recipient, you are hereby
notified that any review, retransmission, dissemination,
distribution, copying or other use of, or taking of any
action in reliance upon this information is strictly
prohibited. If you have received this communication in
error, please contact the sender and delete the material
from your computer.
--
*Guilherme Hott*
/Software Engineer/
Skype: guilhermehott
@guilhermehott
https://www.linkedin.com/in/guilhermehott
<https://www.linkedin.com/in/guilhermehott>
--
*Guilherme Hott*
/Software Engineer/
Skype: guilhermehott
@guilhermehott
https://www.linkedin.com/in/guilhermehott
