It is logged from RecurringTimer#loop():
private def loop() {
try {
while (!stopped) {
clock.waitTillTime(nextTime)
callback(nextTime)
prevTime = nextTime
nextTime += period
logDebug("Callback for " + name + " called at time " + prevTime)
}
For the callback, JobGenerator has this:
private val timer = new RecurringTimer(clock,
ssc.graph.batchDuration.milliseconds,
longTime => eventActor ! GenerateJobs(new Time(longTime)),
"JobGenerator")
...
/** Generate jobs and perform checkpoint for the given `time`. */
private def generateJobs(time: Time) {
Cheers
On Thu, Mar 26, 2015 at 6:55 AM, Adrian Mocanu <[email protected]>
wrote:
> Here’s my log output from a streaming job.
>
> What is this?
>
>
>
>
>
> 09:54:27.504 [RecurringTimer - JobGenerator] DEBUG
> o.a.s.streaming.util.RecurringTimer - Callback for JobGenerator called at
> time 1427378067504
>
> 09:54:27.505 [RecurringTimer - JobGenerator] DEBUG
> o.a.s.streaming.util.RecurringTimer - Callback for JobGenerator called at
> time 1427378067505
>
> 09:54:27.506 [RecurringTimer - JobGenerator] DEBUG
> o.a.s.streaming.util.RecurringTimer - Callback for JobGenerator called at
> time 1427378067506
>
> 09:54:27.508 [RecurringTimer - JobGenerator] DEBUG
> o.a.s.streaming.util.RecurringTimer - Callback for JobGenerator called at
> time 1427378067507
>
> 09:54:27.508 [RecurringTimer - JobGenerator] DEBUG
> o.a.s.streaming.util.RecurringTimer - Callback for JobGenerator called at
> time 1427378067508
>
> 09:54:27.509 [RecurringTimer - JobGenerator] DEBUG
> o.a.s.streaming.util.RecurringTimer - Callback for JobGenerator called at
> time 1427378067509
>
> 09:54:27.510 [RecurringTimer - JobGenerator] DEBUG
> o.a.s.streaming.util.RecurringTimer - Callback for JobGenerator called at
> time 1427378067510
>
> 09:54:27.511 [RecurringTimer - JobGenerator] DEBUG
> o.a.s.streaming.util.RecurringTimer - Callback for JobGenerator called at
> time 1427378067511
>
> 09:54:27.512 [RecurringTimer - JobGenerator] DEBUG
> o.a.s.streaming.util.RecurringTimer - Callback for JobGenerator called at
> time 1427378067512
>
> 09:54:27.513 [RecurringTimer - JobGenerator] DEBUG
> o.a.s.streaming.util.RecurringTimer - Callback for JobGenerator called at
> time 1427378067513
>
> 09:54:27.514 [RecurringTimer - JobGenerator] DEBUG
> o.a.s.streaming.util.RecurringTimer - Callback for JobGenerator called at
> time 1427378067514
>
> 09:54:27.515 [RecurringTimer - JobGenerator] DEBUG
> o.a.s.streaming.util.RecurringTimer - Callback for JobGenerator called at
> time 1427378067515
>
> 09:54:27.516 [RecurringTimer - JobGenerator] DEBUG
> o.a.s.streaming.util.RecurringTimer - Callback for JobGenerator called at
> time 1427378067516
>
> 09:54:27.517 [RecurringTimer - JobGenerator] DEBUG
> o.a.s.streaming.util.RecurringTimer - Callback for JobGenerator called at
> time 1427378067517
>
> 09:54:27.518 [RecurringTimer - JobGenerator] DEBUG
> o.a.s.streaming.util.RecurringTimer - Callback for JobGenerator called at
> time 1427378067518
>
> 09:54:27.519 [RecurringTimer - JobGenerator] DEBUG
> o.a.s.streaming.util.RecurringTimer - Callback for JobGenerator called at
> time 1427378067519
>
> 09:54:27.520 [Recurri …
>
