Re: ParDo with Timer hangs when running under TestStream

2017-12-13 Thread Andrew Jones
Thanks Kenn. I've tried adding calls to advanceProcessingTime[1], but it doesn't seem to be helping. The test still hangs after processing all the data. Is this because I'm using the global window? So the window itself doesn't ever get closed? The point about the expiry timer is a good one, thanks.

Permissions

2017-12-13 Thread Joshua Fox
Documenation from Google says "To access a Datastore owned by a different Cloud Platform project, you'll need to add your Dataflow project's Compute Engine (- comp...@developer.gse

Re: ParDo with Timer hangs when running under TestStream

2017-12-13 Thread Kenneth Knowles
Hi Andrew, As someone else pointed out to me, I didn't read your code carefully enough. Your timer is an event time timer so it should fire. I've filed https://issues.apache.org/jira/browse/BEAM-3341 for investigation. Kenn On Wed, Dec 13, 2017 at 5:53 AM, Andrew Jones wrote: > Thanks Kenn. I'

Re: ParDo with Timer hangs when running under TestStream

2017-12-13 Thread Andrew Jones
No problem, thanks! On Wed, 13 Dec 2017, at 14:30, Kenneth Knowles wrote: > Hi Andrew, > > As someone else pointed out to me, I didn't read your code carefully > enough. Your timer is an event time timer so it should fire. I've > filed https://issues.apache.org/jira/browse/BEAM-3341 for > invest