Re: Behaviour of Windows on Shutdown

[Konstantin Knauf]

Hi Ajoscha,

thank you for the quick answer and sorry for the double-post.

Cheers,

Konstantin

On 17.02.2016 19:20, Aljoscha Krettek wrote:
> Hi,
> we changed it a while back to not emit any buffered elements at the end 
> because we noticed that that would be a more natural behavior. This must be 
> an oversight on our part. I’ll make sure that the 1.0 release will have the 
> correct behavior.
>> On 17 Feb 2016, at 16:35, Konstantin Knauf  
>> wrote:
>>
>> Hi everyone,
>>
>> if a DataStream is created with .fromElements(...) all windows emit all
>> buffered records at the end of the stream. I have two questions about this:
>>
>> 1) Is this only the case for streams created with .fromElements() or
>> does this happen in any streaming application on shutdown?
>>
>> 2) Is there a configuration option to disable this behaviour, such that
>> buffered events remaining in windows are just discarded?
>>
>> In our application it is critical, that only events, which were
>> explicitly fired are emitted from the windows.
>>
>> Cheers and thank you,
>>
>> Konstantin
>>
>> -- 
>> Konstantin Knauf * konstantin.kn...@tngtech.com * +49-174-3413182
>> TNG Technology Consulting GmbH, Betastr. 13a, 85774 Unterföhring
>> Geschäftsführer: Henrik Klagges, Christoph Stock, Dr. Robert Dahlke
>> Sitz: Unterföhring * Amtsgericht München * HRB 135082
> 
> 

-- 
Konstantin Knauf * konstantin.kn...@tngtech.com * +49-174-3413182
TNG Technology Consulting GmbH, Betastr. 13a, 85774 Unterföhring
Geschäftsführer: Henrik Klagges, Christoph Stock, Dr. Robert Dahlke
Sitz: Unterföhring * Amtsgericht München * HRB 135082

Re: Behaviour of Windows on Shutdown

[Aljoscha Krettek]

Hi,
did the first mail from me not arrive? I’m sending it again:

we changed it a while back to not emit any buffered elements at the end because 
we noticed that that would be a more natural behavior. This must be an 
oversight on our part. I’ll make sure that the 1.0 release will have the 
correct behavior.

> On 17 Feb 2016, at 16:18, Konstantin Knauf  
> wrote:
> 
> Hi everyone,
> 
> if a DataStream is created with .fromElements(...) all windows emit all
> buffered records at the end of the stream. I have two questions about this:
> 
> 1) Is this only the case for streams created with .fromElements() or
> does this happen in any streaming application on shutdown?
> 
> 2) Is there a configuration option to disable this behaviour, such that
> buffered events remaining in windows are just discarded?
> 
> In our application it is critical, that only events, which were
> explicitly fired are emitted from the windows.
> 
> Cheers and thank you,
> 
> Konstantin
> 

Re: Behaviour of Windows on Shutdown

[Aljoscha Krettek]

Hi,
we changed it a while back to not emit any buffered elements at the end because 
we noticed that that would be a more natural behavior. This must be an 
oversight on our part. I’ll make sure that the 1.0 release will have the 
correct behavior.
> On 17 Feb 2016, at 16:35, Konstantin Knauf  
> wrote:
> 
> Hi everyone,
> 
> if a DataStream is created with .fromElements(...) all windows emit all
> buffered records at the end of the stream. I have two questions about this:
> 
> 1) Is this only the case for streams created with .fromElements() or
> does this happen in any streaming application on shutdown?
> 
> 2) Is there a configuration option to disable this behaviour, such that
> buffered events remaining in windows are just discarded?
> 
> In our application it is critical, that only events, which were
> explicitly fired are emitted from the windows.
> 
> Cheers and thank you,
> 
> Konstantin
> 
> -- 
> Konstantin Knauf * konstantin.kn...@tngtech.com * +49-174-3413182
> TNG Technology Consulting GmbH, Betastr. 13a, 85774 Unterföhring
> Geschäftsführer: Henrik Klagges, Christoph Stock, Dr. Robert Dahlke
> Sitz: Unterföhring * Amtsgericht München * HRB 135082