Re: Default Timestamp and Watermark

2017-01-26 Thread Kenneth Knowles
On Thu, Jan 26, 2017 at 9:48 AM, Thomas Groh wrote: > > The default watermark policy for a bounded source should be negative > infinity until all of the data is read, then positive infinity. Just to elaborate - there isn't a way for a bounded source to communicate a

Re: Default Timestamp and Watermark

2017-01-26 Thread Thomas Groh
The default timestamp should be BoundedWindow.TIMESTAMP_MIN_VALUE, which is equivalent to -2**63 microseconds. We also occasionally refer to this timestamp as "negative infinity". The default watermark policy for a bounded source should be negative infinity until all of the data is read, then

Default Timestamp and Watermark

2017-01-25 Thread Shen Li
Hi, When reading from a source with no timestamp specified on elements, what should be the default timestamp? I presume that it should be 0 as I saw PAssertTest trying to set timestamps to very small values with 0 allowed timestamp skew. Is that right? What about the default watermark policy?