Ok, thanks for letting us know!
On Thu, 2 Feb 2017 at 17:40 Sujit Sakre wrote:
> Implementing this formula seems to have solved our problem now. Thanks.
>
> On 2 February 2017 at 21:21, Sujit Sakre
> wrote:
>
> Hi Aljoscha,
>
> Thanks for your response.
>
> We wanted to customize the watermark
Implementing this formula seems to have solved our problem now. Thanks.
On 2 February 2017 at 21:21, Sujit Sakre
wrote:
> Hi Aljoscha,
>
> Thanks for your response.
>
> We wanted to customize the watermark period calculation since we were not
> getting the desired results with BoundedOutOfOrdern
Hi Aljoscha,
Thanks for your response.
We wanted to customize the watermark period calculation since we were not
getting the desired results with BoundedOutOfOrdernessGenerator class.
As for the current problem, we have identified the problem of why the
records are not processed as expected. It
Hi,
what about using BoundedOutOfOrdernessGenerator? Why did that not work for
your case?
Cheers,
Aljoscha
On Mon, 30 Jan 2017 at 17:20 Sujit Sakre
wrote:
> Hi Robert, Aljoscha,
>
> Many thanks for pointing out. Watermark generation is the problem. It is
> generating timestamps far ahead of cur
Hi Robert, Aljoscha,
Many thanks for pointing out. Watermark generation is the problem. It is
generating timestamps far ahead of current year due to our code which tried
to cover all records but inadvertently made a very large watermark.
We have tried fixing this with other combinations of genera
Hi,
I would guess that the watermark generation does not work as expected.
I would recommend to log the extracted timestamps + the watermarks to
understand how time is progressing, and when watermarks are generated to
trigger a window computation.
On Tue, Jan 24, 2017 at 6:53 PM, Sujit Sakre
wrot
Hi Aljoscha,
Thanks.
Yes, we are using Event Time.
Yes, Flink program is kept running in the IDE, i.e. eclipse and not closed,
after the first batch of events and when adding the second batch.
Yes, We do have acustom timestamp/watermark assigner, implemented as
BoundedOutOfOrdernessGenerator2
A
Hi,
a bit more information would be useful. Are you using event-time? Is the
Flink program kept running after adding the first batch of events and when
adding the second batch or is it to invocations of your Flink program? Do
you have a custom timestamp/watermark assigner?
Cheers,
Aljoscha
On Tue
Hi,
We are using a sliding window function to process data read from Kafka
Stream. We are using FlinkKafkaConsumer09 to read the data. The window
function and sink are running correctly.
To test the program, we are generating a stream of data from command line.
This works when we add set of recor
