Kinesis conector and record aggregation

2019-09-05 Thread Yoandy Rodríguez
plications. Is there another way to disable record aggregation? -- Best Regards Yoandy Rodríguez

Kinesis stream and serialization schemas

2019-09-02 Thread Yoandy Rodríguez
inggetTargetStream(Stringelement) { returnnull; } }, producerConfig); But that's not working either. What are we doing wrong?. Thanks in advance -- Best Regards Yoandy Rodríguez

Flink Kinesis Producer and records

2019-08-27 Thread Yoandy Rodríguez
nce in the consumer application I get multiple output items for each call to GetRecord. Is this expected behavior? Thanks in advance -- Best Regards Yoandy Rodríguez

Custom Windows/Triggers/Evictors examples or tutorials

2019-08-12 Thread Yoandy Rodríguez
Hello Again, I'm looking for some examples of how to implement custom windows/triggers/evictors using flink 1.6.4, a simple search gives me surprisingly little about the subject. Can you point me to some repos, talks, tutorials? -- Best Regards Yoandy Rodríguez

Re: Can Flink help us solve the following use case

2019-08-08 Thread Yoandy Rodríguez
ote: > > You could do this using custom triggers and evictors in Flink. > That way you can control when the windows fire and what elements > are fired with it. And lastly the custom evictors know when to > remove elements from the window. > > Yes Flink can supp

Can Flink help us solve the following use case

2019-08-07 Thread Yoandy Rodríguez
Hello everybody, We have the following situation: 1) A data stream which collects all system events (near 1/2 a mil per day). 2) A database storing some aggregation of the data. We want to split the data into different "time slices" and be able to "tag it" accordingly. Example: the events in

pattern to detect if event field changed

2019-07-30 Thread Yoandy Rodríguez
Hello, I have a stream of events in the form (key, field1, field2) and I would like to detect every time field2 value changes and emit a new event on another stream.  I searched StackOverflow and [1] was the closest to my use case but not quite since I don't have a pattern to match. Is it poss