Unit testing Async Operator

2021-02-16 Thread Arpith techy
Hi, I tried mocking the Async operator which takes Tuple1, Tuple3 as Input & Output but while creating a test harness I couldn't find the right TupleSerializer. Can anyone help me on this? public class GetMetadataAsyncProcess extends RichAsyncFunction>>, Tuple3>, Map, List>>> { ... } private

[no subject]

2020-12-11 Thread Arpith techy

Flink Kafka Consumer Throughput reduces over time

2020-03-31 Thread Arpith techy
Currently I've Flink consumer with following properties, Flink consumes record at around 400 messages/sec at start of program but later on as numBuffersOut exceeds 100, data rate falls to 200messages/sec. I've set parallelism to only 1, it's Avro based consumer and checkpointing is disabled. D