Anyone using this combination for prod? I am planning to use for a use case with 15000 events per second from few Kafka topics. Through events are big, I would just have to take the businessIds, frequency, first and last event timestamp and save this into mapGroupWithState. I need to keep them for a window if say 20 mins then push them to output Kafka. Total memory of the state will not be more than say 50MB as I have limited number of businessIds say 1 million. Questions, 1.Want you to share any issues you might have faced or I may face. 2. How to debug if I am unable to keep up with inflow of events and lag is increasing constantly?
Regards Sri