Can I create user defined stream processing function/api?

2017-03-06 Thread Wang LongTian
Dear folks, Background: I'm leaning Kafka stream and want to use that in my product for real time streaming process with data from various sensors. Question: 1. Can I define my own processing function/api in Kafka stream except the predefined functions like groupby(), count() etc.? 2. If I

How to connect Modbus, DNP or IEC61850 data to Kafka

2016-12-03 Thread Wang LongTian
Dear all gurus, I'm new to Kafka and I'm going to connect the real time data steaming from power system supervision and control devices to Kafka via different communication protocols for example Modbus, DNP or IEC61850 and next to Storm processing system. I'm wondering how can I get these data