Re: How to connect Modbus, DNP or IEC61850 data to Kafka

[hans]

If the data volumes are low or you just want a quick prototype as a proof of 
concept you could use existing tools like node-red to connect the various input 
protocols with Kafka as an output protocol. For example install from 
http://nodered.org then install node-red-contrib-modbus, then install 
node-red-contrib-rdkafka, connect and configure the inputs and outputs and you 
will have data flow. Same with just about any serial, TCP, or UDP based 
protocol.

If you want something higher performance or industrial strength you can find 
commercial or open source Kafka Connectors or write your own native Kafka 
Connector for each input protocol. There are over 150 Kafka Connectors already 
built (search for "kafka-connect-*" in github) and see the following connector 
landing page for more info on Kafka Connect 
https://www.confluent.io/product/connectors/


-hans



Sent from my iPhone
> On Dec 3, 2016, at 3:53 AM, Wang LongTian  wrote:
> 
> Dear all gurus,
> I'm new to Kafka and I'm going to connect the real time data steaming from 
> power system supervision and control devices to Kafka via different 
> communication protocols for example Modbus, DNP or IEC61850 and next to Storm 
> processing system. 
> I'm wondering how can I get these data via Kafka and I don't know whether 
> that's supported or not.
> 
> Any suggestion and hint are warmly welcomed!
> 
> Regards, 
> Long Tian
> 
> 

How to connect Modbus, DNP or IEC61850 data to Kafka

[Wang LongTian]

Dear all gurus,
I'm new to Kafka and I'm going to connect the real time data steaming from 
power system supervision and control devices to Kafka via different 
communication protocols for example Modbus, DNP or IEC61850 and next to Storm 
processing system. 
I'm wondering how can I get these data via Kafka and I don't know whether 
that's supported or not.

Any suggestion and hint are warmly welcomed!

Regards, 
Long Tian