Re: Kafka Connect in different hosts than Kafka

2017-02-01 Thread hans
In production it is recommended that you install Kafka Connect on a separate 
machine from the Kafka Brokers because brokers are recommended to run by 
themselves on dedicated machines. Connect can be on the same machine(s) as the 
target source or sink (Apache Ignite in your case) or somewhere else, it really 
depends on target system. You have a lot of flexibility with where Connect runs 
and in distributed mode it stores most data in Kafka anyway. Most connectors do 
not use a lot of resources and often connectors run on machines shared with 
other apps.

-hans


> On Feb 1, 2017, at 2:50 AM, Guillermo Ortiz  wrote:
> 
> Hello,
> 
> I'm going to use Kafka Connect (with Apache Ignite). I guess that it's
> possible to install Kafka-Connect in others machines different than Kafka,
> is it recommended? Are you going to lose some data locallity? is it enough
> smart Kafka-connect to get this data locallity? how much resources does
> Kafka Connect consume?


Kafka Connect in different hosts than Kafka

2017-02-01 Thread Guillermo Ortiz
Hello,

I'm going to use Kafka Connect (with Apache Ignite). I guess that it's
possible to install Kafka-Connect in others machines different than Kafka,
is it recommended? Are you going to lose some data locallity? is it enough
smart Kafka-connect to get this data locallity? how much resources does
Kafka Connect consume?