Logcompaction with Kafka and how to send nulls or empty payloads

2018-05-31 Thread Guillermo Ortiz
I don't understand how logcompaction works. I have create an configure a topic and consume from this topic kafka-topics --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic COMPACTION10 kafka-topics --alter --zookeeper localhost:2181 --config

Re: Kafka Connect in different nodes than Kafka.

2017-02-01 Thread Guillermo Ortiz
no > at this time, you need to download and install the entire Kafka > distribution in order to get the bits needed to run Kafka Connect. > > -hans > > > > > > On Feb 1, 2017, at 11:08 AM, Guillermo Ortiz <konstt2...@gmail.com> > wrote: > > > > Is it pos

Kafka Connect in different nodes than Kafka.

2017-02-01 Thread Guillermo Ortiz
Is it possible to use Kafka Connect in nodes where isn't Kafka installed? I can't see on the documentation anything about installed in others nodes.

Kafka Connect in different hosts than Kafka

2017-02-01 Thread Guillermo Ortiz
Hello, I'm going to use Kafka Connect (with Apache Ignite). I guess that it's possible to install Kafka-Connect in others machines different than Kafka, is it recommended? Are you going to lose some data locallity? is it enough smart Kafka-connect to get this data locallity? how much resources

Number of partitions and disks in a topic

2015-12-01 Thread Guillermo Ortiz
Hello, I want to size the kafka cluster with just one topic and I'm going to process the data with Spark and others applications. If I have six hard drives per node, is it kafka smart enough to deal with them? I guess that the memory should be very important in this point and all data is cached