BTW - you could download the jars directly from maven central if you want,
for example:
http://search.maven.org/#search|ga|1|a%3A%22kafka-clients%22
http://search.maven.org/#search|ga|1|a%3A%22spark-streaming-kafka-assembly_2.11%22%20AND%20v%3A%221.5.2%22
Ofir
On Tue, Nov 17, 2015 at 9:36 PM,
Hi,
log.cleanup.policy is the server-level parameter.
The per-topic parameter you are looking for is just cleanup.policy
See here - http://kafka.apache.org/documentation.html#topic-config
Also, it is listed in the help:
$ kafka-topics.sh
Create, delete, describe, or change a topic.
Option
Hi,
I think this is the best reference on the actual trade-off (more/less
partitions):
http://www.confluent.io/blog/how-to-choose-the-number-of-topicspartitions-in-a-kafka-cluster/
As a guess, for a three-node Kafka cluster, I don't see how useful would be
to have 1024 consumers in a single consum
Hi,
I've run into similar issues in the past (in 0.8.2), in a script that
re-creates a topic setup for testing (delete + create).
I added a one second sleep between delete and create, it solved the
sporadic topic creation failure for me.
I hope that helps,
Ofir
On Thu, Dec 31, 2015 at 5:39 AM,
functionality be backported to 0.10.x
clients if deemed critical? (don't have an answer, but this is the right
question IMHO)
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +972-54-7801286 | Email: ofir.ma...@equalum.io
On Thu, Jun 16, 2016 at 11:45 PM, Ismael Juma wrote:
> Hi all,
yourself - create a topic with some partitions,
send some data and observe the log dir(s) (based on log.dir or log.dirs in
the broker config)
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +972-54-7801286 | Email: ofir.ma...@equalum.io
On Tue, May 16, 2017 at 12:44 PM, kant kodali wrote:
>
rds
in the log based on their need, etc etc.
So, Kafka separates producing messages, consuming messages and managing the
logs.
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +972-54-7801286 | Email: ofir.ma...@equalum.io
On Sat, Sep 17, 2016 at 10:49 PM, kant kodali wrote:
> Still it shou
Check the Security section of the documentation, especially authorization
(which means also authentication)
http://kafka.apache.org/documentation.html
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +972-54-7801286 | Email: ofir.ma...@equalum.io
On Tue, Nov 22, 2016 at 9:13 PM, ravi singh w
cy,
100.0 max latency.
6670 records sent, 1334.0 records/sec (1.30 MB/sec), 2.1 ms avg latency,
15.0 max latency.
records sent, 1333.2 records/sec (1.30 MB/sec), 2.6 ms avg latency,
67.0 max latency.
^C
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +972-54-7801286 | Email: ofir.ma...@equalum.io
