lity. We’re on Ubuntu
12.04 and plan to try on 14.04 with the latest HWE to see if that
helps any.
Thanks!
Wes Chow <mailto:w...@chartbeat.com>
June 2, 2015 at 1:39 PM
We have run d2 instances with Kafka. They're currently unstable --
Amazon confirmed a host issue with d2 instances
y workarounds for the d2 issues? We’ve been using them
for our Kafkas too, and ran into the instability. We’re on Ubuntu
12.04 and plan to try on 14.04 with the latest HWE to see if that
helps any.
Thanks!
Wes Chow <mailto:w...@chartbeat.com>
June 2, 2015 at 1:39 PM
We have run d2 in
We have run d2 instances with Kafka. They're currently unstable --
Amazon confirmed a host issue with d2 instances that gets tickled by a
Kafka workload yesterday. Otherwise, it seems the d2 instance type is
ideal as it gets an enormous amount of disk throughput and you'll likely
be network b
Along these lines too, is the function customizable? I could see how
mmh3 (or 2) would be generally sufficient, however in some cases you may
want something that's a bit more cryptographically secure so as to avoid
attacks.
(Though I suppose the programmer could first crypto-hash the key, an
ve partition info included.
From: Wes Chow mailto:w...@chartbeat.com>>
Reply-To: "users@kafka.apache.org <mailto:users@kafka.apache.org>"
mailto:users@kafka.apache.org>>
Date: Tuesday, April 21, 2015 at 10:50 AM
To: "users@kafka.apache.org <mailto:users@ka
ated if new replicas is assigned to the broker.
We might want to know what caused the UnknownException. Did you see any
error log on broker 28?
Jiangjie (Becket) Qin
Wes Chow <mailto:w...@chartbeat.com>
April 21, 2015 at 12:16 PM
I started a partition reassignment (this is a 8.1.1 cluste
I started a partition reassignment (this is a 8.1.1 cluster) some time
ago and it seems to be stuck. Partitions are no longer getting moved
around, but it seems like the cluster is operational otherwise. The
stuck nodes have a lot of .index files, and their
logs show errors
We run with 1000's of partitions too and that's fine. However you
shouldn't expect to be able to run a consumer per user under your model.
Each of your consumers would be discarding most of the data they're
ingesting. In fact, the would be throwing away 24 times more data than
what they proce
After initiating partition reassignment, does Kafka try to move all
partitions at once or does it do a subset at a time?
Thanks,
Wes
We're showing a constant level of unclean leader election errors. I'd
like to investigate but I'm not quite sure how to approach it. Is there
a doc somewhere that goes into some detail on what to look at?
Thanks,
Wes
I'm in the process of reassigning partitions away from failing machines
and it appears to be stuck. One thought is because our machines are
failing at a very high rate and so some partitions no longer have any
live replicas at all. At this point I don't care about the data, I just
want to get
How reusable are node ids? Specifically:
1. Node goes down and loses all data in its local Kafka logs. I bring it
back up, same hostname, same IP, same node id, but with empty logs. Does
it properly sync with the replicas and continue operation?
2. Node goes down and I replace it with a new
I'm trying to understand the config options for auto-rebalancing. This
is what we have in /etc/kafka/server.properties for all the nodes:
auto.leader.rebalance.enable=true
leader.imbalance.per.broker.percentage=10
leader.imbalance.check.interval.seconds=300
We have 10 nodes for this topic which
13 matches
Mail list logo
