RE: Kafka partitions unbalanced

2015-05-27 Thread Jonathan Creasy
I have a similar issue, let me know how it goes. :) -Original Message- From: Andrew Otto [mailto:ao...@wikimedia.org] Sent: Wednesday, May 27, 2015 3:12 PM To: users@kafka.apache.org Subject: Kafka partitions unbalanced Hi all, I’ve recently noticed that our broker log.dirs are using

Partition and Replica assignment for a Topic

2014-10-21 Thread Jonathan Creasy
I¹d like to be able to see a little more detail for a topic. What is the best way to get this information? Topic Partition Replica Broker topic1 1 1 3 topic1 1 2 4 topic1 1 3 1 topic1 2 1 1 topic1 2

Re: Partition and Replica assignment for a Topic

2014-10-21 Thread Jonathan Creasy
--describe --zookeeper localhost:2181 ? On Tue, Oct 21, 2014 at 4:29 PM, Jonathan Creasy jonathan.cre...@turn.com wrote: I¹d like to be able to see a little more detail for a topic. What is the best way to get this information? Topic Partition Replica Broker topic1 1 1

Re: Kafka Messages

2013-06-07 Thread Jonathan Creasy
with metadata. The latter is typically a protocol-specific envelope. Kafka and Rabbit certainly have different envelopes, eg for mapping data to subscribers/queries. alexis -- ** *Jonathan Creasy* | Sr. Ops Engineer e: j...@box.com | t: 314.580.8909

Re: Kafka Messages

2013-06-07 Thread Jonathan Creasy
application(s) writing directly to Kafka you instead have a separate process running that will tail log files and ship them over to Kafka. Is that correct? On Jun 7, 2013, at 5:33 PM, Jonathan Creasy j...@box.com wrote: I recommend Kafka or Flume-NG for this. Our Analytics team is using a Kafka

Re: large amount of disk space freed on restart

2013-05-22 Thread Jonathan Creasy
It isn't uncommon if a process has an open file handle on a file that is deleted, the space is not freed until the handle is closed. So restarting the process that has a handle on the file would cause the space to be freed also. You can troubleshoot that with lsof. Normally, I see 2-4 log

Re: large amount of disk space freed on restart

2013-05-22 Thread Jonathan Creasy
? Jason On Wed, May 22, 2013 at 9:50 PM, Jonathan Creasy j...@box.com wrote: It isn't uncommon if a process has an open file handle on a file that is deleted, the space is not freed until the handle is closed. So restarting the process that has a handle on the file would cause the space

Re: Using Stunnel to encrypt/authenticate Kafka producers and consumers...

2013-04-22 Thread Jonathan Creasy
of servers via the API, and finally try to connect directly to one of those Kafka servers rather than just leveraging the existing connection through the ELB. Thoughts? --Matt -- ** *Jonathan Creasy* | Sr. Ops Engineer e: j...@box.com | t: 314.580.8909

Re: Linux Packages

2013-03-29 Thread Jonathan Creasy
-- ** *Jonathan Creasy* | Sr. Ops Engineer e: j...@box.com | t: 314.580.8909