Re: AWS EFS

to saturate the network interface the EFS volume is mounted on. I am personally evaluating EFS for usecases where I need to share data for content delivery or as a scratch space for PostgreSQL WAL logs for for example. Cheers, -pete -- Pete Wright Lead Systems Architect Rubicon

Re: [DISCUSS] Java 8 as a minimum requirement

l these issues have been addressed, this would cause some serious issues > for us. > I can second this on the FreeBSD front. -pete -- Pete Wright Lead Systems Architect Rubicon Project pwri...@rubiconproject.com 310.309.9298

Re: Introducing Dory

cluster. I could see this being something worth persuing if you are handling data that is critical for financial reasons (as opposed to data used for non-financial reporting or metrics). -pete -- Pete Wright Lead Systems Architect Rubicon Project pwri...@rubiconproject.com 310.309.9298

Re: Using lz4 compression

with the lz4 code as implemented in kafka, but i would assume the java implementation is pretty solid. hope this helps, -pete -- Pete Wright Lead Systems Architect Rubicon Project pwri...@rubiconproject.com 310.309.9298

Re: LVM overhead

the stripe in software as opposed to hardware. Hope this helps! -pete On 02/11/16 07:24, yazgoo wrote: > Hi everyone, > > I have multiple disks on my broker. > Do you know if there's a noticeable overhead using LVM versus multiple > log.dirs ? > > Thanks > --

Re: Kafka and Btrfs

S support for Linux here: http://zfsonlinux.org/ http://open-zfs.org/wiki/Main_Page Hope this helps - and doesn't start a huge bikeshed discussion :) Cheers, -pete -- Pete Wright Lead Systems Architect Rubicon Project pwri...@rubiconproject.com 310.309.9298

noticing blocking of kafka-network-thread

object these threads are seeing contention on? Thanks in advance! -pete -- Pete Wright Lead Systems Architect Rubicon Project pwri...@rubiconproject.com 310.309.9298

Re: Design questions related to kafka

the same message twice? Cheers, -pete -- Pete Wright Lead Systems Architect Rubicon Project pwri...@rubiconproject.com 310.309.9298

Re: Updates To cwiki For Producer

20, 2015 at 11:24 AM, Pete Wright pwri...@rubiconproject.com wrote: Thanks that's helpful. I am working on an example producer using the new API, if I have any helpful notes or examples I'll share that. I was basically trying to be lazy and poach some example code as a starting point for our

Re: Updates To cwiki For Producer

at 4:37 PM, Pete Wright pwri...@rubiconproject.com wrote: Hi, Is there a plan to update the producer documentation on the wiki located here: https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+Producer+Example This would be helpful for people working on implementing the new producer

Updates To cwiki For Producer

for this or other docs available for reference that would be helpful as well. Thanks! -pete -- Pete Wright Lead Systems Architect Rubicon Project pwri...@rubiconproject.com 310.309.9298

Re: Sizing Cluster

/configuration.html Thanks Istvan - this is helpful. Cheers, -pete -- Pete Wright Systems Architect Rubicon Project pwri...@rubiconproject.com 310.309.9298

Sizing Cluster

producers to write to? Is there any overhead I should be concerned with? I guess I am just wanting to make sure that there are not any major pitfalls in deploying a two-node cluster, versus say a 3-node cluster. Any advice or best-practices would be very helpful! Thanks in advance, -pete -- Pete

Re: Sizing Cluster

21, 2014 at 11:12 AM, Pete Wright pwri...@rubiconproject.com wrote: Hi There, I have a question regarding sizing disk for kafka brokers. Let's say I have systems capable of providing 10TB of storage, and they act as Kafka brokers. If I were to deploy two of these nodes, and enable