Re: linkedin and pageview producer + when kafka is down

2014-06-17 Thread Neha Narkhede
1. do you use a single producer for all message types/topics? Not really. It is typical for a java service/process to have multiple producers sending to different topics 2. For your pageview topic i.e. it is getting sent on a per page request (albiet it is batched): *What happens when your

linkedin and pageview producer + when kafka is down

2014-06-16 Thread S Ahmed
I'd love to get some insights on how things work at linkedin in terms of your web servers and kafka producers. You guys probably connect to multiple kafka clusters, so let's assume you are only connecting to a single cluster. 1. do you use a single producer for all message types/topics? 2. For