Thanks Jiangie! So what version is considered the "new api"? Is that the javaapi in version 0.8.2?.
On Mon, Mar 9, 2015 at 2:29 PM, Jiangjie Qin <j...@linkedin.com.invalid> wrote: > The stickiness of partition only applies to old producer. In new producer > we have the round robin for each message. The batching in new producer is > per topic partition, the batch size it is controlled by both max batch > size and linger time config. > > Jiangjie (Becket) Qin > > On 3/9/15, 10:10 AM, "Corey Nolet" <cjno...@gmail.com> wrote: > > >I'm curious what type of batching Kafka producers do at the socket layer. > >For instance, if I have a partitioner that round robin's n messages to a > >different partition, am I guaranteed to get n different messages sent over > >the socket or is there some micro-batching going on underneath? > > > >I am trying to understand the semantics of the default partitioner and why > >it sticks to partitions for 10 minutes. If I were to lower that interval > >to > >1sec, would I acheive better batching that I would if I was to completely > >round-robin each message to a different partition? > >