Re: kafka latency for large message

that's very good information from the slides, thanks. Our design to use kafka has 2 purpose. one is use it as a cache, we use ktable for that purpose, second purpose is use as message delivery mechanism to send it to other system. Because we very much care the latency, the ktable with a compact

Re: kafka latency for large message

Hi Nan, Would you consider other approaches that may actually be a more efficient solution for you? There is a slide deck Handle Large Messages In Apache Kafka . For messages this large, one of the approaches

Re: kafka latency for large message

It takes time to send that much data over the network. Why would you expect a smaller latency? On Mon, Mar 18, 2019 at 8:05 AM Nan Xu wrote: > anyone can give some suggestion? or an explanation why kafka give a big > latency for large payload. > > Thanks, > Nan > > On Thu, Mar 14, 2019 at 3:53

Re: kafka latency for large message

anyone can give some suggestion? or an explanation why kafka give a big latency for large payload. Thanks, Nan On Thu, Mar 14, 2019 at 3:53 PM Xu, Nan wrote: > Hi, > > We are using kafka to send messages and there is less than 1% of > message is very big, close to 30M. understanding kafka

kafka latency for large message

Hi, We are using kafka to send messages and there is less than 1% of message is very big, close to 30M. understanding kafka is not ideal for sending big messages, because the large message rate is very low, we just want let kafka do it anyway. But still want to get a reasonable