kafka latency for large message

2019-03-14 Thread Xu, Nan
Hi, We are using kafka to send messages and there is less than 1% of message is very big, close to 30M. understanding kafka is not ideal for sending big messages, because the large message rate is very low, we just want let kafka do it anyway. But still want to get a reasonable

manually trigger log compaction

2018-09-26 Thread Xu, Nan
Hi, Wondering is there a way to manually trigger a log compaction for a certain topic? Thanks, Nan -- This message, and any attachments, is for the intended recipient(s) only, may contain information that is privileged,

RE: kafka stream latency

2018-08-24 Thread Xu, Nan
Hi Guozhang, Here is the very simple kafka producer/consumer/stream app, using the latest version and just create 2 topics input and output all component are just running on localhost. Sorry, git hub is not allowed from work, nor java extension file Thanks, Nan -Original