Hi folks,
I had been working on flume which use thrift server to receive data
recently and encountered a problem. After removing all the user logic and
only keep the thrift server code, I try to use ~4000 thrift clients to send
data(~1MB per rpc) simultaneously to one thrift server. Seems like the
thrift server can't work well and there're lots of data in the recv-q which
consumes up all the tcp_mem(/proc/sys/net/ipv4/tcp_mem ) of the OS (cent
OS), thus causing node's network down. I had tried THaHsServer,
TThreadedSelectorServer and TThreadPoolServer, but none worked well enough
to solve the problem. I had also tried to increase the selector threads and
other args. Any suggestions? Thank you very much and have a good day.
