We have an application that, when run in Hadoop, may cause a very large
number (up to 1000) clients to attempt connections to the message broker
simultaneously. Currently we use a custom TCP protocol, and I find that when
there are that many inbound connections, the OS starts to refuse them, and I
Hello everyone,
As was recently mentioned [1], we started to analyze the currently used
queue system. During the first iteration, we started to test reliability.
Testing environment:
AWS
Hardware:
| Producer | m5.large | 2vCPU / 8GiB |
| Consumer | t3.medium | 2vCPU / 2GiB |
Software:
OS: