Paul Poulosky created STORM-1380: ------------------------------------ Summary: Automatic Tuple Compression for Worker / Worker connections Key: STORM-1380 URL: https://issues.apache.org/jira/browse/STORM-1380 Project: Apache Storm Issue Type: New Feature Components: storm-core Reporter: Paul Poulosky
We have seen issues with topologies that are resource constrained by network capacity much more than cpu constrained. They are sending large numbers of large tuples worker to worker and hitting bandwidth limitations inter-node, intra-rack, and inter-rack. In situations like this, it would be useful to have an option for a topology to automatically compress any data leaving a worker, and automatically decompress it as it arrives based on a topology setting. -- This message was sent by Atlassian JIRA (v6.3.4#6332)