Hi everyone,
We are a team of researchers at Boston University investigating the energy and performance behavior of open-source stream processing platforms. We have started looking into Flink and we wanted to reach out to community to see if anyone has tried to optimize the underlying OS/VM/container to achieve these outcomes. Some of the specific aspects we would like to explore include the following: What Linux kernel configurations are used? Has any OS tuning been done? What workloads are used to evaluate performance/efficiency, both for turning and more generally to evaluate the impact of changes to either the software or hardware? What is considered a baseline network setup, with respect to both hardware and software? Has anyone investigated the policy used in terms of the cpufreq governor ( https://www.kernel.org/doc/Documentation/cpu-freq/governors.txt)? It would be especially helpful to hear from people running Flink in production or offering it as a service. Thank you! Sana
