I don't think there is a silver bullet solution to avoid an OOM but there are mitigations you can employ if there is a problem, such as: - sizing the workers appropriately, - avoiding memory leaks in the user code, - limiting worker-level parallelism, if necessary.
- Calling external programs in the pipeline - is it feas... Tadas Šubonis
- Re: Calling external programs in the pipeline - i... Luke Cwik
- Re: Calling external programs in the pipeline... Tadas Šubonis
- Re: Calling external programs in the pipe... Valentyn Tymofieiev
- Re: Calling external programs in the ... Robert Bradshaw
- Re: Calling external programs in... Tadas Šubonis
- Re: Calling external program... Valentyn Tymofieiev
