Andy Grove created ARROW-9716: --------------------------------- Summary: [Rust] [DataFusion] MergeExec should have concurrency limit Key: ARROW-9716 URL: https://issues.apache.org/jira/browse/ARROW-9716 Project: Apache Arrow Issue Type: Bug Components: Rust, Rust - DataFusion Reporter: Andy Grove Assignee: Andy Grove Fix For: 1.0.1, 2.0.0
MergeExec currently spins up one thread per input partition which causes apps to effectively hang if there are substantially more partitions than available cores. We can implement a configurable limit here pretty easily. -- This message was sent by Atlassian Jira (v8.3.4#803005)