seddonm1 commented on pull request #9523: URL: https://github.com/apache/arrow/pull/9523#issuecomment-786185550
@edrevo We should revert if there is an issue. This change puts the await per input partition so I thought it would wait until that partition is fully processed with the maximum limited by the `tokio::spawn` rules thus limiting memory? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
