Dandandan opened a new issue #697: URL: https://github.com/apache/arrow-datafusion/issues/697
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** Currently, when polling for work, the executor always waits 250 second in between receiving tasks. This means if the tasks themselves are small, it can be unproductive for a large percent of the time. We can track whether we received tasks in the last iterations to avoid sleeping. Also a slightly lower sleep time (e.g. 100ms) can help reduce the initial delay. **Describe the solution you'd like** Track whether we received tasks in the last iterations to avoid sleeping. **Describe alternatives you've considered** n/a **Additional context** n/a -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
