Weston Pace created ARROW-14367:
-----------------------------------
Summary: [C++][Python] Add some kind of user-visible signal when
backpressure is applied
Key: ARROW-14367
URL: https://issues.apache.org/jira/browse/ARROW-14367
Project: Apache Arrow
Issue Type: Improvement
Reporter: Weston Pace
Initially this will be specific to datasets (since we have don't have well
defined backpressure in the plan itself yet) but there should be a way for a
consumer to inspect an executing datasets operation to know if backpressure is
being applied because they are consuming the data too slowly.
A simple implementation might be a callback that is triggered each time
backpressure is applied. Longer term we might want something with more
extensive visibility into a running query that is integrated with any tracing
utilities.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
