[ https://issues.apache.org/jira/browse/ARROW-13155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Weston Pace reassigned ARROW-13155: ----------------------------------- Assignee: Weston Pace > [C++] MapGenerator should optionally forward reentrant pressure > --------------------------------------------------------------- > > Key: ARROW-13155 > URL: https://issues.apache.org/jira/browse/ARROW-13155 > Project: Apache Arrow > Issue Type: Bug > Components: C++ > Reporter: Weston Pace > Assignee: Weston Pace > Priority: Major > Labels: pull-request-available > Time Spent: 1h 10m > Remaining Estimate: 0h > > Currently the map generator will allow the map function to run in parallel > but it will not forward reentrant pressure onto the source generator. > Instead it queues requests. > In some cases this is the right decision (if source is not async reentrant) > but in some cases we want it to forward the pressure (so that the entire > chain can run in parallel). > By making it an option when the mapped generator is created we can allow > pressure to be forwarded where appropriate. > > Phrasing it another way. If we have source, map function A, map function B, > map function C, and then a reentrant pull we would currently only run C in > parallel. -- This message was sent by Atlassian Jira (v8.20.10#820010)