[ 
https://issues.apache.org/jira/browse/ARROW-13155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Weston Pace reassigned ARROW-13155:
-----------------------------------

    Assignee: Weston Pace

> [C++] MapGenerator should optionally forward reentrant pressure
> ---------------------------------------------------------------
>
>                 Key: ARROW-13155
>                 URL: https://issues.apache.org/jira/browse/ARROW-13155
>             Project: Apache Arrow
>          Issue Type: Bug
>          Components: C++
>            Reporter: Weston Pace
>            Assignee: Weston Pace
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> Currently the map generator will allow the map function to run in parallel 
> but it will not forward reentrant pressure onto the source generator.  
> Instead it queues requests.
> In some cases this is the right decision (if source is not async reentrant) 
> but in some cases we want it to forward the pressure (so that the entire 
> chain can run in parallel).
> By making it an option when the mapped generator is created we can allow 
> pressure to be forwarded where appropriate.
>  
> Phrasing it another way.  If we have source, map function A, map function B, 
> map function C, and then a reentrant pull we would currently only run C in 
> parallel.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to