[ 
https://issues.apache.org/jira/browse/ARROW-9753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17202414#comment-17202414
 ] 

Andrew Lamb commented on ARROW-9753:
------------------------------------

I think [~jorgecarleitao]'s idea makes sense - there is a single  thread that 
gets the iterator (the one that calls `execute` on the partition) -- if that 
consumer is going to process the input in parallel, I would expect the 
parallelism to me managed by that consumer

> [Rust] [DataFusion] Remove the use of Mutex in ExecutionPlan trait
> ------------------------------------------------------------------
>
>                 Key: ARROW-9753
>                 URL: https://issues.apache.org/jira/browse/ARROW-9753
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: Rust, Rust - DataFusion
>            Reporter: Andy Grove
>            Assignee: Andy Grove
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 2.0.0
>
>          Time Spent: 1h 20m
>  Remaining Estimate: 0h
>
> The ExecutionPlan trait should not return Arc<Mutex<RecordBatchIterator>> but 
> just Arc<RecordBatchIterator> since most operators do not need to be mutable. 
> Those that do can use interior mutability.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to