[ 
https://issues.apache.org/jira/browse/ARROW-14663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17444401#comment-17444401
 ] 

Dragoș Moldovan-Grünfeld commented on ARROW-14663:
--------------------------------------------------

Thanks you all for your input. I largely agree with you all. So, in conclusion 
we won't be implementing {{{}num_threads{}}}. The CSV reading function is 
already set up to use the global thread pool and for the CSV writing 
functionality we won't be implementing access to said global pool for now. We 
will revisit {{write_csv_arrow}} & multithreading if there is a strong need 
since the implementation is not trivial. 

> [R] Expose number of threads in read_csv_arrow() and write_csv_arrow()
> ----------------------------------------------------------------------
>
>                 Key: ARROW-14663
>                 URL: https://issues.apache.org/jira/browse/ARROW-14663
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: R
>            Reporter: Dragoș Moldovan-Grünfeld
>            Priority: Minor
>
> As of {{readr}} 2.0.0 (and the switch to {{vroom}}) both {{read_csv()}} and 
> {{write_csv()}} allow the user to pass the number of threads to be used when 
> processing (the {{num_threads}} argument). Currently this functionality is 
> not exposed in Arrow. Some functionality (not yet the CSV read or write) 
> allows the user to use the global CPU thread pool, but {{num_threads}} would 
> offer more granular control. 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to