[jira] [Commented] (ARROW-15265) [C++][Python][Dataset] write_dataset with delete_matching hangs when the number of partitions is too large

2022-01-07 Thread Weston Pace (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17470794#comment-17470794 ] Weston Pace commented on ARROW-15265: - Thanks for figuring that out [~lidavidm]. Ad

[jira] [Commented] (ARROW-15265) [C++][Python][Dataset] write_dataset with delete_matching hangs when the number of partitions is too large

2022-01-07 Thread David Li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17470726#comment-17470726 ] David Li commented on ARROW-15265: -- {{pa.set_io_thread_count(N)}} where {{N > (# partit

[jira] [Commented] (ARROW-15265) [C++][Python][Dataset] write_dataset with delete_matching hangs when the number of partitions is too large

2022-01-07 Thread David Li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17470724#comment-17470724 ] David Li commented on ARROW-15265: -- Thanks for the report. I can reproduce this with 6.