[ https://issues.apache.org/jira/browse/ARROW-13198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384484#comment-17384484 ]
Weston Pace commented on ARROW-13198: ------------------------------------- The root cause may have been ARROW-13417. I have no good way of proving that at the moment but the dataset scans do use the merged generator. > [C++][Dataset] Async scanner occasionally segfaulting in CI > ----------------------------------------------------------- > > Key: ARROW-13198 > URL: https://issues.apache.org/jira/browse/ARROW-13198 > Project: Apache Arrow > Issue Type: Bug > Components: C++ > Reporter: David Li > Assignee: Weston Pace > Priority: Blocker > Labels: dataset, datasets > Fix For: 6.0.0 > > Attachments: AMD64 Conda Python 3.7 Pandas latest.log > > > See attached log; it's failing in > {{test_open_dataset_partitioned_directory[threaded-async]}} [^AMD64 Conda > Python 3.7 Pandas latest.log] > {noformat} > 2021-06-28T15:53:47.0090857Z > opt/conda/envs/arrow/lib/python3.7/site-packages/pyarrow/tests/test_dataset.py::test_scan_iterator[True-True] > PASSED [ 27%] > 2021-06-28T15:53:48.5943186Z /arrow/ci/scripts/python_test.sh: line 32: 7137 > Segmentation fault (core dumped) pytest -r s -v ${PYTEST_ARGS} --pyargs > pyarrow > 2021-06-28T15:53:49.1303267Z 139 > /pyarrow/tests/test_dataset.py::test_open_dataset_partitioned_directory[threaded-async] > > {noformat} -- This message was sent by Atlassian Jira (v8.3.4#803005)