lidavidm commented on pull request #12099:
URL: https://github.com/apache/arrow/pull/12099#issuecomment-1007657502
And there's definitely a race condition somewhere… (using the reproducer
from JIRA)
```
8 partitions
Traceback (most recent call last):
File "/home/lidavidm/Code/upstream/arrow-15265/python/test.py", line 37,
in <module>
ds.write_dataset(
File "/home/lidavidm/Code/upstream/arrow-15265/python/pyarrow/dataset.py",
line 931, in write_dataset
_filesystemdataset_write(
File "pyarrow/_dataset.pyx", line 2658, in
pyarrow._dataset._filesystemdataset_write
check_status(CFileSystemDataset.Write(c_options, c_scanner))
File "pyarrow/error.pxi", line 114, in pyarrow.lib.check_status
raise IOError(message)
OSError: Path does not exist 'my-bucket/test8.parquet/col1=b'
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
