[
https://issues.apache.org/jira/browse/ARROW-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17459316#comment-17459316
]
Nicola Crane commented on ARROW-15104:
--------------------------------------
Hi [~cboettig] , thanks for reporting this! I totally agree that this
functionality should be implemented - and we have a couple of tickets open
which when completed will allow this, so I'm going to close this ticket as a
duplicate (though always good to know that there is user interest in this
getting prioritised)
> write_parquet() / write_csv_arrow() cannot stream a dataset object back to S3
> -----------------------------------------------------------------------------
>
> Key: ARROW-15104
> URL: https://issues.apache.org/jira/browse/ARROW-15104
> Project: Apache Arrow
> Issue Type: Bug
> Components: R
> Affects Versions: 6.0.1
> Reporter: Carl Boettiger
> Priority: Minor
>
> It seems we cannot send a dataset (table) object opened with `open_dataset()`
> into `write_parquet()` or `write_csv_arrow()`. I realize that the former is
> a 'multi-file' representation and the latter two are not, but as both
> represent a single table (single schema) it seems like this should still
> work. (It also looks like write_csv_arrow() gives us more control over
> formatting details than write_dataset() )
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
