[
https://issues.apache.org/jira/browse/ARROW-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243963#comment-17243963
]
Lance Dacey commented on ARROW-10517:
-
Yes, I think the uuid specifier would work fine for my
[
https://issues.apache.org/jira/browse/ARROW-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243917#comment-17243917
]
Joris Van den Bossche commented on ARROW-10517:
---
[~ldacey] thanks for the follow-up.
What
[
https://issues.apache.org/jira/browse/ARROW-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17242425#comment-17242425
]
Lance Dacey commented on ARROW-10517:
-
FYI, it seems like the "part-\{i}" basename_template does not
[
https://issues.apache.org/jira/browse/ARROW-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241833#comment-17241833
]
Lance Dacey commented on ARROW-10517:
-
Thanks - since the \{i} increments each time a new file is
[
https://issues.apache.org/jira/browse/ARROW-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237262#comment-17237262
]
Joris Van den Bossche commented on ARROW-10517:
---
[~ldacey] thanks for the feedback. I
[
https://issues.apache.org/jira/browse/ARROW-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236702#comment-17236702
]
Lance Dacey commented on ARROW-10517:
-
Regarding partition_filename_cb, some common ones I am using
[
https://issues.apache.org/jira/browse/ARROW-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236667#comment-17236667
]
Gregory Hayes commented on ARROW-10517:
---
The update to adlfs for public find has been merged into
[
https://issues.apache.org/jira/browse/ARROW-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236364#comment-17236364
]
Joris Van den Bossche commented on ARROW-10517:
---
bq. write_to_dataset() works for my needs
[
https://issues.apache.org/jira/browse/ARROW-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236357#comment-17236357
]
Lance Dacey commented on ARROW-10517:
-
Thanks for your help. By adding **kwargs to the adlfs find()
[
https://issues.apache.org/jira/browse/ARROW-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235506#comment-17235506
]
Joris Van den Bossche commented on ARROW-10517:
---
{quote}
{code}
>>>
[
https://issues.apache.org/jira/browse/ARROW-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235478#comment-17235478
]
Martin Durant commented on ARROW-10517:
---
I don't actually know. That kind of thing happens in
[
https://issues.apache.org/jira/browse/ARROW-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235477#comment-17235477
]
Lance Dacey commented on ARROW-10517:
-
Yeah, I can open an issue there.
I hopefully am not using an
[
https://issues.apache.org/jira/browse/ARROW-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235450#comment-17235450
]
Joris Van den Bossche commented on ARROW-10517:
---
bq. This really creates the test.parquet
[
https://issues.apache.org/jira/browse/ARROW-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235434#comment-17235434
]
Joris Van den Bossche commented on ARROW-10517:
---
bq. But I am able to read a dataset which
[
https://issues.apache.org/jira/browse/ARROW-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235388#comment-17235388
]
Lance Dacey commented on ARROW-10517:
-
Latest adlfs (0.5.5):
This really creates the
[
https://issues.apache.org/jira/browse/ARROW-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235337#comment-17235337
]
Joris Van den Bossche commented on ARROW-10517:
---
bq. What I don't understand is why I can
[
https://issues.apache.org/jira/browse/ARROW-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235318#comment-17235318
]
Joris Van den Bossche commented on ARROW-10517:
---
I suppose the writing/mkdir issue is
[
https://issues.apache.org/jira/browse/ARROW-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235306#comment-17235306
]
Lance Dacey commented on ARROW-10517:
-
!ss.PNG!
Added a screenshot of the results of the mkdir
[
https://issues.apache.org/jira/browse/ARROW-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235297#comment-17235297
]
Joris Van den Bossche commented on ARROW-10517:
---
bq. This works on my local conda
[
https://issues.apache.org/jira/browse/ARROW-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235277#comment-17235277
]
Lance Dacey commented on ARROW-10517:
-
This works on my local conda environment (dependencies posted
[
https://issues.apache.org/jira/browse/ARROW-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235244#comment-17235244
]
Joris Van den Bossche commented on ARROW-10517:
---
For the first error in the top post (when
[
https://issues.apache.org/jira/browse/ARROW-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235231#comment-17235231
]
Joris Van den Bossche commented on ARROW-10517:
---
[~ldacey] thanks for the updates!
For
[
https://issues.apache.org/jira/browse/ARROW-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235084#comment-17235084
]
Lance Dacey commented on ARROW-10517:
-
Added an edit with the results of pure fsspec and adlfs
[
https://issues.apache.org/jira/browse/ARROW-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231903#comment-17231903
]
Lance Dacey commented on ARROW-10517:
-
Hello - let me know if my edit covers it.
Previously I did
[
https://issues.apache.org/jira/browse/ARROW-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231353#comment-17231353
]
Joris Van den Bossche commented on ARROW-10517:
---
[~ldacey] are you able to provide some
[
https://issues.apache.org/jira/browse/ARROW-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17228552#comment-17228552
]
Joris Van den Bossche commented on ARROW-10517:
---
bq. it looks like fs.find() is returning
[
https://issues.apache.org/jira/browse/ARROW-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17228551#comment-17228551
]
Joris Van den Bossche commented on ARROW-10517:
---
[~ldacey] can you paste the full error
[
https://issues.apache.org/jira/browse/ARROW-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17228257#comment-17228257
]
Lance Dacey commented on ARROW-10517:
-
+ [~mdurant] and [~jorisvandenbossche]
You guys helped me
28 matches
Mail list logo
