GitHub user meteorgan edited a comment on the discussion: Concurrent support
for opendal list
Is this feature primarily intended for recursive directory listing ?
Could we design it like this ?
1. perform a non-recursive list("dir/") operation.
2. divide the result from step 1 into some groups and list every group
concurrently.
The drawback is that determining an optimal splitting strategy may be
challenging, but this challenge also applies in manual partitioning(maybe users
have prior knowledge to guide their partitioning strategy).
GitHub link:
https://github.com/apache/opendal/discussions/6115#discussioncomment-12966993
----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: [email protected]
