[
https://issues.apache.org/jira/browse/SOLR-17646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17922824#comment-17922824
]
David Smiley commented on SOLR-17646:
-------------------------------------
Another comment on remote/cloud storage: A FileSystem
abstraction/implementation alone will have bad performance, as there's no
memory or other caching. But that can be layered above using the
"org.apache.solr.hdfs.store.blockcache.BlockDirectory" (completely unrelated to
HDFS). Any way, I shouldn't distract this issue with follow-on concerns with
real-world usage of a pluggable remote FileSystemProvider.
> DirectoryFactory should support any NIO FileSystemProvider
> ----------------------------------------------------------
>
> Key: SOLR-17646
> URL: https://issues.apache.org/jira/browse/SOLR-17646
> Project: Solr
> Issue Type: New Feature
> Reporter: David Smiley
> Priority: Major
>
> Ideally, the DirectoryFactory should support any NIO FileSystemProvider
> without assuming the local/default FileSystem. There are a variety of
> implementations out there, such as for cloud storage (S3, GCP, ...),
> [HDFS|https://github.com/damiencarol/jsr203-hadoop], and even Zip (imagine a
> read-only directory). This means switching from String & File to Path, and
> avoiding sneaky methods that assume the default FileSystem.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
