Andy Cross created DRILL-566:
--------------------------------
Summary: Storage provider for Azure Cloud Storage
Key: DRILL-566
URL: https://issues.apache.org/jira/browse/DRILL-566
Project: Apache Drill
Issue Type: New Feature
Reporter: Andy Cross
An Azure cloud storage plugin; the idea being that a user of the storage plugin
would be able to address Azure blob storage in a similar way to they might
address a LocalFileSystem.
This is a model that is similar to that developed for Azure's HDInsight service
and in EMR, where WASB:// or S3:// schemes allow access to cloud storage in
Hadoop rather than using the hdfs:// scheme. I realise the implementation as a
plugin differs, and indeed is cleaner in Drill to my mind (before the project
commences!).
Performance and data locality trade-offs are significant in all of these cloud
storage services, so concepts like spanning multiple accounts (to maximise
IOPs) would be built into the plugin.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
