Hi Gil,
Currently, our company uses S3 heavily for data storage. Can you further
explain the benefits of this in relation to S3 when the pending patch does come
out? Also, I have heard of Swift from others. Can you explain to me the pros
and cons of Swift compared to HDFS? It can be just a
We recently released an object store connector for Spark.
https://github.com/SparkTC/stocator
Currently this connector contains driver for the Swift based object store
( like SoftLayer or any other Swift cluster ), but it can easily support
additional object stores.
There is a pending patch to