NetFlix's Apache-licensed S3mper system provides consistency for an S3-backed store. http://techblog.netflix.com/2014/01/s3mper-consistency-in-cloud.html
It would be nice to see this or something like it integrated with Hadoop. I fear that a lot of applications are not ready for eventual consistency, and may never be, leading to the feeling that Hadoop on S3 is buggy. Colin On Thu, Mar 6, 2014 at 10:42 AM, Jay Vyas <jayunit...@gmail.com> wrote: > do you consider that native S3 FS a real "reference implementation" for > blob stores? or just something that , by mere chance, we are able to use as > a ref. impl.
