HDFS has slightly different design goals. It's not meant as a general purpose filesystem, it's meant as the fast sequential input/output storage thing meant for hadoops map/reduce.
Andreas Am Dienstag, den 08.04.2008, 16:24 +0300 schrieb Mika Joukainen: > Hi! > > Yes, I'm aware that it's not good idea build "ordinary" filesystem above > Hadoop. Let's say that I try to build system for my users where is 500 GB > space for every user. It seems that Hadoop can write/store 500 GB fine, but > reading and altering data later isn't easy (at least not altering). > > How the big boys do this? E.g. Google filesystem, Gmail is above that (and > still latency time seems fine for the remote enduser)? How about Amazon S3? > Do the big players implement some caching layers above Hadoop like system? > > My dream is to have system with easy to add more space when needed, with all > those automatic features: balancing, recovery of data (keeping it really > there no matter what happens) etc. I guess I'm not alone there. > > BR,
signature.asc
Description: Dies ist ein digital signierter Nachrichtenteil
