Re: unsubscribe

2012-08-08 Thread Brian Bockelman
Alright folks, enough is enough. While it's fun to watch the number of people who do not know how to work with a basic mailing list, I'd like to have my inbox back. If you wish to unsubscribe from this mailing list, do not send a message like the one below. Instead, send an email to user-unsub

Re: Suitability of HDFS for live file store

2012-10-15 Thread Brian Bockelman
Hi, We use HDFS to process data for the LHC - somewhat similar case here. Our files are a bit larger, our total local data size if ~1PB logical, and we "bring our own" batch system, so no Map-Reduce. We perform many random reads, so we are quite sensitive to underlying latency. I don't see a