Interesting. That's close to a PB if my math is correct. Is there a write up about this somewhere? Something that we could link from the HBase homepage?
-- Lars ----- Original Message ----- From: Jack Levin <magn...@gmail.com> To: user@hbase.apache.org Cc: Andrew Purtell <apurt...@apache.org> Sent: Thursday, January 10, 2013 9:24 AM Subject: Re: Storing images in Hbase We stored about 1 billion images into hbase with file size up to 10MB. Its been running for close to 2 years without issues and serves delivery of images for Yfrog and ImageShack. If you have any questions about the setup, I would be glad to answer them. -Jack On Sun, Jan 6, 2013 at 1:09 PM, Mohit Anchlia <mohitanch...@gmail.com> wrote: > I have done extensive testing and have found that blobs don't belong in the > databases but are rather best left out on the file system. Andrew outlined > issues that you'll face and not to mention IO issues when compaction occurs > over large files. > > On Sun, Jan 6, 2013 at 12:52 PM, Andrew Purtell <apurt...@apache.org> wrote: > >> I meant this to say "a few really large values" >> >> On Sun, Jan 6, 2013 at 12:49 PM, Andrew Purtell <apurt...@apache.org> >> wrote: >> >> > Consider if the split threshold is 2 GB but your one row contains 10 GB >> as >> > really large value. >> >> >> >> >> -- >> Best regards, >> >> - Andy >> >> Problems worthy of attack prove their worth by hitting back. - Piet Hein >> (via Tom White) >>
