Hi, I believe that HBase is the best way to store multi-dimensional arrays. HBase provides storage efficiencies as number of dimensions grow, ordering capability, and also allows you to record and access data corrections and updates directly via HBase client library.
Another option is use of SequenceFile and MapFile. Once data loaded to the program initially, your math operations can run directly in memory and and synchronized using a standard BSP APIs. Thanks. On Wed, Mar 28, 2012 at 12:46 AM, Noah Watkins <[email protected]> wrote: > Hi Hama list, > > I'm interested in using Hama to process large multi-dimensional arrays > (sparse and dense). What is the best way to store and represent this type of > data for processing in Hama? > > Thanks, > Noah -- Best Regards, Edward J. Yoon @eddieyoon
