I have given HBase a fair amount of thought, and I am looking for input. Instead of managing incremental loads myself, why not just setup an HBase cluster ? What are some of the trade offs. My primary use for this cluster would still be data analysis/aggregation and not so much random access. Random access would be something which is a nice to have in case there are problems, and we want to examine the data ad-hoc.
On Sat, Oct 1, 2011 at 12:31 PM, in.abdul <in.ab...@gmail.com> wrote: > There is two method is there for processing OLTP > > 1. Hstremming or scibe these are only methodes > 2. if not use chukuwa for storing the data so that when i you got a > tesent volume then you can move to HDFS > > Thanks and Regards, > S SYED ABDUL KATHER > 9731841519 > > > On Sat, Oct 1, 2011 at 4:32 AM, Sam Seigal [via Lucene] < > ml-node+s472066n3383949...@n3.nabble.com> wrote: > >> Hi, >> >> I am relatively new to Hadoop and was wondering how to do incremental >> loads into HDFS. >> >> I have a continuous stream of data flowing into a service which is >> writing to an OLTP store. Due to the high volume of data, we cannot do >> aggregations on the OLTP store, since this starts affecting the write >> performance. >> >> We would like to offload this processing into a Hadoop cluster, mainly >> for doing aggregations/analytics. >> >> The question is how can this continuous stream of data be >> incrementally loaded and processed into Hadoop ? >> >> Thank you, >> >> Sam >> >> >> ------------------------------ >> If you reply to this email, your message will be added to the discussion >> below: >> >> http://lucene.472066.n3.nabble.com/incremental-loads-into-hadoop-tp3383949p3383949.html >> To unsubscribe from Lucene, click >> here<http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=472066&code=aW4uYWJkdWxAZ21haWwuY29tfDQ3MjA2NnwxMDczOTUyNDEw>. >> >> > > > ----- > THANKS AND REGARDS, > SYED ABDUL KATHER > -- > View this message in context: > http://lucene.472066.n3.nabble.com/incremental-loads-into-hadoop-tp3383949p3385689.html > Sent from the Hadoop lucene-users mailing list archive at Nabble.com.
