Please describe what your queries will be like and what you mean by "loading, processing, and returning the data"? So your files are xml? What size? Then you'd process them in user-time? What kinda processing? xslt'ing?
St.Ack On Thu, Jan 14, 2010 at 10:03 AM, UsefullyWastedIce <[email protected]>wrote: > > I've been doing a lot of research over the past few days, but haven't been > able to find out whether or not hadoop will work for what i am trying to > achieve. > > The data I have is initially in XML, and the user needs to be able to query > that data very quickly (response time should be in the 10 second range). > Since the amount of data will grow into can easily grow into Gigabytes, > just > processing it on the fly is not fast enough. > > What I am was thinking of doing is loading that data into a hadoop cluster, > processing it, and then serving the result back to the user. There are many > tools I've looked at, and since most of them are running on top of hadoop, > i > figured that this would be my biggest hurdle. > > Is 10 seconds a possible return time, including loading, processing and > returning the data? > -- > View this message in context: > http://old.nabble.com/Will-hadoop-work-for-what-i-am-trying-to-achieve--tp27165540p27165540.html > Sent from the HBase User mailing list archive at Nabble.com. > >
