Re: How to make data available in 10 minutes.

2009-07-20 Thread zsongbo
7;ll be a > lot easier to do once we have appends, which will be comparatively > soon, so it doesn't necessarily seem worth it. > > --Ari > > On Fri, Jul 10, 2009 at 12:27 AM, zsongbo wrote: > > Ariel, > > > > Coud you please put more detail about how Chukwa m

Re: How to make data available in 10 minutes.

2009-07-10 Thread zsongbo
ice a day with small incremental > indexes every 10 minutes. Katta can handle distribution and replication of > indexes very nicely. > > http://katta.sourceforge.net/ > > On Mon, Jul 6, 2009 at 7:03 PM, zsongbo wrote: > > > Hi all, > > > > We have buildup a sys

Can I run tow MapReduce Jobs concurrently?

2009-07-07 Thread zsongbo
Hi all, Can I run tow MapReduce Jobs concurrently? Schubert

How to make data available in 10 minutes.

2009-07-06 Thread zsongbo
Hi all, We have buildup a system which use hadoop MapRdeuce to sort and index the input files. The index is straightforward blocked-key=>files+offsets. Then we can query the dataset with low lentacy. Usually, we run the MapReduce jobs in periodic of one day or hours. Then the data before one day