RE: Efficiently partition broadly distributed keys

2011-03-10 Thread Alex Dorman
key distribution as maps progress. Of course, it is feasible if you have relatively low number of keys. I am not sure what is the limit for number of global counters per job. http://hadoop.apache.org/common/docs/r0.20.1/api/org/apache/hadoop/mapred/ Counters.html Hope it helps Alex Dorman

Re: Hadoop Developer Question

2011-03-04 Thread Alex Dorman
I have multiple hadoop jobs open (developers, admin). We are using Hadoop in production and willing to train right candidates. Contact me directly. Thanks, Alex ador...@proclivitysystems.com On Mar 4, 2011, at 8:59 AM, Habermaas, William william.haberm...@fatwire.com wrote: How come all