Re: zlib does not uncompress gzip during MR run

2012-10-23 Thread Jonathan Bishop
Just to follow up on my own question... I believe the problem is caused by the input split during MR. So my real question is how to handle input splits when the input is gzipped. Is it even possible to have splits of a gzipped file? Thanks, Jon On Tue, Oct 23, 2012 at 11:10 AM, Jonathan

using log4j to suppress messages

2012-10-29 Thread Jonathan Bishop
Hi, I would like to suppress messages on the console like... 12/10/29 16:56:03 INFO mapreduce.LoadIncrementalHFiles: Trying to load hfile=hdfs... So I added the following line to log4j.properties in my hadoop/conf dir... .mapreduce.LoadIncrementalHFiles=WARN and rebooted hbase and hadoop. But

Re: What is the preferred way to pass a small number of configuration parameters to a mapper or reducer

2012-12-30 Thread Jonathan Bishop
E. Store them in hbase... On Sun, Dec 30, 2012 at 12:24 AM, Hemanth Yamijala < yhema...@thoughtworks.com> wrote: > If it is a small number, A seems the best way to me. > > On Friday, December 28, 2012, Kshiva Kps wrote: > >> >> Which one is current .. >> >> >> What is the preferred way to pass a

Re: What is the preferred way to pass a small number of configuration parameters to a mapper or reducer

2012-12-30 Thread Jonathan Bishop
ppers and reducers > > > On Monday, December 31, 2012, Jonathan Bishop wrote: > >> E. Store them in hbase... >> >> >> On Sun, Dec 30, 2012 at 12:24 AM, Hemanth Yamijala < >> yhema...@thoughtworks.com> wrote: >> >> If it is a small number, A see