Re: RE!

2009-07-26 Thread Ninad Raut
Check out pro hadoop ... very nice book.. On Mon, Jul 27, 2009 at 11:21 AM, Sugandha Naolekar wrote: > Hello! > > Can u please suggest me few of the good books of HADOOP? > > I am lookking for the book of it more based on the programming rather than > the theory. > > As in, > -> Map-Reduce and Co

RE!

2009-07-26 Thread Sugandha Naolekar
Hello! Can u please suggest me few of the good books of HADOOP? I am lookking for the book of it more based on the programming rather than the theory. As in, -> Map-Reduce and Compression -> HIVE and Hbase -> Experimentations with hadoop I also want to know, in what way can we use hadoop in big

Re: Output of a Reducer as a zip file?

2009-07-26 Thread Mark Kerzner
Now I am trying to do this: Open a ZipOutputStream in the static part of the Reducer, such as in configure(), then keep writing to this stream. I see too potential problems: cleanup in case of failure - I saw this discussed - and I don't know when to close the stream. Thank you, Mark On Sun, Jul

Re: Output of a Reducer as a zip file?

2009-07-26 Thread Mark Kerzner
Sorry that I still don't get it. I have only one reducer, so I produce one output file. In that reducer, I have a standard line output.collect(key, values.next()); Each values.next() is a file, and I would like to write all of these into one zip output. If I do as suggested ZipOutputStream zos

Re: Using bytes or strings as keys?

2009-07-26 Thread Owen O'Malley
On Jul 26, 2009, at 4:51 PM, Mark Kerzner wrote: Hi, I want to use the hash (sha-1) for the key. Should I use the binary representation in bytes, or the ascii representation, as given by the sha1sum utility in Linux? Which is faster, and are there any additional considerations? The easiest

Using bytes or strings as keys?

2009-07-26 Thread Mark Kerzner
Hi, I want to use the hash (sha-1) for the key. Should I use the binary representation in bytes, or the ascii representation, as given by the sha1sum utility in Linux? Which is faster, and are there any additional considerations? Thank you, Mark