Re: Monitoring Hadoop Cluster

2012-05-11 Thread Stu Teasdale
;> > >> > Hi All, > >> > > >> > Which is the best monitoring tool for Hadoop cluster monitoring? Ganglia > >> or > >> > Nagios? > >> > > >> > Thanks, > >> > Manu S > >> > > >> > >> > >> > >> -- > >> Regards > >> Junyong > >> > > > > -- > Lance Norskog > goks...@gmail.com -- >From the prompt of Stu Teasdale Happiness is a hard disk.

Re: Issues with reduce writing results back to HDFS

2012-01-23 Thread Stu Teasdale
On Fri, Jan 20, 2012 at 03:58:10PM +, Stu Teasdale wrote: > Hi all, > > I have a fairly simple hadoop streaming map-reduce task which takes a > batch of 60ishlog files (each around 5-10MB gzip compressed) and > processes them using a cdh3u2 based cluster. The map s

Issues with reduce writing results back to HDFS

2012-01-20 Thread Stu Teasdale
heavy network or io load, and these write failures seem to occur intermittently to all the datanodes in the (small) cluster as the job runs. Any idea what I've messed up? Thanks, Stuart -- >From the prompt of Stu Teasdale "By the time they had diminished from 50 to 8, the other