jobtracker url(Critical)
Hey folks, i m facing a problem, with job Tracker URL, actually i added a node to the cluster and after sometime i restart the cluster, then i found that my job tracker is showing recent added node in *nodes * but rest of nodes are not available not even in *blacklist. * * * can any1 have any idea why its happening. Thanks and regards Vikas Srivastava
Re: jobtracker url(Critical)
Vikas, Have you ensured your non-appearing tasktracker services are started/alive and carry no communication errors in their logs? Did you perhaps bring up a firewall accidentally, that was not present before? On Fri, Jan 27, 2012 at 4:47 PM, hadoop hive wrote: > Hey folks, > > i m facing a problem, with job Tracker URL, actually i added a node to the > cluster and after sometime i restart the cluster, then i found that my job > tracker is showing recent added node in *nodes * but rest of nodes are not > available not even in *blacklist. * > * > * > can any1 have any idea why its happening. > > > Thanks and regards > Vikas Srivastava -- Harsh J Customer Ops. Engineer, Cloudera
Re: jobtracker url(Critical)
Hey Harsh, but after sumtym they are available 1 by 1 in jobtracker URL. any idea how they add up slowly slowly. regards Vikas On Fri, Jan 27, 2012 at 5:05 PM, Harsh J wrote: > Vikas, > > Have you ensured your non-appearing tasktracker services are > started/alive and carry no communication errors in their logs? Did you > perhaps bring up a firewall accidentally, that was not present before? > > On Fri, Jan 27, 2012 at 4:47 PM, hadoop hive wrote: > > Hey folks, > > > > i m facing a problem, with job Tracker URL, actually i added a node to > the > > cluster and after sometime i restart the cluster, then i found that my > job > > tracker is showing recent added node in *nodes * but rest of nodes are > not > > available not even in *blacklist. * > > * > > * > > can any1 have any idea why its happening. > > > > > > Thanks and regards > > Vikas Srivastava > > > > -- > Harsh J > Customer Ops. Engineer, Cloudera >
Re: jobtracker url(Critical)
Task tracker sometimes so not clean up their mapred temp directories well if that is the case the tt on startup can spent many minutes deleting files. I use find to delete files older then a couple of days. On Friday, January 27, 2012, hadoop hive wrote: > Hey Harsh, > > but after sumtym they are available 1 by 1 in jobtracker URL. > > any idea how they add up slowly slowly. > > regards > Vikas > > On Fri, Jan 27, 2012 at 5:05 PM, Harsh J wrote: > >> Vikas, >> >> Have you ensured your non-appearing tasktracker services are >> started/alive and carry no communication errors in their logs? Did you >> perhaps bring up a firewall accidentally, that was not present before? >> >> On Fri, Jan 27, 2012 at 4:47 PM, hadoop hive wrote: >> > Hey folks, >> > >> > i m facing a problem, with job Tracker URL, actually i added a node to >> the >> > cluster and after sometime i restart the cluster, then i found that my >> job >> > tracker is showing recent added node in *nodes * but rest of nodes are >> not >> > available not even in *blacklist. * >> > * >> > * >> > can any1 have any idea why its happening. >> > >> > >> > Thanks and regards >> > Vikas Srivastava >> >> >> >> -- >> Harsh J >> Customer Ops. Engineer, Cloudera >> >
Re: jobtracker url(Critical)
Thanks Edward I'll do that. On Fri, Jan 27, 2012 at 6:36 PM, Edward Capriolo wrote: > Task tracker sometimes so not clean up their mapred temp directories well > if that is the case the tt on startup can spent many minutes deleting > files. I use find to delete files older then a couple of days. > > On Friday, January 27, 2012, hadoop hive wrote: > > Hey Harsh, > > > > but after sumtym they are available 1 by 1 in jobtracker URL. > > > > any idea how they add up slowly slowly. > > > > regards > > Vikas > > > > On Fri, Jan 27, 2012 at 5:05 PM, Harsh J wrote: > > > >> Vikas, > >> > >> Have you ensured your non-appearing tasktracker services are > >> started/alive and carry no communication errors in their logs? Did you > >> perhaps bring up a firewall accidentally, that was not present before? > >> > >> On Fri, Jan 27, 2012 at 4:47 PM, hadoop hive > wrote: > >> > Hey folks, > >> > > >> > i m facing a problem, with job Tracker URL, actually i added a node > to > >> the > >> > cluster and after sometime i restart the cluster, then i found that > my > >> job > >> > tracker is showing recent added node in *nodes * but rest of nodes > are > >> not > >> > available not even in *blacklist. * > >> > * > >> > * > >> > can any1 have any idea why its happening. > >> > > >> > > >> > Thanks and regards > >> > Vikas Srivastava > >> > >> > >> > >> -- > >> Harsh J > >> Customer Ops. Engineer, Cloudera > >> > > >