ok, the reason why hadoop jobs were not showing up was because i did not enable mapreduce to be run as a yarn application.
On Thu, Mar 6, 2014 at 11:45 PM, Jane Wayne <jane.wayne2...@gmail.com>wrote: > when i go to the job history server > > http://hadoop-cluster:19888/jobhistory > > i see no map reduce job there. i ran 3 simple mr jobs successfully. i > verified by the console output and hdfs output directory. > > all i see on the UI is: No data available in table. > > any ideas? > > unless there is a JobHistoryServer just for MapReduce.. where is that? > > > On Thu, Mar 6, 2014 at 7:14 PM, Vinod Kumar Vavilapalli < > vino...@apache.org> wrote: > >> >> Yes. JobTracker and TaskTracker are gone from all the 2.x release lines. >> >> MapReduce is an application on top of YARN. That is per job - launches, >> starts and finishes after it is done with its work. Once it is done, you >> can go look at it in the MapReduce specific JobHistoryServer. >> >> +Vinod >> >> On Mar 6, 2014, at 1:11 PM, Jane Wayne <jane.wayne2...@gmail.com> wrote: >> >> > i recently made the switch from hadoop 0.20.x to hadoop 2.3.0 (yes, big >> > leap). i was wondering if there is a way to view my jobs now via a web >> UI? >> > i used to be able to do this by accessing the following URL >> > >> > http://hadoop-cluster:50030/jobtracker.jsp >> > >> > however, there is no more job tracker monitoring page here. >> > >> > furthermore, i am confused about MapReduce as an application running on >> top >> > of YARN. so the documentation says MapReduce is just an application >> running >> > on YARN. if that is true, how come i do not see MapReduce as an >> application >> > on the ResourceManager web UI? >> > >> > http://hadoop-cluster:8088/cluster/apps >> > >> > is this because MapReduce is NOT a long-running app? meaning, a >> MapReduce >> > job will only show up as an app in YARN when it is running? (please bear >> > with me, i'm still adjusting to this new design). >> > >> > any help/pointer is appreciated. >> >> >> -- >> CONFIDENTIALITY NOTICE >> NOTICE: This message is intended for the use of the individual or entity >> to >> which it is addressed and may contain information that is confidential, >> privileged and exempt from disclosure under applicable law. If the reader >> of this message is not the intended recipient, you are hereby notified >> that >> any printing, copying, dissemination, distribution, disclosure or >> forwarding of this communication is strictly prohibited. If you have >> received this communication in error, please contact the sender >> immediately >> and delete it from your system. Thank You. >> > >
