Re: Enable Debug logging for a job

2014-09-18 Thread Siddhi Mehta
and on client side configuration and it worked fine for me. I would check what was the final setting when the job run on RM configuration tab. Jakub On 11 September 2014 20:28, Siddhi Mehta smehtau...@gmail.com wrote: I am using hadoop2.3.0 with MR2. I tried enablibg debugging logging for a map

Enable Debug logging for a job

2014-09-11 Thread Siddhi Mehta
I am using hadoop2.3.0 with MR2. I tried enablibg debugging logging for a map/reduce tasks by setting to mapreduce.map.log.level and mapreduce.reduce.log.level to DEBUG in mapred-site.xnl Am i missing something or is this a known issue. Aprreciate your response. Thanks, Siddhi

Re: Yarn Exception while getting JobStatus

2013-09-19 Thread Siddhi Mehta
, 2013 at 1:07 AM, Siddhi Mehta smehtau...@gmail.com wrote: Hey All, I am running a Hadoop 2.0(cdh4.2.1) cluster. From the job client whenever we try to get the job status from the cluster we run into the following IOException. The exception has no message on the cause of the IOException

MiniCluster resource manager http port

2013-06-23 Thread Siddhi Mehta
Hey All, I am using the minicluster cli to startup the minicluster http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/CLIMiniCluster.html I see that the jetty bound port for Resource manager is set to 8088. But when I try to open the same localhost:8088 I see the job history

Re: Yarn job stuck with no application master being assigned

2013-06-21 Thread Siddhi Mehta
? -Sandy On Fri, Jun 21, 2013 at 4:21 PM, Siddhi Mehta smehtau...@gmail.comwrote: Hey All, I am running a Hadoop 2.0(cdh4.2.1) cluster on a single node with 1 NodeManager. We have an Map only job that launches a pig job on the cluster(similar to what oozie does) We are seeing that the map

MiniDFS Cluster log dir

2013-05-23 Thread siddhi mehta
yarn.nodemanager.remote-app-log-dir using the -D option while starting up the hadoop cluster but it seems like it doesnot make used of that at all. Any pointer to help resolve the issue. Regards, Siddhi Mehta

MiniDFs cluster

2013-05-15 Thread siddhi mehta
Hey guys, I am new 2 hadoop 2.0 and was setting up minicluster for my hadoop 2.0 client testing. http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/CLIMiniCluster.html I was wondering if there is a way to start the minidfs cluster with HA mode enabled. Is it possible?If yes