unsubscribe me

ya i am sure please unsubscribe me

How do I enable debug mode

Hello, I have below code in mapreduce program. if(logger.isDebugEnabled()){ logger.info(Mapper value = + value); } How do I enable debug mode to print Mapper value = in the logs. I tried modifying hadoop-2.5.1/etc/hadoop/ log4j.properties, and it still

Reliability of Hadoop

hi, hadoop uses rank-aware data placement policy, blocks are randomly placed in datanodes. I wonder how to measure the reliability of the cluster. if i changed data placement policy, how can i compare the reliability of the two policies. Best Regards Yu-jian Zhang

Re: How do I enable debug mode

It seems log4j is not configured properly. try putting below line in log4.properties again log4j.logger.org.apache.hadoop = DEBUG Thanks, Adarsh D On Thu, Dec 4, 2014 at 11:02 AM, Gino Gu01 gino_g...@infosys.com wrote: Hello, I have below code in mapreduce program.

Re: QJM cost 5 minutes for failover

Hi, Are you using ZKFC? If the answer is positive, could you share the configuration files for ZooKeeper? Thanks, - Tsuyoshi On Wed, Dec 3, 2014 at 2:15 AM, mail list louis.hust...@gmail.com wrote: Hi,all we are testing QJM NAMENODE HA, and when the active name node down,it cost about 5

Re: New to the list

Hi Abhishek, Welcome to Hadoop! The Hadoop community has maintained the documents for Hadoop for community edition. You can read it on the web site. http://hadoop.apache.org/docs/current/ If you'd like to know Hadoop for more detail, Hadoop: The Definitive Guide by Tom White is a good book for

job stuck though all maps and reducers completed

I am facing a weird issue on my mapreduce cluster. Look at the screenshot below: [image: Inline image 1] The job status is stuck at Running, while the mappers and reducers are all marked as complete. There have been a ton of killed attempts but not sure if that is impacting it. Any pointers

RE: How do I enable debug mode

You can use below configuration at client for changing log level at MR ApplicationMaster :yarn.app.mapreduce.am.log.level=DEBUG Mapper : mapreduce.map.log.level=DEBUG Reducer : mapreduce.reduce.log.level=DEBUG Thanks Regards Rohith Sharma K S This e-mail and its

Re: Question about the QJM HA namenode

It looks like that's tied to the ipc.client.connect.* properties. You can adjust retries timeout values to something shorter and see if that works for you. Offhand, I'm not certain if that will affect other services besides HDFS. -Ray On Wed, Dec 3, 2014 at 2:51 AM, mail list

Re: Question about the QJM HA namenode

Thanks Ray, I will try this options. On Dec 5, 2014, at 5:50, Ray Chiang rchi...@cloudera.com wrote: It looks like that's tied to the ipc.client.connect.* properties. You can adjust retries timeout values to something shorter and see if that works for you. Offhand, I'm not certain if

RE: How do I enable debug mode

Hi Rohith Sharma K S, Thanks for your help. After adding below four lines to hadoop-2.5.1/etc/hadoop/ log4j.properties, “Mapper value =” still not got printed out. yarn.app.mapreduce.am.log.level=DEBUG mapreduce.map.log.level=DEBUG mapreduce.reduce.log.level=DEBUG log4j.logger.org.apache.hadoop

Re: Question about the QJM HA namenode

Hi ,Ray How can I know the standby name node become active and done the recovery job and can work in log? Is there some obvious mark in name node log? On Dec 5, 2014, at 9:55, mail list louis.hust...@gmail.com wrote: Thanks Ray, I will try this options. On Dec 5, 2014, at 5:50, Ray Chiang

Query regarding the object creation in map reduce code

Hi All, I need your help in writing the map reduce program in Java. I am creating a mapper and reducer classes for reading and processing a log file. I also have many other class files which acts as supporting classes to mapper and will be instantiated from mapper class within the map function.

Re: Question about the QJM HA namenode

For ZooKeeper fencing, you should see messages from ZKFailoverController in the log. For any other fencing, I'm not certain. I'm not an HDFS expert, but I saw something in your log that was easy to lookup in the code. -Ray On Thu, Dec 4, 2014 at 8:17 PM, mail list louis.hust...@gmail.com

Re: Query regarding the object creation in map reduce code

Hi Raghavendra, 1. Make your objects reusable. 2. Instantiate these Reusable objects in the setup method of the Mapper/Reducer, so that these objects are instantiated only once. With Regards, Gautam Hegde On Fri, Dec 5, 2014 at 10:46 AM, Raghavendra Chandra raghavchandra.learn...@gmail.com