Re: Application Master waits a long time after Mapper/Reducers finish

2015-07-20 Thread Jianfeng (Jeff) Zhang
Might due to performance issue of FileOutputCommitter which is resolved in 2.7 https://issues.apache.org/jira/browse/MAPREDUCE-4815 Best Regard, Jeff Zhang From: Ashish Kumar Singh ashish23...@gmail.commailto:ashish23...@gmail.com Reply-To: user@hadoop.apache.orgmailto:user@hadoop.apache.org

Re: Hadoop 2.6 issue

2015-04-01 Thread Jianfeng (Jeff) Zhang
Try to export JAVA_HOME in hadoop-env.sh Best Regard, Jeff Zhang From: Anand Murali anand_vi...@yahoo.commailto:anand_vi...@yahoo.com Reply-To: user@hadoop.apache.orgmailto:user@hadoop.apache.org user@hadoop.apache.orgmailto:user@hadoop.apache.org, Anand Murali

Re: trying to understand HashPartitioner

2015-03-18 Thread Jianfeng (Jeff) Zhang
You can take it similar as the HashMap of java. Use the hashCode of one object to distribute it into different bucket. Best Regard, Jeff Zhang From: xeonmailinglist-gmail xeonmailingl...@gmail.commailto:xeonmailingl...@gmail.com Reply-To: user@hadoop.apache.orgmailto:user@hadoop.apache.org