Re: How is MRv2 fundamentally changed?

2012-01-24 Thread Jie Li
Hi Vinod, Thanks a lot for the info. That's good to know! Yeah our model is based on 0.20. Could you possibly give us a pointer to the main changes related to the map/shuffle/reduce phases since 0.20? We'll be excited to extend our cost-based optimization for YARN. Jie On Tue, Jan 24, 2012 at 1

[jira] [Created] (MAPREDUCE-3721) Race in shuffle can cause it to hang

2012-01-24 Thread Siddharth Seth (Created) (JIRA)
Race in shuffle can cause it to hang Key: MAPREDUCE-3721 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3721 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Version

Hadoop-Mapreduce-trunk-Commit - Build # 1597 - Failure

2012-01-24 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1597/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 14201 lines...] [copy] Copying 1 file to

[jira] [Resolved] (MAPREDUCE-3607) Port missing new API mapreduce lib classes to 1.x

2012-01-24 Thread Tom White (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White resolved MAPREDUCE-3607. -- Resolution: Fixed Fix Version/s: 1.0.1 Hadoop Flags: Reviewed Thanks for the re

[jira] [Created] (MAPREDUCE-3720) Command line listJobs should not visit each AM

2012-01-24 Thread Vinod Kumar Vavilapalli (Created) (JIRA)
Command line listJobs should not visit each AM -- Key: MAPREDUCE-3720 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3720 Project: Hadoop Map/Reduce Issue Type: Bug Components: clie

[jira] [Created] (MAPREDUCE-3719) Make gridmix performance on YARN+MR to match or exceed that on 1.0

2012-01-24 Thread Vinod Kumar Vavilapalli (Created) (JIRA)
Make gridmix performance on YARN+MR to match or exceed that on 1.0 -- Key: MAPREDUCE-3719 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3719 Project: Hadoop Map/Reduce Is

[jira] [Resolved] (MAPREDUCE-3692) yarn-resourcemanager out and log files can get big

2012-01-24 Thread Arun C Murthy (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-3692. -- Resolution: Fixed I'll open a separate jira, to change back some of the logging.

[jira] [Created] (MAPREDUCE-3718) Default AM heartbeat interval should be one second

2012-01-24 Thread Vinod Kumar Vavilapalli (Created) (JIRA)
Default AM heartbeat interval should be one second -- Key: MAPREDUCE-3718 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3718 Project: Hadoop Map/Reduce Issue Type: Sub-task R

[jira] [Created] (MAPREDUCE-3717) JobClient test jar has missing files to run all the test programs.

2012-01-24 Thread Mahadev konar (Created) (JIRA)
JobClient test jar has missing files to run all the test programs. -- Key: MAPREDUCE-3717 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3717 Project: Hadoop Map/Reduce Is

Review Request: MR2 Fair Scheduler

2012-01-24 Thread Patrick Wendell
Hi There, This is a review request for a port of the Fair Scheduler to MR2 (https://issues.apache.org/jira/browse/MAPREDUCE-3451). Ideally someone familiar with the MR2 scheduling code would take a look at this. This patch brings most of the Fair Scheduler features from MR1, with a few exceptions

[jira] [Created] (MAPREDUCE-3716) java.io.File.createTempFile fails in map/reduce tasks

2012-01-24 Thread Jonathan Eagles (Created) (JIRA)
java.io.File.createTempFile fails in map/reduce tasks - Key: MAPREDUCE-3716 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3716 Project: Hadoop Map/Reduce Issue Type: Bug Co

Hadoop-Mapreduce-trunk - Build # 968 - Still Failing

2012-01-24 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/968/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 26774 lines...] [INFO] Reactor Summary: [INFO] [INFO

Hadoop-Mapreduce-0.23-Build - Build # 170 - Still Failing

2012-01-24 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/170/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 31600 lines...] [INFO] hadoop-yarn-api .

[jira] [Resolved] (MAPREDUCE-949) FileSplit still used by TextInputFormat

2012-01-24 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-949. --- Resolution: Invalid TextInputFormat is from the stable API which was once deprecated too. FileSpli

[jira] [Created] (MAPREDUCE-3715) FileSplit's Writable implementation discards hosts information

2012-01-24 Thread Pavel Podgoretsky (Created) (JIRA)
FileSplit's Writable implementation discards hosts information -- Key: MAPREDUCE-3715 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3715 Project: Hadoop Map/Reduce Issue Type