[jira] [Created] (MAPREDUCE-5433) use mapreduce to parse hfiles and output keyvalue

2013-07-30 Thread rulinma (JIRA)
rulinma created MAPREDUCE-5433: -- Summary: use mapreduce to parse hfiles and output keyvalue Key: MAPREDUCE-5433 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5433 Project: Hadoop Map/Reduce

[jira] [Work started] (MAPREDUCE-5433) use mapreduce to parse hfiles and output keyvalue

2013-07-30 Thread rulinma (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on MAPREDUCE-5433 started by rulinma. use mapreduce to parse hfiles and output keyvalue -

[jira] [Commented] (MAPREDUCE-434) local map-reduce job limited to single reducer

2013-07-30 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13723496#comment-13723496 ] Tom White commented on MAPREDUCE-434: - +1 local map-reduce job

[jira] [Commented] (MAPREDUCE-5367) Local jobs all use same local working directory

2013-07-30 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13723498#comment-13723498 ] Tom White commented on MAPREDUCE-5367: -- I think it would be worth changing for

[jira] [Commented] (MAPREDUCE-4168) Support multiple network interfaces

2013-07-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13723634#comment-13723634 ] Karthik Kambatla commented on MAPREDUCE-4168: - The RM configs all listen

[jira] [Created] (MAPREDUCE-5434) WebAppException is thrown in appmaster logs if any task got failed

2013-07-30 Thread Nishan Shetty (JIRA)
Nishan Shetty created MAPREDUCE-5434: Summary: WebAppException is thrown in appmaster logs if any task got failed Key: MAPREDUCE-5434 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5434

[jira] [Updated] (MAPREDUCE-5301) Update MR code to work with YARN-635 changes

2013-07-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5301: -- Assignee: Siddharth Seth Update MR code to work with YARN-635 changes

[jira] [Created] (MAPREDUCE-5435) Nodemanager stops working automatically

2013-07-30 Thread Vishket (JIRA)
Vishket created MAPREDUCE-5435: -- Summary: Nodemanager stops working automatically Key: MAPREDUCE-5435 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5435 Project: Hadoop Map/Reduce Issue

[jira] [Commented] (MAPREDUCE-5435) Nodemanager stops working automatically

2013-07-30 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13723952#comment-13723952 ] Devaraj K commented on MAPREDUCE-5435: -- Can you check the Node Manager log file,

[jira] [Commented] (MAPREDUCE-5399) Large number of map tasks cause slow sort at reduce phase, invariant to amount of data to sort

2013-07-30 Thread Stanislav Barton (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13723967#comment-13723967 ] Stanislav Barton commented on MAPREDUCE-5399: - OK, I started preparing the

[jira] [Assigned] (MAPREDUCE-5399) Large number of map tasks cause slow sort at reduce phase, invariant to amount of data to sort

2013-07-30 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned MAPREDUCE-5399: - Assignee: Stanislav Barton Large number of map tasks cause slow sort at reduce

[jira] [Commented] (MAPREDUCE-5435) Nodemanager stops working automatically

2013-07-30 Thread Vishket (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13724128#comment-13724128 ] Vishket commented on MAPREDUCE-5435: Hey, thanks a ton Devaraj! I checked the log

[jira] [Resolved] (MAPREDUCE-5435) Nodemanager stops working automatically

2013-07-30 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K resolved MAPREDUCE-5435. -- Resolution: Invalid Nodemanager stops working automatically

[jira] [Commented] (MAPREDUCE-4421) Remove dependency on deployed MR jars

2013-07-30 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13724175#comment-13724175 ] Jason Lowe commented on MAPREDUCE-4421: --- bq. Should it not be

[jira] [Updated] (MAPREDUCE-5385) JobContext cache files api are broken

2013-07-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-5385: --- Status: Open (was: Patch Available) +1, looks good. The test

[jira] [Commented] (MAPREDUCE-5435) Nodemanager stops working automatically

2013-07-30 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13724209#comment-13724209 ] Aaron T. Myers commented on MAPREDUCE-5435: --- Vishket, in the future, please

[jira] [Updated] (MAPREDUCE-5385) JobContext cache files api are broken

2013-07-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-5385: --- Attachment: MAPREDUCE-5385.txt Same patch fixing the typo in

[jira] [Updated] (MAPREDUCE-5385) JobContext cache files api are broken

2013-07-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-5385: --- Hadoop Flags: Reviewed Status: Patch Available (was:

[jira] [Commented] (MAPREDUCE-5385) JobContext cache files api are broken

2013-07-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13724289#comment-13724289 ] Hadoop QA commented on MAPREDUCE-5385: -- {color:green}+1 overall{color}. Here are

[jira] [Updated] (MAPREDUCE-5385) JobContext cache files api are broken

2013-07-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-5385: --- Resolution: Fixed Fix Version/s: 2.1.1-beta

[jira] [Commented] (MAPREDUCE-5385) JobContext cache files api are broken

2013-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13724348#comment-13724348 ] Hudson commented on MAPREDUCE-5385: --- SUCCESS: Integrated in Hadoop-trunk-Commit

[jira] [Commented] (MAPREDUCE-5367) Local jobs all use same local working directory

2013-07-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13724508#comment-13724508 ] Sandy Ryza commented on MAPREDUCE-5367: --- Uploading patches for both MR1 and MR2.

[jira] [Updated] (MAPREDUCE-5367) Local jobs all use same local working directory

2013-07-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-5367: -- Attachment: MAPREDUCE-5367-b1-1.patch Local jobs all use same local working directory

[jira] [Commented] (MAPREDUCE-5367) Local jobs all use same local working directory

2013-07-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13724512#comment-13724512 ] Sandy Ryza commented on MAPREDUCE-5367: --- Verified both with TestLocalRunner and

[jira] [Updated] (MAPREDUCE-5367) Local jobs all use same local working directory

2013-07-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-5367: -- Attachment: MAPREDUCE-5367.patch Local jobs all use same local working directory

[jira] [Commented] (MAPREDUCE-5367) Local jobs all use same local working directory

2013-07-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13724529#comment-13724529 ] Hadoop QA commented on MAPREDUCE-5367: -- {color:red}-1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-5367) Local jobs all use same local working directory

2013-07-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13724549#comment-13724549 ] Hadoop QA commented on MAPREDUCE-5367: -- {color:red}-1 overall{color}. Here are

[jira] [Created] (MAPREDUCE-5436) Better exception handling for Invalid AMRMToken exception for MapReduce

2013-07-30 Thread Jian He (JIRA)
Jian He created MAPREDUCE-5436: -- Summary: Better exception handling for Invalid AMRMToken exception for MapReduce Key: MAPREDUCE-5436 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5436 Project:

[jira] [Commented] (MAPREDUCE-4421) Remove dependency on deployed MR jars

2013-07-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13724592#comment-13724592 ] Sandy Ryza commented on MAPREDUCE-4421: --- My opinion is that

[jira] [Commented] (MAPREDUCE-5384) Races in DelegationTokenRenewal

2013-07-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13724594#comment-13724594 ] Karthik Kambatla commented on MAPREDUCE-5384: - [~sseth], given you

[jira] [Updated] (MAPREDUCE-5425) Junit in TestJobHistoryServer failing in jdk 7

2013-07-30 Thread Robert Parker (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Parker updated MAPREDUCE-5425: - Assignee: Robert Parker Junit in TestJobHistoryServer failing in jdk 7

[jira] [Updated] (MAPREDUCE-5425) Junit in TestJobHistoryServer failing in jdk 7

2013-07-30 Thread Robert Parker (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Parker updated MAPREDUCE-5425: - Attachment: MAPREDUCE-5425.patch Modified the JobHistoryServer.main() to call a

[jira] [Updated] (MAPREDUCE-5425) Junit in TestJobHistoryServer failing in jdk 7

2013-07-30 Thread Robert Parker (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Parker updated MAPREDUCE-5425: - Status: Patch Available (was: Open) Junit in TestJobHistoryServer failing in

[jira] [Updated] (MAPREDUCE-5425) Junit in TestJobHistoryServer failing in jdk 7

2013-07-30 Thread Robert Parker (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Parker updated MAPREDUCE-5425: - Target Version/s: trunk, 2.3.0 (was: 2.3.0) Junit in TestJobHistoryServer

[jira] [Updated] (MAPREDUCE-5428) HistoryFileManager doesn't stop threads when service is stopped

2013-07-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated MAPREDUCE-5428: Attachment: mr-5428-1.patch Patch that shuts the moveToDoneExecutor down in

[jira] [Commented] (MAPREDUCE-5425) Junit in TestJobHistoryServer failing in jdk 7

2013-07-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13724658#comment-13724658 ] Hadoop QA commented on MAPREDUCE-5425: -- {color:green}+1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-4168) Support multiple network interfaces

2013-07-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13724660#comment-13724660 ] Karthik Kambatla commented on MAPREDUCE-4168: - Could run jobs successfully

[jira] [Updated] (MAPREDUCE-5352) Optimize node local splits generated by CombineFileInputFormat

2013-07-30 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated MAPREDUCE-5352: -- Attachment: MAPREDUCE-5352.3.txt Updated patch with a unit test.

[jira] [Updated] (MAPREDUCE-5352) Optimize node local splits generated by CombineFileInputFormat

2013-07-30 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated MAPREDUCE-5352: -- Status: Open (was: Patch Available) Optimize node local splits generated by

[jira] [Updated] (MAPREDUCE-5352) Optimize node local splits generated by CombineFileInputFormat

2013-07-30 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated MAPREDUCE-5352: -- Status: Patch Available (was: Open) Optimize node local splits generated by

[jira] [Moved] (MAPREDUCE-5437) MR2 specific metrics should be collected

2013-07-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli moved YARN-989 to MAPREDUCE-5437: - Component/s: (was: api)

[jira] [Commented] (MAPREDUCE-5433) use mapreduce to parse hfiles and output keyvalue

2013-07-30 Thread rulinma (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13724769#comment-13724769 ] rulinma commented on MAPREDUCE-5433: import java.io.IOException; import

[jira] [Updated] (MAPREDUCE-5433) use mapreduce to parse hfiles and output keyvalue

2013-07-30 Thread rulinma (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rulinma updated MAPREDUCE-5433: --- Priority: Minor (was: Major) use mapreduce to parse hfiles and output keyvalue

[jira] [Resolved] (MAPREDUCE-5433) use mapreduce to parse hfiles and output keyvalue

2013-07-30 Thread rulinma (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rulinma resolved MAPREDUCE-5433. Resolution: Fixed do as comments. use mapreduce to parse hfiles and output

[jira] [Commented] (MAPREDUCE-5352) Optimize node local splits generated by CombineFileInputFormat

2013-07-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13724774#comment-13724774 ] Hadoop QA commented on MAPREDUCE-5352: -- {color:green}+1 overall{color}. Here are

[jira] [Resolved] (MAPREDUCE-5437) MR2 specific metrics should be collected

2013-07-30 Thread Srimanth Gunturi (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srimanth Gunturi resolved MAPREDUCE-5437. - Resolution: Won't Fix MR2 applications are too split up to have a central