[jira] Resolved: (MAPREDUCE-119) JobTracker and TaskTracker enter infinite loop when TaskTracker reports bad taskid

[ https://issues.apache.org/jira/browse/MAPREDUCE-119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved MAPREDUCE-119. --- Resolution: Cannot Reproduce resolving Cannot Reproduce. I haven't seen this in the wild o

[jira] Resolved: (MAPREDUCE-238) OutputFormat should be given the reduce id directly rather than a filename

[ https://issues.apache.org/jira/browse/MAPREDUCE-238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu resolved MAPREDUCE-238. --- Resolution: Fixed This is incorporated in HADOOP-1230 > OutputFor

[jira] Resolved: (MAPREDUCE-450) OutputFormat should have a "close" method called after all the reducers have completed

[ https://issues.apache.org/jira/browse/MAPREDUCE-450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu resolved MAPREDUCE-450. --- Resolution: Duplicate This functionality is provided by OutputComm

[jira] Commented: (MAPREDUCE-1471) FileOutputCommitter does not safely clean up it's temporary files

[ https://issues.apache.org/jira/browse/MAPREDUCE-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832391#action_12832391 ] Amareshwari Sriramadasu commented on MAPREDUCE-1471: bq. If the fil

[jira] Updated: (MAPREDUCE-1476) committer.needsTaskCommit should not be called for a task cleanup attempt

[ https://issues.apache.org/jira/browse/MAPREDUCE-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-1476: --- Status: Patch Available (was: Open) > committer.needsTaskCommit

[jira] Updated: (MAPREDUCE-1476) committer.needsTaskCommit should not be called for a task cleanup attempt

[ https://issues.apache.org/jira/browse/MAPREDUCE-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-1476: --- Attachment: patch-1476.txt Patch fixing the bug. Added a unit tes

[jira] Commented: (MAPREDUCE-1408) Allow customization of job submission policies

[ https://issues.apache.org/jira/browse/MAPREDUCE-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832373#action_12832373 ] Chris Douglas commented on MAPREDUCE-1408: -- The patch looks good. A few notes

[jira] Updated: (MAPREDUCE-1220) Implement an in-cluster LocalJobRunner

[ https://issues.apache.org/jira/browse/MAPREDUCE-1220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-1220: - Attachment: MAPREDUCE-1220_yhadoop20.patch I spent a long (and happy) weekend buildin

[jira] Updated: (MAPREDUCE-1473) Sqoop should allow users to control export parallelism

[ https://issues.apache.org/jira/browse/MAPREDUCE-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Kimball updated MAPREDUCE-1473: - Attachment: MAPREDUCE-1473.2.patch New patch; the bugfix in MAPREDUCE-1480 for Combin

[jira] Updated: (MAPREDUCE-1473) Sqoop should allow users to control export parallelism

[ https://issues.apache.org/jira/browse/MAPREDUCE-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Kimball updated MAPREDUCE-1473: - Status: Open (was: Patch Available) > Sqoop should allow users to control export par

[jira] Updated: (MAPREDUCE-1480) CombineFileRecordReader does not properly initialize child RecordReader

[ https://issues.apache.org/jira/browse/MAPREDUCE-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Kimball updated MAPREDUCE-1480: - Attachment: MAPREDUCE-1480.2.patch New patch does not call initialize() for the first

[jira] Updated: (MAPREDUCE-1466) FileInputFormat should save #input-files in JobConf

[ https://issues.apache.org/jira/browse/MAPREDUCE-1466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-1466: - Attachment: MAPREDUCE-1466_yhadoop20.patch Straight-forward patch for yhadoop20 (not

[jira] Created: (MAPREDUCE-1481) Streaming should swallow IOExceptions when closing clientOut

Streaming should swallow IOExceptions when closing clientOut Key: MAPREDUCE-1481 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1481 Project: Hadoop Map/Reduce Issue Type: Bu

[jira] Updated: (MAPREDUCE-1480) CombineFileRecordReader does not properly initialize child RecordReader

[ https://issues.apache.org/jira/browse/MAPREDUCE-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Kimball updated MAPREDUCE-1480: - Attachment: MAPREDUCE-1480.patch Patch that fixes this problem and adds a test case d

[jira] Created: (MAPREDUCE-1480) CombineFileRecordReader does not properly initialize child RecordReader

CombineFileRecordReader does not properly initialize child RecordReader --- Key: MAPREDUCE-1480 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1480 Project: Hadoop Map/Reduce

[jira] Updated: (MAPREDUCE-1480) CombineFileRecordReader does not properly initialize child RecordReader

[ https://issues.apache.org/jira/browse/MAPREDUCE-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Kimball updated MAPREDUCE-1480: - Status: Patch Available (was: Open) > CombineFileRecordReader does not properly init

[jira] Updated: (MAPREDUCE-434) local map-reduce job limited to single reducer

[ https://issues.apache.org/jira/browse/MAPREDUCE-434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Kimball updated MAPREDUCE-434: Status: Open (was: Patch Available) > local map-reduce job limited to single reducer >

[jira] Updated: (MAPREDUCE-434) local map-reduce job limited to single reducer

[ https://issues.apache.org/jira/browse/MAPREDUCE-434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Kimball updated MAPREDUCE-434: Attachment: MAPREDUCE-434.5.patch new patch sync'd with trunk. > local map-reduce job l

[jira] Updated: (MAPREDUCE-434) local map-reduce job limited to single reducer

[ https://issues.apache.org/jira/browse/MAPREDUCE-434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Kimball updated MAPREDUCE-434: Status: Patch Available (was: Open) > local map-reduce job limited to single reducer >

[jira] Created: (MAPREDUCE-1479) The trace generator should test operation on the current format by building a test case that runs an ad hoc cluster

The trace generator should test operation on the current format by building a test case that runs an ad hoc cluster --- Key: MAPREDUCE-1479 URL: https:

[jira] Commented: (MAPREDUCE-1478) Separate the mapred.lib and mapreduce.lib classes to a different jar and include the user jar ahead of the lib jar.

[ https://issues.apache.org/jira/browse/MAPREDUCE-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832254#action_12832254 ] Arun C Murthy commented on MAPREDUCE-1478: -- We also need to load the mapreduce

[jira] Commented: (MAPREDUCE-1478) Separate the mapred.lib and mapreduce.lib classes to a different jar and include the user jar ahead of the lib jar.

[ https://issues.apache.org/jira/browse/MAPREDUCE-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832249#action_12832249 ] Arun C Murthy commented on MAPREDUCE-1478: -- Yes, we would need to use the inst

[jira] Commented: (MAPREDUCE-1478) Separate the mapred.lib and mapreduce.lib classes to a different jar and include the user jar ahead of the lib jar.

[ https://issues.apache.org/jira/browse/MAPREDUCE-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832246#action_12832246 ] Todd Lipcon commented on MAPREDUCE-1478: I assume this would be somewhat option

[jira] Created: (MAPREDUCE-1478) Separate the mapred.lib and mapreduce.lib classes to a different jar and include the user jar ahead of the lib jar.

Separate the mapred.lib and mapreduce.lib classes to a different jar and include the user jar ahead of the lib jar. --- Key: MAPREDUCE-1478 URL: https:

[jira] Commented: (MAPREDUCE-1473) Sqoop should allow users to control export parallelism

[ https://issues.apache.org/jira/browse/MAPREDUCE-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832215#action_12832215 ] Aaron Kimball commented on MAPREDUCE-1473: -- Failure is in pipes; unrelated >

[jira] Updated: (MAPREDUCE-1334) contrib/index - test - TestIndexUpdater fails due to an additional presence of file _SUCCESS in hdfs

[ https://issues.apache.org/jira/browse/MAPREDUCE-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1334: --- Status: Patch Available (was: Open) > contrib/index - test - TestIndexUpdater fails due to an ad

[jira] Updated: (MAPREDUCE-1334) contrib/index - test - TestIndexUpdater fails due to an additional presence of file _SUCCESS in hdfs

[ https://issues.apache.org/jira/browse/MAPREDUCE-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1334: --- Status: Open (was: Patch Available) > contrib/index - test - TestIndexUpdater fails due to an ad

[jira] Commented: (MAPREDUCE-1471) FileOutputCommitter does not safely clean up it's temporary files

[ https://issues.apache.org/jira/browse/MAPREDUCE-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832199#action_12832199 ] Jim Finnessy commented on MAPREDUCE-1471: - It is a pretty common use case for m

[jira] Updated: (MAPREDUCE-1320) StringBuffer -> StringBuilder occurence

[ https://issues.apache.org/jira/browse/MAPREDUCE-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1320: --- Status: Patch Available (was: Reopened) Workflow changes to force hudson to pick up the patch >

[jira] Resolved: (MAPREDUCE-1320) StringBuffer -> StringBuilder occurence

[ https://issues.apache.org/jira/browse/MAPREDUCE-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay resolved MAPREDUCE-1320. Resolution: Later > StringBuffer -> StringBuilder occurence >

[jira] Reopened: (MAPREDUCE-1320) StringBuffer -> StringBuilder occurence

[ https://issues.apache.org/jira/browse/MAPREDUCE-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay reopened MAPREDUCE-1320: > StringBuffer -> StringBuilder occurence > > >

[jira] Updated: (MAPREDUCE-1309) I want to change the rumen job trace generator to use a more modular internal structure, to allow for more input log formats

[ https://issues.apache.org/jira/browse/MAPREDUCE-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dick King updated MAPREDUCE-1309: - Attachment: mapreduce-1309--2010-02-10.patch created the read loop described above > I want

[jira] Updated: (MAPREDUCE-1309) I want to change the rumen job trace generator to use a more modular internal structure, to allow for more input log formats

[ https://issues.apache.org/jira/browse/MAPREDUCE-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dick King updated MAPREDUCE-1309: - Status: Patch Available (was: Open) > I want to change the rumen job trace generator to use

[jira] Updated: (MAPREDUCE-1309) I want to change the rumen job trace generator to use a more modular internal structure, to allow for more input log formats

[ https://issues.apache.org/jira/browse/MAPREDUCE-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dick King updated MAPREDUCE-1309: - Status: Open (was: Patch Available) There was a problem that I discovered in a bulk test. T

[jira] Updated: (MAPREDUCE-1341) Sqoop should have an option to create hive tables and skip the table import step

[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonid Furman updated MAPREDUCE-1341: - Status: Patch Available (was: Open) Uploaded new patch - MAPREDUCE-1341.6.patch, thi

[jira] Updated: (MAPREDUCE-1341) Sqoop should have an option to create hive tables and skip the table import step

[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonid Furman updated MAPREDUCE-1341: - Attachment: MAPREDUCE-1341.6.patch > Sqoop should have an option to create hive table

[jira] Updated: (MAPREDUCE-1341) Sqoop should have an option to create hive tables and skip the table import step

[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonid Furman updated MAPREDUCE-1341: - Status: Open (was: Patch Available) > Sqoop should have an option to create hive tab

[jira] Commented: (MAPREDUCE-1473) Sqoop should allow users to control export parallelism

[ https://issues.apache.org/jira/browse/MAPREDUCE-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832165#action_12832165 ] Hadoop QA commented on MAPREDUCE-1473: -- -1 overall. Here are the results of testi

[jira] Commented: (MAPREDUCE-1455) Authorization for servlets

[ https://issues.apache.org/jira/browse/MAPREDUCE-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832149#action_12832149 ] Ravi Gummadi commented on MAPREDUCE-1455: - (1) As history files don't have job

[jira] Updated: (MAPREDUCE-1408) Allow customization of job submission policies

[ https://issues.apache.org/jira/browse/MAPREDUCE-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rahul k singh updated MAPREDUCE-1408: - Attachment: 1408-1.patch First cut of the feature , there are some issues with new Te

[jira] Commented: (MAPREDUCE-1467) Add a --verbose flag to Sqoop

[ https://issues.apache.org/jira/browse/MAPREDUCE-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832112#action_12832112 ] Aaron Kimball commented on MAPREDUCE-1467: -- Test failure in streaming (unrelat

[jira] Commented: (MAPREDUCE-326) The lowest level map-reduce APIs should be byte oriented

[ https://issues.apache.org/jira/browse/MAPREDUCE-326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832110#action_12832110 ] Doug Cutting commented on MAPREDUCE-326: > Backwards compatible to 20 (including

[jira] Updated: (MAPREDUCE-1399) The archive command shows a null error message

[ https://issues.apache.org/jira/browse/MAPREDUCE-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated MAPREDUCE-1399: -- Assignee: Tsz Wo (Nicholas), SZE (was: Mahadev konar) > The archiv

[jira] Updated: (MAPREDUCE-1354) Refactor JobTracker.submitJob to not lock the JobTracker during the HDFS accesses

[ https://issues.apache.org/jira/browse/MAPREDUCE-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-1354: - Attachment: MAPREDUCE-1354_yhadoop20.patch Illustrative patch for yhadoop20, not to b

[jira] Resolved: (MAPREDUCE-1472) JobTracker.submitJob holds a lock on the JobTracker while copying job-conf from HDFS

[ https://issues.apache.org/jira/browse/MAPREDUCE-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-1472. -- Resolution: Duplicate Duplicate of HADOOP-1354. > JobTracker.submitJob holds a loc

[jira] Updated: (MAPREDUCE-1354) Refactor JobTracker.submitJob to not lock the JobTracker during the HDFS accesses

[ https://issues.apache.org/jira/browse/MAPREDUCE-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-1354: - Component/s: jobtracker Priority: Critical (was: Major) Assignee: Arun

[jira] Commented: (MAPREDUCE-1472) JobTracker.submitJob holds a lock on the JobTracker while copying job-conf from HDFS

[ https://issues.apache.org/jira/browse/MAPREDUCE-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832034#action_12832034 ] Devaraj Das commented on MAPREDUCE-1472: This is a duplicate of MAPREDUCE-1354

[jira] Commented: (MAPREDUCE-1341) Sqoop should have an option to create hive tables and skip the table import step

[ https://issues.apache.org/jira/browse/MAPREDUCE-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832000#action_12832000 ] Hadoop QA commented on MAPREDUCE-1341: -- -1 overall. Here are the results of testi

[jira] Updated: (MAPREDUCE-1307) Introduce the concept of Job Permissions

[ https://issues.apache.org/jira/browse/MAPREDUCE-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod K V updated MAPREDUCE-1307: - Attachment: MAPREDUCE-1307-20100210.txt I am attaching a patch that implements my proposal

[jira] Commented: (MAPREDUCE-1469) Sqoop should disable speculative execution in export

[ https://issues.apache.org/jira/browse/MAPREDUCE-1469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12831943#action_12831943 ] Hadoop QA commented on MAPREDUCE-1469: -- -1 overall. Here are the results of testi

[jira] Created: (MAPREDUCE-1477) Number of free slots on TaskTracker are calculated differently by JobTracker and TaskTracker

Number of free slots on TaskTracker are calculated differently by JobTracker and TaskTracker Key: MAPREDUCE-1477 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1477

[jira] Created: (MAPREDUCE-1476) committer.needsTaskCommit should not be called for a task cleanup attempt

committer.needsTaskCommit should not be called for a task cleanup attempt - Key: MAPREDUCE-1476 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1476 Project: Hadoop Map/Reduc

[jira] Updated: (MAPREDUCE-1475) Race condition while launching task cleanup attempt.

[ https://issues.apache.org/jira/browse/MAPREDUCE-1475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-1475: --- Attachment: tt-logs.txt Attaching TaskTracker logs for the above

[jira] Commented: (MAPREDUCE-1434) Dynamic add input for one job

[ https://issues.apache.org/jira/browse/MAPREDUCE-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12831914#action_12831914 ] Xing Shi commented on MAPREDUCE-1434: - checked this: *_1. TimeOut_* _The timeout

[jira] Created: (MAPREDUCE-1475) Race condition while launching task cleanup attempt.

Race condition while launching task cleanup attempt. Key: MAPREDUCE-1475 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1475 Project: Hadoop Map/Reduce Issue Type: Bug Comp

[jira] Updated: (MAPREDUCE-1305) Running distcp with -delete incurs avoidable penalties

[ https://issues.apache.org/jira/browse/MAPREDUCE-1305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-1305: - Summary: Running distcp with -delete incurs avoidable penalties (was: Massive perfor

[jira] Updated: (MAPREDUCE-1305) Massive performance problem with DistCp and -delete

[ https://issues.apache.org/jira/browse/MAPREDUCE-1305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-1305: - Status: Open (was: Patch Available) > Massive performance problem with DistCp and -d

[jira] Updated: (MAPREDUCE-1305) Massive performance problem with DistCp and -delete

[ https://issues.apache.org/jira/browse/MAPREDUCE-1305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-1305: - Status: Patch Available (was: Open) > Massive performance problem with DistCp and -d

[jira] Updated: (MAPREDUCE-1305) Massive performance problem with DistCp and -delete

[ https://issues.apache.org/jira/browse/MAPREDUCE-1305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-1305: - Attachment: M1305-2.patch *nod* This version uses Trash directly, avoiding FsShell bu

[jira] Commented: (MAPREDUCE-1467) Add a --verbose flag to Sqoop

[ https://issues.apache.org/jira/browse/MAPREDUCE-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12831903#action_12831903 ] Hadoop QA commented on MAPREDUCE-1467: -- -1 overall. Here are the results of testi

[jira] Commented: (MAPREDUCE-1307) Introduce the concept of Job Permissions

[ https://issues.apache.org/jira/browse/MAPREDUCE-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12831902#action_12831902 ] Devaraj Das commented on MAPREDUCE-1307: Dhruba, the FS permission doesn't supp

[jira] Commented: (MAPREDUCE-1455) Authorization for servlets

[ https://issues.apache.org/jira/browse/MAPREDUCE-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12831899#action_12831899 ] Devaraj Das commented on MAPREDUCE-1455: +1 to adding the doAs in the servlets