[jira] Updated: (HADOOP-6110) test-patch takes 45min!

2009-06-29 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-6110: --- Priority: Critical (was: Major) Assignee: Giridharan Kesavan > test-patch takes 45

[jira] Updated: (HADOOP-5921) JobTracker does not come up because of NotReplicatedYetException

2009-06-28 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-5921: --- Release Note: Jobtracker crashes if it fails to create jobtracker.info file (i.e if sufficient

Re: New subproject logos

2009-06-28 Thread Amar Kamat
Amr Awadallah wrote: +1 though, if you want to "spice" them up a bit we can have Aaron Newton perform some "genetic experiments" on them. e.g. check out the hive and jobtracker logos he created :) +1. I liked the jobtracker logo :) Amar http://www.cloudera.com/blog/2009/04/15/hive-and-jobtr

[jira] Updated: (HADOOP-5921) JobTracker does not come up because of NotReplicatedYetException

2009-06-26 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-5921: --- Release Note: jobtracker fails if it cannot create jobtracker.info (if sufficient datanodes are not

[jira] Updated: (HADOOP-5920) TestJobHistory fails some times.

2009-06-26 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-5920: --- Release Note: TestJobHistory fails as jobtracker is restarted very fast (within a minute) and

[jira] Created: (HADOOP-6110) test-patch takes 45min!

2009-06-25 Thread Amar Kamat (JIRA)
test-patch takes 45min! --- Key: HADOOP-6110 URL: https://issues.apache.org/jira/browse/HADOOP-6110 Project: Hadoop Common Issue Type: Improvement Components: test Reporter: Amar Kamat The runtime

Re: PROJECTS SPLIT

2009-06-22 Thread Amar Kamat
Owen O'Malley wrote: All, I have moved the repositories to their new locations. They are: https://svn.apache.org/repos/asf/hadoop/common/trunk https://svn.apache.org/repos/asf/hadoop/hdfs/trunk https://svn.apache.org/repos/asf/hadoop/mapreduce/trunk Please try them out and report back any pro

[jira] Commented: (HADOOP-4973) Allow jobtracker to be configured with zero completed jobs in memory

2009-06-19 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721777#action_12721777 ] Amar Kamat commented on HADOOP-4973: The changes are # check for job a

[jira] Updated: (HADOOP-4973) Allow jobtracker to be configured with zero completed jobs in memory

2009-06-19 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-4973: --- Attachment: HADOOP-4973-v2.2.patch Attaching a new patch incorporating Devaraj's offline com

[jira] Updated: (HADOOP-4973) Allow jobtracker to be configured with zero completed jobs in memory

2009-06-19 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-4973: --- Attachment: HADOOP-4973-v2.1.patch Attaching a patch that makes min-time-before-retire configurable

[jira] Updated: (HADOOP-5994) Move the completed jobs' history files to a DONE subdirectory inside the configured history directory

2009-06-19 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-5994: --- Attachment: HADOOP-5994-v2.1.patch New patch with a bug fix, Result of test-patch [exec] +1

[jira] Commented: (HADOOP-6014) Improvements to Global Black-listing of TaskTrackers

2009-06-18 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721662#action_12721662 ] Amar Kamat commented on HADOOP-6014: bq. Maybe as a first step, we can just treat

[jira] Reopened: (HADOOP-4973) Allow jobtracker to be configured with zero completed jobs in memory

2009-06-18 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat reopened HADOOP-4973: Assignee: Amar Kamat > Allow jobtracker to be configured with zero completed jobs in mem

[jira] Updated: (HADOOP-6055) TestJobTrackerRestart.testJobRecoveryWithEmptyHistory doesnt test the expected

2009-06-18 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-6055: --- Attachment: HADOOP-6055-v1.1.patch Attaching a simple fix. The testcase worked because cleanup

[jira] Updated: (HADOOP-5994) Move the completed jobs' history files to a DONE subdirectory inside the configured history directory

2009-06-18 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-5994: --- Attachment: HADOOP-5994-v2.0.patch Attaching a new patch incorporating Devaraj's offline com

[jira] Commented: (HADOOP-6052) KeyFieldBasedPartitioner would lost data if specifed field not exist

2009-06-18 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721167#action_12721167 ] Amar Kamat commented on HADOOP-6052: Result of test-patch [exec] +1 ove

[jira] Commented: (HADOOP-6058) The TaskTracker's shell environment should not be passed to the children.

2009-06-18 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721126#action_12721126 ] Amar Kamat commented on HADOOP-6058: Something similar is done today.

[jira] Created: (HADOOP-6078) Ability to re-configure hadoop daemons online

2009-06-18 Thread Amar Kamat (JIRA)
Reporter: Amar Kamat Example : Like we have _bin hadoop mradmin -refreshNodes_ we should also have _bin hadoop mradmin -reconfigure_ which re-configures mr while the cluster is online. Few parameters like job-expiry-interval etc can be changed in this way without having to restart

[jira] Resolved: (HADOOP-4973) Allow jobtracker to be configured with zero completed jobs in memory

2009-06-18 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat resolved HADOOP-4973. Resolution: Won't Fix > Allow jobtracker to be configured with zero completed jobs i

[jira] Commented: (HADOOP-6076) Forrest documentation compilation is broken because of HADOOP-5913

2009-06-17 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721090#action_12721090 ] Amar Kamat commented on HADOOP-6076: +1. Applied the patch and the compilation

[jira] Updated: (HADOOP-6052) KeyFieldBasedPartitioner would lost data if specifed field not exist

2009-06-17 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-6052: --- Attachment: HADOOP-6052-v1.1.patch Attaching a new patch incorporating Devaraj's comments. Ru

[jira] Commented: (HADOOP-5995) Delete the jobconf copy from the log directory of the JobTracker when the job is retired

2009-06-17 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721056#action_12721056 ] Amar Kamat commented on HADOOP-5995: Opened HADOOP-6075

[jira] Commented: (HADOOP-6052) KeyFieldBasedPartitioner would lost data if specifed field not exist

2009-06-17 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721055#action_12721055 ] Amar Kamat commented on HADOOP-6052: Opened HADOOP-6075 to add

[jira] Created: (HADOOP-6075) TestTaskTrackerMemoryManager fails with NPE

2009-06-17 Thread Amar Kamat (JIRA)
Reporter: Amar Kamat Here is the error {code} null java.lang.NullPointerException at org.apache.hadoop.mapred.TestTaskTrackerMemoryManager.testTasksBeyondLimits(TestTaskTrackerMemoryManager.java:256) {code} -- This message is automatically generated by JIRA. - You can reply to this email to

[jira] Updated: (HADOOP-5920) TestJobHistory fails some times.

2009-06-17 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-5920: --- Attachment: HADOOP-5920-v1.1-branch0.20.patch Attaching a patch for branch 0.20. > TestJobHist

[jira] Commented: (HADOOP-5995) Delete the jobconf copy from the log directory of the JobTracker when the job is retired

2009-06-17 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12720658#action_12720658 ] Amar Kamat commented on HADOOP-5995: Found corresponding jira's for the test

[jira] Updated: (HADOOP-6052) KeyFieldBasedPartitioner would lost data if specifed field not exist

2009-06-17 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-6052: --- Attachment: HADOOP-6052-v1.0-branch0.20.patch Attaching a patch for branch 0.20

[jira] Commented: (HADOOP-5995) Delete the jobconf copy from the log directory of the JobTracker when the job is retired

2009-06-17 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12720584#action_12720584 ] Amar Kamat commented on HADOOP-5995: Ant tests passed except ||Name||Type||Re

[jira] Created: (HADOOP-6066) TestJobTrackerSafeMode might not work as expected

2009-06-17 Thread Amar Kamat (JIRA)
Reporter: Amar Kamat Assignee: Amar Kamat It failed on trunk for me. Looks like the mapred.tasktracker.expiry.interval is set to 5sec which is too less. I think we should carefully set it. -- This message is automatically generated by JIRA. - You can reply to this email to

[jira] Commented: (HADOOP-6052) KeyFieldBasedPartitioner would lost data if specifed field not exist

2009-06-17 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12720573#action_12720573 ] Amar Kamat commented on HADOOP-6052: Opened HADOOP-6065 to address the failur

[jira] Created: (HADOOP-6065) TestRunningTaskLimit doesnt work as expected

2009-06-17 Thread Amar Kamat (JIRA)
Reporter: Amar Kamat I see the following code in TestRunningTaskLimit {code} JobConf jobConf = createWaitJobConf(mr, "job1", 20, 20); jobConf.setRunningMapLimit(5); jobConf.setRunningReduceLimit(3); // Submit the job RunningJob rJob = (new JobClient(jobConf)).submitJ

[jira] Commented: (HADOOP-6052) KeyFieldBasedPartitioner would lost data if specifed field not exist

2009-06-17 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12720541#action_12720541 ] Amar Kamat commented on HADOOP-6052: Following tests failed. ||Name||Type||Re

[jira] Created: (HADOOP-6063) Runtimes of TestJobTrackerRestart* testcases are high again

2009-06-16 Thread Amar Kamat (JIRA)
Components: mapred Reporter: Amar Kamat Assignee: Amar Kamat [junit] Running org.apache.hadoop.mapred.TestJobTrackerRestart [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 575.887 sec [junit] Running

[jira] Commented: (HADOOP-5920) TestJobHistory fails some times.

2009-06-16 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12720117#action_12720117 ] Amar Kamat commented on HADOOP-5920: Tested this patch by setting the jobtra

[jira] Updated: (HADOOP-6052) KeyFieldBasedPartitioner would lost data if specifed field not exist

2009-06-16 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-6052: --- Attachment: HADOOP-6052-v1.0.patch Attaching a fix. Incorporated Jothi's comments from HADOOP

[jira] Commented: (HADOOP-5779) KeyFieldBasedPartitioner would lost data if specifed field not exist, and it should encode free not only support utf8

2009-06-16 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719989#action_12719989 ] Amar Kamat commented on HADOOP-5779: Opened HADOOP-6052 to address

[jira] Created: (HADOOP-6052) KeyFieldBasedPartitioner would lost data if specifed field not exist

2009-06-16 Thread Amar Kamat (JIRA)
Type: Bug Components: mapred Affects Versions: 0.20.0 Reporter: Amar Kamat Assignee: Amar Kamat Fix For: 0.21.0 When using KeyFieldBasedPartitioner, if the record doesn't contain the specified field, the endChar would equal with array.length,

[jira] Updated: (HADOOP-5995) Delete the jobconf copy from the log directory of the JobTracker when the job is retired

2009-06-16 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-5995: --- Attachment: HADOOP-5995-v1.1.patch Attaching a patch incorporating Amareshwari's comments. R

[jira] Created: (HADOOP-6050) History cleaner is started only on successful job completion and not on killed/failed job.

2009-06-16 Thread Amar Kamat (JIRA)
Project: Hadoop Core Issue Type: Bug Reporter: Amar Kamat Not sure if this is intentionally done but I think we should rethink on the way history cleaner works. Also a testcase is missing that will test history cleaner. -- This message is automatically generated by

[jira] Updated: (HADOOP-6049) Multiple copies of jobconf is present in history-dir after restart

2009-06-15 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-6049: --- Summary: Multiple copies of jobconf is present in history-dir after restart (was: Multiple copies

[jira] Created: (HADOOP-6049) Multiple copies of jobconf are present in history-dir after restart

2009-06-15 Thread Amar Kamat (JIRA)
: Improvement Components: mapred Reporter: Amar Kamat Assignee: Amar Kamat Across restarts, when a job is inited, jobconf for this job is localized to the history folder. These filenames have jobtracker-identifier which changes across restarts. Hence we see

[jira] Commented: (HADOOP-5995) Delete the jobconf copy from the log directory of the JobTracker when the job is retired

2009-06-15 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719912#action_12719912 ] Amar Kamat commented on HADOOP-5995: Result of test-patch [exec] -1 ove

[jira] Updated: (HADOOP-5995) Delete the jobconf copy from the log directory of the JobTracker when the job is retired

2009-06-15 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-5995: --- Attachment: HADOOP-5995-v1.0.patch Attaching a simple fix. Running test-patch now. > Delete

[jira] Created: (HADOOP-6044) Factor out job submission code in testcases into UtilsForTests

2009-06-15 Thread Amar Kamat (JIRA)
: Improvement Components: test Reporter: Amar Kamat I still see code blocks that handcraft wordcount. Ideally we should move it into UtilsForTests. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.

[jira] Created: (HADOOP-6043) show queued jobs on jobtracker.jsp

2009-06-15 Thread Amar Kamat (JIRA)
: Amar Kamat When new jobs are added, they dont show up on the main page. Its sometimes confusing as to why the job doesnt show up. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.

[jira] Commented: (HADOOP-5779) KeyFieldBasedPartitioner would lost data if specifed field not exist, and it should encode free not only support utf8

2009-06-15 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719486#action_12719486 ] Amar Kamat commented on HADOOP-5779: ZhuGuanyin, I am in the process of merging

[jira] Updated: (HADOOP-5643) Ability to blacklist tasktracker

2009-06-14 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-5643: --- Attachment: Fixed+5643-0.20-final Attaching a new patch for branch 0.20 merging the 2 patches. Note

[jira] Commented: (HADOOP-5994) Move the completed jobs' history files to a DONE subdirectory inside the configured history directory

2009-06-12 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12718810#action_12718810 ] Amar Kamat commented on HADOOP-5994: Ant tests passed on my box. > M

[jira] Updated: (HADOOP-3578) mapred.system.dir should be accessible only to hadoop daemons

2009-06-12 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-3578: --- Attachment: hadoop-3578-branch-20-example.patch Attaching a sample patch for branch 0.20 not to be

[jira] Updated: (HADOOP-5981) HADOOP-2838 doesnt work as expected

2009-06-12 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-5981: --- Release Note: This issue completes the feature mentioned in HADOOP-2838. HADOOP-2838 provided a

[jira] Updated: (HADOOP-5920) TestJobHistory fails some times.

2009-06-12 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-5920: --- Attachment: HADOOP-5920-v1.1.patch Attaching a patch that deletes the mapred.system.dir and

[jira] Updated: (HADOOP-5994) Move the completed jobs' history files to a DONE subdirectory inside the configured history directory

2009-06-12 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-5994: --- Attachment: HADOOP-5994-v1.8.patch Fixed a small bug w.r.t. killing of un-initialized jobs. Result

[jira] Updated: (HADOOP-5921) JobTracker does not come up because of NotReplicatedYetException

2009-06-11 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-5921: --- Attachment: HADOOP-5921-v2.5.patch Incorporated Steve's comment. Attached a patch with the c

[jira] Updated: (HADOOP-5981) HADOOP-2838 doesnt work as expected

2009-06-11 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-5981: --- Attachment: hadoop5981-branch-20-example.patch Attaching an example patch for 20 branch (not to be

[jira] Commented: (HADOOP-5994) Move the completed jobs' history files to a DONE subdirectory inside the configured history directory

2009-06-11 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12718704#action_12718704 ] Amar Kamat commented on HADOOP-5994: Result of test-patch [exec] +1 ove

[jira] Updated: (HADOOP-5779) KeyFieldBasedPartitioner would lost data if specifed field not exist, and it should encode free not only support utf8

2009-06-11 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-5779: --- Attachment: HADOOP-5779-v1.0.patch.patch Attaching a merged patch. Testing in progress

[jira] Updated: (HADOOP-5994) Move the completed jobs' history files to a DONE subdirectory inside the configured history directory

2009-06-11 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-5994: --- Attachment: HADOOP-5994-v1.7.patch Attaching a patch that moves completed jobs to a _done_

[jira] Commented: (HADOOP-5921) JobTracker does not come up because of NotReplicatedYetException

2009-06-11 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12718369#action_12718369 ] Amar Kamat commented on HADOOP-5921: ant tests passed on my box. > JobTrack

[jira] Commented: (HADOOP-5920) TestJobHistory fails some times.

2009-06-11 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12718362#action_12718362 ] Amar Kamat commented on HADOOP-5920: Looks like the issue it to do with # reus

[jira] Commented: (HADOOP-5994) Move the completed jobs' history files to a DONE subdirectory inside the configured history directory

2009-06-10 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12718318#action_12718318 ] Amar Kamat commented on HADOOP-5994: bq. That would make the management of

[jira] Commented: (HADOOP-5785) The job setup and cleanup tasks should be optional

2009-06-10 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12718311#action_12718311 ] Amar Kamat commented on HADOOP-5785: Changes look fine to me. > The job se

[jira] Assigned: (HADOOP-5921) JobTracker does not come up because of NotReplicatedYetException

2009-06-10 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat reassigned HADOOP-5921: -- Assignee: Amar Kamat > JobTracker does not come up because of NotReplicatedYetExcept

[jira] Updated: (HADOOP-5921) JobTracker does not come up because of NotReplicatedYetException

2009-06-10 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-5921: --- Attachment: HADOOP-5921-v2.4.patch Attaching a patch that fixes the issue. This patch does the

[jira] Commented: (HADOOP-5981) HADOOP-2838 doesnt work as expected

2009-06-10 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12718012#action_12718012 ] Amar Kamat commented on HADOOP-5981: Ant tests passed on my box. > HADO

[jira] Commented: (HADOOP-5994) Move the completed jobs' history files to a DONE subdirectory inside the configured history directory

2009-06-10 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12717998#action_12717998 ] Amar Kamat commented on HADOOP-5994: Moving completed jobs to a done folder seem

[jira] Updated: (HADOOP-2838) Add HADOOP_LIBRARY_PATH config setting so Hadoop will include external directories for jni

2009-06-09 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-2838: --- Release Note: Now the users can set environment variables using mapred.child.env. They can do the

[jira] Updated: (HADOOP-5801) JobTracker should refresh the hosts list upon recovery

2009-06-09 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-5801: --- Release Note: The mapred-hosts list can change across restarts. Once the jobtracker recovers, it

[jira] Updated: (HADOOP-5746) Errors encountered in MROutputThread after the last map/reduce call can go undetected

2009-06-09 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-5746: --- Release Note: If the child (streaming) process returns successfully and the MROutputThread throws

[jira] Updated: (HADOOP-5924) JT fails to recover the jobs after restart after HADOOP:4372

2009-06-09 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-5924: --- Release Note: Post HADOOP-4372, empty job history files caused NPE. This issues fixes that by

[jira] Updated: (HADOOP-5779) KeyFieldBasedPartitioner would lost data if specifed field not exist, and it should encode free not only support utf8

2009-06-09 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-5779: --- Attachment: HADOOP-5779-partial.patch Hey. I tried testing your patch against my testcase and it

[jira] Updated: (HADOOP-5981) HADOOP-2838 doesnt work as expected

2009-06-09 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-5981: --- Attachment: HADOOP-5981-v2.0.patch Attaching a new patch that # inherits the tastracker'

[jira] Commented: (HADOOP-5921) JobTracker does not come up because of NotReplicatedYetException

2009-06-08 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12717573#action_12717573 ] Amar Kamat commented on HADOOP-5921: The uploaded patch doesnt work as expected.

[jira] Commented: (HADOOP-5981) HADOOP-2838 doesnt work as expected

2009-06-08 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12717272#action_12717272 ] Amar Kamat commented on HADOOP-5981: Hemanth, This is just a bugfix to do with HA

[jira] Commented: (HADOOP-5920) TestJobHistory fails some times.

2009-06-08 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12717199#action_12717199 ] Amar Kamat commented on HADOOP-5920: I tried reproducing this error but I cou

[jira] Commented: (HADOOP-5981) HADOOP-2838 doesnt work as expected

2009-06-05 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12716654#action_12716654 ] Amar Kamat commented on HADOOP-5981: Ant tests passed on my box. > HADO

[jira] Commented: (HADOOP-5981) HADOOP-2838 doesnt work as expected

2009-06-05 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12716602#action_12716602 ] Amar Kamat commented on HADOOP-5981: Result of test-patch [exec] +1 ove

[jira] Updated: (HADOOP-5981) HADOOP-2838 doesnt work as expected

2009-06-05 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-5981: --- Attachment: HADOOP-5981-v1.1.patch HADOOP-5981-v1.1-branch-20.patch Attaching a

[jira] Created: (HADOOP-5981) HADOOP-2838 doesnt work as expected

2009-06-05 Thread Amar Kamat (JIRA)
Kamat Assignee: Amar Kamat Fix For: 0.21.0 The substitution feature i.e X=$X:/tmp doesnt work as expected. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.

[jira] Commented: (HADOOP-5977) Avoid creating JobInProgress objects before Access checks and Queues checks are done in JobTracker submitJob

2009-06-05 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12716577#action_12716577 ] Amar Kamat commented on HADOOP-5977: Rahul, this is done because the jobcon

[jira] Commented: (HADOOP-2838) Add HADOOP_LIBRARY_PATH config setting so Hadoop will include external directories for jni

2009-06-05 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12716574#action_12716574 ] Amar Kamat commented on HADOOP-2838: I tried that with the testcase and the job f

[jira] Commented: (HADOOP-2838) Add HADOOP_LIBRARY_PATH config setting so Hadoop will include external directories for jni

2009-06-05 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12716571#action_12716571 ] Amar Kamat commented on HADOOP-2838: bq. Stumbled on this patch.. what happens if

[jira] Commented: (HADOOP-5785) The job setup and cleanup tasks should be optional

2009-06-05 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12716530#action_12716530 ] Amar Kamat commented on HADOOP-5785: Some comments on JobInProgress : 1. re

[jira] Updated: (HADOOP-5643) Ability to blacklist tasktracker

2009-06-04 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-5643: --- Attachment: Fixed+5643-0.20-part2 Example patch not to be committed. > Ability to blackl

[jira] Updated: (HADOOP-2838) Add HADOOP_LIBRARY_PATH config setting so Hadoop will include external directories for jni

2009-06-04 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-2838: --- Attachment: HADOOP-2838-v2.2-branch-20-example.patch Not to be committed to branch 20. Just an

[jira] Commented: (HADOOP-2838) Add HADOOP_LIBRARY_PATH config setting so Hadoop will include external directories for jni

2009-06-04 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12716262#action_12716262 ] Amar Kamat commented on HADOOP-2838: Ant tests passed on my box. &

[jira] Commented: (HADOOP-5746) Errors encountered in MROutputThread after the last map/reduce call can go undetected

2009-06-04 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12716259#action_12716259 ] Amar Kamat commented on HADOOP-5746: Result of test-patch {code} [exec] -1 ove

[jira] Updated: (HADOOP-2838) Add HADOOP_LIBRARY_PATH config setting so Hadoop will include external directories for jni

2009-06-04 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-2838: --- Attachment: HADOOP-2838-v2.2.patch Attaching a patch incorporating Sharad's comments. Resu

[jira] Updated: (HADOOP-5746) Errors encountered in MROutputThread after the last map/reduce call can go undetected

2009-06-02 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-5746: --- Attachment: 5746-testcase.patch 5746-reproduce.1.patch 5746.6.patch

[jira] Commented: (HADOOP-2838) Add HADOOP_LIBRARY_PATH config setting so Hadoop will include external directories for jni

2009-06-02 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12715785#action_12715785 ] Amar Kamat commented on HADOOP-2838: Todd, I think for now we can keep this si

[jira] Commented: (HADOOP-5921) JobTracker does not come up because of NotReplicatedYetException

2009-06-02 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12715487#action_12715487 ] Amar Kamat commented on HADOOP-5921: Steve/Devaraj, as of today the jobtracker si

[jira] Updated: (HADOOP-5908) ArithmeticException in heartbeats with zero map jobs

2009-06-02 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-5908: --- Attachment: HADOOP-5908-v3.3-branch20.patch Attaching a patch for 0.20 branch

[jira] Updated: (HADOOP-5924) JT fails to recover the jobs after restart after HADOOP:4372

2009-06-02 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-5924: --- Attachment: HADOOP-5924-v1.0-branch20.patch Attaching a patch for 0.20 branch. > JT fails

[jira] Updated: (HADOOP-2838) Add HADOOP_LIBRARY_PATH config setting so Hadoop will include external directories for jni

2009-06-01 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-2838: --- Attachment: HADOOP-2838-v1.1.patch Attaching a new patch with a bug fix. Result of test-patch

[jira] Updated: (HADOOP-2838) Add HADOOP_LIBRARY_PATH config setting so Hadoop will include external directories for jni

2009-06-01 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-2838: --- Component/s: (was: scripts) mapred Assignee: Amar Kamat (was: Owen

[jira] Updated: (HADOOP-2838) Add HADOOP_LIBRARY_PATH config setting so Hadoop will include external directories for jni

2009-06-01 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-2838: --- Attachment: HADOOP-2838-v1.0.patch Attaching a patch that provides the facility to add/set/append

[jira] Updated: (HADOOP-5924) JT fails to recover the jobs after restart after HADOOP:4372

2009-06-01 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-5924: --- Attachment: HADOOP-5924-v1.0.patch Attaching a patch incorporating Devaraj's comments. Resu

[jira] Updated: (HADOOP-5908) ArithmeticException in heartbeats with zero map jobs

2009-06-01 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-5908: --- Attachment: HADOOP-5908-v3.3.patch Attaching a patch incorporating Devaraj's comments. Resu

[jira] Commented: (HADOOP-5924) JT fails to recover the jobs after restart after HADOOP:4372

2009-05-30 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12714707#action_12714707 ] Amar Kamat commented on HADOOP-5924: ant test passed on my box. > JT f

[jira] Commented: (HADOOP-5908) ArithmeticException in heartbeats with zero map jobs

2009-05-30 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12714706#action_12714706 ] Amar Kamat commented on HADOOP-5908: test-patch and ant tests passed on my

[jira] Updated: (HADOOP-5924) JT fails to recover the jobs after restart after HADOOP:4372

2009-05-29 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-5924: --- Attachment: HADOOP-5923-v2.4.patch Attaching a patch that fixes the issue. Result of test-patch

  1   2   3   4   5   6   7   8   9   10   >