[jira] Commented: (MAPREDUCE-1850) Include job submit host information (name and ip) in jobconf and jobdetails display
[ https://issues.apache.org/jira/browse/MAPREDUCE-1850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12882972#action_12882972 ] Krishna Ramachandran commented on MAPREDUCE-1850: - can you commit and resolve? Include job submit host information (name and ip) in jobconf and jobdetails display --- Key: MAPREDUCE-1850 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1850 Project: Hadoop Map/Reduce Issue Type: Improvement Affects Versions: 0.22.0 Reporter: Krishna Ramachandran Assignee: Krishna Ramachandran Attachments: mapred-1850-1.patch, mapred-1850-2.patch, mapred-1850-3.patch, mapred-1850-4.patch, mapred-1850-5.patch, mapred-1850.patch, mapred-1850.patch Enhancement to identify the source (submit host and ip) of a job request. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1845) FairScheduler.tasksToPeempt() can return negative number
[ https://issues.apache.org/jira/browse/MAPREDUCE-1845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12882994#action_12882994 ] Matei Zaharia commented on MAPREDUCE-1845: -- +1, looks good to me. Let me know if you are ready to have it committed (or just have Dhruba commit it). FairScheduler.tasksToPeempt() can return negative number Key: MAPREDUCE-1845 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1845 Project: Hadoop Map/Reduce Issue Type: Bug Components: contrib/fair-share Affects Versions: 0.22.0 Reporter: Scott Chen Assignee: Scott Chen Fix For: 0.22.0 Attachments: MAPREDUCE-1845-v2.txt, MAPREDUCE-1845.20100717.txt This method can return negative number. This will cause the preemption to under-preempt. The bug was discovered by Joydeep. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1850) Include job submit host information (name and ip) in jobconf and jobdetails display
[ https://issues.apache.org/jira/browse/MAPREDUCE-1850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-1850: --- Status: Patch Available (was: Open) Include job submit host information (name and ip) in jobconf and jobdetails display --- Key: MAPREDUCE-1850 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1850 Project: Hadoop Map/Reduce Issue Type: Improvement Affects Versions: 0.22.0 Reporter: Krishna Ramachandran Assignee: Krishna Ramachandran Attachments: mapred-1850-1.patch, mapred-1850-2.patch, mapred-1850-3.patch, mapred-1850-4.patch, mapred-1850-5.patch, mapred-1850.patch, mapred-1850.patch Enhancement to identify the source (submit host and ip) of a job request. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1850) Include job submit host information (name and ip) in jobconf and jobdetails display
[ https://issues.apache.org/jira/browse/MAPREDUCE-1850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-1850: --- Status: Open (was: Patch Available) Couldn't view the test report. Re-running through hudson. Include job submit host information (name and ip) in jobconf and jobdetails display --- Key: MAPREDUCE-1850 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1850 Project: Hadoop Map/Reduce Issue Type: Improvement Affects Versions: 0.22.0 Reporter: Krishna Ramachandran Assignee: Krishna Ramachandran Attachments: mapred-1850-1.patch, mapred-1850-2.patch, mapred-1850-3.patch, mapred-1850-4.patch, mapred-1850-5.patch, mapred-1850.patch, mapred-1850.patch Enhancement to identify the source (submit host and ip) of a job request. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1888) Streaming overrides user given output key and value types.
[
https://issues.apache.org/jira/browse/MAPREDUCE-1888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12883032#action_12883032
]
Amareshwari Sriramadasu commented on MAPREDUCE-1888:
Some comments on the patch:
* Please don't change genArgs() in TestStreaming. You can override it in
TestStreamingJavaTasks as done in other tests.
* Is the Change in TestFileOutputFormat required?
Streaming overrides user given output key and value types.
--
Key: MAPREDUCE-1888
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1888
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: contrib/streaming
Affects Versions: 0.21.0
Reporter: Amareshwari Sriramadasu
Assignee: Ravi Gummadi
Fix For: 0.22.0
Attachments: 1888.patch
The following code in StreamJob.java overrides user given output key and
value types.
{code}
idResolver.resolve(conf.get(StreamJobConfig.MAP_OUTPUT,
IdentifierResolver.TEXT_ID));
conf.setClass(StreamJobConfig.MAP_OUTPUT_READER_CLASS,
idResolver.getOutputReaderClass(), OutputReader.class);
job.setMapOutputKeyClass(idResolver.getOutputKeyClass());
job.setMapOutputValueClass(idResolver.getOutputValueClass());
idResolver.resolve(conf.get(StreamJobConfig.REDUCE_OUTPUT,
IdentifierResolver.TEXT_ID));
conf.setClass(StreamJobConfig.REDUCE_OUTPUT_READER_CLASS,
idResolver.getOutputReaderClass(), OutputReader.class);
job.setOutputKeyClass(idResolver.getOutputKeyClass());
job.setOutputValueClass(idResolver.getOutputValueClass());
{code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Created: (MAPREDUCE-1898) [Herriot] Implement a functionality for getting the job summary information of a job.
[Herriot] Implement a functionality for getting the job summary information of a job. - Key: MAPREDUCE-1898 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1898 Project: Hadoop Map/Reduce Issue Type: Task Components: test Reporter: Vinay Kumar Thota Implement a method for getting the job summary details of a job. The job summary should be. jobId, startTime, launchTime, finishTime, numMaps, numSlotsPerMap, numReduces, numSlotsPerReduce, user, queue, status, mapSlotSeconds, reduceSlotSeconds, clusterMapCapacity,clusterReduceCapacity. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Assigned: (MAPREDUCE-1898) [Herriot] Implement a functionality for getting the job summary information of a job.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay Kumar Thota reassigned MAPREDUCE-1898: Assignee: Vinay Kumar Thota [Herriot] Implement a functionality for getting the job summary information of a job. - Key: MAPREDUCE-1898 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1898 Project: Hadoop Map/Reduce Issue Type: Task Components: test Reporter: Vinay Kumar Thota Assignee: Vinay Kumar Thota Implement a method for getting the job summary details of a job. The job summary should be. jobId, startTime, launchTime, finishTime, numMaps, numSlotsPerMap, numReduces, numSlotsPerReduce, user, queue, status, mapSlotSeconds, reduceSlotSeconds, clusterMapCapacity,clusterReduceCapacity. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
