[jira] Created: (HADOOP-1339) Shuffle should be refactored to a separate task by itself

2007-05-07 Thread Devaraj Das (JIRA)
Shuffle should be refactored to a separate task by itself - Key: HADOOP-1339 URL: https://issues.apache.org/jira/browse/HADOOP-1339 Project: Hadoop Issue Type: New Feature Com

[jira] Created: (HADOOP-1338) Improve the shuffle phase by using the "connection: keep-alive" and doing batch transfers of files

2007-05-07 Thread Devaraj Das (JIRA)
Improve the shuffle phase by using the "connection: keep-alive" and doing batch transfers of files -- Key: HADOOP-1338 URL: https://issues.apache.org/jira/browse/HADOO

[jira] Resolved: (HADOOP-1183) MapTask completion not recorded properly at the Reducer's end

2007-05-07 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved HADOOP-1183. - Resolution: Duplicate The original bug is a duplicate of HADOOP-1270. The comment on redesigning

[jira] Created: (HADOOP-1337) Each shuffle should proceed as a DFA

2007-05-07 Thread Devaraj Das (JIRA)
Each shuffle should proceed as a DFA Key: HADOOP-1337 URL: https://issues.apache.org/jira/browse/HADOOP-1337 Project: Hadoop Issue Type: Improvement Components: mapred Reporter: Deva

[jira] Commented: (HADOOP-1197) The misleading Configuration.set(String, Object) should be removed

2007-05-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12494190 ] Hadoop QA commented on HADOOP-1197: --- +1 http://issues.apache.org/jira/secure/attachment/12356896/no-object-get.pa

[jira] Updated: (HADOOP-1197) The misleading Configuration.set(String, Object) should be removed

2007-05-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1197: -- Attachment: no-object-get.patch > The misleading Configuration.set(String, Object) should be r

[jira] Updated: (HADOOP-1197) The misleading Configuration.set(String, Object) should be removed

2007-05-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1197: -- Status: Patch Available (was: Open) This patch deprecates the offending methods. It also adds

[jira] Resolved: (HADOOP-39) Create a job-configurable best effort for job execution

2007-05-07 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-39?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved HADOOP-39. - Resolution: Duplicate Fixed as a part of HADOOP-1144 > Create a job-configurable best effort for

[jira] Updated: (HADOOP-1298) adding user info to file

2007-05-07 Thread Kurtis Heimerl (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kurtis Heimerl updated HADOOP-1298: --- Attachment: hadoop-user-munncha.patch11 Cleaned up. The only features missing from this rele

[jira] Resolved: (HADOOP-1097) Bug in XML serialization of strings in record I/O

2007-05-07 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milind Bhandarkar resolved HADOOP-1097. --- Resolution: Duplicate Fix Version/s: (was: 0.13.0) Patch for this bug was

[jira] Updated: (HADOOP-1201) Progress reporting can be improved for both Map/Reduce tasks

2007-05-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1201: -- Fix Version/s: (was: 0.13.0) > Progress reporting can be improved for both Map/Reduce task

[jira] Updated: (HADOOP-1197) The misleading Configuration.set(String, Object) should be removed

2007-05-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1197: -- Fix Version/s: (was: 0.13.0) 0.14.0 > The misleading Configuration.set(

[jira] Updated: (HADOOP-1125) IPC client fails to override the close method for FilterOutputStream

2007-05-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1125: -- Fix Version/s: (was: 0.13.0) 0.14.0 > IPC client fails to override the

[jira] Updated: (HADOOP-1084) updating a hdfs file, doesn't cause the distributed file cache to update itself

2007-05-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1084: -- Fix Version/s: (was: 0.13.0) > updating a hdfs file, doesn't cause the distributed file ca

[jira] Updated: (HADOOP-1100) job submission protocol should have a method for getting the "task capacity" of the cluster

2007-05-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1100: -- Fix Version/s: (was: 0.13.0) > job submission protocol should have a method for getting th

[jira] Updated: (HADOOP-1168) Not able to refresh file cache

2007-05-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1168: -- Fix Version/s: (was: 0.13.0) > Not able to refresh file cache > --

[jira] Updated: (HADOOP-1031) Provide "swiggable" C binding for Hadoop Record I/O

2007-05-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1031: -- Fix Version/s: (was: 0.13.0) 0.14.0 > Provide "swiggable" C binding for

[jira] Updated: (HADOOP-1267) change default config to be single node rather than "local" for both map/reduce and hdfs

2007-05-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1267: -- Fix Version/s: (was: 0.13.0) 0.14.0 > change default config to be singl

[jira] Resolved: (HADOOP-1209) Record I/O should support comments in the DDL

2007-05-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved HADOOP-1209. --- Resolution: Cannot Reproduce Fix Version/s: (was: 0.13.0) Assignee: (

[jira] Updated: (HADOOP-1095) Provide ByteStreams in C++ version of record I/O

2007-05-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1095: -- Fix Version/s: (was: 0.13.0) 0.14.0 > Provide ByteStreams in C++ versio

[jira] Resolved: (HADOOP-1069) Rename Hadoop record I/O to Jute

2007-05-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved HADOOP-1069. --- Resolution: Won't Fix Assignee: (was: Milind Bhandarkar) > Rename Hadoop record I/

[jira] Updated: (HADOOP-206) local map-reduce job limited to single reducer

2007-05-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-206: - Fix Version/s: (was: 0.13.0) 0.14.0 > local map-reduce job limited to sing

[jira] Created: (HADOOP-1336) turn on speculative execution by defaul

2007-05-07 Thread Owen O'Malley (JIRA)
turn on speculative execution by defaul --- Key: HADOOP-1336 URL: https://issues.apache.org/jira/browse/HADOOP-1336 Project: Hadoop Issue Type: Task Components: mapred Affects Versions: 0.12.

[jira] Updated: (HADOOP-1324) FSError encountered by one running task should not be fatal to other tasks on that node

2007-05-07 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-1324: - Resolution: Fixed Fix Version/s: 0.13.0 Status: Resolved (was: Patch Available

[jira] Updated: (HADOOP-1252) Disk problems should be handled better by the MR framework

2007-05-07 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-1252: - Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this. Thank

[jira] Resolved: (HADOOP-1098) output blocks lost when speculative execution is used

2007-05-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved HADOOP-1098. --- Resolution: Duplicate This was fixed by HADOOP-1127. > output blocks lost when speculative

[jira] Updated: (HADOOP-1200) Datanode should periodically do a disk check

2007-05-07 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-1200: - Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this. Thank

[jira] Updated: (HADOOP-1224) "Browse the filesystem" link pointing to a dead data-node

2007-05-07 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-1224: - Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this. Thank

[jira] Updated: (HADOOP-1270) Randomize the fetch of map outputs

2007-05-07 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-1270: - Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this. Thank

[jira] Updated: (HADOOP-1326) Return the RunningJob from JobClient.runJob

2007-05-07 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-1326: - Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this. Thank

[jira] Updated: (HADOOP-1298) adding user info to file

2007-05-07 Thread Kurtis Heimerl (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kurtis Heimerl updated HADOOP-1298: --- Attachment: hadoop-user-munncha.patch10 This patch has cleaned up the permissions object and

[jira] Updated: (HADOOP-1276) TaskTracker expiry interval is not configurable

2007-05-07 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-1276: - Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this. Thank

[jira] Updated: (HADOOP-1325) HBase code update 0.0.0-2

2007-05-07 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-1325: - Resolution: Fixed Fix Version/s: 0.13.0 Status: Resolved (was: Patch Available

[jira] Updated: (HADOOP-1263) retry logic when dfs exist or open fails temporarily, e.g because of timeout

2007-05-07 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-1263: - Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this. Thank

[jira] Updated: (HADOOP-1184) Decommission fails if a block that needs replication has only one replica

2007-05-07 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-1184: - Resolution: Fixed Fix Version/s: 0.13.0 Status: Resolved (was: Patch Available

[jira] Created: (HADOOP-1335) C++ reducers under hadoop-pipes are not started when there are no key-value pairs to be reduced

2007-05-07 Thread Christian Kunz (JIRA)
C++ reducers under hadoop-pipes are not started when there are no key-value pairs to be reduced --- Key: HADOOP-1335 URL: https://issues.apache.org/jira/browse/HADOOP-1335

[jira] Commented: (HADOOP-1298) adding user info to file

2007-05-07 Thread Kurtis Heimerl (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12494105 ] Kurtis Heimerl commented on HADOOP-1298: 1-> yes. I've only passed it where it's needed for creation as of n

[jira] Commented: (HADOOP-1327) Doc on Streaming

2007-05-07 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12494099 ] Doug Cutting commented on HADOOP-1327: -- This is great to have! Can you please convert it to Forrest's XML mark

Re: doc on Hadoop streaming

2007-05-07 Thread Doug Cutting
Runping Qi wrote: What is the right procedure to work on docs? If they're going into subversion, then attach them to an issue in Jira, or you can write them directly in the wiki. Things for inclusion in subversion should be written in Forrest's XML markup (http://forrest.apache.org/). Dou

[jira] Commented: (HADOOP-894) dfs client protocol should allow asking for parts of the block map

2007-05-07 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12494094 ] Doug Cutting commented on HADOOP-894: - When we open a file we don't need anything in return except the length, si

[jira] Commented: (HADOOP-1324) FSError encountered by one running task should not be fatal to other tasks on that node

2007-05-07 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12494068 ] Devaraj Das commented on HADOOP-1324: - +1 > FSError encountered by one running task should not be fatal to othe

[jira] Commented: (HADOOP-1252) Disk problems should be handled better by the MR framework

2007-05-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12494042 ] Hadoop QA commented on HADOOP-1252: --- +1 http://issues.apache.org/jira/secure/attachment/12356859/1252.may7.patch

[jira] Updated: (HADOOP-1252) Disk problems should be handled better by the MR framework

2007-05-07 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HADOOP-1252: Status: Patch Available (was: Open) > Disk problems should be handled better by the MR framework

[jira] Updated: (HADOOP-1252) Disk problems should be handled better by the MR framework

2007-05-07 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HADOOP-1252: Attachment: 1252.may7.patch Had attached the wrong patch earlier .. attaching the correct one this

[jira] Updated: (HADOOP-1252) Disk problems should be handled better by the MR framework

2007-05-07 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HADOOP-1252: Attachment: (was: 1252.may7.patch) > Disk problems should be handled better by the MR framewor

[jira] Updated: (HADOOP-1252) Disk problems should be handled better by the MR framework

2007-05-07 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HADOOP-1252: Attachment: 1252.may7.patch Attached is a patch that addresses (hopefully) Doug's concerns. > Di

[jira] Resolved: (HADOOP-1323) Disk problems encountered by a running task are not correctly reported to the user

2007-05-07 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved HADOOP-1323. - Resolution: Won't Fix This issue will be handled by the fix for HADOOP-1324. > Disk problems en

[jira] Resolved: (HADOOP-1087) Reducer hangs pulling from incorrect file.out.index path. (when one of the mapred.local.dir is not accessible but becomes available later at reduce time)

2007-05-07 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved HADOOP-1087. - Resolution: Won't Fix Resolving this for now. The comments made earlier explain the reason. Also

Hudson build is back to normal: Hadoop-Nightly #81

2007-05-07 Thread hudson
See http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/81/

[jira] Commented: (HADOOP-1324) FSError encountered by one running task should not be fatal to other tasks on that node

2007-05-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12494004 ] Hadoop QA commented on HADOOP-1324: --- +1 http://issues.apache.org/jira/secure/attachment/12356848/HADOOP-1324_2007

[jira] Updated: (HADOOP-1324) FSError encountered by one running task should not be fatal to other tasks on that node

2007-05-07 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-1324: -- Affects Version/s: 0.12.3 Status: Patch Available (was: Open) > FSError encoun

[jira] Updated: (HADOOP-1324) FSError encountered by one running task should not be fatal to other tasks on that node

2007-05-07 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-1324: -- Attachment: HADOOP-1324_20070507_1.patch Simple fix: On receipt of FSError from the child-vm,

[jira] Assigned: (HADOOP-1324) FSError encountered by one running task should not be fatal to other tasks on that node

2007-05-07 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy reassigned HADOOP-1324: - Assignee: Arun C Murthy > FSError encountered by one running task should not be fatal to

[jira] Commented: (HADOOP-1171) NPE in TaskTracker RenitTrackerAction

2007-05-07 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12493992 ] Tahir Hashmi commented on HADOOP-1171: -- I went through the code for to figure out why the NPE might have been

[jira] Commented: (HADOOP-1331) Multiple entries for 'dfs.client.buffer.dir'

2007-05-07 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12493991 ] Devaraj Das commented on HADOOP-1331: - The DFSClient already uses the Configuration.getLocalPath API that will