[jira] Assigned: (HADOOP-1694) lzo compressed input files not properly recognized

2007-08-24 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi reassigned HADOOP-1694: Assignee: Tahir Hashmi > lzo compressed input files not properly recognized >

[jira] Assigned: (HADOOP-1432) Use Grizzly for Fetching Map Output in Shuffle

2007-08-24 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi reassigned HADOOP-1432: Assignee: Devaraj Das (was: Tahir Hashmi) > Use Grizzly for Fetching Map Output in Shuffl

[jira] Commented: (HADOOP-1694) lzo compressed input files not properly recognized

2007-08-16 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12520219 ] Tahir Hashmi commented on HADOOP-1694: -- The quoted text doesn't look like a direct dump of LZO header. Could yo

[jira] Commented: (HADOOP-1698) 7500+ reducers/partitions causes job to hang

2007-08-13 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12519492 ] Tahir Hashmi commented on HADOOP-1698: -- Minor nit with the latest patch. SequenceFile.java still has the follow

[jira] Commented: (HADOOP-1698) 7500+ reducers/partitions causes job to hang

2007-08-13 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12519490 ] Tahir Hashmi commented on HADOOP-1698: -- Yeah, that's true. My point was about the fact that changing the value

[jira] Commented: (HADOOP-1698) 7500+ reducers/partitions causes job to hang

2007-08-10 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12519119 ] Tahir Hashmi commented on HADOOP-1698: -- Is there any proof of the fact that generating a 128 bit random number

[jira] Commented: (HADOOP-1432) Use Grizzly for Fetching Map Output in Shuffle

2007-06-08 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12503014 ] Tahir Hashmi commented on HADOOP-1432: -- It was only as fast as Jetty 5 as per a Sort-500 run done on Thursday.

[jira] Commented: (HADOOP-1432) Use Grizzly for Fetching Map Output in Shuffle

2007-06-08 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12502742 ] Tahir Hashmi commented on HADOOP-1432: -- News here. Thanks to pushing, shoving and helping from Devaraj, I've go

[jira] Updated: (HADOOP-1432) Use Grizzly for Fetching Map Output in Shuffle

2007-06-08 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-1432: - Attachment: grizzly.tgz > Use Grizzly for Fetching Map Output in Shuffle > -

[jira] Updated: (HADOOP-1432) Use Grizzly for Fetching Map Output in Shuffle

2007-06-08 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-1432: - Attachment: 1432.patch > Use Grizzly for Fetching Map Output in Shuffle > --

[jira] Resolved: (HADOOP-1273) Upgrade Jetty to 6.x

2007-05-25 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi resolved HADOOP-1273. -- Resolution: Won't Fix Since Jetty 6 still doesn't appear to be stable enough, we've decided to

[jira] Created: (HADOOP-1432) Use Grizzly for Fetching Map Output in Shuffle

2007-05-25 Thread Tahir Hashmi (JIRA)
Use Grizzly for Fetching Map Output in Shuffle -- Key: HADOOP-1432 URL: https://issues.apache.org/jira/browse/HADOOP-1432 Project: Hadoop Issue Type: Improvement Components: mapred

[jira] Commented: (HADOOP-1273) Upgrade Jetty to 6.x

2007-05-24 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12498642 ] Tahir Hashmi commented on HADOOP-1273: -- As per http://jira.codehaus.org/browse/JETTY-345#action_96904, the bug

[jira] Commented: (HADOOP-1273) Upgrade Jetty to 6.x

2007-05-23 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12498265 ] Tahir Hashmi commented on HADOOP-1273: -- Status update: After more than a week of pecking at it, we managed to g

[jira] Updated: (HADOOP-1273) Upgrade Jetty to 6.x

2007-05-14 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-1273: - Attachment: 1273.patch Attaching the patch that's been applied to the current source and a tarba

[jira] Updated: (HADOOP-1273) Upgrade Jetty to 6.x

2007-05-14 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-1273: - Attachment: hadoop-0.12.4-lib.tar.gz > Upgrade Jetty to 6.x > > >

[jira] Commented: (HADOOP-1171) NPE in TaskTracker RenitTrackerAction

2007-05-07 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12493992 ] Tahir Hashmi commented on HADOOP-1171: -- I went through the code for to figure out why the NPE might have been

[jira] Commented: (HADOOP-485) allow a different comparator for grouping keys in calls to reduce

2007-05-03 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12493480 ] Tahir Hashmi commented on HADOOP-485: - Party time! :D > allow a different comparator for grouping keys in calls

[jira] Commented: (HADOOP-1171) NPE in TaskTracker RenitTrackerAction

2007-05-03 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12493348 ] Tahir Hashmi commented on HADOOP-1171: -- Which version of Hadoop was this bug encountered in? The line numbers i

[jira] Updated: (HADOOP-485) allow a different comparator for grouping keys in calls to reduce

2007-05-02 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-485: Status: Patch Available (was: Open) > allow a different comparator for grouping keys in calls to r

[jira] Updated: (HADOOP-485) allow a different comparator for grouping keys in calls to reduce

2007-05-02 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-485: Attachment: 485.patch Rebuilt against revision 534626. Hope this works! > allow a different compar

[jira] Updated: (HADOOP-485) allow a different comparator for grouping keys in calls to reduce

2007-05-02 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-485: Status: Patch Available (was: Open) > allow a different comparator for grouping keys in calls to r

[jira] Updated: (HADOOP-485) allow a different comparator for grouping keys in calls to reduce

2007-05-02 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-485: Attachment: 485.patch Sorry for the delayed turnaround. Had some painful issues with the build env

[jira] Updated: (HADOOP-485) allow a different comparator for grouping keys in calls to reduce

2007-04-30 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-485: Status: Patch Available (was: Open) > allow a different comparator for grouping keys in calls to r

[jira] Updated: (HADOOP-485) allow a different comparator for grouping keys in calls to reduce

2007-04-30 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-485: Attachment: 485.patch Added javadoc documentation for get and set methods in JobConf. > allow a di

[jira] Commented: (HADOOP-1294) Fix unchecked warnings in main Hadoop code under Java 6.

2007-04-26 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491935 ] Tahir Hashmi commented on HADOOP-1294: -- I get the following warning after applying the patch: [javac] /ho

[jira] Updated: (HADOOP-485) allow a different comparator for grouping keys in calls to reduce

2007-04-25 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-485: Status: Patch Available (was: Open) > allow a different comparator for grouping keys in calls to r

[jira] Updated: (HADOOP-485) allow a different comparator for grouping keys in calls to reduce

2007-04-25 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-485: Attachment: 485.patch This patch addresses Devaraj's comments. I could run the specific unit test f

[jira] Updated: (HADOOP-485) allow a different comparator for grouping keys in calls to reduce

2007-04-24 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-485: Attachment: 485.patch Here's a patch that includes a test case for this feature and also changes to

[jira] Updated: (HADOOP-1152) Reduce task hang failing in MapOutputCopier.copyOutput

2007-04-20 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-1152: - Attachment: (was: 1152.workaround.patch) > Reduce task hang failing in MapOutputCopier.copyO

[jira] Updated: (HADOOP-1152) Reduce task hang failing in MapOutputCopier.copyOutput

2007-04-20 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-1152: - Status: Patch Available (was: Open) > Reduce task hang failing in MapOutputCopier.copyOutput >

[jira] Updated: (HADOOP-1152) Reduce task hang failing in MapOutputCopier.copyOutput

2007-04-20 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-1152: - Attachment: 1152.patch Looked at this with Devaraj yesterday and our theory about why this fails

[jira] Commented: (HADOOP-485) allow a different comparator for grouping keys in calls to reduce

2007-04-19 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12490078 ] Tahir Hashmi commented on HADOOP-485: - Got a bit of enlightenment from Sameer on this and it turns out that the w

[jira] Assigned: (HADOOP-1152) Reduce task hang failing in MapOutputCopier.copyOutput

2007-04-19 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi reassigned HADOOP-1152: Assignee: Tahir Hashmi > Reduce task hang failing in MapOutputCopier.copyOutput >

[jira] Assigned: (HADOOP-1171) NPE in TaskTracker RenitTrackerAction

2007-04-19 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi reassigned HADOOP-1171: Assignee: Tahir Hashmi > NPE in TaskTracker RenitTrackerAction >

[jira] Commented: (HADOOP-485) allow a different comparator for grouping keys in calls to reduce

2007-04-19 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12489986 ] Tahir Hashmi commented on HADOOP-485: - Sameer, Devaraj, Arun and I had some involved discussions regarding this i

[jira] Commented: (HADOOP-485) allow a different comparator for grouping keys in calls to reduce

2007-04-18 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12489836 ] Tahir Hashmi commented on HADOOP-485: - Sorry, read that as "...infrastructure for grouping to reduce based on som

[jira] Commented: (HADOOP-485) allow a different comparator for grouping keys in calls to reduce

2007-04-18 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12489835 ] Tahir Hashmi commented on HADOOP-485: - Does the infrastructure for grouping to reduce based on some properties of

[jira] Updated: (HADOOP-485) allow a different comparator for grouping keys in calls to reduce

2007-04-18 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-485: Attachment: TestUserValueGrouping.java.patch Here's a basic test for this requirement. The mapper g

[jira] Updated: (HADOOP-485) allow a different comparator for grouping keys in calls to reduce

2007-04-18 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-485: Attachment: Hadoop-485-pre.patch Here's a proof-of-concept patch for this requirement. The intent i

[jira] Assigned: (HADOOP-485) allow a different comparator for grouping keys in calls to reduce

2007-04-18 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi reassigned HADOOP-485: --- Assignee: Tahir Hashmi (was: Owen O'Malley) > allow a different comparator for grouping keys

[jira] Updated: (HADOOP-1001) the output of the map is not type checked against the specified types

2007-04-10 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-1001: - Status: Patch Available (was: Open) > the output of the map is not type checked against the spe

[jira] Updated: (HADOOP-1001) the output of the map is not type checked against the specified types

2007-04-10 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-1001: - Attachment: final.1001.patch Unified patch for 1001 > the output of the map is not type checked

[jira] Updated: (HADOOP-1001) the output of the map is not type checked against the specified types

2007-04-02 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-1001: - Attachment: TestMapOutputType.java The problem with this test is that the exception thrown by Ma

[jira] Updated: (HADOOP-1001) the output of the map is not type checked against the specified types

2007-03-30 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-1001: - Attachment: TestMapOutputType.java Here's a JUnit test case that generates the exceptions. Unfor

[jira] Updated: (HADOOP-1001) the output of the map is not type checked against the specified types

2007-03-30 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-1001: - Attachment: 1001.patch Re-written exception message to be more meaningful. > the output of the

[jira] Updated: (HADOOP-1001) the output of the map is not type checked against the specified types

2007-03-30 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-1001: - Status: Patch Available (was: Open) > the output of the map is not type checked against the spe

[jira] Commented: (HADOOP-1001) the output of the map is not type checked against the specified types

2007-03-30 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12485614 ] Tahir Hashmi commented on HADOOP-1001: -- Oh yes, reporting the expected and received type names is the right thi

[jira] Updated: (HADOOP-1001) the output of the map is not type checked against the specified types

2007-03-30 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-1001: - Status: Patch Available (was: Open) > the output of the map is not type checked against the spe

[jira] Updated: (HADOOP-1001) the output of the map is not type checked against the specified types

2007-03-30 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-1001: - Attachment: 1001.patch Using fields keyClass and valClass instead of calling JobConf methods. >

[jira] Updated: (HADOOP-1011) ConcurrentModificationException in JobHistory

2007-03-29 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-1011: - Attachment: 1011.patch Here's a patch that probably fixes the issue. I don't have enough infras

[jira] Commented: (HADOOP-1161) need improved release process

2007-03-28 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484779 ] Tahir Hashmi commented on HADOOP-1161: -- > * Use trunk for main development. > * Create a branch for each major

[jira] Updated: (HADOOP-1001) the output of the map is not type checked against the specified types

2007-03-27 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-1001: - Status: Patch Available (was: Open) > the output of the map is not type checked against the spe

[jira] Updated: (HADOOP-1001) the output of the map is not type checked against the specified types

2007-03-27 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-1001: - Attachment: 1001.patch Patch to check the type of keys and values generated by the mapper agains

[jira] Updated: (HADOOP-1071) RPC$VersionMismatch exception is not fatal to JobTracker

2007-03-14 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-1071: - Status: Patch Available (was: Open) > RPC$VersionMismatch exception is not fatal to JobTracker

[jira] Updated: (HADOOP-1071) RPC$VersionMismatch exception is not fatal to JobTracker

2007-03-14 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-1071: - Attachment: 1071.patch Patch for fixing HADOOP-1071. Apart from fixing the retry issue, I've als