[jira] Updated: (HADOOP-3332) improving the logging during shuffling

2008-05-07 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-3332: --- Description: Below is an excerpt from the log file of a reducer. A same set of of messages about fe

[jira] Updated: (HADOOP-3135) if the 'mapred.system.dir' in the client jobconf is different from the JobTracker's value job submission fails

2008-05-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-3135: -- Status: Open (was: Patch Available) I'm sorry, but this patch is out of sync with respect to

[jira] Updated: (HADOOP-3364) Faster image and log edits loading.

2008-05-07 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HADOOP-3364: Attachment: fastLoadImage.patch > Faster image and log edits loading. > --

[jira] Updated: (HADOOP-3364) Faster image and log edits loading.

2008-05-07 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HADOOP-3364: Status: Patch Available (was: Open) > Faster image and log edits loading. > -

[jira] Created: (HADOOP-3364) Faster image and log edits loading.

2008-05-07 Thread Konstantin Shvachko (JIRA)
Faster image and log edits loading. --- Key: HADOOP-3364 URL: https://issues.apache.org/jira/browse/HADOOP-3364 Project: Hadoop Core Issue Type: Improvement Components: dfs Affects Versions: 0.18

[jira] Commented: (HADOOP-1915) adding counters methods using String (as opposed to Enum)

2008-05-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12595092#action_12595092 ] Hadoop QA commented on HADOOP-1915: --- +1 overall. Here are the results of testing the la

[jira] Commented: (HADOOP-3341) make key-value separators in hadoop streaming fully configurable

2008-05-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12595085#action_12595085 ] Owen O'Malley commented on HADOOP-3341: --- Yes, please move the other fields down also

[jira] Commented: (HADOOP-3363) HDFS throws a InconsistentFSStateException when the name node starts up on a directory that isnt formatted

2008-05-07 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12595083#action_12595083 ] Doug Cutting commented on HADOOP-3363: -- I'm not sure what you expect here. The files

[jira] Updated: (HADOOP-3297) The way in which ReduceTask/TaskTracker gets completion events during shuffle can be improved

2008-05-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-3297: -- Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this. Than

[jira] Commented: (HADOOP-3341) make key-value separators in hadoop streaming fully configurable

2008-05-07 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12595079#action_12595079 ] Zheng Shao commented on HADOOP-3341: I agree it's cleaner to push the data fields down

[jira] Updated: (HADOOP-1700) Append to files in HDFS

2008-05-07 Thread Robert Chansler (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Chansler updated HADOOP-1700: Attachment: Grid_HadoopRenumberBlocks.pdf Attached a record of some of the discussions of

[jira] Updated: (HADOOP-3341) make key-value separators in hadoop streaming fully configurable

2008-05-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-3341: -- Status: Open (was: Patch Available) This looks good, except that the data fields should be do

[jira] Updated: (HADOOP-3299) org.apache.hadoop.mapred.join.CompositeInputFormat does not initialize TextInput format files with the configuration resulting in an NullPointerException

2008-05-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-3299: -- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Availa

[jira] Commented: (HADOOP-2065) Replication policy for corrupted block

2008-05-07 Thread lohit vijayarenu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12595072#action_12595072 ] lohit vijayarenu commented on HADOOP-2065: -- :) yes, but this map would be quite s

[jira] Updated: (HADOOP-3350) distcp should permit users to limit the number of maps

2008-05-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-3350: -- Status: Open (was: Patch Available) You seem to be missing testcase and documentation. > dis

[jira] Commented: (HADOOP-2065) Replication policy for corrupted block

2008-05-07 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12595064#action_12595064 ] Tsz Wo (Nicholas), SZE commented on HADOOP-2065: When adding entrys to cor

[jira] Commented: (HADOOP-930) Add support for reading regular (non-block-based) files from S3 in S3FileSystem

2008-05-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12595063#action_12595063 ] Hadoop QA commented on HADOOP-930: -- -1 overall. Here are the results of testing the lates

[jira] Updated: (HADOOP-2065) Replication policy for corrupted block

2008-05-07 Thread lohit vijayarenu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lohit vijayarenu updated HADOOP-2065: - Status: Open (was: Patch Available) > Replication policy for corrupted block > ---

[jira] Updated: (HADOOP-2065) Replication policy for corrupted block

2008-05-07 Thread lohit vijayarenu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lohit vijayarenu updated HADOOP-2065: - Attachment: HADOOP-2065-6.patch Had missed adding comments. > Replication policy for c

[jira] Updated: (HADOOP-2065) Replication policy for corrupted block

2008-05-07 Thread lohit vijayarenu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lohit vijayarenu updated HADOOP-2065: - Status: Patch Available (was: Open) > Replication policy for corrupted block > ---

[jira] Updated: (HADOOP-3226) Run combiner when merging spills from map output

2008-05-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-3226: -- Resolution: Fixed Hadoop Flags: [Incompatible change, Reviewed] Status: Resolve

[jira] Updated: (HADOOP-2065) Replication policy for corrupted block

2008-05-07 Thread lohit vijayarenu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lohit vijayarenu updated HADOOP-2065: - Status: Patch Available (was: Open) > Replication policy for corrupted block > ---

[jira] Updated: (HADOOP-2065) Replication policy for corrupted block

2008-05-07 Thread lohit vijayarenu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lohit vijayarenu updated HADOOP-2065: - Status: Open (was: Patch Available) > Replication policy for corrupted block > ---

[jira] Updated: (HADOOP-2065) Replication policy for corrupted block

2008-05-07 Thread lohit vijayarenu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lohit vijayarenu updated HADOOP-2065: - Attachment: HADOOP-2065-5.patch Attached is the patch against trunk. > Replication poli

[jira] Commented: (HADOOP-3363) HDFS throws a InconsistentFSStateException when the name node starts up on a directory that isnt formatted

2008-05-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12595052#action_12595052 ] Steve Loughran commented on HADOOP-3363: stack trace. The two classes at the root

[jira] Updated: (HADOOP-3349) FSNamesystem.changeLease(src, dst) incorrectly updates the paths inside a lease

2008-05-07 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HADOOP-3349: --- Attachment: 3349_20080507c.patch 3349_20080507c.patch: updated with trunk >

[jira] Created: (HADOOP-3363) HDFS throws a InconsistentFSStateException when the name node starts up on a directory that isnt formatted

2008-05-07 Thread Steve Loughran (JIRA)
HDFS throws a InconsistentFSStateException when the name node starts up on a directory that isnt formatted -- Key: HADOOP-3363 URL: https://issues.apache.org/j

Re: [PROPOSAL] hadoop release process changes

2008-05-07 Thread Owen O'Malley
On May 5, 2008, at 3:42 PM, Nigel Daley wrote: I'd like to propose we move up the Feature Freeze 1 month to the first Friday in March, June, September and October to avoid these problems. +1

[jira] Commented: (HADOOP-3296) Some levels are skipped while creating the task cache in JobInProgress

2008-05-07 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12595040#action_12595040 ] Chris Douglas commented on HADOOP-3296: --- bq. The reason is that if there are more th

[jira] Commented: (HADOOP-3355) Configuration should accept decimal and hexadecimal values

2008-05-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12595037#action_12595037 ] Hadoop QA commented on HADOOP-3355: --- +1 overall. Here are the results of testing the la

Re: [PROPOSAL] hadoop release process changes

2008-05-07 Thread Sameer Paranjpye
+1 Nigel Daley wrote: All, I'd like to propose a change to our Feature Freeze schedule for Hadoop. Currently, we freeze on the first Friday of January, April, July, and October. This schedule causes us to run into holidays right before these freeze dates. For instance, due to new years hol

[jira] Updated: (HADOOP-3058) Hadoop DFS to report more replication metrics

2008-05-07 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated HADOOP-3058: - Resolution: Fixed Fix Version/s: 0.18.0 Hadoop Flags: [Reviewed] Status: R

[jira] Commented: (HADOOP-3058) Hadoop DFS to report more replication metrics

2008-05-07 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12595029#action_12595029 ] Raghu Angadi commented on HADOOP-3058: -- I just committed this. Thanks Lohit! > Hadoo

[jira] Updated: (HADOOP-3349) FSNamesystem.changeLease(src, dst) incorrectly updates the paths inside a lease

2008-05-07 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HADOOP-3349: --- Status: Patch Available (was: Open) > FSNamesystem.changeLease(src, dst) in

[jira] Commented: (HADOOP-3058) Hadoop DFS to report more replication metrics

2008-05-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12595014#action_12595014 ] Hadoop QA commented on HADOOP-3058: --- -1 overall. Here are the results of testing the la

[jira] Updated: (HADOOP-3362) Reduce Task wont complete goes till 16% and halts

2008-05-07 Thread Amit Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Kumar Singh updated HADOOP-3362: - Attachment: hadoop-hadoop-tasktracker-cse-desktop.log > Reduce Task wont complete goes t

[jira] Updated: (HADOOP-3362) Reduce Task wont complete goes till 16% and halts

2008-05-07 Thread Amit Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Kumar Singh updated HADOOP-3362: - Attachment: hadoop-hadoop-secondarynamenode-cse-desktop.log > Reduce Task wont complete

[jira] Updated: (HADOOP-3362) Reduce Task wont complete goes till 16% and halts

2008-05-07 Thread Amit Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Kumar Singh updated HADOOP-3362: - Attachment: hadoop-hadoop-namenode-cse-desktop.log > Reduce Task wont complete goes till

[jira] Updated: (HADOOP-3362) Reduce Task wont complete goes till 16% and halts

2008-05-07 Thread Amit Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Kumar Singh updated HADOOP-3362: - Attachment: hadoop-hadoop-jobtracker-cse-desktop.log > Reduce Task wont complete goes ti

[jira] Updated: (HADOOP-3362) Reduce Task wont complete goes till 16% and halts

2008-05-07 Thread Amit Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Kumar Singh updated HADOOP-3362: - Attachment: hadoop-hadoop-datanode-cse-desktop.log > Reduce Task wont complete goes till

[jira] Created: (HADOOP-3362) Reduce Task wont complete goes till 16% and halts

2008-05-07 Thread Amit Kumar Singh (JIRA)
Reduce Task wont complete goes till 16% and halts - Key: HADOOP-3362 URL: https://issues.apache.org/jira/browse/HADOOP-3362 Project: Hadoop Core Issue Type: Bug Affects Versions: 0.16.3

[jira] Updated: (HADOOP-3349) FSNamesystem.changeLease(src, dst) incorrectly updates the paths inside a lease

2008-05-07 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HADOOP-3349: --- Attachment: 3349_20080507b.patch 3349_20080507b.patch: changed a method name

[jira] Updated: (HADOOP-2065) Replication policy for corrupted block

2008-05-07 Thread lohit vijayarenu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lohit vijayarenu updated HADOOP-2065: - Attachment: HADOOP-2065-4.patch Thanks Konstantin, this new patch adds all the changes y

[jira] Updated: (HADOOP-3322) Hadoop rpc metrics do not get pushed to the MetricsRecord

2008-05-07 Thread girish vaitheeswaran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] girish vaitheeswaran updated HADOOP-3322: - Attachment: rpcmetrics.patch > Hadoop rpc metrics do not get pushed to the Metri

[jira] Updated: (HADOOP-3349) FSNamesystem.changeLease(src, dst) incorrectly updates the paths inside a lease

2008-05-07 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HADOOP-3349: --- Attachment: 3349_20080507.patch 3349_20080507.patch: - fixed changeLease -

[jira] Assigned: (HADOOP-3349) FSNamesystem.changeLease(src, dst) incorrectly updates the paths inside a lease

2008-05-07 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE reassigned HADOOP-3349: -- Assignee: Tsz Wo (Nicholas), SZE > FSNamesystem.changeLease(src, dst)

[jira] Updated: (HADOOP-3348) TestUrlStreamHandler hangs on LINUX

2008-05-07 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated HADOOP-3348: - Attachment: 3348-2nd-option.patch patch for 2nd option. I am not very sure if it is the right fi

[jira] Assigned: (HADOOP-2759) creating a file in hdfs should not automatically create the parent directories

2008-05-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley reassigned HADOOP-2759: - Assignee: Pi Song > creating a file in hdfs should not automatically create the parent d

[jira] Assigned: (HADOOP-3322) Hadoop rpc metrics do not get pushed to the MetricsRecord

2008-05-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley reassigned HADOOP-3322: - Assignee: girish vaitheeswaran > Hadoop rpc metrics do not get pushed to the MetricsReco

[jira] Assigned: (HADOOP-3341) make key-value separators in hadoop streaming fully configurable

2008-05-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley reassigned HADOOP-3341: - Assignee: Zheng Shao > make key-value separators in hadoop streaming fully configurable

[jira] Assigned: (HADOOP-3350) distcp should permit users to limit the number of maps

2008-05-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley reassigned HADOOP-3350: - Assignee: Chris Douglas > distcp should permit users to limit the number of maps > -

[jira] Commented: (HADOOP-3259) Configuration.substituteVars() needs to handle security exceptions

2008-05-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594986#action_12594986 ] Hadoop QA commented on HADOOP-3259: --- -1 overall. Here are the results of testing the la

[jira] Assigned: (HADOOP-1380) We should have a util.Subprocess class with utilities for starting subprocesses

2008-05-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley reassigned HADOOP-1380: - Assignee: Brice Arnould (was: Owen O'Malley) > We should have a util.Subprocess class w

[jira] Commented: (HADOOP-3348) TestUrlStreamHandler hangs on LINUX

2008-05-07 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594973#action_12594973 ] Raghu Angadi commented on HADOOP-3348: -- Two options : 1. FSInputChecker.read() should

[jira] Commented: (HADOOP-3355) Configuration should accept decimal and hexadecimal values

2008-05-07 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594972#action_12594972 ] Tsz Wo (Nicholas), SZE commented on HADOOP-3355: Could we specify negative

[jira] Commented: (HADOOP-2656) Support for upgrading existing cluster to facilitate appends to HDFS files

2008-05-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594964#action_12594964 ] Hadoop QA commented on HADOOP-2656: --- -1 overall. Here are the results of testing the la

[jira] Updated: (HADOOP-3297) The way in which ReduceTask/TaskTracker gets completion events during shuffle can be improved

2008-05-07 Thread Mahadev konar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar updated HADOOP-3297: -- Hadoop Flags: [Reviewed] > The way in which ReduceTask/TaskTracker gets completion events duri

[jira] Commented: (HADOOP-3297) The way in which ReduceTask/TaskTracker gets completion events during shuffle can be improved

2008-05-07 Thread Mahadev konar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594962#action_12594962 ] Mahadev konar commented on HADOOP-3297: --- thats great... +1 for commit. > The way

[jira] Updated: (HADOOP-1915) adding counters methods using String (as opposed to Enum)

2008-05-07 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1915: -- Status: Patch Available (was: Open) > adding counters methods using String (as opposed to Enum) > ---

[jira] Updated: (HADOOP-1915) adding counters methods using String (as opposed to Enum)

2008-05-07 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1915: -- Attachment: hadoop-1915-v10.patch Patch with unit test for user defined counters. > adding counters m

[jira] Commented: (HADOOP-1700) Append to files in HDFS

2008-05-07 Thread Sameer Paranjpye (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594949#action_12594949 ] Sameer Paranjpye commented on HADOOP-1700: -- Dhruba, need some guidance here. Do y

[jira] Commented: (HADOOP-3360) DataNode should be marked as final to prevent subclassing

2008-05-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594947#action_12594947 ] Steve Loughran commented on HADOOP-3360: Having done a bit more coding, its worth

[jira] Assigned: (HADOOP-930) Add support for reading regular (non-block-based) files from S3 in S3FileSystem

2008-05-07 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White reassigned HADOOP-930: Assignee: Tom White > Add support for reading regular (non-block-based) files from S3 in > S3FileS

[jira] Updated: (HADOOP-930) Add support for reading regular (non-block-based) files from S3 in S3FileSystem

2008-05-07 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-930: - Attachment: hadoop-930-v2.patch Second patch with the following changes: * Send Content-MD5 header to per

[jira] Updated: (HADOOP-930) Add support for reading regular (non-block-based) files from S3 in S3FileSystem

2008-05-07 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-930: - Fix Version/s: 0.18.0 Status: Patch Available (was: Open) > Add support for reading regular (

[jira] Commented: (HADOOP-3360) DataNode should be marked as final to prevent subclassing

2008-05-07 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594929#action_12594929 ] Raghu Angadi commented on HADOOP-3360: -- > Consider splitting the constructor from the

[jira] Commented: (HADOOP-3361) Implement renames for NativeS3FileSystem

2008-05-07 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594923#action_12594923 ] Tom White commented on HADOOP-3361: --- The Jets3t library (http://jets3t.s3.amazonaws.com/

[jira] Created: (HADOOP-3361) Implement renames for NativeS3FileSystem

2008-05-07 Thread Tom White (JIRA)
Implement renames for NativeS3FileSystem Key: HADOOP-3361 URL: https://issues.apache.org/jira/browse/HADOOP-3361 Project: Hadoop Core Issue Type: New Feature Components: fs/s3 Re

[jira] Created: (HADOOP-3360) DataNode should be marked as final to prevent subclassing

2008-05-07 Thread Steve Loughran (JIRA)
DataNode should be marked as final to prevent subclassing - Key: HADOOP-3360 URL: https://issues.apache.org/jira/browse/HADOOP-3360 Project: Hadoop Core Issue Type: Bug Compon

[jira] Updated: (HADOOP-2019) DistributedFileCache should support .tgz files in addition to jars and zip files

2008-05-07 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HADOOP-2019: Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available)

[jira] Updated: (HADOOP-2019) DistributedFileCache should support .tgz files in addition to jars and zip files

2008-05-07 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated HADOOP-2019: Release Note: Adds support for .tar, .tgz and .tar.gz files in Distributed

[jira] Commented: (HADOOP-2181) Input Split details for maps should be logged

2008-05-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594887#action_12594887 ] Hudson commented on HADOOP-2181: Integrated in Hadoop-trunk #483 (See [http://hudson.zone

[jira] Commented: (HADOOP-3119) Text.getBytes()

2008-05-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594885#action_12594885 ] Hudson commented on HADOOP-3119: Integrated in Hadoop-trunk #483 (See [http://hudson.zone

[jira] Commented: (HADOOP-2188) RPC should send a ping rather than use client timeouts

2008-05-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594886#action_12594886 ] Hudson commented on HADOOP-2188: Integrated in Hadoop-trunk #483 (See [http://hudson.zone

[jira] Commented: (HADOOP-2930) make {start,stop}-balancer.sh work even if hadoop-daemon.sh isn't in the PATH

2008-05-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594878#action_12594878 ] Hudson commented on HADOOP-2930: Integrated in Hadoop-trunk #483 (See [http://hudson.zone

[jira] Commented: (HADOOP-2294) In hdfs.h , the comment says you release the result of a hdfsListDirectory with a freehdfsFileInfo, but should say hdfsFreeFileInfo

2008-05-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594883#action_12594883 ] Hudson commented on HADOOP-2294: Integrated in Hadoop-trunk #483 (See [http://hudson.zone

[jira] Commented: (HADOOP-3085) pushMetric() method of various metric util classes should catch exceptions

2008-05-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594880#action_12594880 ] Hudson commented on HADOOP-3085: Integrated in Hadoop-trunk #483 (See [http://hudson.zone

[jira] Commented: (HADOOP-3283) Need a mechanism for data nodes to update generation stamps.

2008-05-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594884#action_12594884 ] Hudson commented on HADOOP-3283: Integrated in Hadoop-trunk #483 (See [http://hudson.zone

[jira] Commented: (HADOOP-3101) 'bin/hadoop job' should display the help and silently exit

2008-05-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594882#action_12594882 ] Hudson commented on HADOOP-3101: Integrated in Hadoop-trunk #483 (See [http://hudson.zone

[jira] Commented: (HADOOP-3345) Enhance the hudson-test-patch target

2008-05-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594881#action_12594881 ] Hudson commented on HADOOP-3345: Integrated in Hadoop-trunk #483 (See [http://hudson.zone

[jira] Commented: (HADOOP-3144) better fault tolerance for corrupted text files

2008-05-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594879#action_12594879 ] Hudson commented on HADOOP-3144: Integrated in Hadoop-trunk #483 (See [http://hudson.zone

[jira] Commented: (HADOOP-3337) Name-node fails to start because DatanodeInfo format changed.

2008-05-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594877#action_12594877 ] Hudson commented on HADOOP-3337: Integrated in Hadoop-trunk #483 (See [http://hudson.zone

Hudson build is back to normal: Hadoop-trunk #483

2008-05-07 Thread Apache Hudson Server
See http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/483/changes

[jira] Commented: (HADOOP-3317) add default port for hdfs namenode

2008-05-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594876#action_12594876 ] Hudson commented on HADOOP-3317: Integrated in Hadoop-trunk #483 (See [http://hudson.zone

[jira] Commented: (HADOOP-3031) Remove compiler warnings for ant test

2008-05-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594874#action_12594874 ] Hudson commented on HADOOP-3031: Integrated in Hadoop-trunk #483 (See [http://hudson.zone

[jira] Commented: (HADOOP-3248) Improve Namenode startup performance

2008-05-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594873#action_12594873 ] Hudson commented on HADOOP-3248: Integrated in Hadoop-trunk #483 (See [http://hudson.zone

[jira] Commented: (HADOOP-3335) 'make clean' in src/c++/libhdfs does 'rm -rf /*'

2008-05-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594875#action_12594875 ] Hudson commented on HADOOP-3335: Integrated in Hadoop-trunk #483 (See [http://hudson.zone

[jira] Commented: (HADOOP-3334) Move lease handling codes out from FSNamesystem

2008-05-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594872#action_12594872 ] Hudson commented on HADOOP-3334: Integrated in Hadoop-trunk #483 (See [http://hudson.zone

[jira] Commented: (HADOOP-3297) The way in which ReduceTask/TaskTracker gets completion events during shuffle can be improved

2008-05-07 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594868#action_12594868 ] Devaraj Das commented on HADOOP-3297: - Yes, I ran large jobs with 25 maps and 400

[jira] Issue Comment Edited: (HADOOP-3356) SequenceFile.MergeQueue.merge inadvertently creates merge-outputs in the wrong FileSystem, at times in the InMemoryFileSystem

2008-05-07 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594858#action_12594858 ] devaraj edited comment on HADOOP-3356 at 5/7/08 4:39 AM: - This

[jira] Created: (HADOOP-3359) Inadequate synchronization of namenode shutdown

2008-05-07 Thread Steve Loughran (JIRA)
Inadequate synchronization of namenode shutdown --- Key: HADOOP-3359 URL: https://issues.apache.org/jira/browse/HADOOP-3359 Project: Hadoop Core Issue Type: Bug Components: dfs Affect

[jira] Updated: (HADOOP-3356) SequenceFile.MergeQueue.merge inadvertently creates merge-outputs in the wrong FileSystem, at times in the InMemoryFileSystem

2008-05-07 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HADOOP-3356: Priority: Minor (was: Critical) This part of the code must never be hit under normal circumstance

[jira] Created: (HADOOP-3358) The FileSystem operations in JobInProgress.garbageCollect should be moved out of the synchronized block

2008-05-07 Thread Devaraj Das (JIRA)
The FileSystem operations in JobInProgress.garbageCollect should be moved out of the synchronized block --- Key: HADOOP-3358 URL: https://issues.apache.org/jira/br

[jira] Created: (HADOOP-3357) delete on dfs hung

2008-05-07 Thread Devaraj Das (JIRA)
delete on dfs hung -- Key: HADOOP-3357 URL: https://issues.apache.org/jira/browse/HADOOP-3357 Project: Hadoop Core Issue Type: Bug Components: dfs Affects Versions: 0.18.0 Reporter: Devaraj Das I h

[jira] Commented: (HADOOP-3149) supporting multiple outputs for M/R jobs

2008-05-07 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594854#action_12594854 ] Alejandro Abdelnur commented on HADOOP-3149: How about the following API chang

[jira] Commented: (HADOOP-3149) supporting multiple outputs for M/R jobs

2008-05-07 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594853#action_12594853 ] Alejandro Abdelnur commented on HADOOP-3149: Regarding Owen's _You should also

[jira] Issue Comment Edited: (HADOOP-3149) supporting multiple outputs for M/R jobs

2008-05-07 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594853#action_12594853 ] tucu00 edited comment on HADOOP-3149 at 5/7/08 4:01 AM:

[jira] Updated: (HADOOP-3355) Configuration should accept decimal and hexadecimal values

2008-05-07 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated HADOOP-3355: Attachment: patch-3355.txt Here is patch adding support for Hexadecimal va

[jira] Updated: (HADOOP-3355) Configuration should accept decimal and hexadecimal values

2008-05-07 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated HADOOP-3355: Status: Patch Available (was: Open) > Configuration should accept decimal

[jira] Updated: (HADOOP-3058) Hadoop DFS to report more replication metrics

2008-05-07 Thread lohit vijayarenu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lohit vijayarenu updated HADOOP-3058: - Status: Patch Available (was: Open) > Hadoop DFS to report more replication metrics > -

  1   2   >