[jira] Updated: (HADOOP-3329) DatanodeDescriptor objects stored in FSImage may be out dated.

2008-05-05 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-3329: - Attachment: lastBlockLocations.patch This patch removes the last block locations that we

[jira] Updated: (HADOOP-3329) DatanodeDescriptor objects stored in FSImage may be out dated.

2008-05-05 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-3329: - Fix Version/s: 0.18.0 Status: Patch Available (was: Open) > DatanodeDescript

[jira] Assigned: (HADOOP-3329) DatanodeDescriptor objects stored in FSImage may be out dated.

2008-05-05 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur reassigned HADOOP-3329: Assignee: dhruba borthakur > DatanodeDescriptor objects stored in FSImage may be o

[jira] Commented: (HADOOP-3144) better fault tolerance for corrupted text files

2008-05-05 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594490#action_12594490 ] Zheng Shao commented on HADOOP-3144: The code is tested with a corrupted file of 1GB (

[jira] Updated: (HADOOP-3144) better fault tolerance for corrupted text files

2008-05-05 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HADOOP-3144: --- Status: Patch Available (was: In Progress) > better fault tolerance for corrupted text files >

[jira] Updated: (HADOOP-3144) better fault tolerance for corrupted text files

2008-05-05 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HADOOP-3144: --- Status: In Progress (was: Patch Available) > better fault tolerance for corrupted text files >

[jira] Updated: (HADOOP-3144) better fault tolerance for corrupted text files

2008-05-05 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HADOOP-3144: --- Attachment: 3144-7.patch changed bytesConsumed back to long. > better fault tolerance for corrupte

[jira] Commented: (HADOOP-3350) distcp should permit users to limit the number of maps

2008-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594486#action_12594486 ] Hadoop QA commented on HADOOP-3350: --- -1 overall. Here are the results of testing the la

[jira] Updated: (HADOOP-2019) DistributedFileCache should support .tgz files in addition to jars and zip files

2008-05-05 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated HADOOP-2019: Status: Patch Available (was: Open) > DistributedFileCache should support

[jira] Updated: (HADOOP-2019) DistributedFileCache should support .tgz files in addition to jars and zip files

2008-05-05 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated HADOOP-2019: Status: Open (was: Patch Available) > DistributedFileCache should support

[jira] Updated: (HADOOP-2019) DistributedFileCache should support .tgz files in addition to jars and zip files

2008-05-05 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated HADOOP-2019: Attachment: patch-2019.txt Added documentation > DistributedFileCache sho

[jira] Commented: (HADOOP-3329) DatanodeDescriptor objects stored in FSImage may be out dated.

2008-05-05 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594481#action_12594481 ] dhruba borthakur commented on HADOOP-3329: -- I think it is worthwhile to *not* sto

[jira] Updated: (HADOOP-2656) Support for upgrading existing cluster to facilitate appends to HDFS files

2008-05-05 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-2656: - Status: Patch Available (was: Open) > Support for upgrading existing cluster to facilit

[jira] Updated: (HADOOP-2656) Support for upgrading existing cluster to facilitate appends to HDFS files

2008-05-05 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-2656: - Attachment: upgradeGenStamp11.patch Merged patch with latest trunk. > Support for upgra

[jira] Updated: (HADOOP-2656) Support for upgrading existing cluster to facilitate appends to HDFS files

2008-05-05 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-2656: - Status: Open (was: Patch Available) > Support for upgrading existing cluster to facilit

[jira] Commented: (HADOOP-3297) The way in which ReduceTask/TaskTracker gets completion events during shuffle can be improved

2008-05-05 Thread Mahadev konar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594472#action_12594472 ] Mahadev konar commented on HADOOP-3297: --- agreed. > The way in which ReduceTask/Tas

[jira] Commented: (HADOOP-2656) Support for upgrading existing cluster to facilitate appends to HDFS files

2008-05-05 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594471#action_12594471 ] dhruba borthakur commented on HADOOP-2656: -- I would like to commit this patch ear

[jira] Updated: (HADOOP-3248) Improve Namenode startup performance

2008-05-05 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-3248: - Status: Patch Available (was: Open) > Improve Namenode startup performance > --

[jira] Commented: (HADOOP-3297) The way in which ReduceTask/TaskTracker gets completion events during shuffle can be improved

2008-05-05 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594470#action_12594470 ] Devaraj Das commented on HADOOP-3297: - No it doesn't. That should be outside the scope

[jira] Commented: (HADOOP-3341) make key-value separators in hadoop streaming fully configurable

2008-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594469#action_12594469 ] Hadoop QA commented on HADOOP-3341: --- -1 overall. Here are the results of testing the la

[jira] Commented: (HADOOP-3297) The way in which ReduceTask/TaskTracker gets completion events during shuffle can be improved

2008-05-05 Thread Mahadev konar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594467#action_12594467 ] Mahadev konar commented on HADOOP-3297: --- this patch does not include waiting on the

[jira] Assigned: (HADOOP-3221) Need a "LineBasedTextInputFormat"

2008-05-05 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu reassigned HADOOP-3221: --- Assignee: Amareshwari Sriramadasu > Need a "LineBasedTextInputFormat

[jira] Updated: (HADOOP-3248) Improve Namenode startup performance

2008-05-05 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-3248: - Attachment: fastRestarts3.patch Changed size of transient buffer from 512K to be 32K as

[jira] Updated: (HADOOP-3248) Improve Namenode startup performance

2008-05-05 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-3248: - Status: Open (was: Patch Available) > Improve Namenode startup performance > --

[jira] Commented: (HADOOP-3022) Fast Cluster Restart

2008-05-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594466#action_12594466 ] Konstantin Shvachko commented on HADOOP-3022: - Yes, replication = 3. Block rep

[jira] Commented: (HADOOP-3221) Need a "LineBasedTextInputFormat"

2008-05-05 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594465#action_12594465 ] Amareshwari Sriramadasu commented on HADOOP-3221: - Here is design for the

[jira] Updated: (HADOOP-3297) The way in which ReduceTask/TaskTracker gets completion events during shuffle can be improved

2008-05-05 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HADOOP-3297: Status: Patch Available (was: Open) > The way in which ReduceTask/TaskTracker gets completion eve

[jira] Commented: (HADOOP-2019) DistributedFileCache should support .tgz files in addition to jars and zip files

2008-05-05 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594461#action_12594461 ] Amareshwari Sriramadasu commented on HADOOP-2019: - bq. we could use existi

[jira] Commented: (HADOOP-3333) job failing because of reassigning same tasktracker to failing tasks

2008-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594457#action_12594457 ] Hadoop QA commented on HADOOP-: --- +1 overall. Here are the results of testing the la

[jira] Updated: (HADOOP-3350) distcp should permit users to limit the number of maps

2008-05-05 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-3350: -- Status: Patch Available (was: Open) > distcp should permit users to limit the number of maps

[jira] Updated: (HADOOP-3350) distcp should permit users to limit the number of maps

2008-05-05 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-3350: -- Attachment: 3350-0.patch This retains the existing behavior by default, but observes a "distc

[jira] Created: (HADOOP-3350) distcp should permit users to limit the number of maps

2008-05-05 Thread Chris Douglas (JIRA)
distcp should permit users to limit the number of maps -- Key: HADOOP-3350 URL: https://issues.apache.org/jira/browse/HADOOP-3350 Project: Hadoop Core Issue Type: Improvement Re

[jira] Commented: (HADOOP-3144) better fault tolerance for corrupted text files

2008-05-05 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594445#action_12594445 ] Chris Douglas commented on HADOOP-3144: --- I didn't see that bytesConsumed in readLine

[jira] Commented: (HADOOP-3144) better fault tolerance for corrupted text files

2008-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594446#action_12594446 ] Hadoop QA commented on HADOOP-3144: --- +1 overall. Here are the results of testing the la

[jira] Updated: (HADOOP-3341) make key-value separators in hadoop streaming fully configurable

2008-05-05 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HADOOP-3341: --- Status: Patch Available (was: Open) > make key-value separators in hadoop streaming fully configura

[jira] Updated: (HADOOP-3341) make key-value separators in hadoop streaming fully configurable

2008-05-05 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HADOOP-3341: --- Attachment: 3341-1.patch > make key-value separators in hadoop streaming fully configurable > --

[jira] Updated: (HADOOP-3349) FSNamesystem.changeLease(src, dst) incorrectly updates the paths inside a lease

2008-05-05 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HADOOP-3349: --- Attachment: testDFSRename.patch testDFSRename.patch: a test that current tru

[jira] Updated: (HADOOP-3349) FSNamesystem.changeLease(src, dst) incorrectly updates the paths inside a lease

2008-05-05 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HADOOP-3349: --- Component/s: dfs > FSNamesystem.changeLease(src, dst) incorrectly updates th

[jira] Created: (HADOOP-3349) FSNamesystem.changeLease(src, dst) incorrectly updates the paths inside a lease

2008-05-05 Thread Tsz Wo (Nicholas), SZE (JIRA)
FSNamesystem.changeLease(src, dst) incorrectly updates the paths inside a lease --- Key: HADOOP-3349 URL: https://issues.apache.org/jira/browse/HADOOP-3349 Project: Hadoop Cor

[jira] Commented: (HADOOP-3248) Improve Namenode startup performance

2008-05-05 Thread girish vaitheeswaran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594440#action_12594440 ] girish vaitheeswaran commented on HADOOP-3248: -- >> You mentioned there were 2

[jira] Updated: (HADOOP-3333) job failing because of reassigning same tasktracker to failing tasks

2008-05-05 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-: -- Attachment: (was: HADOOP-_1_20080505.patch) > job failing because of reassigning same

[jira] Updated: (HADOOP-3333) job failing because of reassigning same tasktracker to failing tasks

2008-05-05 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-: -- Attachment: HADOOP-_1_20080505.patch Update patch. I've had to fix MiniMRCluster to speci

[jira] Updated: (HADOOP-3333) job failing because of reassigning same tasktracker to failing tasks

2008-05-05 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-: -- Status: Patch Available (was: Open) > job failing because of reassigning same tasktracker to

[jira] Updated: (HADOOP-3144) better fault tolerance for corrupted text files

2008-05-05 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HADOOP-3144: --- Status: Patch Available (was: In Progress) > better fault tolerance for corrupted text files >

[jira] Updated: (HADOOP-3144) better fault tolerance for corrupted text files

2008-05-05 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HADOOP-3144: --- Attachment: 3144-6.patch > better fault tolerance for corrupted text files > ---

[jira] Commented: (HADOOP-153) skip records that throw exceptions

2008-05-05 Thread Dick King (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594432#action_12594432 ] Dick King commented on HADOOP-153: -- There is a problem with respect to pipes, in that mult

[jira] Updated: (HADOOP-3144) better fault tolerance for corrupted text files

2008-05-05 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HADOOP-3144: --- Status: In Progress (was: Patch Available) > better fault tolerance for corrupted text files >

[jira] Commented: (HADOOP-3144) better fault tolerance for corrupted text files

2008-05-05 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594430#action_12594430 ] Zheng Shao commented on HADOOP-3144: You are right. I was looking at line 221 and fix

[jira] Updated: (HADOOP-4) tool to mount dfs on linux

2008-05-05 Thread Pete Wyckoff (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pete Wyckoff updated HADOOP-4: -- Attachment: HADOOP-4.patch my bad - added if for the package target. > tool to mount dfs on linux > ---

[jira] Updated: (HADOOP-3322) Hadoop rpc metrics do not get pushed to the MetricsRecord

2008-05-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated HADOOP-3322: -- Attachment: HADOOP-3322-3.txt Update patch path from the top level. > Hadoop rpc metrics do not get p

[jira] Updated: (HADOOP-3348) TestUrlStreamHandler hangs on LINUX

2008-05-05 Thread lohit vijayarenu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lohit vijayarenu updated HADOOP-3348: - Attachment: Datanode_jstack.txt > TestUrlStreamHandler hangs on LINUX >

[jira] Updated: (HADOOP-3348) TestUrlStreamHandler hangs on LINUX

2008-05-05 Thread lohit vijayarenu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lohit vijayarenu updated HADOOP-3348: - Description: TestUrlStreamHandler sets setURLStreamHandlerFactory as {noformat} FsUrlStr

[jira] Created: (HADOOP-3348) TestUrlStreamHandler hangs on LINUX

2008-05-05 Thread lohit vijayarenu (JIRA)
TestUrlStreamHandler hangs on LINUX --- Key: HADOOP-3348 URL: https://issues.apache.org/jira/browse/HADOOP-3348 Project: Hadoop Core Issue Type: Bug Components: fs Affects Versions: 0.18.0

[jira] Commented: (HADOOP-3144) better fault tolerance for corrupted text files

2008-05-05 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594414#action_12594414 ] Chris Douglas commented on HADOOP-3144: --- The actual calculated for maxBytesToConsume

[jira] Commented: (HADOOP-4) tool to mount dfs on linux

2008-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594413#action_12594413 ] Hadoop QA commented on HADOOP-4: -1 overall. Here are the results of testing the latest atta

[jira] Commented: (HADOOP-3317) add default port for hdfs namenode

2008-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594411#action_12594411 ] Hadoop QA commented on HADOOP-3317: --- +1 overall. Here are the results of testing the la

[jira] Issue Comment Edited: (HADOOP-3248) Improve Namenode startup performance

2008-05-05 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594410#action_12594410 ] szetszwo edited comment on HADOOP-3248 at 5/5/08 5:11 PM: --

[jira] Commented: (HADOOP-3248) Improve Namenode startup performance

2008-05-05 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594410#action_12594410 ] Tsz Wo (Nicholas), SZE commented on HADOOP-3248: Dhruba, you are right. P

[jira] Commented: (HADOOP-3248) Improve Namenode startup performance

2008-05-05 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594407#action_12594407 ] dhruba borthakur commented on HADOOP-3248: -- Hi Nicholas, I would hate to put in a

[jira] Updated: (HADOOP-3085) pushMetric() method of various metric util classes should catch exceptions

2008-05-05 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-3085: -- Resolution: Fixed Assignee: Chris Douglas Hadoop Flags: [Reviewed] Stat

[jira] Updated: (HADOOP-3347) FSEditLog should not writes long and short as UTF8 and should not use ArrayWritable for writing non-array items

2008-05-05 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HADOOP-3347: --- Description: In FSEditLog, - long and short are first converted to String

[jira] Resolved: (HADOOP-2930) make {start,stop}-balancer.sh work even if hadoop-daemon.sh isn't in the PATH

2008-05-05 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang resolved HADOOP-2930. --- Resolution: Fixed Fix Version/s: 0.18.0 Hadoop Flags: [Reviewed] I just committe

[jira] Commented: (HADOOP-3342) Better safety of killing jobs via web interface

2008-05-05 Thread Enis Soztutar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594401#action_12594401 ] Enis Soztutar commented on HADOOP-3342: --- As far as I remember killing job is already

[jira] Commented: (HADOOP-3347) FSEditLog should not writes long and short as UTF8 and should not use ArrayWritable for writing non-array items

2008-05-05 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594400#action_12594400 ] Tsz Wo (Nicholas), SZE commented on HADOOP-3347: {code} static UTF8 toLo

[jira] Issue Comment Edited: (HADOOP-2930) make {start,stop}-balancer.sh work even if hadoop-daemon.sh isn't in the PATH

2008-05-05 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594396#action_12594396 ] hairong edited comment on HADOOP-2930 at 5/5/08 4:36 PM: --- +1

[jira] Updated: (HADOOP-4) tool to mount dfs on linux

2008-05-05 Thread Pete Wyckoff (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pete Wyckoff updated HADOOP-4: -- Status: Patch Available (was: In Progress) HADOOP-4.patch > tool to mount dfs on linux > -

[jira] Created: (HADOOP-3347) FSEditLog should not writes long and short as UTF8 and should not use ArrayWritable for writing non-array items

2008-05-05 Thread Tsz Wo (Nicholas), SZE (JIRA)
FSEditLog should not writes long and short as UTF8 and should not use ArrayWritable for writing non-array items --- Key: HADOOP-3347 URL: https://issues.ap

[jira] Updated: (HADOOP-4) tool to mount dfs on linux

2008-05-05 Thread Pete Wyckoff (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pete Wyckoff updated HADOOP-4: -- Attachment: HADOOP-4.patch > tool to mount dfs on linux > -- > >

[jira] Updated: (HADOOP-4) tool to mount dfs on linux

2008-05-05 Thread Pete Wyckoff (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pete Wyckoff updated HADOOP-4: -- Status: In Progress (was: Patch Available) > tool to mount dfs on linux > -- > >

[jira] Updated: (HADOOP-4) tool to mount dfs on linux

2008-05-05 Thread Pete Wyckoff (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pete Wyckoff updated HADOOP-4: -- Attachment: HADOOP-4.patch i added the package target and also made fuse dfs build dependent on both com

[jira] Assigned: (HADOOP-4) tool to mount dfs on linux

2008-05-05 Thread Pete Wyckoff (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pete Wyckoff reassigned HADOOP-4: - Assignee: Pete Wyckoff > tool to mount dfs on linux > -- > >

[jira] Updated: (HADOOP-2930) make {start,stop}-balancer.sh work even if hadoop-daemon.sh isn't in the PATH

2008-05-05 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HADOOP-2930: -- Attachment: balancer-path1.patch This patch also allows the {start/stop}-balancer.sh script to

[jira] Updated: (HADOOP-3333) job failing because of reassigning same tasktracker to failing tasks

2008-05-05 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-: -- Comment: was deleted > job failing because of reassigning same tasktracker to failing tasks >

[jira] Commented: (HADOOP-3022) Fast Cluster Restart

2008-05-05 Thread Cagdas Gerede (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594390#action_12594390 ] Cagdas Gerede commented on HADOOP-3022: --- What is the replica count in this benchmark

[jira] Commented: (HADOOP-3333) job failing because of reassigning same tasktracker to failing tasks

2008-05-05 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594387#action_12594387 ] Arun C Murthy commented on HADOOP-: --- bq. BTW, just for the record, the tasktrack

[jira] Commented: (HADOOP-3144) better fault tolerance for corrupted text files

2008-05-05 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594380#action_12594380 ] Zheng Shao commented on HADOOP-3144: Chris, got time to take a look again? > better

[jira] Commented: (HADOOP-3333) job failing because of reassigning same tasktracker to failing tasks

2008-05-05 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594381#action_12594381 ] Arun C Murthy commented on HADOOP-: --- bq. I think the ant tests depend on the fac

[jira] Commented: (HADOOP-3333) job failing because of reassigning same tasktracker to failing tasks

2008-05-05 Thread Christian Kunz (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594379#action_12594379 ] Christian Kunz commented on HADOOP-: This is a good enough work-around, i.e. i

[jira] Commented: (HADOOP-3144) better fault tolerance for corrupted text files

2008-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594377#action_12594377 ] Hadoop QA commented on HADOOP-3144: --- +1 overall. Here are the results of testing the la

[jira] Commented: (HADOOP-3333) job failing because of reassigning same tasktracker to failing tasks

2008-05-05 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594374#action_12594374 ] Arun C Murthy commented on HADOOP-: --- Christian, one way to mitigate this problem

[jira] Commented: (HADOOP-3248) Improve Namenode startup performance

2008-05-05 Thread Cagdas Gerede (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594376#action_12594376 ] Cagdas Gerede commented on HADOOP-3248: --- You mentioned there were 20 million files.

[VOTE] Release Hadoop 0.16.4 (candidate 0)

2008-05-05 Thread Nigel Daley
I've created a candidate build for Hadoop 0.16.4. This fixes 4 issues in 0.16.3. Please download and try it out. http://people.apache.org/~nigel/hadoop-0.16.4-candidate-0/ Should we release this? Vote closes on Thursday, May 8. Nigel

[PROPOSAL] hadoop release process changes

2008-05-05 Thread Nigel Daley
All, I'd like to propose a change to our Feature Freeze schedule for Hadoop. Currently, we freeze on the first Friday of January, April, July, and October. This schedule causes us to run into holidays right before these freeze dates. For instance, due to new years holidays, the January f

[jira] Updated: (HADOOP-3333) job failing because of reassigning same tasktracker to failing tasks

2008-05-05 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-: -- Attachment: HADOOP-_1_20080505.patch Updated patch, I had to fix JobTracker.ExpireTrackers

[jira] Commented: (HADOOP-3155) reducers stuck at shuffling

2008-05-05 Thread Christian Kunz (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594366#action_12594366 ] Christian Kunz commented on HADOOP-3155: We have been running into the same issue

[jira] Updated: (HADOOP-3310) Lease recovery for append

2008-05-05 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HADOOP-3310: --- Assignee: Tsz Wo (Nicholas), SZE The lease recovery algorithm is: * 1) Name

[jira] Commented: (HADOOP-3248) Improve Namenode startup performance

2008-05-05 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594362#action_12594362 ] Tsz Wo (Nicholas), SZE commented on HADOOP-3248: How about move the method

[jira] Commented: (HADOOP-3248) Improve Namenode startup performance

2008-05-05 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594355#action_12594355 ] dhruba borthakur commented on HADOOP-3248: -- Konstantin: Ok, i will change the siz

[jira] Resolved: (HADOOP-1410) target "clean" in Makefile is very dangerous

2008-05-05 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved HADOOP-1410. --- Resolution: Duplicate Fix Version/s: 0.18.0 Assignee: (was: Arun C Murthy

[jira] Updated: (HADOOP-3335) 'make clean' in src/c++/libhdfs does 'rm -rf /*'

2008-05-05 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-3335: -- Resolution: Fixed Fix Version/s: 0.18.0 Hadoop Flags: [Reviewed] Status:

[jira] Updated: (HADOOP-3317) add default port for hdfs namenode

2008-05-05 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-3317: - Attachment: HADOOP-3317.patch > add default port for hdfs namenode > ---

[jira] Updated: (HADOOP-3317) add default port for hdfs namenode

2008-05-05 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-3317: - Status: Patch Available (was: Open) > add default port for hdfs namenode >

[jira] Updated: (HADOOP-3317) add default port for hdfs namenode

2008-05-05 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-3317: - Status: Open (was: Patch Available) Doh! Forgot to make the constant final... > add default p

[jira] Updated: (HADOOP-2188) RPC should send a ping rather than use client timeouts

2008-05-05 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HADOOP-2188: -- Resolution: Fixed Hadoop Flags: [Incompatible change, Reviewed] (was: [Reviewed, Incomp

[jira] Updated: (HADOOP-3144) better fault tolerance for corrupted text files

2008-05-05 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HADOOP-3144: --- Status: In Progress (was: Patch Available) > better fault tolerance for corrupted text files >

[jira] Updated: (HADOOP-3144) better fault tolerance for corrupted text files

2008-05-05 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HADOOP-3144: --- Release Note: (was: Added a new configuration variable: mapred.linerecordreader.maxlength (default

[jira] Updated: (HADOOP-3144) better fault tolerance for corrupted text files

2008-05-05 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HADOOP-3144: --- Attachment: 3144-5.patch Fixed the 2 problems in Chris's comments: 1. Restored Long.MAX_VALUE; 2. T

Re: Hadoop and VMware

2008-05-05 Thread Christophe Taton
You should have a look at bin/rcc and bin/hadoop scripts. They contain a '-Xmx1000m' default JVM parameter. Also you need to tweak hadoop-site.xml to set an appropriate -Xmx option too for the task JVMs. Cheers, Christophe On Mon, May 5, 2008 at 11:03 PM, Ahmad Humayun <[EMAIL PROTECTED]> wrote:

[jira] Commented: (HADOOP-3085) pushMetric() method of various metric util classes should catch exceptions

2008-05-05 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594339#action_12594339 ] Runping Qi commented on HADOOP-3085: +1 The patch looks good. > pushMetric() meth

Re: Hadoop and VMware

2008-05-05 Thread Ahmad Humayun
Thanks Christophe :) Hadoop is running fine now :) does anyone know how to reduce this heap requirementis such a large heap size being imposed by Hadoop itself? Do I need to set the jvm by using -Xms settingsanyone knows how to do that? Thanks again to everyone helping out on the mailing

  1   2   >