[jira] Commented: (HADOOP-153) skip records that throw exceptions

2008-06-24 Thread Sharad Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607874#action_12607874 ] Sharad Agarwal commented on HADOOP-153: --- Instead of keeping bad records ids in JobTra

[jira] Commented: (HADOOP-3552) forrest doc for hadoop commands

2008-06-24 Thread Mahadev konar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607873#action_12607873 ] Mahadev konar commented on HADOOP-3552: --- 1) the job option has nothing to do with th

[jira] Updated: (HADOOP-3149) supporting multiple outputs for M/R jobs

2008-06-24 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated HADOOP-3149: --- Status: Patch Available (was: Open) > supporting multiple outputs for M/R jobs > --

[jira] Updated: (HADOOP-3149) supporting multiple outputs for M/R jobs

2008-06-24 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated HADOOP-3149: --- Attachment: patch3149.txt fixing MultipleOutputs javadoc to avoid warning. the warn

[jira] Updated: (HADOOP-3149) supporting multiple outputs for M/R jobs

2008-06-24 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated HADOOP-3149: --- Status: Open (was: Patch Available) > supporting multiple outputs for M/R jobs > --

[jira] Commented: (HADOOP-3630) CompositeRecordReader: key and values can be in uninitialized state if files being joined have no records

2008-06-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607865#action_12607865 ] Hadoop QA commented on HADOOP-3630: --- -1 overall. Here are the results of testing the la

[jira] Commented: (HADOOP-3632) Fix speculative execution or allow premature stop

2008-06-24 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607860#action_12607860 ] Amar Kamat commented on HADOOP-3632: One crude way of doing this would be to set the

[jira] Updated: (HADOOP-2302) Streaming should provide an option for numerical sort of keys

2008-06-24 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HADOOP-2302: Fix Version/s: 0.19.0 > Streaming should provide an option for numerical sort of keys > -

[jira] Assigned: (HADOOP-2302) Streaming should provide an option for numerical sort of keys

2008-06-24 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das reassigned HADOOP-2302: --- Assignee: Devaraj Das > Streaming should provide an option for numerical sort of keys > ---

[jira] Assigned: (HADOOP-3514) Reduce seeks during shuffle, by inline crcs

2008-06-24 Thread Jothi Padmanabhan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jothi Padmanabhan reassigned HADOOP-3514: - Assignee: Jothi Padmanabhan (was: Devaraj Das) > Reduce seeks during shuffle, b

[jira] Created: (HADOOP-3638) Cache the iFile index files in memory to reduce seeks during map output serving

2008-06-24 Thread Devaraj Das (JIRA)
Cache the iFile index files in memory to reduce seeks during map output serving --- Key: HADOOP-3638 URL: https://issues.apache.org/jira/browse/HADOOP-3638 Project: Hadoop Cor

[jira] Updated: (HADOOP-3514) Reduce seeks during shuffle, by inline crcs

2008-06-24 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HADOOP-3514: Comment: was deleted > Reduce seeks during shuffle, by inline crcs > -

[jira] Updated: (HADOOP-3514) Reduce seeks during shuffle, by inline crcs

2008-06-24 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HADOOP-3514: Description: The number of seeks can be reduced by half in the iFile if we move the crc into the i

[jira] Commented: (HADOOP-3578) mapred.system.dir should be accessible only to hadoop daemons

2008-06-24 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607859#action_12607859 ] Owen O'Malley commented on HADOOP-3578: --- Ok, some more details... I'd suggest using

[jira] Updated: (HADOOP-3630) CompositeRecordReader: key and values can be in uninitialized state if files being joined have no records

2008-06-24 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-3630: -- Fix Version/s: 0.19.0 Status: Patch Available (was: Open) > CompositeRecordReader:

[jira] Updated: (HADOOP-3630) CompositeRecordReader: key and values can be in uninitialized state if files being joined have no records

2008-06-24 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-3630: -- Attachment: 3630-0.patch bq. I think this occurs because CompositeRecordReader#add() [Hadoop 0

[jira] Commented: (HADOOP-3149) supporting multiple outputs for M/R jobs

2008-06-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607841#action_12607841 ] Hadoop QA commented on HADOOP-3149: --- -1 overall. Here are the results of testing the la

Re: [VOTE] Release Hadoop 0.17.1 (candidate 0)

2008-06-24 Thread Nigel Daley
+1 based on testing. Nige On Thu, Jun 19, 2008 at 2:26 AM, Mukund Madhugiri <[EMAIL PROTECTED] inc.com> wrote: We have created a candidate build for Hadoop 0.17.1. This fixes 10 issues in 0.17.0. Please download and try it out. http://people.apache.org/~nigel/hadoop-0.17.1-candidate-0/

[jira] Commented: (HADOOP-3617) Writes from map serialization include redundant checks for accounting space

2008-06-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607836#action_12607836 ] Hadoop QA commented on HADOOP-3617: --- -1 overall. Here are the results of testing the la

[jira] Commented: (HADOOP-3637) Support for snapshots

2008-06-24 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607835#action_12607835 ] Joydeep Sen Sarma commented on HADOOP-3637: --- why are thousands of snapshots requ

[jira] Updated: (HADOOP-3149) supporting multiple outputs for M/R jobs

2008-06-24 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated HADOOP-3149: --- Status: Patch Available (was: Open) > supporting multiple outputs for M/R jobs > --

[jira] Updated: (HADOOP-3149) supporting multiple outputs for M/R jobs

2008-06-24 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated HADOOP-3149: --- Attachment: patch3149.txt incorporated 3258 in the patch as that issue was to addres

[jira] Resolved: (HADOOP-3541) Namespace recovery from the secondary image should be documented.

2008-06-24 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko resolved HADOOP-3541. - Resolution: Fixed I just committed this. > Namespace recovery from the secondar

[jira] Commented: (HADOOP-3637) Support for snapshots

2008-06-24 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607820#action_12607820 ] dhruba borthakur commented on HADOOP-3637: -- A few Primary requirements: 1. Laten

[jira] Resolved: (HADOOP-2541) Online Snapshotting Capability

2008-06-24 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur resolved HADOOP-2541. -- Resolution: Duplicate I missed this earlier. Closing this as this is a duplicate of HA

[jira] Created: (HADOOP-3637) Support for snapshots

2008-06-24 Thread dhruba borthakur (JIRA)
Support for snapshots - Key: HADOOP-3637 URL: https://issues.apache.org/jira/browse/HADOOP-3637 Project: Hadoop Core Issue Type: New Feature Components: dfs Reporter: dhruba borthakur Ass

[jira] Updated: (HADOOP-3617) Writes from map serialization include redundant checks for accounting space

2008-06-24 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-3617: -- Status: Patch Available (was: Open) > Writes from map serialization include redundant checks

[jira] Updated: (HADOOP-3617) Writes from map serialization include redundant checks for accounting space

2008-06-24 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-3617: -- Attachment: 3617-2.patch Updated patch. > Writes from map serialization include redundant che

[jira] Created: (HADOOP-3636) Uncaught Exception in DataTransfer.run

2008-06-24 Thread Koji Noguchi (JIRA)
Uncaught Exception in DataTransfer.run -- Key: HADOOP-3636 URL: https://issues.apache.org/jira/browse/HADOOP-3636 Project: Hadoop Core Issue Type: Bug Components: dfs Affects Versions: 0.17.0

[jira] Updated: (HADOOP-3633) Uncaught exception in DataXceiveServer

2008-06-24 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated HADOOP-3633: - Environment: 17.0 + H1979-H2159-H3442 > Uncaught exception in DataXceiveServer > ---

[jira] Updated: (HADOOP-3635) Uncaught exception in DataBlockScanner

2008-06-24 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated HADOOP-3635: - Environment: 17.0 + H1979-H2159-H3442 > Uncaught exception in DataBlockScanner > ---

[jira] Updated: (HADOOP-3635) Uncaught exception in DataBlockScanner

2008-06-24 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated HADOOP-3635: - Attachment: jstack.H3635.txt > Uncaught exception in DataBlockScanner >

[jira] Created: (HADOOP-3635) Uncaught exception in DataBlockScanner

2008-06-24 Thread Koji Noguchi (JIRA)
Uncaught exception in DataBlockScanner -- Key: HADOOP-3635 URL: https://issues.apache.org/jira/browse/HADOOP-3635 Project: Hadoop Core Issue Type: Bug Components: dfs Affects Versions: 0.17.0

[jira] Created: (HADOOP-3634) Create tests for Hadoop metrics

2008-06-24 Thread Lohit Vijayarenu (JIRA)
Create tests for Hadoop metrics --- Key: HADOOP-3634 URL: https://issues.apache.org/jira/browse/HADOOP-3634 Project: Hadoop Core Issue Type: New Feature Components: metrics Affects Versions: 0.19.0

[jira] Commented: (HADOOP-3633) Uncaught exception in DataXceiveServer

2008-06-24 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607809#action_12607809 ] Konstantin Shvachko commented on HADOOP-3633: - There are 2 issues here, imo #

[jira] Commented: (HADOOP-3633) Uncaught exception in DataXceiveServer

2008-06-24 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607808#action_12607808 ] Koji Noguchi commented on HADOOP-3633: -- Tasks were failing with these error messages.

[jira] Updated: (HADOOP-3633) Uncaught exception in DataXceiveServer

2008-06-24 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated HADOOP-3633: - Attachment: jstack-H3633.txt Datanode's stack trace. It doesn't show DataXceiveServer running

[jira] Created: (HADOOP-3633) Uncaught exception in DataXceiveServer

2008-06-24 Thread Koji Noguchi (JIRA)
Uncaught exception in DataXceiveServer -- Key: HADOOP-3633 URL: https://issues.apache.org/jira/browse/HADOOP-3633 Project: Hadoop Core Issue Type: Bug Components: dfs Affects Versions: 0.17.0

[jira] Commented: (HADOOP-3624) CreateEditsLog could be improved to create tree directory structure

2008-06-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607806#action_12607806 ] Hadoop QA commented on HADOOP-3624: --- +1 overall. Here are the results of testing the la

[jira] Updated: (HADOOP-3541) Namespace recovery from the secondary image should be documented.

2008-06-24 Thread Lohit Vijayarenu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lohit Vijayarenu updated HADOOP-3541: - Hadoop Flags: [Reviewed] +1 Looks good. > Namespace recovery from the secondary image s

[jira] Updated: (HADOOP-3588) Bug report for archives

2008-06-24 Thread Mahadev konar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar updated HADOOP-3588: -- Attachment: Hadoop-3588-18_1.patch here is a patch for 0.18. > Bug report for archives >

[jira] Commented: (HADOOP-3632) Fix speculative execution or allow premature stop

2008-06-24 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607798#action_12607798 ] Doug Cutting commented on HADOOP-3632: -- You could implement this yourself by having y

[jira] Updated: (HADOOP-3541) Namespace recovery from the secondary image should be documented.

2008-06-24 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HADOOP-3541: Attachment: SecondaryDoc.patch It is a good idea to document fs.checkpoint.period

[jira] Commented: (HADOOP-3479) Implement configuration items useful for Hadoop resource manager (v1)

2008-06-24 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607793#action_12607793 ] Doug Cutting commented on HADOOP-3479: -- > If the proposal is to switch to hierarchica

[jira] Commented: (HADOOP-3131) enabling BLOCK compression for map outputs breaks the reduce progress counters

2008-06-24 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607791#action_12607791 ] Matei Zaharia commented on HADOOP-3131: --- Is anyone still interested in me writing a

[jira] Updated: (HADOOP-3604) Reduce stuck at shuffling phase

2008-06-24 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-3604: -- Attachment: HADOOP-3604_1_20080624.patch Plausible patch which incorporates Runping's synchron

[jira] Commented: (HADOOP-3100) Develop tests to test the DFS command line interface

2008-06-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607782#action_12607782 ] Hadoop QA commented on HADOOP-3100: --- -1 overall. Here are the results of testing the la

[jira] Updated: (HADOOP-3624) CreateEditsLog could be improved to create tree directory structure

2008-06-24 Thread Lohit Vijayarenu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lohit Vijayarenu updated HADOOP-3624: - Status: Patch Available (was: Open) > CreateEditsLog could be improved to create tree d

[jira] Updated: (HADOOP-3624) CreateEditsLog could be improved to create tree directory structure

2008-06-24 Thread Lohit Vijayarenu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lohit Vijayarenu updated HADOOP-3624: - Attachment: HADOOP-3624-1.patch This patch moves FileGenerator to separate class FileNam

[jira] Commented: (HADOOP-3479) Implement configuration items useful for Hadoop resource manager (v1)

2008-06-24 Thread Rob Weltman (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607768#action_12607768 ] Rob Weltman commented on HADOOP-3479: - Pretty-printing tools may be nice but do not re

[jira] Commented: (HADOOP-3604) Reduce stuck at shuffling phase

2008-06-24 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607766#action_12607766 ] Runping Qi commented on HADOOP-3604: It seems to me that there might be a lock conten

[jira] Commented: (HADOOP-3604) Reduce stuck at shuffling phase

2008-06-24 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607764#action_12607764 ] Doug Cutting commented on HADOOP-3604: -- > The streaming tasks don't timeout since map

[jira] Commented: (HADOOP-3591) org.apache.hadoop.fs.FileUtil.checkDependencies may want to use .equals() instead of ==

2008-06-24 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607760#action_12607760 ] Doug Cutting commented on HADOOP-3591: -- Depending on FileSystem equality is a bug. E

[jira] Created: (HADOOP-3632) Fix speculative execution or allow premature stop

2008-06-24 Thread Severin Hacker (JIRA)
Fix speculative execution or allow premature stop - Key: HADOOP-3632 URL: https://issues.apache.org/jira/browse/HADOOP-3632 Project: Hadoop Core Issue Type: New Feature Affects Versions: 0.

[jira] Commented: (HADOOP-3628) Add a lifecycle interface for Hadoop components: namenodes, job clients, etc.

2008-06-24 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607757#action_12607757 ] Doug Cutting commented on HADOOP-3628: -- +1 to the concept. However I suggest using a

[jira] Commented: (HADOOP-3618) JobClient should keep on retrying if the jobtracker is still initializing

2008-06-24 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607756#action_12607756 ] Doug Cutting commented on HADOOP-3618: -- Shouldn't this be implemented using a RetryPo

[jira] Commented: (HADOOP-3552) forrest doc for hadoop commands

2008-06-24 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607753#action_12607753 ] Arun C Murthy commented on HADOOP-3552: --- I believe that it will be much more useful

[jira] Updated: (HADOOP-3100) Develop tests to test the DFS command line interface

2008-06-24 Thread Mukund Madhugiri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Madhugiri updated HADOOP-3100: - Status: Patch Available (was: Open) > Develop tests to test the DFS command line interf

[jira] Updated: (HADOOP-3100) Develop tests to test the DFS command line interface

2008-06-24 Thread Mukund Madhugiri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Madhugiri updated HADOOP-3100: - Attachment: H3100.patch Updated patch: renamed TestData to CLITestData > Develop tests

[jira] Updated: (HADOOP-3357) delete on dfs hung

2008-06-24 Thread Amir Youssefi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amir Youssefi updated HADOOP-3357: -- Description: I had a case where the JobTracker was trying to delete some files, as part of Ga

[jira] Commented: (HADOOP-3588) Bug report for archives

2008-06-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607744#action_12607744 ] Hadoop QA commented on HADOOP-3588: --- +1 overall. Here are the results of testing the la

[jira] Commented: (HADOOP-2302) Streaming should provide an option for numerical sort of keys

2008-06-24 Thread Arkady Borkovsky (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607740#action_12607740 ] Arkady Borkovsky commented on HADOOP-2302: -- I think this describes the needs very

[jira] Created: (HADOOP-3631) Transfer of image from secondary name node should not interrupt service

2008-06-24 Thread Robert Chansler (JIRA)
Transfer of image from secondary name node should not interrupt service --- Key: HADOOP-3631 URL: https://issues.apache.org/jira/browse/HADOOP-3631 Project: Hadoop Core Issu

[jira] Issue Comment Edited: (HADOOP-3480) Need to update Eclipse template to reflect current trunk

2008-06-24 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607723#action_12607723 ] szetszwo edited comment on HADOOP-3480 at 6/24/08 11:56 AM:

[jira] Commented: (HADOOP-3480) Need to update Eclipse template to reflect current trunk

2008-06-24 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607723#action_12607723 ] Tsz Wo (Nicholas), SZE commented on HADOOP-3480: +1, hadoop-3480-v2.patch

Re: [VOTE] Release Hadoop 0.17.1 (candidate 0)

2008-06-24 Thread Tom White
+1 based on running tests and checking signatures. Tom On Thu, Jun 19, 2008 at 2:26 AM, Mukund Madhugiri <[EMAIL PROTECTED]> wrote: > We have created a candidate build for Hadoop 0.17.1. This fixes 10 issues > in 0.17.0. > > Please download and try it out. > > http://people.apache.org/~nigel/h

[jira] Commented: (HADOOP-2302) Streaming should provide an option for numerical sort of keys

2008-06-24 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607721#action_12607721 ] Devaraj Das commented on HADOOP-2302: - Would supporting the basic unix/gnu sort option

[jira] Issue Comment Edited: (HADOOP-3620) Namenode should synchronously resolve a datanode's network location when the datanode registers

2008-06-24 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607423#action_12607423 ] hairong edited comment on HADOOP-3620 at 6/24/08 11:25 AM: -

[jira] Updated: (HADOOP-3588) Bug report for archives

2008-06-24 Thread Mahadev konar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar updated HADOOP-3588: -- Status: Patch Available (was: Open) > Bug report for archives > --- > >

[jira] Commented: (HADOOP-3604) Reduce stuck at shuffling phase

2008-06-24 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607717#action_12607717 ] Arun C Murthy commented on HADOOP-3604: --- The streaming tasks don't timeout since map

[jira] Updated: (HADOOP-3588) Bug report for archives

2008-06-24 Thread Mahadev konar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar updated HADOOP-3588: -- Attachment: (was: Hadoop-3588-18_1.patch) > Bug report for archives >

[jira] Updated: (HADOOP-3588) Bug report for archives

2008-06-24 Thread Mahadev konar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar updated HADOOP-3588: -- Status: Open (was: Patch Available) trying hudson again with patch jsut for trunk. hudson app

[jira] Commented: (HADOOP-3588) Bug report for archives

2008-06-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607714#action_12607714 ] Hadoop QA commented on HADOOP-3588: --- -1 overall. Here are the results of testing the la

[jira] Commented: (HADOOP-3402) Add example code to support run terasort on hadoop

2008-06-24 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607715#action_12607715 ] Owen O'Malley commented on HADOOP-3402: --- Since the sort is generic (ie. doesn't depe

[jira] Commented: (HADOOP-3604) Reduce stuck at shuffling phase

2008-06-24 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607711#action_12607711 ] Arun C Murthy commented on HADOOP-3604: --- I'm hoping for some traction on http://for

[jira] Commented: (HADOOP-3479) Implement configuration items useful for Hadoop resource manager (v1)

2008-06-24 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607708#action_12607708 ] Doug Cutting commented on HADOOP-3479: -- > I am offering the engineering effort needed

[jira] Updated: (HADOOP-3588) Bug report for archives

2008-06-24 Thread Mahadev konar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar updated HADOOP-3588: -- Status: Patch Available (was: Open) > Bug report for archives > --- > >

[jira] Updated: (HADOOP-3588) Bug report for archives

2008-06-24 Thread Mahadev konar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar updated HADOOP-3588: -- Attachment: Hadoop-3588-18_1.patch this is a patch for 0.18 branch. > Bug report for archives

[jira] Updated: (HADOOP-3588) Bug report for archives

2008-06-24 Thread Mahadev konar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar updated HADOOP-3588: -- Attachment: Hadoop-3588-trunk_1.patch this patch is for trunk and fixes issues 1, 2, 3, 5, 5

[jira] Commented: (HADOOP-3402) Add example code to support run terasort on hadoop

2008-06-24 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607700#action_12607700 ] Doug Cutting commented on HADOOP-3402: -- Does this correspond to Indy or Daytona? If

Re: [VOTE] Release Hadoop 0.17.1 (candidate 0)

2008-06-24 Thread Mukund Madhugiri
+1 Testing done and passed: Unit tests: - Linux Benchmarks on 20, 100 and 500 nodes: - TestDFSIO - MRBench (aka SmallJobs) - Sort (RandomWriter, Sort, SortValidation) Thanks, Mukund * *Mukund Madhugiri wrote: We have created a candidate build for Hadoop 0.17.1. This fixes 10 issues in 0.17

[jira] Updated: (HADOOP-3532) Create build targets to create api change reports using jdiff

2008-06-24 Thread Mukund Madhugiri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Madhugiri updated HADOOP-3532: - Hadoop Flags: [Reviewed] > Create build targets to create api change reports using jdiff

[jira] Commented: (HADOOP-3532) Create build targets to create api change reports using jdiff

2008-06-24 Thread Mukund Madhugiri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607693#action_12607693 ] Mukund Madhugiri commented on HADOOP-3532: -- +1. Patch looks good > Create build

[jira] Commented: (HADOOP-3479) Implement configuration items useful for Hadoop resource manager (v1)

2008-06-24 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607690#action_12607690 ] Owen O'Malley commented on HADOOP-3479: --- I like the hierarchical solution, if it is

Re: test record append method ?

2008-06-24 Thread Ariel Rabkin
On 6/24/08 10:06 AM, "tienduc_dinh" <[EMAIL PROTECTED]> wrote: > > hi all, > > I'm very new to hadoop. What I want to ask is, if there is an test > implementation of the method "record append" like in Google File System. We don't have record append. Being able to reopen and append to files is a

[jira] Commented: (HADOOP-3357) delete on dfs hung

2008-06-24 Thread Ian Athanasakis (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607687#action_12607687 ] Ian Athanasakis commented on HADOOP-3357: - Randomly happened to me too. java.net.

[jira] Commented: (HADOOP-3630) CompositeRecordReader: key and values can be in uninitialized state if files being joined have no records

2008-06-24 Thread Jingkei Ly (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607685#action_12607685 ] Jingkei Ly commented on HADOOP-3630: I've pasted an example program below to demonstra

[jira] Issue Comment Edited: (HADOOP-3630) CompositeRecordReader: key and values can be in uninitialized state if files being joined have no records

2008-06-24 Thread Jingkei Ly (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607685#action_12607685 ] jly edited comment on HADOOP-3630 at 6/24/08 10:08 AM: -- I've

test record append method ?

2008-06-24 Thread tienduc_dinh
hi all, I'm very new to hadoop. What I want to ask is, if there is an test implementation of the method "record append" like in Google File System. And If yes, would you like to tell me what is the name of that file, because I've searched for it already, but not found yet. Sorry for my bad engli

[jira] Created: (HADOOP-3630) CompositeRecordReader: key and values can be in uninitialized state if files being joined have no records

2008-06-24 Thread Jingkei Ly (JIRA)
CompositeRecordReader: key and values can be in uninitialized state if files being joined have no records - Key: HADOOP-3630 URL: https://issues.apache.org/jir

[jira] Commented: (HADOOP-3479) Implement configuration items useful for Hadoop resource manager (v1)

2008-06-24 Thread Hemanth Yamijala (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607674#action_12607674 ] Hemanth Yamijala commented on HADOOP-3479: -- bq. In terms of API, I think that Hem

[jira] Commented: (HADOOP-3479) Implement configuration items useful for Hadoop resource manager (v1)

2008-06-24 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607673#action_12607673 ] Owen O'Malley commented on HADOOP-3479: --- I should also add that if you had a lot of

[jira] Issue Comment Edited: (HADOOP-3541) Namespace recovery from the secondary image should be documented.

2008-06-24 Thread Lohit Vijayarenu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607658#action_12607658 ] lohit edited comment on HADOOP-3541 at 6/24/08 9:19 AM: ---

[jira] Commented: (HADOOP-3479) Implement configuration items useful for Hadoop resource manager (v1)

2008-06-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607671#action_12607671 ] Steve Loughran commented on HADOOP-3479: +1 to hierarchical; it can be generally u

[jira] Commented: (HADOOP-3479) Implement configuration items useful for Hadoop resource manager (v1)

2008-06-24 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607670#action_12607670 ] Owen O'Malley commented on HADOOP-3479: --- I like having them in the same file, with t

[jira] Commented: (HADOOP-3402) Add example code to support run terasort on hadoop

2008-06-24 Thread Enis Soztutar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607668#action_12607668 ] Enis Soztutar commented on HADOOP-3402: --- >From the patch : {quote} In May 2008, Owe

[jira] Created: (HADOOP-3629) Document the metrics produced by hadoop

2008-06-24 Thread Rob Weltman (JIRA)
Document the metrics produced by hadoop --- Key: HADOOP-3629 URL: https://issues.apache.org/jira/browse/HADOOP-3629 Project: Hadoop Core Issue Type: Task Components: documentation Affects Ver

[jira] Commented: (HADOOP-3479) Implement configuration items useful for Hadoop resource manager (v1)

2008-06-24 Thread Rob Weltman (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607664#action_12607664 ] Rob Weltman commented on HADOOP-3479: - Hierarchical is much better than flat/generic f

[jira] Commented: (HADOOP-3541) Namespace recovery from the secondary image should be documented.

2008-06-24 Thread Lohit Vijayarenu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607658#action_12607658 ] Lohit Vijayarenu commented on HADOOP-3541: -- +1 Looks good - Can we describe creat

[jira] Updated: (HADOOP-3100) Develop tests to test the DFS command line interface

2008-06-24 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-3100: -- Status: Open (was: Patch Available) canceling patch until Nigel's suggestion of changing the

  1   2   >