[jira] Reopened: (HADOOP-210) Namenode not able to accept connections

2006-06-14 Thread Doug Cutting (JIRA)
[ http://issues.apache.org/jira/browse/HADOOP-210?page=all ] Doug Cutting reopened HADOOP-210: - Assign To: Sameer Paranjpye (was: Mahadev konar) I reverted this for now, since it (for unknown reasons) seemed to break distributed operation. > Nam

[jira] Updated: (HADOOP-304) UnregisteredDatanodeException message correction

2006-06-14 Thread Konstantin Shvachko (JIRA)
[ http://issues.apache.org/jira/browse/HADOOP-304?page=all ] Konstantin Shvachko updated HADOOP-304: --- Attachment: UnregisteredDatanodeException.patch UnregisteredDatanodeException should report the expected node name rather than its storage id.

[jira] Created: (HADOOP-304) UnregisteredDatanodeException message correction

2006-06-14 Thread Konstantin Shvachko (JIRA)
UnregisteredDatanodeException message correction Key: HADOOP-304 URL: http://issues.apache.org/jira/browse/HADOOP-304 Project: Hadoop Type: Bug Versions: 0.3.2 Reporter: Konstantin Shvachko Assigned to: K

[jira] Commented: (HADOOP-296) Do not assign blocks to a datanode with < x mb free

2006-06-14 Thread Konstantin Shvachko (JIRA)
[ http://issues.apache.org/jira/browse/HADOOP-296?page=comments#action_12416264 ] Konstantin Shvachko commented on HADOOP-296: Works for me. Although you don't need "fs.space.min" any more. > Do not assign blocks to a datanode with < x mb free >

[jira] Commented: (HADOOP-59) support generic command-line options

2006-06-14 Thread Hairong Kuang (JIRA)
[ http://issues.apache.org/jira/browse/HADOOP-59?page=comments#action_12416263 ] Hairong Kuang commented on HADOOP-59: - I am thinking to design the ToolBase as follows: public class ToolBase implements Tool extends Configured { public final void main

[jira] Assigned: (HADOOP-59) support generic command-line options

2006-06-14 Thread Hairong Kuang (JIRA)
[ http://issues.apache.org/jira/browse/HADOOP-59?page=all ] Hairong Kuang reassigned HADOOP-59: --- Assign To: Hairong Kuang (was: Michel Tourn) > support generic command-line options > > > Key: HADOOP-59 >

[jira] Commented: (HADOOP-210) Namenode not able to accept connections

2006-06-14 Thread Owen O'Malley (JIRA)
[ http://issues.apache.org/jira/browse/HADOOP-210?page=comments#action_12416253 ] Owen O'Malley commented on HADOOP-210: -- I'm having problems with this patch seeming to cause servers to stop serving requests. Usually, I can do a bit of work, but when I

[jira] Updated: (HADOOP-296) Do not assign blocks to a datanode with < x mb free

2006-06-14 Thread Johan Oskarson (JIRA)
[ http://issues.apache.org/jira/browse/HADOOP-296?page=all ] Johan Oskarson updated HADOOP-296: -- Attachment: minspacev3.patch Arghl, sorry.. Forgot to save before I did the diff > Do not assign blocks to a datanode with < x mb free > --

[jira] Updated: (HADOOP-296) Do not assign blocks to a datanode with < x mb free

2006-06-14 Thread Johan Oskarson (JIRA)
[ http://issues.apache.org/jira/browse/HADOOP-296?page=all ] Johan Oskarson updated HADOOP-296: -- Attachment: minspacev3.patch Added the changes suggested by Konstantin. /Johan > Do not assign blocks to a datanode with < x mb free > ---

[jira] Created: (HADOOP-303) JobClient looking for classes for submitted job in the wrong place

2006-06-14 Thread Benjamin Reed (JIRA)
JobClient looking for classes for submitted job in the wrong place -- Key: HADOOP-303 URL: http://issues.apache.org/jira/browse/HADOOP-303 Project: Hadoop Type: Bug Components: mapred Versions:

[jira] Updated: (HADOOP-303) JobClient looking for classes for submitted job in the wrong place

2006-06-14 Thread Benjamin Reed (JIRA)
[ http://issues.apache.org/jira/browse/HADOOP-303?page=all ] Benjamin Reed updated HADOOP-303: - Attachment: jobcl-fix.patch > JobClient looking for classes for submitted job in the wrong place > ---

[jira] Commented: (HADOOP-296) Do not assign blocks to a datanode with < x mb free

2006-06-14 Thread Konstantin Shvachko (JIRA)
[ http://issues.apache.org/jira/browse/HADOOP-296?page=comments#action_12416235 ] Konstantin Shvachko commented on HADOOP-296: Oh, and you also need to add those properties into hadoop-default.xml > Do not assign blocks to a datanode with < x mb

[jira] Commented: (HADOOP-297) When selecting node to put new block on, give priority to those with more free space/less blocks

2006-06-14 Thread Konstantin Shvachko (JIRA)
[ http://issues.apache.org/jira/browse/HADOOP-297?page=comments#action_12416234 ] Konstantin Shvachko commented on HADOOP-297: Implementing a good weight function is a non-trivial problem. It is still a very good thing to implement the framework

[jira] Commented: (HADOOP-296) Do not assign blocks to a datanode with < x mb free

2006-06-14 Thread Konstantin Shvachko (JIRA)
[ http://issues.apache.org/jira/browse/HADOOP-296?page=comments#action_12416233 ] Konstantin Shvachko commented on HADOOP-296: Yoram, as far as I know you use a large cluster of mostly identical machines. For such clusters you need one configurat

Re: Using Hadoop in a production environment

2006-06-14 Thread Eric Baldeschwieler
sounds pretty cool. On Jun 14, 2006, at 9:23 AM, Runping Qi wrote: I have also been thinking of the Hadoop job scheduling issue too. In my applications, some jobs depend on the outputs of other jobs. Therefore, job dependency forms a DAG. A job is ready to run if and only if it does not hav

[jira] Commented: (HADOOP-296) Do not assign blocks to a datanode with < x mb free

2006-06-14 Thread Yoram Arnon (JIRA)
[ http://issues.apache.org/jira/browse/HADOOP-296?page=comments#action_12416226 ] Yoram Arnon commented on HADOOP-296: managing individual configuration files on each node is exceedingly difficult. when I make a config change, say, when a new config vari

RE: Using Hadoop in a production environment

2006-06-14 Thread Runping Qi
I have also been thinking of the Hadoop job scheduling issue too. In my applications, some jobs depend on the outputs of other jobs. Therefore, job dependency forms a DAG. A job is ready to run if and only if it does not have any dependency or all the jobs it depends are finished successfully. T

[jira] Commented: (HADOOP-299) maps from second jobs will not run until the first job finishes completely

2006-06-14 Thread Owen O'Malley (JIRA)
[ http://issues.apache.org/jira/browse/HADOOP-299?page=comments#action_12416204 ] Owen O'Malley commented on HADOOP-299: -- *smile* I don't have that much free time! I certainly agree with you that the right long term solution would involve: 1. Using t

[jira] Updated: (HADOOP-296) Do not assign blocks to a datanode with < x mb free

2006-06-14 Thread Johan Oskarson (JIRA)
[ http://issues.apache.org/jira/browse/HADOOP-296?page=all ] Johan Oskarson updated HADOOP-296: -- Attachment: minspacev2.patch Thanks for the feedback. Quick patch that reads dfs.datanode.du.reserved and dfs.datanode.du.pct from the config. Hope this i

[jira] Commented: (HADOOP-299) maps from second jobs will not run until the first job finishes completely

2006-06-14 Thread Andrzej Bialecki (JIRA)
[ http://issues.apache.org/jira/browse/HADOOP-299?page=comments#action_12416131 ] Andrzej Bialecki commented on HADOOP-299: -- It's the same issue that I reported earlier on the mailing list (e.g. http://www.mail-archive.com/hadoop-dev@lucene.apache