Hello Mates:
Thanks to everyone for their help so far. I have learnt a lot and have now done
single and pseudo mode. I have a hadoop cluster but I ran jps on the master
node and slave node but not all process are started
master:
22160 NameNode
22716 Jps
22458 JobTracker
slave:
32195 Jps
I
; Harsh J
ha...@cloudera.com
Sent: Saturday, 13 August 2011, 0:19
Subject: Hadoop Cluster setup - no datanode
Hello Mates:
Thanks to everyone for their help so far. I have learnt a lot and have now
done single and pseudo mode. I have a hadoop cluster but I ran jps on the
master node and slave node
Subject: Re: Hadoop Cluster setup - no datanode
Hello:
I did more test again but now I noticed that only 3 nodes have datanodes while
the others do not. I ran the admin report tool and the result is below. Where
do i configure the capacity?
bin/hadoop dfsadmin -report
Configured Capacity: 0 (0
Hi Everyone:
I am quite new to hadoop here. I am attempting to set up Hadoop locally in
two machines, connected by LAN. Both of them pass the single-node test.
However, I failed in two-node cluster setup, as shown in the 2 cases below:
1) set one as dedicated namenode and the other as dedicated
, 2011 3:24 PM
To: HADOOP MLIST
Subject: Why I cannot see live nodes in a LAN-based cluster setup?
Hi Everyone:
I am quite new to hadoop here. I am attempting to set up Hadoop locally in
two machines, connected by LAN. Both of them pass the single-node test.
However, I failed in two-node cluster
if there are any errors?
Matt
-Original Message-
From: Jingwei Lu [mailto:j...@ucsd.edu]
Sent: Monday, June 27, 2011 3:24 PM
To: HADOOP MLIST
Subject: Why I cannot see live nodes in a LAN-based cluster setup?
Hi Everyone:
I am quite new to hadoop here. I am attempting to set up Hadoop
http://www.mentby.com/tim-robertson/error-register-getprotocolversion.html
-Original Message-
From: Jingwei Lu [mailto:j...@ucsd.edu]
Sent: Monday, June 27, 2011 3:58 PM
To: common-user@hadoop.apache.org
Subject: Re: Why I cannot see live nodes in a LAN-based cluster setup?
Hi,
I
@hadoop.apache.org
Subject: RE: Why I cannot see live nodes in a LAN-based cluster setup?
http://www.mentby.com/tim-robertson/error-register-getprotocolversion.html
-Original Message-
From: Jingwei Lu [mailto:j...@ucsd.edu]
Sent: Monday, June 27, 2011 3:58 PM
To: common-user@hadoop.apache.org
Subject
-Original Message-
From: jeff.schm...@shell.com [mailto:jeff.schm...@shell.com]
Sent: Monday, June 27, 2011 4:08 PM
To: common-user@hadoop.apache.org
Subject: RE: Why I cannot see live nodes in a LAN-based cluster setup?
http://www.mentby.com/tim-robertson/error-register-getprotocolversion.html
cluster setup?
Hi Matt and Jeff:
Thanks a lot for your instructions. I corrected the mistakes in conf files
of DN, and now the log on DN becomes:
2011-06-27 15:32:36,025 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: clock.ucsd.edu/132.239.95.91:54310. Already tried 0 time(s).
2011
Hey Amit, please try HOD or hadoop on demand tool. This will suffice to your
need for creating multiple users on ur cluster.
-Piyush
On Thu, Feb 10, 2011 at 12:42 AM, Kumar, Amit H. ahku...@odu.edu wrote:
Dear All,
I am trying to setup Hadoop for multiple users in a class, on our cluster.
...@gmail.com]
Sent: Wednesday, February 09, 2011 9:00 PM
To: common-user@hadoop.apache.org
Subject: Re: Hadoop Multi user - Cluster Setup
If can check this property in hdfs-site.xml
property
namedfs.permissions/name
valuetrue/value
description
If true, enable permission checking in HDFS
, February 09, 2011 9:00 PM
To: common-user@hadoop.apache.org
Subject: Re: Hadoop Multi user - Cluster Setup
If can check this property in hdfs-site.xml
property
namedfs.permissions/name
valuetrue/value
description
If true, enable permission checking in HDFS.
If false
Dear All,
I am trying to setup Hadoop for multiple users in a class, on our cluster. For
some reason I don't seem to get it right. If only one user is running it works
great.
I would want to have all of the users submit a Hadoop job to the existing
DataNode and on the cluster, not sure if
If can check this property in hdfs-site.xml
property
namedfs.permissions/name
valuetrue/value
description
If true, enable permission checking in HDFS.
If false, permission checking is turned off,
but all other behavior is unchanged.
Switching from one parameter value to the
hello,
I am trying to setup an Hadoop cluster. From the docs, it says I need
two master: NameNode and Jobtracker and one slave: datanode,
tasktracker.
so, I need at least 4 machines to set up a cluster with hadoop ?
How can I define the role of each machine if core-site.xml needs to be
the same
[mailto:fabio.a.mira...@gmail.com]
Sent: Tuesday, November 09, 2010 1:48 PM
To: common-user@hadoop.apache.org
Subject: Cluster setup
hello,
I am trying to setup an Hadoop cluster. From the docs, it says I need
two master: NameNode and Jobtracker and one slave: datanode,
tasktracker.
so, I need at least 4
?
Can I get sample .xml files for basic cluster setup ?
sample .xml files for basic cluster setup ?
Hi
I'm a beginner in working with hadoop. I want to know if we have to
physically connect the machines using LAN cable before setting up the
cluster.
Urgently needed to clarify this and start my work\
Regards
Janani
, February 03, 2010 8:51 AM
To: common-user@hadoop.apache.org
Subject: Hadoop cluster setup
Hi
I'm a beginner in working with hadoop. I want to know if we have to
physically connect the machines using LAN cable before setting up the
cluster.
Urgently needed to clarify this and start my work\
Regards
Janani
Subject: Hadoop cluster setup
Hi
I'm a beginner in working with hadoop. I want to know if we have to
physically connect the machines using LAN cable before setting up the
cluster.
Urgently needed to clarify this and start my work\
Regards
Janani
]
Sent: Wednesday, February 03, 2010 8:51 AM
To: common-user@hadoop.apache.org
Subject: Hadoop cluster setup
Hi
I'm a beginner in working with hadoop. I want to know if we have to
physically connect the machines using LAN cable before setting up the
cluster.
Urgently needed to clarify
@hadoop.apache.org
Subject: Hadoop cluster setup
Hi
I'm a beginner in working with hadoop. I want to know if we have to
physically connect the machines using LAN cable before setting up the
cluster.
Urgently needed to clarify this and start my work\
Regards
Janani
Hi..
I have been trying to setup hadoop cluster using hadoop-0.20.1. Same machine
acts as the namenode and jobtracker. When I start the cluster namenode,
datanode, jt and tt all get started. But when trying to submit a job the
datanode shows *Retrying connect to server error*.
I am trying to
Does your machines can ssh to each other ?
And can open the JobTracker Web UI?
Jeff Zhang
On Fri, Dec 18, 2009 at 1:25 PM, anjali nair anjalina...@gmail.com wrote:
Hi..
I have been trying to setup hadoop cluster using hadoop-0.20.1. Same
machine
acts as the namenode and jobtracker. When I
I'm running Hadoop 0.20.1+133 (Cloudera distro)
I tried setting up a multi-node Hadoop cluster and on executing the command:
hadoop jar /usr/lib/hadoop/hadoop-0.20.1+133-examples.jar grep input output
'dfs[a-z.]+'
I get:
09/10/27 20:39:21 INFO mapred.FileInputFormat: Total input paths to process
I've seen those errors when I was playing the values in the
core-site.xml, dfs-site.xml and mapreduce-site.xml.
Might be worth comparing your values to mine discussed in the thread
http://www.mail-archive.com/common-user@hadoop.apache.org/msg02522.html
which also represent 8G DN machines
Cheers
Hi,
We are trying to set up a cluster (starting with 2 machines) using the
new 0.20.1 version.
On the master machine, just after the server starts, the name node
dies off with the following exception:
2009-10-13 01:22:24,740 ERROR
org.apache.hadoop.hdfs.server.namenode.NameNode:
Hi Tejas,
I just upgraded to 20.1 as well and you config all looks the same as mine
except in the core-site.xml I have:
configuration
property
namefs.default.name/name
valuehdfs://localhost:9000/value
/property
/configuration
Maybe you need to add the port on yours. I haven't seen
I think you should edit the core-site.xml .
(master and slave machine)
-- core-site.xml ---
configuration
property
namefs.default.name/name
valuehdfs://master_hadoop: 54310
/value
/property
property
namehadoop.tmp.dir/name
value/opt/hadoop-0.20.1/tmp/value
/property
I think you need to specify the port as well for following port
property
namefs.default.name/name
valuehdfs://master_hadoop/value
/property
On Tue, Oct 13, 2009 at 7:17 AM, Tejas Lagvankar t...@umbc.edu wrote:
Hi,
We are trying to set up a cluster (starting with 2 machines) using the new
did you verify the name resolution?
On Tue, Oct 13, 2009 at 4:34 PM, Tejas Lagvankar t...@umbc.edu wrote:
I get the same error even if i specify the port number. I have tried with
port numbers 54310 as well as 9000.
Regards,
Tejas
On Oct 13, 2009, at 12:12 PM, Chandan Tamrakar wrote:
By name resolution, I assume that you mean the name mentioned in /etc/
hosts. Yes, in the logs, the IP address appears in the beginning.
Correct me if I'm wrong
I will also try with using just the IP's instead of the aliases.
On Oct 13, 2009, at 12:37 PM, Kevin Sweeney wrote:
did you verify
Hey Kevin,
You were right...
I changed all my aliases to IP addresses. It worked !
Thank you all again :)
Regards,
Tejas
On Oct 13, 2009, at 12:41 PM, Tejas Lagvankar wrote:
By name resolution, I assume that you mean the name mentioned in /
etc/hosts. Yes, in the logs, the IP address
35 matches
Mail list logo
