How to setup Cloudera Hadoop to run everything on a localhost?
I am trying to run all Hadoop servers on a single Ubuntu localhost. All ports are open and my /etc/hosts file is 127.0.0.1 frigate frigate.domain.locallocalhost # The following lines are desirable for IPv6 capable hosts ::1 ip6-localhost ip6-loopback fe00::0 ip6-localnet ff00::0 ip6-mcastprefix ff02::1 ip6-allnodes ff02::2 ip6-allrouters When trying to install cluster Cloudera manager fails with the following messages: Installation failed. Failed to receive heartbeat from agent. I run my Ubuntu-12.04 host from home connected by WiFi/dialup modem to my provider. What configuration is missing? Thanks!
Re: How to setup Cloudera Hadoop to run everything on a localhost?
Hi Anton, Can you try to add something like: your.local.ip.addressyourhostname into your hosts file? Like: 192.168.1.2 masterserver 2013/3/5 anton ashanin anton.asha...@gmail.com: I am trying to run all Hadoop servers on a single Ubuntu localhost. All ports are open and my /etc/hosts file is 127.0.0.1 frigate frigate.domain.locallocalhost # The following lines are desirable for IPv6 capable hosts ::1 ip6-localhost ip6-loopback fe00::0 ip6-localnet ff00::0 ip6-mcastprefix ff02::1 ip6-allnodes ff02::2 ip6-allrouters When trying to install cluster Cloudera manager fails with the following messages: Installation failed. Failed to receive heartbeat from agent. I run my Ubuntu-12.04 host from home connected by WiFi/dialup modem to my provider. What configuration is missing? Thanks!
Re: How to setup Cloudera Hadoop to run everything on a localhost?
Jean, thanks for trying to help. I get my IP address by DHCP. Every time I start my Ubuntu I possibly can get a different IP address from my WiFi modem /router. Will it be ok to add static address from 192.168.*.* to /etc/hosts in this case? On Tue, Mar 5, 2013 at 9:47 PM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: Hi Anton, Can you try to add something like: your.local.ip.addressyourhostname into your hosts file? Like: 192.168.1.2 masterserver 2013/3/5 anton ashanin anton.asha...@gmail.com: I am trying to run all Hadoop servers on a single Ubuntu localhost. All ports are open and my /etc/hosts file is 127.0.0.1 frigate frigate.domain.locallocalhost # The following lines are desirable for IPv6 capable hosts ::1 ip6-localhost ip6-loopback fe00::0 ip6-localnet ff00::0 ip6-mcastprefix ff02::1 ip6-allnodes ff02::2 ip6-allrouters When trying to install cluster Cloudera manager fails with the following messages: Installation failed. Failed to receive heartbeat from agent. I run my Ubuntu-12.04 host from home connected by WiFi/dialup modem to my provider. What configuration is missing? Thanks!
Re: How to setup Cloudera Hadoop to run everything on a localhost?
Can you please take this Cloudera mailing list? On Tue, Mar 5, 2013 at 10:33 AM, anton ashanin anton.asha...@gmail.comwrote: I am trying to run all Hadoop servers on a single Ubuntu localhost. All ports are open and my /etc/hosts file is 127.0.0.1 frigate frigate.domain.locallocalhost # The following lines are desirable for IPv6 capable hosts ::1 ip6-localhost ip6-loopback fe00::0 ip6-localnet ff00::0 ip6-mcastprefix ff02::1 ip6-allnodes ff02::2 ip6-allrouters When trying to install cluster Cloudera manager fails with the following messages: Installation failed. Failed to receive heartbeat from agent. I run my Ubuntu-12.04 host from home connected by WiFi/dialup modem to my provider. What configuration is missing? Thanks! -- http://hortonworks.com/download/
Re: How to setup Cloudera Hadoop to run everything on a localhost?
Moving to cdh-user, user@hadoop in BCC Anton, can you just with the IP you have and see if it fixed the issue before trying anything else? JM 2013/3/5 anton ashanin anton.asha...@gmail.com: Jean, thanks for trying to help. I get my IP address by DHCP. Every time I start my Ubuntu I possibly can get a different IP address from my WiFi modem /router. Will it be ok to add static address from 192.168.*.* to /etc/hosts in this case? On Tue, Mar 5, 2013 at 9:47 PM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: Hi Anton, Can you try to add something like: your.local.ip.addressyourhostname into your hosts file? Like: 192.168.1.2 masterserver 2013/3/5 anton ashanin anton.asha...@gmail.com: I am trying to run all Hadoop servers on a single Ubuntu localhost. All ports are open and my /etc/hosts file is 127.0.0.1 frigate frigate.domain.locallocalhost # The following lines are desirable for IPv6 capable hosts ::1 ip6-localhost ip6-loopback fe00::0 ip6-localnet ff00::0 ip6-mcastprefix ff02::1 ip6-allnodes ff02::2 ip6-allrouters When trying to install cluster Cloudera manager fails with the following messages: Installation failed. Failed to receive heartbeat from agent. I run my Ubuntu-12.04 host from home connected by WiFi/dialup modem to my provider. What configuration is missing? Thanks!
Re: How to setup Cloudera Hadoop to run everything on a localhost?
Don't use 'localhost' as your host name. For example, if you wanted to use the name 'node'; add another line to your hosts file like: 127.0.1.1 node.domain.local node Then change all the host references in your configuration files to 'node' -- also, don't forget to change the master/slave files as well. Now, if you decide to use an external address it would need to be static. This is easy to do, just follow this guide http://www.howtoforge.com/linux-basics-set-a-static-ip-on-ubuntu and replace '127.0.1.1' with whatever external address you decide on. On Tue, Mar 5, 2013 at 12:59 PM, Suresh Srinivas sur...@hortonworks.comwrote: Can you please take this Cloudera mailing list? On Tue, Mar 5, 2013 at 10:33 AM, anton ashanin anton.asha...@gmail.comwrote: I am trying to run all Hadoop servers on a single Ubuntu localhost. All ports are open and my /etc/hosts file is 127.0.0.1 frigate frigate.domain.locallocalhost # The following lines are desirable for IPv6 capable hosts ::1 ip6-localhost ip6-loopback fe00::0 ip6-localnet ff00::0 ip6-mcastprefix ff02::1 ip6-allnodes ff02::2 ip6-allrouters When trying to install cluster Cloudera manager fails with the following messages: Installation failed. Failed to receive heartbeat from agent. I run my Ubuntu-12.04 host from home connected by WiFi/dialup modem to my provider. What configuration is missing? Thanks! -- http://hortonworks.com/download/
Re: How to setup Cloudera Hadoop to run everything on a localhost?
I am at a loss. I have set an IP address that my node got by DHCP: 127.0.0.1 localhost 192.168.1.6node This has not helped. Cloudera Manager finds this host all right, but still can not get a heartbeat from it next. Maybe the problem is that at the moment of these experiments I have three laptops with addresses assigned by DHCP all running at once? To make Hadoop work I am ready now to switch Ubuntu for CentOS or should I try something else? Please let me know on what Linux version you have managed to run Hadoop on a local host only? On Tue, Mar 5, 2013 at 10:54 PM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: Hi Anton, Here is what my host is looking like: 127.0.0.1 localhost 192.168.1.2myserver JM 2013/3/5 anton ashanin anton.asha...@gmail.com: Morgan, Just did exactly as you suggested, my /etc/hosts: 127.0.1.1 node.domain.local node Wiped out, annihilated my previous installation completely and reinstalled everything from scratch. The same problem with CLOUDERA MANAGER (FREE EDITION): Installation failed. Failed to receive heartbeat from agent I will try now the the bright idea from Jean, looks promising to me On Tue, Mar 5, 2013 at 10:10 PM, Morgan Reece winter2...@gmail.com wrote: Don't use 'localhost' as your host name. For example, if you wanted to use the name 'node'; add another line to your hosts file like: 127.0.1.1 node.domain.local node Then change all the host references in your configuration files to 'node' -- also, don't forget to change the master/slave files as well. Now, if you decide to use an external address it would need to be static. This is easy to do, just follow this guide http://www.howtoforge.com/linux-basics-set-a-static-ip-on-ubuntu and replace '127.0.1.1' with whatever external address you decide on. On Tue, Mar 5, 2013 at 12:59 PM, Suresh Srinivas sur...@hortonworks.com wrote: Can you please take this Cloudera mailing list? On Tue, Mar 5, 2013 at 10:33 AM, anton ashanin anton.asha...@gmail.com wrote: I am trying to run all Hadoop servers on a single Ubuntu localhost. All ports are open and my /etc/hosts file is 127.0.0.1 frigate frigate.domain.locallocalhost # The following lines are desirable for IPv6 capable hosts ::1 ip6-localhost ip6-loopback fe00::0 ip6-localnet ff00::0 ip6-mcastprefix ff02::1 ip6-allnodes ff02::2 ip6-allrouters When trying to install cluster Cloudera manager fails with the following messages: Installation failed. Failed to receive heartbeat from agent. I run my Ubuntu-12.04 host from home connected by WiFi/dialup modem to my provider. What configuration is missing? Thanks! -- http://hortonworks.com/download/
Re: How to setup Cloudera Hadoop to run everything on a localhost?
Hi Anton, Cloudera manager needs fully qualified domain name. Run hostname -f to check whether you have FQDN or not. I am not familiar with Ubuntu, but on my CentOS, I just put the FQDN into /etc/sysconfig/network, which then looks like the following: NETWORKING=yes HOSTNAME=myhost.my.domain GATEWAY=10.2.2.254 http://demo.effectivemeasure.com/signatures/au/YibingShi.vcf On Wed, Mar 6, 2013 at 8:14 AM, anton ashanin anton.asha...@gmail.comwrote: I am at a loss. I have set an IP address that my node got by DHCP: 127.0.0.1 localhost 192.168.1.6node This has not helped. Cloudera Manager finds this host all right, but still can not get a heartbeat from it next. Maybe the problem is that at the moment of these experiments I have three laptops with addresses assigned by DHCP all running at once? To make Hadoop work I am ready now to switch Ubuntu for CentOS or should I try something else? Please let me know on what Linux version you have managed to run Hadoop on a local host only? On Tue, Mar 5, 2013 at 10:54 PM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: Hi Anton, Here is what my host is looking like: 127.0.0.1 localhost 192.168.1.2myserver JM 2013/3/5 anton ashanin anton.asha...@gmail.com: Morgan, Just did exactly as you suggested, my /etc/hosts: 127.0.1.1 node.domain.local node Wiped out, annihilated my previous installation completely and reinstalled everything from scratch. The same problem with CLOUDERA MANAGER (FREE EDITION): Installation failed. Failed to receive heartbeat from agent I will try now the the bright idea from Jean, looks promising to me On Tue, Mar 5, 2013 at 10:10 PM, Morgan Reece winter2...@gmail.com wrote: Don't use 'localhost' as your host name. For example, if you wanted to use the name 'node'; add another line to your hosts file like: 127.0.1.1 node.domain.local node Then change all the host references in your configuration files to 'node' -- also, don't forget to change the master/slave files as well. Now, if you decide to use an external address it would need to be static. This is easy to do, just follow this guide http://www.howtoforge.com/linux-basics-set-a-static-ip-on-ubuntu and replace '127.0.1.1' with whatever external address you decide on. On Tue, Mar 5, 2013 at 12:59 PM, Suresh Srinivas sur...@hortonworks.com wrote: Can you please take this Cloudera mailing list? On Tue, Mar 5, 2013 at 10:33 AM, anton ashanin anton.asha...@gmail.com wrote: I am trying to run all Hadoop servers on a single Ubuntu localhost. All ports are open and my /etc/hosts file is 127.0.0.1 frigate frigate.domain.locallocalhost # The following lines are desirable for IPv6 capable hosts ::1 ip6-localhost ip6-loopback fe00::0 ip6-localnet ff00::0 ip6-mcastprefix ff02::1 ip6-allnodes ff02::2 ip6-allrouters When trying to install cluster Cloudera manager fails with the following messages: Installation failed. Failed to receive heartbeat from agent. I run my Ubuntu-12.04 host from home connected by WiFi/dialup modem to my provider. What configuration is missing? Thanks! -- http://hortonworks.com/download/
Re: How to setup Cloudera Hadoop to run everything on a localhost?
Do you run all Hadoop servers on a single host that gets IP by DHCP? What do you have in /etc/hosts? Thanks! On Wed, Mar 6, 2013 at 1:25 AM, yibing Shi yibing@effectivemeasure.comwrote: Hi Anton, Cloudera manager needs fully qualified domain name. Run hostname -f to check whether you have FQDN or not. I am not familiar with Ubuntu, but on my CentOS, I just put the FQDN into /etc/sysconfig/network, which then looks like the following: NETWORKING=yes HOSTNAME=myhost.my.domain GATEWAY=10.2.2.254 http://demo.effectivemeasure.com/signatures/au/YibingShi.vcf On Wed, Mar 6, 2013 at 8:14 AM, anton ashanin anton.asha...@gmail.comwrote: I am at a loss. I have set an IP address that my node got by DHCP: 127.0.0.1 localhost 192.168.1.6node This has not helped. Cloudera Manager finds this host all right, but still can not get a heartbeat from it next. Maybe the problem is that at the moment of these experiments I have three laptops with addresses assigned by DHCP all running at once? To make Hadoop work I am ready now to switch Ubuntu for CentOS or should I try something else? Please let me know on what Linux version you have managed to run Hadoop on a local host only? On Tue, Mar 5, 2013 at 10:54 PM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: Hi Anton, Here is what my host is looking like: 127.0.0.1 localhost 192.168.1.2myserver JM 2013/3/5 anton ashanin anton.asha...@gmail.com: Morgan, Just did exactly as you suggested, my /etc/hosts: 127.0.1.1 node.domain.local node Wiped out, annihilated my previous installation completely and reinstalled everything from scratch. The same problem with CLOUDERA MANAGER (FREE EDITION): Installation failed. Failed to receive heartbeat from agent I will try now the the bright idea from Jean, looks promising to me On Tue, Mar 5, 2013 at 10:10 PM, Morgan Reece winter2...@gmail.com wrote: Don't use 'localhost' as your host name. For example, if you wanted to use the name 'node'; add another line to your hosts file like: 127.0.1.1 node.domain.local node Then change all the host references in your configuration files to 'node' -- also, don't forget to change the master/slave files as well. Now, if you decide to use an external address it would need to be static. This is easy to do, just follow this guide http://www.howtoforge.com/linux-basics-set-a-static-ip-on-ubuntu and replace '127.0.1.1' with whatever external address you decide on. On Tue, Mar 5, 2013 at 12:59 PM, Suresh Srinivas sur...@hortonworks.com wrote: Can you please take this Cloudera mailing list? On Tue, Mar 5, 2013 at 10:33 AM, anton ashanin anton.asha...@gmail.com wrote: I am trying to run all Hadoop servers on a single Ubuntu localhost. All ports are open and my /etc/hosts file is 127.0.0.1 frigate frigate.domain.locallocalhost # The following lines are desirable for IPv6 capable hosts ::1 ip6-localhost ip6-loopback fe00::0 ip6-localnet ff00::0 ip6-mcastprefix ff02::1 ip6-allnodes ff02::2 ip6-allrouters When trying to install cluster Cloudera manager fails with the following messages: Installation failed. Failed to receive heartbeat from agent. I run my Ubuntu-12.04 host from home connected by WiFi/dialup modem to my provider. What configuration is missing? Thanks! -- http://hortonworks.com/download/
Re: How to setup Cloudera Hadoop to run everything on a localhost?
I didn't run all the services on a single server, but I doesn't matter since the installation is the same no matter how many servers you are going to install on. I got the same error as you and it turned out that CM needs to be able to know the FQDN. But I didn't use DHCP so it is easier for me to fix that. I guess you might have to set up the DHCP server correctly for CM to find your FQDN. http://demo.effectivemeasure.com/signatures/au/YibingShi.vcf On Wed, Mar 6, 2013 at 9:56 AM, anton ashanin anton.asha...@gmail.comwrote: Do you run all Hadoop servers on a single host that gets IP by DHCP? What do you have in /etc/hosts? Thanks! On Wed, Mar 6, 2013 at 1:25 AM, yibing Shi yibing@effectivemeasure.com wrote: Hi Anton, Cloudera manager needs fully qualified domain name. Run hostname -f to check whether you have FQDN or not. I am not familiar with Ubuntu, but on my CentOS, I just put the FQDN into /etc/sysconfig/network, which then looks like the following: NETWORKING=yes HOSTNAME=myhost.my.domain GATEWAY=10.2.2.254 http://demo.effectivemeasure.com/signatures/au/YibingShi.vcf On Wed, Mar 6, 2013 at 8:14 AM, anton ashanin anton.asha...@gmail.comwrote: I am at a loss. I have set an IP address that my node got by DHCP: 127.0.0.1 localhost 192.168.1.6node This has not helped. Cloudera Manager finds this host all right, but still can not get a heartbeat from it next. Maybe the problem is that at the moment of these experiments I have three laptops with addresses assigned by DHCP all running at once? To make Hadoop work I am ready now to switch Ubuntu for CentOS or should I try something else? Please let me know on what Linux version you have managed to run Hadoop on a local host only? On Tue, Mar 5, 2013 at 10:54 PM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: Hi Anton, Here is what my host is looking like: 127.0.0.1 localhost 192.168.1.2myserver JM 2013/3/5 anton ashanin anton.asha...@gmail.com: Morgan, Just did exactly as you suggested, my /etc/hosts: 127.0.1.1 node.domain.local node Wiped out, annihilated my previous installation completely and reinstalled everything from scratch. The same problem with CLOUDERA MANAGER (FREE EDITION): Installation failed. Failed to receive heartbeat from agent I will try now the the bright idea from Jean, looks promising to me On Tue, Mar 5, 2013 at 10:10 PM, Morgan Reece winter2...@gmail.com wrote: Don't use 'localhost' as your host name. For example, if you wanted to use the name 'node'; add another line to your hosts file like: 127.0.1.1 node.domain.local node Then change all the host references in your configuration files to 'node' -- also, don't forget to change the master/slave files as well. Now, if you decide to use an external address it would need to be static. This is easy to do, just follow this guide http://www.howtoforge.com/linux-basics-set-a-static-ip-on-ubuntu and replace '127.0.1.1' with whatever external address you decide on. On Tue, Mar 5, 2013 at 12:59 PM, Suresh Srinivas sur...@hortonworks.com wrote: Can you please take this Cloudera mailing list? On Tue, Mar 5, 2013 at 10:33 AM, anton ashanin anton.asha...@gmail.com wrote: I am trying to run all Hadoop servers on a single Ubuntu localhost. All ports are open and my /etc/hosts file is 127.0.0.1 frigate frigate.domain.locallocalhost # The following lines are desirable for IPv6 capable hosts ::1 ip6-localhost ip6-loopback fe00::0 ip6-localnet ff00::0 ip6-mcastprefix ff02::1 ip6-allnodes ff02::2 ip6-allrouters When trying to install cluster Cloudera manager fails with the following messages: Installation failed. Failed to receive heartbeat from agent. I run my Ubuntu-12.04 host from home connected by WiFi/dialup modem to my provider. What configuration is missing? Thanks! -- http://hortonworks.com/download/
Re: How to setup Cloudera Hadoop to run everything on a localhost?
Do the problem of installing Hadoop on a single DHCP node exist for Apache distribution of Hadoop as well? On Wed, Mar 6, 2013 at 2:30 AM, Suresh Srinivas sur...@hortonworks.comwrote: folks, another gentle reminder. Please use cloudera lists. On Tue, Mar 5, 2013 at 2:56 PM, anton ashanin anton.asha...@gmail.comwrote: Do you run all Hadoop servers on a single host that gets IP by DHCP? What do you have in /etc/hosts? Thanks! On Wed, Mar 6, 2013 at 1:25 AM, yibing Shi yibing@effectivemeasure.com wrote: Hi Anton, Cloudera manager needs fully qualified domain name. Run hostname -f to check whether you have FQDN or not. I am not familiar with Ubuntu, but on my CentOS, I just put the FQDN into /etc/sysconfig/network, which then looks like the following: NETWORKING=yes HOSTNAME=myhost.my.domain GATEWAY=10.2.2.254 http://demo.effectivemeasure.com/signatures/au/YibingShi.vcf On Wed, Mar 6, 2013 at 8:14 AM, anton ashanin anton.asha...@gmail.comwrote: I am at a loss. I have set an IP address that my node got by DHCP: 127.0.0.1 localhost 192.168.1.6node This has not helped. Cloudera Manager finds this host all right, but still can not get a heartbeat from it next. Maybe the problem is that at the moment of these experiments I have three laptops with addresses assigned by DHCP all running at once? To make Hadoop work I am ready now to switch Ubuntu for CentOS or should I try something else? Please let me know on what Linux version you have managed to run Hadoop on a local host only? On Tue, Mar 5, 2013 at 10:54 PM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: Hi Anton, Here is what my host is looking like: 127.0.0.1 localhost 192.168.1.2myserver JM 2013/3/5 anton ashanin anton.asha...@gmail.com: Morgan, Just did exactly as you suggested, my /etc/hosts: 127.0.1.1 node.domain.local node Wiped out, annihilated my previous installation completely and reinstalled everything from scratch. The same problem with CLOUDERA MANAGER (FREE EDITION): Installation failed. Failed to receive heartbeat from agent I will try now the the bright idea from Jean, looks promising to me On Tue, Mar 5, 2013 at 10:10 PM, Morgan Reece winter2...@gmail.com wrote: Don't use 'localhost' as your host name. For example, if you wanted to use the name 'node'; add another line to your hosts file like: 127.0.1.1 node.domain.local node Then change all the host references in your configuration files to 'node' -- also, don't forget to change the master/slave files as well. Now, if you decide to use an external address it would need to be static. This is easy to do, just follow this guide http://www.howtoforge.com/linux-basics-set-a-static-ip-on-ubuntu and replace '127.0.1.1' with whatever external address you decide on. On Tue, Mar 5, 2013 at 12:59 PM, Suresh Srinivas sur...@hortonworks.com wrote: Can you please take this Cloudera mailing list? On Tue, Mar 5, 2013 at 10:33 AM, anton ashanin anton.asha...@gmail.com wrote: I am trying to run all Hadoop servers on a single Ubuntu localhost. All ports are open and my /etc/hosts file is 127.0.0.1 frigate frigate.domain.locallocalhost # The following lines are desirable for IPv6 capable hosts ::1 ip6-localhost ip6-loopback fe00::0 ip6-localnet ff00::0 ip6-mcastprefix ff02::1 ip6-allnodes ff02::2 ip6-allrouters When trying to install cluster Cloudera manager fails with the following messages: Installation failed. Failed to receive heartbeat from agent. I run my Ubuntu-12.04 host from home connected by WiFi/dialup modem to my provider. What configuration is missing? Thanks! -- http://hortonworks.com/download/ -- http://hortonworks.com/download/
