Hadoop shows only one live datanode

2018-12-23 Thread Jérémy C
Hello everyone, I installed hadoop 3.1.1 on 3 virtual machines with VMware on Ubuntu. When I run hdfs namenode -format and start-all.sh then jps works correctly on my master and two slaves nodes. However, with the command hdfs dfsadmin -report, I can see only one live data node (I get the sam

Re: Hadoop shows only one live datanode

2018-12-24 Thread Akira Ajisaka
Hi Jérémy, Would you set "dfs.namenode.rpc-address" to "master:9000" in hdfs-site.xml? The NameNode RPC address is "localhost:8020" by default and that's why only the DataNode running on master is registered. DataNodes running on slave1/slave2 want to connect to "localhost:8020" and cannot find th

Re: Hadoop shows only one live datanode

2018-12-29 Thread Gurmukh Singh
core-site.xml is wrong. It is "fs.defaultFS" not "fs.default.FS" Also remove "/" after the port fs.default.name hdfs://master:9000/ fs.default.FS hdfs://master:9000/ Also, you are running yarn; so you do not need the below: mapre