Re: Namenode Connection Refused

: If it's an HA cluster, is it possible the client doesn't have the proper HA configuration so it doesn't know what host name to connect to? Otherwise, the usual suspect is the firewall configuration between the client and the NameNode. On Tue, Oct 24, 2023 at 9:05 AM Harry Jamison wrote: >

Namenode Connection Refused

I feel like I am doing something really dumb here, but my namenode is having a connection refused on port 8020. There is nothing in the logs that seems to indicate an error as far as I can tell ps aux shows the namenode is running root   13169   10196  9 21:18 pts/100:00:02

systemctl setup for HDFS

I was trying to setup services for systemctl for hdfs services. I think I did something wrong. Could someone send me their example service files? I just want to see if I am missing something. Or is there a better way to startup hdfs on boot? Thanks

HA Namenode unable to connect

I am trying to start my hadoop cluster manually. I am having trouble figuring out what this error means. I see this error repeatedly and eventually the namenode shuts down [2023-10-10 21:03:37,179] INFO Retrying connect to server: vmnode1/192.168.1.159:8485. Already tried 0 time(s); retry policy

Re: HDFS HA standby

@Kiyoshi Mizumaru How would I do that?I tried changing /hadoop/etc/hadoop/hadoop-env.sh export HADOOP_ROOT_LOGGER=TRACE,console But that did not seem to work, I still only get INFO.On Tuesday, October 3, 2023 at 09:13:13 PM PDT, Harry Jamison wrote: I am not sure exactly what

HDFS HA standby

I am not sure exactly what the problem is now. My namenode (and I think journal node are getting shut down.Is there a way to tell Why it is getting the shutdown signal? Also the datanode seems to be getting this error End of File Exception between local host is Here are the logs, and I only see

Re: HDFS HA namenode issue

 Susheel Kumar On Tue, 3 Oct 2023, 10:09 pm Harry Jamison, wrote: OK here is where I am at now. When I start the namenodes, they work, but they are all in standby mode.When I start my first datanode it seems to kill one of the namenodes (the active one I assume) I am getting 2 different warnings

Re: HDFS HA namenode issue

way. Glad you found the root cause. Keep going. On Tue, Oct 3, 2023 at 10:27 AM Harry Jamison wrote: Liming  After looking at my config, I think that maybe my problem is because my  fs.defaultFS is inconsistent between hdfs-site.xml and core-site.xmlWhat does hdfs-site.xml vs core-site.xml do why

Re: HDFS HA namenode issue

, 2023 at 9:05 AM Harry Jamison wrote: I am trying to setup a HA HDFS cluster, and I am running into a problem I am not sure what I am doing wrong, I thought I followed the HA namenode guide, but it is not working. Apache Hadoop 3.3.6 – HDFS High Availability I have 2 namenodes and 3 journal

HDFS HA namenode issue

I am trying to setup a HA HDFS cluster, and I am running into a problem I am not sure what I am doing wrong, I thought I followed the HA namenode guide, but it is not working. Apache Hadoop 3.3.6 – HDFS High Availability I have 2 namenodes and 3 journal nodes, and 3 zookeeper nodes. After some