, 2015 at 5:15 PM, 조주일 lt;tjst...@kgrid.co.krgt; wrote:
ulimit -a
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 62580
max locked memory
...@kgrid.co.krgt;;
Cc:
Sent: 2015-04-24 (금) 16:58:46
Subject: Re: rolling upgrade(2.4.1 to 2.6.0) problem
HI, How about the ulimit setting of the user for hdfs datanode ?Drake 민영근
Ph.Dkt NexR
On Wed, Apr 22, 2015 at 6:25 PM, 조주일 lt;tjst...@kgrid.co.krgt; wrote:
I allocated 5G.
I think OOM
http://hadoop.apache.org/docs/r2.6.0/hadoop-project-dist/hadoop-hdfs/HdfsRollingUpgrade.html
Rolling Upgrade, 2.4.1 to 2.6.0
Downgrade without downtime, 2.6.0 to 2.4.1
Downgrade without downtime is not possible?
org.apache.hadoop.hdfs.server.datanode.DataNode: Reported NameNode version
I allocated 5G.
I think OOM is not the cause of essentially
-Original Message-
From: Han-Cheol Cholt;hancheol@nhn-playart.comgt;
To: lt;user@hadoop.apache.orggt;;
Cc:
Sent: 2015-04-22 (수) 15:32:35
Subject: RE: rolling upgrade(2.4.1 to 2.6.0) problem
Hi,
The first warning
My Cluster is..
hadoop 2.4.1
Capacity : 1.24PB
Used 1.1PB
16 Datanodes
Each node is a capacity of 65TB, 96TB, 80TB, Etc..
I had to proceed with the rolling upgrade 2.4.1 to 2.6.0.
A data node upgraded takes about 40 minutes.
Occurs during the upgrade is in progress under-block.
10 nodes
My cluser version hdfs 2.2 stable ( 2 ha namenodes, 10 datanodes)
I was command bin/hdfs dfs -setrep -R 2 / ( replication 1 to 2 )
I found that HDFS is actually replicating the under replicated blocks but it
works very slowly.
HDFS performs the replication about 1 block per second.
I have
hi.
my cluster is .
2 ha namenode
8 datanodes
Occurred under the block of 506,803.
1000 block of 10 minutes will be replicated.
600 megabytes of traffic per server occurs.
Will take much longer until complete.
How can I increase the replication rate.
ns01 = HA( namenode194-active, namenode195-standby )
ns02 = HA( namenode196-active, namenode197-standby )
I was running on the server command 195
I was running the command(-safemode enter) namenode194 server
$HADOOP_PREFIX/bin/hdfs dfsadmin -safemode enter
I was expecting to change
Occurs when uploading.
Logs are generated in any situation?
It is dangerous problem?
* hadoop version 1.1.2
* namenode log
2014-04-17 09:30:34,280 INFO namenode.FSNamesystem
(FSNamesystem.java:commitBlockSynchronization(2374)) -
