Re: rolling upgrade(2.4.1 to 2.6.0) problem

2015-04-27 Thread 조주일
- From: Drake민영근lt;drake@nexr.comgt; To: userlt;user@hadoop.apache.orggt;; 조주일lt;tjst...@kgrid.co.krgt;; Cc: Sent: 2015-04-24 (금) 17:41:59 Subject: Re: rolling upgrade(2.4.1 to 2.6.0) problem Hi, I think limited by max user processes. see this: https://plumbr.eu/outofmemoryerror/unable

Re: rolling upgrade(2.4.1 to 2.6.0) problem

2015-04-27 Thread Nitin Pawar
:* *Sent:* 2015-04-24 (금) 17:41:59 *Subject:* Re: rolling upgrade(2.4.1 to 2.6.0) problem Hi, I think limited by max user processes. see this: https://plumbr.eu/outofmemoryerror/unable-to-create-new-native-thread In your case, user cannot create more than 10240 processes. In our env

Re: rolling upgrade(2.4.1 to 2.6.0) problem

2015-04-27 Thread Drake민영근
will do patch? Can I patch without service dowtime. -Original Message- *From:* Drake민영근drake@nexr.com *To:* useruser@hadoop.apache.org; 조주일tjst...@kgrid.co.kr; *Cc:* *Sent:* 2015-04-24 (금) 17:41:59 *Subject:* Re: rolling upgrade(2.4.1 to 2.6.0) problem Hi, I think limited

Re: rolling upgrade(2.4.1 to 2.6.0) problem

2015-04-24 Thread Drake민영근
-playart.com *To:* user@hadoop.apache.org; *Cc:* *Sent:* 2015-04-22 (수) 15:32:35 *Subject:* RE: rolling upgrade(2.4.1 to 2.6.0) problem Hi, The first warning shows out-of-memory error of JVM. Did you give enough max heap memory for DataNode daemons? DN daemons, by default, uses max heap size

Re: rolling upgrade(2.4.1 to 2.6.0) problem

2015-04-24 Thread 조주일
...@kgrid.co.krgt;; Cc: Sent: 2015-04-24 (금) 16:58:46 Subject: Re: rolling upgrade(2.4.1 to 2.6.0) problem HI, How about the ulimit setting of the user for hdfs datanode ?Drake 민영근 Ph.Dkt NexR On Wed, Apr 22, 2015 at 6:25 PM, 조주일 lt;tjst...@kgrid.co.krgt; wrote: I allocated 5G. I think OOM

Re: rolling upgrade(2.4.1 to 2.6.0) problem

2015-04-24 Thread Drake민영근
-Cheol Chohancheol@nhn-playart.com *To:* user@hadoop.apache.org; *Cc:* *Sent:* 2015-04-22 (수) 15:32:35 *Subject:* RE: rolling upgrade(2.4.1 to 2.6.0) problem Hi, The first warning shows out-of-memory error of JVM. Did you give enough max heap memory for DataNode daemons? DN daemons

RE: rolling upgrade(2.4.1 to 2.6.0) problem

2015-04-22 Thread Han-Cheol Cho
; To: lt;user@hadoop.apache.orggt;; Cc: Sent: 2015-04-22 (수) 14:54:16 Subject: rolling upgrade(2.4.1 to 2.6.0) problem My Cluster is.. hadoop 2.4.1 Capacity : 1.24PB Used 1.1PB 16 Datanodes Each node is a capacity of 65TB, 96TB, 80TB, Etc.. I had to proceed with the rolling upgrade 2.4.1

RE: rolling upgrade(2.4.1 to 2.6.0) problem

2015-04-22 Thread 조주일
I allocated 5G. I think OOM is not the cause of essentially -Original Message- From: Han-Cheol Cholt;hancheol@nhn-playart.comgt; To: lt;user@hadoop.apache.orggt;; Cc: Sent: 2015-04-22 (수) 15:32:35 Subject: RE: rolling upgrade(2.4.1 to 2.6.0) problem Hi, The first warning

rolling upgrade(2.4.1 to 2.6.0) problem

2015-04-21 Thread 조주일
My Cluster is.. hadoop 2.4.1 Capacity : 1.24PB Used 1.1PB 16 Datanodes Each node is a capacity of 65TB, 96TB, 80TB, Etc.. I had to proceed with the rolling upgrade 2.4.1 to 2.6.0. A data node upgraded takes about 40 minutes. Occurs during the upgrade is in progress under-block. 10 nodes