[jira] [Created] (YARN-7433) java.lang.RuntimeException: native snappy library not available: this version of libhadoop was built without snappy support.

2017-11-02 Thread gehaijiang (JIRA) 
gehaijiang created YARN-7433:


 Summary: java.lang.RuntimeException: native snappy library not 
available: this version of libhadoop was built without snappy support.
 Key: YARN-7433
 URL: https://issues.apache.org/jira/browse/YARN-7433
 Project: Hadoop YARN
  Issue Type: Bug
 Environment: From centos6.5 upgrade centos7,hadoop version(2.7.1) 
is compiled on centos6.5 and Support snappy,   the copy runs on centos7.

but  yarn task error ，yarn  task errorlog： 
(hadoop Native Libraries Whether to recompile based on centos7???)
Error: java.lang.RuntimeException: native snappy library not available: this 
version of libhadoop was built without snappy support.
at 
org.apache.hadoop.io.compress.SnappyCodec.checkNativeCodeLoaded(SnappyCodec.java:65)
at 
org.apache.hadoop.io.compress.SnappyCodec.getCompressorType(SnappyCodec.java:134)
at 
org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:150)
at 
org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:165)
at org.apache.hadoop.mapred.IFile$Writer.(IFile.java:114)
at org.apache.hadoop.mapred.IFile$Writer.(IFile.java:97)
at 
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.mergeParts(MapTask.java:1856)
at 
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1511)
at 
org.apache.hadoop.mapred.MapTask$NewOutputCollector.close(MapTask.java:723)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:793)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
Error: java.io.IOException: Spill failed
Reporter: gehaijiang






--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Updated] (YARN-6229) resource manager web UI display BUG

2017-02-24 Thread gehaijiang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/YARN-6229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

gehaijiang updated YARN-6229:
-
Attachment: rs.png

attachment

> resource manager web UI  display  BUG
> -
>
> Key: YARN-6229
> URL: https://issues.apache.org/jira/browse/YARN-6229
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: resourcemanager
>Affects Versions: 2.7.1
> Environment: hadoop 2.7.1
>Reporter: gehaijiang
> Attachments: rs.png
>
>
> resourcemanager web UI display  bug：
> Memory Used  -3.44TB
> Containers Running -2607
> VCores Used -2607
> Lost Nodes  173
> These numbers are not correct。
> Cluster Metrics
> Apps Submitted | Apps Pending | Apps Running |Apps Completed  | 
> Containers Running | Memory Used | Memory Total | Memory Reserved |VCores 
> Used |  VCores Total | VCores Reserved | Active Nodes   | Decommissioned 
> Nodes | Lost Nodes | Unhealthy Nodes | Rebooted Nodes
> 3027432   0   20  3027412 -2607   -3.44TB 9.70TB  0B  -2607   
> 72400   181 0



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Updated] (YARN-6229) resource manager web UI display BUG

2017-02-24 Thread gehaijiang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/YARN-6229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

gehaijiang updated YARN-6229:
-
Description: 
resourcemanager web UI display  bug：

Memory Used  -3.44TB
Containers Running -2607
VCores Used -2607
Lost Nodes  173

These numbers are not correct。



Cluster Metrics

Apps Submitted | Apps Pending | Apps Running |  Apps Completed  | Containers 
Running | Memory Used | Memory Total | Memory Reserved |VCores Used |  
VCores Total | VCores Reserved | Active Nodes   | Decommissioned Nodes | Lost 
Nodes | Unhealthy Nodes | Rebooted Nodes
3027432 0   20  3027412 -2607   -3.44TB 9.70TB  0B  -2607   7240
0   181 0



  was:
resourcemanager web UI display  bug：

Memory Used  -3.44TB
Containers Running -2607
VCores Used -2607
Lost Nodes  173

These numbers are not correct。



Cluster Metrics
Apps Submitted  Apps PendingApps RunningApps Completed  Containers 
Running  Memory Used Memory TotalMemory Reserved VCores Used 
VCores TotalVCores Reserved Active NodesDecommissioned NodesLost 
Nodes  Unhealthy Nodes Rebooted Nodes
3027432 0   20  3027412 -2607   -3.44 TB9.70 TB 0 B -2607   
72400   181 0




> resource manager web UI  display  BUG
> -
>
> Key: YARN-6229
> URL: https://issues.apache.org/jira/browse/YARN-6229
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: resourcemanager
>Affects Versions: 2.7.1
> Environment: hadoop 2.7.1
>Reporter: gehaijiang
>
> resourcemanager web UI display  bug：
> Memory Used  -3.44TB
> Containers Running -2607
> VCores Used -2607
> Lost Nodes  173
> These numbers are not correct。
> Cluster Metrics
> Apps Submitted | Apps Pending | Apps Running |Apps Completed  | 
> Containers Running | Memory Used | Memory Total | Memory Reserved |VCores 
> Used |  VCores Total | VCores Reserved | Active Nodes   | Decommissioned 
> Nodes | Lost Nodes | Unhealthy Nodes | Rebooted Nodes
> 3027432   0   20  3027412 -2607   -3.44TB 9.70TB  0B  -2607   
> 72400   181 0



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Created] (YARN-6229) resource manager web UI display BUG

2017-02-23 Thread gehaijiang (JIRA) 
gehaijiang created YARN-6229:


 Summary: resource manager web UI  display  BUG
 Key: YARN-6229
 URL: https://issues.apache.org/jira/browse/YARN-6229
 Project: Hadoop YARN
  Issue Type: Bug
  Components: resourcemanager
Affects Versions: 2.7.1
 Environment: hadoop 2.7.1
Reporter: gehaijiang


resourcemanager web UI display  bug：

Memory Used  -3.44TB
Containers Running -2607
VCores Used -2607
Lost Nodes  173

These numbers are not correct。



Cluster Metrics
Apps Submitted  Apps PendingApps RunningApps Completed  Containers 
Running  Memory Used Memory TotalMemory Reserved VCores Used 
VCores TotalVCores Reserved Active NodesDecommissioned NodesLost 
Nodes  Unhealthy Nodes Rebooted Nodes
3027432 0   20  3027412 -2607   -3.44 TB9.70 TB 0 B -2607   
72400   181 0





--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Commented] (YARN-6062) nodemanager memory leak

2017-01-11 Thread gehaijiang (JIRA) 

[ 
https://issues.apache.org/jira/browse/YARN-6062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15817846#comment-15817846
 ] 

gehaijiang commented on YARN-6062:
--

thanks！   JDK 7U80  and  JDK8  Is using beta

> nodemanager memory leak
> ---
>
> Key: YARN-6062
> URL: https://issues.apache.org/jira/browse/YARN-6062
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: nodemanager
>Affects Versions: 2.7.1
>Reporter: gehaijiang
> Attachments: jmap.84971.txt, jstack.84971.txt, smaps.84971.txt
>
>
>  PID USER  PR  NI  VIRT  RES  SHR S %CPU %MEMTIME+  COMMAND
>  8986 data  20   0 21.3g  19g 7376 S  5.5 20.7   2458:09 java
> 38432 data  20   0  9.8g 7.9g 6300 S 95.5  8.4  35273:23 java
>  6653 data  20   0 4558m 3.4g  10m S  9.2  3.6   6640:37 java
> $ jps
> 6653 NodeManager
> Nodemanager memory has been up，Reach  10G。
> nodemanager   yarn-env.sh  configure  (2G)
> YARN_NODEMANAGER_OPTS=" -Xms2048m -Xmn768m 
> -Xloggc:${YARN_LOG_DIR}/nodemanager.gc.log -XX:+PrintGCDateStamps 
> -XX:+PrintGCDetails -XX:+PrintGCTimeStamps"



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Commented] (YARN-6062) nodemanager memory leak

2017-01-09 Thread gehaijiang (JIRA) 

[ 
https://issues.apache.org/jira/browse/YARN-6062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813562#comment-15813562
 ] 

gehaijiang commented on YARN-6062:
--

pid  6653 process restart. Cluster nodemanager have memory leaks

> nodemanager memory leak
> ---
>
> Key: YARN-6062
> URL: https://issues.apache.org/jira/browse/YARN-6062
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: nodemanager
>Affects Versions: 2.7.1
>Reporter: gehaijiang
> Attachments: jmap.84971.txt, jstack.84971.txt, smaps.84971.txt
>
>
>  PID USER  PR  NI  VIRT  RES  SHR S %CPU %MEMTIME+  COMMAND
>  8986 data  20   0 21.3g  19g 7376 S  5.5 20.7   2458:09 java
> 38432 data  20   0  9.8g 7.9g 6300 S 95.5  8.4  35273:23 java
>  6653 data  20   0 4558m 3.4g  10m S  9.2  3.6   6640:37 java
> $ jps
> 6653 NodeManager
> Nodemanager memory has been up，Reach  10G。
> nodemanager   yarn-env.sh  configure  (2G)
> YARN_NODEMANAGER_OPTS=" -Xms2048m -Xmn768m 
> -Xloggc:${YARN_LOG_DIR}/nodemanager.gc.log -XX:+PrintGCDateStamps 
> -XX:+PrintGCDetails -XX:+PrintGCTimeStamps"



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Commented] (YARN-6062) nodemanager memory leak

2017-01-09 Thread gehaijiang (JIRA) 

[ 
https://issues.apache.org/jira/browse/YARN-6062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813556#comment-15813556
 ] 

gehaijiang commented on YARN-6062:
--

java version "1.7.0_65"
Java(TM) SE Runtime Environment (build 1.7.0_65-b17)
Java HotSpot(TM) 64-Bit Server VM (build 24.65-b04, mixed mode)

> nodemanager memory leak
> ---
>
> Key: YARN-6062
> URL: https://issues.apache.org/jira/browse/YARN-6062
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: nodemanager
>Affects Versions: 2.7.1
>Reporter: gehaijiang
> Attachments: jmap.84971.txt, jstack.84971.txt, smaps.84971.txt
>
>
>  PID USER  PR  NI  VIRT  RES  SHR S %CPU %MEMTIME+  COMMAND
>  8986 data  20   0 21.3g  19g 7376 S  5.5 20.7   2458:09 java
> 38432 data  20   0  9.8g 7.9g 6300 S 95.5  8.4  35273:23 java
>  6653 data  20   0 4558m 3.4g  10m S  9.2  3.6   6640:37 java
> $ jps
> 6653 NodeManager
> Nodemanager memory has been up，Reach  10G。
> nodemanager   yarn-env.sh  configure  (2G)
> YARN_NODEMANAGER_OPTS=" -Xms2048m -Xmn768m 
> -Xloggc:${YARN_LOG_DIR}/nodemanager.gc.log -XX:+PrintGCDateStamps 
> -XX:+PrintGCDetails -XX:+PrintGCTimeStamps"



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Comment Edited] (YARN-6062) nodemanager memory leak

2017-01-08 Thread gehaijiang (JIRA) 

[ 
https://issues.apache.org/jira/browse/YARN-6062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15809058#comment-15809058
 ] 

gehaijiang edited comment on YARN-6062 at 1/8/17 9:19 AM:
--

mat  information:

使用的堆内存  41M
对象数量413,471
类数量 6,033
Class Loader 数量 92
GC ROOT 数量  1,904
文件格式hprof
日期  2016-12-27 10:38:18
位数  64-bit

 类名称   (类ID)对象个数本身所占内存  本身加引用所占内存
java.util.concurrent.ConcurrentHashMap   (37247)530 41K 25M
java.util.concurrent.ConcurrentHashMap$Segment[]   (41421)  530 78K 
25M
java.util.concurrent.ConcurrentHashMap$Segment   (34044)5,938   278K
25M
java.util.concurrent.ConcurrentHashMap$HashEntry[]   (37906)5,938   1,239K  
25M
java.util.concurrent.ConcurrentHashMap$HashEntry   (34043)  41,944  1,966K  
25M
byte[]   (35091)2,566   16,633K 16M
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
   (41148)  1   0K  11M
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalResourcesTrackerImpl
   (37582)138 13K 11M
org.apache.hadoop.mapred.ShuffleHandler$HttpPipelineFactory   (45434)   1   
0K  10M
org.apache.hadoop.mapred.ShuffleHandler$Shuffle   (45435)   1   0K  
10M
org.apache.hadoop.mapred.IndexCache   (89561)   1   0K  10M


was (Author: gehaijiang):
mat  information:

 类名称   (类ID)对象个数本身所占内存  本身加引用所占内存
java.util.concurrent.ConcurrentHashMap   (37247)530 41K 25M
java.util.concurrent.ConcurrentHashMap$Segment[]   (41421)  530 78K 
25M
java.util.concurrent.ConcurrentHashMap$Segment   (34044)5,938   278K
25M
java.util.concurrent.ConcurrentHashMap$HashEntry[]   (37906)5,938   1,239K  
25M
java.util.concurrent.ConcurrentHashMap$HashEntry   (34043)  41,944  1,966K  
25M
byte[]   (35091)2,566   16,633K 16M
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
   (41148)  1   0K  11M
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalResourcesTrackerImpl
   (37582)138 13K 11M
org.apache.hadoop.mapred.ShuffleHandler$HttpPipelineFactory   (45434)   1   
0K  10M
org.apache.hadoop.mapred.ShuffleHandler$Shuffle   (45435)   1   0K  
10M
org.apache.hadoop.mapred.IndexCache   (89561)   1   0K  10M

> nodemanager memory leak
> ---
>
> Key: YARN-6062
> URL: https://issues.apache.org/jira/browse/YARN-6062
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: nodemanager
>Affects Versions: 2.7.1
>Reporter: gehaijiang
> Attachments: jmap.84971.txt, jstack.84971.txt, smaps.84971.txt
>
>
>  PID USER  PR  NI  VIRT  RES  SHR S %CPU %MEMTIME+  COMMAND
>  8986 data  20   0 21.3g  19g 7376 S  5.5 20.7   2458:09 java
> 38432 data  20   0  9.8g 7.9g 6300 S 95.5  8.4  35273:23 java
>  6653 data  20   0 4558m 3.4g  10m S  9.2  3.6   6640:37 java
> $ jps
> 6653 NodeManager
> Nodemanager memory has been up，Reach  10G。
> nodemanager   yarn-env.sh  configure  (2G)
> YARN_NODEMANAGER_OPTS=" -Xms2048m -Xmn768m 
> -Xloggc:${YARN_LOG_DIR}/nodemanager.gc.log -XX:+PrintGCDateStamps 
> -XX:+PrintGCDetails -XX:+PrintGCTimeStamps"



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Commented] (YARN-6062) nodemanager memory leak

2017-01-08 Thread gehaijiang (JIRA) 

[ 
https://issues.apache.org/jira/browse/YARN-6062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15809058#comment-15809058
 ] 

gehaijiang commented on YARN-6062:
--

mat  information:

 类名称   (类ID)对象个数本身所占内存  本身加引用所占内存
java.util.concurrent.ConcurrentHashMap   (37247)530 41K 25M
java.util.concurrent.ConcurrentHashMap$Segment[]   (41421)  530 78K 
25M
java.util.concurrent.ConcurrentHashMap$Segment   (34044)5,938   278K
25M
java.util.concurrent.ConcurrentHashMap$HashEntry[]   (37906)5,938   1,239K  
25M
java.util.concurrent.ConcurrentHashMap$HashEntry   (34043)  41,944  1,966K  
25M
byte[]   (35091)2,566   16,633K 16M
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
   (41148)  1   0K  11M
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalResourcesTrackerImpl
   (37582)138 13K 11M
org.apache.hadoop.mapred.ShuffleHandler$HttpPipelineFactory   (45434)   1   
0K  10M
org.apache.hadoop.mapred.ShuffleHandler$Shuffle   (45435)   1   0K  
10M
org.apache.hadoop.mapred.IndexCache   (89561)   1   0K  10M

> nodemanager memory leak
> ---
>
> Key: YARN-6062
> URL: https://issues.apache.org/jira/browse/YARN-6062
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: nodemanager
>Affects Versions: 2.7.1
>Reporter: gehaijiang
> Attachments: jmap.84971.txt, jstack.84971.txt, smaps.84971.txt
>
>
>  PID USER  PR  NI  VIRT  RES  SHR S %CPU %MEMTIME+  COMMAND
>  8986 data  20   0 21.3g  19g 7376 S  5.5 20.7   2458:09 java
> 38432 data  20   0  9.8g 7.9g 6300 S 95.5  8.4  35273:23 java
>  6653 data  20   0 4558m 3.4g  10m S  9.2  3.6   6640:37 java
> $ jps
> 6653 NodeManager
> Nodemanager memory has been up，Reach  10G。
> nodemanager   yarn-env.sh  configure  (2G)
> YARN_NODEMANAGER_OPTS=" -Xms2048m -Xmn768m 
> -Xloggc:${YARN_LOG_DIR}/nodemanager.gc.log -XX:+PrintGCDateStamps 
> -XX:+PrintGCDetails -XX:+PrintGCTimeStamps"



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Commented] (YARN-6062) nodemanager memory leak

2017-01-08 Thread gehaijiang (JIRA) 

[ 
https://issues.apache.org/jira/browse/YARN-6062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15809052#comment-15809052
 ] 

gehaijiang commented on YARN-6062:
--

Already attached

> nodemanager memory leak
> ---
>
> Key: YARN-6062
> URL: https://issues.apache.org/jira/browse/YARN-6062
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: nodemanager
>Affects Versions: 2.7.1
>Reporter: gehaijiang
> Attachments: jmap.84971.txt, jstack.84971.txt, smaps.84971.txt
>
>
>  PID USER  PR  NI  VIRT  RES  SHR S %CPU %MEMTIME+  COMMAND
>  8986 data  20   0 21.3g  19g 7376 S  5.5 20.7   2458:09 java
> 38432 data  20   0  9.8g 7.9g 6300 S 95.5  8.4  35273:23 java
>  6653 data  20   0 4558m 3.4g  10m S  9.2  3.6   6640:37 java
> $ jps
> 6653 NodeManager
> Nodemanager memory has been up，Reach  10G。
> nodemanager   yarn-env.sh  configure  (2G)
> YARN_NODEMANAGER_OPTS=" -Xms2048m -Xmn768m 
> -Xloggc:${YARN_LOG_DIR}/nodemanager.gc.log -XX:+PrintGCDateStamps 
> -XX:+PrintGCDetails -XX:+PrintGCTimeStamps"



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Updated] (YARN-6062) nodemanager memory leak

2017-01-08 Thread gehaijiang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/YARN-6062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

gehaijiang updated YARN-6062:
-
Attachment: smaps.84971.txt
jstack.84971.txt
jmap.84971.txt

jmap、jstack、 /proc/pid/smaps  file  information 

> nodemanager memory leak
> ---
>
> Key: YARN-6062
> URL: https://issues.apache.org/jira/browse/YARN-6062
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: nodemanager
>Affects Versions: 2.7.1
>Reporter: gehaijiang
> Attachments: jmap.84971.txt, jstack.84971.txt, smaps.84971.txt
>
>
>  PID USER  PR  NI  VIRT  RES  SHR S %CPU %MEMTIME+  COMMAND
>  8986 data  20   0 21.3g  19g 7376 S  5.5 20.7   2458:09 java
> 38432 data  20   0  9.8g 7.9g 6300 S 95.5  8.4  35273:23 java
>  6653 data  20   0 4558m 3.4g  10m S  9.2  3.6   6640:37 java
> $ jps
> 6653 NodeManager
> Nodemanager memory has been up，Reach  10G。
> nodemanager   yarn-env.sh  configure  (2G)
> YARN_NODEMANAGER_OPTS=" -Xms2048m -Xmn768m 
> -Xloggc:${YARN_LOG_DIR}/nodemanager.gc.log -XX:+PrintGCDateStamps 
> -XX:+PrintGCDetails -XX:+PrintGCTimeStamps"



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Created] (YARN-6062) nodemanager memory leak

2017-01-06 Thread gehaijiang (JIRA) 
gehaijiang created YARN-6062:


 Summary: nodemanager memory leak
 Key: YARN-6062
 URL: https://issues.apache.org/jira/browse/YARN-6062
 Project: Hadoop YARN
  Issue Type: Bug
  Components: nodemanager
Affects Versions: 2.7.1
Reporter: gehaijiang


 PID USER  PR  NI  VIRT  RES  SHR S %CPU %MEMTIME+  COMMAND
 8986 data  20   0 21.3g  19g 7376 S  5.5 20.7   2458:09 java
38432 data  20   0  9.8g 7.9g 6300 S 95.5  8.4  35273:23 java
 6653 data  20   0 4558m 3.4g  10m S  9.2  3.6   6640:37 java

$ jps
6653 NodeManager

Nodemanager memory has been up，Reach  10G。

nodemanager   yarn-env.sh  configure  (2G)
YARN_NODEMANAGER_OPTS=" -Xms2048m -Xmn768m 
-Xloggc:${YARN_LOG_DIR}/nodemanager.gc.log -XX:+PrintGCDateStamps 
-XX:+PrintGCDetails -XX:+PrintGCTimeStamps"




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org