Hello, I gathered stats of my jobs in a Hadoop Cluster. I took the
JobHistory logs and process them with Rumen. In the json file, for
each task attemp, there are a field named "cpuUsages".
Example:
"cpuUsages" : [ 6028, 3967, 3597, 3354, 3225, 3454, 3589, 4316, 42632,
102, 103, 103 ]
I need to
Hi,
I used AWS EMR to create a hadoop vm and do my work.I got the following error:
com.google.common.util.concurrent.UncheckedExecutionException:
java.lang.IllegalArgumentException: /tmp is a symbolic link to a directory
STATUS: 500
The /tmp directory in an AWS EMR EC2 instance is a symbolic
Dear Apache enthusiast,
ApacheCon and Apache Big Data will be held at the Intercontinental in
Miami, Florida, May 16-18, 2017. Submit your talks, and register, at
http://apachecon.com/ Talks aimed at the Big Data section of the event
should go to
Dear Apache enthusiast,
ApacheCon and Apache Big Data will be held at the Intercontinental in
Miami, Florida, May 16-18, 2017. Submit your talks, and register, at
http://apachecon.com/ Talks aimed at the Big Data section of the event
should go to
Dear Apache enthusiast,
ApacheCon and Apache Big Data will be held at the Intercontinental in
Miami, Florida, May 16-18, 2017. Submit your talks, and register, at
http://apachecon.com/ Talks aimed at the Big Data section of the event
should go to
Dear Apache enthusiast,
ApacheCon and Apache Big Data will be held at the Intercontinental in
Miami, Florida, May 16-18, 2017. Submit your talks, and register, at
http://apachecon.com/ Talks aimed at the Big Data section of the event
should go to
The following property in my cluster was set to false. This needs to be
true for being able to read data from timeline server.
The setting that controls whether yarn system metrics is
published on the timeline server or not by RM.
yarn.resourcemanager.system-metrics-publisher.enabled
true
Dear all,
Is there a way to specify a different number of vcores and memory for
node managers on different hosts.
I was only able to find the property yarn.nodemanager.resource.cpu-vcores of
Yarn,
but this setting then applies to all node managers.
Thank you for your help.
Best,
Sebastian
Hi
I am running Hadoop 2.6.0 on a cluster setup. I have setup the timeline
server on this cluster.
My code wants to fetch details of KILLED containers for an application. I
have used the yarnClient.getContainerReport() call to get
details of containers. This call throws an exception for KILLED
