Hi all,
I'm wondering if it is possible to get information such as Spill file
numbers, Spill start/ end time for each Mapper from mapreduce's log?
Thanks!
On Mon, Mar 03, 2014 at 11:56:08AM +0530, shashwat shriparv wrote:
Ya its always better to change the temp dir path in hadoop, as it will prevent
deletion of file while the server reboots.
Thanks, so is there anyway to recovery from this state? Or I have to format
namenode again?
--
Thanks,
On Mon, Mar 03, 2014 at 01:57:49PM +0530, shashwat shriparv wrote:
NO need to format just change the value and restart the cluster;
Hmm, seems it doesn't work for me, if the only need to do is to change
to another directory, then why it can not re-init the directory in /tmp
just as another
I will be out of the office starting 03/03/2014 and will not return until
03/06/2014.
I am attending workshops with client till 6th March, there might be delays
in response.
Warm Regards
Dhrubo
We had a DN/NM node that went offline for a while and been removed from the
cluster via Ambari without decommissioning (because it was offline).
When the node came back up, its NM attempted connection to the RM.
Later the RM failed with this exception (dokken is the errant node):
2014-03-03
With the services stopped you would change the setting in core-site.xml:
property
namehadoop.tmp.dir/name
value/var/hadoop/tmp/value
/property
Then move your /tmp/hadoop folder over to the new location:
mv /tmp/hadoop /var/hadoop/tmp
On Mon, Mar 3, 2014 at 5:55 AM, Chengwei Yang
Hello,
Anyone can help regarding the below query.
Regards,
Indrashish
On Sat, 01 Mar 2014 13:52:11 -0500, Basu,Indrashish wrote:
Hello,
I am trying to execute a CUDA benchmark in a Hadoop Framework and
using Hadoop Pipes for invoking the CUDA code which is written in a
C++ interface from
Hi
I even don't know what information to provide but my container log is:
2014-03-03 17:36:05,311 FATAL [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Error starting MRAppMaster
java.lang.VerifyError: class
org.apache.hadoop.yarn.proto.YarnProtos$ApplicationIdProto overrides final
Can you tell us the hadoop release you're using ?
Seems there is inconsistency in protobuf library.
On Mon, Mar 3, 2014 at 8:01 AM, Margusja mar...@roo.ee wrote:
Hi
I even don't know what information to provide but my container log is:
2014-03-03 17:36:05,311 FATAL [main]
Hi
2.2.0 and 2.3.0 gave me the same container log.
A little bit more details.
I'll try to use external java client who submits job.
some lines from maven pom.xml file:
dependency
groupIdorg.apache.hadoop/groupId
artifactIdhadoop-client/artifactId
version2.3.0/version
Thanks Brahma,
That answers my question.
**
Cheers !!!
Siddharth Tiwari
Have a refreshing day !!!
Every duty is holy, and devotion to duty is the highest form of worship of
God.”
Maybe other people will try to limit me but I don't limit myself
From:
Hadoop 2.2.0
CentOS 6.4
Viewing UI in various browsers.
I am having a problem where no information is visible in my Job History UI.
I run test jobs, they complete without error, but no information ever
populates the nodemanager or jobhistory server UI.
Also, there are no job logs generated on
Hi, I believe this is recently fixed in
https://issues.apache.org/jira/browse/YARN-713, and will be part of 2.4.0
release.
Jian
On Mon, Mar 3, 2014 at 5:19 AM, John Lilley john.lil...@redpoint.netwrote:
We had a DN/NM node that went offline for a while and been removed from
the cluster via
Note that node manager will not keep the finished applications and only
show running apps, so the UI won't show the finished apps.
Conversely, job history server UI will only show the finished apps but not
the running apps.
bq. there are no job logs generated on the server that is running the
Thanks for that info Jian.
You said, there are no job logs generated on the server that is running
the job.. So am I correct in assuming the logs will be in the dir
specified by yarn.nodemanager.log-dirs on the datanodes?
I am quite confused as to where the logs for each specific part of the
On Mon, Mar 03, 2014 at 09:03:28AM -0500, JCAD Cell 1 wrote:
With the services stopped you would change the setting in core-site.xml:
property
namehadoop.tmp.dir/name
value/var/hadoop/tmp/value
/property
Then move your /tmp/hadoop folder over to the new location:
mv
which avro version are you using when running outside of hadoop?
Regards,
*Stanley Shi,*
On Mon, Mar 3, 2014 at 11:49 PM, John Pauley john.pau...@threattrack.comwrote:
This is cross posted to avro-user list (
Why you have 2 hadoop version in the same pom file? In this case, you are
not going to know which hadoop class you are actually using.
dependency
groupIdorg.apache.hadoop/groupId
artifactIdhadoop-client/artifactId
version2.3.0/version
/dependency
dependency
Hi
The reason for
org.apache.hadoop.yarn.proto.YarnProtos$ApplicationIdProto overrides final
method getUnknownFields.()Lcom/google/protobuf/UnknownFieldSet is hadoop is
compiled with protoc-2.5.0 version, but in the classpath lower version of
protobuf is present.
1. Check MRAppMaster
You said, there are no job logs generated on the server that is running
the job..
that was quoting your previous sentence and answer your question..
If I were to run a job and I wanted to tail the job log as it was
running, where would I find that log?
1) set
Hi,
I checked out the hadoop trunck from
http://svn.apache.org/repos/asf/hadoop/common/trunk.
I set up protobuf-2.5.0 and then did mvn build.
mvn clean install -DskipTests .. worked well. Maven build was Successful.
So, I tried importing the project into eclipse.
It is showing errors in
Have you run the following command under the root of your workspace ?
mvn eclipse:eclipse
On Mar 3, 2014, at 9:18 PM, nagarjuna kanamarlapudi
nagarjuna.kanamarlap...@gmail.com wrote:
Hi,
I checked out the hadoop trunck from
http://svn.apache.org/repos/asf/hadoop/common/trunk.
I set up
Hi Ted,
I didn't do that earlier.
Now , I did it
mvn:eclipse eclipse
and tried importing the projects same into eclipse. Now, this is throwing
the following errors
1. No marketplace entries found to handle Execution compile-protoc, in
hadoop-common/pom.xml in Eclipse. Please see Help for
Have you installed protobuf on your computer?
https://code.google.com/p/protobuf/downloads/list
On Tue, Mar 4, 2014 at 3:08 PM, nagarjuna kanamarlapudi
nagarjuna.kanamarlap...@gmail.com wrote:
Hi Ted,
I didn't do that earlier.
Now , I did it
mvn:eclipse eclipse
and tried importing
24 matches
Mail list logo
