Re: Unable to export hadoop trunk into eclipse

Have you installed protobuf on your computer? https://code.google.com/p/protobuf/downloads/list On Tue, Mar 4, 2014 at 3:08 PM, nagarjuna kanamarlapudi < nagarjuna.kanamarlap...@gmail.com> wrote: > Hi Ted, > > I didn't do that earlier. > > Now , I did it > mvn:eclipse eclipse > and tried impo

Re: Unable to export hadoop trunk into eclipse

Hi Ted, I didn't do that earlier. Now , I did it mvn:eclipse eclipse and tried importing the projects same into eclipse. Now, this is throwing the following errors 1. No marketplace entries found to handle Execution compile-protoc, in hadoop-common/pom.xml in Eclipse. Please see Help for more

Re: Unable to export hadoop trunk into eclipse

Have you run the following command under the root of your workspace ? mvn eclipse:eclipse On Mar 3, 2014, at 9:18 PM, nagarjuna kanamarlapudi wrote: > Hi, > I checked out the hadoop trunck from > http://svn.apache.org/repos/asf/hadoop/common/trunk. > > I set up protobuf-2.5.0 and then did

Unable to export hadoop trunk into eclipse

Hi, I checked out the hadoop trunck from http://svn.apache.org/repos/asf/hadoop/common/trunk. I set up protobuf-2.5.0 and then did mvn build. mvn clean install -DskipTests .. worked well. Maven build was Successful. So, I tried importing the project into eclipse. It is showing errors in pom.xml

Re: Not information in Job History UI

> You said, "there are no job logs generated on the server that is running the job.". that was quoting your previous sentence and answer your question.. > If I were to run a job and I wanted to tail the job log as it was running, where would I find that log? 1) set yarn.nodemanager.delete.debug-de

RE: class org.apache.hadoop.yarn.proto.YarnProtos$ApplicationIdProto overrides final method getUnknownFields

Hi The reason for " org.apache.hadoop.yarn.proto.YarnProtos$ApplicationIdProto overrides final method getUnknownFields.()Lcom/google/protobuf/UnknownFieldSet" is hadoop is compiled with protoc-2.5.0 version, but in the classpath lower version of protobuf is present. 1. Check MRAppMaster

Re: class org.apache.hadoop.yarn.proto.YarnProtos$ApplicationIdProto overrides final method getUnknownFields

Why you have 2 hadoop version in the same pom file? In this case, you are not going to know which hadoop class you are actually using. org.apache.hadoop hadoop-client 2.3.0 org.apache.hadoop hadoop-core 1.2.1 Regards, *Stanley Shi,* O

Re: [hadoop] AvroMultipleOutputs org.apache.avro.file.DataFileWriter$AppendWriteException

which avro version are you using when running outside of hadoop? Regards, *Stanley Shi,* On Mon, Mar 3, 2014 at 11:49 PM, John Pauley wrote: > This is cross posted to avro-user list ( > http://mail-archives.apache.org/mod_mbox/avro-user/201402.mbox/%3ccf3612f6.94d2%25john.pau...@threattrack.

Re: Need help to understand hadoop.tmp.dir

On Mon, Mar 03, 2014 at 09:03:28AM -0500, JCAD Cell 1 wrote: > With the services stopped you would change the setting in core-site.xml: >   >     hadoop.tmp.dir >     /var/hadoop/tmp >   > > Then move your /tmp/hadoop folder over to the new location: > mv /tmp/hadoop /var/hadoop/tmp Thank you,

Re: Not information in Job History UI

Thanks for that info Jian. You said, "there are no job logs generated on the server that is running the job.". So am I correct in assuming the logs will be in the dir specified by yarn.nodemanager.log-dirs on the datanodes? I am quite confused as to where the logs for each specific part of the e

Re: Not information in Job History UI

Note that node manager will not keep the finished applications and only show running apps, so the UI won't show the finished apps. Conversely, job history server UI will only show the finished apps but not the running apps. bq. there are no job logs generated on the server that is running the jo

Re: ResourceManager crash on deleted NM node back from the dead

Hi, I believe this is recently fixed in https://issues.apache.org/jira/browse/YARN-713, and will be part of 2.4.0 release. Jian On Mon, Mar 3, 2014 at 5:19 AM, John Lilley wrote: > We had a DN/NM node that went offline for a while and been removed from > the cluster via Ambari without decommis

Not information in Job History UI

Hadoop 2.2.0 CentOS 6.4 Viewing UI in various browsers. I am having a problem where no information is visible in my Job History UI. I run test jobs, they complete without error, but no information ever populates the nodemanager or jobhistory server UI. Also, there are no job logs generated on th

RE: Huge disk IO on only one disk

Thanks Brahma, That answers my question. ** Cheers !!! Siddharth Tiwari Have a refreshing day !!! "Every duty is holy, and devotion to duty is the highest form of worship of God.” "Maybe other people will try to limit me but I don't limit myself" From: brahmareddy.b

Re: class org.apache.hadoop.yarn.proto.YarnProtos$ApplicationIdProto overrides final method getUnknownFields

Hi 2.2.0 and 2.3.0 gave me the same container log. A little bit more details. I'll try to use external java client who submits job. some lines from maven pom.xml file: org.apache.hadoop hadoop-client 2.3.0 org.apache.hadoop hadoop-core 1.2

Re: class org.apache.hadoop.yarn.proto.YarnProtos$ApplicationIdProto overrides final method getUnknownFields

Can you tell us the hadoop release you're using ? Seems there is inconsistency in protobuf library. On Mon, Mar 3, 2014 at 8:01 AM, Margusja wrote: > Hi > > I even don't know what information to provide but my container log is: > > 2014-03-03 17:36:05,311 FATAL [main] > org.apache.hadoop.mapr

class org.apache.hadoop.yarn.proto.YarnProtos$ApplicationIdProto overrides final method getUnknownFields

Hi I even don't know what information to provide but my container log is: 2014-03-03 17:36:05,311 FATAL [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Error starting MRAppMaster java.lang.VerifyError: class org.apache.hadoop.yarn.proto.YarnProtos$ApplicationIdProto overrides final met

[hadoop] AvroMultipleOutputs org.apache.avro.file.DataFileWriter$AppendWriteException

This is cross posted to avro-user list (http://mail-archives.apache.org/mod_mbox/avro-user/201402.mbox/%3ccf3612f6.94d2%25john.pau...@threattrack.com%3e). Hello all, I’m having an issue using AvroMultipleOutputs in a map/reduce job. The issue occurs when using a schema that has a union of null

Re: Drawbacks of Hadoop Pipes

Hello, Anyone can help regarding the below query. Regards, Indrashish On Sat, 01 Mar 2014 13:52:11 -0500, Basu,Indrashish wrote: Hello, I am trying to execute a CUDA benchmark in a Hadoop Framework and using Hadoop Pipes for invoking the CUDA code which is written in a C++ interface from the

Re: Need help to understand hadoop.tmp.dir

With the services stopped you would change the setting in core-site.xml: hadoop.tmp.dir /var/hadoop/tmp Then move your /tmp/hadoop folder over to the new location: mv /tmp/hadoop /var/hadoop/tmp On Mon, Mar 3, 2014 at 5:55 AM, Chengwei Yang wrote: > On Mon, Mar 03, 2014 at 01:57:

ResourceManager crash on deleted NM node back from the dead

We had a DN/NM node that went offline for a while and been removed from the cluster via Ambari without decommissioning (because it was offline). When the node came back up, its NM attempted connection to the RM. Later the RM failed with this exception (dokken is the errant node): 2014-03-03 05:53

Dhruba is in workshop with client

I will be out of the office starting 03/03/2014 and will not return until 03/06/2014. I am attending workshops with client till 6th March, there might be delays in response. Warm Regards Dhrubo

Re: Need help to understand hadoop.tmp.dir

On Mon, Mar 03, 2014 at 01:57:49PM +0530, shashwat shriparv wrote: > NO need to format just change the value and restart the cluster; Hmm, seems it doesn't work for me, if the only need to do is to change to another directory, then why it can not re-init the directory in /tmp just as another direc

Re: Need help to understand hadoop.tmp.dir

NO need to format just change the value and restart the cluster; *Warm Regards_**∞_* * Shashwat Shriparv* [image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9][image: https://twitter.com/shriparv]

Re: Need help to understand hadoop.tmp.dir

On Mon, Mar 03, 2014 at 11:56:08AM +0530, shashwat shriparv wrote: > Ya its always better to change the temp dir path in hadoop, as it will prevent > deletion of file while the server reboots. Thanks, so is there anyway to recovery from this state? Or I have to format namenode again? -- Thanks, C