Using 2.4 hadoop version - Thinking in a future deployment in AWS (EC2)

Hi people, i'm new on this user list, and i need help! I'm starting with hadoop recently, and i'm trying to use it with giraph. So, for building giraph, i choose the 2.4 release of hadoop (because according to this link

Re: Using 2.4 hadoop version - Thinking in a future deployment in AWS (EC2)

to EMR. It’s always important to get this type of feedback from our customers so we can provide what they want, so thanks for reaching out. Craig AWS 2015-03-28 19:19 GMT-03:00 José Luis Larroque : > Hi people, i'm new on this user list, and i need help! > > I'm starting with

mapred.job.id is deprecated. Instead, use mapreduce.job.id

Hi guys, i was removing some warnings for deprecated properties from my hadoop cluster, but i find this interesting warning when my cluster it's initializing: *mapred.job.id is deprecated. Instead, use mapreduce.job.id * But i can't find this proper

Use of hadoop in AWS - Build it from scratch on a EC2 instance / MapR hadoop distribution / Amazon hadoop distribution

Hi all ! I started to use hadoop with aws, and a big question appears in front of me! I'm using a MapR distribution, for hadoop 2.4.0 in AWS. I already tried some trivial examples, and before moving forward i have one question. What is the better option for using Hadoop on AWS? - Build it from s

Re: Use of hadoop in AWS - Build it from scratch on a EC2 instance / MapR hadoop distribution / Amazon hadoop distribution

h on EC2. > -Do you need to run on many nodes or just a 1 node to test some Mapreduce > scripts on a small data set? > > Regards, > > Anders > > > > > On Sun, Oct 18, 2015 at 10:03 PM, José Luis Larroque < > larroques...@gmail.com> wrote: > >> Hi

Re: Use of hadoop in AWS - Build it from scratch on a EC2 instance / MapR hadoop distribution / Amazon hadoop distribution

time when we did this and >> this was at the beginning of this year and they supported Hadoop 2.6. >> >> In my honest opinion you are giving yourself a lot of extra work for >> nothing to get us in Hadoop. Try out emr with temporary cluster and go from >> there. I ma

Can't run hadoop examples with YARN Single node cluster

Hi there, i'm currently running a single node yarn cluster, hadoop 2.4.0, and for some reason, i can't execute even a example that comes with map reduce (grep, wordcount, etc). With this line i execute grep: $HADOOP_HOME/bin/yarn jar /usr/local/hadoop/share/hadoop/yarn/lib/hadoop-mapreduce-exa

Re: Can't run hadoop examples with YARN Single node cluster

27;m not sure. Bye! Jose 2016-01-16 19:41 GMT-03:00 Namikaze Minato : > Hello José Luis Larroque. > > Your problem here is only that grep is returning a non-zero exit code > when no occurences are found. > I know that for spark-streaming, using the option "-jobconf > s

Re: Can't run hadoop examples with YARN Single node cluster

Hi guys, thanks for your answers. Wordcount logs: 16/01/19 21:58:32 INFO client.RMProxy: Connecting to ResourceManager at hdnode01/192.168.0.10:8050 SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/usr/local/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.5.

Redefine yarn.application.classpath value

Hi guys! i have a Ubuntu 14.04 LTS, with a hadoop 2.4.0 single node cluster. When i execute yarn classpath on console, gives me this: /usr/local/hadoop/etc/hadoop:/usr/local/hadoop/etc/hadoop:/usr/local/hadoop/etc/hadoop:/usr/local/hadoop/share/hadoop/common/lib/*:/usr/local/hadoop/share/hadoop/c

Re: Redefine yarn.application.classpath value

HADOOP_CONF_DIR:-"/usr/local/hadoop/etc/hadoop"} But it isn't working, the classpath remains the same. I tried removing it, but was the same anyway. Please!!! any help would be greatly appreciated. Bye! Jose 2016-01-30 13:42 GMT-03:00 José Luis Larroque : > Hi guys! > > i

Re: Redefine yarn.application.classpath value

depending how you installed everything on Ubuntu, > take a look also into yarn-env.sh, and inside > /etc/default/${whateveryarnorhadoopfile}. > > However, I would personally expect it to be in yarn-env.sh. > > Cheers > > On Sun, Feb 7, 2016 at 2:02 AM José Luis Larroque &g

Re: EC2 Hadoop Cluster VS Amazon EMR

Hi Jonathan! I was trying to know which of those options use a time ago. For now i'm using Amazon EMR, because it's more easy, you have some stuff configurated already. But, a few benefits could be that, with EC2, you can use the Free tier, and save some money while you are testing your stuff. An

Lease renewer daemon for [] with renew id 1 exited

Hi guys! I have a yarn app (a Giraph one for being more precise) that gives this error on containers when run in DEBUG mode: 16/08/30 00:48:56 DEBUG hdfs.LeaseRenewer: Lease renewer daemon for [] with renew id 1 executed 16/08/30 00:48:56 DEBUG hdfs.LeaseRenewer: Lease renewer daemon for [] with