RE: Hadoop Meetup

2011-08-16 Thread rishikesh
Hi Ankit, Kindly please send me your updated resume Thanks Regards Rishi | Associate Recruiter 080--40950825\9620245003 Aim Plus Staffing Solutions | Bangalore | Branches -New Delhi | Chennai www.aimplusstaffing.com -Original Message- From: Ankit Minocha

Re: Hadoop Meetup

2011-08-16 Thread Ankit Minocha
Rishikesh This is regarding a casual meetup for discussing latest happenings in Hadoop, and not a career opportunity, much like a BARCAMP. I would get in touch with you whenever I am looking for work. Thanks Ankit On 16 August 2011 11:49, rishikesh rishik...@aimplusstaffing.com wrote: Hi

RE: Hadoop Meetup

2011-08-16 Thread rishikesh
Ok thanks, Ankit will u give me some reference for Hadoop developer I have a critical requirement Thanks Regards Rishi | Associate Recruiter 080--40950825\9620245003 Aim Plus Staffing Solutions | Bangalore | Branches -New Delhi | Chennai www.aimplusstaffing.com -Original Message-

Re: Hadoop Meetup

2011-08-16 Thread Shahnawaz Saifi
Totally Agree On Tue, Aug 16, 2011 at 12:47 PM, Ted Dunning tdunn...@maprtech.com wrote: Please keep the recruiting to private email and off the list. On Monday, August 15, 2011, rishikesh rishik...@aimplusstaffing.com wrote: Ok thanks, Ankit will u give me some reference for Hadoop

Re: Hadoop Meetup

2011-08-16 Thread Ankit Minocha
Agreed On 16 August 2011 12:52, Shahnawaz Saifi shahsa...@gmail.com wrote: Totally Agree On Tue, Aug 16, 2011 at 12:47 PM, Ted Dunning tdunn...@maprtech.com wrote: Please keep the recruiting to private email and off the list. On Monday, August 15, 2011, rishikesh

Re: hadoop cluster mode not starting up

2011-08-16 Thread Steve Loughran
On 16/08/11 11:02, A Df wrote: Hello All: I used a combination of tutorials to setup hadoop but most seems to be using either an old version of hadoop or only using 2 machines for the cluster which isn't really a cluster. Does anyone know of a good tutorial which setups multiple nodes for a

Re: hadoop cluster mode not starting up

2011-08-16 Thread shanmuganathan.r
Hi Df, I think you didn,t set the conf/slave files in hadoop and bin/* (* - files you specified are not present ). Verified these files in bin directory. The following link is very useful to configure the hadoop in multinode.

Re: hadoop cluster mode not starting up

2011-08-16 Thread A Df
See inline From: Steve Loughran ste...@apache.org To: common-user@hadoop.apache.org Sent: Tuesday, 16 August 2011, 11:08 Subject: Re: hadoop cluster mode not starting up On 16/08/11 11:02, A Df wrote: Hello All: I used a combination of tutorials to setup

Is is possible to use HFTP as input when streaming?

2011-08-16 Thread Chenguang Li
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Hi all, Is it possible to use HFTP input like this: $ hadoop jar hadoop-streaming.jar \ - -input hftp://node1/records \ - -output hdfs://node2/result ... ? I've tried several times with different versions but failed with exceptions thrown as

Re: hadoop cluster mode not starting up

2011-08-16 Thread Shahnawaz Saifi
Hi Df, Can you get : echo $HADOOP_HOME On Tue, Aug 16, 2011 at 3:49 PM, A Df abbey_dragonfor...@yahoo.com wrote: See inline From: Steve Loughran ste...@apache.org To: common-user@hadoop.apache.org Sent: Tuesday, 16 August 2011, 11:08 Subject: Re: hadoop

Re: hadoop cluster mode not starting up

2011-08-16 Thread A Df
I already used a few tutorials as follows: * Hadoop Tutorial on Yahoo Developer network which uses an old hadoop and thus older conf files. * http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/ which only has two nodes and the master acts as

Re: WritableComparable

2011-08-16 Thread Chris White
Are you using a hash partioner? If so make sure the hash value of the writable is not calculated using the hashCode value of the enum - use the ordinal value instead. The hashcode value of an enum is different for each jvm.

Re: hadoop cluster mode not starting up

2011-08-16 Thread shanmuganathan.r
Hi Df, Are you use the IP instead of names in conf/masters and conf/slaves . For running the secondary namenode in separate machine refer the following link http://www.hadoop-blog.com/2010/12/secondarynamenode-process-is-starting.html Regards, Shanmuganathan On Tue,

Re: WritableComparable

2011-08-16 Thread Stan Rosenberg
On Tue, Aug 16, 2011 at 6:14 AM, Chris White chriswhite...@gmail.comwrote: Are you using a hash partioner? If so make sure the hash value of the writable is not calculated using the hashCode value of the enum - use the ordinal value instead. The hashcode value of an enum is different for each

Re: hadoop cluster mode not starting up

2011-08-16 Thread A Df
See inline: From: shanmuganathan.r shanmuganatha...@zohocorp.com To: common-user@hadoop.apache.org Sent: Tuesday, 16 August 2011, 13:35 Subject: Re: hadoop cluster mode not starting up Hi Df,            Are you use the IP instead of names in conf/masters and

Re: How do I add Hadoop dependency to a Maven project?

2011-08-16 Thread W.P. McNeill
Just to make sure I understand, the drop of smartfrog.svn.sourceforge.net is just a build of the latest Hadoop JARs, right? I can't use it as a Maven repository (because it's POM-less).

Re: Why hadoop should be built on JAVA?

2011-08-16 Thread Bill Graham
There was a fairly long discussion on this topic at the beginning of the year FYI: http://search-hadoop.com/m/JvSQe2wNlY11 On Mon, Aug 15, 2011 at 9:00 PM, Chris Song sjh...@gmail.com wrote: Why hadoop should be built in JAVA? For integrity and stability, it is good for hadoop to be

Re: How do I add Hadoop dependency to a Maven project?

2011-08-16 Thread W.P. McNeill
Here is my specific problem: I have a sample word count Hadoop program up on github ( https://github.com/wpm/WordCountTestAdapter) that illustrates unit testing techniques for Hadoop. This code uses the new API. (On my development machine I'm using version 0.20.2) I want to use Maven for its

Re: How do I add Hadoop dependency to a Maven project?

2011-08-16 Thread Joey Echeverria
If you're talking about the org.apache.hadoop.mapreduce.* API, that was introduced in 0.20.0. There should be no need to use the 0.21 version. -Joey On Tue, Aug 16, 2011 at 1:22 PM, W.P. McNeill bill...@gmail.com wrote: Here is my specific problem: I have a sample word count Hadoop program up

NameNode not registering DataNodes for unknown reason

2011-08-16 Thread Adam DeConinck
Hi all, I've been seeing an HDFS issue I don't understand, and I'm hoping someone else has seen this before. I'm currently attempting to set up a simple-stupid Hadoop 0.20.203.0 test cluster on two Dell PE1950s running a minimal installation of RHEL 5.6. The master node, wd0031, is running a

Re: WritableComparable

2011-08-16 Thread Chris White
Can you copy the contents of your parent Writable readField and write methods (not the ones youve already posted) Another thing you could try is if you know you have two identical keys, can you write a unit test to examine the result of compareTo for two instances to confirm the correct behavior

Hadoop Meetup in Sept in Shanghai

2011-08-16 Thread Michael Lv
Hi, We plan to organize a developer meetup to talk about Hadoop and big data during the week of Sept 12 in Shanghai. We'll have presenters from U.S and the topic looks very interesting. Suggestions and presentation by guest are welcome. If you are interested to attend, please reply to this

Re:Hadoop Meetup in Sept in Shanghai

2011-08-16 Thread Daniel,Wu
I'd like to attend, like to hear more about hive At 2011-08-17 07:42:07,Michael Lv luiy.mich...@gmail.com wrote: Hi, We plan to organize a developer meetup to talk about Hadoop and big data during the week of Sept 12 in Shanghai. We'll have presenters from U.S and the topic looks very

Re: Hadoop Meetup in Sept in Shanghai

2011-08-16 Thread Nan Zhu
Hi, I'm interested in it, any more details? Best, Nan On Wed, Aug 17, 2011 at 7:42 AM, Michael Lv luiy.mich...@gmail.com wrote: Hi, We plan to organize a developer meetup to talk about Hadoop and big data during the week of Sept 12 in Shanghai. We'll have presenters from U.S and the

Re: Why hadoop should be built on JAVA?

2011-08-16 Thread Edward Capriolo
This should explain it http://jz10.java.no/java-4-ever-trailer.html . On Tue, Aug 16, 2011 at 1:17 PM, Adi adi.pan...@gmail.com wrote: On Mon, Aug 15, 2011 at 9:00 PM, Chris Song sjh...@gmail.com wrote: Why hadoop should be built in JAVA? For integrity and stability, it is

my hadoop job failed sometimes

2011-08-16 Thread Jianxin Wang
hi, my job runs once ervey day. but it failed sometimes. i checked the log in job tracker. It seems a hdfs error? thanks a lot! 2011-08-16 21:07:13,247 INFO org.apache.hadoop.mapred.TaskInProgress: Error from attempt_201106021431_1719_r_000498_1: org.ap ache.hadoop.ipc.RemoteException:

Re: NameNode not registering DataNodes for unknown reason

2011-08-16 Thread Harsh J
Adam, You've run into a fairly common issue with the 0.20.x release, that of /dev/random being used by the DataNode daemon upon startup, which blocks the input calls until it has enough data to give back. Usually, if your DN machines have some other activity (mouse, keyboard on terminal, etc.),

Re: my hadoop job failed sometimes

2011-08-16 Thread Harsh J
Do you notice anything related in the NameNode logs? One reason for this is that the NameNode may be in safe mode for some reason, but there are many other reasons so the NameNode's log would be the best place to look for exactly why the complete()-op fails. On Wed, Aug 17, 2011 at 8:20 AM,