Re: How to get Hadoop Admin job being fresher in Big Data Field?

2015-01-04 Thread Harsh J
You may find this blog post by Gwen S. useful: http://www.pythian.com/blog/hadoop-faq-but-what-about-the-dbas/ On Sat, Jan 3, 2015 at 3:56 AM, Krish Donald gotomyp...@gmail.com wrote: Hi, In this group we have so many experienced people and i wanted to know how to get a job as Hadoop admin

Re: Hadoop testing with 72GB HDD?

2015-01-04 Thread hadoop.support
Yes Amjad, Virtualization is nothing but a layer where you can different instances of Operating systems running on same machine. I don’t see any difference in using real Hardware with Virtualization. One advantage with Virtualization is you can have multiple instances of OS on Same machine

Re: way to add custom udf jar in hadoop 2.x version

2015-01-04 Thread Niels Basjes
Hi, These options: - HIVE_HOME/auxlib - http://stackoverflow.com/questions/14032924/how-to-add-serde-jar - ADD JAR commands in your $HOME/.hiverc file either require IT operations to put my JAR on all nodes OR I cannot share it, Only works on the commandline and it won't work in HUE/Beeswax.

Re: way to add custom udf jar in hadoop 2.x version

2015-01-04 Thread Niels Basjes
I created https://issues.apache.org/jira/browse/HIVE-9252 for this improvement. On Sun, Jan 4, 2015 at 5:16 PM, Niels Basjes ni...@basjes.nl wrote: Hi, These options: - HIVE_HOME/auxlib - http://stackoverflow.com/questions/14032924/how-to-add-serde-jar - ADD JAR commands in your

Re:

2015-01-04 Thread Ted Yu
See http://hadoop.apache.org/mailing_lists.html#User On Sun, Jan 4, 2015 at 9:41 AM, Verma, Indrajeet ive...@innodata.com wrote: unsubscribe This e-mail and any attachments transmitted with it are for the sole use of the intended recipient(s) and may contain confidential , proprietary or

Re: unscubscribe

2015-01-04 Thread Daniel Jankovic
resubscribe :) On Wed, Dec 31, 2014 at 8:22 AM, Ted Yu yuzhih...@gmail.com wrote: Please see http://hadoop.apache.org/mailing_lists.html#User Cheers On Dec 30, 2014, at 11:17 PM, Zarey Chang z2c...@gmail.com wrote: unscubscribe -- Zarey C.Y. Chang

future of labor with machine learning

2015-01-04 Thread Publius
 Hello is there any hope for human jobs wit the future of computerized bot and machine learning taking over huge swaths of the labor pool? will Hadoop jobs come and go in the blink of an eye?

Re: future of labor with machine learning

2015-01-04 Thread mark charts
Don't let looks fool you. Mankind is caught between a rock and a hard place. Yet, humans are creative and industrious and survivors. With that said Hadoop is in the beginning of its Renaissance. The window is short so climb aboard before it's too late. That's what I hope to do.  Unemployed EE

Re: Hadoop testing with 72GB HDD?

2015-01-04 Thread Jeffrey Rodriguez
Yes it can be done through virtualization providing you can setup VMWare in your hardware for example ( you may find other options for virtualizing). If you needed to do a proof of concept though I would advice to go with a cloud vendor like IBM Bluemix or Amazon EC. You may have a better

Unit tests on Hadoop Cluster

2015-01-04 Thread kamaldeep singh
Hi , I'm a beginner to writing unit tests in hadoop. As per https://wiki.apache.org/hadoop/HowToDevelopUnitTests the Hadoop Unit tests are all designed to work on a local machine, rather than a full-scale Hadoop cluster. However i do see the Hadoop-QA

Hadoop testing with 72GB HDD?

2015-01-04 Thread Amjad Syed
Hello, My manager has asked me to do a proof of concept on old HP DL380 G6 Quadcore systems having 12GB RAM and 4*72GB SAS Drives. My question is it possible to make a 2 node hadoop cluster with this hardware? I have read that minimum HDD should be 1TB .

Re: Hadoop testing with 72GB HDD?

2015-01-04 Thread Amjad Syed
Thanks jeffrey, But if i want to do it using Centos 7.0 without virtualization on my machines, is it possible? On Mon, Jan 5, 2015 at 8:45 AM, Jeffrey Rodriguez jeffrey...@gmail.com wrote: Yes it can be done through virtualization providing you can setup VMWare in your hardware for example (

Re: Putting multiple files..

2015-01-04 Thread Cao Yi.曹铱
At the current version(2.6.0), /hadoop fs/ is deprecated, use /hdfs dfs/ instead. Ref: http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/CommandsManual.html 在 2014年12月29日 05:26, Abhishek Singh 写道: Hello Anil, There are 2 ways I'm aware of :- 1) use put command put