Re: "Big Data" Problem

2016-05-24 Thread Amr Shahin
It sounds very unethical, if i had the choice i wouldn't do it, think however that if you don't then someone else with less moral standards will do On Tue, May 24, 2016 at 1:59 AM, Deepak Goel wrote: > > Hey > > Namaskara~Nalama~Guten Tag~Bonjour > > (Sorry, as this might not be the right questi

Re: HDFS undo Overwriting

2014-06-02 Thread Amr Shahin
There is no built in functionality in HDFS to do this. However, there are some software that can restore the hard-drive to a previous date (they work on the OS level transparent to HDFS), you might wanna try one of those. Not sure how the namenode will react to this though, you could at least get t

Re: Force one mapper per machine (not core)?

2014-01-28 Thread Amr Shahin
-in theory this should work- Find the part of hadoop code that calculates the number of cores and patch it to always return one. [?] On Wed, Jan 29, 2014 at 3:41 AM, Keith Wiley wrote: > Yeah, it isn't, not even remotely, but thanks. > > On Jan 28, 2014, at 14:06 , Bryan Beaudreault wrote: > >

Re: How to learn hadoop follow Tom White

2014-01-22 Thread Amr Shahin
Looks pretty illegal to me as well. On Thu, Jan 23, 2014 at 11:32 AM, Marco Shaw wrote: > I'm pretty sure that site is illegal... > > On Jan 23, 2014, at 3:22 AM, Cooleaf wrote: > > thanks all for comment on my concern. by the way, are those books in the > website are copy right free? > > > >

Re: How to learn hadoop follow Tom White

2014-01-21 Thread Amr Shahin
If you're very new to hadoop you will find this book a bit too complicated. I would suggest starting by something simpler like the beginner's guide ( http://www.amazon.com/Hadoop-Beginners-Guide-Garry-Turkington-ebook/dp/B00BKXQT8S/ref=sr_1_6?s=books&ie=UTF8&qid=1390371397&sr=1-6&keywords=hadoop )

Re: Folder not created using Hadoop Mapreduce code

2013-11-13 Thread Amr Shahin
run hadoop fs -lsr / Could've been created in a location different from where you expected On Thu, Nov 14, 2013 at 10:51 AM, unmesha sreeveni wrote: > no exception Amr. just fail to create . > > > On Thu, Nov 14, 2013 at 12:10 PM, Amr Shahin wrote: > >> Do you get an

Re: Folder not created using Hadoop Mapreduce code

2013-11-13 Thread Amr Shahin
Do you get an exception or it just fails silently ? On Thu, Nov 14, 2013 at 10:27 AM, unmesha sreeveni wrote: > I am trying to create a file with in "in" folder. but when i tried to run > this in cluster i noticed that this "in" folder is not within hdfs. > > why is it so? > > Any thing wrong? >

Re: Help on installing Hadoop-2.2 on fedora-19

2013-11-10 Thread Amr Shahin
For fedora if you just need to install you can use RPM On Mon, Nov 11, 2013 at 6:09 AM, Eng. Husam Qublan wrote: > Dear All, > > I am totally new to Hadoop-2.2 and want your help. I downloaded the > Hadoop.2.2 from this website: > http://mirrors.sonic.net/apache/hadoop/common/hadoop-2.2.0/ > > I

Re: how to monitor hadoop cluster components logs?

2013-11-10 Thread Amr Shahin
For log aggregation in general i used logstash and splunk. Splunk is crazy good but a bit expensive On Mon, Nov 11, 2013 at 6:23 AM, ch huang wrote: > hi,all: > as we know,hadoop cluster has a lot of components ,each has it's own > log,is there any good tools for monitor these logs? >

Re: C++ example for hadoop-2.2.0

2013-11-04 Thread Amr Shahin
both... But I > am not sure just a random guess :-( > > Regards.. > Salman. > > Salman Toor, PhD > salman.t...@it.uu.se > > > > On Nov 4, 2013, at 1:38 PM, Amr Shahin wrote: > > I believe hadoop isn't compatible with 64 architecture. Try installing the

Re: C++ example for hadoop-2.2.0

2013-11-04 Thread Amr Shahin
I believe hadoop isn't compatible with 64 architecture. Try installing the 32 libraries and compile against them. This error (skipping incompatible /home/sztoor/hadoop-2.2.0/lib/native/libhadooppipes.a when searching -lhadooppipes) indicates so On Mon, Nov 4, 2013 at 2:44 PM, Salman Toor wrote:

Re: Implementing a custom hadoop key and value - need Help

2013-11-02 Thread Amr Shahin
Can you share the code? sent from mobile On Nov 1, 2013 7:06 AM, "unmesha sreeveni" wrote: > > thanks Steve Loughran and Amr Shahin > Amr Shahin , i refered " > http://my.safaribooksonline.com/book/databases/hadoop/9780596521974/serialization/id3548156"; > t

Re: Implementing a custom hadoop key and value - need Help

2013-10-31 Thread Amr Shahin
Check this out: http://developer.yahoo.com/hadoop/tutorial/module5.html#writable-notes It shows how to create a customer writable. If you have "hadoop the definitive guide" there is a really good explanation about custom data types. Happy Halloween On Thu, Oct 31, 2013 at 3:03 PM, unmesha sreev

Re: number of map and reduce task does not change in M/R program

2013-10-20 Thread Amr Shahin
g to process... what do you think about this? > > > On Sun, Oct 20, 2013 at 1:49 AM, Amr Shahin wrote: > >> Try running the job locally on a small set of the data and see if it >> takes too long. If so, you map code might have some performance issues >> >>

Re: number of map and reduce task does not change in M/R program

2013-10-19 Thread Amr Shahin
Try running the job locally on a small set of the data and see if it takes too long. If so, you map code might have some performance issues On Sat, Oct 19, 2013 at 9:08 AM, Anseh Danesh wrote: > Hi all.. I have a question.. I have a mapreduce program that get input > from cassandra. my input is