Hello,
On Fri, Nov 18, 2011 at 10:44 AM, Something Something
wrote:
> Thanks for the reply. Here's another concern we have. Let's say Mapper has
> finished processing 1000 lines from the input file & then the machine goes
> down. I believe Hadoop is smart enough to re-distribute the input spli
Thanks for the reply. Here's another concern we have. Let's say Mapper
has finished processing 1000 lines from the input file & then the machine
goes down. I believe Hadoop is smart enough to re-distribute the input
split that was assigned to this Mapper, correct? After re-assigning will
it rep
Hi,
If you mirror the logic of checking the error condition in both mapper and
reducer (from the counters), you have a higher probability that the job
will fail as early as possible. The mappers are not guaranteed to get the
last updated value of a counter from all the mappers and if it slips thru
Hi Sudhan,
well that was just an example. In reality the situation is slightly more
complex, as its not a single thread but some serious amount of third party
libs that are not fully under my control. While there is a chance that I
can shut these things down in most cases, experience shows that s
If you only need the client to print DEBUG log, please
export HADOOP_ROOT_LOGGER=DEBUG,console
On Thu, Nov 17, 2011 at 10:36 PM, seven garfee wrote:
> hi,all
>when I start a Job,lots of messages are printed on screen,as follows:
>
>Job started: Thu Nov 17 22:15:57 CST 2011
> 11/11/17 22:
hi,all
when I start a Job,lots of messages are printed on screen,as follows:
Job started: Thu Nov 17 22:15:57 CST 2011
11/11/17 22:15:58 WARN snappy.LoadSnappy: Snappy native library is available
11/11/17 22:15:58 INFO util.NativeCodeLoader: Loaded the native-hadoop
library
11/11/17 22:15:58
Who:Dr. Jimmy Lin, University of Maryland,
When: 2 December 2011, 11.00 - 12.00
Where: Amolf, 2nd floor, Science Park 104, Amsterdam
Directions: http://www.amolf.nl/about-amolf/visitor/#c42
Register for this lecture at http://bghadoop.eventbrite.com/. Feel free to
redis
Who:Dr. Jimmy Lin, University of Maryland,
When: 2 December 2011, 11.00 - 12.00
Where: Amolf, 2nd floor, Science Park 104, Amsterdam
Directions: http://www.amolf.nl/about-amolf/visitor/#c42
Register for this lecture at http://bghadoop.eventbrite.com/. Feel free to
redis
Hi Sharad
Great effort. Hats off!.. I'd bring my whole team in. Please fix on
the date as well. I have proposed for December 2nd 4 PM in the meet up.
Please contact me for any assistance as even I'm put up in the same campus.
Thanks a lot!..
Regards
Bejoy K S
-Original Message
Hi Bangalore Area Hadoop Developers and Users,
There is a lot of interest in Hadoop and Big Data space in Bangalore. Many
folks have been asking for Bangalore meetups for long.
I have just created the group here to manage the logistics -
http://www.meetup.com/Bangalore-Hadoop-Meetups
The idea is
10 matches
Mail list logo
