Re: cleanup of data when restarting Tasktracker of Hadoop

[hadoop anis]

Thanks for Replying,

   I am using shared directory to store the data

On 5/29/12, Devaraj k  wrote:
> What is the local directory you are using to store the data?
>
> Thanks
> Devaraj
>
> ________
> From: hadoop anis [hadoop.a...@gmail.com]
> Sent: Tuesday, May 29, 2012 12:29 PM
> To: mapreduce-user@hadoop.apache.org; mapreduce-...@hadoop.apache.org
> Subject: Re: cleanup of data when restarting Tasktracker of Hadoop
>
>   Hi friends,
>
>I am using Hadoop 0.20.2 version.
>>
>
>>In my setup When Tasktracker exits, then data persist on
>> linux filesystem. (I am using Hadoop without HDFS)
>>  but when I restart the tasktracker on that node it cleans all data
>> on
>> it's directory.
>>
>>Is this normal behavior? and what I have to do to persist
>> that data even after restarting of Tasktracker.?
>>please let me know.
>>
>>
>
>
> --
> Regards,
>
> Anis
> Student MTech (Comp.Sci. & Engg)
>


-- 
Regards,

Anis
Student MTech (Comp.Sci. & Engg)

Re: cleanup of data when restarting Tasktracker of Hadoop

[hadoop anis]

  Hi friends,

   I am using Hadoop 0.20.2 version.
>

>In my setup When Tasktracker exits, then data persist on
> linux filesystem. (I am using Hadoop without HDFS)
>  but when I restart the tasktracker on that node it cleans all data on
> it's directory.
>
>Is this normal behavior? and what I have to do to persist
> that data even after restarting of Tasktracker.?
>please let me know.
>
>


-- 
Regards,

Anis
Student MTech (Comp.Sci. & Engg)

cleanup of data when restarting Tasktracker of Hadoop

[hadoop anis]

Friends,

   When Tasktracker exits, then data persist on linux
filesystem. (I am using Hadoop without HDFS)
 but when I restart the tasktracker on that node it cleans all data on
it's directory.

   Is this normal behavior and what I have to do to persist
that data even after restarting of Tasktracker.
   please let me know.

-- 
Regards,

Anis
Student MTech (Comp.Sci. & Engg)

Re: Information regarding completed MapTask

[hadoop anis]

Thanks a lot Sir, it worked.

On Tue, Dec 27, 2011 at 9:47 PM, Arun C Murthy  wrote:

> The reduces get it from the JobTracker. Take a look at
> TaskCompletionEvents.java.
>
> Arun
>
> On Dec 27, 2011, at 1:26 AM, hadoop anis wrote:
>
>
>
> Friends,
>
> I want to know where does information regarding completed MapTask get
> stored?
> i.e. how reduce task know about completed map output data is available on
> which tasktracker?
> what data structure gets maintained to track for the map output data?
>
> If anyone know this please let me know.
>
> --
> Regards,
>
> Anis
> Student MTech (Comp.Sci. & Engg)
>
>
>
>
>
>
>


-- 
Regards,

Anis
Student MTech (Comp.Sci. & Engg)

Information regarding completed MapTask

[hadoop anis]

Friends,

I want to know where does information regarding completed MapTask get
stored?
i.e. how reduce task know about completed map output data is available on
which tasktracker?
what data structure gets maintained to track for the map output data?

If anyone know this please let me know.

-- 
Regards,

Anis
Student MTech (Comp.Sci. & Engg)

Information regarding completed MapTask

[hadoop anis]

Hi, I want to know where has information regarding completed MapTask been
stored?
i.e. how reduce task know about completed map output data is available on
which tasktracker?
please let me know this.

-- 
Regards,

Anis
Student MTech (Comp.Sci. & Engg)

Re: Where JobTracker stores Task'sinformation

[hadoop anis]

 From where Jobtracker takes information regrading which map &
reduce task fails.
 and where it reschedules these map & reduce task (i.e. which
code it executes to reschedule map & reduce task)

On Thu, Dec 15, 2011 at 12:02 AM, Arun C Murthy  wrote:

> Take a look at JobInProgress.java. There is one object per job.
>
> Arun
>
> On Dec 14, 2011, at 1:14 AM, hadoop anis wrote:
>
> >
> >
> >
> >   Hi Friends,
> >   I want to know, where JobTracker stores Task's Information,
> >   i.e.  which task is being executed on which tasktracker, and
> how JobTracker  stores this information.
> >   If anyone know this please let me know it.
> >
> >
> >
> > Regards,
> > Anis
> >
> > M.Tech. Student
> >
>
>

Where JobTracker stores Task'sinformation

[hadoop anis]

  Hi Friends,
  I want to know, where JobTracker stores Task's Information,
  i.e.  which task is being executed on which tasktracker, and how
JobTracker  stores this information.
  If anyone know this please let me know it.



Regards,
Anis

M.Tech. Student