Re: What happens after COMMIT_PENDING?

2011-03-11 Thread Harsh J
Hello, On Wed, Mar 9, 2011 at 3:17 PM, Pedro Costa wrote: > I know that when a task is in COMMIT_PENDING, is requesting something > to the TaskTracker or the JobTracker, for the task become SUCCESSFUL. > But, in detail, I don't know nothing. Can anyone explain in more > details what's happening?

How to generate Value Classes at runtime for Sequence files

2011-03-11 Thread Mapred Learn
Hi, I have some types of data that I have to upload on HDFS as Sequence Files. Initially, I had thought of creating a .jr file at runtime depending on the type of schema and use rcc DDL tool by Hadoop to create these classes and use them. But looking at rcc documentation, I see that it has been d

Re: memory leak in reduce side

2011-03-11 Thread Harsh J
Hello, On Fri, Mar 11, 2011 at 1:18 PM, exception wrote: > What I am trying to do is storing the values from the map side into a list > and doing some computation. Before you attempt this, know how many values you can possibly receive for a grouped key in your reducer. Storing a few values is al