Hi,
I am a newbie to Hadoop. I want to use the Multi threaded runner by default,
so I tried to change the MapTask.java code. it failed to compile using ant,
as mapreduce - mapred library conflict was there, Can you please suggest a
way through, so that I can use the same.
Regards,
Jyothish Soman
Hi,
I see "Shuffle and Sort Configuration Tuning" in "Hadoop---The Definitive
Guide", which told me that each job in the same cluster can use different
parameters below without restart the cluster. But some of my partner told me
not. For some reason I have no Linux cluster at hand. I wonder whe
A better way (than holding a static variable) would be to define a
Configuration key-value and use that from within your method to set
the name each time. The Context object can help you retrieve the set
configuration value.
On Thu, Jun 10, 2010 at 6:19 PM, Giridhar Addepalli
wrote:
> Hi,
>
>
>
>
Hadoop 0.21 using the new API. All working.
Then I try to use MultipleOutputs in my reducer:
private MultipleOutputs mos;
protected void setup(Context context) throws IOException,
InterruptedException {
mos = new MultipleOutputs(context);
}
protected String generateFileNa
Hi,
I am using hadoop 0.20.2
Maperduce framework by default writes output to part-r- etc.
I want to write to a file with different name.
I am trying to override "getDefaultWorkFile" method in TextOutputFormat
class.
I am getting following error :
java.lang.IllegalArgumentExceptio
Pedro,
> If I define in mapred-site.xml the property mapred.reduce.tasks to 1, how
> many reduce tasks will actually run? I think it will run 2 and I don't know
> why.
Did you actually notice this happening ? Also, can you give some
information about the cluster where you're running into this pro
