Re: How to set mapreduce.input.fileinputformat.split.maxsize for a specific job

2015-05-17 Thread Answer Agrawal
Thanks, Is this the correct way to write ? conf.set(mapreduce.input.fileinputformat.split.maxsize, 102400); or job.getConfiguration().set(mapreduce.input.fileinputformat.split.maxsize, 102400); I think another ways as FileInputFormat.setMaxInputSplitSize(null, 102400); Is this all right ? Are

Re: How to set mapreduce.input.fileinputformat.split.maxsize for a specific job

2015-05-17 Thread Shahab Yunus
What do you think is the type of the property value that you are trying to write? Is it string? Or numeric? Have you check the documentation of the Configuration class that I sent earlier? There are multiple setXXX methods depending on the type of the property value being set:

How to set mapreduce.input.fileinputformat.split.maxsize for a specific job

2015-05-16 Thread Answer Agrawal
Hi, In xmls configuration file of Hadoop-2.x, mapreduce.input.fileinputformat.split.minsize is given which can be set but how to set mapreduce.input.fileinputformat.split.maxsize in xml file. I need to set it in my mapreduce code. Thanks,

Re: How to set mapreduce.input.fileinputformat.split.maxsize for a specific job

2015-05-16 Thread Shahab Yunus
You can either pass them on as command line argument using -D option. Assuming your job is implementing the standard Tool interface: https://hadoop.apache.org/docs/current/api/org/apache/hadoop/util/Tool.html Or you can set them in the code using the various 'set' methods to set key/value values