Re: Which replication value will be used

[hadoop hive]

Its should pick whatever value you are providing in your api only If in
hdfs-site.XML doesn't have set final in replication parameter.
On Jul 29, 2014 1:26 PM, "Satyam Singh"  wrote:

> Hello,
>
>
>
> I have given dfs.replication=2 in hdfs-site.xml as:
> 
> dfs.replication
> 2
> 
>
> Also, In my application i have used api for wrting in hdfs:
> public FSDataOutputStream create(Path f,
> boolean overwrite,
> int bufferSize,
> short replication,
> long blockSize,
> Progressable progress
> ) throws IOException {
> return this.create(f, FsPermission.getFileDefault().applyUMask(
> FsPermission.getUMask(getConf())), overwrite, bufferSize,
> replication, blockSize, progress);
>   }
>
> here i also given replication as fourth parameter.
>
> So my question is which replication value will be used that we have given
> in api or in hdfs-site.xml
>
>
> Warm Regards,
> Satyam
>

Re: Which replication value will be used

[Nitin Pawar]

first it will check if you have set replication factor in your write call
.. if yes .. it will be respected.
if there is no value for replication in write process, it falls back to
default value in hdfs-site.xml


On Tue, Jul 29, 2014 at 1:25 PM, Satyam Singh 
wrote:

> Hello,
>
>
>
> I have given dfs.replication=2 in hdfs-site.xml as:
> 
> dfs.replication
> 2
> 
>
> Also, In my application i have used api for wrting in hdfs:
> public FSDataOutputStream create(Path f,
> boolean overwrite,
> int bufferSize,
> short replication,
> long blockSize,
> Progressable progress
> ) throws IOException {
> return this.create(f, FsPermission.getFileDefault().applyUMask(
> FsPermission.getUMask(getConf())), overwrite, bufferSize,
> replication, blockSize, progress);
>   }
>
> here i also given replication as fourth parameter.
>
> So my question is which replication value will be used that we have given
> in api or in hdfs-site.xml
>
>
> Warm Regards,
> Satyam
>



-- 
Nitin Pawar

Which replication value will be used

[Satyam Singh]

Hello,



I have given dfs.replication=2 in hdfs-site.xml as:

dfs.replication
2


Also, In my application i have used api for wrting in hdfs:
public FSDataOutputStream create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress
) throws IOException {
return this.create(f, FsPermission.getFileDefault().applyUMask(
FsPermission.getUMask(getConf())), overwrite, bufferSize,
replication, blockSize, progress);
  }

here i also given replication as fourth parameter.

So my question is which replication value will be used that we have 
given in api or in hdfs-site.xml



Warm Regards,
Satyam