Re: Changing dfs.block.size

2011-06-06 Thread Allen Wittenauer
On Jun 6, 2011, at 12:09 PM, J. Ryan Earl wrote: > Hello, > > So I have a question about changing dfs.block.size in > $HADOOP_HOME/conf/hdfs-site.xml. I understand that when files are created, > blocksizes can be modified from default. What happens if you modify the > blocks

Re: Changing dfs.block.size

2011-06-06 Thread J. Ryan Earl
On Mon, Jun 6, 2011 at 3:08 PM, Ayon Sinha wrote: > Do newly created files get the default blocksize and old files remain the > same? Yes > Is there a way to change the blocksize of existing files? I have done this > using copy-out and copy back in script. Couldn't find a short-cut analogous > t

Re: Changing dfs.block.size

2011-06-06 Thread J. Ryan Earl
On Mon, Jun 6, 2011 at 2:56 PM, Marcos Ortiz wrote: > Another advice here, is that you can test the right block size with a > seemed enviroment to your production system, before to deploy the real > system, and then, you can avoid these kinds of changes. > What do you mean by "seemed" environmen

Re: Changing dfs.block.size

2011-06-06 Thread Ayon Sinha
k out my Blog for answers to commonly asked questions. From: J. Ryan Earl To: hdfs-user@hadoop.apache.org Sent: Monday, June 6, 2011 12:09 PM Subject: Changing dfs.block.size Hello, So I have a question about changing dfs.block.size in $HADOOP_HOME/conf

Re: Changing dfs.block.size

2011-06-06 Thread Marcos Ortiz
Another advice here, is that you can test the right block size with a seemed enviroment to your production system, before to deploy the real system, and then, you can avoid these kinds of changes. El 6/6/2011 3:09 PM, J. Ryan Earl escribió: Hello, So I have a question about changing

Re: Changing dfs.block.size

2011-06-06 Thread Marcos Ortiz
rl" wrote: Hello, So I have a question about changing dfs.block.size in $HADOOP_HOME/conf/hdfs-site.xml. I understand that when files are created, blocksizes can be modified from default. What happens if you modify the blocksize of an existing HDFS site? Do newly created files get the def

Re: Changing dfs.block.size

2011-06-06 Thread Jeff Bean
Sorry, that's rep factor and not blocksize. I think you need to copy the files. Sent from my iPhone On Jun 6, 2011, at 12:09 PM, "J. Ryan Earl" wrote: > Hello, > > So I have a question about changing dfs.block.size in > $HADOOP_HOME/conf/hdfs-site.xml. I und

Re: Changing dfs.block.size

2011-06-06 Thread Jeff Bean
hadoop fs -setrep Sent from my iPhone On Jun 6, 2011, at 12:09 PM, "J. Ryan Earl" wrote: > Hello, > > So I have a question about changing dfs.block.size in > $HADOOP_HOME/conf/hdfs-site.xml. I understand that when files are created, > blocksizes can be modified fr

Changing dfs.block.size

2011-06-06 Thread J. Ryan Earl
Hello, So I have a question about changing dfs.block.size in $HADOOP_HOME/conf/hdfs-site.xml. I understand that when files are created, blocksizes can be modified from default. What happens if you modify the blocksize of an existing HDFS site? Do newly created files get the default blocksize