Re: Java version with Hadoop 2.0

2013-10-10 Thread J. Ryan Earl
We recently switched all our productions clusters to JDK7 off the EOL JDK6. The one big gotcha, and this was -not- specifically a problem with the Hadoop framework but you may have issues with your own applications or clients is the with the Java 7 bytecode verifier which can be disabled with

Re: overreplicated blocks are not getting removed

2012-08-07 Thread J. Ryan Earl
Replication factor is per file, and set when written. When you wrote the file, RF was 3. Changing -default- replication factor for new files does not affect existing files. On Tue, Aug 7, 2012 at 10:23 AM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: Hi All, I ended up with

I/O Error on rsync to hdfs-fuse mount

2011-06-09 Thread J. Ryan Earl
Are there any glaring culprits to check for errors like this: receiving incremental file list rsync: failed to set times on /mnt/hdfs/user/hadoop/reports_new: Input/output error (5) rsync: failed to set times on /mnt/hdfs/user/hadoop/reports_new/regenerator_201012: Input/output error (5) rsync:

Re: Changing dfs.block.size

2011-06-06 Thread J. Ryan Earl
On Mon, Jun 6, 2011 at 2:56 PM, Marcos Ortiz mlor...@uci.cu wrote: Another advice here, is that you can test the right block size with a seemed enviroment to your production system, before to deploy the real system, and then, you can avoid these kinds of changes. What do you mean by seemed

problems compiling HDFS FUSE

2011-06-02 Thread J. Ryan Earl
Hello I'm trying to compile HDFS/FUSE for mountable HDFS. When I go through the documented process @ http://wiki.apache.org/hadoop/MountableHDFS I get: BUILD FAILED /home/hadoop/hadoop-0.20.203.0/build.xml:614: The following error occurred while executing this line: