Re: Hama Problem

2009-05-22 Thread ykj
Currently in Hama, eigenvalue decomposition is not implement.So In STEP 4, it is hard to migrate it.so I work out an idea to bypass it. before Step 4, I can let L be denseMatrix.when I come to Step 4, I can transform L into submatrix.in Jama,eigenvalue decomposition is support although it

input/output error while setting up superblock

2009-05-22 Thread 신승엽
Hi, I have a problem to use hdfs. I mounted hdfs using fuse-dfs. I created a dummy file for 'Xen' in hdfs and then formated the dummy file using 'mke2fs'. But the operation was faced error. The error message is as follows. [r...@localhost hdfs]# mke2fs -j -F ./file_dumy mke2fs 1.40.2

Re: input/output error while setting up superblock

2009-05-22 Thread Taeho Kang
I don't think HDFS is a good place to store your Xen image file as it will likely be updated/appended frequently in small blocks. With the way HDFS is designed for, you can't quite use it like a regular filesystem (e.g. ones that support frequent small block appends/updates in files). My

Re: Hama Problem

2009-05-22 Thread Edward J. Yoon
Hi, Before consider this, let's talk about your problem and why do you want to use these. If your application isn't huge then I think MPI-based matrix package could be much helpful to you since Hama concept also is the large-scale, not high performance for small matrices. And, Have you tried to

Re: ssh issues

2009-05-22 Thread Pankil Doshi
Well i made ssh with passphares. as the system in which i need to login requires ssh with pass phrases and those systems have to be part of my cluster. and so I need a way where I can specify -i path/to key/ and passphrase to hadoop in before hand. Pankil On Thu, May 21, 2009 at 9:35 PM, Aaron

Re: ssh issues

2009-05-22 Thread Steve Loughran
Pankil Doshi wrote: Well i made ssh with passphares. as the system in which i need to login requires ssh with pass phrases and those systems have to be part of my cluster. and so I need a way where I can specify -i path/to key/ and passphrase to hadoop in before hand. Pankil Well, are trying

Re: ssh issues

2009-05-22 Thread hmarti2
Steve, Security through obscurity is always a good practice from a development standpoint and one of the reasons why tricking you out is an easy task. Please, keep hiding relevant details from people in order to keep everyone smiling. Hal Pankil Doshi wrote: Well i made ssh with passphares.

Can not start task tracker because java.lang.NullPointerException

2009-05-22 Thread Lance Riedel
Version 19.1 with patches: 4780-2v19.patch (Jira 4780) closeAll3.patch (Jira 3998) I have confirmed that https://issues.apache.org/jira/browse/HADOOP-4924patch is in, so that is not the fix. We are having task trackers die every night with a null pointer exception. Usually 2 or so out of 8 (25%

Re: ssh issues

2009-05-22 Thread Edward Capriolo
Pankil, I used to be very confused by hadoop and SSH keys. SSH is NOT required. Each component can be started by hand. This gem of knowledge is hidden away in the hundreds of DIGG style articles entitled 'HOW TO RUN A HADOOP MULTI-MASTER CLUSTER!' The SSH keys are only required by the shell

Re: input/output error while setting up superblock

2009-05-22 Thread Aaron Kimball
More specifically: HDFS does not support operations such as opening a file for write/append after it has already been closed, or seeking to a new location in a writer. You can only write files linearly; all other operations will return a not supported error. You'll also find that random-access

Tutorial on building an AMI

2009-05-22 Thread Saptarshi Guha
Hello, Is there a tutorial available to build an Hadoop AMI (like Cloudera's)? Cloudera has an 18.2 ami and for reasons I understand they can't provide(as of now) AMIs for higher Hadoop versions until they become stable. I would like to create an AMI for 19.2 - so was hoping if there is a guide

Re: Can not start task tracker because java.lang.NullPointerException

2009-05-22 Thread Todd Lipcon
Hi Lance, Is it possible that your mapred.local.dir is in /tmp and you have a cron job that cleans it up at night (default on many systems)? Thanks -Todd On Fri, May 22, 2009 at 9:33 AM, Lance Riedel la...@dotspots.com wrote: Version 19.1 with patches: 4780-2v19.patch (Jira 4780)

Re: Can not start task tracker because java.lang.NullPointerException

2009-05-22 Thread Lance Riedel
Sure, I'll try out 19.2.. but where is it? I don't see it here: http://svn.apache.org/repos/asf/hadoop/core/ (looking under tags) On Fri, May 22, 2009 at 2:11 PM, Todd Lipcon t...@cloudera.com wrote: Hi Lance, It's possible this is related to the other JIRA (HADOOP-5761). If it's not too