Re: hadoop file system browser
Thanks! On Thu, 24 Jan 2008 20:29:20 +0100, Pete Wyckoff <[EMAIL PROTECTED]> wrote: I attached the newest version to: https://issues.apache.org/jira/browse/HADOOP-4 Still a work in progress and any help appreciated. Not much by way of instructions but here are some: 1. download and install fuse and do a modprobe fuse 2. modify fuse_dfs.c¹s Makefile to have the right paths for fuse, hdfs.h and jni 3. ensure you have hadoop in your class path and the jni stuff in your library path 4. mkdir /tmp/hdfs 5. ./fuse_dfs dfs://hadoop_namenode:9000 /tmp/hdfs d Probably will be missing things in your class path and LD_LIBRARY_PATH when you do 5, so just add them and iterate. To run this as production quality, you basically need fuse_dfs in root¹s path and add a line to /etc/fstab. For people interested, I can give you my config line. -- pete On 1/24/08 10:55 AM, "Vetle Roeim" <[EMAIL PROTECTED]> wrote: > -- Using Opera's revolutionary e-mail client: http://www.opera.com/mail/
Re: hadoop file system browser
Yes, please post it again. :) Lack of trash and directory protection shouldn't be an issue for my needs. On Thu, 24 Jan 2008 20:11:26 +0100, Pete Wyckoff <[EMAIL PROTECTED]> wrote: I can post it again, but it doesn¹t include ioctl commands so the trash feature cannot be configured. I can still create a flag and default it to false. And also the directory protection isn¹t configurable so I can set a flag to false. The main directory we protect here is /user/facebook for data (and job :) ) protection purposes. On 1/24/08 10:55 AM, "Vetle Roeim" <[EMAIL PROTECTED]> wrote: > -- Using Opera's revolutionary e-mail client: http://www.opera.com/mail/
Re: hadoop file system browser
Great! Where can I get it? :) On Thu, 24 Jan 2008 19:48:57 +0100, Pete Wyckoff <[EMAIL PROTECTED]> wrote: Right now its tested with 0.14.4. It also includes rmdir, rm, mkdir, mv. I¹ve implemented write, but it has to wait for appends to work in Hadoop because of the Fuse protocol. Our strategy thus far has been to use FUSE on a single box and then NFS export it to other machines. We don¹t do heavy, heavy operations on it, so it isn¹t a performance problem. The things I think are most useful anyway are ls, find, du, mkdir, rmdir, rm and mv none of which tax FUSe much. -- pete On 1/24/08 10:39 AM, "Vetle Roeim" <[EMAIL PROTECTED]> wrote: On Tue, 22 Jan 2008 22:03:03 +0100, Jeff Hammerbacher <[EMAIL PROTECTED]> wrote: > we use FUSE: who wants a gui when you could have a shell? > http://issues.apache.org/jira/browse/HADOOP-4 Does this work with newer versions of Hadoop? [...] -- Using Opera's revolutionary e-mail client: http://www.opera.com/mail/ -- Using Opera's revolutionary e-mail client: http://www.opera.com/mail/
Re: hadoop file system browser
On Tue, 22 Jan 2008 22:03:03 +0100, Jeff Hammerbacher <[EMAIL PROTECTED]> wrote: we use FUSE: who wants a gui when you could have a shell? http://issues.apache.org/jira/browse/HADOOP-4 Does this work with newer versions of Hadoop? [...] -- Using Opera's revolutionary e-mail client: http://www.opera.com/mail/
