Re: [ubuntu-in] Distributed File System
Hi, On 22/03/2010, Venkatesh Nandakumar venkates...@gmail.com wrote: If I understood you currently then: Have a server with say /mountpoint and mount multiple client's /freediskspace to it /mountpoint/cli1, /mountpoint/cli2, /mountpoint/cli3.. and have all the clients mount server's /mountpoint to say ~/User? Yes. In this case, I would say that the amount of userspace available to a user is limited. It acts more of a samba like shared-folders where you have read-write permission. So, if a person uses up all the space available on /mountpoint/cli1/mydir he'd have to manually move/create another directory in /mountpoint/cli2/mydir. Which is not ideal. Yes, true. This did not occur to me. :) This is anyway a very simplistic solution to the problem you are looking at. Ilug-c members have suggested GlusterFS and openafs, I'd be looking into it for now, if I receive no other suggestions. (Thanks guys!) Please blog about this or post it to the mailing list once you have the setup, for the benefit of others. Would love to know how this works out. :) -- Ninad S. Pundalik http://twitter.com/ni_nad http://ninadpundalik.co.cc/blog GPG Key Fingerprint: 2DF7 B856 C75E C9F9 0504 C0EF D456 1946 7C45 2C69 -- ubuntu-in mailing list ubuntu-in@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-in
Re: [ubuntu-in] Distributed File System
On 03/22/2010 05:26 PM, BR!j!TH wrote:
Hi,
@Jkhatri
Don't they have any deb build?
brij...@nucoreindia.com mailto:brij...@nucoreindia.com
www.linux-minds.blogspot.com http://www.linux-minds.blogspot.com
On 22 March 2010 17:12, Jkhatri khatri.ja...@gmail.com
mailto:khatri.ja...@gmail.com wrote:
On 03/22/2010 04:55 PM, Venkatesh Nandakumar wrote:
Hi,
We have a lab (Debian+Ubuntu Comps) and we want a very basic
Distributed Files System.
The requirements should be:-
1) Should connect all comps as one huge files system ( or at
least a part of it, for e.g ~/Users folder in all computers). May
have a single server daemon running and multiple client services
(or some other combination)
2) Prefer using native 'cp' 'mv' 'rm' commands. For e.g
Tahoe-LAFS had its own complex set of `tahoe add` commands which
were difficult to use and supported less flags {And no, alias did
not make it any easier to use}
3) Should be dropbox-like in functionality. Drag-Drop using
nautilus should be supported since most of the users are not very
experienced.
4) Windows support is of low priority, but added advantage.
5) Least data redundancy ( and wastage of disk space)
There were a huge number of distributed file systems listed on
wikipedia, and I prefer to get your opinions instead. Especially
from people with prior experience in this regard.
Thanking you in advance!
Venkatesh Nandakumar
Department of Electronics Computer Engineering
Indian Institute of Technology Roorkee
Have a look at this[1].. may be it can help you
[1] http://www.openafs.org/
Regards
--
Jatin Khatri
Web www.khatrijatin.co.nr http://www.khatrijatin.co.nr/
www.fedoraproject.org/wiki/Jatin
http://www.fedoraproject.org/wiki/Jatin
Phone (+91) 98250 20393
Save Paper, Save Environment.**
/*(Plant at least one tree in your life and nurture it !!!)*/
--
ubuntu-in mailing list
ubuntu-in@lists.ubuntu.com mailto:ubuntu-in@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-in
As I know No
I think you have to go for source ( source is available here[1] )
[1] http://dl.openafs.org/dl/openafs/1.4.12/openafs-1.4.12-src.tar.gz
--
Jatin Khatri
Web www.khatrijatin.co.nr http://www.khatrijatin.co.nr/
www.fedoraproject.org/wiki/Jatin http://www.fedoraproject.org/wiki/Jatin
Phone (+91) 98250 20393
Save Paper, Save Environment.**
/*(Plant at least one tree in your life and nurture it !!!)*/
--
ubuntu-in mailing list
ubuntu-in@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-in
Re: [ubuntu-in] Distributed File System
On 03/22/2010 05:26 PM, BR!j!TH wrote:
Hi,
@Jkhatri
Don't they have any deb build?
brij...@nucoreindia.com mailto:brij...@nucoreindia.com
www.linux-minds.blogspot.com http://www.linux-minds.blogspot.com
On 22 March 2010 17:12, Jkhatri khatri.ja...@gmail.com
mailto:khatri.ja...@gmail.com wrote:
On 03/22/2010 04:55 PM, Venkatesh Nandakumar wrote:
Hi,
We have a lab (Debian+Ubuntu Comps) and we want a very basic
Distributed Files System.
The requirements should be:-
1) Should connect all comps as one huge files system ( or at
least a part of it, for e.g ~/Users folder in all computers). May
have a single server daemon running and multiple client services
(or some other combination)
2) Prefer using native 'cp' 'mv' 'rm' commands. For e.g
Tahoe-LAFS had its own complex set of `tahoe add` commands which
were difficult to use and supported less flags {And no, alias did
not make it any easier to use}
3) Should be dropbox-like in functionality. Drag-Drop using
nautilus should be supported since most of the users are not very
experienced.
4) Windows support is of low priority, but added advantage.
5) Least data redundancy ( and wastage of disk space)
There were a huge number of distributed file systems listed on
wikipedia, and I prefer to get your opinions instead. Especially
from people with prior experience in this regard.
Thanking you in advance!
Venkatesh Nandakumar
Department of Electronics Computer Engineering
Indian Institute of Technology Roorkee
Have a look at this[1].. may be it can help you
[1] http://www.openafs.org/
Regards
--
Jatin Khatri
Web www.khatrijatin.co.nr http://www.khatrijatin.co.nr/
www.fedoraproject.org/wiki/Jatin
http://www.fedoraproject.org/wiki/Jatin
Phone (+91) 98250 20393
Save Paper, Save Environment.**
/*(Plant at least one tree in your life and nurture it !!!)*/
--
ubuntu-in mailing list
ubuntu-in@lists.ubuntu.com mailto:ubuntu-in@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-in
have a look at this[1] ...may this can help some how
[1]
http://www.edwardjensen.net/2009/12/03/installing-openafs-and-kerberos-on-ubuntu-9-10/
regards
Take Care
--
Jatin Khatri
Web www.khatrijatin.co.nr http://www.khatrijatin.co.nr/
www.fedoraproject.org/wiki/Jatin http://www.fedoraproject.org/wiki/Jatin
Phone (+91) 98250 20393
Save Paper, Save Environment.**
/*(Plant at least one tree in your life and nurture it !!!)*/
--
ubuntu-in mailing list
ubuntu-in@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-in
Re: [ubuntu-in] Distributed File System
Hi, How tough would it be to implement this on top of sshfs? Mount all the partitions other than root for 'clients' onto a common location on a 'server', and then all the clients can mount that mountpoint and access the entire hierarchy? I have no idea if any problems of recursive nature will happen, but I guess you can worry about it later, as the current set of users is primarily Windows based and we don't expect them to play around with stuff. I've tried doing cyclic mounts between 2 systems, but I was sane enough to not experiment by remounting the mountpoint at the 'server' on to the client again. Because of this, the usual cp, mv, rm and even Nautilus will work flawlessly, as sshfs uses fuse to implement a transparent userspace filesystem, (which is what all FUSE based clients do). Also, transfer is completely secure, as SFTP is used to do the transfers, and you have pretty decent performance over a LAN (wired obviously). I've watched movies and processed images over sshfs without hiccups. You might have to configure fstab and export public keys to the server and vice versa, to allow auto mounting once a machine comes up on the LAN, and write some bash scripts that'll take down the networked file system via ssh/clusterssh/some other suitable program when your server is being shutdown/restarted. These scripts will make the lab guys less reliant on you, as they can operate the whole thing, as call you just for troubleshooting. For Windows support, I could suggest WinSCP on the clients, but I'm not sure if you will be able to use the disk's partition as part of the network. Ninad S. Pundalik http://twitter.com/ni_nad http://ninadpundalik.co.cc/blog GPG Key Fingerprint: 2DF7 B856 C75E C9F9 0504 C0EF D456 1946 7C45 2C69 -- ubuntu-in mailing list ubuntu-in@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-in
Re: [ubuntu-in] Distributed File System
First thing I would suggest is trying to setup a NFS + LDAP kind of setup. This will be not be a distributed setup but rather a file system on central server shared by computers on network. It might be a bit hard to setup but works wonderfully when done. Second thing is glusterfs. I have never used it but just read about it. It is a distributed file system that can encapsulate NFS, SMB and other file systems. Onkar -- ubuntu-in mailing list ubuntu-in@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-in
