Re: [OpenAFS] Add new fileserver
On Apr 12, 2007, at 10:19 AM, chas williams - CONTRACTOR wrote: In message <[EMAIL PROTECTED]>,Steve Simmons write s: You also comment that multihomed cells would be listed more than once. Yes, uniq-ifying them would be good. Can you point me at a cell to test against? yeah, i said unique but after thinking about it, there is no requirement that the reverse addresses of the servers have to be the same (although since we run krb it is a requirement here). i think using - printuuid might be the right solution. % vos listaddrs -printuuid -noresolve UUID: 009796ae-b44b-1290-94-25-460acf86aa77 134.207.10.70 134.207.12.70 ... Nice. Update version attached. This weeds multi-homed hosts to a single ref, allows cell to be specified on command line. Anybody who uses this - if you get long pauses, you've got old (dead) fileservers left in your list. Do 'vos changeaddr -remove' to each, and this'll run really fast. For the 18-odd umich servers it takes under a second. Otherwise you get about 60 seconds hang per down server. Steve afsdf Description: Binary data
Re: [OpenAFS] Add new fileserver
On Thursday, April 12, 2007 10:41:28 AM -0500 "Christopher D. Clausen" <[EMAIL PROTECTED]> wrote: chas williams - CONTRACTOR <[EMAIL PROTECTED]> wrote: In message <[EMAIL PROTECTED]>,Steve Simmons write s: my servers dont start with afs. is this a common thing? Most cells I've seen do that. But that particular line is a umich-ism that ought to be taken out. looking at CellServDB i wouldnt say most. Well, certain cells might have a different entry in the CellServDB versus various CNAMES that are used locally. [EMAIL PROTECTED] C:\>vos listaddrs cac.illigal.uiuc.edu gcs.illigal.uiuc.edu ial.illigal.uiuc.edu [EMAIL PROTECTED] C:\>@for /l %i in (1,1,3) do @vos partinfo file%i.illigal.uiuc.edu Free space on partition /vicepa: 6603356 K blocks out of total 6636464 Free space on partition /vicepa: 8994296 K blocks out of total 9125772 Free space on partition /vicepa: 278516032 K blocks out of total 279261540 Free space on partition /vicepb: 547315572 K blocks out of total 547446812 Free space on partition /vicepc: 575637588 K blocks out of total 602187124 (In this instance, I have AFS servers prefixed with file instead of afs.) One well-known cell uses 'vice'. My fileservers are apple, cranberry, grape, tomato, orange, date, fig, plum, apricot, cherry, strawberry, pumpkin, kiwi. Another cell I know has servers named ronald-ann, rosebud, and reynelda (with aliases ra, rb, and rc). Then there's the grand.central.org cell, whose servers are named penn.central.org, blueberry.srv.cs.cmu.edu, grand-opening.mit.edu, and andrew.e.kth.se. At yet another site I know, it is possible to tell by looking at a machine's hostname whether it is an AFS fileserver, but only if you know how to parse their rather cryptic hostnames. -- Jeff ___ OpenAFS-info mailing list [EMAIL PROTECTED] https://lists.openafs.org/mailman/listinfo/openafs-info
Re: [OpenAFS] Add new fileserver
chas williams - CONTRACTOR <[EMAIL PROTECTED]> wrote: > In message <[EMAIL PROTECTED]>,Steve > Simmons write s: >>> my servers dont start with afs. is this a common thing? >> >> Most cells I've seen do that. But that particular line is a umich-ism >> that ought to be taken out. > > looking at CellServDB i wouldnt say most. Well, certain cells might have a different entry in the CellServDB versus various CNAMES that are used locally. [EMAIL PROTECTED] C:\>vos listaddrs cac.illigal.uiuc.edu gcs.illigal.uiuc.edu ial.illigal.uiuc.edu [EMAIL PROTECTED] C:\>@for /l %i in (1,1,3) do @vos partinfo file%i.illigal.uiuc.edu Free space on partition /vicepa: 6603356 K blocks out of total 6636464 Free space on partition /vicepa: 8994296 K blocks out of total 9125772 Free space on partition /vicepa: 278516032 K blocks out of total 279261540 Free space on partition /vicepb: 547315572 K blocks out of total 547446812 Free space on partition /vicepc: 575637588 K blocks out of total 602187124 (In this instance, I have AFS servers prefixed with file instead of afs.)
Re: [OpenAFS] Add new fileserver
In message <[EMAIL PROTECTED]>,Steve Simmons write s: >> my servers dont start with afs. is this a common thing? > >Most cells I've seen do that. But that particular line is a umich-ism >that ought to be taken out. looking at CellServDB i wouldnt say most. >You also comment that multihomed cells would be listed more than >once. Yes, uniq-ifying them would be good. Can you point me at a cell >to test against? yeah, i said unique but after thinking about it, there is no requirement that the reverse addresses of the servers have to be the same (although since we run krb it is a requirement here). i think using -printuuid might be the right solution. % vos listaddrs -printuuid -noresolve UUID: 009796ae-b44b-1290-94-25-460acf86aa77 134.207.10.70 134.207.12.70 UUID: 002db428-f79c-1d20-b3-a8-86cf0a45aa77 134.207.10.69 UUID: 0087046a-b6aa-1257-91-9e-440acf86aa77 134.207.10.68 134.207.12.68 five addresses, but only 3 servers. ___ OpenAFS-info mailing list [EMAIL PROTECTED] https://lists.openafs.org/mailman/listinfo/openafs-info
Re: [OpenAFS] Add new fileserver
On Apr 10, 2007, at 2:13 PM, chas williams - CONTRACTOR wrote: In message <[EMAIL PROTECTED]>,Steve Simmons write s: open( FSDATA, "vos listaddrs -noauth |" ); multihomed cells will be listed more than once. perhaps uniq would be helpful here. while ( $server = ) { chomp $server; # I'm not thrilled with this, but it works for us next if $server !~ /^afs/; my servers dont start with afs. is this a common thing? Most cells I've seen do that. But that particular line is a umich-ism that ought to be taken out. otherwise, this script is pretty cool. Thanks. You also comment that multihomed cells would be listed more than once. Yes, uniq-ifying them would be good. Can you point me at a cell to test against? Steve ___ OpenAFS-info mailing list [EMAIL PROTECTED] https://lists.openafs.org/mailman/listinfo/openafs-info
Re: [OpenAFS] Add new fileserver
FTR, At MIT what we used to do (and might STILL do) is make a small volume on every partition (svc.part..) and mount it into /afs//service/partitions. Then you can do: fs df /afs//service/partitions/* And it will tell you how much space you have in your cell. -derek -- Derek Atkins, SB '93 MIT EE, SM '95 MIT Media Laboratory Member, MIT Student Information Processing Board (SIPB) URL: http://web.mit.edu/warlord/PP-ASEL-IA N1NWH [EMAIL PROTECTED]PGP key available ___ OpenAFS-info mailing list OpenAFS-info@openafs.org https://lists.openafs.org/mailman/listinfo/openafs-info
Re: [OpenAFS] Add new fileserver
In message <[EMAIL PROTECTED]>,Steve Simmons write s: >open( FSDATA, "vos listaddrs -noauth |" ); multihomed cells will be listed more than once. perhaps uniq would be helpful here. >while ( $server = ) { > chomp $server; ># I'm not thrilled with this, but it works for us > next if $server !~ /^afs/; my servers dont start with afs. is this a common thing? otherwise, this script is pretty cool. ___ OpenAFS-info mailing list OpenAFS-info@openafs.org https://lists.openafs.org/mailman/listinfo/openafs-info
Re: [OpenAFS] Add new fileserver
On Apr 8, 2007, at 4:39 AM, Chris Huebsch wrote: There is no command "give me all the available space on all of my afs servers". You need to write a little script for that. So space does not combine or sum up. Enjoy. Works on the half-dozen cells I've tried it on. afsdf Description: Binary data
Re: [OpenAFS] Add new fileserver
On Mon, 9 Apr 2007, Steve Devine wrote: You create a volume (vos create) on the server you want to use and then you mount that somewhere (fs mkm). I suggest you create one volume for each user, one for each project etc. And make sure replicate all volumes that need not be updated too often like, root.afs, root.cell, home (in which you mount all user's home volumes) and so on. I would reconsider making home dirs replicas. I don't know how many users you will have but do you want to be releasing their vols all the time? He did not suggest replication user-homes. But it is really recommended not to have a single point of failure mountpoint down to the leaves of the mount-tree. If one has really that much users, that releasing the volume with the mountpoints of the user-volumes has to take place too often, then splitting the content of home to different volumes seems to be a good idea. Chris -- Mitarbeiter an der TU Chemnitz, Fak.f. Informatik, Professur VSR Buero: Str. d. Nationen 62, B204, D-09111 Chemnitz Tel: +49 371 531-31118, Fax: +49 371 531-831118 ___ OpenAFS-info mailing list OpenAFS-info@openafs.org https://lists.openafs.org/mailman/listinfo/openafs-info
Re: [OpenAFS] Add new fileserver
Alexander Boström wrote: sön 2007-04-08 klockan 17:33 +0800 skrev Melvin Wong: But I'm a bit lost on how should I further expand to afs2, afs3 and so on. If I create a home directory for my users on afs1, do I need to create the exact directory on my afs2? You create a volume (vos create) on the server you want to use and then you mount that somewhere (fs mkm). I suggest you create one volume for each user, one for each project etc. And make sure replicate all volumes that need not be updated too often like, root.afs, root.cell, home (in which you mount all user's home volumes) and so on. I would reconsider making home dirs replicas. I don't know how many users you will have but do you want to be releasing their vols all the time? /sd /abo ___ OpenAFS-info mailing list OpenAFS-info@openafs.org https://lists.openafs.org/mailman/listinfo/openafs-info -- Steve Devine Storage Systems Academic Computing & Network Services Michigan State University 506 Computer Center East Lansing, MI 48824-1042 1-517-432-7327 Baseball is ninety percent mental; the other half is physical. - Yogi Berra ___ OpenAFS-info mailing list OpenAFS-info@openafs.org https://lists.openafs.org/mailman/listinfo/openafs-info
RE: [OpenAFS] Add new fileserver
sön 2007-04-08 klockan 17:33 +0800 skrev Melvin Wong: > But I'm a bit lost on how should I further expand to afs2, afs3 and so > on. If I create a home directory for my users on afs1, do I need to > create the exact directory on my afs2? You create a volume (vos create) on the server you want to use and then you mount that somewhere (fs mkm). I suggest you create one volume for each user, one for each project etc. And make sure replicate all volumes that need not be updated too often like, root.afs, root.cell, home (in which you mount all user's home volumes) and so on. /abo ___ OpenAFS-info mailing list OpenAFS-info@openafs.org https://lists.openafs.org/mailman/listinfo/openafs-info
Re: [OpenAFS] Add new fileserver
Chris Huebsch wrote: There is no command "give me all the available space on all of my afs servers". You need to write a little script for that. Here's mine: % which rdf rdf: aliased to fs df /afs/citi.umich.edu/partitions/* To make this work you have to remember to create a tiny volume on every partition and mount it in that directory. In our tiny cell that's easy. Right now we only have one partition. ___ OpenAFS-info mailing list OpenAFS-info@openafs.org https://lists.openafs.org/mailman/listinfo/openafs-info
Re: [OpenAFS] Add new fileserver
On Sun, 8 Apr 2007, Dirk Heinrichs wrote: However, it is not recommended to do this for volumes which should be writeable most of the times (because afs always prefers the read-only volume over the read-write one). This is not the whole story. You can have ro-copies of your users-home-volumes too, but you must provide a rw-path to the home-volume. The most easiest way is to mount the home-volume with the -rw-switch: fs mkmount user.chu /afs/cell/home/chu -rw You can even make the ro-copy available to your users as a kind of "cheap" backup: fs momount user.chu /afs/cell/yesterday/chu (this accesses the ro-clone, if all mountpoints up to /afs are ro-mounts) And you can go even further... If your ro-clones are on a different server, you can recover from a catastrophic system-crash on your rw-server by converting your ro-clone back to a rw-volume. (But it will involve data-loss, if the user changed his/her volume after the last "vos release".) As for the home volumes, I would "vos move" some of them to the other server, so that a failure of one server doesn't affect all users. Yes. That job can be automated by a tool named balancer. Chris -- Mitarbeiter an der TU Chemnitz, Fak.f. Informatik, Professur VSR Buero: Str. d. Nationen 62, B204, D-09111 Chemnitz Tel: +49 371 531-31118, Fax: +49 371 531-831118 ___ OpenAFS-info mailing list OpenAFS-info@openafs.org https://lists.openafs.org/mailman/listinfo/openafs-info
RE: [OpenAFS] Add new fileserver
Hello, On Sun, 8 Apr 2007, Melvin Wong wrote: Tks for replying so fast. Maybe I am not so clear with openafs's concept and I find the openafs guide not really so updated and clear. I execute the commands as you has re: [EMAIL PROTECTED] ~]# vos listaddrs afs1.ben.muveenet afs2.ben.muveenet So. Your second file server is known to your database servers. Fine. [EMAIL PROTECTED] ~]# vos partinfo afs1.ben.muveenet Free space on partition /vicepa: 711420 K blocks out of total 734684 [EMAIL PROTECTED] ~]# vos partinfo afs2.ben.muveenet Free space on partition /vicepa: 948956 K blocks out of total 983080 And both partitions are recognized. I am trying to attain high availability There are many different types of availability out there. You need to know against what problems your infrastructure has to be immune. * Failure of power -> UPS * Failure of one single disk -> Raid 5, 6, 1, 10 * Failure of network -> redundant links * Failure of entire servers -> Replication ... * Failure of anything -> infinite number of copies The more things you want to avoid, the more it costs and the slower it gets (rule of thumb ;-) as well as creating a big distributed storage space (hopefully it can reach 30-40 Tera) with many low-end servers. Even in this situation it depends on the type of data if AFS is the right choice. Will it be - let's say - 10 big files each 2-4 Tera or hundreds of thousands small ones. Can they be grouped in a way or not? What access patterns do you need. Random or more sequentially? I've created the 1st afs server with home directory and the users can login and access their home folder without any problems. But I'm a bit lost on how should I further expand to afs2, afs3 and so on. AFS knows 3 kinds of volumes: read-write (rw), readonly (ro) and backup. For each volume there is only one(!) rw-instance. It is on one single server at exactly one partition. So the largest volume you can have cannot be larger than your largest partition. You can have many (afak 14) ro-clones of each rw-volume. This ro-clones can be distributed all over your servers. And there can be exactly one backup-clone, wich is on the same server as your rw-volume. Creating a ro-clone is done by issuing a special vos-command. Cloning takes time an it is (generally) not recommended to do it too often. Normally intervals of 24 hours are used, more often is possible, but increases the load on your servers. If I create a home directory for my users on afs1, do I need to create the exact directory on my afs2? No. You do not need. In fact you can not ;-) Perhaps there should be a small article on openafs.org, saying what openafs is and what is not... every 2-4 weeks someone is asking the same questions. What about the wiki? Oh there is an FAQ: http://www.dementia.org/twiki/bin/view/AFSLore/GeneralFAQ Chris -- Mitarbeiter an der TU Chemnitz, Fak.f. Informatik, Professur VSR Buero: Str. d. Nationen 62, B204, D-09111 Chemnitz Tel: +49 371 531-31118, Fax: +49 371 531-831118 ___ OpenAFS-info mailing list OpenAFS-info@openafs.org https://lists.openafs.org/mailman/listinfo/openafs-info
Re: [OpenAFS] Add new fileserver
Am Sonntag, 8. April 2007 schrieb Melvin Wong: > [EMAIL PROTECTED] ~]# vos listaddrs > afs1.ben.muveenet > afs2.ben.muveenet > > [EMAIL PROTECTED] ~]# vos partinfo afs1.ben.muveenet > Free space on partition /vicepa: 711420 K blocks out of total 734684 > [EMAIL PROTECTED] ~]# vos partinfo afs2.ben.muveenet > Free space on partition /vicepa: 948956 K blocks out of total 983080 > > I am trying to attain high availability as well as creating a big > distributed storage space (hopefully it can reach 30-40 Tera) with many > low-end servers. I've created the 1st afs server with home directory and > the users can login and access their home folder without any problems. > But I'm a bit lost on how should I further expand to afs2, afs3 and so > on. If I create a home directory for my users on afs1, do I need to > create the exact directory on my afs2? Appreciate for the all the help > given. You can now add read-only replicas for your volumes by using the "vos addsite" command. However, it is not recommended to do this for volumes which should be writeable most of the times (because afs always prefers the read-only volume over the read-write one). As for the home volumes, I would "vos move" some of them to the other server, so that a failure of one server doesn't affect all users. HTH... Dirk pgpYV6m7frAuo.pgp Description: PGP signature
RE: [OpenAFS] Add new fileserver
Hi Alex, Thank you for the quick response. I've managed to setup my 1st afs as what you have mention below and it seems perfectly alright. I've created a home directory (/afs/ben.muveenet/home) for my users and they are able to access it when they login. [EMAIL PROTECTED] ~]# vos exa root.afs -c ben.muveenet -noauth root.afs 536870912 RW 4 K On-line afs1.ben.muveenet /vicepa RWrite 536870912 ROnly 536870913 Backup 0 MaxQuota 5000 K CreationTue Mar 27 20:16:03 2007 CopyTue Mar 27 20:16:03 2007 Backup Never Last Update Tue Mar 27 20:32:38 2007 0 accesses in the past day (i.e., vnode references) RWrite: 536870912 ROnly: 536870913 number of sites -> 2 server afs1.ben.muveenet partition /vicepa RW Site server afs1.ben.muveenet partition /vicepa RO Site But I'm a bit lost on how should I further expand to afs2, afs3 and so on. If I create a home directory for my users on afs1, do I need to create the exact directory on my afs2? I am trying to attain high availability as well as creating a big distributed storage space (hopefully it can reach 30-40 Tera) with many low-end servers. I hope that with openafs, I can create a hugh home directory and keep on adding low-end servers when I run out of space. Many thanks. Regards, Melvin -Original Message- From: Alexander Boström [mailto:[EMAIL PROTECTED] Sent: Sunday, April 08, 2007 5:05 PM To: Melvin Wong Cc: openafs-info@openafs.org Subject: Re: [OpenAFS] Add new fileserver sön 2007-04-08 klockan 15:18 +0800 skrev Melvin Wong: > But the client still see only the 1st afs's vol space when I "fs > diskfree /afs". Must I perform another step or the storage space > should automatically combine once it sync? Is there any guide out > there to help me? Appreciate if someone can guide me. What you see in /afs is the contents of the volume root.afs in your cell. Traditionally, the contents of that volume is a set of mount points to the volume root.cell in each of the different AFS cells you would like to be able to access, including your own cell. These are not Unix mount points, but rather internal to AFS. They can be created like this (assuming the name of your cell is example.com): cd /afs fs mkm -dir example.com -vol root.cell -cell example.com fs mkm -dir .example.com -vol root.cell -cell example.com -rw fs mkm -dir stacken.kth.se -vol root.cell -cell stacken.kth.se fs mkm -dir openafs.org -vol root.cell -cell openafs.org and so on. You probably need to actually create the root.cell volume first, using the vos command. You should also use the vos command to replicate your root.afs and root.cell volumes (and as many other volumes as possible) so they look something like this: $ /usr/sbin/vos exa root.afs -c stacken.kth.se -noauth root.afs 536870912 RW 55 K On-line kexchoklad.stacken.kth.se /vicepa RWrite 536870912 ROnly 0 Backup 536870914 MaxQuota 5000 K CreationMon Sep 15 22:58:37 1997 CopyThu Oct 26 21:25:20 2006 Backup Sun Apr 8 00:58:43 2007 Last Update Mon Jun 27 19:08:13 2005 0 accesses in the past day (i.e., vnode references) RWrite: 536870912 ROnly: 536870913 Backup: 536870914 number of sites -> 3 server kexchoklad.stacken.kth.se partition /vicepa RW Site server kexchoklad.stacken.kth.se partition /vicepa RO Site server fishburger.stacken.kth.se partition /vicepb RO Site Notice how kexchoklad:/vicepa contains both a the RW volume and a RO replica. This is recommended since the extra "copy" isn't really a copy, so it comes essentially without cost. The .example.com directory is there to help you use read-only replication (for redundancy and load balancing), which is highly recommended. After you've created these, you can start adding more volumes and mount points to build a useful directory structure. A typical one looks like this: /afs - Unix mount point of root.afs in stacken.kth.se. /afs/stacken.kth.se - AFS mount point of root.cell in stacken.kth.se /afs/stacken.kth.se/home - AFS mount point of the volume home in stacken.kth.se /afs/stacken.kth.se/home/abo - The volume home.abo in stacken.kth.se /afs/stacken.kth.se/projects - A directory /afs/stacken.kth.se/projects/arla - The volume projects.arla in stacken.kth.se And so on... Now, to answer your question: Each volume can reside on one partition on one server, with multiple read-only replicas of it on all or a subset of all partitions of every server. So to use more servers, you need to create more volumes. /abo
RE: [OpenAFS] Add new fileserver
Hi Chris, Tks for replying so fast. Maybe I am not so clear with openafs's concept and I find the openafs guide not really so updated and clear. I execute the commands as you has re: [EMAIL PROTECTED] ~]# vos listaddrs afs1.ben.muveenet afs2.ben.muveenet [EMAIL PROTECTED] ~]# vos partinfo afs1.ben.muveenet Free space on partition /vicepa: 711420 K blocks out of total 734684 [EMAIL PROTECTED] ~]# vos partinfo afs2.ben.muveenet Free space on partition /vicepa: 948956 K blocks out of total 983080 I am trying to attain high availability as well as creating a big distributed storage space (hopefully it can reach 30-40 Tera) with many low-end servers. I've created the 1st afs server with home directory and the users can login and access their home folder without any problems. But I'm a bit lost on how should I further expand to afs2, afs3 and so on. If I create a home directory for my users on afs1, do I need to create the exact directory on my afs2? Appreciate for the all the help given. Melvin -Original Message- From: Chris Huebsch [mailto:[EMAIL PROTECTED] Sent: Sunday, April 08, 2007 4:40 PM To: Melvin Wong Cc: openafs-info@openafs.org Subject: Re: [OpenAFS] Add new fileserver Hello, On Sun, 8 Apr 2007, Melvin Wong wrote: > I am trying to add a new fileserver to my 1st afs server to increase the > storage space. I did managed to get the 2nd afs server sync with the 1st > afs server. But the client still see only the 1st afs's vol space when I > "fs diskfree /afs". You are asking the wrong question ;-) diskfree shows how much space is left of your quota and the partition your volume is in (and only the rw-version, iirc). You can ask: "vos listaddrs" to show all your fileserver names. And then "vos partinfo $server" for each server. > Must I perform another step or the storage space should automatically > combine once it sync? There is no command "give me all the available space on all of my afs servers". You need to write a little script for that. So space does not combine or sum up. Adding a fileserver is a very simple task: * Install server binaries * create /vicepXX-partitions * start upclient (or copy ThisCell, CellServDB and afs.key to your new server) * start fs-service (bos create fs fs ... - like on the first machine) > Is there any guide out there to help me? It's a bit out of date, but the general steps are still the same http://www.openafs.org/pages/doc/QuickStartUnix/auqbg006.htm Chris -- Mitarbeiter an der TU Chemnitz, Fak.f. Informatik, Professur VSR Buero: Str. d. Nationen 62, B204, D-09111 Chemnitz Tel: +49 371 531-31118, Fax: +49 371 531-831118 ___ OpenAFS-info mailing list OpenAFS-info@openafs.org https://lists.openafs.org/mailman/listinfo/openafs-info
Re: [OpenAFS] Add new fileserver
sön 2007-04-08 klockan 15:18 +0800 skrev Melvin Wong: > But the client still see only the 1st afs's vol space when I "fs > diskfree /afs". Must I perform another step or the storage space > should automatically combine once it sync? Is there any guide out > there to help me? Appreciate if someone can guide me. What you see in /afs is the contents of the volume root.afs in your cell. Traditionally, the contents of that volume is a set of mount points to the volume root.cell in each of the different AFS cells you would like to be able to access, including your own cell. These are not Unix mount points, but rather internal to AFS. They can be created like this (assuming the name of your cell is example.com): cd /afs fs mkm -dir example.com -vol root.cell -cell example.com fs mkm -dir .example.com -vol root.cell -cell example.com -rw fs mkm -dir stacken.kth.se -vol root.cell -cell stacken.kth.se fs mkm -dir openafs.org -vol root.cell -cell openafs.org and so on. You probably need to actually create the root.cell volume first, using the vos command. You should also use the vos command to replicate your root.afs and root.cell volumes (and as many other volumes as possible) so they look something like this: $ /usr/sbin/vos exa root.afs -c stacken.kth.se -noauth root.afs 536870912 RW 55 K On-line kexchoklad.stacken.kth.se /vicepa RWrite 536870912 ROnly 0 Backup 536870914 MaxQuota 5000 K CreationMon Sep 15 22:58:37 1997 CopyThu Oct 26 21:25:20 2006 Backup Sun Apr 8 00:58:43 2007 Last Update Mon Jun 27 19:08:13 2005 0 accesses in the past day (i.e., vnode references) RWrite: 536870912 ROnly: 536870913 Backup: 536870914 number of sites -> 3 server kexchoklad.stacken.kth.se partition /vicepa RW Site server kexchoklad.stacken.kth.se partition /vicepa RO Site server fishburger.stacken.kth.se partition /vicepb RO Site Notice how kexchoklad:/vicepa contains both a the RW volume and a RO replica. This is recommended since the extra "copy" isn't really a copy, so it comes essentially without cost. The .example.com directory is there to help you use read-only replication (for redundancy and load balancing), which is highly recommended. After you've created these, you can start adding more volumes and mount points to build a useful directory structure. A typical one looks like this: /afs - Unix mount point of root.afs in stacken.kth.se. /afs/stacken.kth.se - AFS mount point of root.cell in stacken.kth.se /afs/stacken.kth.se/home - AFS mount point of the volume home in stacken.kth.se /afs/stacken.kth.se/home/abo - The volume home.abo in stacken.kth.se /afs/stacken.kth.se/projects - A directory /afs/stacken.kth.se/projects/arla - The volume projects.arla in stacken.kth.se And so on... Now, to answer your question: Each volume can reside on one partition on one server, with multiple read-only replicas of it on all or a subset of all partitions of every server. So to use more servers, you need to create more volumes. /abo ___ OpenAFS-info mailing list OpenAFS-info@openafs.org https://lists.openafs.org/mailman/listinfo/openafs-info
Re: [OpenAFS] Add new fileserver
Hello, On Sun, 8 Apr 2007, Melvin Wong wrote: I am trying to add a new fileserver to my 1st afs server to increase the storage space. I did managed to get the 2nd afs server sync with the 1st afs server. But the client still see only the 1st afs's vol space when I "fs diskfree /afs". You are asking the wrong question ;-) diskfree shows how much space is left of your quota and the partition your volume is in (and only the rw-version, iirc). You can ask: "vos listaddrs" to show all your fileserver names. And then "vos partinfo $server" for each server. Must I perform another step or the storage space should automatically combine once it sync? There is no command "give me all the available space on all of my afs servers". You need to write a little script for that. So space does not combine or sum up. Adding a fileserver is a very simple task: * Install server binaries * create /vicepXX-partitions * start upclient (or copy ThisCell, CellServDB and afs.key to your new server) * start fs-service (bos create fs fs ... - like on the first machine) Is there any guide out there to help me? It's a bit out of date, but the general steps are still the same http://www.openafs.org/pages/doc/QuickStartUnix/auqbg006.htm Chris -- Mitarbeiter an der TU Chemnitz, Fak.f. Informatik, Professur VSR Buero: Str. d. Nationen 62, B204, D-09111 Chemnitz Tel: +49 371 531-31118, Fax: +49 371 531-831118 ___ OpenAFS-info mailing list OpenAFS-info@openafs.org https://lists.openafs.org/mailman/listinfo/openafs-info