Re: [Gluster-users] Somebody build glusterfs 3.2 with macosx sucessfully
Hi John, So, ist macos X supported as native glusterfs client? Yes or No? Kind Regards Uwe 2011/8/5 John Mark Walker jwal...@gluster.com Hi Luis, Thanks for the clarification. I wasn't referring to the client, but I should have been more specific - I misunderstood the context of the thread. Yes, on the glusterfs client side, we have multiple users and customers happily using Mac OS X. -JM -- *From:* Luis Cerezo [l...@luiscerezo.org] *Sent:* Friday, August 05, 2011 1:09 PM *To:* John Mark Walker *Cc:* Uwe Kastens; gluster-users@gluster.org *Subject:* Re: [Gluster-users] Somebody build glusterfs 3.2 with macosx sucessfully paying customer here and our users will use a mac gluster client. -luis On Aug 5, 2011, at 3:05 PM, John Mark Walker wrote: The official word is that we don't support OSX. However, we would certainly welcome a community effort to help out, if enough people are interested. -JM Portal: http://www.gluster.org/ Get help: http://community.gluster.org/ Report bugs: http://bugs.gluster.com/ -- *From:* gluster-users-boun...@gluster.org [ gluster-users-boun...@gluster.org] on behalf of Uwe Kastens [ kiste...@googlemail.com] *Sent:* Friday, August 05, 2011 12:55 PM *To:* gluster-users@gluster.org *Subject:* Re: [Gluster-users] Somebody build glusterfs 3.2 with macosx sucessfully Looks like there is an fix on github available https://github.com/gluster/glusterfs/commit/e719518e561033af0ffd07d0c8ad7d15fe89#xlators/features/marker/src/marker.h 2011/8/5 paul simpson p...@realisestudio.com any official word here? native gluster on the mac would be great... On 5 August 2011 16:55, Uwe Kastens kiste...@googlemail.com wrote: Hi, there is a open bug which seems to prevent one from compiling on macosx Darwin und Lion. http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3292 2011/8/5 Amar Tumballi a...@gluster.com xcode components. I had worked on a Portfile during 2.0.x time to create a .dmg package. At present we are not working on Mac, and hence not tested in long time. On Fri, Aug 5, 2011 at 3:32 PM, Uwe Kastens kiste...@googlemail.com wrote: Hi, Are you using the xcode components (gcc, make) or ports? Regards Uwe ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users Luis E. Cerezo http://www.luiscerezo.org http://twitter.com/luiscerezo http://flickr.com/photos/luiscerezo photos for sale: http://photos.luiscerezo.org Voice: 412 223 7396 ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
[Gluster-users] HW raid or not
Hi, I know, that there is no general answer to this question :) Is it better to use HW Raid or LVM as gluster backend or raw disks? Regards Uwe ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] HW raid or not
I am using raid 5 1 spare disk without any problem on centos 5.6 EDV Daniel Müller Leitung EDV Tropenklinik Paul-Lechler-Krankenhaus Paul-Lechler-Str. 24 72076 Tübingen Tel.: 07071/206-463, Fax: 07071/206-499 eMail: muel...@tropenklinik.de Internet: www.tropenklinik.de Von: gluster-users-boun...@gluster.org [mailto:gluster-users-boun...@gluster.org] Im Auftrag von Uwe Kastens Gesendet: Montag, 8. August 2011 08:55 An: Gluster-users@gluster.org Betreff: [Gluster-users] HW raid or not Hi, I know, that there is no general answer to this question :) Is it better to use HW Raid or LVM as gluster backend or raw disks? Regards Uwe ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
[Gluster-users] scrub as in zfs
Hi again, If one thinks about a large amount of data, maybe as a replacement for tapes. Will auto heal of gluster help with data corruption problems? I would expect that, but only, if the files are accessed on a regular basis. As far as I have seen, there is no regular scrub mechanism like in zfs? Kind Regards Uwe Kastens kiste...@googlemail.com ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
[Gluster-users] How to disable the self-heal?
HI ALL: I find a problem when testing the replication volume . There are two node with the replication volume and I off one of them .Everything is ok. And then I recover the power-off node. The self-heal will be triggered. The file in the recovering node will be locked .And most IO are used in the self-heal. I'd like to disable the self-heal to solve this problem. Tell me how to do . Thanks Add: Rm.2503, CITY Gateway, No. 398 Caoxi Road North. Shanghai, China 20030 Mobile: +86-136-0195-0405 Tel:+82-21-24193010 Tel:+86-21-33688277 Fax: +86-21-33688012 Email: mailto:c...@netopcomputing.com lih...@netopcomputing.com Http: http://www.netopcomputing.com/ www.netopcomputing.com Easy Supercomputing Easy Visualization. ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] scrub as in zfs
On Monday 08 August 2011 01:30 PM, Uwe Kastens wrote: Hi again, If one thinks about a large amount of data, maybe as a replacement for tapes. Will auto heal of gluster help with data corruption problems? I would expect that, but only, if the files are accessed on a regular basis. As far as I have seen, there is no regular scrub mechanism like in zfs? Right. Not for now. With proative/Background self-heal, you will get something similar to that. Stay tuned. Pavan Kind Regards Uwe Kastens kiste...@googlemail.com ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Somebody build glusterfs 3.2 with macosx sucessfully
Also very keen to hear the answer to this... On Aug 8, 2011 7:43 AM, Uwe Kastens kiste...@googlemail.com wrote: Hi John, So, ist macos X supported as native glusterfs client? Yes or No? Kind Regards Uwe 2011/8/5 John Mark Walker jwal...@gluster.com Hi Luis, Thanks for the clarification. I wasn't referring to the client, but I should have been more specific - I misunderstood the context of the thread. Yes, on the glusterfs client side, we have multiple users and customers happily using Mac OS X. -JM -- *From:* Luis Cerezo [l...@luiscerezo.org] *Sent:* Friday, August 05, 2011 1:09 PM *To:* John Mark Walker *Cc:* Uwe Kastens; gluster-users@gluster.org *Subject:* Re: [Gluster-users] Somebody build glusterfs 3.2 with macosx sucessfully paying customer here and our users will use a mac gluster client. -luis On Aug 5, 2011, at 3:05 PM, John Mark Walker wrote: The official word is that we don't support OSX. However, we would certainly welcome a community effort to help out, if enough people are interested. -JM Portal: http://www.gluster.org/ Get help: http://community.gluster.org/ Report bugs: http://bugs.gluster.com/ -- *From:* gluster-users-boun...@gluster.org [ gluster-users-boun...@gluster.org] on behalf of Uwe Kastens [ kiste...@googlemail.com] *Sent:* Friday, August 05, 2011 12:55 PM *To:* gluster-users@gluster.org *Subject:* Re: [Gluster-users] Somebody build glusterfs 3.2 with macosx sucessfully Looks like there is an fix on github available https://github.com/gluster/glusterfs/commit/e719518e561033af0ffd07d0c8ad7d15fe89#xlators/features/marker/src/marker.h 2011/8/5 paul simpson p...@realisestudio.com any official word here? native gluster on the mac would be great... On 5 August 2011 16:55, Uwe Kastens kiste...@googlemail.com wrote: Hi, there is a open bug which seems to prevent one from compiling on macosx Darwin und Lion. http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3292 2011/8/5 Amar Tumballi a...@gluster.com xcode components. I had worked on a Portfile during 2.0.x time to create a .dmg package. At present we are not working on Mac, and hence not tested in long time. On Fri, Aug 5, 2011 at 3:32 PM, Uwe Kastens kiste...@googlemail.com wrote: Hi, Are you using the xcode components (gcc, make) or ports? Regards Uwe ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users Luis E. Cerezo http://www.luiscerezo.org http://twitter.com/luiscerezo http://flickr.com/photos/luiscerezo photos for sale: http://photos.luiscerezo.org Voice: 412 223 7396 ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Somebody build glusterfs 3.2 with macosx sucessfully
The current releases do not support native gluster client on Mac OS. Please use NFS for now. Avati On Mon, Aug 8, 2011 at 2:39 PM, paul simpson p...@realisestudio.com wrote: Also very keen to hear the answer to this... On Aug 8, 2011 7:43 AM, Uwe Kastens kiste...@googlemail.com wrote: Hi John, So, ist macos X supported as native glusterfs client? Yes or No? Kind Regards Uwe 2011/8/5 John Mark Walker jwal...@gluster.com Hi Luis, Thanks for the clarification. I wasn't referring to the client, but I should have been more specific - I misunderstood the context of the thread. Yes, on the glusterfs client side, we have multiple users and customers happily using Mac OS X. -JM -- *From:* Luis Cerezo [l...@luiscerezo.org] *Sent:* Friday, August 05, 2011 1:09 PM *To:* John Mark Walker *Cc:* Uwe Kastens; gluster-users@gluster.org *Subject:* Re: [Gluster-users] Somebody build glusterfs 3.2 with macosx sucessfully paying customer here and our users will use a mac gluster client. -luis On Aug 5, 2011, at 3:05 PM, John Mark Walker wrote: The official word is that we don't support OSX. However, we would certainly welcome a community effort to help out, if enough people are interested. -JM Portal: http://www.gluster.org/ Get help: http://community.gluster.org/ Report bugs: http://bugs.gluster.com/ -- *From:* gluster-users-boun...@gluster.org [ gluster-users-boun...@gluster.org] on behalf of Uwe Kastens [ kiste...@googlemail.com] *Sent:* Friday, August 05, 2011 12:55 PM *To:* gluster-users@gluster.org *Subject:* Re: [Gluster-users] Somebody build glusterfs 3.2 with macosx sucessfully Looks like there is an fix on github available https://github.com/gluster/glusterfs/commit/e719518e561033af0ffd07d0c8ad7d15fe89#xlators/features/marker/src/marker.h 2011/8/5 paul simpson p...@realisestudio.com any official word here? native gluster on the mac would be great... On 5 August 2011 16:55, Uwe Kastens kiste...@googlemail.com wrote: Hi, there is a open bug which seems to prevent one from compiling on macosx Darwin und Lion. http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3292 2011/8/5 Amar Tumballi a...@gluster.com xcode components. I had worked on a Portfile during 2.0.x time to create a .dmg package. At present we are not working on Mac, and hence not tested in long time. On Fri, Aug 5, 2011 at 3:32 PM, Uwe Kastens kiste...@googlemail.com wrote: Hi, Are you using the xcode components (gcc, make) or ports? Regards Uwe ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users Luis E. Cerezo http://www.luiscerezo.org http://twitter.com/luiscerezo http://flickr.com/photos/luiscerezo photos for sale: http://photos.luiscerezo.org Voice: 412 223 7396 ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Fwd: nfs.rpc-auth-allow : not working in 3.2.1 (but two patches fix that)
Hello, Just wanted an update on this one . We submitted a patch for that against 3.1 then again against 3.2.0 and 3.2.1 But it seems that you keep forgetting it in the next release . This is a claimed feature, it is listed in the documentation, in the wiki, in the web site. But it is just not working. And has never been. Why can't this be fixed for once especially when you look at the patch: A typo ( - instead of. ) seriously can't you get it throught to the trunk. So what is the status of this bug ? Is it going to be fixed in 3.3 ? Are you going to test it ? Thanks -- Benjamin Cleyet-Marrel http://outsourcing.openwide.fr On 01/08/2011 11:10, Cedric Lagneau wrote: same in 3.2.2. i.e. #gluster volume set preprod nfs.rpc-auth-allow 192.168.10.* : not working, *ANY* nfs client ips can mount the volume. we have submit a patch, then use patch from others. But why i'ts not commited to a release ? wiki explain this feature. thanks, - Mail transféré - Hi, I'm back with nfs.rpc-auth-allow not working in all glusterfs version. This two patches have fixed issue in 3.2.0: http://patches.gluster.com/patch/7104/ http://patches.gluster.com/patch/7233/ They have not be commited to 3.2.1 so nfs.rpc-auth-allow is broken for now. To fix that i need to apply: __patches 7104__ adapted to 3.2.1: # diff -u glusterd-volgen.c.3.2.1 glusterd-volgen.c.ok --- glusterd-volgen.c.3.2.1 2011-06-15 17:18:43.0 +0200 +++ glusterd-volgen.c.ok2011-06-15 17:18:09.0 +0200 @@ -1622,7 +1622,7 @@ if ( !volinfo || !volinfo-volname) return 0; -if (! strcmp (vme-option, !nfs.rpc-auth-addr-allow)) { +if (! strcmp (vme-option, !nfs.rpc-auth.addr.allow)) { ret = gf_asprintf (aa, rpc-auth.addr.%s.allow, volinfo-volname); @@ -1635,7 +1635,7 @@ return -1; } -if (! strcmp (vme-option, !nfs.rpc-auth-addr-reject)) { +if (! strcmp (vme-option, !nfs.rpc-auth.addr.reject)) { ret = gf_asprintf (aa, rpc-auth.addr.%s.reject, volinfo-volname); __patches 7233__ as it because there are no change in xlators/nfs/lib/src/rpcsvc.c file between 3.2.0 and 3.2.1. Why this two patches have not been commited in 3.2.1 release ? thanks, regards, -- Cédric Lagneau ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] HW raid or not
We use raw disks with our setup. Gluster takes care of the replication part, so RAID would be useless for us. Performance wise, you are better off just adding a new brick and let gluster do the rest. Best regards, Gabriel On Mon, Aug 8, 2011 at 9:54 AM, Uwe Kastens kiste...@googlemail.com wrote: Hi, I know, that there is no general answer to this question :) Is it better to use HW Raid or LVM as gluster backend or raw disks? Regards Uwe ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] scrub as in zfs
On 08/08/2011 04:00 AM, Uwe Kastens wrote: Hi again, If one thinks about a large amount of data, maybe as a replacement for tapes. Will auto heal of gluster help with data corruption problems? I would expect that, but only, if the files are accessed on a regular basis. As far as I have seen, there is no regular scrub mechanism like in zfs? In hardware and software RAID, this mechanism exists. -- Joseph Landman, Ph.D Founder and CEO Scalable Informatics, Inc. email: land...@scalableinformatics.com web : http://scalableinformatics.com http://scalableinformatics.com/sicluster phone: +1 734 786 8423 x121 fax : +1 866 888 3112 cell : +1 734 612 4615 ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] HW raid or not
On Mon, 8 Aug 2011, Uwe Kastens wrote: Hi, I know, that there is no general answer to this question :) Is it better to use HW Raid or LVM as gluster backend or raw disks? HW Raid. Nathan StrattonCTO, BlinkMind, Inc. nathan at robotics.net nathan at blinkmind.com http://www.robotics.nethttp://www.blinkmind.com ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] HW raid or not
I would agree with this. While GlusterFS mirroring is good on a server to server level, it's not as robust (provably on my installation) as HW RAID due to continuing GlusterFS issues with replication and extended attributes (through versions 3.2.2). That's not to say that the server replication is rubbish - it's just that there are edge cases for which bugs have already been submitted that affect file integrity from a mounted GlusterFS point of view. James Burnash Unix Engineer Knight Capital Group -Original Message- From: gluster-users-boun...@gluster.org [mailto:gluster-users-boun...@gluster.org] On Behalf Of Nathan Stratton Sent: Monday, August 08, 2011 11:04 AM To: Uwe Kastens Cc: Gluster-users@gluster.org Subject: Re: [Gluster-users] HW raid or not On Mon, 8 Aug 2011, Uwe Kastens wrote: Hi, I know, that there is no general answer to this question :) Is it better to use HW Raid or LVM as gluster backend or raw disks? HW Raid. Nathan StrattonCTO, BlinkMind, Inc. nathan at robotics.net nathan at blinkmind.com http://www.robotics.nethttp://www.blinkmind.com ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users DISCLAIMER: This e-mail, and any attachments thereto, is intended only for use by the addressee(s) named herein and may contain legally privileged and/or confidential information. If you are not the intended recipient of this e-mail, you are hereby notified that any dissemination, distribution or copying of this e-mail, and any attachments thereto, is strictly prohibited. If you have received this in error, please immediately notify me and permanently delete the original and any copy of any e-mail and any printout thereof. E-mail transmission cannot be guaranteed to be secure or error-free. The sender therefore does not accept liability for any errors or omissions in the contents of this message which arise as a result of e-mail transmission. NOTICE REGARDING PRIVACY AND CONFIDENTIALITY Knight Capital Group may, at its discretion, monitor and review the content of all e-mail communications. http://www.knight.com ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
[Gluster-users] help! - cant bring 1 of 4 servers up..
hi gluster gurus, i have 4 servers g1,g2,g3 g4 with 24T each running gluster 3.1.5 on opensuse 11.3. they have been running well for the last few months in a distributed+replicated setup. i just found that the nfs log had filled up my root disk of g4 (my bad). so, i removed the log file - and a couple of other large ones and restored a load of disk space. however, gluster 3.1.5 will not restart on this machine!! it err's out with http://pastebin.com/646W8zjg i've searched this forum, and searched the documentation. however, i cant see anything that mentions this situation. please can anyone help - i'm quite concerned about my system. this is a live server with live data. i need to get g4 up and running and back into sync ASAP. many thanks in advance, -paul ps - the following command just hangs: g4:~ # gluster peer status ..however, on g3 it works: g3:/etc/glusterd/logs # gluster peer status Number of Peers: 3 Hostname: 10.0.0.12 Uuid: 8061196e-a075-42f6-89f5-1f60281485f5 State: Peer in Cluster (Connected) Hostname: g2 Uuid: 154d5c46-f62f-4e9c-a328-443e30cadf4e State: Peer in Cluster (Connected) Hostname: g4 Uuid: 62365589-61f8-479f-bb50-11519beba045 State: Peer in Cluster (Disconnected) ..i've also tried rebooting the machine - and nothing changes. ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] help! - cant bring 1 of 4 servers up..
zip /etc/glusterd and send across Pranith On 08/08/2011 10:15 PM, paul simpson wrote: hi gluster gurus, i have 4 servers g1,g2,g3 g4 with 24T each running gluster 3.1.5 on opensuse 11.3. they have been running well for the last few months in a distributed+replicated setup. i just found that the nfs log had filled up my root disk of g4 (my bad). so, i removed the log file - and a couple of other large ones and restored a load of disk space. however, gluster 3.1.5 will not restart on this machine!! it err's out with http://pastebin.com/646W8zjg i've searched this forum, and searched the documentation. however, i cant see anything that mentions this situation. please can anyone help - i'm quite concerned about my system. this is a live server with live data. i need to get g4 up and running and back into sync ASAP. many thanks in advance, -paul ps - the following command just hangs: g4:~ # gluster peer status ..however, on g3 it works: g3:/etc/glusterd/logs # gluster peer status Number of Peers: 3 Hostname: 10.0.0.12 Uuid: 8061196e-a075-42f6-89f5-1f60281485f5 State: Peer in Cluster (Connected) Hostname: g2 Uuid: 154d5c46-f62f-4e9c-a328-443e30cadf4e State: Peer in Cluster (Connected) Hostname: g4 Uuid: 62365589-61f8-479f-bb50-11519beba045 State: Peer in Cluster (Disconnected) ..i've also tried rebooting the machine - and nothing changes. ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] help! - cant bring 1 of 4 servers up..
Pranith - thanks for following up! -JM From: gluster-users-boun...@gluster.org [gluster-users-boun...@gluster.org] on behalf of Pranith Kumar K [prani...@gluster.com] Sent: Monday, August 08, 2011 10:35 AM To: paul simpson; gluster-users Subject: Re: [Gluster-users] help! - cant bring 1 of 4 servers up.. After debugging the problem with paul on IRC, we found that because his disk had no free space, the subsequent writes on one of the peer files (used for recovering run-time information) failed so the file became empty. Because of this glusterd could not restore that peer so it is not re-starting successfully. We copied the contents of that file from other peer in the cluster to the problematic one. Then glusterd started successfully. Pranith. On 08/08/2011 10:32 PM, paul simpson wrote: hi pranith, many thanks for the super quick reply! i've attached the files asked for - be keen to hear your thoughts. i'm stumped - and scared! regards, paul On 8 August 2011 17:59, Pranith Kumar K prani...@gluster.commailto:prani...@gluster.com wrote: zip /etc/glusterd and send across Pranith On 08/08/2011 10:15 PM, paul simpson wrote: hi gluster gurus, i have 4 servers g1,g2,g3 g4 with 24T each running gluster 3.1.5 on opensuse 11.3. they have been running well for the last few months in a distributed+replicated setup. i just found that the nfs log had filled up my root disk of g4 (my bad). so, i removed the log file - and a couple of other large ones and restored a load of disk space. however, gluster 3.1.5 will not restart on this machine!! it err's out with http://pastebin.com/646W8zjg i've searched this forum, and searched the documentation. however, i cant see anything that mentions this situation. please can anyone help - i'm quite concerned about my system. this is a live server with live data. i need to get g4 up and running and back into sync ASAP. many thanks in advance, -paul ps - the following command just hangs: g4:~ # gluster peer status ..however, on g3 it works: g3:/etc/glusterd/logs # gluster peer status Number of Peers: 3 Hostname: 10.0.0.12 Uuid: 8061196e-a075-42f6-89f5-1f60281485f5 State: Peer in Cluster (Connected) Hostname: g2 Uuid: 154d5c46-f62f-4e9c-a328-443e30cadf4e State: Peer in Cluster (Connected) Hostname: g4 Uuid: 62365589-61f8-479f-bb50-11519beba045 State: Peer in Cluster (Disconnected) ..i've also tried rebooting the machine - and nothing changes. ___ Gluster-users mailing list Gluster-users@gluster.orgmailto:Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] help! - cant bring 1 of 4 servers up..
pranith - a huge and heartfelt thanks for your super prompt attention. a very scary event turned into a non-event. :) regards, -p On 8 August 2011 18:35, Pranith Kumar K prani...@gluster.com wrote: ** After debugging the problem with paul on IRC, we found that because his disk had no free space, the subsequent writes on one of the peer files (used for recovering run-time information) failed so the file became empty. Because of this glusterd could not restore that peer so it is not re-starting successfully. We copied the contents of that file from other peer in the cluster to the problematic one. Then glusterd started successfully. Pranith. On 08/08/2011 10:32 PM, paul simpson wrote: hi pranith, many thanks for the super quick reply! i've attached the files asked for - be keen to hear your thoughts. i'm stumped - and scared! regards, paul On 8 August 2011 17:59, Pranith Kumar K prani...@gluster.com wrote: zip /etc/glusterd and send across Pranith On 08/08/2011 10:15 PM, paul simpson wrote: hi gluster gurus, i have 4 servers g1,g2,g3 g4 with 24T each running gluster 3.1.5 on opensuse 11.3. they have been running well for the last few months in a distributed+replicated setup. i just found that the nfs log had filled up my root disk of g4 (my bad). so, i removed the log file - and a couple of other large ones and restored a load of disk space. however, gluster 3.1.5 will not restart on this machine!! it err's out with http://pastebin.com/646W8zjg i've searched this forum, and searched the documentation. however, i cant see anything that mentions this situation. please can anyone help - i'm quite concerned about my system. this is a live server with live data. i need to get g4 up and running and back into sync ASAP. many thanks in advance, -paul ps - the following command just hangs: g4:~ # gluster peer status ..however, on g3 it works: g3:/etc/glusterd/logs # gluster peer status Number of Peers: 3 Hostname: 10.0.0.12 Uuid: 8061196e-a075-42f6-89f5-1f60281485f5 State: Peer in Cluster (Connected) Hostname: g2 Uuid: 154d5c46-f62f-4e9c-a328-443e30cadf4e State: Peer in Cluster (Connected) Hostname: g4 Uuid: 62365589-61f8-479f-bb50-11519beba045 State: Peer in Cluster (Disconnected) ..i've also tried rebooting the machine - and nothing changes. ___ Gluster-users mailing listGluster-users@gluster.orghttp://gluster.org/cgi-bin/mailman/listinfo/gluster-users ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] gluster usable as open source solution
Glad I could help, Uwe. We do use hardware RAID inside the servers. The reason being is because gluster isn't block level so doing a remirror/resync with 80+ million files takes weeks - so if we lose a hard drive the rebuild time would be unacceptable. With hardware raid a rebuild takes only a day or two. We access our clusters mostly via the native fuse gluster client because performance via the NFS client is somewhat slow. However we do have a few clients that connect via NFS so we can mount readonly or that don't require a lot of performance. liam On Thu, Aug 4, 2011 at 11:13 AM, Uwe Kastens kiste...@googlemail.com wrote: Hello Liam, Thank you for sharing information. This is very kind and helpful. Indeed there are some questions: - Are you working with hardware raid inside the server? - How are you acessing the storage? NFS/gluster native? Kind Regards Uwe 2011/8/4 Liam Slusser lslus...@gmail.com I run two Gluster clusters in a very production roll using open source Gluster, all supported in-house mostly by myself. We have a 4-node 240tb after raid (576tb raw) cluster supporting a farm of audio transcoders. This one was built not so much for speed (its not very speedy), but to be reliable and cheap. Over the last two years we've had a few small issues but nothing major. Very reliable. All built on commodity hardware (Supermicro chassis's, Seagate 7.2k desktop harddrives). I also run a smaller 6-node 120tb (432tb raw) as storage for a pool of public facing apache webservers. This smaller cluster serves content to feed our CDN providers which feeds all our users. We can saturate a gigabit line (with 2-3meg http objects) without issues. (Same Supermicro chassis's and Seagate 7.2k desktop harddrives) This cluster has never gone down in the last two years it has been running. Our two homebuilt Gluster clusters replaced nearly 1/4 of a million dollars in Isilon hardware for less then the cost of the Isilon annual support contract while doubling the space at the same time. It has saved our company hundreds of thousands of dollars and has been hugely successful. You're welcome to email me offline if you would like more information. liam On Thu, Aug 4, 2011 at 3:38 AM, Uwe Kastens kiste...@googlemail.com wrote: Hi, I looked at gluster over the past year. It looks nice but the commercial option is not so interesting, since it is not possible to evaluate a storage solution within 30 days. More than one any other storage platform its a matter of trust, if the scaling is working. So my questions to this mailinglist are: - Anybody using the open source edition in a bigger production environment? How is the expierence over a longer time? - Since gluster seems only to offer support within the enterprise version. Anybody out there how is supporting the open source edition? Regards Uwe ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] HW raid or not
I'm in the HW raid camp. Mostly because gluster is not block level, so with large quantities of files replication can take days or weeks. In my case a rebuild/resync can take weeks because of how many files/directories I have in my cluster. With hardware RAID I can just replace the disk and a rebuild happens automatically and very quickly. liam On Mon, Aug 8, 2011 at 4:12 AM, Gabriel-Adrian Samfira samfiragabr...@gmail.com wrote: We use raw disks with our setup. Gluster takes care of the replication part, so RAID would be useless for us. Performance wise, you are better off just adding a new brick and let gluster do the rest. Best regards, Gabriel On Mon, Aug 8, 2011 at 9:54 AM, Uwe Kastens kiste...@googlemail.com wrote: Hi, I know, that there is no general answer to this question :) Is it better to use HW Raid or LVM as gluster backend or raw disks? Regards Uwe ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
[Gluster-users] Your Feedback Requested: New gluster.org design
Hi guys, We are almost ready to launch a redesign of www.gluster.orghttp://www.gluster.org/ - please take a look at what's in store on http://staging.gluster.orghttp://staging.gluster.org/ We wanted to accomplish a few things with this redesign: - look friendlier and cleaner - give a better view of what's happening in the GlusterFS community - present clear options for getting more help Please let me know if we missed anything, or if there's something you'd like to see. If we can't get it in the initial launch, we'll plan for it down the road. Thanks! John Mark Walker Gluster Community Guy ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users