Re: [Gluster-users] gluster usable as open source solution
John, 2011/8/4 John Mark Walker > Uwe - I'll let others in the community speak to the effectiveness of > GlusterFS. I'm obviously biased in that respect :) > > Thats nice :) > However, one point I would like to make is that if you're curious about > what we provide commercially, I would encourage you to contact someone here > to get the information directly from the source. If you need longer than 30 > days to evaluate, communicate that to someone here so that we can try to > accommodate you. > > I will stay in contact with Rich and evaluate the commercial option for sure. KInd Regards Uwe ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] gluster usable as open source solution
I run two Gluster clusters in a very production roll using open source Gluster, all supported in-house mostly by myself. We have a 4-node 240tb after raid (576tb raw) cluster supporting a farm of audio transcoders. This one was built not so much for speed (its not very speedy), but to be reliable and cheap. Over the last two years we've had a few small issues but nothing major. Very reliable. All built on commodity hardware (Supermicro chassis's, Seagate 7.2k desktop harddrives). I also run a smaller 6-node 120tb (432tb raw) as storage for a pool of public facing apache webservers. This smaller cluster serves content to feed our CDN providers which feeds all our users. We can saturate a gigabit line (with 2-3meg http objects) without issues. (Same Supermicro chassis's and Seagate 7.2k desktop harddrives) This cluster has never gone down in the last two years it has been running. Our two homebuilt Gluster clusters replaced nearly 1/4 of a million dollars in Isilon hardware for less then the cost of the Isilon annual support contract while doubling the space at the same time. It has saved our company hundreds of thousands of dollars and has been hugely successful. You're welcome to email me offline if you would like more information. liam On Thu, Aug 4, 2011 at 3:38 AM, Uwe Kastens wrote: > Hi, > > I looked at gluster over the past year. It looks nice but the commercial > option is not so interesting, since it is not possible to evaluate a storage > solution within 30 days. More than one any other storage platform its a > matter of trust, if the scaling is working. > > So my questions to this mailinglist are: > - Anybody using the open source edition in a bigger production environment? > How is the expierence over a longer time? > - Since gluster seems only to offer support within the enterprise version. > Anybody out there how is supporting the open source edition? > > Regards > > Uwe > > > ___ > Gluster-users mailing list > Gluster-users@gluster.org > http://gluster.org/cgi-bin/mailman/listinfo/gluster-users > > ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] gluster usable as open source solution
On 08/04/2011 06:38 AM, Uwe Kastens wrote: Hi, I looked at gluster over the past year. It looks nice but the commercial option is not so interesting, since it is not possible to evaluate a storage solution within 30 days. More than one any other storage platform its a matter of trust, if the scaling is working. Greetings Uwe You can evaluate it as long as needed using the open source code. The evaluation is really of the support and service side of things. We could have more discussion offline if you wish, so as not to spam the group. I thought you had decided upon Nexenta though ... has this changed? I'd certainly like to hear more about your consideration of Nexenta and Gluster. So my questions to this mailinglist are: - Anybody using the open source edition in a bigger production environment? How is the expierence over a longer time? Multiple of our customers are doing this, ranging from smaller 10TB shops through a few 500TB shops. - Since gluster seems only to offer support within the enterprise version. Anybody out there how is supporting the open source edition? Support is customizable to your needs. This is a conversation best had offline. Regards, Joe -- Joseph Landman, Ph.D Founder and CEO Scalable Informatics Inc. email: land...@scalableinformatics.com web : http://scalableinformatics.com http://scalableinformatics.com/sicluster phone: +1 734 786 8423 x121 fax : +1 866 888 3112 cell : +1 734 612 4615 ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Problem with Gluster Geo Replication, status faulty
Thanks for writing this up, Kaushik. Can you add this to a post on community.gluster.org? Thanks, JM From: gluster-users-boun...@gluster.org [gluster-users-boun...@gluster.org] on behalf of Kaushik BV [kaushi...@gluster.com] Sent: Wednesday, August 03, 2011 11:42 PM To: Dantas; zhourong.m...@flixlab.com Cc: gluster-users@gluster.org Subject: Re: [Gluster-users] Problem with Gluster Geo Replication, status faulty The geo-replication module forks (gsyncd) two process' one in the Master node (where geo-replication start was invoked) and another in Slave node. The two gsyncd' communicate with each other through a pair of pipe either on the same machine or through an ssh-tunnel (depending on where the Slave node resides), The above log basically means that the communication-channel between Master and Slave is failing. Here are the few reasons for which it may occur: 1) The ssh tunnel b/w the Master & Slave gsyncd is broken: The pre-requisite for geo-rep b/w Master and Slave to work is to have a passwordless SSH setup b/w them either as mentioned in http://www.gluster.com/community/documentation/index.php/Gluster_3.2:_Setting_Up_the_Environment_for_Geo-replication or as it is done normally. Verify if the password-less SSH is working fine. 2) The Master gsyncd could not spawn the Slave gsyncd session successfully: a) This could be due to the SSH-tunnel not been setup as desired, or b) The Master gsyncd spawns the Slave gsyncd process by locating the gsyncd executable in the slave in a predefined location, if the gsyncd executable is not found in the expected location the above scenario might occur. Execute the following in the Master node to see where Master gsyncd expects the gsyncd executable in the Slave Node. #gluster volume geo-replication config remote-gsyncd The outuput might would be a location similar to: /usr/local/libexec/glusterfs/gsyncd Verify in the Slave node if the above output is valid executable. If not configure the remote-gsyncd to point to the appropriate location by executing the following command in the Master node. #gluster volume geo-replication config remote-gsyncd c) The Slave gsyncd process died unexpectedly after being spawned: - If the Slave is a plain directory the gsyncd expects the directory to be created already. Verify if the directory has already been created. - If the Slave is a Gluster Volume then verify if Slave volume is started. - If the Slave is a Gluster Volume , gsyncd does a fuse mount on the Slave Volume, if the mount fails (maybe due to fuse module not running) the Slave gsyncd dies if it cannot mount the Slave Volume. For all the above scenarios looking at the Slave gsynd as well as auxialarry gluster log might throw more light on the issue, to locate the respective logs refer to the Locating Log Files section in http://gluster.com/community/documentation/index.php/Gluster_3.2:_Troubleshooting_Geo-replication If the problem persists post all the above logs by running the geo-replication session in DEBUG log level by executing the following command: #gluster volume geo-replication config-log-level DEBUG So that the problem could be root caused. A lot of log improvements is done in the devel branch, will have a more sanitized logs in the future releases. Regards, Kaushik ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] gluster usable as open source solution
Uwe - I'll let others in the community speak to the effectiveness of GlusterFS. I'm obviously biased in that respect :) However, one point I would like to make is that if you're curious about what we provide commercially, I would encourage you to contact someone here to get the information directly from the source. If you need longer than 30 days to evaluate, communicate that to someone here so that we can try to accommodate you. Thanks, John Mark Walker Gluster Community Guy From: gluster-users-boun...@gluster.org [gluster-users-boun...@gluster.org] on behalf of Uwe Kastens [kiste...@googlemail.com] Sent: Thursday, August 04, 2011 3:38 AM To: Gluster-users@gluster.org Subject: [Gluster-users] gluster usable as open source solution Hi, I looked at gluster over the past year. It looks nice but the commercial option is not so interesting, since it is not possible to evaluate a storage solution within 30 days. More than one any other storage platform its a matter of trust, if the scaling is working. So my questions to this mailinglist are: - Anybody using the open source edition in a bigger production environment? How is the expierence over a longer time? - Since gluster seems only to offer support within the enterprise version. Anybody out there how is supporting the open source edition? Regards Uwe ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] gluster usable as open source solution
I am using gluster together with a failover samba-domain. But only 2 nodes replicating bricks without any problems. Having around 100 Pcs and 80 User. EDV Daniel Müller Leitung EDV Tropenklinik Paul-Lechler-Krankenhaus Paul-Lechler-Str. 24 72076 Tübingen Tel.: 07071/206-463, Fax: 07071/206-499 eMail: muel...@tropenklinik.de Internet: www.tropenklinik.de Von: gluster-users-boun...@gluster.org [mailto:gluster-users-boun...@gluster.org] Im Auftrag von Uwe Kastens Gesendet: Donnerstag, 4. August 2011 15:52 An: Scott Nolin Cc: Gluster-users@gluster.org Betreff: Re: [Gluster-users] gluster usable as open source solution Scott, That sound interesting. It hasn't been going well so far. Currently we are struggling with performance problems that seem to be linked to certain versions of the linux kernel. The lack of in depth and current documentation is one of the most glaring and obvious problems. What is your feeling about stability of the solution? Kind Regards Uwe ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] gluster usable as open source solution
Scott, That sound interesting. It hasn't been going well so far. Currently we are struggling with > performance problems that seem to be linked to certain versions of the linux > kernel. > > The lack of in depth and current documentation is one of the most glaring > and obvious problems. > > > What is your feeling about stability of the solution? Kind Regards Uwe ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] gluster usable as open source solution
Uwe Kastens wrote on 08/04/2011 08:36:43 AM: > > - Anybody using the open source edition in a bigger production > > environment? How is the expierence over a longer time? > bigger is a matter of perspective and implementation. My bigger is very > different than most other people on the list's bigger. would be more > beneficial to you to ask more specific questions. > > > I was thinking about a setup with 50TB and 4 Nodes. Starting with a > simple storage for vm snapshots. so my experience is not helpful for you :) I've a similar number of nodes, but i have hundreds of volumes and all the clients are accessing millions of little files. that being said... i am curious about people's experience with your scenario too, its something we are considering gluster for in the future if we ever get to that point. -greg ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] gluster usable as open source solution
Greg, > - Anybody using the open source edition in a bigger production > > environment? How is the expierence over a longer time? > > bigger is a matter of perspective and implementation. My bigger is very > different than most other people on the list's bigger. would be more > beneficial to you to ask more specific questions. > I was thinking about a setup with 50TB and 4 Nodes. Starting with a simple storage for vm snapshots. Regards Uwe ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] gluster usable as open source solution
gluster-users-boun...@gluster.org wrote on 08/04/2011 05:38:45 AM: > I looked at gluster over the past year. It looks nice but the > commercial option is not so interesting, since it is not possible to > evaluate a storage solution within 30 days. More than one any other > storage platform its a matter of trust, if the scaling is working. > > So my questions to this mailinglist are: > - Anybody using the open source edition in a bigger production > environment? How is the expierence over a longer time? bigger is a matter of perspective and implementation. My bigger is very different than most other people on the list's bigger. would be more beneficial to you to ask more specific questions. -greg ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
[Gluster-users] "fd not open on any subvolume" causes root ownership
Hello All- I have had a spate of these errors in one of my volumes recently, with GlusterFS version 3.2.2. [2011-08-02 16:14:38.211400] W [afr-open.c:624:afr_openfd_flush] 0-atmos-replicate-7: fd not open on any subvolume 0x2f51e174 (/users/rle/CMIP5/NCC/NorESM1-M/rcp45/r1i1p1/ua_6hrPlev_NorESM1-M_rcp45_r1i1p1_2182010100-2182123118.nc) The files have root ownership (which is not correct) but are otherwise intact. The errors occur when the files are being written and the problem is not restricted to one client or one server. I have seen this error in GlusterFS client logs and in nfs.log. I am not running any rebalance operations at the moment. Does anybody know what causes this or how to stop it? I hope I don't have to go back to doing "chown -R" in people's directories regularly to correct ownership problems. Regards Dan. -- Mr. D.A. Bretherton Computer System Manager Environmental Systems Science Centre Harry Pitt Building 3 Earley Gate University of Reading Reading, RG6 6AL UK Tel. +44 118 378 5205 Fax: +44 118 378 6413 ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] gluster usable as open source solution
On 2011-08-04 12:38, Uwe Kastens wrote: Hi, I looked at gluster over the past year. It looks nice but the commercial option is not so interesting, since it is not possible to evaluate a storage solution within 30 days. More than one any other storage platform its a matter of trust, if the scaling is working. So my questions to this mailinglist are: - Anybody using the open source edition in a bigger production environment? How is the expierence over a longer time? - Since gluster seems only to offer support within the enterprise version. Anybody out there how is supporting the open source edition? hi! Correct me, if I'm wrong, there is only one (OSS) edition. You can buy for example appliance, but it's running the same version. tamas ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
[Gluster-users] gluster usable as open source solution
Hi, I looked at gluster over the past year. It looks nice but the commercial option is not so interesting, since it is not possible to evaluate a storage solution within 30 days. More than one any other storage platform its a matter of trust, if the scaling is working. So my questions to this mailinglist are: - Anybody using the open source edition in a bigger production environment? How is the expierence over a longer time? - Since gluster seems only to offer support within the enterprise version. Anybody out there how is supporting the open source edition? Regards Uwe ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
