Re: [Gluster-users] Striped Replicated Volumes: create files error.
It's a problem of stripped volumes in 3.3.1. It does not appear on 3.3.0 and it's solved in coming 3.4. Best regards, Samuel. On 25 January 2013 14:41, axel.we...@cbc.de wrote: Hi there, each time I copy (or dd or similar) a file to a striped replicated volume I get an error: the argument is not valid. An empty file is created. If I now run the copy, it works. This is in independed of the client platform. We are using version 3.3.1 ** ** ** ** Mit freundlichen Grüßen / Kind regards ** ** ** ** Axel Weber ** ** ** ** ___ Gluster-users mailing list Gluster-users@gluster.org http://supercolony.gluster.org/mailman/listinfo/gluster-users ___ Gluster-users mailing list Gluster-users@gluster.org http://supercolony.gluster.org/mailman/listinfo/gluster-users
[Gluster-users] please please please I beg redhat fix file system crush issue for fluster
It's mid night in china about 2:00 and I can't sleep. I have a glusterfs 3.3 cluster in production and there're several hundreds of clients on it. The io load is extremely high 24 hours. So the file system crush happens frequently in the cluster. About several times a year(I use xfs ) When one of the brick file system crush the whole volume collapse. Please don't say there're only few files can't be accessed. I swear to Beijing air the truth is the whole volume collapse and more files can't be accessed if don't handle it. Almost no file can be accessed. Some directory can't be accessed too which make millions of files missing and almost no fops can be performed. If you don't believe in me I have to swear to Beijing air again that I have see it happens several times. It's too expensive for us to restore this kind of failure! I admire redhat works and I hate myself that I don't have the ability to fix it. But I hope one day I can make contribute too. I have raise this issue before and I see there're updates. But I beg you please raise it's priority! Thank you very much! ___ Gluster-users mailing list Gluster-users@gluster.org http://supercolony.gluster.org/mailman/listinfo/gluster-users
Re: [Gluster-users] please please please I beg redhat fix file system crush issue for fluster
Hi, this list is for Gluster.org, which is a self-support community and only has volunteers. If you need immediate help from red hat, I recommend you call them. Thanks, JM yongtaofu yongta...@gmail.com wrote: It's mid night in china about 2:00 and I can't sleep. I have a glusterfs 3.3 cluster in production and there're several hundreds of clients on it. The io load is extremely high 24 hours. So the file system crush happens frequently in the cluster. About several times a year(I use xfs ) When one of the brick file system crush the whole volume collapse. Please don't say there're only few files can't be accessed. I swear to Beijing air the truth is the whole volume collapse and more files can't be accessed if don't handle it. Almost no file can be accessed. Some directory can't be accessed too which make millions of files missing and almost no fops can be performed. If you don't believe in me I have to swear to Beijing air again that I have see it happens several times. It's too expensive for us to restore this kind of failure! I admire redhat works and I hate myself that I don't have the ability to fix it. But I hope one day I can make contribute too. I have raise this issue before and I see there're updates. But I beg you please raise it's priority! Thank you very much! ___ Gluster-users mailing list Gluster-users@gluster.org http://supercolony.gluster.org/mailman/listinfo/gluster-users
[Gluster-users] high CPU load on all bricks
Gluster gurus ~ I've deployed and 8-brick (2x replicate) Gluster 3.3.1 volume on CentOS 6.3 with tcp transport. I was able to build, start, mount, and use the volume. On each system contributing a brick, however, my CPU usage (glusterfsd) is hovering around 20% (virtually zero memory usage thankfully). These are brand new, fairly beefy servers so 20% CPU load is quite a bit. The deployment is pretty plain with each brick mounting the volume to itself via a glusterfs mount. I assume this type of CPU usage is atypically high; is there anything I can do to investigate what's soaking up CPU and minimize it? Total usable volume size is only about 22 TB (about 45 TB total with 2x replicate). Thanks, ~Mike C. ___ Gluster-users mailing list Gluster-users@gluster.org http://supercolony.gluster.org/mailman/listinfo/gluster-users
Re: [Gluster-users] high CPU load on all bricks
Forgot to mention: on a client system (not a brick) the glusterfs process is consuming ~ 68% CPU continuously. This is a much less powerful desktop system so the CPU load can't be compared 1:1 with the systems comprising the bricks but still very high. So the issue seems to exist with both glusterfsd and glusterfs processes. Thanks, ~Mike C. From: gluster-users-boun...@gluster.org [mailto:gluster-users-boun...@gluster.org] On Behalf Of Michael Colonno Sent: Friday, February 01, 2013 12:46 PM To: gluster-users@gluster.org Subject: [Gluster-users] high CPU load on all bricks Gluster gurus ~ I've deployed and 8-brick (2x replicate) Gluster 3.3.1 volume on CentOS 6.3 with tcp transport. I was able to build, start, mount, and use the volume. On each system contributing a brick, however, my CPU usage (glusterfsd) is hovering around 20% (virtually zero memory usage thankfully). These are brand new, fairly beefy servers so 20% CPU load is quite a bit. The deployment is pretty plain with each brick mounting the volume to itself via a glusterfs mount. I assume this type of CPU usage is atypically high; is there anything I can do to investigate what's soaking up CPU and minimize it? Total usable volume size is only about 22 TB (about 45 TB total with 2x replicate). Thanks, ~Mike C. ___ Gluster-users mailing list Gluster-users@gluster.org http://supercolony.gluster.org/mailman/listinfo/gluster-users
Re: [Gluster-users] New version of UFO - is there a new HOWTO?
On 1/31/2013 3:23 PM, Shawn Heisey wrote: On 1/31/2013 12:36 PM, Kaleb
Keithley wrote:
Not sure if you saw this in #gluster on IRC.
The other work-around for F18 is to delete
/etc/swift/{account,container,object}-server.conf before starting UFO.
With that my UFO set-up works as it did in F17.
Still no joy.
http://fpaste.org/SOYM/
Same thing happens if I remove all the packages, get rid of /etc/swift,
and reinstall. I can confirm that the file referenced in the last part
of the paste (/etc/swift/object.ring.gz) did not exist at any point. A
previous installation of 3.3.1-2 on F17 has both .builder and .ring.gz
files.
http://fpaste.org/jIm5/
I have also now tried it on the latest CentOS with the same result. I
must be doing something wrong, which is why I had hoped for a new HOWTO.
Thanks,
Shawn
___
Gluster-users mailing list
Gluster-users@gluster.org
http://supercolony.gluster.org/mailman/listinfo/gluster-users
Re: [Gluster-users] high CPU load on all bricks
On Fri, Feb 01, 2013 at 12:53:24PM -0800, Michael Colonno wrote: Forgot to mention: on a client system (not a brick) the glusterfs process is consuming ~ 68% CPU continuously. This is a much less powerful desktop system so the CPU load can’t be compared 1:1 with the systems comprising the bricks but still very high. So the issue seems to exist with both glusterfsd and glusterfs processes. You said the host systems were also running the gluster client to have the gluster mount locally available. Does the high load go away on them if you unmount that? Some versions back (3.1.5), on some older systems (Ubuntu 8.04 with Gluster built from source), I had problems with the gluster client running away on me. Those systems are happy using nfs mounts instead. And the gluster servers, which aren't doing local mounting of gluster at all, don't use much by way of CPU. Then again, they're not highly stressed by use, so it's not much of a test. That's a long winded way of asking, are you sure it's glusterfsd too, and not just glusterfs sucking up the CPU cycles? Whit ___ Gluster-users mailing list Gluster-users@gluster.org http://supercolony.gluster.org/mailman/listinfo/gluster-users
Re: [Gluster-users] high CPU load on all bricks
On 02/01/13 12:46, Michael Colonno wrote: Gluster gurus ~ I’ve deployed and 8-brick (2x replicate) Gluster 3.3.1 volume on CentOS 6.3 with tcp transport. I was able to build, start, mount, and use the volume. On each system contributing a brick, however, my CPU usage (glusterfsd) is hovering around 20% (virtually zero memory usage thankfully). These are brand new, fairly beefy servers so 20% CPU load is quite a bit. The deployment is pretty plain with each brick mounting the volume to itself via a glusterfs mount. I assume this type of CPU usage is atypically high; is there anything I can do to investigate what’s soaking up CPU and minimize it? Total usable volume size is only about 22 TB (about 45 TB total with 2x replicate). Where are you reading the 20% from? If it is from the per process line in top, then that 20% is of a single core/hyperthread. It is not of the whole system. If you have an otherwise quiescent server and the Cpu(s) summary line at the top says 20%us, then you can extrapolate to under 20% of the total system. -- Mr. Flibble King of the Potato People ___ Gluster-users mailing list Gluster-users@gluster.org http://supercolony.gluster.org/mailman/listinfo/gluster-users
Re: [Gluster-users] high CPU load on all bricks
Update: after a few hours the CPU usage seems to have dropped down to a small value. I did not change anything with respect to the configuration or unmount / stop anything as I wanted to see if this would persist for a long period of time. Both the client and the self-mounted bricks are now showing CPU 1% (as reported by top). Prior to the larger CPU loads I installed a bunch of software into the volume (~ 5 GB total). Is this kind a transient behavior – by which I mean larger CPU loads after a lot of filesystem activity in short time – typical? This is not a problem in my deployment; I just want to know what to expect in the future and to complete this thread for future users. If this is expected behavior we can wrap up this thread. If not then I’ll do more digging into the logs on the client and brick sides. Thanks, ~Mike C. From: Joe Julian [mailto:j...@julianfamily.org] Sent: Friday, February 01, 2013 2:08 PM To: Michael Colonno; gluster-users@gluster.org Subject: Re: [Gluster-users] high CPU load on all bricks Check the client log(s). Michael Colonno mcolo...@stanford.edu wrote: Forgot to mention: on a client system (not a brick) the glusterfs process is consuming ~ 68% CPU continuously. This is a much less powerful desktop system so the CPU load can’t be compared 1:1 with the systems comprising the bricks but still very high. So the issue seems to exist with both glusterfsd and glusterfs processes. Thanks, ~Mike C. From: gluster-users-boun...@gluster.org [mailto:gluster-users-boun...@gluster.org] On Behalf Of Michael Colonno Sent: Friday, February 01, 2013 12:46 PM To: gluster-users@gluster.org Subject: [Gluster-users] high CPU load on all bricks Gluster gurus ~ I’ve deployed and 8-brick (2x replicate) Gluster 3.3.1 volume on CentOS 6.3 with tcp transport. I was able to build, start, mount, and use the volume. On each system contributing a brick, however, my CPU usage (glusterfsd) is hovering around 20% (virtually zero memory usage thankfully). These are brand new, fairly beefy servers so 20% CPU load is quite a bit. The deployment is pretty plain with each brick mounting the volume to itself via a glusterfs mount. I assume this type of CPU usage is atypically high; is there anything I can do to investigate what’s soaking up CPU and minimize it? Total usable volume size is only about 22 TB (about 45 TB total with 2x replicate). Thanks, ~Mike C. _ Gluster-users mailing list Gluster-users@gluster.org http://supercolony.gluster.org/mailman/listinfo/gluster-users ___ Gluster-users mailing list Gluster-users@gluster.org http://supercolony.gluster.org/mailman/listinfo/gluster-users
