Could be fuse, check 'dmesg' for kernel module timeouts.
In a similar vein, has anyone seen signifigant performance/reliability with
diff fuse versions? say, latest source vs. Rhel distro rpms vers.
-Tony
-----Original Message-----
From: Mohit Anchlia <mohitanch...@gmail.com>
Sent: June 06, 2011 1:14 PM
To: Markus Fröhlich <markus.froehl...@xidras.com>
Cc: gluster-users@gluster.org <gluster-users@gluster.org>
Subject: Re: [Gluster-users] uninterruptible processes writing to glusterfsshare
Is there anything in the server logs? Does it follow any particular
pattern before going in this mode?
Did you upgrade Gluster or is this new install?
2011/6/6 Markus Fröhlich <markus.froehl...@xidras.com>:
> hi!
>
> sometimes we've on some client-servers hanging uninterruptible processes
> ("ps aux" stat is on "D" ) and on one the CPU wait I/O grows within some
> minutes to 100%.
> you are not able to kill such processes - also "kill -9" doesnt work - when
> you connect via "strace" to such an process, you wont see anything and you
> cannot detach it again.
>
> there are only two possibilities:
> killing the glusterfs process (umount GFS share) or rebooting the server.
>
> the only log entry I found, was on one client - just a single line:
> [2011-06-06 10:44:18.593211] I [afr-common.c:581:afr_lookup_collect_xattr]
> 0-office-data-replicate-0: data self-heal is pending for
> /pc-partnerbet-public/Promotionaktionen/Mailakquise_2009/Webmaster_2010/HTML/bilder/Thumbs.db.
>
> one of the client-servers is a samba-server, the other one a backup-server
> based on rsync with millions of small files.
>
> gfs-servers + gfs-clients: SLES11 x86_64, glusterfs V 3.2.0
>
> and here are the configs from server and client:
> server config
> "/etc/glusterd/vols/office-data/office-data.gfs-01-01.GFS-office-data02.vol":
> volume office-data-posix
> type storage/posix
> option directory /GFS/office-data02
> end-volume
>
> volume office-data-access-control
> type features/access-control
> subvolumes office-data-posix
> end-volume
>
> volume office-data-locks
> type features/locks
> subvolumes office-data-access-control
> end-volume
>
> volume office-data-io-threads
> type performance/io-threads
> subvolumes office-data-locks
> end-volume
>
> volume office-data-marker
> type features/marker
> option volume-uuid 3c6e633d-a0bb-4c52-8f05-a2db9bc9c659
> option timestamp-file /etc/glusterd/vols/office-data/marker.tstamp
> option xtime off
> option quota off
> subvolumes office-data-io-threads
> end-volume
>
> volume /GFS/office-data02
> type debug/io-stats
> option latency-measurement off
> option count-fop-hits off
> subvolumes office-data-marker
> end-volume
>
> volume office-data-server
> type protocol/server
> option transport-type tcp
> option auth.addr./GFS/office-data02.allow *
> subvolumes /GFS/office-data02
> end-volume
>
>
> --------------
> client config "/etc/glusterd/vols/office-data/office-data-fuse.vol":
> volume office-data-client-0
> type protocol/client
> option remote-host gfs-01-01
> option remote-subvolume /GFS/office-data02
> option transport-type tcp
> end-volume
>
> volume office-data-replicate-0
> type cluster/replicate
> subvolumes office-data-client-0
> end-volume
>
> volume office-data-write-behind
> type performance/write-behind
> subvolumes office-data-replicate-0
> end-volume
>
> volume office-data-read-ahead
> type performance/read-ahead
> subvolumes office-data-write-behind
> end-volume
>
> volume office-data-io-cache
> type performance/io-cache
> subvolumes office-data-read-ahead
> end-volume
>
> volume office-data-quick-read
> type performance/quick-read
> subvolumes office-data-io-cache
> end-volume
>
> volume office-data-stat-prefetch
> type performance/stat-prefetch
> subvolumes office-data-quick-read
> end-volume
>
> volume office-data
> type debug/io-stats
> option latency-measurement off
> option count-fop-hits off
> subvolumes office-data-stat-prefetch
> end-volume
>
>
> -- Mit freundlichen Grüssen
>
> Markus Fröhlich
> Techniker
>
> ________________________________________________________
>
> Xidras GmbH
> Stockern 47
> 3744 Stockern
> Austria
>
> Tel: +43 (0) 2983 201 30503
> Fax: +43 (0) 2983 201 305039
> Email: markus.froehl...@xidras.com
> Web: http://www.xidras.com
>
> FN 317036 f | Landesgericht Krems | ATU64485024
>
> ________________________________________________________________________________
>
> VERTRAULICHE INFORMATIONEN!
> Diese eMail enthält vertrauliche Informationen und ist nur für den
> berechtigten Empfänger bestimmt. Wenn diese eMail nicht für Sie bestimmt
> ist, bitten wir Sie, diese eMail an uns zurückzusenden und anschließend
> auf Ihrem Computer und Mail-Server zu löschen. Solche eMails und Anlagen
> dürfen Sie weder nutzen, noch verarbeiten oder Dritten zugänglich
> machen, gleich in welcher Form.
> Wir danken für Ihre Kooperation!
>
> CONFIDENTIAL!
> This email contains confidential information and is intended for the
> authorised recipient only. If you are not an authorised recipient,
> please return the email to us and then delete it from your computer
> and mail-server. You may neither use nor edit any such emails including
> attachments, nor make them accessible to third parties in any manner
> whatsoever.
> Thank you for your cooperation
>
> ________________________________________________________________________________
>
>
>
>
>
>
>
>
> _______________________________________________
> Gluster-users mailing list
> Gluster-users@gluster.org
> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>
_______________________________________________
Gluster-users mailing list
Gluster-users@gluster.org
http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
_______________________________________________
Gluster-users mailing list
Gluster-users@gluster.org
http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
