Re: [Gluster-users] question about list directory missing files or hang
can you post more details? like gluster volume info, gluster peer status, output of mount, and df ? On Mon, Aug 13, 2012 at 10:42 PM, 符永涛 yongta...@gmail.com wrote: Hi all, Any one helps? More information about this issue. for example if i create abc.zip by touch abc.zip then run ls it hangs but if I run rm -rf abc.zip then ls returns many file with same name seems there's bug here. ls hangs because it falls into a loop and the files stat are not valid. Thank you. 2012/8/14 符永涛 yongta...@gmail.com Hi Gluster experts, I'm new to glusterfs and I have encountered a problem about list directory of glusters 3.3. I have a volume configuration of 3(distribute) * 2(replica). When write file on the glusterfs client mount directory some of the files can't be listed through ls command but the file exists. Some times the ls command hangs. Any one know what's the problem is? Thank you very much. -- 符永涛 -- 符永涛 ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] question about list directory missing files or hang
Hi Bryan, Thank you for your support. Just find out glusterfs 3.2 and 3.3 both have this issue. My server is redhat 6.3 kernel is 2.6.32-279.el6.x86_64 is it compatible? More info listed bellow: volume info: Volume Name: yfudis3rep2 Type: Distributed-Replicate Volume ID: 6a8da204-1348-4cd8-a188-13807b827965 Status: Started Number of Bricks: 3 x 2 = 6 Transport-type: tcp Bricks: Brick1: 10.10.135.21:/mnt/yfudis3rep2d Brick2: 10.10.135.23:/mnt/yfudis3rep2d Brick3: 10.10.135.24:/mnt/yfudis3rep2d Brick4: 10.10.135.25:/mnt/yfudis3rep2d Brick5: 10.10.135.26:/mnt/yfudis3rep2d Brick6: 10.10.135.27:/mnt/yfudis3rep2d Options Reconfigured: cluster.quorum-count: 2 cluster.quorum-type: fixed diagnostics.client-log-level: DEBUG diagnostics.brick-log-level: DEBUG df 10.10.135.24:/yfudis3rep2 87G 16G 67G 20% /mnt/yfudis3rep2 [root@10.10.135.21 ~]# gluster peer status Number of Peers: 7 Hostname: 10.10.135.28 Uuid: f5ed0acf-9ef2-4378-801f-21c1e4c3ed7e State: Peer in Cluster (Connected) Hostname: 10.10.135.25 Uuid: c3ed7be0-cd14-4c3a-9523-c3a059515faa State: Peer in Cluster (Connected) Hostname: 10.1.4.17 Uuid: 6525bd4f-6f43-4eb7-b8c7-9860528a0cb6 State: Peer in Cluster (Connected) Hostname: 10.10.135.24 Uuid: 04bb84a6-a7f9-4b43-8c84-154914e807b5 State: Peer in Cluster (Connected) Hostname: 10.10.135.23 Uuid: 46651bb6-7584-4dc3-a32a-72ffee7c6775 State: Peer in Cluster (Connected) Hostname: 10.10.135.27 Uuid: a8b65039-eb5a-4787-a2f2-8cc963ceb09e State: Peer in Cluster (Connected) Hostname: 10.10.135.26 Uuid: c02ac9eb-f0e5-4757-b31a-f9d22031ff38 State: Peer in Cluster (Connected) mount 10.10.135.24:/yfudis3rep2 on /mnt/yfudis3rep2 type fuse.glusterfs (rw,default_permissions,allow_other,max_read=131072) 2012/8/14 Bryan Whitehead dri...@megahappy.net can you post more details? like gluster volume info, gluster peer status, output of mount, and df ? On Mon, Aug 13, 2012 at 10:42 PM, 符永涛 yongta...@gmail.com wrote: Hi all, Any one helps? More information about this issue. for example if i create abc.zip by touch abc.zip then run ls it hangs but if I run rm -rf abc.zip then ls returns many file with same name seems there's bug here. ls hangs because it falls into a loop and the files stat are not valid. Thank you. 2012/8/14 符永涛 yongta...@gmail.com Hi Gluster experts, I'm new to glusterfs and I have encountered a problem about list directory of glusters 3.3. I have a volume configuration of 3(distribute) * 2(replica). When write file on the glusterfs client mount directory some of the files can't be listed through ls command but the file exists. Some times the ls command hangs. Any one know what's the problem is? Thank you very much. -- 符永涛 -- 符永涛 ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users -- 符永涛 ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] question about list directory missing files or hang
I'm betting that your bricks are formatted ext4. If they are, you have a bug due to a recent structure change in ext4. If that is the problem, you can downgrade your kernel to before they backported the change (not sure which version that is though), or reformat your bricks xfs. On 08/14/2012 12:15 AM, ??? wrote: Hi Bryan, Thank you for your support. Just find out glusterfs 3.2 and 3.3 both have this issue. My server is redhat 6.3 kernel is 2.6.32-279.el6.x86_64 is it compatible? More info listed bellow: volume info: Volume Name: yfudis3rep2 Type: Distributed-Replicate Volume ID: 6a8da204-1348-4cd8-a188-13807b827965 Status: Started Number of Bricks: 3 x 2 = 6 Transport-type: tcp Bricks: Brick1: 10.10.135.21:/mnt/yfudis3rep2d Brick2: 10.10.135.23:/mnt/yfudis3rep2d Brick3: 10.10.135.24:/mnt/yfudis3rep2d Brick4: 10.10.135.25:/mnt/yfudis3rep2d Brick5: 10.10.135.26:/mnt/yfudis3rep2d Brick6: 10.10.135.27:/mnt/yfudis3rep2d Options Reconfigured: cluster.quorum-count: 2 cluster.quorum-type: fixed diagnostics.client-log-level: DEBUG diagnostics.brick-log-level: DEBUG df 10.10.135.24:/yfudis3rep2 87G 16G 67G 20% /mnt/yfudis3rep2 [root@10.10.135.21 mailto:root@10.10.135.21 ~]# gluster peer status Number of Peers: 7 Hostname: 10.10.135.28 Uuid: f5ed0acf-9ef2-4378-801f-21c1e4c3ed7e State: Peer in Cluster (Connected) Hostname: 10.10.135.25 Uuid: c3ed7be0-cd14-4c3a-9523-c3a059515faa State: Peer in Cluster (Connected) Hostname: 10.1.4.17 Uuid: 6525bd4f-6f43-4eb7-b8c7-9860528a0cb6 State: Peer in Cluster (Connected) Hostname: 10.10.135.24 Uuid: 04bb84a6-a7f9-4b43-8c84-154914e807b5 State: Peer in Cluster (Connected) Hostname: 10.10.135.23 Uuid: 46651bb6-7584-4dc3-a32a-72ffee7c6775 State: Peer in Cluster (Connected) Hostname: 10.10.135.27 Uuid: a8b65039-eb5a-4787-a2f2-8cc963ceb09e State: Peer in Cluster (Connected) Hostname: 10.10.135.26 Uuid: c02ac9eb-f0e5-4757-b31a-f9d22031ff38 State: Peer in Cluster (Connected) mount 10.10.135.24:/yfudis3rep2 on /mnt/yfudis3rep2 type fuse.glusterfs (rw,default_permissions,allow_other,max_read=131072) 2012/8/14 Bryan Whitehead dri...@megahappy.net mailto:dri...@megahappy.net can you post more details? like gluster volume info, gluster peer status, output of mount, and df ? On Mon, Aug 13, 2012 at 10:42 PM, ??? yongta...@gmail.com mailto:yongta...@gmail.com wrote: Hi all, Any one helps? More information about this issue. for example if i create abc.zip by touch abc.zip then run ls it hangs but if I run rm -rf abc.zip then ls returns many file with same name seems there's bug here. ls hangs because it falls into a loop and the files stat are not valid. Thank you. 2012/8/14 ??? yongta...@gmail.com mailto:yongta...@gmail.com Hi Gluster experts, I'm new to glusterfs and I have encountered a problem about list directory of glusters 3.3. I have a volume configuration of 3(distribute) * 2(replica). When write file on the glusterfs client mount directory some of the files can't be listed through ls command but the file exists. Some times the ls command hangs. Any one know what's the problem is? Thank you very much. -- ??? -- ??? ___ Gluster-users mailing list Gluster-users@gluster.org mailto:Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users -- ??? ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] question about list directory missing files or hang
Hi Joe, Problem solved, I'm betting you're genius！！！ The issue is related to ext4, thank you very much! 2012/8/14 Joe Julian j...@julianfamily.org I'm betting that your bricks are formatted ext4. If they are, you have a bug due to a recent structure change in ext4. If that is the problem, you can downgrade your kernel to before they backported the change (not sure which version that is though), or reformat your bricks xfs. On 08/14/2012 12:15 AM, 符永涛 wrote: Hi Bryan, Thank you for your support. Just find out glusterfs 3.2 and 3.3 both have this issue. My server is redhat 6.3 kernel is 2.6.32-279.el6.x86_64 is it compatible? More info listed bellow: volume info: Volume Name: yfudis3rep2 Type: Distributed-Replicate Volume ID: 6a8da204-1348-4cd8-a188-13807b827965 Status: Started Number of Bricks: 3 x 2 = 6 Transport-type: tcp Bricks: Brick1: 10.10.135.21:/mnt/yfudis3rep2d Brick2: 10.10.135.23:/mnt/yfudis3rep2d Brick3: 10.10.135.24:/mnt/yfudis3rep2d Brick4: 10.10.135.25:/mnt/yfudis3rep2d Brick5: 10.10.135.26:/mnt/yfudis3rep2d Brick6: 10.10.135.27:/mnt/yfudis3rep2d Options Reconfigured: cluster.quorum-count: 2 cluster.quorum-type: fixed diagnostics.client-log-level: DEBUG diagnostics.brick-log-level: DEBUG df 10.10.135.24:/yfudis3rep2 87G 16G 67G 20% /mnt/yfudis3rep2 [root@10.10.135.21 ~]# gluster peer status Number of Peers: 7 Hostname: 10.10.135.28 Uuid: f5ed0acf-9ef2-4378-801f-21c1e4c3ed7e State: Peer in Cluster (Connected) Hostname: 10.10.135.25 Uuid: c3ed7be0-cd14-4c3a-9523-c3a059515faa State: Peer in Cluster (Connected) Hostname: 10.1.4.17 Uuid: 6525bd4f-6f43-4eb7-b8c7-9860528a0cb6 State: Peer in Cluster (Connected) Hostname: 10.10.135.24 Uuid: 04bb84a6-a7f9-4b43-8c84-154914e807b5 State: Peer in Cluster (Connected) Hostname: 10.10.135.23 Uuid: 46651bb6-7584-4dc3-a32a-72ffee7c6775 State: Peer in Cluster (Connected) Hostname: 10.10.135.27 Uuid: a8b65039-eb5a-4787-a2f2-8cc963ceb09e State: Peer in Cluster (Connected) Hostname: 10.10.135.26 Uuid: c02ac9eb-f0e5-4757-b31a-f9d22031ff38 State: Peer in Cluster (Connected) mount 10.10.135.24:/yfudis3rep2 on /mnt/yfudis3rep2 type fuse.glusterfs (rw,default_permissions,allow_other,max_read=131072) 2012/8/14 Bryan Whitehead dri...@megahappy.net can you post more details? like gluster volume info, gluster peer status, output of mount, and df ? On Mon, Aug 13, 2012 at 10:42 PM, 符永涛 yongta...@gmail.com wrote: Hi all, Any one helps? More information about this issue. for example if i create abc.zip by touch abc.zip then run ls it hangs but if I run rm -rf abc.zip then ls returns many file with same name seems there's bug here. ls hangs because it falls into a loop and the files stat are not valid. Thank you. 2012/8/14 符永涛 yongta...@gmail.com Hi Gluster experts, I'm new to glusterfs and I have encountered a problem about list directory of glusters 3.3. I have a volume configuration of 3(distribute) * 2(replica). When write file on the glusterfs client mount directory some of the files can't be listed through ls command but the file exists. Some times the ls command hangs. Any one know what's the problem is? Thank you very much. -- 符永涛 -- 符永涛 ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users -- 符永涛 ___ Gluster-users mailing listGluster-users@gluster.orghttp://gluster.org/cgi-bin/mailman/listinfo/gluster-users ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users -- 符永涛 ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] question about list directory missing files or hang
On Tue, Aug 14, 2012 at 12:19:10AM -0700, Joe Julian wrote: I'm betting that your bricks are formatted ext4. If they are, you have a bug due to a recent structure change in ext4. If that is the problem, you can downgrade your kernel to before they backported the change (not sure which version that is though), or reformat your bricks xfs. Do you have a link to any info on that issue? Does it only affect RedHat, or does it also affect distros running new kernels? I am using ext4 rather than xfs because I was reliably able to make machines running xfs lock up (these are Ubuntu not RedHat BTW) just by throwing bonnie++ load at them, but not when running the same test on ext4. ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] question about list directory missing files or hang
Hi all, Any one helps? More information about this issue. for example if i create abc.zip by touch abc.zip then run ls it hangs but if I run rm -rf abc.zip then ls returns many file with same name seems there's bug here. ls hangs because it falls into a loop and the files stat are not valid. Thank you. 2012/8/14 符永涛 yongta...@gmail.com Hi Gluster experts, I'm new to glusterfs and I have encountered a problem about list directory of glusters 3.3. I have a volume configuration of 3(distribute) * 2(replica). When write file on the glusterfs client mount directory some of the files can't be listed through ls command but the file exists. Some times the ls command hangs. Any one know what's the problem is? Thank you very much. -- 符永涛 -- 符永涛 ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
