Re: [Gluster-users] question about list directory missing files or hang

[Brian Candler]

On Tue, Aug 14, 2012 at 12:19:10AM -0700, Joe Julian wrote:
>I'm betting that your bricks are formatted ext4. If they are, you have
>a bug due to a recent structure change in ext4. If that is the problem,
>you can downgrade your kernel to before they backported the change (not
>sure which version that is though), or reformat your bricks xfs.

Do you have a link to any info on that issue?

Does it only affect RedHat, or does it also affect distros running new
kernels?

I am using ext4 rather than xfs because I was reliably able to make machines
running xfs lock up (these are Ubuntu not RedHat BTW) just by throwing
bonnie++ load at them, but not when running the same test on ext4.
___
Gluster-users mailing list
Gluster-users@gluster.org
http://gluster.org/cgi-bin/mailman/listinfo/gluster-users

Re: [Gluster-users] question about list directory missing files or hang

[符永涛]

Hi Joe,
Problem solved, I'm betting you're genius！！！
The issue is related to ext4, thank you very much!

2012/8/14 Joe Julian 

>  I'm betting that your bricks are formatted ext4. If they are, you have a
> bug due to a recent structure change in ext4. If that is the problem, you
> can downgrade your kernel to before they backported the change (not sure
> which version that is though), or reformat your bricks xfs.
>
>
> On 08/14/2012 12:15 AM, 符永涛 wrote:
>
> Hi Bryan,
>
> Thank you for your support.  Just find out glusterfs 3.2 and 3.3 both have
> this issue.
> My server is redhat 6.3 kernel is 2.6.32-279.el6.x86_64 is it compatible?
>
> More info listed bellow:
>
> volume info:
> Volume Name: yfudis3rep2
> Type: Distributed-Replicate
> Volume ID: 6a8da204-1348-4cd8-a188-13807b827965
> Status: Started
> Number of Bricks: 3 x 2 = 6
> Transport-type: tcp
> Bricks:
> Brick1: 10.10.135.21:/mnt/yfudis3rep2d
> Brick2: 10.10.135.23:/mnt/yfudis3rep2d
> Brick3: 10.10.135.24:/mnt/yfudis3rep2d
> Brick4: 10.10.135.25:/mnt/yfudis3rep2d
> Brick5: 10.10.135.26:/mnt/yfudis3rep2d
> Brick6: 10.10.135.27:/mnt/yfudis3rep2d
> Options Reconfigured:
> cluster.quorum-count: 2
> cluster.quorum-type: fixed
> diagnostics.client-log-level: DEBUG
> diagnostics.brick-log-level: DEBUG
>
> df
> 10.10.135.24:/yfudis3rep2
>87G   16G   67G  20% /mnt/yfudis3rep2
>
> [root@10.10.135.21 ~]# gluster peer status
> Number of Peers: 7
>
> Hostname: 10.10.135.28
> Uuid: f5ed0acf-9ef2-4378-801f-21c1e4c3ed7e
> State: Peer in Cluster (Connected)
>
> Hostname: 10.10.135.25
> Uuid: c3ed7be0-cd14-4c3a-9523-c3a059515faa
> State: Peer in Cluster (Connected)
>
> Hostname: 10.1.4.17
> Uuid: 6525bd4f-6f43-4eb7-b8c7-9860528a0cb6
> State: Peer in Cluster (Connected)
>
> Hostname: 10.10.135.24
> Uuid: 04bb84a6-a7f9-4b43-8c84-154914e807b5
> State: Peer in Cluster (Connected)
>
> Hostname: 10.10.135.23
> Uuid: 46651bb6-7584-4dc3-a32a-72ffee7c6775
> State: Peer in Cluster (Connected)
>
> Hostname: 10.10.135.27
> Uuid: a8b65039-eb5a-4787-a2f2-8cc963ceb09e
> State: Peer in Cluster (Connected)
>
> Hostname: 10.10.135.26
> Uuid: c02ac9eb-f0e5-4757-b31a-f9d22031ff38
> State: Peer in Cluster (Connected)
>
>
> mount
> 10.10.135.24:/yfudis3rep2 on /mnt/yfudis3rep2 type fuse.glusterfs
> (rw,default_permissions,allow_other,max_read=131072)
>
>
>
> 2012/8/14 Bryan Whitehead 
>
>> can you post more details? like gluster volume info, gluster peer
>> status, output of mount, and df ?
>>
>> On Mon, Aug 13, 2012 at 10:42 PM, 符永涛  wrote:
>> > Hi all,
>> >
>> > Any one helps?
>> > More information about this issue.
>> >
>> > for example if i create abc.zip by
>> > touch abc.zip
>> > then run
>> > ls &
>> > it hangs
>> > but if I run
>> > rm -rf abc.zip
>> > then ls returns many file with same name seems there's bug here. ls
>> hangs
>> > because it falls into a loop and the files stat are not valid.
>> >
>> > Thank you.
>> >
>> >
>> >
>> > 2012/8/14 符永涛 
>> >>
>> >> Hi Gluster experts,
>> >>
>> >>
>> >> I'm new to glusterfs and I have encountered a problem about list
>> directory
>> >> of glusters 3.3.
>> >>
>> >> I have a volume configuration of 3(distribute) * 2(replica). When write
>> >> file on the glusterfs client mount directory some of the files can't be
>> >> listed through ls command but the file exists. Some times the ls
>> command
>> >> hangs.
>> >>
>> >>
>> >> Any one know what's the problem is?
>> >>
>> >>
>> >> Thank you very much.
>> >>
>> >> --
>> >> 符永涛
>> >
>> >
>> >
>> >
>> > --
>> > 符永涛
>> >
>>  > ___
>> > Gluster-users mailing list
>> > Gluster-users@gluster.org
>> > http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>> >
>>
>
>
>
> --
> 符永涛
>
>
> ___
> Gluster-users mailing 
> listGluster-users@gluster.orghttp://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>
>
> ___
> Gluster-users mailing list
> Gluster-users@gluster.org
> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>
>


-- 
符永涛
___
Gluster-users mailing list
Gluster-users@gluster.org
http://gluster.org/cgi-bin/mailman/listinfo/gluster-users

Re: [Gluster-users] question about list directory missing files or hang

[Joe Julian]

I'm betting that your bricks are formatted ext4. If they are, you have a 
bug due to a recent structure change in ext4. If that is the problem, 
you can downgrade your kernel to before they backported the change (not 
sure which version that is though), or reformat your bricks xfs.


On 08/14/2012 12:15 AM, ??? wrote:

Hi Bryan,

Thank you for your support.  Just find out glusterfs 3.2 and 3.3 both 
have this issue.

My server is redhat 6.3 kernel is 2.6.32-279.el6.x86_64 is it compatible?

More info listed bellow:

volume info:
Volume Name: yfudis3rep2
Type: Distributed-Replicate
Volume ID: 6a8da204-1348-4cd8-a188-13807b827965
Status: Started
Number of Bricks: 3 x 2 = 6
Transport-type: tcp
Bricks:
Brick1: 10.10.135.21:/mnt/yfudis3rep2d
Brick2: 10.10.135.23:/mnt/yfudis3rep2d
Brick3: 10.10.135.24:/mnt/yfudis3rep2d
Brick4: 10.10.135.25:/mnt/yfudis3rep2d
Brick5: 10.10.135.26:/mnt/yfudis3rep2d
Brick6: 10.10.135.27:/mnt/yfudis3rep2d
Options Reconfigured:
cluster.quorum-count: 2
cluster.quorum-type: fixed
diagnostics.client-log-level: DEBUG
diagnostics.brick-log-level: DEBUG

df
10.10.135.24:/yfudis3rep2
   87G   16G   67G  20% /mnt/yfudis3rep2

[root@10.10.135.21  ~]# gluster peer status
Number of Peers: 7

Hostname: 10.10.135.28
Uuid: f5ed0acf-9ef2-4378-801f-21c1e4c3ed7e
State: Peer in Cluster (Connected)

Hostname: 10.10.135.25
Uuid: c3ed7be0-cd14-4c3a-9523-c3a059515faa
State: Peer in Cluster (Connected)

Hostname: 10.1.4.17
Uuid: 6525bd4f-6f43-4eb7-b8c7-9860528a0cb6
State: Peer in Cluster (Connected)

Hostname: 10.10.135.24
Uuid: 04bb84a6-a7f9-4b43-8c84-154914e807b5
State: Peer in Cluster (Connected)

Hostname: 10.10.135.23
Uuid: 46651bb6-7584-4dc3-a32a-72ffee7c6775
State: Peer in Cluster (Connected)

Hostname: 10.10.135.27
Uuid: a8b65039-eb5a-4787-a2f2-8cc963ceb09e
State: Peer in Cluster (Connected)

Hostname: 10.10.135.26
Uuid: c02ac9eb-f0e5-4757-b31a-f9d22031ff38
State: Peer in Cluster (Connected)


mount
10.10.135.24:/yfudis3rep2 on /mnt/yfudis3rep2 type fuse.glusterfs 
(rw,default_permissions,allow_other,max_read=131072)




2012/8/14 Bryan Whitehead >


can you post more details? like gluster volume info, gluster peer
status, output of mount, and df ?

On Mon, Aug 13, 2012 at 10:42 PM, ??? mailto:yongta...@gmail.com>> wrote:
> Hi all,
>
> Any one helps?
> More information about this issue.
>
> for example if i create abc.zip by
> touch abc.zip
> then run
> ls &
> it hangs
> but if I run
> rm -rf abc.zip
> then ls returns many file with same name seems there's bug here.
ls hangs
> because it falls into a loop and the files stat are not valid.
>
> Thank you.
>
>
>
> 2012/8/14 ??? mailto:yongta...@gmail.com>>
>>
>> Hi Gluster experts,
>>
>>
>> I'm new to glusterfs and I have encountered a problem about
list directory
>> of glusters 3.3.
>>
>> I have a volume configuration of 3(distribute) * 2(replica).
When write
>> file on the glusterfs client mount directory some of the files
can't be
>> listed through ls command but the file exists. Some times the
ls command
>> hangs.
>>
>>
>> Any one know what's the problem is?
>>
>>
>> Thank you very much.
>>
>> --
>> ???
>
>
>
>
> --
> ???
>
> ___
> Gluster-users mailing list
> Gluster-users@gluster.org 
> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>




--
???


___
Gluster-users mailing list
Gluster-users@gluster.org
http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
___
Gluster-users mailing list
Gluster-users@gluster.org
http://gluster.org/cgi-bin/mailman/listinfo/gluster-users

Re: [Gluster-users] question about list directory missing files or hang

[符永涛]

Hi Bryan,

Thank you for your support.  Just find out glusterfs 3.2 and 3.3 both have
this issue.
My server is redhat 6.3 kernel is 2.6.32-279.el6.x86_64 is it compatible?

More info listed bellow:

volume info:
Volume Name: yfudis3rep2
Type: Distributed-Replicate
Volume ID: 6a8da204-1348-4cd8-a188-13807b827965
Status: Started
Number of Bricks: 3 x 2 = 6
Transport-type: tcp
Bricks:
Brick1: 10.10.135.21:/mnt/yfudis3rep2d
Brick2: 10.10.135.23:/mnt/yfudis3rep2d
Brick3: 10.10.135.24:/mnt/yfudis3rep2d
Brick4: 10.10.135.25:/mnt/yfudis3rep2d
Brick5: 10.10.135.26:/mnt/yfudis3rep2d
Brick6: 10.10.135.27:/mnt/yfudis3rep2d
Options Reconfigured:
cluster.quorum-count: 2
cluster.quorum-type: fixed
diagnostics.client-log-level: DEBUG
diagnostics.brick-log-level: DEBUG

df
10.10.135.24:/yfudis3rep2
   87G   16G   67G  20% /mnt/yfudis3rep2

[root@10.10.135.21 ~]# gluster peer status
Number of Peers: 7

Hostname: 10.10.135.28
Uuid: f5ed0acf-9ef2-4378-801f-21c1e4c3ed7e
State: Peer in Cluster (Connected)

Hostname: 10.10.135.25
Uuid: c3ed7be0-cd14-4c3a-9523-c3a059515faa
State: Peer in Cluster (Connected)

Hostname: 10.1.4.17
Uuid: 6525bd4f-6f43-4eb7-b8c7-9860528a0cb6
State: Peer in Cluster (Connected)

Hostname: 10.10.135.24
Uuid: 04bb84a6-a7f9-4b43-8c84-154914e807b5
State: Peer in Cluster (Connected)

Hostname: 10.10.135.23
Uuid: 46651bb6-7584-4dc3-a32a-72ffee7c6775
State: Peer in Cluster (Connected)

Hostname: 10.10.135.27
Uuid: a8b65039-eb5a-4787-a2f2-8cc963ceb09e
State: Peer in Cluster (Connected)

Hostname: 10.10.135.26
Uuid: c02ac9eb-f0e5-4757-b31a-f9d22031ff38
State: Peer in Cluster (Connected)


mount
10.10.135.24:/yfudis3rep2 on /mnt/yfudis3rep2 type fuse.glusterfs
(rw,default_permissions,allow_other,max_read=131072)



2012/8/14 Bryan Whitehead 

> can you post more details? like gluster volume info, gluster peer
> status, output of mount, and df ?
>
> On Mon, Aug 13, 2012 at 10:42 PM, 符永涛  wrote:
> > Hi all,
> >
> > Any one helps?
> > More information about this issue.
> >
> > for example if i create abc.zip by
> > touch abc.zip
> > then run
> > ls &
> > it hangs
> > but if I run
> > rm -rf abc.zip
> > then ls returns many file with same name seems there's bug here. ls hangs
> > because it falls into a loop and the files stat are not valid.
> >
> > Thank you.
> >
> >
> >
> > 2012/8/14 符永涛 
> >>
> >> Hi Gluster experts,
> >>
> >>
> >> I'm new to glusterfs and I have encountered a problem about list
> directory
> >> of glusters 3.3.
> >>
> >> I have a volume configuration of 3(distribute) * 2(replica). When write
> >> file on the glusterfs client mount directory some of the files can't be
> >> listed through ls command but the file exists. Some times the ls command
> >> hangs.
> >>
> >>
> >> Any one know what's the problem is?
> >>
> >>
> >> Thank you very much.
> >>
> >> --
> >> 符永涛
> >
> >
> >
> >
> > --
> > 符永涛
> >
> > ___
> > Gluster-users mailing list
> > Gluster-users@gluster.org
> > http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
> >
>



-- 
符永涛
___
Gluster-users mailing list
Gluster-users@gluster.org
http://gluster.org/cgi-bin/mailman/listinfo/gluster-users

Re: [Gluster-users] question about list directory missing files or hang

[Bryan Whitehead]

can you post more details? like gluster volume info, gluster peer
status, output of mount, and df ?

On Mon, Aug 13, 2012 at 10:42 PM, 符永涛  wrote:
> Hi all,
>
> Any one helps?
> More information about this issue.
>
> for example if i create abc.zip by
> touch abc.zip
> then run
> ls &
> it hangs
> but if I run
> rm -rf abc.zip
> then ls returns many file with same name seems there's bug here. ls hangs
> because it falls into a loop and the files stat are not valid.
>
> Thank you.
>
>
>
> 2012/8/14 符永涛 
>>
>> Hi Gluster experts,
>>
>>
>> I'm new to glusterfs and I have encountered a problem about list directory
>> of glusters 3.3.
>>
>> I have a volume configuration of 3(distribute) * 2(replica). When write
>> file on the glusterfs client mount directory some of the files can't be
>> listed through ls command but the file exists. Some times the ls command
>> hangs.
>>
>>
>> Any one know what's the problem is?
>>
>>
>> Thank you very much.
>>
>> --
>> 符永涛
>
>
>
>
> --
> 符永涛
>
> ___
> Gluster-users mailing list
> Gluster-users@gluster.org
> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>
___
Gluster-users mailing list
Gluster-users@gluster.org
http://gluster.org/cgi-bin/mailman/listinfo/gluster-users

Re: [Gluster-users] question about list directory missing files or hang

[符永涛]

Hi all,

Any one helps?
More information about this issue.

for example if i create abc.zip by
touch abc.zip
then run
ls &
it hangs
but if I run
rm -rf abc.zip
then ls returns many file with same name seems there's bug here. ls hangs
because it falls into a loop and the files stat are not valid.

Thank you.


2012/8/14 符永涛 

> Hi Gluster experts,
>
>
> I'm new to glusterfs and I have encountered a problem about list directory
> of glusters 3.3.
>
> I have a volume configuration of 3(distribute) * 2(replica). When write
> file on the glusterfs client mount directory some of the files can't be
> listed through ls command but the file exists. Some times the ls command
> hangs.
>
>
> Any one know what's the problem is?
>
>
> Thank you very much.
> --
> 符永涛
>



-- 
符永涛
___
Gluster-users mailing list
Gluster-users@gluster.org
http://gluster.org/cgi-bin/mailman/listinfo/gluster-users