Re: [Gluster-users] Fedora 17 GlusterFS 3.3.0 problmes

[Nathan Stratton]

On Fri, 22 Jun 2012, Harry Mangalam wrote:


Were you automounting your glusterfs?

This is extremely similar to what I described previously:



 In my case the servers were running SL6.2; clients were running
CentOS 5.7 and were automounting the glusterfs with IPoIB.  When we
switched to hard mounts, the problem seems to have gone away, but I'd
be interested in seeing this resolved.  The "Client lk-version numbers
are not same, reopening the fds" strings in the logs were also
identical, even when I compiled new client versions that matched the
server version.

If this does not have a trivial answer, I'll be happy to file an
official bug report.  One report could be a twit :). second one could
be a bug.


I was automounting, however I get the same problem when I manually mount 
with:


mount -t glusterfs localhost:/share /share



<>

Nathan Stratton
nathan at robotics.net
http://www.robotics.net


hjm

On Fri, Jun 22, 2012 at 7:49 AM, Nathan Stratton  wrote:


When I do a NFS mount and do a ls I get:

[root@ovirt share]# ls
ls: reading directory .: Too many levels of symbolic links

[root@ovirt share]# ls -fl
ls: reading directory .: Too many levels of symbolic links
total 3636
drwxr-xr-x   3 root root 16384 Jun 21 19:34 .
dr-xr-xr-x. 21 root root  4096 Jun 21 19:29 ..
drwxr-xr-x   3 root root 16384 Jun 21 19:34 .
dr-xr-xr-x. 21 root root  4096 Jun 21 19:29 ..
drwxr-xr-x   3 root root 16384 Jun 21 19:34 .
dr-xr-xr-x. 21 root root  4096 Jun 21 19:29 ..
drwxr-xr-x   3 root root 16384 Jun 21 19:34 .
dr-xr-xr-x. 21 root root  4096 Jun 21 19:29 ..
drwxr-xr-x   3 root root 16384 Jun 21 19:34 .

{and so on}

When I try a fuse mount I get:
[client-handshake.c:1445:client_setvolume_cbk] 0-share-client-0: Server and
Client lk-version numbers are not same, reopening the fds

I have tried the fedora 16 RPMs and also built new fedora 17 RPMs.

Full Log:

[2012-06-21 19:24:35.633510] I [glusterfsd.c:1666:main]
0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.3.0
[2012-06-21 19:24:35.646832] I [io-cache.c:1549:check_cache_size_ok]
0-share-quick-read: Max cache size is 16825450496
[2012-06-21 19:24:35.646916] I [io-cache.c:1549:check_cache_size_ok]
0-share-io-cache: Max cache size is 16825450496
[2012-06-21 19:24:35.660807] I [client.c:2142:notify] 0-share-client-0:
parent translators are ready, attempting connect on transport
[2012-06-21 19:24:35.664026] I [client.c:2142:notify] 0-share-client-1:
parent translators are ready, attempting connect on transport
[2012-06-21 19:24:35.666801] I [client.c:2142:notify] 0-share-client-2:
parent translators are ready, attempting connect on transport
[2012-06-21 19:24:35.669385] I [client.c:2142:notify] 0-share-client-3:
parent translators are ready, attempting connect on transport
[2012-06-21 19:24:35.671951] I [client.c:2142:notify] 0-share-client-4:
parent translators are ready, attempting connect on transport
[2012-06-21 19:24:35.674514] I [client.c:2142:notify] 0-share-client-5:
parent translators are ready, attempting connect on transport
[2012-06-21 19:24:35.677093] I [client.c:2142:notify] 0-share-client-6:
parent translators are ready, attempting connect on transport
[2012-06-21 19:24:35.679652] I [client.c:2142:notify] 0-share-client-7:
parent translators are ready, attempting connect on transport
Given volfile:
+--+
 1: volume share-client-0
 2:     type protocol/client
 3:     option remote-host virt01.casabi.net
 4:     option remote-subvolume /export
 5:     option transport-type tcp
 6:     option username f0a71b3a-1cb2-4a38-8620-f3853aa90798
 7:     option password 9641cac2-de93-4621-b94b-9320ada20fd7
 8: end-volume
 9:
 10: volume share-client-1
 11:     type protocol/client
 12:     option remote-host virt02.casabi.net
 13:     option remote-subvolume /export
 14:     option transport-type tcp
 15:     option username f0a71b3a-1cb2-4a38-8620-f3853aa90798
 16:     option password 9641cac2-de93-4621-b94b-9320ada20fd7
 17: end-volume
 18:
 19: volume share-client-2
 20:     type protocol/client
 21:     option remote-host virt03.casabi.net
 22:     option remote-subvolume /export
 23:     option transport-type tcp
 24:     option username f0a71b3a-1cb2-4a38-8620-f3853aa90798
 25:     option password 9641cac2-de93-4621-b94b-9320ada20fd7
 26: end-volume
 27:
 28: volume share-client-3
 29:     type protocol/client
 30:     option remote-host virt04.casabi.net
 31:     option remote-subvolume /export
 32:     option transport-type tcp
 33:     option username f0a71b3a-1cb2-4a38-8620-f3853aa90798
 34:     option password 9641cac2-de93-4621-b94b-9320ada20fd7
 35: end-volume
 36:
 37: volume share-client-4
 38:     type protocol/client
 39:     option remote-host virt05.casabi.net
 40:     option remote-subvolume /export
 41:     option transport-type tcp
 42:     option username f0a71b3a-1cb2-4a38-8620-f3853a

Re: [Gluster-users] Fedora 17 GlusterFS 3.3.0 problmes

[Harry Mangalam]

Were you automounting your glusterfs?

This is extremely similar to what I described previously:



  In my case the servers were running SL6.2; clients were running
CentOS 5.7 and were automounting the glusterfs with IPoIB.  When we
switched to hard mounts, the problem seems to have gone away, but I'd
be interested in seeing this resolved.  The "Client lk-version numbers
are not same, reopening the fds" strings in the logs were also
identical, even when I compiled new client versions that matched the
server version.

If this does not have a trivial answer, I'll be happy to file an
official bug report.  One report could be a twit :). second one could
be a bug.

hjm

On Fri, Jun 22, 2012 at 7:49 AM, Nathan Stratton  wrote:
>
> When I do a NFS mount and do a ls I get:
>
> [root@ovirt share]# ls
> ls: reading directory .: Too many levels of symbolic links
>
> [root@ovirt share]# ls -fl
> ls: reading directory .: Too many levels of symbolic links
> total 3636
> drwxr-xr-x   3 root root 16384 Jun 21 19:34 .
> dr-xr-xr-x. 21 root root  4096 Jun 21 19:29 ..
> drwxr-xr-x   3 root root 16384 Jun 21 19:34 .
> dr-xr-xr-x. 21 root root  4096 Jun 21 19:29 ..
> drwxr-xr-x   3 root root 16384 Jun 21 19:34 .
> dr-xr-xr-x. 21 root root  4096 Jun 21 19:29 ..
> drwxr-xr-x   3 root root 16384 Jun 21 19:34 .
> dr-xr-xr-x. 21 root root  4096 Jun 21 19:29 ..
> drwxr-xr-x   3 root root 16384 Jun 21 19:34 .
>
> {and so on}
>
> When I try a fuse mount I get:
> [client-handshake.c:1445:client_setvolume_cbk] 0-share-client-0: Server and
> Client lk-version numbers are not same, reopening the fds
>
> I have tried the fedora 16 RPMs and also built new fedora 17 RPMs.
>
> Full Log:
>
> [2012-06-21 19:24:35.633510] I [glusterfsd.c:1666:main]
> 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.3.0
> [2012-06-21 19:24:35.646832] I [io-cache.c:1549:check_cache_size_ok]
> 0-share-quick-read: Max cache size is 16825450496
> [2012-06-21 19:24:35.646916] I [io-cache.c:1549:check_cache_size_ok]
> 0-share-io-cache: Max cache size is 16825450496
> [2012-06-21 19:24:35.660807] I [client.c:2142:notify] 0-share-client-0:
> parent translators are ready, attempting connect on transport
> [2012-06-21 19:24:35.664026] I [client.c:2142:notify] 0-share-client-1:
> parent translators are ready, attempting connect on transport
> [2012-06-21 19:24:35.666801] I [client.c:2142:notify] 0-share-client-2:
> parent translators are ready, attempting connect on transport
> [2012-06-21 19:24:35.669385] I [client.c:2142:notify] 0-share-client-3:
> parent translators are ready, attempting connect on transport
> [2012-06-21 19:24:35.671951] I [client.c:2142:notify] 0-share-client-4:
> parent translators are ready, attempting connect on transport
> [2012-06-21 19:24:35.674514] I [client.c:2142:notify] 0-share-client-5:
> parent translators are ready, attempting connect on transport
> [2012-06-21 19:24:35.677093] I [client.c:2142:notify] 0-share-client-6:
> parent translators are ready, attempting connect on transport
> [2012-06-21 19:24:35.679652] I [client.c:2142:notify] 0-share-client-7:
> parent translators are ready, attempting connect on transport
> Given volfile:
> +--+
>  1: volume share-client-0
>  2:     type protocol/client
>  3:     option remote-host virt01.casabi.net
>  4:     option remote-subvolume /export
>  5:     option transport-type tcp
>  6:     option username f0a71b3a-1cb2-4a38-8620-f3853aa90798
>  7:     option password 9641cac2-de93-4621-b94b-9320ada20fd7
>  8: end-volume
>  9:
>  10: volume share-client-1
>  11:     type protocol/client
>  12:     option remote-host virt02.casabi.net
>  13:     option remote-subvolume /export
>  14:     option transport-type tcp
>  15:     option username f0a71b3a-1cb2-4a38-8620-f3853aa90798
>  16:     option password 9641cac2-de93-4621-b94b-9320ada20fd7
>  17: end-volume
>  18:
>  19: volume share-client-2
>  20:     type protocol/client
>  21:     option remote-host virt03.casabi.net
>  22:     option remote-subvolume /export
>  23:     option transport-type tcp
>  24:     option username f0a71b3a-1cb2-4a38-8620-f3853aa90798
>  25:     option password 9641cac2-de93-4621-b94b-9320ada20fd7
>  26: end-volume
>  27:
>  28: volume share-client-3
>  29:     type protocol/client
>  30:     option remote-host virt04.casabi.net
>  31:     option remote-subvolume /export
>  32:     option transport-type tcp
>  33:     option username f0a71b3a-1cb2-4a38-8620-f3853aa90798
>  34:     option password 9641cac2-de93-4621-b94b-9320ada20fd7
>  35: end-volume
>  36:
>  37: volume share-client-4
>  38:     type protocol/client
>  39:     option remote-host virt05.casabi.net
>  40:     option remote-subvolume /export
>  41:     option transport-type tcp
>  42:     option username f0a71b3a-1cb2-4a38-8620-f3853aa90798
>  43:     option password 9641cac2-de93-4621-b94b-9320

[Gluster-users] Fedora 17 GlusterFS 3.3.0 problmes

[Nathan Stratton]

When I do a NFS mount and do a ls I get:

[root@ovirt share]# ls
ls: reading directory .: Too many levels of symbolic links

[root@ovirt share]# ls -fl
ls: reading directory .: Too many levels of symbolic links
total 3636
drwxr-xr-x   3 root root 16384 Jun 21 19:34 .
dr-xr-xr-x. 21 root root  4096 Jun 21 19:29 ..
drwxr-xr-x   3 root root 16384 Jun 21 19:34 .
dr-xr-xr-x. 21 root root  4096 Jun 21 19:29 ..
drwxr-xr-x   3 root root 16384 Jun 21 19:34 .
dr-xr-xr-x. 21 root root  4096 Jun 21 19:29 ..
drwxr-xr-x   3 root root 16384 Jun 21 19:34 .
dr-xr-xr-x. 21 root root  4096 Jun 21 19:29 ..
drwxr-xr-x   3 root root 16384 Jun 21 19:34 .

{and so on}

When I try a fuse mount I get: [client-handshake.c:1445:client_setvolume_cbk] 
0-share-client-0: Server and Client lk-version numbers are not same, reopening 
the fds


I have tried the fedora 16 RPMs and also built new fedora 17 RPMs.

Full Log:

[2012-06-21 19:24:35.633510] I [glusterfsd.c:1666:main] 0-/usr/sbin/glusterfs: 
Started running /usr/sbin/glusterfs version 3.3.0
[2012-06-21 19:24:35.646832] I [io-cache.c:1549:check_cache_size_ok] 
0-share-quick-read: Max cache size is 16825450496
[2012-06-21 19:24:35.646916] I [io-cache.c:1549:check_cache_size_ok] 
0-share-io-cache: Max cache size is 16825450496
[2012-06-21 19:24:35.660807] I [client.c:2142:notify] 0-share-client-0: parent 
translators are ready, attempting connect on transport
[2012-06-21 19:24:35.664026] I [client.c:2142:notify] 0-share-client-1: parent 
translators are ready, attempting connect on transport
[2012-06-21 19:24:35.666801] I [client.c:2142:notify] 0-share-client-2: parent 
translators are ready, attempting connect on transport
[2012-06-21 19:24:35.669385] I [client.c:2142:notify] 0-share-client-3: parent 
translators are ready, attempting connect on transport
[2012-06-21 19:24:35.671951] I [client.c:2142:notify] 0-share-client-4: parent 
translators are ready, attempting connect on transport
[2012-06-21 19:24:35.674514] I [client.c:2142:notify] 0-share-client-5: parent 
translators are ready, attempting connect on transport
[2012-06-21 19:24:35.677093] I [client.c:2142:notify] 0-share-client-6: parent 
translators are ready, attempting connect on transport
[2012-06-21 19:24:35.679652] I [client.c:2142:notify] 0-share-client-7: parent 
translators are ready, attempting connect on transport

Given volfile:
+--+
  1: volume share-client-0
  2: type protocol/client
  3: option remote-host virt01.casabi.net
  4: option remote-subvolume /export
  5: option transport-type tcp
  6: option username f0a71b3a-1cb2-4a38-8620-f3853aa90798
  7: option password 9641cac2-de93-4621-b94b-9320ada20fd7
  8: end-volume
  9:
 10: volume share-client-1
 11: type protocol/client
 12: option remote-host virt02.casabi.net
 13: option remote-subvolume /export
 14: option transport-type tcp
 15: option username f0a71b3a-1cb2-4a38-8620-f3853aa90798
 16: option password 9641cac2-de93-4621-b94b-9320ada20fd7
 17: end-volume
 18:
 19: volume share-client-2
 20: type protocol/client
 21: option remote-host virt03.casabi.net
 22: option remote-subvolume /export
 23: option transport-type tcp
 24: option username f0a71b3a-1cb2-4a38-8620-f3853aa90798
 25: option password 9641cac2-de93-4621-b94b-9320ada20fd7
 26: end-volume
 27:
 28: volume share-client-3
 29: type protocol/client
 30: option remote-host virt04.casabi.net
 31: option remote-subvolume /export
 32: option transport-type tcp
 33: option username f0a71b3a-1cb2-4a38-8620-f3853aa90798
 34: option password 9641cac2-de93-4621-b94b-9320ada20fd7
 35: end-volume
 36:
 37: volume share-client-4
 38: type protocol/client
 39: option remote-host virt05.casabi.net
 40: option remote-subvolume /export
 41: option transport-type tcp
 42: option username f0a71b3a-1cb2-4a38-8620-f3853aa90798
 43: option password 9641cac2-de93-4621-b94b-9320ada20fd7
 44: end-volume
 45:
 46: volume share-client-5
 47: type protocol/client
 48: option remote-host virt06.casabi.net
 49: option remote-subvolume /export
 50: option transport-type tcp
 51: option username f0a71b3a-1cb2-4a38-8620-f3853aa90798
 52: option password 9641cac2-de93-4621-b94b-9320ada20fd7
 53: end-volume
 54:
 55: volume share-client-6
 56: type protocol/client
 57: option remote-host virt07.casabi.net
 58: option remote-subvolume /export
 59: option transport-type tcp
 60: option username f0a71b3a-1cb2-4a38-8620-f3853aa90798
 61: option password 9641cac2-de93-4621-b94b-9320ada20fd7
 62: end-volume
 63:
 64: volume share-client-7
 65: type protocol/client
 66: option remote-host virt08.casabi.net
 67: option remote-subvolume /export
 68: option transport-type tcp
 69: option username f0a71b3a-1cb2-4a38-8620-f3853aa90798
 70: option password 9641cac2-de93-46