Re: [Gluster-users] DHT with AFR
- Hiren Joshi j...@moonfruit.com wrote: My thinking is both on the client so: I AFR my nodes. I then DHT my AFR bricks. I then mount the DHT vols. Or would I get better performance the other way around? DHT over AFR'd pairs is the configuration you want. You can then add another AFR pair whenever you want to scale up. Vikas -- Engineer - Gluster ___ Gluster-users mailing list Gluster-users@gluster.org http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] DHT with AFR
-Original Message- From: Vikas Gorur [mailto:vi...@gluster.com] Sent: 15 July 2009 09:01 To: Hiren Joshi Cc: Kirby Zhou; gluster-users@gluster.org Subject: Re: [Gluster-users] DHT with AFR - Hiren Joshi j...@moonfruit.com wrote: My thinking is both on the client so: I AFR my nodes. I then DHT my AFR bricks. I then mount the DHT vols. Or would I get better performance the other way around? DHT over AFR'd pairs is the configuration you want. You can then add another AFR pair whenever you want to scale up. When I add another pair, is there a way of re-distributing the data evenly? Will this have a big performance hit? Vikas -- Engineer - Gluster ___ Gluster-users mailing list Gluster-users@gluster.org http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users
[Gluster-users] invalid argument: xattrop_stub
Hi, i installed glusterfs ( v2.0.4 ) on 3 servers. One client, two servers. The System is FreeBSD 7.2. I can start the clusterfsd and clusterfs ( with fuse ). If i want to write something ( like touch file ), following error is logged on the servers. The client says Invalid argument and writes nothing. [2009-07-15 10:37:16] E [server-protocol.c:4681:server_xattrop] biggy: invalid argument: xattrop_stub [2009-07-15 10:37:16] D [server-protocol.c:2386:server_xattrop_cbk] server: 19: XATTROP / (-4294967295) == 1746757056 ((null)) What does this mean? Can you help me? Many Thanks! Kai Here are my configs: # ### GlusterFS Server Volume File ## # ### Export volume biggy with the contents of /home/export directory. volume biggy-dir type storage/posix option directory /home/export end-volume volume biggy type features/posix-locks subvolumes biggy-dir end-volume ### Add network serving capability to above brick. volume server type protocol/server option transport-type tcp option transport.socket.bind-address 192.168.69.158 # ( 192.168.69.5 on the other server ) subvolumes biggy option auth.addr.biggy.allow 192.168.69.* end-volume # ### GlusterFS Client Volume File ## # ### Add client feature and attach to remote subvolume volume biggy1 type protocol/client option transport-type tcp option remote-host 192.168.69.158 option remote-subvolume biggy end-volume volume biggy2 type protocol/client option transport-type tcp option remote-host 192.168.69.5 option remote-subvolume biggy end-volume volume afr type cluster/afr subvolumes biggy1 biggy2 end-volume ___ Gluster-users mailing list Gluster-users@gluster.org http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] invalid argument: xattrop_stub
Hi Kai, Please refer the following page in the document http://www.gluster.org/docs/index.php/Whats_New_v2.0#Known_Issues which explains problems regarding FreeBSD 7.x --- snip - Some known issues and pending activities stalled for upcoming releases. - Distribute translator: uses 64bit inode numbers, as FreeBSD doesn't support 64bit inodes. Distribute is seen to not work on FreeBSDhttp://www.mavetju.org/weblog/html/00262.html -- This problem will happen even for AFR. This could be fixed with patching the fuse kernel module for FreeBSD when they bring in 64bit inode number support. Regards -- Harshavardhana Z Research Inc http://www.zresearch.com/ On Wed, Jul 15, 2009 at 2:35 PM, Kai Kockro kkoc...@mirablau.de wrote: Hi, i installed glusterfs ( v2.0.4 ) on 3 servers. One client, two servers. The System is FreeBSD 7.2. I can start the clusterfsd and clusterfs ( with fuse ). If i want to write something ( like touch file ), following error is logged on the servers. The client says Invalid argument and writes nothing. [2009-07-15 10:37:16] E [server-protocol.c:4681:server_xattrop] biggy: invalid argument: xattrop_stub [2009-07-15 10:37:16] D [server-protocol.c:2386:server_xattrop_cbk] server: 19: XATTROP / (-4294967295) == 1746757056 ((null)) What does this mean? Can you help me? Many Thanks! Kai Here are my configs: # ### GlusterFS Server Volume File ## # ### Export volume biggy with the contents of /home/export directory. volume biggy-dir type storage/posix option directory /home/export end-volume volume biggy type features/posix-locks subvolumes biggy-dir end-volume ### Add network serving capability to above brick. volume server type protocol/server option transport-type tcp option transport.socket.bind-address 192.168.69.158 # ( 192.168.69.5 on the other server ) subvolumes biggy option auth.addr.biggy.allow 192.168.69.* end-volume # ### GlusterFS Client Volume File ## # ### Add client feature and attach to remote subvolume volume biggy1 type protocol/client option transport-type tcp option remote-host 192.168.69.158 option remote-subvolume biggy end-volume volume biggy2 type protocol/client option transport-type tcp option remote-host 192.168.69.5 option remote-subvolume biggy end-volume volume afr type cluster/afr subvolumes biggy1 biggy2 end-volume ___ Gluster-users mailing list Gluster-users@gluster.org http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users ___ Gluster-users mailing list Gluster-users@gluster.org http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] glusterfs 2.0.3 core dump
On the 15-07-2009 at 17:58pm, Vikas Gorur wrote: Do you still have the core file? Can you give us the value of op_ret in frame 0? (frame 0; print op_ret). Sure do, here's the output: #0 client_readv_cbk (frame=0x2c00bb10, hdr=0x9629d40, hdrlen=value optimized out, iobuf=0x0) at client-protocol.c:4319 4319vector.iov_base = iobuf-ptr; (gdb) frame 0 #0 client_readv_cbk (frame=0x2c00bb10, hdr=0x9629d40, hdrlen=value optimized out, iobuf=0x0) at client-protocol.c:4319 4319vector.iov_base = iobuf-ptr; (gdb) print op_ret $1 = 4096 Thanks, Jeff. ___ Gluster-users mailing list Gluster-users@gluster.org http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users
[Gluster-users] io-threads/io-cache
Hi All, http://www.gluster.org/docs/index.php/Translators/performance Can anyone tell me the difference between the 2? It has the same description Thanks, Josh. ___ Gluster-users mailing list Gluster-users@gluster.org http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] glusterfs 2.0.3 core dump
Hi Vikas, Thanks for the output. Could you also send the client log? (If it is too big just send the last 1000 lines or so). Not long at all, as this crash was a controlled (induced) one: Version : glusterfs 2.0.3 built on Jul 12 2009 23:44:40 TLA Revision : v2.0.3 Starting Time: 2009-07-13 00:09:15 Command line : /sbin/glusterfs --log-level=NORMAL --disable-direct-io-mode --volfile=/etc/glusterfs/glusterfs-client.vol /glusterfs/u0 PID : 3663 System name : Linux Nodename : melnode2 Kernel Release : 2.6.18-128.1.6.el5xen Hardware Identifier: x86_64 Given volfile: ** SNIP (see previous post) ** [2009-07-13 00:09:15] W [write-behind.c:1895:init] writebehind: setting window-size to be equal to aggregate-size(131072) [2009-07-13 00:09:15] N [glusterfsd.c:1224:main] glusterfs: Successfully started [2009-07-13 00:09:15] N [client-protocol.c:5559:client_setvolume_cbk] u0-2: Connected to 192.168.200.2:6996, attached to remote volume 'u0'. [2009-07-13 00:09:15] N [afr.c:2199:notify] afr: Subvolume 'u0-2' came back up; going online. [2009-07-13 00:09:15] N [client-protocol.c:5559:client_setvolume_cbk] u0-2: Connected to 192.168.200.2:6996, attached to remote volume 'u0'. [2009-07-13 00:09:15] N [afr.c:2199:notify] afr: Subvolume 'u0-2' came back up; going online. [2009-07-13 00:09:15] N [client-protocol.c:5559:client_setvolume_cbk] u0-2: Connected to 192.168.200.2:6996, attached to remote volume 'u0'. [2009-07-13 00:09:15] N [afr.c:2199:notify] afr: Subvolume 'u0-2' came back up; going online. [2009-07-13 00:09:15] N [client-protocol.c:5559:client_setvolume_cbk] u0-1: Connected to 192.168.200.1:6996, attached to remote volume 'u0'. [2009-07-13 00:09:15] N [client-protocol.c:5559:client_setvolume_cbk] u0-1: Connected to 192.168.200.1:6996, attached to remote volume 'u0'. pending frames: frame : type(1) op(READ) frame : type(1) op(READ) patchset: v2.0.3 signal received: 11 configuration details:argp 1 backtrace 1 db.h 1 dlfcn 1 fdatasync 1 libpthread 1 llistxattr 1 setfsid 1 spinlock 1 epoll.h 1 xattr.h 1 st_atim.tv_nsec 1 package-string: glusterfs 2.0.3 /lib64/libc.so.6[0x303d230280] /lib/glusterfs/2.0.3/xlator/protocol/client.so(client_readv_cbk+0x15d)[0x2b1089e8fa5d]/lib/glusterfs/2.0.3/xlator/protocol/client.so(protocol_client_pollin+0xca)[0x2b1089e807ca]/lib/glusterfs/2.0.3/xlator/protocol/client.so(notify+0x1d2)[0x2b1089e87b42]/lib/glusterfs/2.0.3/transport/socket.so(socket_event_handler+0xd3)[0x2aaafcf3]/lib/libglusterfs.so.0[0x2b10893f5135] /sbin/glusterfs(main+0x96a)[0x4039ea] /lib64/libc.so.6(__libc_start_main+0xf4)[0x303d21d974] /sbin/glusterfs[0x402389] ___ Gluster-users mailing list Gluster-users@gluster.org http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] io-threads/io-cache
I think it's an error with the info that was entered. Hopefully one of the admins sees this and corrects. Justice London Systems Administrator E-mail: jlon...@lawinfo.com Website: www.lawinfo.com Office: 800-397-3743 x105 | Fax: 800-220-4546 # Legal Help For Everyone Find an Attorney: http://www.lawinfo.com/advanced-search.html Lead Counsel Program: http://www.lawinfo.com/programs.html ## PLEASE NOTE: This message, including any attachments, may include privileged, confidential and/or inside information. Any distribution or use of this communication by anyone other than the intended recipient(s) is strictly prohibited and may be unlawful. If you are not the intended recipient, please notify the sender by replying to this message and then delete it from your system. Thank you. _ From: gluster-users-boun...@gluster.org [mailto:gluster-users-boun...@gluster.org] On Behalf Of Hiren Joshi Sent: Wednesday, July 15, 2009 7:24 AM To: gluster-users@gluster.org Subject: [Gluster-users] io-threads/io-cache Hi All, http://www.gluster.org/docs/index.php/Translators/performance Can anyone tell me the difference between the 2? It has the same description Thanks, Josh. Checked by AVG - www.avg.com Version: 8.5.375 / Virus Database: 270.13.14/2238 - Release Date: 07/14/09 18:03:00 ___ Gluster-users mailing list Gluster-users@gluster.org http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] DHT with AFR
If I do this on a client that's solely dedicated to copying out and in again, will there be a performance hit on all the other clients using it? I really like the simplicity of glusterfs, hats off to the dev guys! -Original Message- From: Kirby Zhou [mailto:kirbyz...@sohu-rd.com] Sent: 15 July 2009 16:45 To: Hiren Joshi; 'Vikas Gorur' Cc: gluster-users@gluster.org Subject: RE: [Gluster-users] DHT with AFR AFAIK, There is no method to redistribute your already stored files except copy out then copy in again. -Original Message- From: Hiren Joshi [mailto:j...@moonfruit.com] Sent: Wednesday, July 15, 2009 4:52 PM To: Vikas Gorur Cc: Kirby Zhou; gluster-users@gluster.org Subject: RE: [Gluster-users] DHT with AFR -Original Message- From: Vikas Gorur [mailto:vi...@gluster.com] Sent: 15 July 2009 09:01 To: Hiren Joshi Cc: Kirby Zhou; gluster-users@gluster.org Subject: Re: [Gluster-users] DHT with AFR - Hiren Joshi j...@moonfruit.com wrote: My thinking is both on the client so: I AFR my nodes. I then DHT my AFR bricks. I then mount the DHT vols. Or would I get better performance the other way around? DHT over AFR'd pairs is the configuration you want. You can then add another AFR pair whenever you want to scale up. When I add another pair, is there a way of re-distributing the data evenly? Will this have a big performance hit? Vikas -- Engineer - Gluster ___ Gluster-users mailing list Gluster-users@gluster.org http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users
