Re: [Gluster-users] Issue with Samba over Gluster
Pavan, As i said before that i cannot switch to gluster 3.0.5 as most of my applications dont work properly in 3.0.5 so i am giving u all the info required using 3.0.4 version. I used to get the same issue with 3.0.5 also with samba. Here are the trace logs : http://dpaste.com/217973/ I have attached core dump file. Please have a look and reply. Irshad On Tue, Jul 13, 2010 at 1:10 PM, Irshad Ahmed irshad2...@gmail.com wrote: ThanxI will surely do what you have asked. I was using 3.0.5...But had to remove it as my Jira Atlassian applications were crashing and i dont know why. So reverted back to 3.0.4 and they started working normally. Whenever i mounted my gluster volume it used to show split brain afr error in the logs. But as far as samba is concerned it not working in 3.0.4 nor in 3.0.5. I will send in logs asap. Irshad On Tue, Jul 13, 2010 at 1:07 PM, Pavan Sondur pa...@gluster.com wrote: Hi Irshad, Are you using GlusterFS 3.0.5? If not, give 3.0.5 a try and let us know how it goes. If you run into this problem, try capturing some data which can be useful for debugging - * Use 'option trace on' in the locks translator in the vol file The will print debug info in the log (in normal logging mode). * If users are experiencing hung like behavior, initiate a process state dump - kill -USR1 pid of glusterfs This will dump the state of glusterfs in /tmp/glusterdump.pid Send us the state dump and the logs if you run into the issues you mentioned. Pavan - Original Message - From: Irshad Ahmed irshad2...@gmail.com To: Gluster General Discussion List gluster-users@gluster.org Sent: Sunday, July 11, 2010 10:41:43 AM Subject: [Gluster-users] Issue with Samba over Gluster Hey guys, I am facing an issue with samba. When i expose a gluster volume using samba so my windows users can connect to it. My windows users normally use Microsoft Office and some use OpenOffice as they store all Excel/PPT/Word file in samba share. Users who use OpenOffice are able to work properly without any issues. But users who use Microsoft Office are not able to even open the files exposed by samba. When they try to open a file they get downloading file and then it timeouts and gives an error cannot read from source. This is my Gluster Server Config # Filestore Volume to be mounted volume gluster-filestore-data type storage/posix option directory /data/mpath2/filestore-data end-volume volume gluster-filestore-data-lock type features/locks subvolumes gluster-filestore-data end-volume volume gluster-filestore-data-brick type performance/io-threads option thread-count 16 subvolumes gluster-filestore-data-lock end-volume volume gluster-filestore-data-server type protocol/server option transport-type tcp option transport.socket.listen-port 7001 option auth.addr.gluster-filestore-data-brick.allow 10.15.* subvolumes gluster-filestore-data-brick end-volume Gluster Client Config volume gluster-filestore-data-1 type protocol/client option transport-type tcp option remote-host 10.15.6.10 option remote-port 7001 option remote-subvolume gluster-filestore-data-brick end-volume volume gluster-filestore-data-2 type protocol/client option transport-type tcp option remote-host 10.15.6.11 option remote-port 7001 option remote-subvolume gluster-filestore-data-brick end-volume volume replicate type cluster/replicate subvolumes gluster-filestore-data-1 gluster-filestore-data-2 end-volume volume writebehind type performance/write-behind option cache-size 1MB subvolumes replicate end-volume volume cache type performance/io-cache option cache-size 512MB subvolumes writebehind end-volume I tested samba without gluster and it works fine so this is not a samba issue. I did some more testing to find out what happening with samba over gluster. I check the logs of samba and when i access files using MS Office i get oplock errors. I tried disabling oplock and MS Office application was able to open the file but in read-only mode but OpenOffice stopepd working now. If i enable oplocks everything started working other than MS Office. I dont see any kind of crash logs or any other logging in gluster logs. Any help please -- Irshad Ahmed ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users -- Irshad Ahmed -- Irshad Ahmed ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Issue with Samba over Gluster
ThanxI will surely do what you have asked. I was using 3.0.5...But had to remove it as my Jira Atlassian applications were crashing and i dont know why. So reverted back to 3.0.4 and they started working normally. Whenever i mounted my gluster volume it used to show split brain afr error in the logs. But as far as samba is concerned it not working in 3.0.4 nor in 3.0.5. I will send in logs asap. Irshad On Tue, Jul 13, 2010 at 1:07 PM, Pavan Sondur pa...@gluster.com wrote: Hi Irshad, Are you using GlusterFS 3.0.5? If not, give 3.0.5 a try and let us know how it goes. If you run into this problem, try capturing some data which can be useful for debugging - * Use 'option trace on' in the locks translator in the vol file The will print debug info in the log (in normal logging mode). * If users are experiencing hung like behavior, initiate a process state dump - kill -USR1 pid of glusterfs This will dump the state of glusterfs in /tmp/glusterdump.pid Send us the state dump and the logs if you run into the issues you mentioned. Pavan - Original Message - From: Irshad Ahmed irshad2...@gmail.com To: Gluster General Discussion List gluster-users@gluster.org Sent: Sunday, July 11, 2010 10:41:43 AM Subject: [Gluster-users] Issue with Samba over Gluster Hey guys, I am facing an issue with samba. When i expose a gluster volume using samba so my windows users can connect to it. My windows users normally use Microsoft Office and some use OpenOffice as they store all Excel/PPT/Word file in samba share. Users who use OpenOffice are able to work properly without any issues. But users who use Microsoft Office are not able to even open the files exposed by samba. When they try to open a file they get downloading file and then it timeouts and gives an error cannot read from source. This is my Gluster Server Config # Filestore Volume to be mounted volume gluster-filestore-data type storage/posix option directory /data/mpath2/filestore-data end-volume volume gluster-filestore-data-lock type features/locks subvolumes gluster-filestore-data end-volume volume gluster-filestore-data-brick type performance/io-threads option thread-count 16 subvolumes gluster-filestore-data-lock end-volume volume gluster-filestore-data-server type protocol/server option transport-type tcp option transport.socket.listen-port 7001 option auth.addr.gluster-filestore-data-brick.allow 10.15.* subvolumes gluster-filestore-data-brick end-volume Gluster Client Config volume gluster-filestore-data-1 type protocol/client option transport-type tcp option remote-host 10.15.6.10 option remote-port 7001 option remote-subvolume gluster-filestore-data-brick end-volume volume gluster-filestore-data-2 type protocol/client option transport-type tcp option remote-host 10.15.6.11 option remote-port 7001 option remote-subvolume gluster-filestore-data-brick end-volume volume replicate type cluster/replicate subvolumes gluster-filestore-data-1 gluster-filestore-data-2 end-volume volume writebehind type performance/write-behind option cache-size 1MB subvolumes replicate end-volume volume cache type performance/io-cache option cache-size 512MB subvolumes writebehind end-volume I tested samba without gluster and it works fine so this is not a samba issue. I did some more testing to find out what happening with samba over gluster. I check the logs of samba and when i access files using MS Office i get oplock errors. I tried disabling oplock and MS Office application was able to open the file but in read-only mode but OpenOffice stopepd working now. If i enable oplocks everything started working other than MS Office. I dont see any kind of crash logs or any other logging in gluster logs. Any help please -- Irshad Ahmed ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users -- Irshad Ahmed ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Issue with Samba over Gluster
Can any1 please reply on this ? Irshad On Sun, Jul 11, 2010 at 10:41 AM, Irshad Ahmed irshad2...@gmail.com wrote: Hey guys, I am facing an issue with samba. When i expose a gluster volume using samba so my windows users can connect to it. My windows users normally use Microsoft Office and some use OpenOffice as they store all Excel/PPT/Word file in samba share. Users who use OpenOffice are able to work properly without any issues. But users who use Microsoft Office are not able to even open the files exposed by samba. When they try to open a file they get downloading file and then it timeouts and gives an error cannot read from source. This is my Gluster Server Config # Filestore Volume to be mounted volume gluster-filestore-data type storage/posix option directory /data/mpath2/filestore-data end-volume volume gluster-filestore-data-lock type features/locks subvolumes gluster-filestore-data end-volume volume gluster-filestore-data-brick type performance/io-threads option thread-count 16 subvolumes gluster-filestore-data-lock end-volume volume gluster-filestore-data-server type protocol/server option transport-type tcp option transport.socket.listen-port 7001 option auth.addr.gluster-filestore-data-brick.allow 10.15.* subvolumes gluster-filestore-data-brick end-volume Gluster Client Config volume gluster-filestore-data-1 type protocol/client option transport-type tcp option remote-host 10.15.6.10 option remote-port 7001 option remote-subvolume gluster-filestore-data-brick end-volume volume gluster-filestore-data-2 type protocol/client option transport-type tcp option remote-host 10.15.6.11 option remote-port 7001 option remote-subvolume gluster-filestore-data-brick end-volume volume replicate type cluster/replicate subvolumes gluster-filestore-data-1 gluster-filestore-data-2 end-volume volume writebehind type performance/write-behind option cache-size 1MB subvolumes replicate end-volume volume cache type performance/io-cache option cache-size 512MB subvolumes writebehind end-volume I tested samba without gluster and it works fine so this is not a samba issue. I did some more testing to find out what happening with samba over gluster. I check the logs of samba and when i access files using MS Office i get oplock errors. I tried disabling oplock and MS Office application was able to open the file but in read-only mode but OpenOffice stopepd working now. If i enable oplocks everything started working other than MS Office. I dont see any kind of crash logs or any other logging in gluster logs. Any help please -- Irshad Ahmed -- Irshad Ahmed ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
[Gluster-users] Issue with Samba over Gluster
Hey guys, I am facing an issue with samba. When i expose a gluster volume using samba so my windows users can connect to it. My windows users normally use Microsoft Office and some use OpenOffice as they store all Excel/PPT/Word file in samba share. Users who use OpenOffice are able to work properly without any issues. But users who use Microsoft Office are not able to even open the files exposed by samba. When they try to open a file they get downloading file and then it timeouts and gives an error cannot read from source. This is my Gluster Server Config # Filestore Volume to be mounted volume gluster-filestore-data type storage/posix option directory /data/mpath2/filestore-data end-volume volume gluster-filestore-data-lock type features/locks subvolumes gluster-filestore-data end-volume volume gluster-filestore-data-brick type performance/io-threads option thread-count 16 subvolumes gluster-filestore-data-lock end-volume volume gluster-filestore-data-server type protocol/server option transport-type tcp option transport.socket.listen-port 7001 option auth.addr.gluster-filestore-data-brick.allow 10.15.* subvolumes gluster-filestore-data-brick end-volume Gluster Client Config volume gluster-filestore-data-1 type protocol/client option transport-type tcp option remote-host 10.15.6.10 option remote-port 7001 option remote-subvolume gluster-filestore-data-brick end-volume volume gluster-filestore-data-2 type protocol/client option transport-type tcp option remote-host 10.15.6.11 option remote-port 7001 option remote-subvolume gluster-filestore-data-brick end-volume volume replicate type cluster/replicate subvolumes gluster-filestore-data-1 gluster-filestore-data-2 end-volume volume writebehind type performance/write-behind option cache-size 1MB subvolumes replicate end-volume volume cache type performance/io-cache option cache-size 512MB subvolumes writebehind end-volume I tested samba without gluster and it works fine so this is not a samba issue. I did some more testing to find out what happening with samba over gluster. I check the logs of samba and when i access files using MS Office i get oplock errors. I tried disabling oplock and MS Office application was able to open the file but in read-only mode but OpenOffice stopepd working now. If i enable oplocks everything started working other than MS Office. I dont see any kind of crash logs or any other logging in gluster logs. Any help please -- Irshad Ahmed ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Gluster Volume Crash
On Sat, Jul 3, 2010 at 6:30 PM, Irshad Ahmed irshad2...@gmail.com wrote:
I installed glusterfs using rpmSo should i install glusterfs by
compiling it ?
Is der any other way i can perform the said actions in my rpm installed
gluster ?
If der is no other way other than compiling then i wil;l do what you have
said.
But please lemme know if i can do it using my rpm.
Irshad
On Sat, Jul 3, 2010 at 10:42 AM, sac s...@gluster.com wrote:
Hi,
On Sat, Jul 3, 2010 at 10:16 AM, Irshad Ahmed irshad2...@gmail.comwrote:
Any help on this please.
While you do configure do:
# ./configure CFLAGS=-g
# make install
When it crashes attach the core to gdb
# gdb /path/to/glusterfsd /path/to/core.pid
# thread apply all bt full
This will give you complete backtrace. Please post that to us.
Regards,
Sachidananda.
--
Irshad Ahmed
Please check and revert me back soon.
Here is the core dump
(gdb) thread apply all bt full
Thread 3 (Thread 12440):
#0 0x00354029a0b1 in nanosleep () from /lib64/libc.so.6
No symbol table info available.
#1 0x0035402cd684 in usleep () from /lib64/libc.so.6
No symbol table info available.
#2 0x2b0db703db85 in gf_timer_proc (ctx=0x1648f010) at timer.c:177
now = 1278419884386169
now_tv = {tv_sec = 1278419884, tv_usec = 386169}
event = 0x1649c3f0
reg = 0x16498c40
__FUNCTION__ = gf_timer_proc
#3 0x003540a06617 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#4 0x0035402d3c2d in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 2 (Thread 12446):
#0 0x0035402cc7a3 in readv () from /lib64/libc.so.6
No symbol table info available.
#1 0x2b0db87ba6a9 in fuse_thread_proc (data=0x16490620) at
fuse-bridge.c:3125
mount_point = 0x0
this = 0x16490620
priv = 0x16498e20
res = 88
iobuf = 0x164900a8
finh = 0x164a7f90
iov_in = {{iov_base = 0x164aa6f0, iov_len = 80}, {iov_base =
0x2b0db7a61000, iov_len = 131072}}
msg = 0x164a7fb8
msg0_size = 168
ret = 0
now = {tv_sec = 1278419810, tv_usec = 391029}
timeout = {tv_sec = 1278419811, tv_nsec = 391029000}
__FUNCTION__ = fuse_thread_proc
#2 0x003540a06617 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#3 0x0035402d3c2d in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 1 (Thread 12439):
#0 0x2b0db87b90e5 in fuse_getlk_cbk (frame=0x164a81c8,
cookie=0x164a2b80, this=0x16490620, op_ret=0, op_errno=0, lock=0x0) at
fuse-bridge.c:2753
state = 0x164a7350
flo = {lk = {start = 0, end = 0, type = 0, pid = 0}}
__FUNCTION__ = fuse_getlk_cbk
#1 0x2b0db7035db9 in default_lk_cbk (frame=0x164a2b80,
cookie=0x164a78a0, this=0x16497df0, op_ret=0, op_errno=0, lock=0x0) at
defaults.c:1056
fn = 0x2b0db87b9037 fuse_getlk_cbk
_parent = 0x164a81c8
old_THIS = 0x16497df0
#2 0x2b0db838c035 in qr_lk_cbk (frame=0x164a78a0,
cookie=0x2c004e60, this=0x164975b0, op_ret=0, op_errno=0, lock=0x0) at
quick-read.c:2015
fn = 0x2b0db7035cef default_lk_cbk
_parent = 0x164a2b80
old_THIS = 0x164975b0
#3 0x2b0db7035db9 in default_lk_cbk (frame=0x2c004e60,
cookie=0x2c004be0, this=0x16496bf0, op_ret=0, op_errno=0, lock=0x0) at
defaults.c:1056
fn = 0x2b0db838bf73 qr_lk_cbk
_parent = 0x164a78a0
old_THIS = 0x16496bf0
#4 0x2b0db7035db9 in default_lk_cbk (frame=0x2c004be0,
cookie=0x2c0050e0, this=0x164962c0, op_ret=0, op_errno=0, lock=0x0) at
defaults.c:1056
fn = 0x2b0db7035cef default_lk_cbk
_parent = 0x2c004e60
old_THIS = 0x164962c0
---Type return to continue, or q return to quit---
#5 0x2b0db7d23e97 in afr_lk_cbk (frame=0x2c0050e0, cookie=0x1,
this=0x16495a30, op_ret=-1, op_errno=77, lock=0x0) at afr.c:2454
fn = 0x2b0db7035cef default_lk_cbk
_parent = 0x2c004be0
old_THIS = 0x16495a30
__local = 0x2c02dc60
__this = 0x16495a30
local = 0x2c02dc60
priv = 0x16499480
call_count = -1
child_index = 2
#6 0x2b0db7afcc4d in client_lk (frame=0x2c0252f0, this=0x164954d0,
fd=0x164a0f30, cmd=5, flock=0x2c02df98) at client-protocol.c:2875
fn = 0x2b0db7d23912 afr_lk_cbk
_parent = 0x2c0050e0
old_THIS = 0x164954d0
ret = -1
hdr = 0x0
req = 0x0
hdrlen = 0
remote_fd = -1
gf_cmd = 0
gf_type = 0
fdctx = 0x0
conf = 0x164995e0
__FUNCTION__ = client_lk
#7 0x2b0db7d23c55 in afr_lk_cbk (frame=0x2c0050e0, cookie=0x0,
this=0x16495a30, op_ret=0, op_errno=0, lock=0x7fffeb8baa40) at afr.c:2442
_new = 0x2c0252f0
old_THIS = 0x16495a30
tmp_cbk = 0x2b0db7d23912 afr_lk_cbk
local = 0x2c02dc60
priv
[Gluster-users] Gluster Volume Crash
Hey guys, Please help me out with this issue in gluster. I mounted a gluster volume on a server and using samba so my windows clients can access the shares. This volume is used for sharing purpose. Gluster Version Used : 3.0.4 OS : CentOS Linux 5.4 (64 Bit) Kernel Version : 2.6.18-164.15.1.el5 Here is my gluster client volume config Gluster Config : http://dpaste.com/213489/ Here is my gluster server config Gluster Server Config : http://dpaste.com/213818/ My crash logs Crash Log : http://dpaste.com/213817/ http://dpaste.com/213488/ I did some more testing and this is what i found. * When i try to browse any folders in that share it works fine and gluster does nto crash * But when i try to browse any file in a folder or open a file gluster crashes. This is pretty weird and it only crashes when any file is touched. Also one more imp aspect is that i am using replicate in my gluster client volume file. If i remove the replicate xlator it works fine. But as we need replication so i cannot live without it. Any kind of info would be of great help. Irshad ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
