[Gluster-users] GlusterFS Install Guide

2013-10-23 Thread lad . raghavendra
Hi GFS,

I am interested to install GlusterFS Server and Client. I need the tutorial or 
Guide request you to send a link or point towards it.

Regards,
Raghavendra Lad

___
Gluster-users mailing list
Gluster-users@gluster.org
http://supercolony.gluster.org/mailman/listinfo/gluster-users


[Gluster-users] Information about Option min-free-disk

2013-10-23 Thread Dragon
Hello,

i have a question about the Volume Option min-free-disk. Actually i set it to 1%. I understand this, that 1% auf the total Space e.g. 100GB out of 10TB will reserved for files which is copied in a distributed cluster. if the file is bigger, it will copied to the next node. i think 100GB is a lot space and  i didnt find out how to set it e.g to 0,5% or 10GB. is this possible and what would happend if i set it to zero, will i lost data?

 

Explain please
___
Gluster-users mailing list
Gluster-users@gluster.org
http://supercolony.gluster.org/mailman/listinfo/gluster-users

[Gluster-users] glusterfsd 3.3.1 VIRT memory allocation

2013-10-23 Thread The Figuras
Hello,

  I past months I have notice *glusterfsd* reserves a lot of VIRT memory.
Has anyone noticed of knows why this is happening?

 TOP shows:

  PID USER  PR  NI  VIRT  RES  SHR S %CPU %MEMTIME+  COMMAND


 1427 root  20   0 * 9.8g*  69m 1468 S  0.0  4.6 745:48.31 glusterfsd
 1439 root  20   0 *10.6g*  67m 1468 S  0.0  4.5 618:09.13 glusterfsd

My specs are on both Gluster Nodes:

- glusterfs 3.3.1 built on Apr 17 2013 17:11:20

- Volume Name: gv0
Type: Distributed-Replicate
Volume ID: 8031aed0-af37-4cae-a4b7-8dc549f3a5e6
Status: Started
Number of Bricks: 2 x 2 = 4
Transport-type: tcp
Bricks:
Brick1: gluster01:/data/bricks/0
Brick2: gluster02:/data/bricks/0
Brick3: gluster01:/data/bricks/1
Brick4: gluster02:/data/bricks/1

  Here are screen shots of Munin graphs which shows how progressively it
keep growing.

Munin graphs:

Year overview -
http://i.imgur.com/aJsgMfh.png

Week overview

http://i.imgur.com/blfetAK.png
___
Gluster-users mailing list
Gluster-users@gluster.org
http://supercolony.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] glusterfs 3.4.1 test performance

2013-10-23 Thread Harshavardhana
Completely normal! - and very good values indeed


On Wed, Oct 23, 2013 at 9:47 AM, huan wang  wrote:

> I test the performance of glusterfs3.4.1.
>
> 1 client---  2 servers(raid 5 800MB/s, 10Gb )
>
> client dd test write .DHT 450MB/s AFR  330MB/s
>
> is it normal ?
>
> thank you very much.
>
> ___
> Gluster-users mailing list
> Gluster-users@gluster.org
> http://supercolony.gluster.org/mailman/listinfo/gluster-users
>



-- 
*Religious confuse piety with mere ritual, the virtuous confuse regulation
with outcomes*
___
Gluster-users mailing list
Gluster-users@gluster.org
http://supercolony.gluster.org/mailman/listinfo/gluster-users

[Gluster-users] glusterfs 3.4.1 test performance

2013-10-23 Thread huan wang
I test the performance of glusterfs3.4.1.

1 client---  2 servers(raid 5 800MB/s, 10Gb )

client dd test write .DHT 450MB/s AFR  330MB/s

is it normal ?

thank you very much.
___
Gluster-users mailing list
Gluster-users@gluster.org
http://supercolony.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] Samba vfs_glusterfs Quota Support?

2013-10-23 Thread Harshavardhana
You should perhaps open a [RFE] ?


On Wed, Oct 23, 2013 at 4:56 AM, David Gibbons wrote:

> Hi All,
>
> I'm setting up a gluster cluster that will be accessed via smb. I was
> hoping that the quotas. I've configured a quota on the path itself:
>
> # gluster volume quota gfsv0 list
> path  limit_set  size
>
> --
> /shares/testsharedave   10GB8.0KB
>
> And I've configured the share in samba (and can access it fine):
> # cat /etc/samba/smb.conf
> [testsharedave]
> vfs objects = glusterfs
> glusterfs:volfile_server = localhost
> glusterfs:volume = gfsv0
> path = /shares/testsharedave
> valid users = dave
> guest ok = no
> writeable = yes
>
> But windows does not reflect the quota and instead shows the full size of
> the gluster volume.
>
> I've reviewed the code in
> https://forge.gluster.org/samba-glusterfs/samba-glusterfs-vfs/blobs/master/src/vfs_glusterfs.c
>  --
> which does not appear to support passing gluster quotas to samba. So I
> don't think my installation is broken, it seems like maybe this just isn't
> supported.
>
> Can anyone speak to whether or not quotas are going to be implemented in
> vfs_glusterfs for samba? Or if I'm just crazy and doing this wrong ;)? I'm
> definitely willing to help with the code but don't have much experience
> with either samba modules or the gluster API.
>
> Cheers,
> Dave
>
>
> ___
> Gluster-users mailing list
> Gluster-users@gluster.org
> http://supercolony.gluster.org/mailman/listinfo/gluster-users
>



-- 
*Religious confuse piety with mere ritual, the virtuous confuse regulation
with outcomes*
___
Gluster-users mailing list
Gluster-users@gluster.org
http://supercolony.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] GlusterFS Install Link ubuntu 12.04

2013-10-23 Thread Brian
THe Ubuntu Server package already has the client bundled in it (like a 
one-stop shop).


You will need to install the client package on each server that wishes 
to access the gluster servers.


So: the servers only need the server package. and the clients only need 
the client package.



Brian Silverwood
Systems Administrator
Viddler | Viddler.com  | 215-962-5829
Subscribe to the Viddler blog 
On 10/23/2013 10:50 AM, Raghavendra Lad wrote:

Hi Brian,

Thank you. I found that package helpful and it worked :)

I have to install the package on Server and Client both (The one you 
provided right?).


I have just installed on one separate Gluster node, is that fine?

I already have Openstak and in that Storage node so should I install 
GLuster server package in that?


Thank you for your help in advance.

Regards,
Raghavendra Lad


On Wed, Oct 23, 2013 at 7:39 AM, Brian > wrote:


glusterfs-client is the package you need for the servers mounting
the gluster server filesystems



Brian Silverwood
Systems Administrator
Viddler | Viddler.com  | 215-962-5829

Subscribe to the Viddler blog 
On 10/23/2013 10:23 AM, Raghavendra Lad wrote:

Hi Brian,

Thank you mate. I would definitely give it a try. Please let me
know if I  need a Server and a Agent for Gluster setup?
I already have Openstack Grizzly and trying to click on Volume
and select the Gluster from Openstack.

Regards,
Raghavendra Lad



On Wed, Oct 23, 2013 at 7:19 AM, Brian mailto:bsilverw...@viddler.com>> wrote:

Here are my step-by-step notes for installing the packages in
12.04 LTS

add-apt-repository ppa:semiosis/ubuntu-glusterfs-3.3
apt-get update
apt-get install glusterfs-server attr chkconfig
gluster --version  # Should report at 3.3.2

Brian Silverwood
Systems Administrator
Viddler | Viddler.com  | 215-962-5829

Subscribe to the Viddler blog 
On 10/23/2013 09:59 AM, Raghavendra Lad wrote:

Hi GFS,

Please provide the link to download and install GlusterFS
for Ubuntu 12.04. I am finding difficulty downloading to
install the packages as well.

I have Openstack Grizzly installed and another GlusterFS
node with Grizzly.

I would also like to know if I already have Openstack
installed and another node of GlusterFS is that enough?  Or
should I need to install another GlusterFS node??


Please clarify.

Regards,
Raghavendra Lad
GlusterFS new user


___
Gluster-users mailing list
Gluster-users@gluster.org  
http://supercolony.gluster.org/mailman/listinfo/gluster-users



___
Gluster-users mailing list
Gluster-users@gluster.org 
http://supercolony.gluster.org/mailman/listinfo/gluster-users







___
Gluster-users mailing list
Gluster-users@gluster.org
http://supercolony.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] GlusterFS Install Link ubuntu 12.04

2013-10-23 Thread Brian
glusterfs-client is the package you need for the servers mounting the 
gluster server filesystems



Brian Silverwood
Systems Administrator
Viddler | Viddler.com  | 215-962-5829
Subscribe to the Viddler blog 
On 10/23/2013 10:23 AM, Raghavendra Lad wrote:

Hi Brian,

Thank you mate. I would definitely give it a try. Please let me know 
if I  need a Server and a Agent for Gluster setup?
I already have Openstack Grizzly and trying to click on Volume and 
select the Gluster from Openstack.


Regards,
Raghavendra Lad



On Wed, Oct 23, 2013 at 7:19 AM, Brian > wrote:


Here are my step-by-step notes for installing the packages in
12.04 LTS

add-apt-repository ppa:semiosis/ubuntu-glusterfs-3.3
apt-get update
apt-get install glusterfs-server attr chkconfig
gluster --version  # Should report at 3.3.2

Brian Silverwood
Systems Administrator
Viddler | Viddler.com  | 215-962-5829

Subscribe to the Viddler blog 
On 10/23/2013 09:59 AM, Raghavendra Lad wrote:

Hi GFS,

Please provide the link to download and install GlusterFS for
Ubuntu 12.04. I am finding difficulty downloading to install the
packages as well.

I have Openstack Grizzly installed and another GlusterFS node
with Grizzly.

I would also like to know if I already have Openstack installed
and another node of GlusterFS is that enough?  Or should I need
to install another GlusterFS node??


Please clarify.

Regards,
Raghavendra Lad
GlusterFS new user


___
Gluster-users mailing list
Gluster-users@gluster.org  
http://supercolony.gluster.org/mailman/listinfo/gluster-users



___
Gluster-users mailing list
Gluster-users@gluster.org 
http://supercolony.gluster.org/mailman/listinfo/gluster-users




___
Gluster-users mailing list
Gluster-users@gluster.org
http://supercolony.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] GlusterFS Install Link ubuntu 12.04

2013-10-23 Thread Brian

Here are my step-by-step notes for installing the packages in 12.04 LTS

add-apt-repository ppa:semiosis/ubuntu-glusterfs-3.3
apt-get update
apt-get install glusterfs-server attr chkconfig
gluster --version  # Should report at 3.3.2

Brian Silverwood
Systems Administrator
Viddler | Viddler.com  | 215-962-5829
Subscribe to the Viddler blog 
On 10/23/2013 09:59 AM, Raghavendra Lad wrote:

Hi GFS,

Please provide the link to download and install GlusterFS for Ubuntu 
12.04. I am finding difficulty downloading to install the packages as 
well.


I have Openstack Grizzly installed and another GlusterFS node with 
Grizzly.


I would also like to know if I already have Openstack installed and 
another node of GlusterFS is that enough? Or should I need to install 
another GlusterFS node??



Please clarify.

Regards,
Raghavendra Lad
GlusterFS new user


___
Gluster-users mailing list
Gluster-users@gluster.org
http://supercolony.gluster.org/mailman/listinfo/gluster-users


___
Gluster-users mailing list
Gluster-users@gluster.org
http://supercolony.gluster.org/mailman/listinfo/gluster-users

[Gluster-users] GlusterFS Install Link ubuntu 12.04

2013-10-23 Thread Raghavendra Lad
Hi GFS,

Please provide the link to download and install GlusterFS for Ubuntu 12.04.
I am finding difficulty downloading to install the packages as well.

I have Openstack Grizzly installed and another GlusterFS node with Grizzly.

I would also like to know if I already have Openstack installed and another
node of GlusterFS is that enough?  Or should I need to install another
GlusterFS node??


Please clarify.

Regards,
Raghavendra Lad
GlusterFS new user
___
Gluster-users mailing list
Gluster-users@gluster.org
http://supercolony.gluster.org/mailman/listinfo/gluster-users

[Gluster-users] Samba vfs_glusterfs Quota Support?

2013-10-23 Thread David Gibbons
Hi All,

I'm setting up a gluster cluster that will be accessed via smb. I was
hoping that the quotas. I've configured a quota on the path itself:

# gluster volume quota gfsv0 list
path  limit_set  size
--
/shares/testsharedave   10GB8.0KB

And I've configured the share in samba (and can access it fine):
# cat /etc/samba/smb.conf
[testsharedave]
vfs objects = glusterfs
glusterfs:volfile_server = localhost
glusterfs:volume = gfsv0
path = /shares/testsharedave
valid users = dave
guest ok = no
writeable = yes

But windows does not reflect the quota and instead shows the full size of
the gluster volume.

I've reviewed the code in
https://forge.gluster.org/samba-glusterfs/samba-glusterfs-vfs/blobs/master/src/vfs_glusterfs.c
--
which does not appear to support passing gluster quotas to samba. So I
don't think my installation is broken, it seems like maybe this just isn't
supported.

Can anyone speak to whether or not quotas are going to be implemented in
vfs_glusterfs for samba? Or if I'm just crazy and doing this wrong ;)? I'm
definitely willing to help with the code but don't have much experience
with either samba modules or the gluster API.

Cheers,
Dave
___
Gluster-users mailing list
Gluster-users@gluster.org
http://supercolony.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] [Gluster-devel] GlusterFS 3.3.1 client crash (signal received: 6)

2013-10-23 Thread Song
Pranith,

Thanks for your detail answer. 

Our workload includes CREATE/WRITE/READ/STAT/ACCESS, as well as chmod(filepath, 
0). While I don't know which kind of workload lead to the crash.
We have analyzed the related code such as dict, lookup of cluster/afr, lookup 
of protocol/client and have nothing useful information to help locate the 
issues.

Song.

-Original Message-
From: Pranith Kumar Karampuri [mailto:pkara...@redhat.com] 
Sent: Tuesday, October 22, 2013 5:25 PM
To: Song
Cc: John Mark Walker; gluster-users@gluster.org
Subject: Re: [Gluster-users] [Gluster-devel] GlusterFS 3.3.1 client crash 
(signal received: 6)

Song,
 The information printed in that function gf_print_trace has been useful in 
the sense that we know it happens when there is a double 'memput' of one of the 
data structures as part of 'lookup'. The problem is this issue seems to be 
happening only in some peculiar case, which unfortunately you are hitting every 
day on 1-2 clients. That is why I was trying to figure out what the workload is.

Let me tell you what I mean by 'workload' is.
For example:
For websites which do some kind of image manipulation. They generally CREATE 
temporary information and do some transformations i.e. READS/WRITES and then 
RENAME them to the actual files.
So here the work load is CREATE/READ/WRITE/RENAME intensive.

To give you one more example:
VM image hosting(At least with the KVM images that I test generally), On each 
VM image it pretty much does WRITES, READs, STATs so it is WRITEs/STATs/READs 
intensive.

I would really like to know what kind of workload happens on your setup to 
figure out what is that peculiar thing that may lead to this crash.

Pranith.

- Original Message -
> From: "Song" 
> To: "Song" , "John Mark Walker" , 
> "Pranith Kumar Karampuri"
> 
> Cc: gluster-users@gluster.org
> Sent: Tuesday, October 22, 2013 1:56:48 PM
> Subject: RE: [Gluster-users] [Gluster-devel] GlusterFS 3.3.1 client crash 
> (signal received: 6)
> 
> To locate this issue, is it possible to print more useful information 
> in backtrace?
> When client crashed, trace information was printed. Which is coded in 
> function of "gf_print_trace", in common-utils.c.
> I hope that some helpful debug information would be appended in this 
> function and when client crash next time, the data can help us to 
> analyze the problem.
> 
> Could you give me the suggestion what codes is useful?
> Thanks!
> 
> -Original Message-
> From: gluster-users-boun...@gluster.org 
> [mailto:gluster-users-boun...@gluster.org] On Behalf Of Song
> Sent: Friday, September 06, 2013 10:17 AM
> To: 'John Mark Walker'; 'Pranith Kumar Karampuri'
> Cc: gluster-users@gluster.org
> Subject: Re: [Gluster-users] [Gluster-devel] GlusterFS 3.3.1 client 
> crash (signal received: 6)
> 
> It's a pity I don't know how to re-create the issue. While there are 
> 1-2 crashed clients in total 120 clients every day.
> 
> Below is gdb result:
> 
> (gdb) where
> #0  0x003267432885 in raise () from /lib64/libc.so.6
> #1  0x003267434065 in abort () from /lib64/libc.so.6
> #2  0x00326746f7a7 in __libc_message () from /lib64/libc.so.6
> #3  0x0032674750c6 in malloc_printerr () from /lib64/libc.so.6
> #4  0x7fc4f2847684 in mem_put (ptr=0x7fc4b0a4c03c) at 
> mem-pool.c:559
> #5  0x7fc4f281cc9b in dict_destroy (this=0x7fc4f12cc5cc) at 
> dict.c:397
> #6  0x7fc4ede24c30 in afr_local_cleanup (local=0x7fc4ce68ac20, 
> this=) at afr-common.c:848
> #7  0x7fc4ede2c0f1 in afr_lookup_done (frame=0x18d5ae4, 
> cookie=0x0, this=, op_ret=, 
> op_errno=, inode=0x18d5b20,
> buf=0x7fffcb83ec50, xattr=0x7fc4f12e1818, 
> postparent=0x7fffcb83ebe0) at
> afr-common.c:1881
> #8  afr_lookup_cbk (frame=0x18d5ae4, cookie=0x0, this= out>, op_ret=, op_errno=, 
> inode=0x18d5b20, buf=0x7fffcb83ec50,
> xattr=0x7fc4f12e1818, postparent=0x7fffcb83ebe0) at 
> afr-common.c:2044
> #9  0x7fc4ee066550 in client3_1_lookup_cbk (req= out>, iov=, count=,
> myframe=0x7fc4f16f390c) at client3_1-fops.c:2636
> #10 0x7fc4f25ff4e5 in rpc_clnt_handle_reply (clnt=0x3b5c600,
> pollin=0x6ba00f0) at rpc-clnt.c:786
> #11 0x7fc4f25ffce0 in rpc_clnt_notify (trans= out>, mydata=0x3b5c630, event=, data= optimized out>) at rpc-clnt.c:905
> #12 0x7fc4f25faeb8 in rpc_transport_notify (this= out>, event=, data=) at
> rpc-transport.c:489
> #13 0x7fc4eeeb0764 in socket_event_poll_in (this=0x3b6c060) at
> socket.c:1677
> #14 0x7fc4eeeb0847 in socket_event_handler (fd= out>, idx=265, data=0x3b6c060, poll_in=1, poll_out=0, poll_err= optimized
> out>) at socket.c:1792
> #15 0x7fc4f2846464 in event_dispatch_epoll_handler
> (event_pool=0x177cdf0) at event.c:785
> #16 event_dispatch_epoll (event_pool=0x177cdf0) at event.c:847
> #17 0x0040736a in main (argc=,
> argv=0x7fffcb83efc8) at glusterfsd.c:1689
> 
> 
> -Original Message-
> From: jowal...@redhat.com [mailto:jowal...@redhat.com] On Behalf Of 
> John Mark Walker

Re: [Gluster-users] New to GlusterFS

2013-10-23 Thread Hoggins!
Hey guys,

By the way, when I issue service glusterd stop and service glusterfsd
stop, there are still gluster* processes running on the machine, even
after a minute.
Is that a normal behavior, should I kill them directly, should I just
wait for them to die peacefully, or is it safe to shutdown the machine
at this moment ?

Thanks !


Le 23/10/2013 07:32, Joe Julian a écrit :
> Yes.
>
> Bobby Jacob  wrote:
>
> Joe,
>
> You mentioned “If you shut down a server through the normal kill
> process”:
>
> What do you mean by normal kill process. Is it just shutdown the
> server for maintanence after going a “service glusterd stop” and
> “service glusterfsd stop”.
>

___
Gluster-users mailing list
Gluster-users@gluster.org
http://supercolony.gluster.org/mailman/listinfo/gluster-users