Re: [Gluster-users] GlusterFS over S3FS

2016-06-15 Thread Niklaas Baudet von Gersdorff
Vincent Miszczak [2016-06-15 10:27 +] :

> I would like to combine Glusterfs with S3FS.
[...]
> I also have the idea to test this with Swift object storage. Advises are 
> welcome.

Never tried this before. Maybe S3QL [1] works since it "is
a standard conforming, full featured UNIX file system that is
conceptually indistinguishable from any local file system".

1: https://bitbucket.org/nikratio/s3ql/

The entire approach sounds a bit hackish to me though. :-)

Niklaas


signature.asc
Description: PGP signature
___
Gluster-users mailing list
Gluster-users@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] Gluster update

2016-05-27 Thread Niklaas Baudet von Gersdorff
Gandalf Corvotempesta [2016-05-27 13:18 +0200] :

> and the recommended way is to shut everything down as the rolling
> update states: "feel adventurous"

I just read that... Anyway, I hope that it's possible. I'm with you
since I don't see a point in a clustered file system if you can't take
a node down by plan. Not only to upgrade GlusterFS, but the entire
system.

Niklaas


signature.asc
Description: PGP signature
___
Gluster-users mailing list
Gluster-users@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] Gluster update

2016-05-27 Thread Niklaas Baudet von Gersdorff
Niklaas Baudet von Gersdorff [2016-05-27 13:12 +0200] :

> Gandalf Corvotempesta [2016-05-27 12:17 +0200] :
> 
> > Please read this:
> > http://www.gluster.org/community/documentation/index.php/Upgrade_to_3.7
> > 
> > "GlusterFS upgrade to 3.7.x
> > "a) Scheduling a downtime
> > For this approach, schedule a downtime and prevent all your clients
> > from accessing (umount your volumes, stop gluster Volumes..etc)the
> > servers."
> 
> On the website there a options a (the one you quoted) *and b*. The
> second option says
> 
>  b) Rolling Upgrade [TBD] 
> 
> I guess, this can be translated in two ways. First, at this stage is it
> not possible to perform a rolling upgrade. Because of this, this is
> something that needs to be worked on (to be done). Or, second, it is
> indeed possible to perform a rolling upgrade. Nonetheless, we still have
> to document here how to do; this documentation needs to be done.
> 
> Just my two cents.

Please see

http://www.gluster.org/community/documentation/index.php/Upgrade_to_3.5

where it's documented how to perform a rolling upgrade. This is for 3.5
but maybe you can adapt this procedure (in hope that the feature
"performing rolling upgrades" didn't become abandoned in more recent
versions).

That was my third cent.

Niklaas


signature.asc
Description: PGP signature
___
Gluster-users mailing list
Gluster-users@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] Gluster update

2016-05-27 Thread Niklaas Baudet von Gersdorff
Gandalf Corvotempesta [2016-05-27 12:17 +0200] :

> Please read this:
> http://www.gluster.org/community/documentation/index.php/Upgrade_to_3.7
> 
> "GlusterFS upgrade to 3.7.x
> "a) Scheduling a downtime
> For this approach, schedule a downtime and prevent all your clients
> from accessing (umount your volumes, stop gluster Volumes..etc)the
> servers."

On the website there a options a (the one you quoted) *and b*. The
second option says

 b) Rolling Upgrade [TBD] 

I guess, this can be translated in two ways. First, at this stage is it
not possible to perform a rolling upgrade. Because of this, this is
something that needs to be worked on (to be done). Or, second, it is
indeed possible to perform a rolling upgrade. Nonetheless, we still have
to document here how to do; this documentation needs to be done.

Just my two cents.

Niklaas


signature.asc
Description: PGP signature
___
Gluster-users mailing list
Gluster-users@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] file permissions for shared access

2016-05-25 Thread Niklaas Baudet von Gersdorff
Ryan Brothers [2016-05-25 14:38 -0400] :

> I am mounting a gluster volume on several clients for shared access.
> The uid's and gid's of the users and groups do not match on each of
> the clients, so a given user could have a different uid on each
> client.

I am not a professional, so take the following advice with a grain of
salt: Have you thought about using bindfs [1] to map uid and gid as
needed?

1: http://bindfs.org/

Niklaas


signature.asc
Description: PGP signature
___
Gluster-users mailing list
Gluster-users@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] 0-management: argument invalid

2016-05-25 Thread Niklaas Baudet von Gersdorff
Atin Mukherjee [2016-05-25 18:30 +0530] :

> It seems like 24007 port is blocked by firewall. Also brick process
> starts binding from port 49152, so you may have to open up those ports too.

I can confirm that it was related to some firewall/network related
issue. I could eventually solve the problem. Thanks again!

Niklaas


signature.asc
Description: PGP signature
___
Gluster-users mailing list
Gluster-users@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] 0-management: argument invalid

2016-05-25 Thread Niklaas Baudet von Gersdorff
Niklaas Baudet von Gersdorff [2016-05-25 13:59 +0200] :

> To me it looks like a firewall issue since there's a problem
> establishing a connection (see line 2 and three). Yet, IP 10.1.0.1 is
> on an internal interface that is not protected by firewall:

I just figured out that it's indeed a problem with the firewall. So the
problem should be solved once I set up the firewall correctly.

> Maybe that's causing some issues. How can I force the daemon to only
> listen to IP 10.1.0.1?

Anyway, I will be happy if someone can provide me the answer to the
question above. I prefer services not to listen on every IP address.

Niklaas


signature.asc
Description: PGP signature
___
Gluster-users mailing list
Gluster-users@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] 0-management: argument invalid

2016-05-25 Thread Niklaas Baudet von Gersdorff
Atin Mukherjee [2016-05-25 15:50 +0530] :

> Could you check the brick log?

Sorry, I was not aware of the fact that there is an additional log. Here
it is:

[2016-05-25 08:26:11.830795] I [MSGID: 100030] [glusterfsd.c:2318:main] 
0-/usr/local/sbin/glusterfsd: Started running /usr/local/sbin/glusterfsd 
version 3.7.6 (args: /usr/local/sbin/glusterfsd -s box-fra-01.klaas 
--volfile-id volume1.box-fra-01.klaas.usr-local-glusterfs-volume1 -p 
/var/db/glusterd/vols/volume1/run/box-fra-01.klaas-usr-local-glusterfs-volume1.pid
 -S /var/run/gluster/f816ca60d4f69f995e570ed408036266.socket --brick-name 
/usr/local/glusterfs/volume1 -l 
/var/log/glusterfs/bricks/usr-local-glusterfs-volume1.log --xlator-option 
*-posix.glusterd-uuid=2a95ee7c-bfb7-4acd-b029-42da963d5862 --brick-port 49153 
--xlator-option volume1-server.listen-port=49153)
[2016-05-25 08:27:26.838921] E [socket.c:2278:socket_connect_finish] 
0-glusterfs: connection to 10.1.0.1:24007 failed (Operation timed out)
[2016-05-25 08:27:26.839707] E [glusterfsd-mgmt.c:1818:mgmt_rpc_notify] 
0-glusterfsd-mgmt: failed to connect with remote-host: box-fra-01.klaas 
(Connection reset by peer)
[2016-05-25 08:27:26.839756] I [glusterfsd-mgmt.c:1824:mgmt_rpc_notify] 
0-glusterfsd-mgmt: Exhausted all volfile servers
[2016-05-25 08:27:26.840712] W [glusterfsd.c:1236:cleanup_and_exit] 
(-->0x40d0a0  at /usr/local/sbin/glusterfsd -->0x4079ed  at 
/usr/local/sbin/glusterfsd ) 0-: received signum (1), shutting down
[2016-05-25 08:27:26.848019] W [rpc-clnt.c:1586:rpc_clnt_submit] 
0-glusterfs: failed to submit rpc-request (XID: 0x1 Program: Gluster Portmap, 
ProgVers: 1, Proc: 5) to rpc-transport (glusterfs)

To me it looks like a firewall issue since there's a problem
establishing a connection (see line 2 and three). Yet, IP 10.1.0.1 is on
an internal interface that is not protected by firewall:

tap0: flags=8943 metric 0 
mtu 1500
options=8
ether 00:bd:17:0f:00:00
inet6 fd16:dcc0:f4cc::1:0:1 prefixlen 80 
inet6 fe80::2bd:17ff:fe0f:0%tap0 prefixlen 64 scopeid 0x4 
inet 10.1.0.1 netmask 0xff00 broadcast 10.255.255.255 
nd6 options=21
media: Ethernet autoselect
status: active
Opened by PID 10208

Further, I noticed that the daemon listens on every IP address:

USER COMMANDPID   FD PROTO  LOCAL ADDRESS FOREIGN ADDRESS   
   
root glusterfsd 27595 11 tcp4   *:24007   *:*

Maybe that's causing some issues. How can I force the daemon to only
listen to IP 10.1.0.1?

Niklaas


signature.asc
Description: PGP signature
___
Gluster-users mailing list
Gluster-users@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-users

[Gluster-users] 0-management: argument invalid

2016-05-25 Thread Niklaas Baudet von Gersdorff
Hello,

on a FreeBSD 10.3 machine I get the following error if I try to start
a volume with `gluster volume start volume1`:

[2016-05-25 08:26:11.807056] W [common-utils.c:1685:gf_string2boolean] 
(-->0x8048d84e4  at 
/usr/local/lib/glusterfs/3.7.6/xlator/mgmt/glusterd.so -->0x800870f6b 
 at /usr/local/lib/libglusterfs.so.0 ) 0-management: 
argument invalid [Invalid argument]
[2016-05-25 08:27:26.845925] E [MSGID: 106005] 
[glusterd-utils.c:4534:glusterd_brick_start] 0-management: Unable to start 
brick box-fra-01.klaas:/usr/local/glusterfs/volume1
[2016-05-25 08:27:26.847596] E [MSGID: 106123] 
[glusterd-syncop.c:1404:gd_commit_op_phase] 0-management: Commit of operation 
'Volume Start' failed on localhost

The first warning appears immediately after I issue the command. As the
timestamp reveals, the command remains idle for quite some time.

This is how I created the volume:

$ gluster volume create volume1 replica 2 transport tcp 
box-fra-01.klaas:/usr/local/glusterfs/volume1 
box-ams-01.klaas:/usr/local/glusterfs/volume1 force
volume create: volume1: success: please start the volume to access data

This is the version of gluster that is installed:

$ pkg info | grep gluster
glusterfs-3.7.6GlusterFS distributed file system

Any help is appreciated.

Niklaas


signature.asc
Description: PGP signature
___
Gluster-users mailing list
Gluster-users@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-users