Re: [Gluster-users] missing files on FUSE mount

2020-10-23 Thread Strahil Nikolov
Hi Martin,

why should you use samba 4.10.5 ? What is your OS version ?

Recently AnoopCS has provided packages for samba 4.12 .

Best Regards,
Strahil Nikolov






В петък, 23 октомври 2020 г., 18:50:35 Гринуич+3, Martín Lorenzo 
 написа: 





Hi Eli, remounting the volume fixes it. 
So, regarding cache invalidation, which volume options should I modify in order 
to minimize it?
I cannot use gluster vfs on samba since it is broken on 4.10.5 
https://lists.samba.org/archive/samba/2019-June/223683.html
Also, is  it correlated to system load?. I'm planning to upgrade CPU/RAM on a 
pair of nodes to see what happens...

On Fri, Oct 23, 2020 at 12:33 PM Eli V  wrote:
> On Tue, Oct 20, 2020 at 8:41 AM Martín Lorenzo  wrote:
>>
>> Hi, I have the following problem, I have a distributed replicated cluster 
>> set up with samba and CTDB, over fuse mount points
>> I am having inconsistencies across the FUSE mounts, users report that files 
>> are disappearing after being copied/moved. I take a look at the mount points 
>> on each node, and they don't display the same data
>>
>>  faulty mount point
>> [root@gluster6 ARRIBA GENTE martes 20 de octubre]# ll
>> ls: cannot access PANEO VUELTA A CLASES CON TAPABOCAS.mpg: No such file or 
>> directory
>> ls: cannot access PANEO NIÑOS ESCUELAS CON TAPABOCAS.mpg: No such file or 
>> directory
>> total 633723
>> drwxr-xr-x. 5 arribagente PN      4096 Oct 19 10:52 COMERCIAL AG martes 20 
>> de octubre
>> -rw-r--r--. 1 arribagente PN 648927236 Jun  3 07:16 PANEO FACHADA PALACIO 
>> LEGISLATIVO DRONE DIA Y NOCHE.mpg
>> -?? ? ?           ?          ?            ? PANEO NIÑOS ESCUELAS CON 
>> TAPABOCAS.mpg
>> -?? ? ?           ?          ?            ? PANEO VUELTA A CLASES 
>> CON TAPABOCAS.mpg
>>
>>
>> ###healthy mount point###
>> [root@gluster7 ARRIBA GENTE martes 20 de octubre]# ll
>> total 3435596
>> drwxr-xr-x. 5 arribagente PN       4096 Oct 19 10:52 COMERCIAL AG martes 20 
>> de octubre
>> -rw-r--r--. 1 arribagente PN  648927236 Jun  3 07:16 PANEO FACHADA PALACIO 
>> LEGISLATIVO DRONE DIA Y NOCHE.mpg
>> -rw-r--r--. 1 arribagente PN 2084415492 Aug 18 09:14 PANEO NIÑOS ESCUELAS 
>> CON TAPABOCAS.mpg
>> -rw-r--r--. 1 arribagente PN  784701444 Sep  4 07:23 PANEO VUELTA A CLASES 
>> CON TAPABOCAS.mpg
>>
>>  - So far the only way to solve this is to create a directory in the healthy 
>>mount point, on the same path:
>> [root@gluster7 ARRIBA GENTE martes 20 de octubre]# mkdir hola
>>
>> - When you refresh the other mountpoint, and the issue is resolved:
>> [root@gluster6 ARRIBA GENTE martes 20 de octubre]# ll
>> total 3435600
>> drwxr-xr-x. 5 arribagente PN         4096 Oct 19 10:52 COMERCIAL AG martes 
>> 20 de octubre
>> drwxr-xr-x. 2 root        root       4096 Oct 20 08:45 hola
>> -rw-r--r--. 1 arribagente PN    648927236 Jun  3 07:16 PANEO FACHADA PALACIO 
>> LEGISLATIVO DRONE DIA Y NOCHE.mpg
>> -rw-r--r--. 1 arribagente PN   2084415492 Aug 18 09:14 PANEO NIÑOS ESCUELAS 
>> CON TAPABOCAS.mpg
>> -rw-r--r--. 1 arribagente PN    784701444 Sep  4 07:23 PANEO VUELTA A CLASES 
>> CON TAPABOCAS.mpg
>>
>> Interestingly, the error occurs on the mount point where the files were 
>> copied. They don't show up as pending heal entries. I have around 15 people 
>> using them over samba, I think I'm having this issue reported every two days.
>>
>> I have an older cluster with similar issues, different gluster version, but 
>> a very similar topology (4 bricks, initially two bricks then expanded)
>> Please note , the bricks aren't the same size (but their replicas are), so 
>> my other suspicion is that rebalancing has something to do with it.
>>
>> I'm trying to reproduce it over a small virtualized cluster, so far no 
>> results.
>>
>> Here are the cluster details
>> four nodes, replica 2, plus one arbiter hosting 2 bricks
>> I have 2 bricks with ~20 TB capacity and the other pair is ~48TB
>> Volume Name: tapeless
>> Type: Distributed-Replicate
>> Volume ID: 53bfa86d-b390-496b-bbd7-c4bba625c956
>> Status: Started
>> Snapshot Count: 0
>> Number of Bricks: 2 x (2 + 1) = 6
>> Transport-type: tcp
>> Bricks:
>> Brick1: gluster6.glustersaeta.net:/data/glusterfs/tapeless/brick_6/brick
>> Brick2: gluster7.glustersaeta.net:/data/glusterfs/tapeless/brick_7/brick
>> Brick3: 
>> kitchen-store.glustersaeta.net:/data/glusterfs/tapeless/brick_1a/brick 
>> (arbiter)
>> Brick4: gluster12.glustersaeta.net:/data/glusterfs/tapeless/brick_12/brick
>> Brick5: gluster13.glustersaeta.net:/data/glusterfs/tapeless/brick_13/brick
>> Brick6: 
>> kitchen-store.glustersaeta.net:/data/glusterfs/tapeless/brick_2a/brick 
>> (arbiter)
>> Options Reconfigured:
>> features.quota-deem-statfs: on
>> performance.client-io-threads: on
>> nfs.disable: on
>> transport.address-family: inet
>> features.quota: on
>> features.inode-quota: on
>> features.cache-invalidation: on
>> features.cache-invalidation-timeout: 600
>> performance.cache-samba-metadata: on
>> performance.stat-prefetch: on
>> performance.cach

Re: [Gluster-users] missing mount-shared-storage.sh on glusterfs 7.8-2

2020-10-23 Thread peter knezel
Well, thanks for the info.
I have upgraded my servers from 7.8-2 to 7.8-3.
7.8-3 contains the needed mount-shared-storage.sh
And Ingo is right - it was not there on 21st of October ...;-)

NOTE: when i disable the glusterfssharedstorage.service, i can live without
it.
What is the real purpose of using this service?

Kind regards,
peterk


On Fri, 23 Oct 2020 at 18:34, Ingo Fischer  wrote:

> Hi,
>
> verified ... they are available now ... were not on 21.10. :-)
>
> Thank you!
>
> Ingo
>
> Am 23.10.20 um 18:05 schrieb Kaleb Keithley:
> >
> >
> > On Fri, Oct 23, 2020 at 6:15 AM peter knezel  > > wrote:
> >
> > Hello All,
> >
> > can somebody responsible confirm me, that mount-shared-storage.sh
> > is really missing from glusterfs 7.8-2 packages?
> > Will new version be created?
> >
> >
> > It is fixed in 7.8-3, which has been on download.gluster.org
> >  for several days now.
> >
> >
> >
> > I have recreated this file manually on my two glusterfs servers
> > (i took the mount-shared-storage.sh file from a server that was OS
> > updated from debian stretch to debian buster (10.5)) - with 7.8-1 at
> > that time:
> >
> > root@server1:~# cd /usr/lib/x86_64-linux-gnu/glusterfs
> > root@server1:/usr/lib/x86_64-linux-gnu/glusterfs# ls -ltr|grep
> > storage.sh
> > -rwxr-xr-x 1 root root  1259 Oct 23 09:28 mount-shared-storage.sh
> > root@server1:/usr/lib/x86_64-linux-gnu/glusterfs# cat
> > mount-shared-storage.sh
> > #!/bin/bash
> > #Post reboot there is a chance in which mounting of shared storage
> > will fail
> > #This will impact starting of features like NFS-Ganesha. So this
> > script will
> > #try to mount the shared storage if it fails
> >
> > exitStatus=0
> >
> > while IFS= read -r glm
> > do
> > IFS=$' \t' read -r -a arr <<< "$glm"
> >
> > #Validate storage type is glusterfs
> > if [ "${arr[2]}" == "glusterfs" ]
> > then
> >
> > #check whether shared storage is mounted
> > #if it is mounted then mountpoint -q will return a 0
> > success code
> > if mountpoint -q "${arr[1]}"
> > then
> > echo "${arr[1]} is already mounted"
> > continue
> > fi
> >
> > mount -t glusterfs "${arr[0]}" "${arr[1]}"
> > #wait for few seconds
> > sleep 10
> >
> > #recheck mount got succeed
> > if mountpoint -q "${arr[1]}"
> > then
> > echo "${arr[1]} has been mounted"
> > continue
> > else
> > echo "${arr[1]} failed to mount"
> > exitStatus=1
> > fi
> > fi
> > done <<< "$(sed '/^#/ d'  > exit $exitStatus
> > root@server1:/usr/lib/x86_64-linux-gnu/glusterfs#
> >
> > root@server1:/usr/lib/x86_64-linux-gnu/glusterfs# uname -a
> > Linux server1 4.19.0-10-amd64 #1 SMP Debian 4.19.132-1 (2020-07-24)
> > x86_64 GNU/Linux
> > root@server1:/usr/lib/x86_64-linux-gnu/glusterfs# cat
> > /etc/debian_version
> > 10.5
> > root@server1:/usr/lib/x86_64-linux-gnu/glusterfs#
> >
> >
> > Then I enabled and started glusterfssharedstorage.service.
> > It works.
> > NOTE: same done on server2 as well.
> >
> >
> >
> > Kind regards,
> > peterk
> >
> >
> > 
> >
> >
> >
> > Community Meeting Calendar:
> >
> > Schedule -
> > Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC
> > Bridge: https://bluejeans.com/441850968
> >
> > Gluster-users mailing list
> > Gluster-users@gluster.org 
> > https://lists.gluster.org/mailman/listinfo/gluster-users
> >
> >
> > 
> >
> >
> >
> > Community Meeting Calendar:
> >
> > Schedule -
> > Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC
> > Bridge: https://bluejeans.com/441850968
> >
> > Gluster-users mailing list
> > Gluster-users@gluster.org
> > https://lists.gluster.org/mailman/listinfo/gluster-users
> >
>
> -
>




Community Meeting Calendar:

Schedule -
Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC
Bridge: https://bluejeans.com/441850968

Gluster-users mailing list
Gluster-users@gluster.org
https://lists.gluster.org/mailman/listinfo/gluster-users


Re: [Gluster-users] missing mount-shared-storage.sh on glusterfs 7.8-2

2020-10-23 Thread Kaleb Keithley
On Fri, Oct 23, 2020 at 6:15 AM peter knezel  wrote:

> Hello All,
>
> can somebody responsible confirm me, that mount-shared-storage.sh
> is really missing from glusterfs 7.8-2 packages?
> Will new version be created?
>

It is fixed in 7.8-3, which has been on download.gluster.org for several
days now.


>
> I have recreated this file manually on my two glusterfs servers
> (i took the mount-shared-storage.sh file from a server that was OS updated
> from debian stretch to debian buster (10.5)) - with 7.8-1 at that time:
>
> root@server1:~# cd /usr/lib/x86_64-linux-gnu/glusterfs
> root@server1:/usr/lib/x86_64-linux-gnu/glusterfs# ls -ltr|grep storage.sh
> -rwxr-xr-x 1 root root  1259 Oct 23 09:28 mount-shared-storage.sh
> root@server1:/usr/lib/x86_64-linux-gnu/glusterfs# cat
> mount-shared-storage.sh
> #!/bin/bash
> #Post reboot there is a chance in which mounting of shared storage will
> fail
> #This will impact starting of features like NFS-Ganesha. So this script
> will
> #try to mount the shared storage if it fails
>
> exitStatus=0
>
> while IFS= read -r glm
> do
> IFS=$' \t' read -r -a arr <<< "$glm"
>
> #Validate storage type is glusterfs
> if [ "${arr[2]}" == "glusterfs" ]
> then
>
> #check whether shared storage is mounted
> #if it is mounted then mountpoint -q will return a 0
> success code
> if mountpoint -q "${arr[1]}"
> then
> echo "${arr[1]} is already mounted"
> continue
> fi
>
> mount -t glusterfs "${arr[0]}" "${arr[1]}"
> #wait for few seconds
> sleep 10
>
> #recheck mount got succeed
> if mountpoint -q "${arr[1]}"
> then
> echo "${arr[1]} has been mounted"
> continue
> else
> echo "${arr[1]} failed to mount"
> exitStatus=1
> fi
> fi
> done <<< "$(sed '/^#/ d'  exit $exitStatus
> root@server1:/usr/lib/x86_64-linux-gnu/glusterfs#
>
> root@server1:/usr/lib/x86_64-linux-gnu/glusterfs# uname -a
> Linux server1 4.19.0-10-amd64 #1 SMP Debian 4.19.132-1 (2020-07-24) x86_64
> GNU/Linux
> root@server1:/usr/lib/x86_64-linux-gnu/glusterfs# cat /etc/debian_version
> 10.5
> root@server1:/usr/lib/x86_64-linux-gnu/glusterfs#
>
>
> Then I enabled and started glusterfssharedstorage.service.
> It works.
> NOTE: same done on server2 as well.
>
>
>
> Kind regards,
> peterk
>
>
> 
>
>
>
> Community Meeting Calendar:
>
> Schedule -
> Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC
> Bridge: https://bluejeans.com/441850968
>
> Gluster-users mailing list
> Gluster-users@gluster.org
> https://lists.gluster.org/mailman/listinfo/gluster-users
>




Community Meeting Calendar:

Schedule -
Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC
Bridge: https://bluejeans.com/441850968

Gluster-users mailing list
Gluster-users@gluster.org
https://lists.gluster.org/mailman/listinfo/gluster-users


Re: [Gluster-users] missing files on FUSE mount

2020-10-23 Thread Martín Lorenzo
Hi Eli, remounting the volume fixes it.
So, regarding cache invalidation, which volume options should I modify in
order to minimize it?
I cannot use gluster vfs on samba since it is broken on 4.10.5
https://lists.samba.org/archive/samba/2019-June/223683.html
Also, is  it correlated to system load?. I'm planning to upgrade CPU/RAM on
a pair of nodes to see what happens...

On Fri, Oct 23, 2020 at 12:33 PM Eli V  wrote:

> On Tue, Oct 20, 2020 at 8:41 AM Martín Lorenzo  wrote:
> >
> > Hi, I have the following problem, I have a distributed replicated
> cluster set up with samba and CTDB, over fuse mount points
> > I am having inconsistencies across the FUSE mounts, users report that
> files are disappearing after being copied/moved. I take a look at the mount
> points on each node, and they don't display the same data
> >
> >  faulty mount point
> > [root@gluster6 ARRIBA GENTE martes 20 de octubre]# ll
> > ls: cannot access PANEO VUELTA A CLASES CON TAPABOCAS.mpg: No such file
> or directory
> > ls: cannot access PANEO NIÑOS ESCUELAS CON TAPABOCAS.mpg: No such file
> or directory
> > total 633723
> > drwxr-xr-x. 5 arribagente PN  4096 Oct 19 10:52 COMERCIAL AG martes
> 20 de octubre
> > -rw-r--r--. 1 arribagente PN 648927236 Jun  3 07:16 PANEO FACHADA
> PALACIO LEGISLATIVO DRONE DIA Y NOCHE.mpg
> > -?? ? ?   ?  ?? PANEO NIÑOS ESCUELAS
> CON TAPABOCAS.mpg
> > -?? ? ?   ?  ?? PANEO VUELTA A
> CLASES CON TAPABOCAS.mpg
> >
> >
> > ###healthy mount point###
> > [root@gluster7 ARRIBA GENTE martes 20 de octubre]# ll
> > total 3435596
> > drwxr-xr-x. 5 arribagente PN   4096 Oct 19 10:52 COMERCIAL AG martes
> 20 de octubre
> > -rw-r--r--. 1 arribagente PN  648927236 Jun  3 07:16 PANEO FACHADA
> PALACIO LEGISLATIVO DRONE DIA Y NOCHE.mpg
> > -rw-r--r--. 1 arribagente PN 2084415492 Aug 18 09:14 PANEO NIÑOS
> ESCUELAS CON TAPABOCAS.mpg
> > -rw-r--r--. 1 arribagente PN  784701444 Sep  4 07:23 PANEO VUELTA A
> CLASES CON TAPABOCAS.mpg
> >
> >  - So far the only way to solve this is to create a directory in the
> healthy mount point, on the same path:
> > [root@gluster7 ARRIBA GENTE martes 20 de octubre]# mkdir hola
> >
> > - When you refresh the other mountpoint, and the issue is resolved:
> > [root@gluster6 ARRIBA GENTE martes 20 de octubre]# ll
> > total 3435600
> > drwxr-xr-x. 5 arribagente PN 4096 Oct 19 10:52 COMERCIAL AG
> martes 20 de octubre
> > drwxr-xr-x. 2 rootroot   4096 Oct 20 08:45 hola
> > -rw-r--r--. 1 arribagente PN648927236 Jun  3 07:16 PANEO FACHADA
> PALACIO LEGISLATIVO DRONE DIA Y NOCHE.mpg
> > -rw-r--r--. 1 arribagente PN   2084415492 Aug 18 09:14 PANEO NIÑOS
> ESCUELAS CON TAPABOCAS.mpg
> > -rw-r--r--. 1 arribagente PN784701444 Sep  4 07:23 PANEO VUELTA A
> CLASES CON TAPABOCAS.mpg
> >
> > Interestingly, the error occurs on the mount point where the files were
> copied. They don't show up as pending heal entries. I have around 15 people
> using them over samba, I think I'm having this issue reported every two
> days.
> >
> > I have an older cluster with similar issues, different gluster version,
> but a very similar topology (4 bricks, initially two bricks then expanded)
> > Please note , the bricks aren't the same size (but their replicas are),
> so my other suspicion is that rebalancing has something to do with it.
> >
> > I'm trying to reproduce it over a small virtualized cluster, so far no
> results.
> >
> > Here are the cluster details
> > four nodes, replica 2, plus one arbiter hosting 2 bricks
> > I have 2 bricks with ~20 TB capacity and the other pair is ~48TB
> > Volume Name: tapeless
> > Type: Distributed-Replicate
> > Volume ID: 53bfa86d-b390-496b-bbd7-c4bba625c956
> > Status: Started
> > Snapshot Count: 0
> > Number of Bricks: 2 x (2 + 1) = 6
> > Transport-type: tcp
> > Bricks:
> > Brick1: gluster6.glustersaeta.net:/data/glusterfs/tapeless/brick_6/brick
> > Brick2: gluster7.glustersaeta.net:/data/glusterfs/tapeless/brick_7/brick
> > Brick3: 
> > kitchen-store.glustersaeta.net:/data/glusterfs/tapeless/brick_1a/brick
> (arbiter)
> > Brick4: gluster12.glustersaeta.net:
> /data/glusterfs/tapeless/brick_12/brick
> > Brick5: gluster13.glustersaeta.net:
> /data/glusterfs/tapeless/brick_13/brick
> > Brick6: 
> > kitchen-store.glustersaeta.net:/data/glusterfs/tapeless/brick_2a/brick
> (arbiter)
> > Options Reconfigured:
> > features.quota-deem-statfs: on
> > performance.client-io-threads: on
> > nfs.disable: on
> > transport.address-family: inet
> > features.quota: on
> > features.inode-quota: on
> > features.cache-invalidation: on
> > features.cache-invalidation-timeout: 600
> > performance.cache-samba-metadata: on
> > performance.stat-prefetch: on
> > performance.cache-invalidation: on
> > performance.md-cache-timeout: 600
> > network.inode-lru-limit: 20
> > performance.nl-cache: on
> > performance.nl-cache-timeout: 600
> > performance.readdir-ahead: on
> > performance.parallel

Re: [Gluster-users] missing files on FUSE mount

2020-10-23 Thread Eli V
On Tue, Oct 20, 2020 at 8:41 AM Martín Lorenzo  wrote:
>
> Hi, I have the following problem, I have a distributed replicated cluster set 
> up with samba and CTDB, over fuse mount points
> I am having inconsistencies across the FUSE mounts, users report that files 
> are disappearing after being copied/moved. I take a look at the mount points 
> on each node, and they don't display the same data
>
>  faulty mount point
> [root@gluster6 ARRIBA GENTE martes 20 de octubre]# ll
> ls: cannot access PANEO VUELTA A CLASES CON TAPABOCAS.mpg: No such file or 
> directory
> ls: cannot access PANEO NIÑOS ESCUELAS CON TAPABOCAS.mpg: No such file or 
> directory
> total 633723
> drwxr-xr-x. 5 arribagente PN  4096 Oct 19 10:52 COMERCIAL AG martes 20 de 
> octubre
> -rw-r--r--. 1 arribagente PN 648927236 Jun  3 07:16 PANEO FACHADA PALACIO 
> LEGISLATIVO DRONE DIA Y NOCHE.mpg
> -?? ? ?   ?  ?? PANEO NIÑOS ESCUELAS CON 
> TAPABOCAS.mpg
> -?? ? ?   ?  ?? PANEO VUELTA A CLASES CON 
> TAPABOCAS.mpg
>
>
> ###healthy mount point###
> [root@gluster7 ARRIBA GENTE martes 20 de octubre]# ll
> total 3435596
> drwxr-xr-x. 5 arribagente PN   4096 Oct 19 10:52 COMERCIAL AG martes 20 
> de octubre
> -rw-r--r--. 1 arribagente PN  648927236 Jun  3 07:16 PANEO FACHADA PALACIO 
> LEGISLATIVO DRONE DIA Y NOCHE.mpg
> -rw-r--r--. 1 arribagente PN 2084415492 Aug 18 09:14 PANEO NIÑOS ESCUELAS CON 
> TAPABOCAS.mpg
> -rw-r--r--. 1 arribagente PN  784701444 Sep  4 07:23 PANEO VUELTA A CLASES 
> CON TAPABOCAS.mpg
>
>  - So far the only way to solve this is to create a directory in the healthy 
> mount point, on the same path:
> [root@gluster7 ARRIBA GENTE martes 20 de octubre]# mkdir hola
>
> - When you refresh the other mountpoint, and the issue is resolved:
> [root@gluster6 ARRIBA GENTE martes 20 de octubre]# ll
> total 3435600
> drwxr-xr-x. 5 arribagente PN 4096 Oct 19 10:52 COMERCIAL AG martes 20 
> de octubre
> drwxr-xr-x. 2 rootroot   4096 Oct 20 08:45 hola
> -rw-r--r--. 1 arribagente PN648927236 Jun  3 07:16 PANEO FACHADA PALACIO 
> LEGISLATIVO DRONE DIA Y NOCHE.mpg
> -rw-r--r--. 1 arribagente PN   2084415492 Aug 18 09:14 PANEO NIÑOS ESCUELAS 
> CON TAPABOCAS.mpg
> -rw-r--r--. 1 arribagente PN784701444 Sep  4 07:23 PANEO VUELTA A CLASES 
> CON TAPABOCAS.mpg
>
> Interestingly, the error occurs on the mount point where the files were 
> copied. They don't show up as pending heal entries. I have around 15 people 
> using them over samba, I think I'm having this issue reported every two days.
>
> I have an older cluster with similar issues, different gluster version, but a 
> very similar topology (4 bricks, initially two bricks then expanded)
> Please note , the bricks aren't the same size (but their replicas are), so my 
> other suspicion is that rebalancing has something to do with it.
>
> I'm trying to reproduce it over a small virtualized cluster, so far no 
> results.
>
> Here are the cluster details
> four nodes, replica 2, plus one arbiter hosting 2 bricks
> I have 2 bricks with ~20 TB capacity and the other pair is ~48TB
> Volume Name: tapeless
> Type: Distributed-Replicate
> Volume ID: 53bfa86d-b390-496b-bbd7-c4bba625c956
> Status: Started
> Snapshot Count: 0
> Number of Bricks: 2 x (2 + 1) = 6
> Transport-type: tcp
> Bricks:
> Brick1: gluster6.glustersaeta.net:/data/glusterfs/tapeless/brick_6/brick
> Brick2: gluster7.glustersaeta.net:/data/glusterfs/tapeless/brick_7/brick
> Brick3: 
> kitchen-store.glustersaeta.net:/data/glusterfs/tapeless/brick_1a/brick 
> (arbiter)
> Brick4: gluster12.glustersaeta.net:/data/glusterfs/tapeless/brick_12/brick
> Brick5: gluster13.glustersaeta.net:/data/glusterfs/tapeless/brick_13/brick
> Brick6: 
> kitchen-store.glustersaeta.net:/data/glusterfs/tapeless/brick_2a/brick 
> (arbiter)
> Options Reconfigured:
> features.quota-deem-statfs: on
> performance.client-io-threads: on
> nfs.disable: on
> transport.address-family: inet
> features.quota: on
> features.inode-quota: on
> features.cache-invalidation: on
> features.cache-invalidation-timeout: 600
> performance.cache-samba-metadata: on
> performance.stat-prefetch: on
> performance.cache-invalidation: on
> performance.md-cache-timeout: 600
> network.inode-lru-limit: 20
> performance.nl-cache: on
> performance.nl-cache-timeout: 600
> performance.readdir-ahead: on
> performance.parallel-readdir: on
> performance.cache-size: 1GB
> client.event-threads: 4
> server.event-threads: 4
> performance.normal-prio-threads: 16
> performance.io-thread-count: 32
> performance.write-behind-window-size: 8MB
> storage.batch-fsync-delay-usec: 0
> cluster.data-self-heal: on
> cluster.metadata-self-heal: on
> cluster.entry-self-heal: on
> cluster.self-heal-daemon: on
> performance.write-behind: on
> performance.open-behind: on
>
> Log section form faulty mount point. I think the [file exists] entries are 
> from people trying to copy the missing files over an 

Re: [Gluster-users] Trouble in create session in geo-rep environment

2020-10-23 Thread Gilberto Nunes
Thanks, I'll check it out.
---
Gilberto Nunes Ferreira





Em sex., 23 de out. de 2020 às 10:48, Aravinda VK 
escreveu:

> Try setting the gluster command dir option for remote side.
>
> gluster volume geo-replication storage geoaccount@gluster-bkp::storage
> config slave-gluster-command-dir /usr/sbin
>
> Note: These terminologies will change soon.(
> https://github.com/gluster/glusterfs/issues/1415)
>
> Aravinda Vishwanathapura
> https://kadalu.io
>
>
> On 22-Oct-2020, at 7:08 PM, Gilberto Nunes 
> wrote:
>
> Hi
>
> I have used as a guide this doc
> https://docs.gluster.org/en/latest/Administrator%20Guide/Geo%20Replication
>
> Everything is ok until I tried to create a session with the command:
> gluster volume geo-replication storage geoaccount@gluster-bkp::storage
> create push-pem
>
> It's return to me the following
>
> gluster command not found on gluster-bkp for user geoaccount.
> geo-replication command failed
>
> I can do ssh to gluster-bkp passwordless.
> In fact, as I am using Debian 10, I have noticed that gluster command was
> not in the normal PATH. So I edit .bashrc and add
> export PATH=$PATH:/usr/sbin/
> So when I do ssh to the gluster-bkp I can execute the gluster command.
> ssh geoaccount@gluster-bkp gluster help
> peer help- display help for peer commands
> volume help  - display help for volume commands
> volume bitrot help   - display help for volume bitrot commands
> volume quota help- display help for volume quota commands
> snapshot help- display help for snapshot commands
> global help  - list global commands
>
> I tried to search some in google but no luck...
>
> Thanks for any help.
>
> ---
> Gilberto Nunes Ferreira
>
>
>
>
> 
>
>
>
> Community Meeting Calendar:
>
> Schedule -
> Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC
> Bridge: https://bluejeans.com/441850968
>
> Gluster-users mailing list
> Gluster-users@gluster.org
> https://lists.gluster.org/mailman/listinfo/gluster-users
>
>
>
>
>
>




Community Meeting Calendar:

Schedule -
Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC
Bridge: https://bluejeans.com/441850968

Gluster-users mailing list
Gluster-users@gluster.org
https://lists.gluster.org/mailman/listinfo/gluster-users


Re: [Gluster-users] Trouble in create session in geo-rep environment

2020-10-23 Thread Aravinda VK
Try setting the gluster command dir option for remote side.

gluster volume geo-replication storage geoaccount@gluster-bkp::storage config 
slave-gluster-command-dir /usr/sbin

Note: These terminologies will change 
soon.(https://github.com/gluster/glusterfs/issues/1415 
)

Aravinda Vishwanathapura
https://kadalu.io


> On 22-Oct-2020, at 7:08 PM, Gilberto Nunes  wrote:
> 
> Hi 
> 
> I have used as a guide this doc
> https://docs.gluster.org/en/latest/Administrator%20Guide/Geo%20Replication 
> 
> 
> Everything is ok until I tried to create a session with the command:
> gluster volume geo-replication storage geoaccount@gluster-bkp::storage create 
> push-pem
> 
> It's return to me the following
> 
> gluster command not found on gluster-bkp for user geoaccount. 
> geo-replication command failed
> 
> I can do ssh to gluster-bkp passwordless.
> In fact, as I am using Debian 10, I have noticed that gluster command was not 
> in the normal PATH. So I edit .bashrc and add 
> export PATH=$PATH:/usr/sbin/
> So when I do ssh to the gluster-bkp I can execute the gluster command.
> ssh geoaccount@gluster-bkp gluster help
> peer help- display help for peer commands 
> volume help  - display help for volume commands 
> volume bitrot help   - display help for volume bitrot commands 
> volume quota help- display help for volume quota commands 
> snapshot help- display help for snapshot commands 
> global help  - list global commands
> 
> I tried to search some in google but no luck...
> 
> Thanks for any help.
> 
> ---
> Gilberto Nunes Ferreira
> 
> 
> 
> 
> 
> 
> 
> 
> Community Meeting Calendar:
> 
> Schedule -
> Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC
> Bridge: https://bluejeans.com/441850968
> 
> Gluster-users mailing list
> Gluster-users@gluster.org
> https://lists.gluster.org/mailman/listinfo/gluster-users








Community Meeting Calendar:

Schedule -
Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC
Bridge: https://bluejeans.com/441850968

Gluster-users mailing list
Gluster-users@gluster.org
https://lists.gluster.org/mailman/listinfo/gluster-users


[Gluster-users] missing mount-shared-storage.sh on glusterfs 7.8-2

2020-10-23 Thread peter knezel
Hello All,

can somebody responsible confirm me, that mount-shared-storage.sh
is really missing from glusterfs 7.8-2 packages?
Will new version be created?

I have recreated this file manually on my two glusterfs servers
(i took the mount-shared-storage.sh file from a server that was OS updated
from debian stretch to debian buster (10.5)) - with 7.8-1 at that time:

root@server1:~# cd /usr/lib/x86_64-linux-gnu/glusterfs
root@server1:/usr/lib/x86_64-linux-gnu/glusterfs# ls -ltr|grep storage.sh
-rwxr-xr-x 1 root root  1259 Oct 23 09:28 mount-shared-storage.sh
root@server1:/usr/lib/x86_64-linux-gnu/glusterfs# cat
mount-shared-storage.sh
#!/bin/bash
#Post reboot there is a chance in which mounting of shared storage will fail
#This will impact starting of features like NFS-Ganesha. So this script will
#try to mount the shared storage if it fails

exitStatus=0

while IFS= read -r glm
do
IFS=$' \t' read -r -a arr <<< "$glm"

#Validate storage type is glusterfs
if [ "${arr[2]}" == "glusterfs" ]
then

#check whether shared storage is mounted
#if it is mounted then mountpoint -q will return a 0
success code
if mountpoint -q "${arr[1]}"
then
echo "${arr[1]} is already mounted"
continue
fi

mount -t glusterfs "${arr[0]}" "${arr[1]}"
#wait for few seconds
sleep 10

#recheck mount got succeed
if mountpoint -q "${arr[1]}"
then
echo "${arr[1]} has been mounted"
continue
else
echo "${arr[1]} failed to mount"
exitStatus=1
fi
fi
done <<< "$(sed '/^#/ d' 



Community Meeting Calendar:

Schedule -
Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC
Bridge: https://bluejeans.com/441850968

Gluster-users mailing list
Gluster-users@gluster.org
https://lists.gluster.org/mailman/listinfo/gluster-users