Re: [Gluster-users] Arbiter node in slow network

As Alan mentioned latency is more important. Also consider using an SSD for all arbiter bricks and set maxpct (man 8 mkfs.xfs) to a high level (I prefer to use '90'). Best Regards, Strahil Nikolov В събота, 31 декември 2022 г., 10:43:50 ч. Гринуич+2, Alan Orth написа: Hi Filipe, I

Re: [Gluster-users] Arbiter node in slow network

Hi Filipe, I think it would probably be fine. The Red Hat Storage docs list the important thing being *5ms latency*, not link speed: https://access.redhat.com/documentation/en-us/red_hat_gluster_storage/3.5/html/administration_guide/creating_arbitrated_replicated_volumes I haven't used an

Re: [Gluster-users] Arbiter node in slow network

As the arbiter doesn't receive or provide any data to the clients - just metadata ,so bandwith is not critical but lattency is.Ensure that lattency is the same or lower for the arbiter node and you can use an SSD/NVME to ensure that storage lattency won't be a bottleneck. Also, don't forget to

[Gluster-users] Arbiter node in slow network

Hi glusters, I'm close to deploy my first GlusterFS replica 3 arbiter 1 volume. Below I will describe my hardware / plans: Node1: two bricks, 2 x raid0 arrays 40gbe network Node2: two bricks, 2 x raid0 arrays 40gbe network Node3: Arbiter 1gbe network Between Node1 and Node2, I have a 40gbe

Re: [Gluster-users] Arbiter

Il 08/02/2022 12:17, Karthik Subrahmanya ha scritto: Since there are 4 nodes available here, and based on the configuration of the available volumes (requested volume info for the same) I was thinking whether the arbiter brick can be hosted on one of those nodes itself, or a new node is

Re: [Gluster-users] Arbiter

Yes! That's what I meant. Two-nodes plus the arbiter to achieve quorum. Sorry if I made some confusion. Thanks a lot. --- Gilberto Nunes Ferreira (47) 99676-7530 - Whatsapp / Telegram Em ter., 8 de fev. de 2022 às 08:18, Karthik Subrahmanya < ksubr...@redhat.com> escreveu: > > > On Tue, Feb

Re: [Gluster-users] Arbiter

On Tue, Feb 8, 2022 at 4:28 PM Gilberto Ferreira wrote: > Forgive me if I am wrong, but AFAIK, arbiter is for a two-node > configuration, isn't it? > Arbiter is to give the same consistency as replica-3 with 3 nodes, without the need to have a full sized 3rd brick [1]. It will store the files

Re: [Gluster-users] Arbiter

IIUC it always requires 3 servers. Lightweight arbiter is just to avoid split brain (a client needs to reach two servers out of three to be able to write data). "Full" arbiter is a third replica of metadata while there are only two copies of the data. Il 08/02/2022 11:58, Gilberto Ferreira ha

Re: [Gluster-users] Arbiter

Forgive me if I am wrong, but AFAIK, arbiter is for a two-node configuration, isn't it? --- Gilberto Nunes Ferreira (47) 99676-7530 - Whatsapp / Telegram Em ter., 8 de fev. de 2022 às 07:17, Karthik Subrahmanya < ksubr...@redhat.com> escreveu: > Hi Andre, > > Striped volumes are deprecated

Re: [Gluster-users] Arbiter

Hi Andre, Striped volumes are deprecated long back, see [1] & [2]. Seems like you are using a very old version. May I know which version of gluster you are running and the gluster volume info please? Release schedule and the maintained branches can be found at [3]. [1]

[Gluster-users] Arbiter

I have a striped and replicated volume with 4 nodes. How do I add an arbiter to this volume? -- André Probst Consultor de Tecnologia 43 99617 8765 Community Meeting Calendar: Schedule - Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC Bridge: https://meet.google.com/cpu-eiue-hvk

Re: [Gluster-users] arbiter node on client?

- Original Message - > From: "Dave Sherohman" <d...@sherohman.org> > To: gluster-users@gluster.org > Sent: Monday, May 7, 2018 7:21:49 AM > Subject: Re: [Gluster-users] arbiter node on client? > > On Sun, May 06, 2018 at 11:15:32AM +, Gandalf Corvotemp

Re: [Gluster-users] arbiter node on client?

Il giorno lun 7 mag 2018 alle ore 13:22 Dave Sherohman ha scritto: > I'm pretty sure that you can only have one arbiter per subvolume, and > I'm not even sure what the point of multiple arbiters over the same data > would be. Multiple arbiter add availability. I can safely

Re: [Gluster-users] arbiter node on client?

On Sun, May 06, 2018 at 11:15:32AM +, Gandalf Corvotempesta wrote: > is possible to add an arbiter node on the client? I've been running in that configuration for a couple months now with no problems. I have 6 data + 3 arbiter bricks hosting VM disk images and all three of my arbiter bricks

[Gluster-users] arbiter node on client?

is possible to add an arbiter node on the client? Let's assume a gluster storage made with 2 storage server. This is prone to split-brains. An arbiter node can be added, but can I put the arbiter on one of the client ? Can I use multiple arbiter for the same volume ? In example, one arbiter on

Re: [Gluster-users] Arbiter and geo-replication

On 09/22/2017 02:25 AM, Kotresh Hiremath Ravishankar wrote: The volume layout of geo-replication slave volume could be different from master volume. It's not mandatory that if the master volume is arbiter type, the slave also needs to be arbiter. But if it's decided to use the arbiter both at

[Gluster-users] Arbiter and geo-replication

Hi all! Today I have a small gluster replication on 2 machines. My plan is to scale this, I though need some feedback that how I plan things is in the right direction. First of all I have understood the need of an arbiter. When I scale this, say that I just have 2 replica and 1 arbiter, when

Re: [Gluster-users] Arbiter node as VM

ans it has something to do with indexing. But is this warning normal? anything I can do about it? Regards, M. > Original Message > Subject: Re: [Gluster-users] Arbiter node as VM > Local Time: June 29, 2017 11:55 PM > UTC Time: June 29, 2017 9:55 PM > From: dougti+glu

Re: [Gluster-users] Arbiter node as VM

As long as the VM isn't hosted on one of the two Gluster nodes, that's perfectly fine. One of my smaller clusters uses the same setup. As for your other questions, as long as it supports Unix file permissions, Gluster doesn't care what filesystem you use. Mix & match as you wish. Just try to keep

[Gluster-users] Arbiter node as VM

Hello, I have a replica 2 GlusterFS 3.8.11 cluster on 2 Debian 8 physical servers using ZFS as filesystem. Now in order to avoid a split-brain situation I would like to add a third node as arbiter. Regarding the arbiter node I have a few questions: - can the arbiter node be a virtual machine?

Re: [Gluster-users] Arbiter and Hot Tier

Thank you very much for the assistance. -Walter Deignan -Uline IT, Systems Architect From: Ravishankar N <ravishan...@redhat.com> To: Walter Deignan <wdeig...@uline.com> Cc: gluster-users@gluster.org Date: 05/05/2017 11:43 AM Subject: Re: [Gluster-users] Arbiter

Re: [Gluster-users] Arbiter and Hot Tier

From: Ravishankar N <ravishan...@redhat.com> To: Walter Deignan <wdeig...@uline.com>, gluster-users@gluster.org Date: 05/05/2017 11:08 AM Subject: Re: [Gluster-users] Arbiter and Hot Tier Hi Walter, Yes, arb

Re: [Gluster-users] Arbiter and Hot Tier

g Date: 05/05/2017 11:08 AM Subject: Re: [Gluster-users] Arbiter and Hot Tier Hi Walter, Yes, arbiter volumes are currently not supported with tiering. -Ravi On 05/05/2017 08:54 PM, Walter Deignan wrote: I've been googling this to no avail so apologies if this is explained somewh

Re: [Gluster-users] Arbiter and Hot Tier

Hi Walter, Yes, arbiter volumes are currently not supported with tiering. -Ravi On 05/05/2017 08:54 PM, Walter Deignan wrote: I've been googling this to no avail so apologies if this is explained somewhere I missed. Is there a known incompatibility between using arbiters and hot tiering?

[Gluster-users] Arbiter and Hot Tier

I've been googling this to no avail so apologies if this is explained somewhere I missed. Is there a known incompatibility between using arbiters and hot tiering? Experience on 3.9 Original volume - replica 3 arbiter 1 Attach replica 2 arbiter 1 hot tier - failure Attach replica 3 hot tier -

Re: [Gluster-users] arbiter node sharing

On 01/16/2017 09:42 PM, p...@email.cz wrote: Hello dears, how can i share the arbiter node between two-three gluster clusters ?? I've got two clusters ( centos 7.2) with gluster (3.8) filesystem and I'd need to share arbiter node between them to spare server nodes. exam: gluster volume

[Gluster-users] arbiter node sharing

Hello dears, how can i share the arbiter node between two-three gluster clusters ?? I've got two clusters ( centos 7.2) with gluster (3.8) filesystem and I'd need to share arbiter node between them to spare server nodes. exam: gluster volume create SDAP1 replica 3 arbiter 1

Re: [Gluster-users] Arbiter Addition in Replicated environment

On 12/06/2016 01:33 PM, Atul Yadav wrote: Hi Team, Can we add Arbiter brick in 2 node replication running environment. Yes. this should work on 3.8 release with the command you mentioned. It is recommended to add the brick when no I/O is happening on the volume. For an example Glusterfs 2

[Gluster-users] Arbiter Addition in Replicated environment

Hi Team, Can we add Arbiter brick in 2 node replication running environment. For an example Glusterfs 2 node replication Current glusterfs storage size 4 TB. After adding Arbiter brick in this environment what will be the result. #gluster volume add-brick test replica 3 arbiter 1

Re: [Gluster-users] Arbiter performance issue

On 03/30/2016 06:36 AM, Ravishankar N wrote: On 03/30/2016 01:03 AM, Russell Purinton wrote: Hi all, sorry for 2 threads today, but I felt like this deserved a separate thread… I was trying to replace my replica 2 volumes with replica 3 arbiter 1 volumes… The new volumes though are 10x

Re: [Gluster-users] Arbiter performance issue

On 03/30/2016 01:03 AM, Russell Purinton wrote: Hi all, sorry for 2 threads today, but I felt like this deserved a separate thread… I was trying to replace my replica 2 volumes with replica 3 arbiter 1 volumes… The new volumes though are 10x slower on direct writes than their replica 2

[Gluster-users] Arbiter performance issue

Hi all, sorry for 2 threads today, but I felt like this deserved a separate thread… I was trying to replace my replica 2 volumes with replica 3 arbiter 1 volumes… The new volumes though are 10x slower on direct writes than their replica 2 counterparts. Im wondering if this is to be expected

Re: [Gluster-users] Arbiter doesn't create

The third brick should be the arbiter. Not sure if it should be marked as arbiter in volume info. Try to put data on it. Brick 3 should be empty and get only metadata. Regards André Am 23.03.2016 um 14:33 schrieb Ralf Simon: > Hello, > > I've installed > > # yum info glusterfs-server >

[Gluster-users] Arbiter doesn't create

Hello, I've installed # yum info glusterfs-server Loaded plugins: fastestmirror Loading mirror speeds from cached hostfile Installed Packages Name: glusterfs-server Arch: x86_64 Version : 3.7.6 Release : 1.el7 Size: 4.3 M Repo: installed >From repo

Re: [Gluster-users] Arbiter brick size estimation

And for 256b inode: (597904 - 33000) / (1066036 - 23) == 530 bytes per inode. So I still consider 1k to be good estimation for average workload. Regards, Oleksandr. On четвер, 17 березня 2016 р. 09:58:14 EET Ravishankar N wrote: > Looks okay to me Oleksandr. You might want to make a github

Re: [Gluster-users] Arbiter brick size estimation

On 03/16/2016 10:57 PM, Oleksandr Natalenko wrote: OK, I've repeated the test with the following hierarchy: * 10 top-level folders with 10 second-level folders each; * 10 000 files in each second-level folder. So, this composes 10×10×1=1M files and 100 folders Initial brick used space: 33

Re: [Gluster-users] Arbiter brick size estimation

Thanks Oleksandr! I'll update http://gluster.readthedocs.org/en/latest/Administrator%20Guide/arbiter-volumes-and-quorum/ with a link to your gist. On 03/18/2016 04:24 AM, Oleksandr Natalenko wrote: Ravi, here is the summary: [1] Regards, Oleksandr. [1]

Re: [Gluster-users] Arbiter brick size estimation

OK, I've repeated the test with the following hierarchy: * 10 top-level folders with 10 second-level folders each; * 10 000 files in each second-level folder. So, this composes 10×10×1=1M files and 100 folders Initial brick used space: 33 M Initial inodes count: 24 After test: * each

Re: [Gluster-users] Arbiter brick size estimation

Ravi, I will definitely arrange the results into some short handy document and post it here. Also, @JoeJulian on IRC suggested me to perform this test on XFS bricks with inode size of 256b and 1k: === 22:38 <@JoeJulian> post-factum: Just wondering what 256 byte inodes might look like for

Re: [Gluster-users] Arbiter brick size estimation

Ravi, here is the summary: [1] Regards, Oleksandr. [1] https://gist.github.com/e8265ca07f7b19f30bb3 On четвер, 17 березня 2016 р. 09:58:14 EET Ravishankar N wrote: > On 03/16/2016 10:57 PM, Oleksandr Natalenko wrote: > > OK, I've repeated the test with the following hierarchy: > > > > * 10

Re: [Gluster-users] Arbiter brick size estimation

Hi. On вівторок, 8 березня 2016 р. 19:13:05 EET Ravishankar N wrote: > I think the first one is right because you still haven't used up all the > inodes.(2036637 used vs. the max. permissible 3139091). But again this > is an approximation because not all files would be 899 bytes. For > example if

[Gluster-users] Arbiter brick size estimation

In order to estimate GlusterFS arbiter brick size, I've deployed test setup with replica 3 arbiter 1 volume within one node. Each brick is located on separate HDD (XFS with inode size == 512). Using GlusterFS v3.7.6 + memleak patches. Volume options are kept default. Here is the script that

Re: [Gluster-users] Arbiter vs Dummy Node Details

On 12/30/2015 04:20 AM, Kyle Harris wrote: Hello All, Forgive the duplicate but I forgot to give the first post a title so this corrects that. Anyway, I recently discovered the new arbiter functionality of the 3.7 branch so I decided to give it a try. First off, I too am looking forward to

[Gluster-users] Arbiter vs Dummy Node Details

Hello All, Forgive the duplicate but I forgot to give the first post a title so this corrects that. Anyway, I recently discovered the new arbiter functionality of the 3.7 branch so I decided to give it a try. First off, I too am looking forward to the ability to add an arbiter to an already

Re: [Gluster-users] Arbiter vs Dummy Node Details

On 12/30/2015 06:42 AM, Ravishankar N wrote: On 12/30/2015 04:20 AM, Kyle Harris wrote: Hello All, Forgive the duplicate but I forgot to give the first post a title so this corrects that. Anyway, I recently discovered the new arbiter functionality of the 3.7 branch so I decided to give it

Re: [Gluster-users] Arbiter volume

On 08/06/2015 09:17 AM, Pranith Kumar Karampuri wrote: On 08/06/2015 02:41 AM, Fredrik Brandt wrote: Arbiter volume Hi, Gave arbiter volume a shot today but ran into som problems with it: 1. My arbiter brick is running with a much smaller disk which during a df presents a problem,

[Gluster-users] Arbiter volume

Hi, Gave arbiter volume a shot today but ran into som problems with it: 1. My arbiter brick is running with a much smaller disk which during a df presents a problem, it shows the smaller disksize. If I understand the arbiter correctly, then there is no need to match the size of the real

Re: [Gluster-users] Arbiter volume

On 08/06/2015 02:41 AM, Fredrik Brandt wrote: Arbiter volume Hi, Gave arbiter volume a shot today but ran into som problems with it: 1. My arbiter brick is running with a much smaller disk which during a df presents a problem, it shows the smaller disksize. If I understand the