Re: [Gluster-users] Add single server

On Mon, May 1, 2017, at 02:34 PM, Gandalf Corvotempesta wrote: > I'm still thinking that saving (I don't know where, I don't know how) > a mapping between > files and bricks would solve many issues and add much more flexibility. Every system we've discussed has a map. The differences are only

Re: [Gluster-users] Add single server

> Don't bother with another bug. We have raised > https://github.com/gluster/glusterfs/issues/169 for the issue in mail > thread. If I'm not mistaken that's about the possibility of adding bricks without adding a full replica set at once, that's a different subject. We were talking about adding

Re: [Gluster-users] Add single server

On 05/01/2017 11:47 AM, Pranith Kumar Karampuri wrote: On Tue, May 2, 2017 at 12:14 AM, Shyam > wrote: On 05/01/2017 02:42 PM, Pranith Kumar Karampuri wrote: On Tue, May 2, 2017 at 12:07 AM, Shyam

Re: [Gluster-users] Add single server

On 05/01/2017 11:55 AM, Pranith Kumar Karampuri wrote: On Tue, May 2, 2017 at 12:20 AM, Gandalf Corvotempesta > wrote: 2017-05-01 20:43 GMT+02:00 Shyam >:

Re: [Gluster-users] Add single server

2017-05-01 21:08 GMT+02:00 Vijay Bellur : > We might also want to start thinking about spare bricks that can be brought > into a volume based on some policy. For example, if the posix health > checker determines that underlying storage stack has problems, we can bring > a

Re: [Gluster-users] Add single server

2017-05-01 21:00 GMT+02:00 Shyam : > So, Gandalf, it will be part of the roadmap, just when we maybe able to pick > and deliver this is not clear yet (as Pranith puts it as well). I doesn't matter when. Knowing that adding a single brick will be made possible is enough (at

Re: [Gluster-users] Add single server

2017-05-01 20:55 GMT+02:00 Pranith Kumar Karampuri : > Replace-brick as a command is implemented with the goal of replacing a disk > that went bad. So the availability was already less. In 2013-2014 I proposed > that we do it by adding brick to just the replica set and

Re: [Gluster-users] Add single server

On Mon, May 1, 2017 at 2:55 PM, Pranith Kumar Karampuri wrote: > > > On Tue, May 2, 2017 at 12:20 AM, Gandalf Corvotempesta < > gandalf.corvotempe...@gmail.com> wrote: > >> 2017-05-01 20:43 GMT+02:00 Shyam : >> > I do agree that for the duration a brick

Re: [Gluster-users] Add single server

On Tue, May 2, 2017 at 12:30 AM, Shyam wrote: > On 05/01/2017 02:55 PM, Pranith Kumar Karampuri wrote: > >> >> >> On Tue, May 2, 2017 at 12:20 AM, Gandalf Corvotempesta >> > > wrote: >> >>

Re: [Gluster-users] Add single server

2017-05-01 20:46 GMT+02:00 Shyam : > Fair point. If Gandalf concurs, we will add this to our "+1 scaling" feature > effort (not yet on github as an issue). Everything is ok for me as long that: a) operation must be automated (this is what i've asked initially [1]), maybe

Re: [Gluster-users] Add single server

On 05/01/2017 02:55 PM, Pranith Kumar Karampuri wrote: On Tue, May 2, 2017 at 12:20 AM, Gandalf Corvotempesta > wrote: 2017-05-01 20:43 GMT+02:00 Shyam >: > I

Re: [Gluster-users] Add single server

On Tue, May 2, 2017 at 12:20 AM, Gandalf Corvotempesta < gandalf.corvotempe...@gmail.com> wrote: > 2017-05-01 20:43 GMT+02:00 Shyam : > > I do agree that for the duration a brick is replaced its replication > count > > is down by 1, is that your concern? In which case I do

Re: [Gluster-users] Add single server

On 05/01/2017 02:47 PM, Pranith Kumar Karampuri wrote: On Tue, May 2, 2017 at 12:14 AM, Shyam > wrote: On 05/01/2017 02:42 PM, Pranith Kumar Karampuri wrote: On Tue, May 2, 2017 at 12:07 AM, Shyam

Re: [Gluster-users] Add single server

2017-05-01 20:43 GMT+02:00 Shyam : > I do agree that for the duration a brick is replaced its replication count > is down by 1, is that your concern? In which case I do note that without (a) > above, availability is at risk during the operation. Which needs other >

Re: [Gluster-users] Add single server

2017-05-01 20:42 GMT+02:00 Joe Julian : > Because it's done by humans. Exactly. I forgot to mention this. ___ Gluster-users mailing list Gluster-users@gluster.org http://lists.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] Add single server

On Tue, May 2, 2017 at 12:14 AM, Shyam wrote: > On 05/01/2017 02:42 PM, Pranith Kumar Karampuri wrote: > >> >> >> On Tue, May 2, 2017 at 12:07 AM, Shyam > > wrote: >> >> On 05/01/2017 02:23 PM, Pranith Kumar Karampuri

Re: [Gluster-users] Add single server

On 05/01/2017 02:42 PM, Joe Julian wrote: On 05/01/2017 11:36 AM, Pranith Kumar Karampuri wrote: On Tue, May 2, 2017 at 12:04 AM, Gandalf Corvotempesta > wrote: 2017-05-01 20:30 GMT+02:00 Shyam

Re: [Gluster-users] Add single server

2017-05-01 20:36 GMT+02:00 Pranith Kumar Karampuri : > Why? Because you have to manually replace bricks with the newer one, format the older one and add it back. What happens if, by mistake, we replace the older brick with another brick on the same disk ? Currently you have

Re: [Gluster-users] Add single server

On 05/01/2017 02:42 PM, Pranith Kumar Karampuri wrote: On Tue, May 2, 2017 at 12:07 AM, Shyam > wrote: On 05/01/2017 02:23 PM, Pranith Kumar Karampuri wrote: On Mon, May 1, 2017 at 11:43 PM, Shyam

Re: [Gluster-users] Add single server

On 05/01/2017 02:36 PM, Pranith Kumar Karampuri wrote: On Tue, May 2, 2017 at 12:04 AM, Gandalf Corvotempesta > wrote: 2017-05-01 20:30 GMT+02:00 Shyam >: >

Re: [Gluster-users] Add single server

On 05/01/2017 11:36 AM, Pranith Kumar Karampuri wrote: On Tue, May 2, 2017 at 12:04 AM, Gandalf Corvotempesta > wrote: 2017-05-01 20:30 GMT+02:00 Shyam >:

Re: [Gluster-users] Add single server

On Tue, May 2, 2017 at 12:07 AM, Shyam wrote: > On 05/01/2017 02:23 PM, Pranith Kumar Karampuri wrote: > >> >> >> On Mon, May 1, 2017 at 11:43 PM, Shyam > > wrote: >> >> On 05/01/2017 02:00 PM, Pranith Kumar Karampuri

Re: [Gluster-users] Add single server

On 05/01/2017 02:23 PM, Pranith Kumar Karampuri wrote: On Mon, May 1, 2017 at 11:43 PM, Shyam > wrote: On 05/01/2017 02:00 PM, Pranith Kumar Karampuri wrote: Splitting the bricks need not be a post factum decision, we can

Re: [Gluster-users] Add single server

On Tue, May 2, 2017 at 12:04 AM, Gandalf Corvotempesta < gandalf.corvotempe...@gmail.com> wrote: > 2017-05-01 20:30 GMT+02:00 Shyam : > > Yes, as a matter of fact, you can do this today using the CLI and > creating > > nx2 instead of 1x2. 'n' is best decided by you, depending

Re: [Gluster-users] Add single server

2017-05-01 20:30 GMT+02:00 Shyam : > Yes, as a matter of fact, you can do this today using the CLI and creating > nx2 instead of 1x2. 'n' is best decided by you, depending on the growth > potential of your cluster, as at some point 'n' wont be enough if you grow > by some

Re: [Gluster-users] Add single server

On 05/01/2017 02:25 PM, Gandalf Corvotempesta wrote: 2017-05-01 20:22 GMT+02:00 Shyam : Brick splitting (I think was first proposed by Jeff Darcy) is to create more bricks out of given storage backends. IOW, instead of using a given brick as is, create sub-dirs and use them

Re: [Gluster-users] Add single server

2017-05-01 20:22 GMT+02:00 Shyam : > Brick splitting (I think was first proposed by Jeff Darcy) is to create more > bricks out of given storage backends. IOW, instead of using a given brick as > is, create sub-dirs and use them as bricks. > > Hence, given 2 local FS end points

Re: [Gluster-users] Add single server

On Mon, May 1, 2017 at 11:43 PM, Shyam wrote: > On 05/01/2017 02:00 PM, Pranith Kumar Karampuri wrote: > >> Splitting the bricks need not be a post factum decision, we can >> start with larger brick counts, on a given node/disk count, and >> hence spread these

Re: [Gluster-users] Add single server

2017-05-01 20:08 GMT+02:00 Pranith Kumar Karampuri : > Filename can be renamed and then we lost the link because hash will be > different. Anyways all these kinds of problems are already solved in > distribute layer. Filename can be renamed even with the current architecture.

Re: [Gluster-users] Add single server

On 05/01/2017 01:52 PM, Gandalf Corvotempesta wrote: 2017-05-01 19:50 GMT+02:00 Shyam : Splitting the bricks need not be a post factum decision, we can start with larger brick counts, on a given node/disk count, and hence spread these bricks to newer nodes/bricks as they

Re: [Gluster-users] Add single server

2017-05-01 20:00 GMT+02:00 Pranith Kumar Karampuri : > Let's say we have 1 disk, we format it with say XFS and that becomes a brick > at the moment. Just curious, what will be the relationship between brick to > disk in this case(If we leave out LVM for this example)? No

Re: [Gluster-users] Add single server

On Mon, May 1, 2017 at 11:20 PM, Gandalf Corvotempesta < gandalf.corvotempe...@gmail.com> wrote: > 2017-05-01 19:36 GMT+02:00 Pranith Kumar Karampuri : > > To know GFID of file1 you must know where the file resides so that you > can > > do getxattr trusted.gfid on the file.

Re: [Gluster-users] Add single server

On Mon, May 1, 2017 at 11:20 PM, Shyam wrote: > On 05/01/2017 01:13 PM, Pranith Kumar Karampuri wrote: > >> >> >> On Mon, May 1, 2017 at 10:42 PM, Pranith Kumar Karampuri >> > wrote: >> >> >> >> On Mon, May 1, 2017 at

Re: [Gluster-users] Add single server

2017-05-01 19:50 GMT+02:00 Shyam : > Splitting the bricks need not be a post factum decision, we can start with > larger brick counts, on a given node/disk count, and hence spread these > bricks to newer nodes/bricks as they are added. > > If I understand the ceph PG count, it

Re: [Gluster-users] Add single server

On 05/01/2017 01:13 PM, Pranith Kumar Karampuri wrote: On Mon, May 1, 2017 at 10:42 PM, Pranith Kumar Karampuri > wrote: On Mon, May 1, 2017 at 10:39 PM, Gandalf Corvotempesta

Re: [Gluster-users] Add single server

2017-05-01 19:36 GMT+02:00 Pranith Kumar Karampuri : > To know GFID of file1 you must know where the file resides so that you can > do getxattr trusted.gfid on the file. So storing server/brick location on > gfid is not getting us much more information that what we already

Re: [Gluster-users] Add single server

On Mon, May 1, 2017 at 10:57 PM, Gandalf Corvotempesta < gandalf.corvotempe...@gmail.com> wrote: > 2017-05-01 19:12 GMT+02:00 Pranith Kumar Karampuri : > > I agree it should. Question is how? What will be the resulting brick-map? > > This is why i'm suggesting to add a file

Re: [Gluster-users] Add single server

On Mon, May 1, 2017 at 10:42 PM, Pranith Kumar Karampuri < pkara...@redhat.com> wrote: > > > On Mon, May 1, 2017 at 10:39 PM, Gandalf Corvotempesta < > gandalf.corvotempe...@gmail.com> wrote: > >> 2017-05-01 18:57 GMT+02:00 Pranith Kumar Karampuri : >> > Yes this is precisely

Re: [Gluster-users] Add single server

On Mon, May 1, 2017 at 10:39 PM, Gandalf Corvotempesta < gandalf.corvotempe...@gmail.com> wrote: > 2017-05-01 18:57 GMT+02:00 Pranith Kumar Karampuri : > > Yes this is precisely what all the other SDS with metadata servers kind > of > > do. They kind of keep a map of on what

Re: [Gluster-users] Add single server

2017-05-01 18:57 GMT+02:00 Pranith Kumar Karampuri : > Yes this is precisely what all the other SDS with metadata servers kind of > do. They kind of keep a map of on what all servers a particular file/blob is > stored in a metadata server. Not exactly. Other SDS has some

Re: [Gluster-users] Add single server

On Sun, Apr 30, 2017 at 1:43 PM, wrote: > > So I was a little but luck. If I has all the hardware part, probably i > > would be firesd after causing data loss by using a software marked as > stable > > Yes, we lost our data last year to this bug, and it wasn't a test

Re: [Gluster-users] Add single server

2017-05-01 18:30 GMT+02:00 Gandalf Corvotempesta : > Maybe a simple DB (just as an idea: sqlite, berkeleydb, ...) stored in > a fixed location on gluster itself, being replicated across nodes. Even better, embedding RocksDB with it's data directory stored in

Re: [Gluster-users] Add single server

On Mon, May 1, 2017 at 9:53 PM, Pranith Kumar Karampuri wrote: > > > On Sun, Apr 30, 2017 at 2:04 PM, Gandalf Corvotempesta < > gandalf.corvotempe...@gmail.com> wrote: > >> 2017-04-30 10:13 GMT+02:00 : >> > I was (I believe) the first one to run into

Re: [Gluster-users] Add single server

2017-05-01 18:23 GMT+02:00 Pranith Kumar Karampuri : > IMHO It is difficult to implement what you are asking for without metadata > server which stores where each replica is stored. Can't you distribute a sort of file mapping to each node ? AFAIK , gluster already has some

Re: [Gluster-users] Add single server

On Sun, Apr 30, 2017 at 2:04 PM, Gandalf Corvotempesta < gandalf.corvotempe...@gmail.com> wrote: > 2017-04-30 10:13 GMT+02:00 : > > I was (I believe) the first one to run into the bug, it happens and I > knew it > > was a risk when installing gluster. > > I know. > > > But

Re: [Gluster-users] Add single server

Il 29 apr 2017 4:12 PM, "Gandalf Corvotempesta" < gandalf.corvotempe...@gmail.com> ha scritto: Anyway, the proposed workaround: https://joejulian.name/blog/how-to-expand-glusterfs- replicated-clusters-by-one-server/ won't work with just a single volume made up of 2 replicated bricks. If I have a

Re: [Gluster-users] Add single server

2017-04-30 10:13 GMT+02:00 : > I was (I believe) the first one to run into the bug, it happens and I knew it > was a risk when installing gluster. I know. > But since then I didn't see any warnings anywhere except here, I agree > with you that it should be mentionned in

Re: [Gluster-users] Add single server

> So I was a little but luck. If I has all the hardware part, probably i > would be firesd after causing data loss by using a software marked as stable Yes, we lost our data last year to this bug, and it wasn't a test cluster. We still hear from it from our clients to this day. > Is known that

Re: [Gluster-users] Add single server

I'm not acting like a customer, but having lost a whole cluster twice for the same reason (hopefully they was test cluster with no valuable data only because I'm still waiting for an hardware part that has still to arrive) I'm a little bit angry. The commercial solution isn't a solution because

Re: [Gluster-users] Add single server

I have to agree though, you keep acting like a customer. If you don't like what the developers focus on, you are free to try and offer a bounty to motivate someone to look at what you want, or even better : go and buy a license for one of gluster's commercial alternatives. On Sat, Apr 29, 2017

Re: [Gluster-users] Add single server

I'm pretty sure that I'll be able to sleep well even after your block. Il 29 apr 2017 11:28 PM, "Joe Julian" ha scritto: > No, you proposed a wish. A feature needs described behavior, certainly a > lot more than "it should just know what I want it to do". > > I'm done.

Re: [Gluster-users] Add single server

No, you proposed a wish. A feature needs described behavior, certainly a lot more than "it should just know what I want it to do". I'm done. You can continue to feel entitled here on the mailing list. I'll just set my filters to bitbucket anything from you. On 04/29/2017 01:00 PM, Gandalf

Re: [Gluster-users] Add single server

I repeat: I've just proposed a feature I'm not a C developer and I don't know gluster internals, so I can't provide details I've just asked if simplifying the add brick process is something that developers are interested to add Il 29 apr 2017 9:34 PM, "Joe Julian" ha

Re: [Gluster-users] Add single server

I am just a user, one that's been here for ten years. I've been highly involved in the community and spend countless hours if my own time contributing by helping users on irc. I'm not a C developer and so I do not contribute code. My point is that suggesting something is very different from

Re: [Gluster-users] Add single server

Mine was a suggestion Fell free to ignore was gluster users has to say and still keep going though your way Usually, open source project tends to follow users suggestions Il 29 apr 2017 5:32 PM, "Joe Julian" ha scritto: > Since this is an open source community project,

Re: [Gluster-users] Add single server

Since this is an open source community project, not a company product, feature requests like these are welcome, but would be more welcome with either code or at least a well described method. Broad asks like these are of little value, imho. On 04/29/2017 07:12 AM, Gandalf Corvotempesta

Re: [Gluster-users] Add single server

Anyway, the proposed workaround: https://joejulian.name/blog/how-to-expand-glusterfs-replicated-clusters-by-one-server/ won't work with just a single volume made up of 2 replicated bricks. If I have a replica 2 volume with server1:brick1 and server2:brick1, how can I add server3:brick1 ? I don't

Re: [Gluster-users] Add single server

2017-04-24 10:21 GMT+02:00 Pranith Kumar Karampuri : > Are you suggesting this process to be easier through commands, rather than > for administrators to figure out how to place the data? > > [1] http://lists.gluster.org/pipermail/gluster-users/2016-July/027431.html Admin

Re: [Gluster-users] Add single server

2017-04-24 10:21 GMT+02:00 Pranith Kumar Karampuri : > At least in case of EC it is with good reason. If you want to change > volume's configuration from 6+2->7+2 you have to compute the encoding again > and place different data on the resulting 9 bricks. Which has to be done

Re: [Gluster-users] Add single server

On Mon, Apr 24, 2017 at 1:24 PM, Gandalf Corvotempesta < gandalf.corvotempe...@gmail.com> wrote: > Il 24 apr 2017 9:40 AM, "Ashish Pandey" ha scritto: > > > There is difference between server and bricks which we should understand. > When we say m+n = 6+2, then we are

Re: [Gluster-users] Add single server

Il 24 apr 2017 9:40 AM, "Ashish Pandey" ha scritto: There is difference between server and bricks which we should understand. When we say m+n = 6+2, then we are talking about the bricks. Total number of bricks are m+n = 8. Now, these bricks could be anywhere on any

Re: [Gluster-users] Add single server

ot;Serkan Çoban" <cobanser...@gmail.com> To: "Gandalf Corvotempesta" <gandalf.corvotempe...@gmail.com> Cc: "gluster-users" <Gluster-users@gluster.org> Sent: Saturday, April 22, 2017 5:34:52 PM Subject: Re: [Gluster-users] Add single server In EC if

Re: [Gluster-users] Add single server

In EC if you have m+n configuration, you have to grow by m+n bricks. If you have 6+2 you need to add another 8 bricks. On Sat, Apr 22, 2017 at 3:02 PM, Gandalf Corvotempesta wrote: > I'm still trying to figure out if adding a single server to an > existing

[Gluster-users] Add single server

I'm still trying to figure out if adding a single server to an existing gluster cluster is possible or not, based on EC or standard replica. I don't think so, because with replica 3, when each server is already full (no more slots for disks), I need to add 3 server at once. Is this the same even