[Gluster-users] Announcing Glusterfs release 3.12.4 (Long Term Maintenance)

[Jiffin Tony Thottan]

The Gluster community is pleased to announce the release of Gluster 
3.12.4 (packages available at [1,2,3]).


Release notes for the release can be found at [4].

We still carry following major issue that is reported in the 
release-notes as follows,


1.) - Expanding a gluster volume that is sharded may cause file corruption

    Sharded volumes are typically used for VM images, if such volumes 
are expanded or possibly contracted (i.e add/remove bricks and 
rebalance) there are reports of VM images getting corrupted.


    The last known cause for corruption (Bug #1465123) has a fix with 
this release. As further testing is still in progress, the issue is 
retained as a major issue.


    Status of this bug can be tracked here, #1465123

Thanks,
Gluster community


[1] https://download.gluster.org/pub/gluster/glusterfs/3.12/3.12.4/
[2] https://launchpad.net/~gluster/+archive/ubuntu/glusterfs-3.12
[3] https://build.opensuse.org/project/subprojects/home:glusterfs
[4] Release notes: 
https://gluster.readthedocs.io/en/latest/release-notes/3.12.4/


___
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] interval or event to evaluate free disk space?

[Nithya Balachandran]

On 19 December 2017 at 00:11, Stefan Solbrig  wrote:

> Hi all,
>
> with the option "cluster.min-free-disk" set, glusterfs avoids placing
> files bricks that are "too full".
> I'd like to understand when the free space on the bricks  is calculated.
> It seems to me that this does not happen for every write call (naturally)
> but at some interval or that some other event triggers this.
>

This is checked as part of the file create and mkdir calls.

>
> i.e, if I write two files quickly (that together would fill a brick) I'd
> get a error message:
>
> dd if=/dev/zero  of=abs=1k count=15000 && sleep 1 && dd if=/dev/zero
> of=aa bs=1k count=15000
> #yiels: dd: error writing ‘aa’: No space left on device
> #(brick1 is full, but glusterd still tries to place file "aa" on the same
> brick
>
> dd if=/dev/zero  of=abs=1k count=15000 && sleep 60  && dd
> if=/dev/zero  of=aa bs=1k count=15000
> #this works
> #link file on brick1 to "aa" and the real "aa"-file on brick2
>

Are these being done in parallel? If yes, you can hit this problem as the
value is calculated before the create at which point there is sufficient
disk space.

Regards,
Nithya

>
> when is statfs (or a simlar call) evaluated?
>
> Thank you!
> best wishes,
> Stefan
>
>
>
>
> ___
> Gluster-users mailing list
> Gluster-users@gluster.org
> http://lists.gluster.org/mailman/listinfo/gluster-users
___
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] Gluster consulting

[Amye Scavarda]

That being said, if there are other companies who support Gluster, we
are more than happy to add them to the support page!
- amye

On Mon, Dec 18, 2017 at 12:13 PM, Herb Burnswell
 wrote:
> Thanks for the replies Joe.
>
> Yes, it does seem that Gluster is a very in-demand expertise.  And it's hard
> to justify the cost of Red Hat's commercial offering without first putting a
> POC in place to confirm viability.
>
> Thanks again,
>
> HB
>
> On Mon, Dec 18, 2017 at 12:08 PM, Joe Julian  wrote:
>>
>> Yeah, unfortunately that's all that have come forward as available. I
>> think the demand for gluster expertise is just so high and the pool of
>> experts so low that there's nobody left to do consulting work.
>>
>>
>> On 12/18/2017 12:04 PM, Herb Burnswell wrote:
>>
>> Hi,
>>
>> Sorry, I just saw the post from last week
>>
>> I have seen this page before, however other than Red Hat (who I've spoken
>> with and we're not ready to pay for their enterprise gluster offering) these
>> companies appear to all be located in Europe.  Ideally, it would be easier
>> for us to work in a closer time zone (PST) to have better overlap during
>> business hours.
>>
>> If nothing else is available I understand, I just want to see if anyone
>> knew of other options.
>>
>> Thanks again,
>>
>> HB
>>
>> On Mon, Dec 18, 2017 at 11:50 AM, Herb Burnswell
>>  wrote:
>>>
>>> Hi,
>>>
>>> Can anyone suggest any companies or other that do Gluster consulting?
>>>
>>> I'm looking for guidance on on configuration, best practices, trouble
>>> shooting, etc.
>>>
>>> Any guidance is greatly appreciated.
>>>
>>> HB
>>
>>
>>
>>
>> ___
>> Gluster-users mailing list
>> Gluster-users@gluster.org
>> http://lists.gluster.org/mailman/listinfo/gluster-users
>>
>>
>>
>> ___
>> Gluster-users mailing list
>> Gluster-users@gluster.org
>> http://lists.gluster.org/mailman/listinfo/gluster-users
>
>
>
> ___
> Gluster-users mailing list
> Gluster-users@gluster.org
> http://lists.gluster.org/mailman/listinfo/gluster-users



-- 
Amye Scavarda | a...@redhat.com | Gluster Community Lead
___
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] Gluster consulting

[Herb Burnswell]

Thanks for the replies Joe.

Yes, it does seem that Gluster is a very in-demand expertise.  And it's
hard to justify the cost of Red Hat's commercial offering without first
putting a POC in place to confirm viability.

Thanks again,

HB

On Mon, Dec 18, 2017 at 12:08 PM, Joe Julian  wrote:

> Yeah, unfortunately that's all that have come forward as available. I
> think the demand for gluster expertise is just so high and the pool of
> experts so low that there's nobody left to do consulting work.
>
> On 12/18/2017 12:04 PM, Herb Burnswell wrote:
>
> Hi,
>
> Sorry, I just saw the post
> 
> from last week
>
> I have seen this page  before, however
> other than Red Hat (who I've spoken with and we're not ready to pay for
> their enterprise gluster offering) these companies appear to all be located
> in Europe.  Ideally, it would be easier for us to work in a closer time
> zone (PST) to have better overlap during business hours.
>
> If nothing else is available I understand, I just want to see if anyone
> knew of other options.
>
> Thanks again,
>
> HB
>
> On Mon, Dec 18, 2017 at 11:50 AM, Herb Burnswell <
> herbert.burnsw...@gmail.com> wrote:
>
>> Hi,
>>
>> Can anyone suggest any companies or other that do Gluster consulting?
>>
>> I'm looking for guidance on on configuration, best practices, trouble
>> shooting, etc.
>>
>> Any guidance is greatly appreciated.
>>
>> HB
>>
>
>
>
> ___
> Gluster-users mailing 
> listGluster-users@gluster.orghttp://lists.gluster.org/mailman/listinfo/gluster-users
>
>
>
> ___
> Gluster-users mailing list
> Gluster-users@gluster.org
> http://lists.gluster.org/mailman/listinfo/gluster-users
>
___
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] Gluster consulting

[Joe Julian]

Yeah, unfortunately that's all that have come forward as available. I 
think the demand for gluster expertise is just so high and the pool of 
experts so low that there's nobody left to do consulting work.



On 12/18/2017 12:04 PM, Herb Burnswell wrote:

Hi,

Sorry, I just saw the post 
 
from last week


I have seen this page  before, 
however other than Red Hat (who I've spoken with and we're not ready 
to pay for their enterprise gluster offering) these companies appear 
to all be located in Europe.  Ideally, it would be easier for us to 
work in a closer time zone (PST) to have better overlap during 
business hours.


If nothing else is available I understand, I just want to see if 
anyone knew of other options.


Thanks again,

HB

On Mon, Dec 18, 2017 at 11:50 AM, Herb Burnswell 
> wrote:


Hi,

Can anyone suggest any companies or other that do Gluster consulting?

I'm looking for guidance on on configuration, best practices,
trouble shooting, etc.

Any guidance is greatly appreciated.

HB




___
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users


___
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] Gluster consulting

[Herb Burnswell]

Hi,

Sorry, I just saw the post

from last week

I have seen this page  before, however
other than Red Hat (who I've spoken with and we're not ready to pay for
their enterprise gluster offering) these companies appear to all be located
in Europe.  Ideally, it would be easier for us to work in a closer time
zone (PST) to have better overlap during business hours.

If nothing else is available I understand, I just want to see if anyone
knew of other options.

Thanks again,

HB

On Mon, Dec 18, 2017 at 11:50 AM, Herb Burnswell <
herbert.burnsw...@gmail.com> wrote:

> Hi,
>
> Can anyone suggest any companies or other that do Gluster consulting?
>
> I'm looking for guidance on on configuration, best practices, trouble
> shooting, etc.
>
> Any guidance is greatly appreciated.
>
> HB
>
___
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] Gluster consulting

[Joe Julian]

https://www.gluster.org/support


On 12/18/2017 11:50 AM, Herb Burnswell wrote:

Hi,

Can anyone suggest any companies or other that do Gluster consulting?

I'm looking for guidance on on configuration, best practices, trouble 
shooting, etc.


Any guidance is greatly appreciated.

HB


___
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users


___
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users

[Gluster-users] Gluster consulting

[Herb Burnswell]

Hi,

Can anyone suggest any companies or other that do Gluster consulting?

I'm looking for guidance on on configuration, best practices, trouble
shooting, etc.

Any guidance is greatly appreciated.

HB
___
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users

[Gluster-users] Upgrading from Gluster 3.8 to 3.12

[Ziemowit Pierzycki]

Hi,

I have a cluster of 10 servers all running Fedora 24 along with
Gluster 3.8.  I'm planning on doing rolling upgrades to Fedora 27 with
Gluster 3.12.  I saw the documentation and did some testing but I
would like to run my plan through some (more?) educated minds.

The current setup is:

Volume Name: vol0
Distributed-Replicate
Number of Bricks: 2 x (2 + 1) = 6
Bricks:
Brick1: glt01:/vol/vol0
Brick2: glt02:/vol/vol0
Brick3: glt05:/vol/vol0 (arbiter)
Brick4: glt03:/vol/vol0
Brick5: glt04:/vol/vol0
Brick6: glt06:/vol/vol0 (arbiter)

Volume Name: vol1
Distributed-Replicate
Number of Bricks: 2 x (2 + 1) = 6
Bricks:
Brick1: glt07:/vol/vol1
Brick2: glt08:/vol/vol1
Brick3: glt05:/vol/vol1 (arbiter)
Brick4: glt09:/vol/vol1
Brick5: glt10:/vol/vol1
Brick6: glt06:/vol/vol1 (arbiter)

After performing the upgrade because of differences in checksums, the
upgraded nodes will become:

State: Peer Rejected (Connected)

If I start doing the upgrades one at a time, with nodes glt10 to glt01
except for the arbiters glt05 and glt06, and then upgrading the
arbiters last, everything should remain online at all times through
the process.  Correct?

Thanks.
___
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users

[Gluster-users] interval or event to evaluate free disk space?

[Stefan Solbrig]

Hi all, 

with the option "cluster.min-free-disk" set, glusterfs avoids placing files 
bricks that are "too full".
I'd like to understand when the free space on the bricks  is calculated. It 
seems to me that this does not happen for every write call (naturally) but at 
some interval or that some other event triggers this. 

i.e, if I write two files quickly (that together would fill a brick) I'd get a 
error message:

dd if=/dev/zero  of=abs=1k count=15000 && sleep 1 && dd if=/dev/zero  of=aa 
bs=1k count=15000
#yiels: dd: error writing ‘aa’: No space left on device
#(brick1 is full, but glusterd still tries to place file "aa" on the same brick

dd if=/dev/zero  of=abs=1k count=15000 && sleep 60  && dd if=/dev/zero  
of=aa bs=1k count=15000
#this works
#link file on brick1 to "aa" and the real "aa"-file on brick2

when is statfs (or a simlar call) evaluated?

Thank you!
best wishes,
Stefan




___
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users

[Gluster-users] Heketi v5.0.1 security release available for download

[Michael Adam]

Heketi v5.0.1 is now available.


This release[1] fixes a flaw that was found in heketi API that
permits issuing of OS commands through specially crafted
requests, possibly leading to escalation of privileges. More
details can be obtained at CVE-2017-15103. [2]

If authentication is turned "on" in heketi configuration, the
flaw can be exploited only by those who possess authentication
key. In case you have a deployment without authentication set to
true, we recommend that you turn it on and also upgrade to
version with fix.


We thank Markus Krell of NTT Security for identifying
the vulnerability and notifying us about the it.

The fix was provided by Raghavendra Talur of Red Hat.


Note that previous versions of Heketi are discontinued
and users are strongly recommended to upgrade to Heketi 5.0.1.


Michael Adam on behalf of the Heketi team


[1] https://github.com/heketi/heketi/releases/tag/v5.0.1
[2] https://cve.mitre.org/cgi-bin/cvename.cgi?name=2017-15103


signature.asc
Description: PGP signature
___
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] reset-brick command questions

[Jorick Astrego]

Hi Ashish,

Thanks for the information.

Weird, I did another test and it works fine now. Maybe I did something 
wrong the first time...

I will try it a couple more times to see if I can reproduce..

Regards, Jorick


On 12/12/2017 03:00 AM, Ashish Pandey wrote:
> Hi Jorick,
>
> 1 - Why would I even need to specify the "|HOSTNAME:BRICKPATH|" twice? 
> I just want to replace the disk and get it back into the volume.
>
> Reset brick command can be used in different scenarios. One more case 
> could be where you just want to change the host name to IP address of 
> that node of bricks.
> In this case also you will follow the same steps but just have to 
> provide IP address
>
> gluster volume reset-brick glustervol 
> gluster1:/gluster/brick1/glusterbrick1 */"gluster1 IP 
> address"/*:/gluster/brick1/glusterbrick1 commit force
>
> Now as we have this command for different cases, to keep uniformity of 
> the command, we chose to provide brick path twice.
>
> Coming to your case, I think you followed all the steps correctly and 
> it should be successful.
> Please provide guster volume status of the volume and also try to use 
> "commit force" and only "commit" and let us know the result.
> You may have to raise a bug if it does not work so be prepared to 
> provide glusterd logs in /var/log/glusterfs/
>
> --
> Ashish
>
>
> 
> *From: *"Jorick Astrego" 
> *To: *gluster-users@gluster.org
> *Sent: *Monday, December 11, 2017 7:32:53 PM
> *Subject: *[Gluster-users] reset-brick command questions
>
> Hi,
>
> I'm trying to use the reset-brick command, but it's not completely 
> clear to me
>
>
>   Introducing reset-brick command
>
> /Notes for users:/ The reset-brick command provides support to
> reformat/replace the disk(s) represented by a brick within a
> volume. This is helpful when a disk goes bad etc
>
> That's what I need, the use case is a disk goes bad on a disperse 
> gluster node and we want to replace it with a new disk
>
> Start reset process -
>
> |gluster volume reset-brick VOLNAME HOSTNAME:BRICKPATH start |
>
> This works, I can see in gluster volume status the brick is not there 
> anymore
>
> The above command kills the respective brick process. Now the
> brick can be reformatted.
>
> To restart the brick after modifying configuration -
>
> |gluster volume reset-brick VOLNAME HOSTNAME:BRICKPATH
> HOSTNAME:BRICKPATH commit |
>
> If the brick was killed to replace the brick with same brick path,
> restart with following command -
>
> |gluster volume reset-brick VOLNAME HOSTNAME:BRICKPATH
> HOSTNAME:BRICKPATH commit force |
>
> This fails, I unmounted the gluster path, formatted a fresh disk, 
> mounted it on the old mount point and created the brick subdir on it.
>
> gluster volume reset-brick glustervol
> gluster1:/gluster/brick1/glusterbrick1
> gluster1:/gluster/brick1/glusterbrick1 commit force
>
> volume reset-brick: failed: Source brick must be stopped. Please
> use gluster volume reset-brick   start.
>
> Why would I even need to specify the "|HOSTNAME:BRICKPATH|" twice? I 
> just want to replace the disk and get it back into the volume.
>
>
>
>
>
>
> Met vriendelijke groet, With kind regards,
>
> Jorick Astrego
> *
> Netbulae Virtualization Experts *
> 
> Tel: 053 20 30 270i...@netbulae.euStaalsteden 4-3AKvK 
> 08198180
> Fax: 053 20 30 271www.netbulae.eu 7547 TA EnschedeBTW 
> NL821234584B01
>
>
> 
>
>
> ___
> Gluster-users mailing list
> Gluster-users@gluster.org
> http://lists.gluster.org/mailman/listinfo/gluster-users
>





Met vriendelijke groet, With kind regards,

Jorick Astrego

Netbulae Virtualization Experts 



Tel: 053 20 30 270  i...@netbulae.euStaalsteden 4-3A
KvK 08198180
Fax: 053 20 30 271  www.netbulae.eu 7547 TA Enschede
BTW NL821234584B01



___
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] Production Volume will not start

[Matt Waymack]

Hi thank you for the reply.  Ultimately the volume did eventually start after 
about 1.5 hours from the volume start command.  Could it have something to do 
with the amount of files on the volume?

From: Atin Mukherjee [mailto:amukh...@redhat.com]
Sent: Monday, December 18, 2017 1:26 AM
To: Matt Waymack 
Cc: gluster-users 
Subject: Re: [Gluster-users] Production Volume will not start



On Sat, Dec 16, 2017 at 12:45 AM, Matt Waymack 
> wrote:

Hi all,



I have an issue where our volume will not start from any node.  When attempting 
to start the volume it will eventually return:

Error: Request timed out



For some time after that, the volume is locked and we either have to wait or 
restart Gluster services.  In the gluserd.log, it shows the following:



[2017-12-15 18:00:12.423478] I [glusterd-utils.c:5926:glusterd_brick_start] 
0-management: starting a fresh brick process for brick /exp/b1/gv0

[2017-12-15 18:03:12.673885] I 
[glusterd-locks.c:729:gd_mgmt_v3_unlock_timer_cbk] 0-management: In 
gd_mgmt_v3_unlock_timer_cbk

[2017-12-15 18:06:34.304868] I [MSGID: 106499] 
[glusterd-handler.c:4303:__glusterd_handle_status_volume] 0-management: 
Received status volume req for volume gv0

[2017-12-15 18:06:34.306603] E [MSGID: 106301] 
[glusterd-syncop.c:1353:gd_stage_op_phase] 0-management: Staging of operation 
'Volume Status' failed on localhost : Volume gv0 is not started

[2017-12-15 18:11:39.412700] I [glusterd-utils.c:5926:glusterd_brick_start] 
0-management: starting a fresh brick process for brick /exp/b2/gv0

[2017-12-15 18:11:42.405966] I [MSGID: 106143] 
[glusterd-pmap.c:280:pmap_registry_bind] 0-pmap: adding brick /exp/b2/gv0 on 
port 49153

[2017-12-15 18:11:42.406415] I [rpc-clnt.c:1044:rpc_clnt_connection_init] 
0-management: setting frame-timeout to 600

[2017-12-15 18:11:42.406669] I [glusterd-utils.c:5926:glusterd_brick_start] 
0-management: starting a fresh brick process for brick /exp/b3/gv0

[2017-12-15 18:14:39.737192] I 
[glusterd-locks.c:729:gd_mgmt_v3_unlock_timer_cbk] 0-management: In 
gd_mgmt_v3_unlock_timer_cbk

[2017-12-15 18:35:20.856849] I [MSGID: 106143] 
[glusterd-pmap.c:280:pmap_registry_bind] 0-pmap: adding brick /exp/b1/gv0 on 
port 49152

[2017-12-15 18:35:20.857508] I [rpc-clnt.c:1044:rpc_clnt_connection_init] 
0-management: setting frame-timeout to 600

[2017-12-15 18:35:20.858277] I [glusterd-utils.c:5926:glusterd_brick_start] 
0-management: starting a fresh brick process for brick /exp/b4/gv0

[2017-12-15 18:46:07.953995] I [MSGID: 106143] 
[glusterd-pmap.c:280:pmap_registry_bind] 0-pmap: adding brick /exp/b3/gv0 on 
port 49154

[2017-12-15 18:46:07.954432] I [rpc-clnt.c:1044:rpc_clnt_connection_init] 
0-management: setting frame-timeout to 600

[2017-12-15 18:46:07.971355] I [rpc-clnt.c:1044:rpc_clnt_connection_init] 
0-snapd: setting frame-timeout to 600

[2017-12-15 18:46:07.989392] I [rpc-clnt.c:1044:rpc_clnt_connection_init] 
0-nfs: setting frame-timeout to 600

[2017-12-15 18:46:07.989543] I [MSGID: 106132] 
[glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: nfs already stopped

[2017-12-15 18:46:07.989562] I [MSGID: 106568] 
[glusterd-svc-mgmt.c:229:glusterd_svc_stop] 0-management: nfs service is stopped

[2017-12-15 18:46:07.989575] I [MSGID: 106600] 
[glusterd-nfs-svc.c:82:glusterd_nfssvc_manager] 0-management: nfs/server.so 
xlator is not installed

[2017-12-15 18:46:07.989601] I [rpc-clnt.c:1044:rpc_clnt_connection_init] 
0-glustershd: setting frame-timeout to 600

[2017-12-15 18:46:08.003011] I [MSGID: 106132] 
[glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: glustershd already 
stopped

[2017-12-15 18:46:08.003039] I [MSGID: 106568] 
[glusterd-svc-mgmt.c:229:glusterd_svc_stop] 0-management: glustershd service is 
stopped

[2017-12-15 18:46:08.003079] I [MSGID: 106567] 
[glusterd-svc-mgmt.c:197:glusterd_svc_start] 0-management: Starting glustershd 
service

[2017-12-15 18:46:09.005173] I [rpc-clnt.c:1044:rpc_clnt_connection_init] 
0-quotad: setting frame-timeout to 600

[2017-12-15 18:46:09.005569] I [rpc-clnt.c:1044:rpc_clnt_connection_init] 
0-bitd: setting frame-timeout to 600

[2017-12-15 18:46:09.005673] I [MSGID: 106132] 
[glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: bitd already stopped

[2017-12-15 18:46:09.005689] I [MSGID: 106568] 
[glusterd-svc-mgmt.c:229:glusterd_svc_stop] 0-management: bitd service is 
stopped

[2017-12-15 18:46:09.005712] I [rpc-clnt.c:1044:rpc_clnt_connection_init] 
0-scrub: setting frame-timeout to 600

[2017-12-15 18:46:09.005892] I [MSGID: 106132] 
[glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: scrub already stopped

[2017-12-15 18:46:09.005912] I [MSGID: 106568] 
[glusterd-svc-mgmt.c:229:glusterd_svc_stop] 0-management: scrub service is 
stopped

[2017-12-15 18:46:09.026559] I [socket.c:3672:socket_submit_reply] 
0-socket.management: not connected (priv->connected = -1)

[2017-12-15