Re: [Gluster-users] gfid entries in volume heal info that do not heal

[Karthik Subrahmanya]

Hi Matt,

Run these commands on all the bricks of the replica pair to get the attrs
set on the backend.

On the bricks of first replica set:
getfattr -d -e hex -m . /.glusterfs/10/86/
108694db-c039-4b7c-bd3d-ad6a15d811a2

On the fourth replica set:
getfattr -d -e hex -m . /.glusterfs/
e0/c5/e0c56bf7-8bfe-46ca-bde1-e46b92d33df3

Also run the "gluster volume heal " once and send the shd log.
And the output of "gluster volume heal  info split-brain"

Regards,
Karthik

On Mon, Oct 16, 2017 at 9:51 PM, Matt Waymack  wrote:

> OK, so here’s my output of the volume info and the heal info. I have not
> yet tracked down physical location of these files, any tips to finding them
> would be appreciated, but I’m definitely just wanting them gone.  I forgot
> to mention earlier that the cluster is running 3.12 and was upgraded from
> 3.10; these files were likely stuck like this when it was on 3.10.
>
>
>
> [root@tpc-cent-glus1-081017 ~]# gluster volume info gv0
>
>
>
> Volume Name: gv0
>
> Type: Distributed-Replicate
>
> Volume ID: 8f07894d-e3ab-4a65-bda1-9d9dd46db007
>
> Status: Started
>
> Snapshot Count: 0
>
> Number of Bricks: 4 x (2 + 1) = 12
>
> Transport-type: tcp
>
> Bricks:
>
> Brick1: tpc-cent-glus1-081017:/exp/b1/gv0
>
> Brick2: tpc-cent-glus2-081017:/exp/b1/gv0
>
> Brick3: tpc-arbiter1-100617:/exp/b1/gv0 (arbiter)
>
> Brick4: tpc-cent-glus1-081017:/exp/b2/gv0
>
> Brick5: tpc-cent-glus2-081017:/exp/b2/gv0
>
> Brick6: tpc-arbiter1-100617:/exp/b2/gv0 (arbiter)
>
> Brick7: tpc-cent-glus1-081017:/exp/b3/gv0
>
> Brick8: tpc-cent-glus2-081017:/exp/b3/gv0
>
> Brick9: tpc-arbiter1-100617:/exp/b3/gv0 (arbiter)
>
> Brick10: tpc-cent-glus1-081017:/exp/b4/gv0
>
> Brick11: tpc-cent-glus2-081017:/exp/b4/gv0
>
> Brick12: tpc-arbiter1-100617:/exp/b4/gv0 (arbiter)
>
> Options Reconfigured:
>
> nfs.disable: on
>
> transport.address-family: inet
>
>
>
> [root@tpc-cent-glus1-081017 ~]# gluster volume heal gv0 info
>
> Brick tpc-cent-glus1-081017:/exp/b1/gv0
>
> 
>
> 
>
> 
>
> 
>
> 
>
>
>
> 
>
>
>
> Status: Connected
>
> Number of entries: 118
>
>
>
> Brick tpc-cent-glus2-081017:/exp/b1/gv0
>
> 
>
> 
>
> 
>
> 
>
> 
>
>
>
> 
>
>
>
> Status: Connected
>
> Number of entries: 118
>
>
>
> Brick tpc-arbiter1-100617:/exp/b1/gv0
>
> Status: Connected
>
> Number of entries: 0
>
>
>
> Brick tpc-cent-glus1-081017:/exp/b2/gv0
>
> Status: Connected
>
> Number of entries: 0
>
>
>
> Brick tpc-cent-glus2-081017:/exp/b2/gv0
>
> Status: Connected
>
> Number of entries: 0
>
>
>
> Brick tpc-arbiter1-100617:/exp/b2/gv0
>
> Status: Connected
>
> Number of entries: 0
>
>
>
> Brick tpc-cent-glus1-081017:/exp/b3/gv0
>
> Status: Connected
>
> Number of entries: 0
>
>
>
> Brick tpc-cent-glus2-081017:/exp/b3/gv0
>
> Status: Connected
>
> Number of entries: 0
>
>
>
> Brick tpc-arbiter1-100617:/exp/b3/gv0
>
> Status: Connected
>
> Number of entries: 0
>
>
>
> Brick tpc-cent-glus1-081017:/exp/b4/gv0
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> Status: Connected
>
> Number of entries: 24
>
>
>
> Brick tpc-cent-glus2-081017:/exp/b4/gv0
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> Status: Connected
>
> Number of entries: 24
>
>
>
> Brick tpc-arbiter1-100617:/exp/b4/gv0
>
> Status: Connected
>
> Number of entries: 0
>
>
>
> Thank you for your help!
>
>
>
> *From:* Karthik Subrahmanya [mailto:ksubr...@redhat.com]
> *Sent:* Monday, October 16, 2017 10:27 AM
> *To:* Matt Waymack 
> *Cc:* gluster-users 
> *Subject:* Re: [Gluster-users] gfid entries in volume heal info that do
> not heal
>
>
>
> Hi Matt,
>
>
>
> The files might be in split brain. Could you please send the outputs of
> these?
>
> gluster volume info 
>
> gluster volume heal  info
>
> And also the getfattr output of the files which are in the heal info
> output from all the bricks of that replica pair.
>
> getfattr -d -e hex -m . 
>
>
>
> Thanks &  Regards
>
> Karthik
>
>
>
> On 16-Oct-2017 8:16 PM, "Matt Waymack"  wrote:
>
> Hi all,
>
>
>
> I have a volume where the output of volume heal info shows several gfid
> entries to be healed, but they’ve been there for weeks and have not
> healed.  Any normal file that shows up on the heal info does get healed as
> expected, but these gfid entries do not.  Is there any way to remove these
> orphaned entries from the volume so they are no longer stuck in the heal
> process?
>
>
>
> Thank you!
>
>
> ___
> Gluster-users mailing list
> Gluster-users@gluster.org
> http://lists.gluster.org/mailman/listinfo/gluster-users
>
>
>
___
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users

[Gluster-users] Gluster CLI reference

[Nithya Balachandran]

Hi,

As part of our initiative to improve our docs, we have made a few changes
over the past few weeks. One of this is a CLI reference [1]. This is still
a WIP so not all commands have been documented.

Is this something you would find useful?
Would you like to see more information captured as part of this? If yes,
what else should we include?

Thanks,
Nithya

[1]: http://docs.gluster.org/en/latest/CLI-Reference/cli-main/
___
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users

[Gluster-users] gluster-block v0.3 is alive!

[Prasanna Kalever]

Hello Gluster folks,

We are happy to announce the release of gluster-block [1] v0.3. Please
find highlights and notable fixes which went in this release at [2].

The packages are made available at copr for Fedora users [3]. For
other distributions, one can easily compile it from source. Details
about installation can be found in the easy install guide at [4]. The
source tarball and community provided packages will be available soon
at [5].

The next release v0.4 is planned to have some exciting features and
improvements. Here is a potential list of features in v0.4:
* Replace node feature to substitute a faulty node.
* Support for Snapshots
* Ability to re-size existing block devices
* Performance improvements (IO and management)
* Containerized gluster-block and more!

gluster-block is now part of fedora package collection (f26), an
updated package with release version v0.3 will be soon made available.

Please report any issues that you observe using [6].

We look forward to your feedback to help us get better!


[1] https://github.com/gluster/gluster-block
[2] https://github.com/gluster/gluster-block/blob/master/NEWS
[3] https://copr.fedorainfracloud.org/coprs/pkalever/gluster-block/build/637643/
[4] https://github.com/gluster/gluster-block/blob/master/INSTALL
[5] https://download.gluster.org/pub/gluster/gluster-block/
[6] https://github.com/gluster/gluster-block/issues/new


Thanks!
___
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] gfid entries in volume heal info that do not heal

[Matt Waymack]

OK, so here’s my output of the volume info and the heal info. I have not yet 
tracked down physical location of these files, any tips to finding them would 
be appreciated, but I’m definitely just wanting them gone.  I forgot to mention 
earlier that the cluster is running 3.12 and was upgraded from 3.10; these 
files were likely stuck like this when it was on 3.10.

[root@tpc-cent-glus1-081017 ~]# gluster volume info gv0

Volume Name: gv0
Type: Distributed-Replicate
Volume ID: 8f07894d-e3ab-4a65-bda1-9d9dd46db007
Status: Started
Snapshot Count: 0
Number of Bricks: 4 x (2 + 1) = 12
Transport-type: tcp
Bricks:
Brick1: tpc-cent-glus1-081017:/exp/b1/gv0
Brick2: tpc-cent-glus2-081017:/exp/b1/gv0
Brick3: tpc-arbiter1-100617:/exp/b1/gv0 (arbiter)
Brick4: tpc-cent-glus1-081017:/exp/b2/gv0
Brick5: tpc-cent-glus2-081017:/exp/b2/gv0
Brick6: tpc-arbiter1-100617:/exp/b2/gv0 (arbiter)
Brick7: tpc-cent-glus1-081017:/exp/b3/gv0
Brick8: tpc-cent-glus2-081017:/exp/b3/gv0
Brick9: tpc-arbiter1-100617:/exp/b3/gv0 (arbiter)
Brick10: tpc-cent-glus1-081017:/exp/b4/gv0
Brick11: tpc-cent-glus2-081017:/exp/b4/gv0
Brick12: tpc-arbiter1-100617:/exp/b4/gv0 (arbiter)
Options Reconfigured:
nfs.disable: on
transport.address-family: inet

[root@tpc-cent-glus1-081017 ~]# gluster volume heal gv0 info
Brick tpc-cent-glus1-081017:/exp/b1/gv0








Status: Connected
Number of entries: 118

Brick tpc-cent-glus2-081017:/exp/b1/gv0








Status: Connected
Number of entries: 118

Brick tpc-arbiter1-100617:/exp/b1/gv0
Status: Connected
Number of entries: 0

Brick tpc-cent-glus1-081017:/exp/b2/gv0
Status: Connected
Number of entries: 0

Brick tpc-cent-glus2-081017:/exp/b2/gv0
Status: Connected
Number of entries: 0

Brick tpc-arbiter1-100617:/exp/b2/gv0
Status: Connected
Number of entries: 0

Brick tpc-cent-glus1-081017:/exp/b3/gv0
Status: Connected
Number of entries: 0

Brick tpc-cent-glus2-081017:/exp/b3/gv0
Status: Connected
Number of entries: 0

Brick tpc-arbiter1-100617:/exp/b3/gv0
Status: Connected
Number of entries: 0

Brick tpc-cent-glus1-081017:/exp/b4/gv0
























Status: Connected
Number of entries: 24

Brick tpc-cent-glus2-081017:/exp/b4/gv0
























Status: Connected
Number of entries: 24

Brick tpc-arbiter1-100617:/exp/b4/gv0
Status: Connected
Number of entries: 0

Thank you for your help!

From: Karthik Subrahmanya [mailto:ksubr...@redhat.com]
Sent: Monday, October 16, 2017 10:27 AM
To: Matt Waymack 
Cc: gluster-users 
Subject: Re: [Gluster-users] gfid entries in volume heal info that do not heal

Hi Matt,

The files might be in split brain. Could you please send the outputs of these?
gluster volume info 
gluster volume heal  info
And also the getfattr output of the files which are in the heal info output 
from all the bricks of that replica pair.
getfattr -d -e hex -m . 

Thanks &  Regards
Karthik

On 16-Oct-2017 8:16 PM, "Matt Waymack" 
mailto:mwaym...@nsgdv.com>> wrote:
Hi all,

I have a volume where the output of volume heal info shows several gfid entries 
to be healed, but they’ve been there for weeks and have not healed.  Any normal 
file that shows up on the heal info does get healed as expected, but these gfid 
entries do not.  Is there any way to remove these orphaned entries from the 
volume so they are no longer stuck in the heal process?

Thank you!

___
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users

___
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] gfid entries in volume heal info that do not heal

[Karthik Subrahmanya]

Hi Matt,

The files might be in split brain. Could you please send the outputs of
these?
gluster volume info 
gluster volume heal  info
And also the getfattr output of the files which are in the heal info output
from all the bricks of that replica pair.
getfattr -d -e hex -m . 

Thanks &  Regards
Karthik

On 16-Oct-2017 8:16 PM, "Matt Waymack"  wrote:

Hi all,



I have a volume where the output of volume heal info shows several gfid
entries to be healed, but they’ve been there for weeks and have not
healed.  Any normal file that shows up on the heal info does get healed as
expected, but these gfid entries do not.  Is there any way to remove these
orphaned entries from the volume so they are no longer stuck in the heal
process?



Thank you!

___
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users
___
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users

[Gluster-users] gfid entries in volume heal info that do not heal

[Matt Waymack]

Hi all,

I have a volume where the output of volume heal info shows several gfid entries 
to be healed, but they've been there for weeks and have not healed.  Any normal 
file that shows up on the heal info does get healed as expected, but these gfid 
entries do not.  Is there any way to remove these orphaned entries from the 
volume so they are no longer stuck in the heal process?

Thank you!
___
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] Gluster CLI Feedback

[Nithya Balachandran]

Gentle reminder.

Thanks to those who have already responded.
Nithya

On 11 October 2017 at 14:38, Nithya Balachandran 
wrote:

> Hi,
>
> As part of our initiative to improve Gluster usability, we would like
> feedback on the current Gluster CLI. Gluster 4.0 upstream development is
> currently in progress and it is an ideal time to consider CLI changes.
> Answers to the following would be appreciated:
>
>1. How often do you use the Gluster CLI? Is it a preferred method to
>manage Gluster?
>2. What operations do you commonly perform using the CLI?
>3. How intuitive/easy to use do you find the CLI ?
>4. Is the help/information displayed sufficient?
>5. Are there operations that are difficult to perform?
>
> Regards,
> Nithya
>
___
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users