Re: [Gluster-devel] heal info output

[Emmanuel Dreyfus]

On Mon, Jul 06, 2020 at 12:27:38PM +0200, Xavi Hernandez wrote:
> Is the '.attribute' directory only present on the root directory of a
> filesystem ? if so I strongly recommend to never use the root of a
> filesystem to place bricks. Always place the brick into a subdirectory.

Right, but once the user did the mistake, we need a way out. I found 
the new places in the posix xlator where taht directory was not properly
ignored, I will submit a patch.

> > 2) /owncloud/data  is a directory. mode, owner and groups are the same
> > on bricks. Why is it listed here?
> 
> If files or subdirectories have been created or removed from that directory
> and the operation failed on some brick (or the brick was down), the
> directory is also marked as bad. You should also check the contents.

Indeed there was some messy stuff, but the only way I found to fix it was
cp -rp dir dir.bak && mv dir dir.orig && mv dir.bak dir  rm -rf dir.orig

But now I have directories in split brain. The only difference I find
is a file mtime. How should I fix that? gluster volume heal gfs splut-brain 
latest-mtime dir does not work, and if I try it on the file inside, I am told 
it is
not in split brain.

-- 
Emmanuel Dreyfus
m...@netbsd.org
___

Community Meeting Calendar:

Schedule -
Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC
Bridge: https://bluejeans.com/441850968




Gluster-devel mailing list
Gluster-devel@gluster.org
https://lists.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] heal info output

[Xavi Hernandez]

Hi Emmanuel,

On Thu, Jul 2, 2020 at 3:05 AM Emmanuel Dreyfus  wrote:

> Hello
>
> gluster volume heal info show me questionable entries. I wonder if these
> are bugs, or if I shoud handle them and how.
>
> bidon# gluster volume heal gfs info
> Brick bidon:/export/wd0e_tmp
> Status: Connected
> Number of entries: 0
>
> Brick baril:/export/wd0e
> /.attribute/system
> 
> Status: Connected
> Number of entries: 2
>
> (...)
> Brick bidon:/export/wd2e
> 
> 
> /owncloud/data
> 
> 
> 
> 
>
> There are three cases:
> 1) /.attribute directory is special on NetBSD, it is where extended
> attributes are stored for the filesystem. The posix xlator takes care of
> screening it, but there must be some other softrware component that
> should learn it must disregeard it. Hints are welcome about where I
> should look at.
>

Is the '.attribute' directory only present on the root directory of a
filesystem ? if so I strongly recommend to never use the root of a
filesystem to place bricks. Always place the brick into a subdirectory.


> 2) /owncloud/data  is a directory. mode, owner and groups are the same
> on bricks. Why is it listed here?
>

If files or subdirectories have been created or removed from that directory
and the operation failed on some brick (or the brick was down), the
directory is also marked as bad. You should also check the contents.


> 3)  What should I do with this?
>

These are files or directories for whose real path is not known. If
gfid2path feature is enabled, you can check the
trusted.gfid2path.xx xattr on the gfid. It shows the gfid of the parent
directory and the file name. The full path can be retrieved by following
the directory symlinks or using the gfid-to-dirname.sh script in the extras
directory.

If gfid2path is not enabled, I fear that finding them will need to be done
by bruteforce:

1. Get the inode number of one of the gfid entries on one brick.
2. Run 'find  -inum 

Once you find the entries, if you do an 'stat' on the mount point of the
volume, the next "gluster volume heal info" should show the real path of
the files instead its gfid

Regards,

Xavi

-- 
> Emmanuel Dreyfus
> http://hcpnet.free.fr/pubz
> m...@netbsd.org
> ___
>
> Community Meeting Calendar:
>
> Schedule -
> Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC
> Bridge: https://bluejeans.com/441850968
>
>
>
>
> Gluster-devel mailing list
> Gluster-devel@gluster.org
> https://lists.gluster.org/mailman/listinfo/gluster-devel
>
>
___

Community Meeting Calendar:

Schedule -
Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC
Bridge: https://bluejeans.com/441850968




Gluster-devel mailing list
Gluster-devel@gluster.org
https://lists.gluster.org/mailman/listinfo/gluster-devel