Re: [Gluster-users] Hundreds of duplicate files

2014-12-27 Thread Vijay Bellur
On 12/27/2014 01:11 PM, tben...@3vgeomatics.com wrote: Thanks for your continued help Joe. A demonstration of the problem, in this case I was able to open the file in vim (a text file) without any issues, however sometimes duplicated text files open in vim as one line consisting of @ characters,

Re: [Gluster-users] Hundreds of duplicate files

2014-12-27 Thread tbenzvi
Moving the file with linkto attribute worked! Just one copy of the file is retained in the listing and can be read without problems. I will write a script to remove these rogue link files from the bricks - any risks associated with this? Thanks everyone for your help, of course if anyone could

Re: [Gluster-users] Hundreds of duplicate files

2014-12-27 Thread Joe Julian
Should be safe. Here's what I've done in the past to clean up rogue dht link files (not that yours looked rogue though): find $brick_root -type f -size 0 -perm 1000 -exec /bin/rm {} \; On 12/27/2014 11:09 AM, tben...@3vgeomatics.com wrote: Moving the file with linkto attribute worked! Just

Re: [Gluster-users] Hundreds of duplicate files

2014-12-27 Thread tbenzvi
Ok, I am really tearing my hair out here. I tried doing this manually for several other files just to be sure. And in these cases it removed the duplicate file from the directory listing, but the file can still not be read.. Reading directly from the brick works fine. - Original

Re: [Gluster-users] Hundreds of duplicate files

2014-12-27 Thread Joe Julian
I'm wondering if this is from a corrupted failed rebalance. In a directory that has duplicates, do setfattr -n trusted.distribute.fix.layout -v 1 . If that fixes it, do a rebalance...fix-layout On December 27, 2014 12:38:01 PM PST, tben...@3vgeomatics.com wrote: Ok, I am really tearing my hair

Re: [Gluster-users] Hundreds of duplicate files

2014-12-27 Thread tbenzvi
That didn't fix it unfortunately. In fact, I've done a full rebalance after initially discovering the problem and after updating Gluster, but nothing was changed.. I don't know too much about how Gluster works internally; is it possible to compute the hash for each duplicate filename - figure

Re: [Gluster-users] Hundreds of duplicate files

2014-12-27 Thread Joe Julian
The linkfile you showed earlier was perfect. Check this article on my blog for the details on how dht works and how to calculate hashes: http://joejulian.name/blog/dht-misses-are-expensive/ On December 27, 2014 3:18:00 PM PST, tben...@3vgeomatics.com wrote: That didn't fix it unfortunately. In

Re: [Gluster-users] split-brain with quorum enabled

2014-12-27 Thread Pranith Kumar Karampuri
On 12/25/2014 08:05 PM, Alexey wrote: Hi all, We are using glusterfs setup with a quorum turned on and the configuration as the follows: Nodes: 3 Type: Replicate Number of Bricks: 1 x 3 = 3 cluster.quorum-type: fixed cluster.quorum-count: 2 cluster.data-self-heal-algorithm: diff

Re: [Gluster-users] Hundreds of duplicate files

2014-12-27 Thread tbenzvi
Thanks Joe, I've read your blog post as well as your post regarding the .glusterfs directory. I found some unneeded duplicate files which were not being read properly. I then deleted the link file from the brick. This always removes the duplicate file from the listing, but the file does not

Re: [Gluster-users] Hundreds of duplicate files

2014-12-27 Thread Vijay Bellur
On 12/28/2014 10:13 AM, tben...@3vgeomatics.com wrote: Thanks Joe, I've read your blog post as well as your post regarding the .glusterfs directory. I found some unneeded duplicate files which were not being read properly. I then deleted the link file from the brick. This always removes the

Re: [Gluster-users] Hundreds of duplicate files

2014-12-27 Thread tbenzvi
Hi Vijay, Yes the files are still readable from the .glusterfs path. There is no explicit error. However, trying to read a text file in python simply gives me null characters: open('ott_mf_itab').readlines()