Re: [Gluster-users] View from one client's gone subbornly bad
Can you post gluster client logs and check if there are any core dumps? Avati On Fri, Jul 22, 2011 at 9:05 AM, Whit Blauvelt wrote: > Okay ... > > Finally got that one replicated partition back in line. A few of the > recommended > > find /mnt/point -print0 | xargs --null stat > > from each side seems to have done some good. Then while I'm away a second > replicated partition on the same two systems ends up with a > > Transport endpoint is disconnected > > and even totally shutting down all the Gluster processes on that box and > restarting them does nothing for this - doesn't even create more entries in > the log for it. > > The other two replicated Gluster shares between these machines are > operating > still - including the one I first had the trouble with today. But this > third > one that decided it would be disconnected seems intent to stay that way - > despite that it's the same physical connection betweent the machines - > which > is fine - and the same Gluster daemons running on both. > > Again, this was all happy for many weeks with 3.1.3. So I'd give pretty > good > odds that 3.1.5 has some deep bugs. Should I go back, or do things finally > look better going forward? And what do I do to wake that disconnected > endpoint in the morning? > > Thanks, > Whit > > ___ > Gluster-users mailing list > Gluster-users@gluster.org > http://gluster.org/cgi-bin/mailman/listinfo/gluster-users > ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] View from one client's gone subbornly bad
Okay ... Finally got that one replicated partition back in line. A few of the recommended find /mnt/point -print0 | xargs --null stat from each side seems to have done some good. Then while I'm away a second replicated partition on the same two systems ends up with a Transport endpoint is disconnected and even totally shutting down all the Gluster processes on that box and restarting them does nothing for this - doesn't even create more entries in the log for it. The other two replicated Gluster shares between these machines are operating still - including the one I first had the trouble with today. But this third one that decided it would be disconnected seems intent to stay that way - despite that it's the same physical connection betweent the machines - which is fine - and the same Gluster daemons running on both. Again, this was all happy for many weeks with 3.1.3. So I'd give pretty good odds that 3.1.5 has some deep bugs. Should I go back, or do things finally look better going forward? And what do I do to wake that disconnected endpoint in the morning? Thanks, Whit ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Anyone have that find command handy
i would also add a -size 0.
-luis
On Jul 21, 2011, at 9:30 AM, Joe Landman wrote:
> On 07/21/2011 11:21 AM, Joe Landman wrote:
>> On 07/21/2011 11:17 AM, Burnash, James wrote:
>>> Hi Joe.
>>>
>
> Found it:
>
> find $local -type f -perm +01000 -exec rm -v '{}' \;
>
> for $local
>
>
>>> Before I answer - can you share your volume info dump?
>>
>> This is
>>
>> [root@X02 ~]# gluster volume info
>>
>> Volume Name: brick1
>> Type: Distribute
>> Status: Started
>> Number of Bricks: 4
>> Transport-type: tcp
>> Bricks:
>> Brick1: X01:/data/glusterfs/dht
>> Brick2: X02:/data/glusterfs/dht
>> Brick3: X03:/data/brick-sdc2/glusterfs/dht
>> Brick4: X03:/data/brick-sdd2/glusterfs/dht
>>
>>
>>>
>>> My understanding is that those "link" files are valid if you have my
>>> kind of config - which is distributed-replicate across 2 mirrored
>>> pairs of backed servers. If the request for a file come into the pair
>>> that do not have that file physically on their storage, the "link"
>>> file is created to point to the actual location on the other mirror.
>>> At least ... that is what I think it's supposed to do ...
>>
>> They are a known bug from 2.0.x time frame. I am searching my emails
>> from 2 years ago for the magic command that removes them.
>>
>>>
>>> James Burnash Unix Engineer Knight Capital Group
>>>
>>>
>>> -Original Message- From: gluster-users-boun...@gluster.org
>>> [mailto:gluster-users-boun...@gluster.org] On Behalf Of Joe Landman
>>> Sent: Thursday, July 21, 2011 11:11 AM To: gluster-users Subject:
>>> [Gluster-users] Anyone have that find command handy
>>>
>>> Ran into a situation that I thought had been corrected in the 2.0.x
>>> time frame.
>>>
>>> [root@X03 ~]# ls -alF
>>> /data/brick-sdc2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats
>>>
>>>
>>>
>> /data/brick-sdd2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip
>>
>>> -T 1 root root 0 Jul 19 18:08
>>> /data/brick-sdc2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats
>>>
>>>
>>>
>> -T 1 root root 0 Jul 21 10:48
>>> /data/brick-sdd2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip
>>>
>>>
>>> and the real files
>>>
>>> [root@X02 ~]# ls -alF
>>> /data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_*
>>> -rw-r--r-- 1 oracle oinstall 984227914 Jul 21 11:05
>>> /data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip
>>>
>>>
>> -rw-r--r-- 1 root root 17028780 Jul 20 13:00
>>> /data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats
>>>
>>>
>>> Note the permissions on the first as compared to the second. This
>>> came from a rebalance operation with 3.1.5.
>>>
>>> Anyone have that handy
>>>
>>> find -perm -exec rm {}
>>>
>>> command handy so we can scan for and remove the ghost files? I can
>>> search for it in my old emails, just figured I'd ask.
>>>
>>> -- Joseph Landman, Ph.D Founder and CEO Scalable Informatics, Inc.
>>> email: land...@scalableinformatics.com web :
>>> http://scalableinformatics.com
>>> http://scalableinformatics.com/sicluster phone: +1 734 786 8423 x121
>>> fax : +1 866 888 3112 cell : +1 734 612 4615
>>> ___ Gluster-users mailing
>>> list Gluster-users@gluster.org
>>> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>>>
>>>
>>> DISCLAIMER: This e-mail, and any attachments thereto, is intended
>>> only for use by the addressee(s) named herein and may contain legally
>>> privileged and/or confidential information. If you are not the
>>> intended recipient of this e-mail, you are hereby notified that any
>>> dissemination, distribution or copying of this e-mail, and any
>>> attachments thereto, is strictly prohibited. If you have received
>>> this in error, please immediately notify me and permanently delete
>>> the original and any copy of any e-mail and any printout thereof.
>>> E-mail transmission cannot be guaranteed to be secure or error-free.
>>> The sender therefore does not accept liability for any errors or
>>> omissions in the contents of this message which arise as a result of
>>> e-mail transmission. NOTICE REGARDING PRIVACY AND CONFIDENTIALITY
>>> Knight Capital Group may, at its discretion, monitor and review the
>>> content of all e-mail communications. http://www.knight.com
>>
>>
>
>
> --
> Joseph Landman, Ph.D
> Founder and CEO
> Scalable Informatics, Inc.
> email: land...@scalableinformatics.com
> web : http://scalableinformatics.com
> http://scalableinformatics.com/sicluster
> phone: +1 734 786 8423 x121
> fax : +1 866 888 3112
> cell : +1 734 612 4615
> ___
> Gluster-users mailing list
> Gluster-users@gluster.org
> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Luis E. Cerezo
http://www.luiscerezo.org
http://twitter.com/luiscerezo
http://flickr.com/photos/luiscerezo
photos for sale:
http://photos.lu
Re: [Gluster-users] View from one client's gone subbornly bad
> The client on the other system in the pair continues through this to have > normal access. The system with the Gluster client problem shows no other > symptoms. Update: Now the second system's having the same symptoms. Maybe I need to just go back to 3.1.3? Whit ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
[Gluster-users] View from one client's gone subbornly bad
Hi, This setup is two system which have replicated Gluster storage, and also are the clients for it. In both cases the Gluster mount is handled by autofs. The setup was quite stable with Gluster 3.1.3 for some weeks. Then a few days back I upgraded to 3.1.5 - wanted to try it on a less essential system before risking a production instance with the upgrade. Today the view from one of the systems, as client, has gone sour. The mount keeps disappearing, in a way that requires a manual "umount -l" on it to get automount to bring it back - for a bit. Operations that involve writing to it or even viewing the directory tend to lock up. I've rebooted the system several times with no improvement. I've copied all the files out of the backing store with Gluster not running, and then after restarting Gluster back in through the mount - which seemed to work. But then no improvement. The Gluster logs look totally uneventful through this - not many messages and nothing they hadn't had on prior days. The client on the other system in the pair continues through this to have normal access. The system with the Gluster client problem shows no other symptoms. What's the right way to troubleshoot this? Need to learn how before the production system I'm using Gluster with gets into this sort of trouble. Thanks, Whit ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Tools for the admin
On Thu, Jul 21, 2011 at 05:17:05PM -0400, Joe Landman wrote: > Depending upon distro, you would need libattr, attr-dev, etc. > Sadly, there is little/no consistency in naming these. On Ubuntu 10.04 attr-dev is an alias for libattr1-dev, which seems to install okay but there's still no ExtAttr.pm on the system. However fetching the source for File::ExtAttr from CPAN and building that by hand, rather than with the cpan utility, does work. Then Getopt::Lucid does install successfully with the cpan utility - couldn't find it as an Ubuntu package. At which point your script runs. Thanks, Whit ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Tools for the admin
On 07/21/2011 05:07 PM, Whit Blauvelt wrote: On Thu, Jul 14, 2011 at 12:15:00AM -0400, Joe Landman wrote: Tool #2: scan_gluster.pl Joe, Thanks for this contributions. scan_gluster.pl seems to depend on File::ExtAttr, which when I try to install it from cpan to Perl v5.10.1 fails at the "make" step for reasons cpan leaves unclear. Is there some prerequisite that might not be properly requested? Looking at this now because I just had a simple Gluster replication setup blow up in a nonobvious way. Not obvious from the logs anyhow. It may well be because I switched it from 3.1.3 to 3.1.5 a few days back. Anyway, it gives me a good excuse to learn how to diagnose a good failure, so I thought I'd start by seeing what your tools can show. Depending upon distro, you would need libattr, attr-dev, etc. Sadly, there is little/no consistency in naming these. If this turns out to be an issue, I'll see if I can code around it, but doing a sub process for each file would be seriously expensive for even reasonable sized file systems. Best, Whit -- Joseph Landman, Ph.D Founder and CEO Scalable Informatics, Inc. email: land...@scalableinformatics.com web : http://scalableinformatics.com http://scalableinformatics.com/sicluster phone: +1 734 786 8423 x121 fax : +1 866 888 3112 cell : +1 734 612 4615 ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Tools for the admin
On Thu, Jul 14, 2011 at 12:15:00AM -0400, Joe Landman wrote: > Tool #2: scan_gluster.pl Joe, Thanks for this contributions. scan_gluster.pl seems to depend on File::ExtAttr, which when I try to install it from cpan to Perl v5.10.1 fails at the "make" step for reasons cpan leaves unclear. Is there some prerequisite that might not be properly requested? Looking at this now because I just had a simple Gluster replication setup blow up in a nonobvious way. Not obvious from the logs anyhow. It may well be because I switched it from 3.1.3 to 3.1.5 a few days back. Anyway, it gives me a good excuse to learn how to diagnose a good failure, so I thought I'd start by seeing what your tools can show. Best, Whit ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
[Gluster-users] Optimal config for 2 replicated webservers with read performence
Hi! With my setup, when I copy a 500MB file from the Gluster mount to local disk it takes about 6-10 times longer than disk to disk. When I investigate it further, I see huge amounts of data between my two gluster servers. Is this the way gluster should work? I thought it just checked meta-data on the other server, it should not copy the entire file from the other server? My client config is the same on both servers: volume global1 type protocol/client option transport-type tcp option remote-host 10.10.10.20 option transport.socket.nodelay on option transport.remote-port 6996 option remote-subvolume brick2 end-volume volume global2 type protocol/client option transport-type tcp option remote-host 10.10.10.21 option transport.socket.nodelay on option transport.remote-port 6996 option remote-subvolume brick2 end-volume volume mirror-0 type cluster/replicate subvolumes global1 global2 end-volume volume writebehind type performance/write-behind option cache-size 10MB subvolumes mirror-0 end-volume volume iocache type performance/io-cache option cache-size 1GB option cache-timeout 5 subvolumes writebehind end-volume volume quickread type performance/quick-read option cache-timeout 5 option max-file-size 1024kB subvolumes iocache end-volume volume global type performance/stat-prefetch subvolumes quickread end-volume - Marius ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Anyone have that find command handy
On Thu, Jul 21, 2011 at 9:41 AM, Joe Landman
wrote:
> On 07/21/2011 12:35 PM, Mohit Anchlia wrote:
>>
>> Did this occur after adding or removing a brick and then running
>> rebalance?
>
> Adding and rebalance.
bug# 3026
>
>>
>> On Thu, Jul 21, 2011 at 8:30 AM, Joe Landman
>> wrote:
>>>
>>> On 07/21/2011 11:21 AM, Joe Landman wrote:
On 07/21/2011 11:17 AM, Burnash, James wrote:
>
> Hi Joe.
>
>>>
>>> Found it:
>>>
>>> find $local -type f -perm +01000 -exec rm -v '{}' \;
>>>
>>> for $local
>>>
>>>
> Before I answer - can you share your volume info dump?
This is
[root@X02 ~]# gluster volume info
Volume Name: brick1
Type: Distribute
Status: Started
Number of Bricks: 4
Transport-type: tcp
Bricks:
Brick1: X01:/data/glusterfs/dht
Brick2: X02:/data/glusterfs/dht
Brick3: X03:/data/brick-sdc2/glusterfs/dht
Brick4: X03:/data/brick-sdd2/glusterfs/dht
>
> My understanding is that those "link" files are valid if you have my
> kind of config - which is distributed-replicate across 2 mirrored
> pairs of backed servers. If the request for a file come into the pair
> that do not have that file physically on their storage, the "link"
> file is created to point to the actual location on the other mirror.
> At least ... that is what I think it's supposed to do ...
They are a known bug from 2.0.x time frame. I am searching my emails
from 2 years ago for the magic command that removes them.
>
> James Burnash Unix Engineer Knight Capital Group
>
>
> -Original Message- From: gluster-users-boun...@gluster.org
> [mailto:gluster-users-boun...@gluster.org] On Behalf Of Joe Landman
> Sent: Thursday, July 21, 2011 11:11 AM To: gluster-users Subject:
> [Gluster-users] Anyone have that find command handy
>
> Ran into a situation that I thought had been corrected in the 2.0.x
> time frame.
>
> [root@X03 ~]# ls -alF
>
>
> /data/brick-sdc2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats
>
>
>
/data/brick-sdd2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip
> -T 1 root root 0 Jul 19 18:08
>
>
> /data/brick-sdc2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats
>
>
>
-T 1 root root 0 Jul 21 10:48
>
>
>
> /data/brick-sdd2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip
>
>
> and the real files
>
> [root@X02 ~]# ls -alF
> /data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_*
> -rw-r--r-- 1 oracle oinstall 984227914 Jul 21 11:05
> /data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip
>
>
-rw-r--r-- 1 root root 17028780 Jul 20 13:00
>
>
>
> /data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats
>
>
> Note the permissions on the first as compared to the second. This
> came from a rebalance operation with 3.1.5.
>
> Anyone have that handy
>
> find -perm -exec rm {}
>
> command handy so we can scan for and remove the ghost files? I can
> search for it in my old emails, just figured I'd ask.
>
> -- Joseph Landman, Ph.D Founder and CEO Scalable Informatics, Inc.
> email: land...@scalableinformatics.com web :
> http://scalableinformatics.com
> http://scalableinformatics.com/sicluster phone: +1 734 786 8423 x121
> fax : +1 866 888 3112 cell : +1 734 612 4615
> ___ Gluster-users mailing
> list Gluster-users@gluster.org
> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>
>
> DISCLAIMER: This e-mail, and any attachments thereto, is intended
> only for use by the addressee(s) named herein and may contain legally
> privileged and/or confidential information. If you are not the
> intended recipient of this e-mail, you are hereby notified that any
> dissemination, distribution or copying of this e-mail, and any
> attachments thereto, is strictly prohibited. If you have received
> this in error, please immediately notify me and permanently delete
> the original and any copy of any e-mail and any printout thereof.
> E-mail transmission cannot be guaranteed to be secure or error-free.
> The sender therefore does not accept liability for any errors or
> omissions in the contents of this message which arise as a result of
> e-mail transmission. NOTICE REGARDING PRIVACY AND CONFIDENTIALITY
> Knight Capital Group may, at its discretion, monitor and review the
> content of all e-mail communications. http://www.knight.com
>>>
>>>
>>> --
>>> Joseph Landman, Ph.D
>>> Founder and CEO
>>> Scalable Informatics, Inc.
>>> email: land...@scalableinform
Re: [Gluster-users] Anyone have that find command handy
On 07/21/2011 12:35 PM, Mohit Anchlia wrote:
Did this occur after adding or removing a brick and then running rebalance?
Adding and rebalance.
On Thu, Jul 21, 2011 at 8:30 AM, Joe Landman
wrote:
On 07/21/2011 11:21 AM, Joe Landman wrote:
On 07/21/2011 11:17 AM, Burnash, James wrote:
Hi Joe.
Found it:
find $local -type f -perm +01000 -exec rm -v '{}' \;
for $local
Before I answer - can you share your volume info dump?
This is
[root@X02 ~]# gluster volume info
Volume Name: brick1
Type: Distribute
Status: Started
Number of Bricks: 4
Transport-type: tcp
Bricks:
Brick1: X01:/data/glusterfs/dht
Brick2: X02:/data/glusterfs/dht
Brick3: X03:/data/brick-sdc2/glusterfs/dht
Brick4: X03:/data/brick-sdd2/glusterfs/dht
My understanding is that those "link" files are valid if you have my
kind of config - which is distributed-replicate across 2 mirrored
pairs of backed servers. If the request for a file come into the pair
that do not have that file physically on their storage, the "link"
file is created to point to the actual location on the other mirror.
At least ... that is what I think it's supposed to do ...
They are a known bug from 2.0.x time frame. I am searching my emails
from 2 years ago for the magic command that removes them.
James Burnash Unix Engineer Knight Capital Group
-Original Message- From: gluster-users-boun...@gluster.org
[mailto:gluster-users-boun...@gluster.org] On Behalf Of Joe Landman
Sent: Thursday, July 21, 2011 11:11 AM To: gluster-users Subject:
[Gluster-users] Anyone have that find command handy
Ran into a situation that I thought had been corrected in the 2.0.x
time frame.
[root@X03 ~]# ls -alF
/data/brick-sdc2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats
/data/brick-sdd2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip
-T 1 root root 0 Jul 19 18:08
/data/brick-sdc2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats
-T 1 root root 0 Jul 21 10:48
/data/brick-sdd2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip
and the real files
[root@X02 ~]# ls -alF
/data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_*
-rw-r--r-- 1 oracle oinstall 984227914 Jul 21 11:05
/data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip
-rw-r--r-- 1 root root 17028780 Jul 20 13:00
/data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats
Note the permissions on the first as compared to the second. This
came from a rebalance operation with 3.1.5.
Anyone have that handy
find -perm -exec rm {}
command handy so we can scan for and remove the ghost files? I can
search for it in my old emails, just figured I'd ask.
-- Joseph Landman, Ph.D Founder and CEO Scalable Informatics, Inc.
email: land...@scalableinformatics.com web :
http://scalableinformatics.com
http://scalableinformatics.com/sicluster phone: +1 734 786 8423 x121
fax : +1 866 888 3112 cell : +1 734 612 4615
___ Gluster-users mailing
list Gluster-users@gluster.org
http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
DISCLAIMER: This e-mail, and any attachments thereto, is intended
only for use by the addressee(s) named herein and may contain legally
privileged and/or confidential information. If you are not the
intended recipient of this e-mail, you are hereby notified that any
dissemination, distribution or copying of this e-mail, and any
attachments thereto, is strictly prohibited. If you have received
this in error, please immediately notify me and permanently delete
the original and any copy of any e-mail and any printout thereof.
E-mail transmission cannot be guaranteed to be secure or error-free.
The sender therefore does not accept liability for any errors or
omissions in the contents of this message which arise as a result of
e-mail transmission. NOTICE REGARDING PRIVACY AND CONFIDENTIALITY
Knight Capital Group may, at its discretion, monitor and review the
content of all e-mail communications. http://www.knight.com
--
Joseph Landman, Ph.D
Founder and CEO
Scalable Informatics, Inc.
email: land...@scalableinformatics.com
web : http://scalableinformatics.com
http://scalableinformatics.com/sicluster
phone: +1 734 786 8423 x121
fax : +1 866 888 3112
cell : +1 734 612 4615
___
Gluster-users mailing list
Gluster-users@gluster.org
http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
--
Joseph Landman, Ph.D
Founder and CEO
Scalable Informatics, Inc.
email: land...@scalableinformatics.com
web : http://scalableinformatics.com
http://scalableinformatics.com/sicluster
phone: +1 734 786 8423 x121
fax : +1 866 888 3112
cell : +1 734 612 4615
___
Gluster-users mailing list
Gluster-users@gluster.org
http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Anyone have that find command handy
Did this occur after adding or removing a brick and then running rebalance?
On Thu, Jul 21, 2011 at 8:30 AM, Joe Landman
wrote:
> On 07/21/2011 11:21 AM, Joe Landman wrote:
>>
>> On 07/21/2011 11:17 AM, Burnash, James wrote:
>>>
>>> Hi Joe.
>>>
>
> Found it:
>
> find $local -type f -perm +01000 -exec rm -v '{}' \;
>
> for $local
>
>
>>> Before I answer - can you share your volume info dump?
>>
>> This is
>>
>> [root@X02 ~]# gluster volume info
>>
>> Volume Name: brick1
>> Type: Distribute
>> Status: Started
>> Number of Bricks: 4
>> Transport-type: tcp
>> Bricks:
>> Brick1: X01:/data/glusterfs/dht
>> Brick2: X02:/data/glusterfs/dht
>> Brick3: X03:/data/brick-sdc2/glusterfs/dht
>> Brick4: X03:/data/brick-sdd2/glusterfs/dht
>>
>>
>>>
>>> My understanding is that those "link" files are valid if you have my
>>> kind of config - which is distributed-replicate across 2 mirrored
>>> pairs of backed servers. If the request for a file come into the pair
>>> that do not have that file physically on their storage, the "link"
>>> file is created to point to the actual location on the other mirror.
>>> At least ... that is what I think it's supposed to do ...
>>
>> They are a known bug from 2.0.x time frame. I am searching my emails
>> from 2 years ago for the magic command that removes them.
>>
>>>
>>> James Burnash Unix Engineer Knight Capital Group
>>>
>>>
>>> -Original Message- From: gluster-users-boun...@gluster.org
>>> [mailto:gluster-users-boun...@gluster.org] On Behalf Of Joe Landman
>>> Sent: Thursday, July 21, 2011 11:11 AM To: gluster-users Subject:
>>> [Gluster-users] Anyone have that find command handy
>>>
>>> Ran into a situation that I thought had been corrected in the 2.0.x
>>> time frame.
>>>
>>> [root@X03 ~]# ls -alF
>>>
>>> /data/brick-sdc2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats
>>>
>>>
>>>
>>
>> /data/brick-sdd2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip
>>
>>> -T 1 root root 0 Jul 19 18:08
>>>
>>> /data/brick-sdc2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats
>>>
>>>
>>>
>> -T 1 root root 0 Jul 21 10:48
>>>
>>>
>>> /data/brick-sdd2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip
>>>
>>>
>>> and the real files
>>>
>>> [root@X02 ~]# ls -alF
>>> /data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_*
>>> -rw-r--r-- 1 oracle oinstall 984227914 Jul 21 11:05
>>> /data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip
>>>
>>>
>> -rw-r--r-- 1 root root 17028780 Jul 20 13:00
>>>
>>>
>>> /data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats
>>>
>>>
>>> Note the permissions on the first as compared to the second. This
>>> came from a rebalance operation with 3.1.5.
>>>
>>> Anyone have that handy
>>>
>>> find -perm -exec rm {}
>>>
>>> command handy so we can scan for and remove the ghost files? I can
>>> search for it in my old emails, just figured I'd ask.
>>>
>>> -- Joseph Landman, Ph.D Founder and CEO Scalable Informatics, Inc.
>>> email: land...@scalableinformatics.com web :
>>> http://scalableinformatics.com
>>> http://scalableinformatics.com/sicluster phone: +1 734 786 8423 x121
>>> fax : +1 866 888 3112 cell : +1 734 612 4615
>>> ___ Gluster-users mailing
>>> list Gluster-users@gluster.org
>>> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>>>
>>>
>>> DISCLAIMER: This e-mail, and any attachments thereto, is intended
>>> only for use by the addressee(s) named herein and may contain legally
>>> privileged and/or confidential information. If you are not the
>>> intended recipient of this e-mail, you are hereby notified that any
>>> dissemination, distribution or copying of this e-mail, and any
>>> attachments thereto, is strictly prohibited. If you have received
>>> this in error, please immediately notify me and permanently delete
>>> the original and any copy of any e-mail and any printout thereof.
>>> E-mail transmission cannot be guaranteed to be secure or error-free.
>>> The sender therefore does not accept liability for any errors or
>>> omissions in the contents of this message which arise as a result of
>>> e-mail transmission. NOTICE REGARDING PRIVACY AND CONFIDENTIALITY
>>> Knight Capital Group may, at its discretion, monitor and review the
>>> content of all e-mail communications. http://www.knight.com
>>
>>
>
>
> --
> Joseph Landman, Ph.D
> Founder and CEO
> Scalable Informatics, Inc.
> email: land...@scalableinformatics.com
> web : http://scalableinformatics.com
> http://scalableinformatics.com/sicluster
> phone: +1 734 786 8423 x121
> fax : +1 866 888 3112
> cell : +1 734 612 4615
> ___
> Gluster-users mailing list
> Gluster-users@gluster.org
> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>
___
Gluster-users mailing list
Gluster-users@gluster.org
http:/
Re: [Gluster-users] Anyone have that find command handy
On 07/21/2011 11:21 AM, Joe Landman wrote:
On 07/21/2011 11:17 AM, Burnash, James wrote:
Hi Joe.
Found it:
find $local -type f -perm +01000 -exec rm -v '{}' \;
for $local
Before I answer - can you share your volume info dump?
This is
[root@X02 ~]# gluster volume info
Volume Name: brick1
Type: Distribute
Status: Started
Number of Bricks: 4
Transport-type: tcp
Bricks:
Brick1: X01:/data/glusterfs/dht
Brick2: X02:/data/glusterfs/dht
Brick3: X03:/data/brick-sdc2/glusterfs/dht
Brick4: X03:/data/brick-sdd2/glusterfs/dht
My understanding is that those "link" files are valid if you have my
kind of config - which is distributed-replicate across 2 mirrored
pairs of backed servers. If the request for a file come into the pair
that do not have that file physically on their storage, the "link"
file is created to point to the actual location on the other mirror.
At least ... that is what I think it's supposed to do ...
They are a known bug from 2.0.x time frame. I am searching my emails
from 2 years ago for the magic command that removes them.
James Burnash Unix Engineer Knight Capital Group
-Original Message- From: gluster-users-boun...@gluster.org
[mailto:gluster-users-boun...@gluster.org] On Behalf Of Joe Landman
Sent: Thursday, July 21, 2011 11:11 AM To: gluster-users Subject:
[Gluster-users] Anyone have that find command handy
Ran into a situation that I thought had been corrected in the 2.0.x
time frame.
[root@X03 ~]# ls -alF
/data/brick-sdc2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats
/data/brick-sdd2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip
-T 1 root root 0 Jul 19 18:08
/data/brick-sdc2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats
-T 1 root root 0 Jul 21 10:48
/data/brick-sdd2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip
and the real files
[root@X02 ~]# ls -alF
/data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_*
-rw-r--r-- 1 oracle oinstall 984227914 Jul 21 11:05
/data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip
-rw-r--r-- 1 root root 17028780 Jul 20 13:00
/data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats
Note the permissions on the first as compared to the second. This
came from a rebalance operation with 3.1.5.
Anyone have that handy
find -perm -exec rm {}
command handy so we can scan for and remove the ghost files? I can
search for it in my old emails, just figured I'd ask.
-- Joseph Landman, Ph.D Founder and CEO Scalable Informatics, Inc.
email: land...@scalableinformatics.com web :
http://scalableinformatics.com
http://scalableinformatics.com/sicluster phone: +1 734 786 8423 x121
fax : +1 866 888 3112 cell : +1 734 612 4615
___ Gluster-users mailing
list Gluster-users@gluster.org
http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
DISCLAIMER: This e-mail, and any attachments thereto, is intended
only for use by the addressee(s) named herein and may contain legally
privileged and/or confidential information. If you are not the
intended recipient of this e-mail, you are hereby notified that any
dissemination, distribution or copying of this e-mail, and any
attachments thereto, is strictly prohibited. If you have received
this in error, please immediately notify me and permanently delete
the original and any copy of any e-mail and any printout thereof.
E-mail transmission cannot be guaranteed to be secure or error-free.
The sender therefore does not accept liability for any errors or
omissions in the contents of this message which arise as a result of
e-mail transmission. NOTICE REGARDING PRIVACY AND CONFIDENTIALITY
Knight Capital Group may, at its discretion, monitor and review the
content of all e-mail communications. http://www.knight.com
--
Joseph Landman, Ph.D
Founder and CEO
Scalable Informatics, Inc.
email: land...@scalableinformatics.com
web : http://scalableinformatics.com
http://scalableinformatics.com/sicluster
phone: +1 734 786 8423 x121
fax : +1 866 888 3112
cell : +1 734 612 4615
___
Gluster-users mailing list
Gluster-users@gluster.org
http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Anyone have that find command handy
On 07/21/2011 11:17 AM, Burnash, James wrote:
Hi Joe.
Before I answer - can you share your volume info dump?
This is
[root@X02 ~]# gluster volume info
Volume Name: brick1
Type: Distribute
Status: Started
Number of Bricks: 4
Transport-type: tcp
Bricks:
Brick1: X01:/data/glusterfs/dht
Brick2: X02:/data/glusterfs/dht
Brick3: X03:/data/brick-sdc2/glusterfs/dht
Brick4: X03:/data/brick-sdd2/glusterfs/dht
My understanding is that those "link" files are valid if you have my
kind of config - which is distributed-replicate across 2 mirrored
pairs of backed servers. If the request for a file come into the pair
that do not have that file physically on their storage, the "link"
file is created to point to the actual location on the other mirror.
At least ... that is what I think it's supposed to do ...
They are a known bug from 2.0.x time frame. I am searching my emails
from 2 years ago for the magic command that removes them.
James Burnash Unix Engineer Knight Capital Group
-Original Message- From: gluster-users-boun...@gluster.org
[mailto:gluster-users-boun...@gluster.org] On Behalf Of Joe Landman
Sent: Thursday, July 21, 2011 11:11 AM To: gluster-users Subject:
[Gluster-users] Anyone have that find command handy
Ran into a situation that I thought had been corrected in the 2.0.x
time frame.
[root@X03 ~]# ls -alF
/data/brick-sdc2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats
/data/brick-sdd2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip
-T 1 root root 0 Jul 19 18:08
/data/brick-sdc2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats
-T 1 root root 0 Jul 21 10:48
/data/brick-sdd2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip
and the real files
[root@X02 ~]# ls -alF
/data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_*
-rw-r--r-- 1 oracle oinstall 984227914 Jul 21 11:05
/data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip
-rw-r--r-- 1 root root 17028780 Jul 20 13:00
/data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats
Note the permissions on the first as compared to the second. This
came from a rebalance operation with 3.1.5.
Anyone have that handy
find -perm -exec rm {}
command handy so we can scan for and remove the ghost files? I can
search for it in my old emails, just figured I'd ask.
-- Joseph Landman, Ph.D Founder and CEO Scalable Informatics, Inc.
email: land...@scalableinformatics.com web :
http://scalableinformatics.com
http://scalableinformatics.com/sicluster phone: +1 734 786 8423 x121
fax : +1 866 888 3112 cell : +1 734 612 4615
___ Gluster-users mailing
list Gluster-users@gluster.org
http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
DISCLAIMER: This e-mail, and any attachments thereto, is intended
only for use by the addressee(s) named herein and may contain legally
privileged and/or confidential information. If you are not the
intended recipient of this e-mail, you are hereby notified that any
dissemination, distribution or copying of this e-mail, and any
attachments thereto, is strictly prohibited. If you have received
this in error, please immediately notify me and permanently delete
the original and any copy of any e-mail and any printout thereof.
E-mail transmission cannot be guaranteed to be secure or error-free.
The sender therefore does not accept liability for any errors or
omissions in the contents of this message which arise as a result of
e-mail transmission. NOTICE REGARDING PRIVACY AND CONFIDENTIALITY
Knight Capital Group may, at its discretion, monitor and review the
content of all e-mail communications. http://www.knight.com
--
Joseph Landman, Ph.D
Founder and CEO
Scalable Informatics, Inc.
email: land...@scalableinformatics.com
web : http://scalableinformatics.com
http://scalableinformatics.com/sicluster
phone: +1 734 786 8423 x121
fax : +1 866 888 3112
cell : +1 734 612 4615
___
Gluster-users mailing list
Gluster-users@gluster.org
http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Anyone have that find command handy
Hi Joe.
Before I answer - can you share your volume info dump?
My understanding is that those "link" files are valid if you have my kind of
config - which is distributed-replicate across 2 mirrored pairs of backed
servers. If the request for a file come into the pair that do not have that
file physically on their storage, the "link" file is created to point to the
actual location on the other mirror. At least ... that is what I think it's
supposed to do ...
James Burnash
Unix Engineer
Knight Capital Group
-Original Message-
From: gluster-users-boun...@gluster.org
[mailto:gluster-users-boun...@gluster.org] On Behalf Of Joe Landman
Sent: Thursday, July 21, 2011 11:11 AM
To: gluster-users
Subject: [Gluster-users] Anyone have that find command handy
Ran into a situation that I thought had been corrected in the 2.0.x time frame.
[root@X03 ~]# ls -alF
/data/brick-sdc2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats
/data/brick-sdd2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip
-T 1 root root 0 Jul 19 18:08
/data/brick-sdc2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats
-T 1 root root 0 Jul 21 10:48
/data/brick-sdd2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip
and the real files
[root@X02 ~]# ls -alF
/data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_*
-rw-r--r-- 1 oracle oinstall 984227914 Jul 21 11:05
/data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip
-rw-r--r-- 1 root root 17028780 Jul 20 13:00
/data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats
Note the permissions on the first as compared to the second. This came from a
rebalance operation with 3.1.5.
Anyone have that handy
find -perm -exec rm {}
command handy so we can scan for and remove the ghost files? I can search for
it in my old emails, just figured I'd ask.
--
Joseph Landman, Ph.D
Founder and CEO
Scalable Informatics, Inc.
email: land...@scalableinformatics.com
web : http://scalableinformatics.com
http://scalableinformatics.com/sicluster
phone: +1 734 786 8423 x121
fax : +1 866 888 3112
cell : +1 734 612 4615
___
Gluster-users mailing list
Gluster-users@gluster.org
http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
DISCLAIMER:
This e-mail, and any attachments thereto, is intended only for use by the
addressee(s) named herein and may contain legally privileged and/or
confidential information. If you are not the intended recipient of this e-mail,
you are hereby notified that any dissemination, distribution or copying of this
e-mail, and any attachments thereto, is strictly prohibited. If you have
received this in error, please immediately notify me and permanently delete the
original and any copy of any e-mail and any printout thereof. E-mail
transmission cannot be guaranteed to be secure or error-free. The sender
therefore does not accept liability for any errors or omissions in the contents
of this message which arise as a result of e-mail transmission.
NOTICE REGARDING PRIVACY AND CONFIDENTIALITY Knight Capital Group may, at its
discretion, monitor and review the content of all e-mail communications.
http://www.knight.com
___
Gluster-users mailing list
Gluster-users@gluster.org
http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
[Gluster-users] Anyone have that find command handy
Ran into a situation that I thought had been corrected in the 2.0.x time
frame.
[root@X03 ~]# ls -alF
/data/brick-sdc2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats
/data/brick-sdd2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip
-T 1 root root 0 Jul 19 18:08
/data/brick-sdc2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats
-T 1 root root 0 Jul 21 10:48
/data/brick-sdd2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip
and the real files
[root@X02 ~]# ls -alF
/data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_*
-rw-r--r-- 1 oracle oinstall 984227914 Jul 21 11:05
/data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip
-rw-r--r-- 1 root root 17028780 Jul 20 13:00
/data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats
Note the permissions on the first as compared to the second. This came
from a rebalance operation with 3.1.5.
Anyone have that handy
find -perm -exec rm {}
command handy so we can scan for and remove the ghost files? I can
search for it in my old emails, just figured I'd ask.
--
Joseph Landman, Ph.D
Founder and CEO
Scalable Informatics, Inc.
email: land...@scalableinformatics.com
web : http://scalableinformatics.com
http://scalableinformatics.com/sicluster
phone: +1 734 786 8423 x121
fax : +1 866 888 3112
cell : +1 734 612 4615
___
Gluster-users mailing list
Gluster-users@gluster.org
http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Top Reset
Hmm, i just find out that top stats are not changing at all, it look like it was grabbing data for some time and then no changes ... does anyone know how it is working ? Documentation is very bad about this feature. thanks Matus 2011/7/20 bxma...@gmail.com : > Hello, > > is there any way how to reset volume TOP statistics ? > > thanks > > Matus > ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
