Re: [Gluster-users] Problem with files showing zero links

On Fri, Jan 29, 2016 at 10:46:14AM +, Ronny Adsetts wrote: > Follow up for the archives. I fixed this by 'touch'ing all the files with > zero links: > > Testing: > > # ls -al /stor/software/win_patches/IE11-Windows6.1-x64-en-us.exe > -rwxr--r-- 0 ainet Domain Admins 55915216 Oct 15 2013 >

Re: [Gluster-users] Problem with files showing zero links

On Fri, Jan 29, 2016 at 11:34:37AM +, Ronny Adsetts wrote: > Venky Shankar wrote on 29/01/2016 11:09: > > On Fri, Jan 29, 2016 at 10:46:14AM +, Ronny Adsetts wrote: > >> > >> No idea how it came about in the first place. Suspect it happened > >> durin

[Gluster-users] [CANCELLED] Weekly meeting on #gluster-meeting

Due to less number of participants and noone to chair. Thanks. Venky ___ Gluster-users mailing list Gluster-users@gluster.org http://www.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] Debugging georeplication failures

On Tue, Nov 24, 2015 at 1:23 AM, Audrius Butkevicius wrote: > Hi, > > I've got a geo-replicated gluster volume, with a few hundred thousand > images, which get generated on demand. > > I started getting replication failures in the status detail view, but it's > not

Re: [Gluster-users] Debugging georeplication failures

On Tue, Nov 24, 2015 at 1:23 AM, Audrius Butkevicius wrote: > Hi, > > I've got a geo-replicated gluster volume, with a few hundred thousand > images, which get generated on demand. > > I started getting replication failures in the status detail view, but it's > not

Re: [Gluster-users] Balance within node

On Fri, Aug 7, 2015 at 7:29 AM, Jordan Willis jwillis0...@gmail.com wrote: Hi, If I have two disk arrays on one node via two separate bricks, is there a rebalance command that will work on two inter node bricks? Is that what the fix-layout option does? fix-layout followed by rebalance is

[Gluster-users] Minutes of todays Gluster Community Meeting

As every week, we had our Gluster Community Meeting earlier today. The agenda for next week can be found here: https://public.pad.fsfe.org/p/gluster-community-meetings Please add topics to the Open Floor / BYOT item around line 66 of the etherpad and attend the meeting next week to discuss

Re: [Gluster-users] [Gluster-devel] Proposal for addition of maintainers and more...

On Wed, Jun 10, 2015 at 3:32 PM, Vijay Bellur vbel...@redhat.com wrote: On 06/10/2015 03:24 PM, Venky Shankar wrote: I would like to propose Aravinda (avish...@redhat.com) as a maintainer for Geo-replication. I can act as a backup maintainer in his absence. Hope it's not too late

Re: [Gluster-users] [Gluster-devel] Proposal for addition of maintainers and more...

: Overall Maintainer across various components. Bitrot - Venky Shankar Raghavendra Bhat Erasure Coding - Xavier Hernandez Pranith Karampuri Fuse - Niels de Vos Raghavendra Bhat Glusterd - Atin Mukherjee libglusterfs - Pranith Karampuri Niels de Vos Snapshot - Rajesh Joseph Tiering

Re: [Gluster-users] SLES 11 geo-replication packages for gluster 3.5 or 3.6

On Thu, May 21, 2015 at 11:26 AM, Óscar Menéndez Sánchez omenen...@gmv.com wrote: Thanks Kaleb. Do you know the minimum python version required for geo-replication? 2.6 ___ Gluster-users mailing list Gluster-users@gluster.org

[Gluster-users] Hangout: BitRot detection in GlusterFS

Hello folks, I've scheduled an Hangout[1] session tomorrow regarding upcoming BitRot Detection feature in GlusterFS. This session would include a preview of the feature, implementation details and quick demo. Please plan to join the Hangout session and spread the word around. [1]:

Re: [Gluster-users] [PATCH ANNOUNCE] BitRot : Object signing

Oops, my bad. Thanks for the correction. February it is. Thanks, Venky On Feb 21, 2015 6:14 PM, Markus Ueberall markus.ueber...@gmail.com wrote: NB according to the link, it's *this* Tuesday, 24th February. Kind regards, Markus Am 19.02.2015 um 15:04 schrieb Venky Shankar

[Gluster-users] [PATCH ANNOUNCE] BitRot : Object signing

Hi folks, Listed below is the initial patchset for the upcoming bitrot detection feature targeted for GlusterFS 3.7. As of now, these set of patches implement object signing. Myself and Raghavendra (rabhat@) are working on pending items (scrubber, etc..) and would be sending those patches

Re: [Gluster-users] Changelog dir in gluster 3.6

journals inside .glusterfs/changlogs/* are use by geo-replication (as of now). Disabling change-logging (as shown below) would stop generating journals inside the directory. # gluster volume set volname changelog off Starting geo-replication would turn enable change-logging. On Mon, Feb 16,

Re: [Gluster-users] Re-Sync Geo Replication

​touch filename should trigger a re-sync. On Sun, Oct 5, 2014 at 3:03 AM, James Payne jimqwer...@hotmail.com wrote: Hi, Just wondering if there was a method to manually force a re-sync of a geo replication slave so it is an identical mirror of the master? History of this request is

Re: [Gluster-users] Bricks as BTRFS

On Sep 30, 2014 5:00 AM, Justin Clift jus...@gluster.org wrote: On 25/09/2014, at 7:53 AM, Venky Shankar wrote: snip Wanted to check if anyone out here uses BTRFS (and willing to share their experiences[1]) as the backend filesystem for GlusterFS. We're planning to explore some of it's

[Gluster-users] Bricks as BTRFS

Hey folks, Wanted to check if anyone out here uses BTRFS (and willing to share their experiences[1]) as the backend filesystem for GlusterFS. We're planning to explore some of it's features and put it to use for GlusterFS. This was discussed briefly during the weekly meeting on

Re: [Gluster-users] geo-replication status faulty

/glusterfs/vol0/brick0/brick):207:logerr] Popen: ssh bash: /nonexistent/gsyncd: No such file or directory [2014-06-26 17:09:10.266753] I [syncdutils(/data/glusterfs/vol0/brick0/brick):192:finalize] top: exiting. Thanks again for any help Chris From: Venky Shankar [mailto:yknev.shan

Re: [Gluster-users] geo-replication status faulty

the steps you're using for setting up a geo-rep session? On Fri, Jun 27, 2014 at 5:59 AM, Chris Ferraro chrisferr...@fico.com wrote: Venky Shankar, can you follow up on these questions? I too have this issue and cannot resolve the reference to ‘/nonexistent/gsyncd’. As Steve mentions

Re: [Gluster-users] Possible to pre-sync data before geo-rep?

There are couple of things here: 1. With 3.5, geo-replication would also take care to maintain the GFIDs of files to be in sync. Syncing data using rsync this way would haves mangled the GFIDs. This is very much similar to an upgrade scenario to 3.5 where data synced by geo-rep pre 3.5 would not

Re: [Gluster-users] geo-replication delay?

Hi James, Just checking back -- were you able to test it out with the config option? Thanks, -venky On Wed, May 7, 2014 at 11:07 PM, Venky Shankar yknev.shan...@gmail.comwrote: On Wed, May 7, 2014 at 6:10 PM, James Le Cuirot ch...@aura-online.co.ukwrote: Hello, I know this has been

Re: [Gluster-users] Question about geo-replication and deletes in 3.5 beta train

xsync changelog /var/run/gluster/gluster-poc/ssh%3A%2F%2Froot%4010.10.10.120%3Agluster%3A%2F%2F127.0.0.1%3Agluster-poc/5afdd54e66545ea49962eb4d8e257a59/xsync/XSYNC-CHANGELOG.1399317115 -CJ From: Venky Shankar vshan...@redhat.com Date: Friday, May 2, 2014 at 2:41 AM To: gluster-users

Re: [Gluster-users] geo-replication delay?

On Wed, May 7, 2014 at 6:10 PM, James Le Cuirot ch...@aura-online.co.ukwrote: Hello, I know this has been asked before but I felt that it wasn't fully answered and I think the situation may have changed in 3.5. I have set up geo-replication between two machines on my LAN for testing. Both

Re: [Gluster-users] tar_ssh.pem?

I had seen the new create push-pem option and gave it a try today. I see that it does indeed create a different key with a different command in the authorized_keys file. One question remains though and this stems back to bug # ​​ ​​ 1091079. push-pem expects you to have setup passwordless

Re: [Gluster-users] Question about geo-replication and deletes in 3.5 beta train

to use change-logging. This happens on geo-rep restart. -CJ From: CJ Beck chris.b...@workday.commailto:chris.b...@workday.com Date: Thursday, May 1, 2014 at 10:28 AM To: Venky Shankar yknev.shan...@gmail.commailto:yknev.shan...@gmail.com Cc: gluster-users@gluster.orgmailto:gluster-users

Re: [Gluster-users] geo-replication status faulty

On 04/29/2014 11:12 PM, Steve Dainard wrote: Fixed by editing the geo-rep volumes gsyncd.conf file, changing /nonexistent/gsyncd to /usr/libexec/glusterfs/gsyncd on both the master nodes. That is not required. Did you invoke create command with push-pem? Any reason why this is in the default

Re: [Gluster-users] tar_ssh.pem?

On 04/28/2014 07:00 PM, Joe Julian wrote: Where is this process documented? On April 28, 2014 6:03:16 AM PDT, Venky Shankar vshan...@redhat.com wrote: On 04/27/2014 11:55 PM, James Le Cuirot wrote: Hello all, I'm new to Gluster but have successfully tried geo-rep with 3.5.0. I've read

Re: [Gluster-users] Can't stop (or control) geo-replication?

anything in glusterd log file? glusterd in debug mode (glusterd -LDEBUG) would provide more logs to debug. On Tue, Feb 25, 2014 at 8:15 PM, Danny Sauer da...@dannysauer.com wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 I have the current gluster 3.4 running on some RHEL6 systems.

Re: [Gluster-users] Question about geo-replication and deletes in 3.5 beta train

a bug on it. -CJ From: Venky Shankar yknev.shan...@gmail.com Date: Wednesday, April 16, 2014 at 4:43 PM To: CJ Beck chris.b...@workday.com Cc: gluster-users@gluster.org gluster-users@gluster.org Subject: Re: [Gluster-users] Question about geo-replication and deletes in 3.5 beta train

Re: [Gluster-users] Question about geo-replication and deletes in 3.5 beta train

ignore-deletes is only valid in the initial crawl mode[1] where it does not propagate deletes to the slave (changelog mode does). Was the session restarted by any chance? [1] Geo-replication now has two internal operations modes: a one shot filesystem crawl mode (used to replicate data already

Re: [Gluster-users] Question about geo-replication and deletes in 3.5 beta train

Crawl10765 70 00 0 From: Venky Shankar yknev.shan...@gmail.com Date: Wednesday, April 16, 2014 at 1:54 PM To: CJ Beck chris.b...@workday.com Cc: gluster-users@gluster.org gluster-users@gluster.org Subject: Re: [Gluster-users] Question about

Re: [Gluster-users] HELP on Geo-Replication Faulty rsync failed with ENOENT

rsync is in /usr/bin of Slave VM. Why rsync failed with ENOENT (No file or directory)? what about the mater node? I basically follow the Gluster_FS_3.3.0_admin guide. What did I miss? I have tried on Debian and CentOS, all failed. BTW, under CentOS 6.4, I cannot even stop the

Re: [Gluster-users] HELP on Geo-Replication Faulty rsync failed with ENOENT

I meant master node On Sat, Mar 29, 2014 at 11:53 AM, Venky Shankar yknev.shan...@gmail.comwrote: rsync is in /usr/bin of Slave VM. Why rsync failed with ENOENT (No file or directory)? what about the mater node? I basically follow the Gluster_FS_3.3.0_admin guide. What did I miss? I

Re: [Gluster-users] geo-replication errors

says 3.0.7. Is this relevant ? On Wed, Feb 12, 2014 at 2:12 AM, Venky Shankar yknev.shan...@gmail.comwrote: Is this from the latest master branch? On Tue, Feb 11, 2014 at 4:35 PM, John Ewing johnewi...@gmail.com wrote: I am trying to use geo-replication but it is running slowly and I keep

Re: [Gluster-users] geo-replication errors

Is this from the latest master branch? On Tue, Feb 11, 2014 at 4:35 PM, John Ewing johnewi...@gmail.com wrote: I am trying to use geo-replication but it is running slowly and I keep getting the following logged in the geo-replication log. [2014-02-11 10:56:42.831517] I

Re: [Gluster-users] gluster-fuse and proftpd/vsftpd issue

Could you provide this information from the server (also the client/server logs): cat /proc/pid/task/*/stack ls -l /proc/pid/task/*/fd pid == process ID of glusterfsd On Fri, Feb 7, 2014 at 6:14 PM, Barry Stetler ba...@hivelocity.net wrote: We started using gluster in a custom solution

Re: [Gluster-users] Geo Replication Hooks

Hey Fred, You could implement this without touching Geo-Replication code. Gluster now has the changelog translator (journaling mechanism) which records changes made to the filesystem (on each brick). Journals can be consumed using the changelog consumer library (libgfchangelog). Geo-Replication

Re: [Gluster-users] GlusterFS extended attributes, system namespace

'system' namespace is flipped to 'trusted' for geo-replication auxillary mount. So, it should be left as 'system' in the source. I see that you're trying to connect to the remote slave as a non-super user. For that, you'd need to access the slave via mount-broker, which would require some

Re: [Gluster-users] Geo-replication broken in 3.4 alpha2?

Looks like you may be running into this bug: https://bugzilla.redhat.com/show_bug.cgi?id=905871 can you gdb to the client process (on the master) and give the backtrace? -venky On Thursday 21 March 2013 12:28 AM, Samuli Heinonen wrote: Dear all, I'm running GlusterFS 3.4 alpha2 together

Re: [Gluster-users] geo-replication issues/questions

[root@sum1-gstore01 ~]# gluster volume set gstore geo-replication.indexing off geo-replication.indexing cannot be disabled while geo-replication sessions exist Set volume unsuccessful so, my question is, how to do i stop these outright? You cannot turn off indexing (xtime based change

Re: [Gluster-users] geo-replication issues/questions

so, its got a config! Even if a session is not active/never-initiated, the config can be viewed (This is the default configuration). It just needs a valid master volume and a valid slave (valid in the sense which is parsable by geo-rep). Thus: # gluster volume geo-replication valid-master

Re: [Gluster-users] configure: error: python does not have ctypes support

As you're running Python 2.4.x you would need install python ctypes module or if possible try to use Python 2.6.x. OR you can get rid of this error if you do not plan to use geo replication. For that, configure without geo-rep ./configure --disable-georeplication Thanks, -Venky On Mon, Dec 3,

Re: [Gluster-users] Hadoop version dependency

Does version matters? No support over Hadoop 0.20 ? Yes. As of now, the plugin only works with Hadoop 0.20.2 Thanks, -Venky ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users

Re: [Gluster-users] Recommended settings for geo-replication for folders with lots of files

Well, you can use geo-replication to sync files from master (a GlusterFS volume) to a directory tree on a remote slave. Due to the overhead of syncing xtime (geo-rep's way of versioning ), large number of small files are sync'd in an non optimal way. There is a tunable that speeds this up but

Re: [Gluster-users] Protocol stacking: gluster over NFS

Hi Harry, There is a compression translator in Gerrit which you might be interested in: http://review.gluster.org/#change,3251 It compresses data (using zlib library) before it is sent out to the network from the server and on the other side (client; FUSE mount) it decompresses it. Also,

Re: [Gluster-users] georeplication on huge files

On 07/18/2012 03:14 AM, Gandalf Corvotempesta wrote: how does gluster perform on huge file georeplication like a VM disk based image? Let's assume a 150GB image on a single file. Does it replicate the whole file every time, like rsync, or only differences will be replicated? AFAIK, Rsync does

Re: [Gluster-users] geo-replication and rsync

...@gmail.com wrote: 2012/6/1 Venky Shankar yknev.shan...@gmail.com Whenever an entity is the master gluster volume is changed (writes) the marker xlator (feature/marker) updates the xtime extended attribute for that particular file and propagates it up the directory hierarchy. This by looking

Re: [Gluster-users] geo-replication and rsync

Geo-Replication is a more intelligent way of doing Rsync. Although Geo-Rep uses Rsync to transfer file data, identifying candidates that need to be sync'd (by handing it over to Rsync) is based on a extended attribute. Whenever an entity is the master gluster volume is changed (writes) the marker

Re: [Gluster-users] (Fixed) Re: Can Hadoop run on gluster in 1 JT, N TT setup or only works for 1 JT+TT?

Hi, [snip] However, after reading your mail, I wonder if Hadoop plugin for gluster implements some location-based job scheduling similar to the one in Hadoop on HDFS. I mean, in Hadoop on HDFS the JT coordinates with the NN (which knows where every file block is located withing the

Re: [Gluster-users] Can't Get 3.3beta2-1 Going :(

Hey Joey, Can you try installing the glusterfs-geo-replication rpm ? You are using 3.3-beta2; so the rpm would be here: http://download.gluster.org/pub/gluster/glusterfs/qa-releases/3.3-beta-2/RHEL/ Let me know if installing this works for you. This should have been in the dependency list

Re: [Gluster-users] Gluster Hadoop Plugin

Hi, 11/03/2011 04:09 PM, Neo wrote: I am trying out the Hadoop Plugin with Gluster. I am trying to setup a debug evironment for Hadoop using Eclipse with which I will be able to debug Hadoop and Plugin Code. Can you give me some pointers regarding configuring the Plugin code in Hadoop? Is the

Re: [Gluster-users] Confused about Geo Replication..

Hi, I've been trying a few things out, it seems for geo-replication you need a third node. Or am I overlooking something? The *third* node can be local i.e. on the same host where you invoke geo-replication or it could be a remote host. This host need not to be a part of the cluster i.e. it

Re: [Gluster-users] Confused about Geo Replication..

On 10/24/2011 02:16 PM, Robert Krig wrote: I've been reading the documentation, but I'm a bit stumped as to how to setup geo-replication with glusterfs. The documentation mentions that you use an existing glusterfs volume to start geo replication. But what kind of volume? Do you just create a

Re: [Gluster-users] gluster map/reduce performance..

기술담당/SKCC [andrew.k...@sk.com] Sent: Wednesday, October 19, 2011 11:04 PM To: Venky Shankar; andrew; gluster-users@gluster.org Subject: RE: [Gluster-users] gluster map/reduce performance.. Yes, I used the GlusterFS plugin. Gluster version is - 3.3 beta 2. For the Volumes Distributed-mirroring

Re: [Gluster-users] gluster map/reduce performance..

Hi there, Appreciate if you could share the following info with us: * Are you using GlusterFS hadoop plugin (which is here http://download.gluster.com/pub/gluster/glusterfs/qa-releases/3.3-beta-2/glusterfs-hadoop-0.20.2-0.1.x86_64.rpm and is still in beta) or are you using GlusterFS as an

Re: [Gluster-users] Any success on FreeBSD ?

On Monday 25 April 2011 02:12 AM, Leon Meßner wrote: Hi, i wanted to know if anyone succeeded in building glusterfs-3.1.4 on FreeBSD. The problems will probably by manifold. One of them is there is no TCP_KEEPALIVE. I am using some older versions of glusterfs on FreeBSD and know there is no