[Gluster-users] Gluster on ZFS performance concerns

2013-12-27 Thread Tony Maro
Off and on for the past 8 months I've been working on setting up a rather sizable Gluster configuration on top of ZFS. I wanted to report back my experiences. First, I'm running Ubuntu 12.04 with zfsonlinux.org packages. Gluster is installed from the semiosis PPA. My test config is as follows:

[Gluster-users] Geo-Replication just won't go past 1TB - half the replication process crashing?

2013-09-05 Thread Tony Maro
I'm trying to create a new Geo-Rep of about 3 TB of data currently stored in a 2 brick mirror config. Obviously the geo-rep destination is a third server. This is my 150th attempt. Okay, maybe not that far, but it's pretty darn bad. Replication works fine until I hit around 1TB of data sync'd, t

Re: [Gluster-users] Geo-replication fails to even TRY to start doesnt create /tmp/gsyncd-* dir

2013-07-30 Thread Tony Maro
. On Tue, Jul 30, 2013 at 11:09 AM, Tony Maro wrote: > I'm using the Ubuntu repositories for Precise ( ppa:zfs-native/stable ), > so not sure, but I can guarantee there are no symlinks anywhere within the > volume. The data is all created and maintained by one app that I wrote, &g

Re: [Gluster-users] Geo-replication fails to even TRY to start doesnt create /tmp/gsyncd-* dir

2013-07-30 Thread Tony Maro
Joe Julian wrote: > Are you using the zfs that doesn't allow setting extended attributes on > symlinks? > > Tony Maro wrote: >> >> Well I guess I'm carrying on a conversation with myself here, but I've >> turned on Debug and gsyncd appears to b

Re: [Gluster-users] Geo-replication fails to even TRY to start doesnt create /tmp/gsyncd-* dir

2013-07-30 Thread Tony Maro
r(errn)) OSError: [Errno 107] Transport endpoint is not connected [2013-07-30 08:21:44.453290] I [syncdutils:142:finalize] : exiting. [2013-07-30 08:21:45.411412] D [monitor(monitor):100:monitor] Monitor: worker died in startup phase [2013-07-30 08:21:45.411653] I [monitor(monitor):21:set_stat

Re: [Gluster-users] Geo-replication fails to even TRY to start doesnt create /tmp/gsyncd-* dir

2013-07-26 Thread Tony Maro
Correction: Manually running the command after creating the temp directory actually doesn't work, but it doesn't error out it just hangs and never connects to the remote server. Dunno if this is something within gsyncd or what... On Fri, Jul 26, 2013 at 10:38 AM, Tony Maro wrote: &g

[Gluster-users] Geo-replication fails to even TRY to start doesnt create /tmp/gsyncd-* dir

2013-07-26 Thread Tony Maro
Setting up Geo-replication with an existing 3 TB of data is turning out to be a huge pain. It was working for a bit but would go faulty by the time it hit 1TB synced. Multiple attempts resulted in the same thing. Now, I don't know what's changed, but it never actually tries to log into the remot

[Gluster-users] Possible to preload data on a georeplication target? First sync taking forever...

2013-07-08 Thread Tony Maro
I have about 4 TB of data in a Gluster mirror configuration on top of ZFS, mostly consisting of 20KB files. I've added a georeplication target and the sync started ok. The target is using an SSH destination. It ran pretty quick for a while but it's taken over 2 weeks to sync just under 1 TB of d