[Gluster-devel] gluster tiering maintainer

Dear Gluster Community, 2017 has arrived, and I have taken an opportunity which will require a new maintainer for gluster tiering to replace me. I will continue to be available to help with the feature as a contributor. As seen in this year's CES conference [1], new storage types are coming

Re: [Gluster-devel] Release 3.10 feature proposal : Volume expansion on tiered volumes.

- Original Message - > From: "Shyam" > To: "Hari Gowtham" , "gluster-devel" > > Sent: Thursday, December 8, 2016 7:35:27 AM > Subject: Re: [Gluster-devel] Release 3.10 feature proposal : Volume expansion > on tiered

Re: [Gluster-devel] New commands for supporting add/remove brick and rebalance on tiered volume

- Original Message - > From: "Hari Gowtham" > To: "Atin Mukherjee" > Cc: "gluster-users" , "gluster-devel" > > Sent: Friday, October 21, 2016 3:52:34 AM > Subject: Re: [Gluster-devel] New

Re: [Gluster-devel] Possible race condition bug with tiered volume

t4 Brick24: gprfs020:/t4 Brick25: gprfs017:/t5 Brick26: gprfs018:/t5 Brick27: gprfs019:/t5 Brick28: gprfs020:/t5 Options Reconfigured: cluster.tier-mode: cache features.ctr-enabled: on performance.readdir-ahead: on - Original Message - > From: "Dustin Black" <dbl...@redhat

Re: [Gluster-devel] Possible race condition bug with tiered volume

Dustin, What level code ? I often run smallfile on upstream code with tiered volumes and have not seen this. Sure, one of us will get back to you. Unfortunately, gluster has a lot of protocol overhead (LOOKUPs), and they overwhelm the boost in transfer speeds you get for small files. A

Re: [Gluster-devel] tiering: emergency demotions

- Original Message - > From: "Milind Changire" > To: gluster-devel@gluster.org > Sent: Thursday, October 13, 2016 7:53:48 AM > Subject: Re: [Gluster-devel] tiering: emergency demotions > > Dilemma: > *without* my patch, the demotions in degraded (hi-watermark

Re: [Gluster-devel] md-cache changes and impact on tiering

> - Original Message - > > From: "Poornima Gurusiddaiah" <pguru...@redhat.com> > > To: "Dan Lambright" <dlamb...@redhat.com>, "Nithya Balachandran" > > <nbala...@redhat.com> > > Cc: "Gluster Devel" <g

Re: [Gluster-devel] md-cache changes and impact on tiering

- Original Message - > From: "Dan Lambright" <dlamb...@redhat.com> > To: "Poornima Gurusiddaiah" <pguru...@redhat.com> > Cc: "Nithya Balachandran" <nbala...@redhat.com>, "Gluster Devel" > <gluster-devel@gluster

[Gluster-devel] counters in tiering / request for comments

Below is a write-up on tiering counters (bz 1275917) I give three options, and I think option (1) and (3) are doable. (2) is harder and would need more discussion. Currently counters give limited information on tiering behavior. They are just a raw count of the number of files moved each

Re: [Gluster-devel] md-cache changes and impact on tiering

- Original Message - > From: "Poornima Gurusiddaiah" <pguru...@redhat.com> > To: "Dan Lambright" <dlamb...@redhat.com>, "Nithya Balachandran" > <nbala...@redhat.com> > Cc: "Gluster Devel" <gluster-devel@glus

Re: [Gluster-devel] md-cache improvements

- Original Message - > From: "Niels de Vos" <nde...@redhat.com> > To: "Raghavendra G" <raghaven...@gluster.com> > Cc: "Dan Lambright" <dlamb...@redhat.com>, "Gluster Devel" > <gluster-devel@gluster.org>, "C

[Gluster-devel] md-cache improvements

There have been recurring discussions within the gluster community to build on existing support for md-cache and upcalls to help performance for small file workloads. In certain cases, "lookup amplification" dominates data transfers, i.e. the cumulative round trip times of multiple LOOKUPs

Re: [Gluster-devel] State of the 4.0 World

- Original Message - > From: "Jeff Darcy" > To: "Gluster Devel" > Sent: Tuesday, May 3, 2016 11:50:30 AM > Subject: [Gluster-devel] State of the 4.0 World > > One of my recurring action items at community meetings is to report to > the

Re: [Gluster-devel] "Samba and NFS-Ganesha support for tiered volumes" is at risk for 3.8

- Original Message - > From: "Niels de Vos" <nde...@redhat.com> > To: "Dan Lambright" <dlamb...@redhat.com>, "Joseph Fernandes" > <josfe...@redhat.com> > Cc: gluster-devel@gluster.org > Sent: Friday, April 1, 2016 4:09:11

Re: [Gluster-devel] 3.7.9 update

- Original Message - > From: "Vijay Bellur" <vbel...@redhat.com> > To: "Gluster Devel" <gluster-devel@gluster.org>, "Niels de Vos" > <nde...@redhat.com>, "Raghavendra Bhat" > <rab...@redhat.com>, "Da

Re: [Gluster-devel] [Gluster-infra] tests/basic/tier/tier-file-create.t dumping core on Linux

- Original Message - > From: "Niels de Vos" <nde...@redhat.com> > To: "Krutika Dhananjay" <kdhan...@redhat.com>, "Vijay Bellur" > <vbel...@redhat.com> > Cc: "Dan Lambright" <dlamb...@redhat.com>, "Gluster

Re: [Gluster-devel] [Gluster-infra] tests/basic/tier/tier-file-create.t dumping core on Linux

a real bug. The author of the test should help chase this down. > -Krutika > > On Mon, Mar 7, 2016 at 4:17 PM, Krutika Dhananjay <kdhan...@redhat.com> > wrote: > > > +Pranith > > > > -Krutika > > > > > > On Sat, Mar 5, 2016 at 11:34 PM, D

Re: [Gluster-devel] Reverse brick order in tier volume- Why?

- Original Message - > From: "Pranith Kumar Karampuri" <pkara...@redhat.com> > To: "Ravishankar N" <ravishan...@redhat.com>, "Gluster Devel" > <gluster-devel@gluster.org>, "Dan Lambright" > <dlamb...@redhat.com>

Re: [Gluster-devel] tests/bugs/tier/bug-1286974.t failed and dropped a core

- Original Message - > From: "Niels de Vos" <nde...@redhat.com> > To: "Dan Lambright" <dlamb...@redhat.com>, "Joseph Fernandes" > <josfe...@redhat.com> > Cc: gluster-devel@gluster.org > Sent: Tuesday, January 12,

Re: [Gluster-devel] volume-snapshot.t failures

They fail on RHEL6 machines due to an issue with sqlite. The test has been moved to the ignore list already (13056). I'd like to look into having tests that do not run on RHEL6, only RHEL7+. I've been running it on RHEL7 the last few hours in a loop successfully. - Original Message - >

Re: [Gluster-devel] spurious regression error / bug-924726.t

This test case has failed several time for me in the last few days, ./tests/bugs/fuse/bug-924726.t https://build.gluster.org/job/rackspace-regression-2GB-triggered/16141/consoleFull I'll cc: the author (per git blame). - Original Message - > From: "Dan Lambright" <dla

Re: [Gluster-devel] [release-3.7] regression failure in ./tests/basic/tier/fops-during-migration-pause.t

- Original Message - > From: "Niels de Vos" <nde...@redhat.com> > To: gluster-devel@gluster.org > Cc: "Dan Lambright" <dlamb...@redhat.com>, "Nithya Balachandran" > <nbala...@redhat.com>, "Joseph Fernandes" &

Re: [Gluster-devel] spurious regression errors getting worse

- Original Message - > From: "Dan Lambright" <dlamb...@redhat.com> > To: "Niels de Vos" <nde...@redhat.com> > Cc: "Gluster Devel" <gluster-devel@gluster.org> > Sent: Monday, November 9, 2015 4:18:31 PM > Subjec

Re: [Gluster-devel] spurious regression errors getting worse

- Original Message - > From: "Niels de Vos" <nde...@redhat.com> > To: "Atin Mukherjee" <amukh...@redhat.com>, "Rajesh Joseph" > <rjos...@redhat.com> > Cc: "Dan Lambright" <dlamb...@redhat.com>, "Gluster

Re: [Gluster-devel] spurious regression errors getting worse

- Original Message - > From: "Niels de Vos" <nde...@redhat.com> > To: "Dan Lambright" <dlamb...@redhat.com> > Cc: "Gluster Devel" <gluster-devel@gluster.org> > Sent: Monday, November 9, 2015 4:09:08 PM > Subject: Re: [Glus

Re: [Gluster-devel] Roadmap for afr, ec

- Original Message - > From: "Pranith Kumar Karampuri" <pkara...@redhat.com> > To: "fanghuang data" <fanghuang.d...@yahoo.com>, "Gluster Devel" > <gluster-devel@gluster.org>, "Xavier Hernandez" > <xhernan...@datala

[Gluster-devel] Fwd: Nightly build for 3.7

All, I do not see build for 3.7 after 27th July @http://download.gluster.org/pub/gluster/glusterfs/nightly/glusterfs-3.7/ Is there an alternate location for the nightly build for 3.7? Regards, Dan Vivek ___ Gluster-devel mailing list

Re: [Gluster-devel] Failure in tests/basic/tier/bug-1214222-directories_miising_after_attach_tier.t

I'll check on this. - Original Message - From: Pranith Kumar Karampuri pkara...@redhat.com To: Gluster Devel gluster-devel@gluster.org, Joseph Fernandes josfe...@redhat.com Sent: Thursday, July 2, 2015 5:40:34 AM Subject: [Gluster-devel] Failure in

Re: [Gluster-devel] spurious failure with test-case ./tests/basic/tier/tier.t

- Original Message - From: Raghavendra Bhat rab...@redhat.com To: gluster-devel@gluster.org Sent: Friday, June 26, 2015 6:37:37 AM Subject: Re: [Gluster-devel] spurious failure with test-case ./tests/basic/tier/tier.t On 06/26/2015 04:00 PM, Ravishankar N wrote: On

[Gluster-devel] Amazon EFS (elastic file system)

Of interest to this group, AWS is previewing an elastic file system feature. https://aws.amazon.com/efs/ - access by NFSv4. - automatically scales as files added. - metering based on storage used. - integrated with their web interface, security groups, etc.

Re: [Gluster-devel] NetBSD regression status

- Original Message - From: Niels de Vos nde...@redhat.com To: Emmanuel Dreyfus m...@netbsd.org Cc: Gluster Devel gluster-devel@gluster.org Sent: Wednesday, June 3, 2015 9:43:56 AM Subject: Re: [Gluster-devel] NetBSD regression status On Wed, Jun 03, 2015 at 01:30:31PM +,

Re: [Gluster-devel] NetBSD regression status upate

- Original Message - From: Vijay Bellur vbel...@redhat.com To: Emmanuel Dreyfus m...@netbsd.org, gluster-devel@gluster.org Sent: Monday, April 27, 2015 5:40:11 AM Subject: Re: [Gluster-devel] NetBSD regression status upate On 04/26/2015 09:33 AM, Emmanuel Dreyfus wrote: Hello

Re: [Gluster-devel] tiering demo Thursday

- Original Message - From: Niels de Vos nde...@redhat.com To: Dan Lambright dlamb...@redhat.com Cc: Gluster Devel gluster-devel@gluster.org, gluster-us...@gluster.org List gluster-us...@gluster.org Sent: Sunday, April 19, 2015 8:37:30 AM Subject: Re: [Gluster-devel] tiering demo

Re: [Gluster-devel] Upcall state + Data Tiering

- Original Message - From: Niels de Vos nde...@redhat.com To: Dan Lambright dlamb...@redhat.com, Joseph Fernandes josfe...@redhat.com Cc: gluster Devel gluster-devel@gluster.org, Soumya Koduri skod...@redhat.com Sent: Sunday, April 19, 2015 9:01:56 AM Subject: Re: [Gluster-devel

Re: [Gluster-devel] tiering demo Thursday

:/home/t6 Brick2: gprfs018:/home/t5 cold Type: Distributed Replicate Number of Bricks: 3 x 2 = 6 Brick3: gprfs018:/home/t1 Brick4: gprfs018:/home/t2 Brick5: gprfs018:/home/t3 Brick6: gprfs018:/home/t4 - Original Message - From: Dan Lambright dlamb...@redhat.com To: Gluster Devel gluster

[Gluster-devel] tiering demo Thursday

Hello folks, We are scheduling a Hangout[1] session Thursday 1:30PM UTC regarding the upcoming Gluster tiering feature in GlusterFS. This session would include a preview of the feature, implementation details and quick demo. Please plan to join the Hangout session and spread the word around.

Re: [Gluster-devel] Patch #10000

: [Gluster-devel] Patch #1 And the winner is ... Dan Lambright! http://review.gluster.org/#/c/1 Congrats, Dan. ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] Object Quota feature proposal for GlusterFS-3.7

Prashanth , Not sure exactly what you are trying to do, but the changetimerecorder translator records in a database files that are created/modified/deleted/read (or some subset). This is a new translator thats part of the tier feature, though was written to be multipurpose and modular etc. It

Re: [Gluster-devel] readdir vs readdirp

- Original Message - From: Vijay Bellur vbel...@redhat.com To: Dan Lambright dlamb...@redhat.com, Gluster Devel gluster-devel@gluster.org Sent: Saturday, February 7, 2015 7:45:49 PM Subject: Re: [Gluster-devel] readdir vs readdirp On 02/06/2015 02:03 PM, Dan Lambright wrote

[Gluster-devel] readdir vs readdirp

Hi All, I hope this is not an overly stupid question.. Does anyone know a good way to test readdir (not readdirplus) on gluster? I see in : bugs/replicate/886998/strict-readdir.t .. that there is a switch cluster.strict-readdir. It does not appear to work, or be referenced in the code -

Re: [Gluster-devel] GlusterFS 4.0 updates needed

data classification has been updated to better reflect cache tiering's current status. - Original Message - From: Jeff Darcy jda...@redhat.com To: Gluster Devel gluster-devel@gluster.org Sent: Monday, January 26, 2015 7:53:37 AM Subject: [Gluster-devel] GlusterFS 4.0 updates needed

Re: [Gluster-devel] Readdir d_off encoding

.. also keep in mind we may want more than two DHT layers if we spin up the data classification project in the future. - Original Message - From: Shyam srang...@redhat.com To: Anand Avati av...@gluster.org, Gluster Devel gluster-devel@gluster.org, Soumya Koduri skod...@redhat.com

Re: [Gluster-devel] Discussion: Implications on geo-replication due to bitrot and tiering changes!!!!

Looks good to me. Thank you - Original Message - From: Kotresh Hiremath Ravishankar khire...@redhat.com To: Venky Shankar vshan...@redhat.com Cc: Joseph Fernandes josfe...@redhat.com, Gluster Devel gluster-devel@gluster.org, Vijay Bellur vbel...@redhat.com, Dan Lambright dlamb

Re: [Gluster-devel] if/else coding style :-)

+1 on choosing a single brace style [1] for the entire codebase. [1] http://en.wikipedia.org/wiki/Indent_style - Original Message - From: Shyam srang...@redhat.com To: Pranith Kumar Karampuri pkara...@redhat.com, gluster-devel@gluster.org Sent: Monday, October 13, 2014 10:13:38 AM

Re: [Gluster-devel] how do you debug ref leaks?

If we could disable/enable ref tracking dynamically, it may only be heavy weight tempoarily while the customer is being observed. You could get a state dump , or another idea is to take a core of the live process. gcore $(pidof processname) - Original Message - From: Pranith Kumar

Re: [Gluster-devel] Reviewers needed for ec xlator

yes, I'll take a look, - Original Message - From: Xavier Hernandez xhernan...@datalab.es To: gluster-devel@gluster.org Sent: Wednesday, September 10, 2014 4:21:17 AM Subject: [Gluster-devel] Reviewers needed for ec xlator Hi, does anyone have some time to review these ec patches

Re: [Gluster-devel] Languages (was Re: Proposal for GlusterD-2.0)

Parthasarathi kpart...@redhat.com Cc: Dan Lambright dlamb...@redhat.com, Gluster Devel gluster-devel@gluster.org Sent: Monday, September 8, 2014 8:14:07 AM Subject: Re: [Gluster-devel] Languages (was Re: Proposal for GlusterD-2.0) Two characteristics of a language (tool chain) are important

Re: [Gluster-devel] Languages (was Re: Proposal for GlusterD-2.0)

like a great fit. I'm looking forward to giving it a spin :) - Original Message - From: Dan Lambright dlamb...@redhat.com To: Jeff Darcy jda...@redhat.com Cc: Justin Clift jus...@gluster.org, Gluster Devel gluster-devel@gluster.org Sent: Friday, September 5, 2014 5:32:05 PM Subject

Re: [Gluster-devel] 3.6 Feature Freeze - move to mid next week?

- Original Message - From: Jeff Darcy jda...@redhat.com To: Vijay Bellur vbel...@redhat.com Cc: Gluster Devel gluster-devel@gluster.org Sent: Friday, July 4, 2014 10:14:32 AM Subject: Re: [Gluster-devel] 3.6 Feature Freeze - move to mid next week? Given the holiday weekend in

Re: [Gluster-devel] Data classification proposal

Implementing brick splitting using LVM would allow you to treat each logical volume (split) as an independent brick. Each split would have its own .glusterfs subdirectory. I think this would help with taking snapshots as well. - Original Message - From: Shyamsundar Ranganathan

Re: [Gluster-devel] Data classification proposal

rack4 # some files we just don't care rule D option filter-condition *.h select SSD1, SSD2, SSD3, SSD4, DISK1 volume: option filter-condition A,B,C,D - Original Message - From: Jeff Darcy jda...@redhat.com To: Dan Lambright dlamb...@redhat.com Cc: Gluster Devel gluster-devel

Re: [Gluster-devel] Data classification proposal

A frustrating aspect of Linux is the complexity of /etc configuration file's formats (rsyslog.conf, logrotate, cron, yum repo files, etc) In that spirit I would simplify the select in the data classification proposal (copied below) to only accept a list of bricks/sub-tiers with wild-cards '*',

Re: [Gluster-devel] Data classification proposal

did. I'm ok with that. As far as the user stories idea goes, that seems like a good next step. - Original Message - From: Jeff Darcy jda...@redhat.com To: Dan Lambright dlamb...@redhat.com Cc: Gluster Devel gluster-devel@gluster.org Sent: Monday, June 23, 2014 5:24:14 PM Subject: Re

Re: [Gluster-devel] GlusterFS and the logging framework

Hello, In a previous job, an engineer in our storage group modified our I/O stack logs in a manner similar to your proposal #1 (except he did not tell anyone, and did it for DEBUG messages as well as ERRORS and WARNINGS, over the weekend). Developers came to work Monday and found over a