Re: [Gluster-users] Hot Tier exceeding watermark-hi

Hi David, Just for your information, as a project, we are not currently taking any development focus on Tiering feature! Please refer to email thread @ https://lists.gluster.org/pipermail//gluster-devel/2018-July/055017.html It is recommended to use 'dmcache' on your disks to get best

Re: [Gluster-users] Hot Tier exceeding watermark-hi

Hi, The demotion has failed, so it's not moving files to cold tier any more. Transport endpoint usually refers to the bricks or servers. Need to see if the brick processes are up. The demotion failed because of the bricks being unavailable. Can you send the "gluster volume status" output again,

Re: [Gluster-users] Hot Tier exceeding watermark-hi

Just found this in the tierd.log Not sure what it means or how to fix it tho, but I assume it may be the cause of my problem with files not being demoted from the hot tier.. [2018-09-30 12:25:56.438821] E [MSGID: 114031] [client-rpc-fops.c:233:client3_3_mknod_cbk] 0-FFPrimary-client-5: remote

Re: [Gluster-users] Hot Tier exceeding watermark-hi

4 hours later, no files have been demoted [root@Glus1 ~]# gluster volume status FFPrimary detail Status of volume: FFPrimary Hot Bricks: -- Brick: Brick Glus3:/data/glusterfs/FFPrimary/brick3 TCP Port

Re: [Gluster-users] Hot Tier exceeding watermark-hi

Thank you Hari, I have set: cluster.tier-promote-frequency: 1800 cluster.tier-demote-frequency: 120 I will let you know if it makes a difference after some time. So far (10 minutes), nothing has changed. I would agree with you, that by looking at the result of 'gluster volume tier FFPrimary

Re: [Gluster-users] Hot Tier exceeding watermark-hi

Hi, I can see that the demotion is happening from the status provided by you. Do verify it. I would recommend you to change the cluster.tier-demote-frequency to 120 and cluster.tier-promote-frequency to 1800 to increase the demotions until the hot tier is emptied to a certain extent. Later you

[Gluster-users] Hot Tier exceeding watermark-hi

Hey Everyone, I have a 3 node GlusterFS cluster that uses NVMe hot tier and a HDD cold tier. I recently ran into some problems when the hot tier became full with df-h showing 100%. I did not have a watermark-hi set, but it is my understanding that 90% is the default. In an attempt to get the

Re: [Gluster-users] Hot Tier

Hi, We will look into the " failed to get index" error. It shouldn't affect the normal working. Do let us know if you face any other issues. Regards, Hari. On 02-Aug-2017 11:55 PM, "Dmitri Chebotarov" <4dim...@gmail.com> wrote: Hello I reattached hot tier to a new empty EC volume and started

Re: [Gluster-users] Hot Tier

Hello I reattached hot tier to a new empty EC volume and started to copy data to the volume. Good news is I can see files now on SSD bricks (hot tier) - 'find /path/to/brick -type f' shows files, before 'find' would only show dirs. But I've got a 'rebalance' error in glusterd.log file after I

Re: [Gluster-users] Hot Tier

Hi At this point I already detached Hot Tier volume to run rebalance. Many volume settings only take effect for the new data (or rebalance), so I thought may this was the case with Hot Tier as well. Once rebalance finishes, I'll re-attache hot tier. cluster.write-freq-threshold and

Re: [Gluster-users] Hot Tier

Hi, Before you try turning off the perf translators can you send us the following, So we will make sure that the other things haven't gone wrong. can you send us the log files for tier (would be better if you attach other logs too), the version of gluster you are using, the client, and the

Re: [Gluster-users] Hot Tier

For the tier daemon to migrate the files for read, few performance translators have to be turned off. By default the performance quick-read and io-cache are turned on. You can turn them off so that the files will be migrated for read. On Mon, Jul 31, 2017 at 11:34 AM, Hari Gowtham

Re: [Gluster-users] Hot Tier

Hi, If it was just reads then the tier daemon won't migrate the files to hot tier. If you create a file or write to a file that file will be made available on the hot tier. On Mon, Jul 31, 2017 at 11:06 AM, Nithya Balachandran wrote: > Milind and Hari, > > Can you please

Re: [Gluster-users] Hot Tier

Milind and Hari, Can you please take a look at this? Thanks, Nithya On 31 July 2017 at 05:12, Dmitri Chebotarov <4dim...@gmail.com> wrote: > Hi > > I'm looking for an advise on hot tier feature - how can I tell if the hot > tier is working? > > I've attached replicated-distributed hot tier to

[Gluster-users] Hot Tier

Hi I'm looking for an advise on hot tier feature - how can I tell if the hot tier is working? I've attached replicated-distributed hot tier to an EC volume. Yet, I don't think it's working, at least I don't see any files directly on the bricks (only folder structure). 'Status' command has all 0s