Some feedback when using "ignore_fileclass" in purge_policy section:
* only one "ignore_fileclass" entry is matched, multiple entries are
ignored.
* The matched fileclass is always labelled "ignored" ie) regardless
FileSet name, the fileclass will only match against keyword "ignored"
eg) rbh-report --filter-class ignored
regards,
chris hunter
yale hpc group
On 01/13/2015 03:21 AM, LEIBOVICI Thomas wrote:
> As this is a common question, I added a new article in the wiki about that:
>
> Thomas.
>
>
> On 01/12/15 17:47, Chris Hunter wrote:
>> I think I have discovered my problem. Fileclasses do works as Thomas
>> described.
>>
>> I am scanning a local filesystem mounted as "/apps". Since we are
>> testing, I do not want to delete any files. I set the default
>> purge_policy to ignore all files in my fs_path. I created this
>> Purge_Policies section:
>>> Purge_Policies {
>>> ignore_fileclass = large_files;
>> >
>>> Ignore {
>>> tree == "/apps"
>>> }
>>> } ##Purge_Policies
>>
>> However, the "large_files" fileclass was not recognized. All files
>> were reported as part of "ignored" fileclass.
>>
>> I had thought the *order* of entries in the purge_policies was
>> important. I thought this would match the ignore_fileclass first, then
>> everything else would be ignored.
>> However, it appears the "Ignore" definition has precedence over other
>> definitions, and the ignore_fileclass entry was not being applied.
>>
>> To fix my problem, I had to remove the "Ignore" definition from
>> Purge_Policies eg)
>>> Purge_Policies {
>> >
>>> ignore_fileclass = large_files;
>> >
>>> } ##Purge_Policies
>>
>> Now the "large_files" fileclass is reported by rbh-report command.
>>
>> Hope that makes sense :/
>> Chris Hunter
>> [email protected]
>>
>> On 01/12/2015 11:18 AM, Chris Hunter wrote:
>>> Hi Thomas,
>>>
>>> Thanks for the suggestion. I added ignore_fileclass in the purge_policy
>>> section:
>>>> Purge_Policies {
>>>>
>>>> ignore_fileclass = large_files;
>>>>
>>>> } ##Purge_Policies
>>>
>>> However the report output does not change, all files are matched
>>> to "ignored" class:
>>>> # rbh-report -f /etc/robinhood.d/tmpfs/fileclass.test --class-info
>>>> purge class , count, spc_used, volume,
>>>> min_size, max_size, avg_size
>>>> [ignored] , 4447, 3.43 GB, 3.42 GB,
>>>> 0, 1.03 GB, 805.86 KB
>>>>
>>>> Total: 4447 entries, 3669665045 bytes (3.42 GB)
>>>
>>> I also observe in the log all files are reported as "matches no
>>> policy" eg)
>>>> 2015/01/12 11:06:04 [23298/8] FS_Scan | Starting scan of /apps
>>>> 2015/01/12 11:06:04 [23298/8] FS_Scan | Notice: this is the first scan
>>>> (DB is empty)
>>>> 2015/01/12 11:06:04 [23298/4] Policy | Entry '/apps/openvpn/howto.odt'
>>>> matches no policy case: not applying purge to it.
>>>
>>> Any other suggestions ?
>>>
>>> regards,
>>> [email protected]
>>>
>>> On 01/12/2015 03:30 AM, LEIBOVICI Thomas wrote:
>>>> Hi Chris,
>>>>
>>>> To match a fileclass, it needs to be referenced in a policy. I agree
>>>> this is quite confusing, so this will change in upcoming robinhood v3.
>>>> If you only need to match classes withour applying policies, you can
>>>> just define a dummy purge policy like the following:
>>>>
>>>> Purge_Policies {
>>>> ignore_fileclass = your_class1;
>>>> ignore_fileclass = your_class2;
>>>> }
>>>>
>>>> Regards,
>>>> Thomas
>>>>
>>>>
>>>>
>>>> On 01/12/15 02:21, Chris Hunter wrote:
>>>>> I am using robinhood tmpfs without lustre support.
>>>>>> # robinhood --version
>>>>>>
>>>>>> Product: robinhood
>>>>>> Version: 2.5.3.2-1
>>>>>> Build: 2014-10-29 15:55:57
>>>>>>
>>>>>> Compilation switches:
>>>>>> Temporary filesystem manager
>>>>>> Address entries by path
>>>>>> MDT Changelogs disabled
>>>>>>
>>>>>> No Lustre support
>>>>>> Database binding: MySQL
>>>>> I am trying to create fileclasses for use in filesystem reporting.
>>>>> However my fileclass entries appear to be ignored by robinhood.
>>>>>
>>>>> I am testing against a small local ext4 filesystem. For each test, I
>>>>> delete the database via "rbh-config empty_db" command. Then I start a
>>>>> scan with command "robinhood --scan --once". When the scan is
>>>>> complete,
>>>>> I use command "rbh-report --class-info" to check results.
>>>>>
>>>>> My tmpfs config file has no purge_polices and no Purge_Trigger
>>>>> sections.
>>>>> I have defined this fileclass:
>>>>>> Filesets
>>>>>> {
>>>>>> FileClass large_files
>>>>>> {
>>>>>> Definition {
>>>>>> type == file
>>>>>> and
>>>>>> size > 10GB
>>>>>> }
>>>>>> }
>>>>>> }
>>>>> However rbh-report always matches against the "ignored" class eg)
>>>>>> # rbh-report --class-info
>>>>>> Using config file '/etc/robinhood.d/tmpfs/fileclass.conf'.
>>>>>> purge class , count, spc_used, volume,
>>>>>> min_size, max_size, avg_size
>>>>>> [ignored] , 4447, 3.43 GB, 3.42 GB,
>>>>>> 0, 1.03 GB, 805.86 KB
>>>>>>
>>>>>> Total: 4447 entries, 3669665045 bytes (3.42 GB)
>>>>> Not sure where I'm going wrong, any suggestions would be appreciated.
>>>>>
>>>>> chris hunter
>>>>> yale hpc group
>>>>> [email protected]
>>>>>
>>>>> ------------------------------------------------------------------------------
>>>>>
>>>>>
>>>>>
>>>>> New Year. New Location. New Benefits. New Data Center in Ashburn, VA.
>>>>> GigeNET is offering a free month of service with a new server in
>>>>> Ashburn.
>>>>> Choose from 2 high performing configs, both with 100TB of bandwidth.
>>>>> Higher redundancy.Lower latency.Increased capacity.Completely
>>>>> compliant.
>>>>> vanity: www.gigenet.com
>>>>> _______________________________________________
>>>>> robinhood-support mailing list
>>>>> [email protected]
>>>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.sourceforge.net_lists_listinfo_robinhood-2Dsupport&d=AwIC-g&c=-dg2m7zWuuDZ0MUcV7Sdqw&r=d_G2h_sZYG4xtHMeKo8QgjDmOcMVdQvYgM-5Dri1AOY&m=XvcfBcD6u5mLbWLXHMJCj8-k1eutYpy1wB4NvrgVP8Q&s=EuMHuSHIOSIVdv-qoMsPR5UJcLFJyMBP-BfSRkr1Eug&e=
>>>>>
>>>>>
>>>>
>>>>
>
------------------------------------------------------------------------------
New Year. New Location. New Benefits. New Data Center in Ashburn, VA.
GigeNET is offering a free month of service with a new server in Ashburn.
Choose from 2 high performing configs, both with 100TB of bandwidth.
Higher redundancy.Lower latency.Increased capacity.Completely compliant.
http://p.sf.net/sfu/gigenet
_______________________________________________
robinhood-support mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/robinhood-support
