OK. Thanks for the update. I was reading documentation under Software
Presentation , section 1.1 "With Lustre v2, scanning is no longer needed
thanks to Lustre MDT Changelog mechanism"... I ran an initial scan with
robinhood -S -once and looks much better now.
Re,
MB
From: Thomas LEIBOVICI [mailto:[email protected]]
Sent: Sunday, July 27, 2014 9:20 AM
To: Matthew BETTINGER; [email protected]
Subject: Re: [robinhood-support] rbh-report clarification
Hi Matthew,
An initial scan is required to make robinhood aware of existing filesystem
contents. Did you run one?
Then the changelog keeps robinhood DB updated.
Also, you have to take care of your MDS changelog mask configuration, else
robinhood will not get all the updates it needs.
If it is not set persistently (as far as I can remember, using "lfs setparam
-P" which is the replacement for "lfs confparam")
is will be lost each time you restart your mds.
"Entry has incomplete path in DB: parent_id='0x20000373c:0xc2ef:0x0',
relative_path='illum_s_1.H@'"
This can obviously be explained if there were no initial scan.
This can also sometimes appear with specific "create/rename" patterns because
of a bug in rbh 2.5.2
which is now fixed in master branch and will be part of next robinhood 2.5.3:
> git clone https://github.com/cea-hpc/robinhood.git
Regards,
Thomas
Le 25/07/2014 18:05, Matthew BETTINGER a écrit :
Hello,
Returning back to robinhood 2.5.2 after another new cluster deployment and we
are going to give robinhood one more chance.
Everytime I attempt to get robinhood running I get strange results that do not
even look remotely close to the filesystem I am trying to monitor. Here is an
example which hopefully explains what I am confused about.
On my robinhood server I have our test 2.4.3 lustre mounted as /lustre2
Lfs df -h shows
filesystem summary: 335.4T 1.8T 330.2T 1% /lustre2
I am using the changelogs and tmpfs for robinhood using a very very basic
configuration but not seeing what I think I should be seeing..
Rbh-report shows 0 entries!
[root@hous0162 ~]# rbh-report -D -P /lustre2
Using config file '/etc/robinhood.d/tmpfs/tmpfs_detailed.conf'.
filter path: /lustre2
type, size, user, group, purge class,
path
Total: 0 entries, 0 bytes (0)
Rbh-report -D by itself shows
Total: 1445 entries, 1921316123 bytes (1.79 GB)
How can this be since lfs df shows us using 1.8 TB of 330.2TB. I have no idea
where rbh-report is getting this number from.
Another thing which is odd is that the rbh-report -D show a bunch of files
with a strange path
file, 13.59 KB, l0413591, rt, [ignored],
0x20000373c:0xc2f0:0x0/WEM_migration_ffd_kernel_iso+pat+27365-12t/000079.xf
file, 13.59 KB, l0413591, rt, [ignored],
0x20000373c:0xc2f0:0x0/WEM_migration_ffd_kernel_iso+pat+27365-12t/000077.xf
Shouldn't this be /lustre2/WEM_migration_ffd_kernel_iso+pat+27365-12t/000077.xf
??
My log file also shows some things which I do not know if they are 'normal' or
not...
2014/07/24 14:49:11 robinhood@hous0162[32245/7] EntryProc | Parent dir for
entry [0x2000036fc:0xd1:0x0] is unknown (parent: [0x20000373c:0xc2ef:0x0],
child name: 'image_1.H@'): updating entry path info
2014/07/24 14:49:11 robinhood@hous0162[32245/9] ListMgr | Entry has incomplete
path in DB: parent_id='0x20000373c:0xc2ef:0x0', relative_path='illum_s_1.H@'
2014/07/24 14:49:11 robinhood@hous0162[32245/6] ListMgr | Entry has incomplete
path in DB: parent_id='0x20000373c:0xc2ef:0x0', relative_path='illum_r_1.H@'
2014/07/24 14:49:11 robinhood@hous0162[32245/9] EntryProc | Parent dir for
entry [0x2000036fc:0xd2:0x0] is unknown (parent: [0x20000373c:0xc2ef:0x0],
child name: 'illum_s_1.H@'): updating entry path info
2014/07/24 14:49:11 robinhood@hous0162[32245/6] EntryProc | Parent dir for
entry [0x2000036fc:0xd3:0x0] is unknown (parent: [0x20000373c:0xc2ef:0x0],
child name: 'illum_r_1.H@'): updating entry path info
I have dropped and recreated the databases after changing the classes as well.
Any suggestion as to what could be going on and why robinhood is not showing
the same or even remotely close information that we see in a simple df?
Thanks!
Matt Bettinger
Technical Computing
Total E&P Research & Technology USA, LLC
1201 Louisiana St., Suite 1800, Houston TX 77002
Phone: 713-647-3352
------------------------------------------------------------------------------
Want fast and easy access to all the code in your enterprise? Index and
search up to 200,000 lines of code with a free copy of Black Duck
Code Sight - the same software that powers the world's largest code
search on Ohloh, the Black Duck Open Hub! Try it now.
http://p.sf.net/sfu/bds
_______________________________________________
robinhood-support mailing list
[email protected]<mailto:[email protected]>
https://lists.sourceforge.net/lists/listinfo/robinhood-support
------------------------------------------------------------------------------
Infragistics Professional
Build stunning WinForms apps today!
Reboot your WinForms applications with our WinForms controls.
Build a bridge from your legacy apps to the future.
http://pubads.g.doubleclick.net/gampad/clk?id=153845071&iu=/4140/ostg.clktrk
_______________________________________________
robinhood-support mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/robinhood-support
