It may be a difference between the logical size of entries and the
physical blocksd they use.
"rbh-report -i" displays sum(size)
but the physical usage may be lower if files are sparse.
To confirm or invalidate this guess, you can run and compare:
"rbh-du" (based on physical blocks) and "rbh-du -b" (based on logical size).
Regards,
Thomas
On 04/21/15 19:00, Hadrian Djohari wrote:
Hi Thomas,
I am talking about the comparison between the total in "rbh-report -i"
or the summation of "rbh-report --top-users" and the actual physical
space of the storage system. The rbh-report result is much higher than
the actual physical storage size. In the case below, rbh-report would
indicate 215tb being used, while the actual storage space is only
about 75tb.
This is an output:
# rbh-report -i -f scratch
Using config file
'/usr/local/robinhood/2.5.2/etc/robinhood.d/tmpfs/scratch.conf'.
type , count, volume, avg_size
symlink , 4594, 50.30 KB, 11
dir , 1412993, 13.22 GB, 9.81 KB
file , 24305699, 214.46 TB, 9.25 MB
Total: 25723286 entries, 235812918326035 bytes (214.47 TB)
# rbh-report -i -f scratch -F
Using config file
'/usr/local/robinhood/2.5.2/etc/robinhood.d/tmpfs/scratch.conf'.
type , count, volume, min_size, max_size, avg_size
symlink , 4594, 50.30 KB, 4, 84, 11
dir , 1412993, 13.22 GB, 4.00 KB, 89.12 MB, 9.81 KB
file , 24305699, 214.46 TB, 0, 4.32 TB, 9.25 MB
Total: 25723286 entries, 235812918326035 bytes (214.47 TB)
The /scratch storage space only has ~75TB of space.
It is almost like some old data still got retained in the database and
be counted as "active".
Best,
Hadrian.
On Tue, Apr 21, 2015 at 10:15 AM, LEIBOVICI Thomas
<[email protected] <mailto:[email protected]>> wrote:
Hi Hadrian,
Do you talk about the output of "rbh-report -i"?
Is the problem about the total number of entries or the volume ?
Do you get the same result with: "rbh-report -i -F"?
Regards,
Thomas
On 04/20/15 23:12, Hadrian Djohari wrote:
Hi,
We have installed Robinhood on a dedicated node that transverse 2
filesystems as tmpfs: a Panasas and a Nexsan (ZFS) storage.
The total from the Nexsan appears to be correct, but the total
from the Panasas seems to be higher - as much as 2x the total
amount.
Is there a setting that needs to be tweaked for the Panasas?
This is a typical conf file:
General
{
fs_path = "/mnt/DataX";
fs_type = panfs;
check_mounted = TRUE;
}
Log
{
log_file = "/var/log/robinhood/abc123_fs.log";
report_file = "/var/log/robinhood/abc123_reports.log";
alert_file = "/var/log/robinhood/abc123_alerts.log";
}
ListManager
{
MySQL
{
server = localhost;
db = robinhood_abc123;
user = robinhood;
password_file =
/usr/local/robinhood/2.5.2/etc/robinhood.d/.dbpassword;
}
}
FS_Scan
{
scan_interval = 14d;
nb_threads_scan = 4;
Ignore
{
# ignore ".snapshot" and ".snapdir" directories (don't scan them)
type == directory
and
( name == ".snapdir" or name == ".snapshot" )
}
}
Thank you,
--
Hadrian Djohari
HPCC Manager
Case Western Reserve University
(W): 216-368-0395 <tel:216-368-0395>
(M): 216-798-7490 <tel:216-798-7490>
------------------------------------------------------------------------------
BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
Develop your own process in accordance with the BPMN 2 standard
Learn Process modeling best practices with Bonita BPM through live exercises
http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- event?utm_
source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF
_______________________________________________
robinhood-support mailing list
[email protected]
<mailto:[email protected]>
https://lists.sourceforge.net/lists/listinfo/robinhood-support
--
Hadrian Djohari
HPCC Manager
Case Western Reserve University
(W): 216-368-0395
(M): 216-798-7490
------------------------------------------------------------------------------
BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
Develop your own process in accordance with the BPMN 2 standard
Learn Process modeling best practices with Bonita BPM through live exercises
http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- event?utm_
source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF
_______________________________________________
robinhood-support mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/robinhood-support
