On 21/9/17 01:20, Gandalf Corvotempesta wrote:
2017-09-20 17:15 GMT+02:00 Ray Frush <fr...@rams.colostate.edu>:
You indicate that your ZFS store does 50-70MB/s. That's pretty slow in
today's world. I get bothered when storage is slower than a single 10K RPM
drive (~100-120MB/sec). I wonder how fast metadata operations are.
bonnie++ benchmarks might indicate an issue here as BackupPC is metadata
intensive, and has to read a lot of metadata to properly place files in the
CPOOL. Compare those results with other storage to gauge how well your ZFS
is performing. I'm not a ZFS expert.
Yes, is not very fast but keep in mind that i'm using SATA disks.
But the issue is not the server performance, because all other software are
able to backup in a very short time, with the same hardware.
Except it probably is.... or else it wouldn't take so long ;)
A 4x 1Gbps network link will look exactly like a single 1Gbps per network
channel (stream) unless you've got some really nice port aggregation
hardware that can spray data at 4Gbps across those. As such, unless you
have parallel jobs running (multithreaded), I wouldn't expect to see any
product do better than 1Gbps from any single client in your environment.
The BackupPC server, running multiple backup jobs could see a benefit from
the bonded connection, being able to manage 4 1Gpbs streams at the same
time, under optimal conditions, which never happens.
I'm running 4 concurrent backups, with plain rsync/rsnapshot i'm able to run 8.
Except as you know, BPC demands a little more resources to do the
backup, and running concurrent backups multiplies those demands. When
you are close to, or slightly exceed your system capacity, then you will
see massive decrease in overall performance. The more the system has to
"pretend" it has capacity that it doesn't, and therefore it will do more
swapping, or more seeking (on the HDD's) and less useful caching, then
useful activity decreases significantly.
Find the performance bottleneck first, then you can decide how best to
proceed, whether that's increase hardware, modify the config, or change
the code.
Regards,
Adam
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
