Shawn Walker wrote:
Jeppe Fihl Toustrup wrote:
This system would then require a small system for fetching the
snapshots, applying them, and destroying old snapshots, but I guess
most of the job is already done within the auto-snapshot service?
What do you guys think of this idea, and do you have a better idea
instead?
One option that can help significantly if you believe your previous
rsync runs to be correct is to use --ignore-existing with rsync.
The other issue currently with the repository is its structure, which
has too many directories (about 350K) which slows down the rsync
significantly:
http://defect.opensolaris.org/bz/show_bug.cgi?id=7960
I don't know that we have the provisioning and resources necessary to
provide zfs snapshots at this time.
Cheers,
We already use the --ignore-existing option, which does help with making
the entire update process quicker, but that does however not help the
file list generation, which takes up two thirds of the total time, as
far as my records show.
This was not meant to create any stress at all, but rather to think of
the better alternatives to using rsync, or making optimizations which
may make rsync run faster.
Another option would be to pack all the packages in one file per
package, like things are done in the Linux world, which would decrease
the amount of files dramatically, but it may increase the total size of
the repository. This does however require changes to be made in the pkg
client, which I thought would be smart to avoid, since I can understand
that resources to the OpenSolaris project is limited, at lease compared
to what could be used :)
--
Kind regards
Jeppe Toustrup
_______________________________________________
pkg-discuss mailing list
[email protected]
http://mail.opensolaris.org/mailman/listinfo/pkg-discuss
