So with a recent build of spacewalk-backend from master, i'm not able to
sync channels with a large number of packages (i.e. rhel-i386-server-5)
It does everything at a normal speed with the exception of "Linking
Packages". This now takes an extremely long time (Hours) whereas before
it would take less than a minute.
Michael, It looks like you made some changes in this area, so that it
doesn't look at short packages, but instead loads the full package. I
think this is what is causing it because it looks like it is reloading
every package from cache. I'm not sure if it is supposed to take this
long to do, but satellite-sync seems to be grabbing ~99% cpu with a 2nd
python process jumping up to ~40% for a second or two every now and then.
Here's a trace of where it is at:
File "/usr/bin/satellite-sync", line 172, in ?
sys.exit(abs(main() or 0))
File "/usr/bin/satellite-sync", line 143, in main
return satsync.Runner().main()
File "/usr/share/rhn/satellite_tools/satsync.py", line 224, in main
ret = method()
File "/usr/share/rhn/satellite_tools/satsync.py", line 329, in
_step_packages
self._affected_channels = self.syncer.import_packages()
File "/usr/share/rhn/satellite_tools/satsync.py", line 1710, in
import_packages
return self._link_channel_packages()
File "/usr/share/rhn/satellite_tools/satsync.py", line 1745, in
_link_channel_packages
package = package_collection.get_package(pid, timestamp)
File "/usr/share/rhn/satellite_tools/sync_handlers.py", line 254, in
get_package
return self._cache.cache_get(package_id, timestamp=timestamp)
File "/usr/share/rhn/satellite_tools/syncCache.py", line 41, in cache_get
compressed=self._compressed)
File "/usr/share/rhn/common/rhnCache.py", line 80, in get
return cache.get(name, modified)
File "/usr/share/rhn/common/rhnCache.py", line 383, in get
return self.cache.get(name, modified)
File "/usr/share/rhn/common/rhnCache.py", line 356, in get
return cPickle.loads(pickled)
Some packages seem to load fairly quick (i.e. >1 sec), other take a few
secionds, but some seem to take an extremely long time, (but I think at
that point it was because my machine was swapping so much).
-Justin
--
Justin Sherrill, RHCA 1801 Varsity Drive.
Software Engineer Raleigh, NC 27603
Red Hat, Inc.
_______________________________________________
Spacewalk-devel mailing list
[email protected]
https://www.redhat.com/mailman/listinfo/spacewalk-devel
