Shawn Walker wrote: > Erik LaFever wrote: >> DC team, >> >> While reviewing the results of the python26 DC testing I have 11 >> new test failures that are all related to logging and I still see the >> problem with pkg_image size increased from < 5mb to > 80mb. > > As I previously noted, the catalog data for a publisher is *much* > larger now than it used to be. It is expected that you would see > image size go from < 5MB to > 80MB when you have the 'opensolaris.org' > publisher configured using 'http://pkg.opensolaris.org/dev', as an > example. > > Please check the size of '/var/pkg' to confirm, and remember that this > information compresses extremely well. > > Cheers, If I create a pkg_image with the --no-refresh option, I get a size under 5mb. If the --no-refresh option is not used, I would see a size over 80mb.
DC (up to build 127) created a pkg_image with a small footprint. Now the footprint is larger (yes you mentioned that the catalog is larger) I don't know if anything changed in DC or if they were using the --no-refresh option previously for pkg_image creation. The new logging that they are doing shows the full "pkg" commands and I do not see a --no-refresh option being sent. If I manually create a pkg_image and use the -no-refresh option, the size is small. DC has historically been working to conserve space. I have a couple of tests that use small partitions. These tests fail now during the pkg_image creation when they used to be failing during pkg installation. The line in the log file looks like: 520|2 46 28563 1 16|wands 19:34:19 Command "/usr/bin/distro_const build -p2 /var/tmp/dc_tests/dc_manifest_046_LOG/dc_manifest_046_XML >>/var/tmp/dc_tests/dc_manifest_046_LOG/out 2>/var/tmp/dc_tests/dc_manifest_046_LOG/err" failed with status 1 520|2 46 28563 1 17|wands 19:34:19 printing output from /rpool/dctest/dc/logs/detail-log-2009-11-30-19-34-02 520|2 46 28563 1 18|wands 19:34:19 +++ /rpool/dctest/dc/logs/detail-log-2009-11-30-19-34-02 +++ 520|2 46 28563 1 19|wands 19:34:19 Build started Mon Nov 30 19:34:02 2009 520|2 46 28563 1 20|wands 19:34:19 Distribution name: OpenSolaris 520|2 46 28563 1 21|wands 19:34:19 Build Area dataset: rpool/dctest/dc 520|2 46 28563 1 22|wands 19:34:19 Build Area mount point: /rpool/dctest/dc 520|2 46 28563 1 23|wands 19:34:19 ==== im-pop: Populate the image with packages 520|2 46 28563 1 24|wands 19:34:19 Initializing the IPS package image area: /rpool/dctest/dc/build_data/pkg_image 520|2 46 28563 1 25|wands 19:34:19 Setting preferred publisher: opensolaris.org 520|2 46 28563 1 26|wands 19:34:19 Origin repository: http://ipkg.sfbay/dev 520|2 46 28563 1 27|wands 19:34:19 pkg cmd: /usr/bin/pkg image-create -F -p opensolaris.org=http://ipkg.sfbay/dev /rpool/dctest/dc/build_data/pkg_image 520|2 46 28563 1 28|wands 19:34:19 /usr/lib/python2.6/vendor-packages/pkg/manifest.py:32: DeprecationWarning: the sha module is deprecated; use the hashlib module instead 520|2 46 28563 1 29|wands 19:34:19 import sha 520|2 46 28563 1 30|wands 19:34:19 /usr/lib/python2.6/vendor-packages/pkg/client/api_errors.py:289: DeprecationWarning: BaseException.message has been deprecated as of Python 2.6 520|2 46 28563 1 31|wands 19:34:19 self.message = message 520|2 46 28563 1 32|wands 19:34:19 pkg image-create: 520|2 46 28563 1 33|wands 19:34:19 pkg: 0/1 catalogs successfully updated: 520|2 46 28563 1 34|wands 19:34:19 520|2 46 28563 1 35|wands 19:34:19 Framework error: code: 23 reason: Failed writing body (16064 != 65536) 520|2 46 28563 1 36|wands 19:34:19 URL: 'http://ipkg.sfbay/dev/catalog/1/catalog.summary.C'. 520|2 46 28563 1 37|wands 19:34:19 /usr/bin/pkg:1958: DeprecationWarning: BaseException.message has been deprecated as of Python 2.6 520|2 46 28563 1 38|wands 19:34:19 if cre.message: 520|2 46 28563 1 39|wands 19:34:19 Unable to initialize the IPS image 520|2 46 28563 1 40|wands 19:34:19 Build completed Mon Nov 30 19:34:19 2009 520|2 46 28563 1 41|wands 19:34:19 Build failed. I am reporting what I find to the team because it is a change and I would like to know if they consider this issue a bug or just a result of changes to "pkg". If the issue is known and they are fine with the change I would need to update my tests to reflect this or else file a bug. Thanks, -Erik
