On Fri, May 22, 2009 at 5:57 PM, Shawn Walker <swalker at opensolaris.org> wrote: > Martin Bochnig wrote: >> >> On Fri, May 22, 2009 at 5:26 PM, Shawn Walker <swalker at opensolaris.org> >> wrote: >>> >>> Martin Bochnig wrote: >>>> >>>> Ignore my remark about the BE, of course _everything_ makes up a new BE. >>>> It was before breakfast. >>>> >>>> Now I see where the problem occurs: >>>> >>>> >>>> Install Phase ? ? ? ? ? ? ? ? ? ? ? ? ? ?74640/217564 Action install >>>> failed for 'opt/onbld/etc/abi/ABI_i386.db' (pkg:/SUNWonbld): >>>> ?MemoryError: >>>> >>>> >>>> Sorry for dumb findings, remarks and questions like that. >>>> Until now I used OSyyyy.nn exclusively as LiveCD or for a few >>>> test-install inside VirtualBox. >>>> And for the SPARC LiveCD which I created last September, based on it. >>> >>> It's very likely that you will need more memory to install such a >>> significantly large amount of packages at one time. >>> >>> The traceback you posted last time has been fixed already in 111a and >>> this >>> time the pkg client should exit with a more appropriate message. >>> However, you will still need to increase your swap space to continue. >> >> >> Ok, at first I add 5GB of swap. Then re-run "pfexec pkg install >> redistributable" and wait for the results: >> >> zfs create -V 5gb rpool/swap5GB >> /usr/sbin/swap -a /dev/zvol/dsk/rpool/swap5GB >> (Then I may add it to vfstab, but I only do it after the tests.) >> >> Afterwards I upgrade to 111a, remove the 5GB extra-swap, and verify, >> which other error essage I then get on 111a. > > If you could track your peak memory usage during install, that would be > helpful information to have. > > Cheers, > -- > Shawn Walker
Ok, this time (with more swap than was configured by the installer during install time by default, although almost 2TB of hdd space were and are available) everything associated to $ pfexec pkg install redistributable went through smoothly on b111 i86pc. The maximum memory consumption by the "pkg" process could be tracked down to circa 440MB. Although this is based only on my cron job's periodic output, because I was away. Therefore this number should be treated with caution for now. I must repeat this on a fresh install of b111a (b is not on genunix.org yet) and then stay at the monitor. It can not be excluded, that the peek is 20% or more higher than those 440MB, because after downloading all sub-packages and other messages, the mem consumption can heavily increase at the time before the actual upgrade or install actions are to be performed, when "Indexing packages" reaches the last two component packages. # # # Shawn, notice that I did not experience any problems yet (other than the initial OutOfMemoryError reported by Python), although I did it "my way" with continuing to have the authority called "dev", rather than "opensolaris.org". martin at opensolaris:~$ pkg authority PUBLISHER TYPE STATUS URI dev (preferred) origin online http://pkg.opensolaris.org/dev/ martin at opensolaris:~$ Yesterday Danek Duvall confirmed on pkg-discuss, that the label of the authority should not have severe consequences,, atleast not in this context: http://mail.opensolaris.org/pipermail/pkg-discuss/2009-May/013708.html Which strange behavior exactly do you have in mind? Maybe you are right that it should not be recomended to end-users, but for me it works wel so far. I also could succesfully perform an image-update. # # # Here is some output from the session: martin at opensolaris:~$ pfexec zfs create -V 5gb rpool/swap5GB martin at opensolaris:~$ pfexec /usr/sbin/swap -a /dev/zvol/dsk/rpool/swap5GB martin at opensolaris:~$ top martin at opensolaris:~$ pfexec pkg install redistributable DOWNLOAD PKGS FILES XFER (MB) Completed 745/745 181408/181408 1519.70/1519.70 PHASE ACTIONS Install Phase 217564/217564 PHASE ITEMS Reading Existing Index 7/7 Indexing Packages 745/745 Optimizing Index... PHASE ITEMS Indexing Packages 1365/1365 martin at opensolaris:~$ >From "top" and "prstat" (snapped at different times) : load averages: 1.38, 1.61, 1.50; up 0+21:04:17 23:55:03 85 processes: 82 sleeping, 2 running, 1 on cpu CPU states: 64.0% idle, 4.2% user, 31.8% kernel, 0.0% iowait, 0.0% swap Kernel: 1320 ctxsw, 25 trap, 480 intr, 509 syscall, 16 flt Memory: 1024M phys mem, 23M free mem, 5632M total swap, 5375M free swap 18369 root 409M 373M run 10 0 0:36:26 27% pkg/1 ... 18369 root 1 59 0 409M 372M sleep 36:50 3.89% pkg ... 18369 root 1 59 0 434M 319M run 54:35 23.37% pkg ... So, if the peek stayed indeed at _all_ times below 450MB (which I cannot yet 100% guarantee), then - if the user is running the default gnome session without any running extra apps - he needs at least a total of 1.5GB of anonymous memory for the "install redistributable" operation not to fail. Here comes some more output related to image-update (issued straight after the "install redistributable" from above) : martin at opensolaris:~$ pfexec pkg image-update WARNING: pkg(5) appears to be out of date, and should be updated before running image-update. Please update pkg(5) using 'pfexec pkg install SUNWipkg' and then retry the image-update. martin at opensolaris:~$ pfexec pkg install SUNWipkg DOWNLOAD PKGS FILES XFER (MB) Completed 1/1 119/119 0.55/0.55 PHASE ACTIONS Install Phase 2/2 Update Phase 181/181 PHASE ITEMS Reading Existing Index 7/7 Indexing Packages 1/1 martin at opensolaris:~$ pfexec pkg install SUNWipkg No updates available for this image. martin at opensolaris:~$ pfexec pkg image-update DOWNLOAD PKGS FILES XFER (MB) Completed 617/617 2830/2830 109.23/109.23 PHASE ACTIONS Removal Phase 77/77 Install Phase 512/512 Update Phase 7621/7621 PHASE ITEMS Indexing Packages 1365/1365 A clone of opensolaris exists and has been updated and activated. On the next boot the Boot Environment opensolaris-1 will be mounted on '/'. Reboot when ready to switch to this updated BE. --------------------------------------------------------------------------- NOTE: Please review release notes posted at: http://opensolaris.org/os/project/indiana/resources/relnotes/200906/x86/ --------------------------------------------------------------------------- martin at opensolaris:~$ During the image-update operation the "pkg" process's peek mem usage was just 264MB. Ok, now I repeat everything (to verify that the peek stays below 450MB during a fresh post-install "install redistributable"), but after a fresh install of 111a. %martin
