** Description changed:

- UCA Rocky has older versions than UCA Stein for some Ceph python2
- packages, e.g., python-cephfs.
+ Some ceph python2 packages have been dropped between rocky and stein.
+ (in Disco, from 13.2.1+dfsg1-0ubuntu3 to 13.2.2+dfsg1-0ubuntu1 [1]).
  
- This is an issue for versioned dependencies that require an exact
- version that isn't there.
+ The packages python-{cephfs,rados,rbd} have no upgrades, but have exact
+ versioned dependencies on packages that have upgrades.
  
- The apt solution is removing packages, but that's not allowed on `apt
- upgrade`, thus `apt` keeps back / doesn't upgrade some ceph packages
- (`apt full-upgrade` can remove/works fine.)
+ So, during `apt upgrade` the former block the latter from being
+ upgraded, which in turn block  other ceph packages from being upgraded
+ (e.g., ceph-{common,mon,osd,mgr}).
  
- Example:
+ Note this isn't a problem on `apt full-upgrade` or `apt dist-upgrade` as
+ these allow package removals (`apt upgrade` does not), then `apt` just
+ decides to remove those 3 packages.
  
-       $ apt-cache madison python-cephfs
-       python-cephfs | 13.2.8-0ubuntu0.18.10.1~cloud0 | 
http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-updates/rocky/main 
amd64 Packages
-       python-cephfs | 13.2.1+dfsg1-0ubuntu3~cloud0 | 
http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-updates/stein/main 
amd64 Packages
-       ...
+ It's possible to fix this with dummy transitional packages that remove
+ the exact versioned dependency (patch provided/tested in comment #5).
+ 
+ [1] https://launchpad.net/ubuntu/+source/ceph/13.2.2+dfsg1-0ubuntu1
+ 
+ Steps to Reproduce:
+ ---
  
  
  Setup Bionic container:
- ---
  
- $ lxc launch ubuntu:bionic mfo-bionic-uca
- $ ssh mfo-bionic-uca.lxd
+ $ lxc launch ubuntu:bionic bionic-uca
+ $ lxc exec bionic-uca -- su - ubuntu
  
  $ sudo apt --yes purge unattended-upgrades
  $ sudo apt update
  
- 
  Install ceph from Bionic (Queens):
- ---
  
  $ sudo apt --yes install ceph
  
  $ dpkg -s ceph | grep Version
  Version: 12.2.13-0ubuntu0.18.04.10
  
- 
- Upgrade to ceph from UCA Rocky:
- ---
+ Upgrade to UCA Rocky:
  
  $ sudo add-apt-repository --yes cloud-archive:rocky
  
  $ sudo apt --dry-run upgrade
  ...
  The following packages will be upgraded:
-   ceph ceph-base ceph-common ceph-mgr ceph-mon ceph-osd libcephfs2 librados2 
libradosstriper1 librbd1 python-cephfs python-pecan python-rados python-rbd
-   python-webob python3-jsonpatch
+   ceph ceph-base ceph-common ceph-mgr ceph-mon ceph-osd libcephfs2 librados2 
libradosstriper1 librbd1 python-cephfs python-pecan python-rados python-rbd
+   python-webob python3-jsonpatch
  ...
  
  $ sudo apt --yes upgrade
  
  $ dpkg -s ceph | grep Version
  Version: 13.2.8-0ubuntu0.18.10.1~cloud0
  
- 
- Upgrade to ceph from UCA Stein:
- ---
+ Upgrade to UCA Stein:
  
  $ sudo add-apt-repository --yes cloud-archive:stein
  
  $ sudo apt --dry-run upgrade
  ...
  The following packages have been kept back:
-   ceph ceph-base ceph-common ceph-mgr ceph-mon ceph-osd libcephfs2 librados2 
libradosstriper1 librbd1
+   ceph ceph-base ceph-common ceph-mgr ceph-mon ceph-osd libcephfs2 librados2 
libradosstriper1 librbd1
  ...
+ 
+ Issue above.
+ 
  
  Check:
  ---
  
  $ sudo apt -o Debug::pkgProblemResolver=1 --dry-run upgrade
-       ...
-       Entering ResolveByKeep 10%
+  ...
+  Entering ResolveByKeep 10%
  
-         Dependencies are not satisfied for python-cephfs:amd64 < 
13.2.8-0ubuntu0.18.10.1~cloud0 @ii mK Ib >
-       Keeping package python-cephfs:amd64
-         Dependencies are not satisfied for python-cephfs:amd64 < 
13.2.8-0ubuntu0.18.10.1~cloud0 @ii mK Ib >
-       Package python-cephfs:amd64 python-cephfs:amd64 Depends on 
libcephfs2:amd64 < 13.2.8-0ubuntu0.18.10.1~cloud0 -> 
13.2.9-0ubuntu0.19.04.1~cloud3 @ii umU > (= 13.2
-       .8-0ubuntu0.18.10.1~cloud0)
-         Keeping Package libcephfs2:amd64 due to Depends
+    Dependencies are not satisfied for python-cephfs:amd64 < 
13.2.8-0ubuntu0.18.10.1~cloud0 @ii mK Ib >
+  Keeping package python-cephfs:amd64
+    Dependencies are not satisfied for python-cephfs:amd64 < 
13.2.8-0ubuntu0.18.10.1~cloud0 @ii mK Ib >
+  Package python-cephfs:amd64 python-cephfs:amd64 Depends on libcephfs2:amd64 
< 13.2.8-0ubuntu0.18.10.1~cloud0 -> 13.2.9-0ubuntu0.19.04.1~cloud3 @ii umU > (= 
13.2
+  .8-0ubuntu0.18.10.1~cloud0)
+    Keeping Package libcephfs2:amd64 due to Depends
  
  ...
  
- Issue:
- -----
+ Details:
+ -------
  
  python-cephfs at version 13.2.__8__ has exact version dep on libcephfs2,
  which is being upgraded to 13.2.__9__.
  
  Why isn't python-cephfs being upgraded to 13.2.__9__ too?
  
  AH, there's no 13.2.__9__ version for python-cephfs, only for libcephfs2.
  So, it stopped on 13.2.__8__ in UCA Rocky, there's no 13.2.__9__ in UCA 
Stein, as there's for libcephfs2.
- 
- Why is that?
- 
- OH, wait. UCA Stein does have python-cephfs, but in an _older_ version than 
UCA Rocky: 13.2.__1__.
- (but it has _newer_ libcephfs2, ahhh OK; there's the mismatch)
- 
-       ubuntu@mfo-bionic-uca:~$ apt-cache madison python-cephfs
-       python-cephfs | 13.2.8-0ubuntu0.18.10.1~cloud0 | 
http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-updates/rocky/main 
amd64 Packages
-       python-cephfs | 13.2.1+dfsg1-0ubuntu3~cloud0 | 
http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-updates/stein/main 
amd64 Packages
-       python-cephfs | 12.2.13-0ubuntu0.18.04.10 | 
http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages
-       python-cephfs | 12.2.13-0ubuntu0.18.04.10 | 
http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages
-       python-cephfs | 12.2.4-0ubuntu1 | http://archive.ubuntu.com/ubuntu 
bionic/main amd64 Packages
- 
-       ubuntu@mfo-bionic-uca:~$ apt-cache madison libcephfs2
-       libcephfs2 | 13.2.9-0ubuntu0.19.04.1~cloud3 | 
http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-updates/stein/main 
amd64 Packages
-       libcephfs2 | 13.2.8-0ubuntu0.18.10.1~cloud0 | 
http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-updates/rocky/main 
amd64 Packages
-       libcephfs2 | 12.2.13-0ubuntu0.18.04.10 | 
http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages
-       libcephfs2 | 12.2.13-0ubuntu0.18.04.10 | 
http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages
-       libcephfs2 | 12.2.4-0ubuntu1 | http://archive.ubuntu.com/ubuntu 
bionic/main amd64 Packages
- 
- Ah, the python*2* pkg is no longer built after that version:
- 
-       Page 
https://launchpad.net/ubuntu/+source/ceph/13.2.1+dfsg1-0ubuntu3/+build/15590380
-       Has python3-cephfs 13.2.1+dfsg1-0ubuntu3
-       And python-cephfs 13.2.1+dfsg1-0ubuntu3
- 
-       Page 
https://launchpad.net/ubuntu/+source/ceph/13.2.2+dfsg1-0ubuntu4/+build/15747822
-       Has python3-cephfs 13.2.2+dfsg1-0ubuntu4
-       NOT python-cephfs
- 
- But how did UCA Rocky get it.
- Hm, it's from 13.2.__8__.  
- Is it an UCA only thing?
- 
-       Yes, page not found w/out ~cloud suffix
-               
https://launchpad.net/ubuntu/+source/ceph/13.2.8-0ubuntu0.18.10.1
-       Disco goes up to 13.2.7.
-               https://launchpad.net/ubuntu/disco/+source/ceph
-       Eoan starts on 13.2.4 then jumps to 14.2.1:
-               https://launchpad.net/ubuntu/eoan/+source/ceph
- 
- So maybe do equivalently on Stein.
- 
- 
- And.. it's been reported that installing just `ceph-common` works, and it 
actually REMOVES those.
- 
- ubuntu@mfo-bionic-uca:~$ sudo apt --dry-run install ceph-common
- ...
- The following packages will be REMOVED:
-   python-cephfs python-rados python-rbd
- ...
- The following packages will be upgraded:
-   ceph ceph-base ceph-common ceph-mgr ceph-mon ceph-osd libcephfs2 librados2 
libradosstriper1 librbd1
- ...
- 
-         
- And that's why `apt upgrade` doesn't work; it CANNOT remove packages.
- 
- Ok, so `apt full-upgrade` does WORK, as it CAN:
- 
- man 8 apt
- 
-        upgrade (apt-get(8))
-            ... If an upgrade for a package
-            requires the remove of an installed package the upgrade for this 
package isn't performed.
- 
-        full-upgrade (apt-get(8))
-            full-upgrade performs the function of upgrade but will remove 
currently installed packages if this is needed to upgrade the system as a whole.
- 
- And there we go.
- 
- ubuntu@mfo-bionic-uca:~$ sudo apt --dry-run full-upgrade
- ...
- The following packages will be REMOVED:
-   python-cephfs python-rados python-rbd
- The following NEW packages will be installed:
- ...
- The following packages will be upgraded:
-   ceph ceph-base ceph-common ceph-mgr ceph-mon ceph-osd ibverbs-providers 
libcephfs2 libibverbs1 libnuma1 librados2 libradosstriper1 librbd1
-   python-pkg-resources python-setuptools python-webob python3-jwt 
python3-pkg-resources
- ...
- 
- Yeah, so it seems the issue is UCA Stein having older versions of some
- packages than UCA Rocky.

** Description changed:

- Some ceph python2 packages have been dropped between rocky and stein.
+ The ceph python2 packages have been dropped between rocky and stein.
  (in Disco, from 13.2.1+dfsg1-0ubuntu3 to 13.2.2+dfsg1-0ubuntu1 [1]).
  
  The packages python-{cephfs,rados,rbd} have no upgrades, but have exact
  versioned dependencies on packages that have upgrades.
  
  So, during `apt upgrade` the former block the latter from being
  upgraded, which in turn block  other ceph packages from being upgraded
  (e.g., ceph-{common,mon,osd,mgr}).
  
  Note this isn't a problem on `apt full-upgrade` or `apt dist-upgrade` as
  these allow package removals (`apt upgrade` does not), then `apt` just
  decides to remove those 3 packages.
  
  It's possible to fix this with dummy transitional packages that remove
  the exact versioned dependency (patch provided/tested in comment #5).
  
  [1] https://launchpad.net/ubuntu/+source/ceph/13.2.2+dfsg1-0ubuntu1
  
  Steps to Reproduce:
  ---
- 
  
  Setup Bionic container:
  
  $ lxc launch ubuntu:bionic bionic-uca
  $ lxc exec bionic-uca -- su - ubuntu
  
  $ sudo apt --yes purge unattended-upgrades
  $ sudo apt update
  
  Install ceph from Bionic (Queens):
  
  $ sudo apt --yes install ceph
  
  $ dpkg -s ceph | grep Version
  Version: 12.2.13-0ubuntu0.18.04.10
  
  Upgrade to UCA Rocky:
  
  $ sudo add-apt-repository --yes cloud-archive:rocky
  
  $ sudo apt --dry-run upgrade
  ...
  The following packages will be upgraded:
    ceph ceph-base ceph-common ceph-mgr ceph-mon ceph-osd libcephfs2 librados2 
libradosstriper1 librbd1 python-cephfs python-pecan python-rados python-rbd
    python-webob python3-jsonpatch
  ...
  
  $ sudo apt --yes upgrade
  
  $ dpkg -s ceph | grep Version
  Version: 13.2.8-0ubuntu0.18.10.1~cloud0
  
  Upgrade to UCA Stein:
  
  $ sudo add-apt-repository --yes cloud-archive:stein
  
  $ sudo apt --dry-run upgrade
  ...
  The following packages have been kept back:
    ceph ceph-base ceph-common ceph-mgr ceph-mon ceph-osd libcephfs2 librados2 
libradosstriper1 librbd1
  ...
  
  Issue above.
  
- 
  Check:
  ---
  
  $ sudo apt -o Debug::pkgProblemResolver=1 --dry-run upgrade
   ...
   Entering ResolveByKeep 10%
  
     Dependencies are not satisfied for python-cephfs:amd64 < 
13.2.8-0ubuntu0.18.10.1~cloud0 @ii mK Ib >
   Keeping package python-cephfs:amd64
     Dependencies are not satisfied for python-cephfs:amd64 < 
13.2.8-0ubuntu0.18.10.1~cloud0 @ii mK Ib >
   Package python-cephfs:amd64 python-cephfs:amd64 Depends on libcephfs2:amd64 
< 13.2.8-0ubuntu0.18.10.1~cloud0 -> 13.2.9-0ubuntu0.19.04.1~cloud3 @ii umU > (= 
13.2
   .8-0ubuntu0.18.10.1~cloud0)
     Keeping Package libcephfs2:amd64 due to Depends
  
  ...
  
  Details:
  -------
  
  python-cephfs at version 13.2.__8__ has exact version dep on libcephfs2,
  which is being upgraded to 13.2.__9__.
  
  Why isn't python-cephfs being upgraded to 13.2.__9__ too?
  
  AH, there's no 13.2.__9__ version for python-cephfs, only for libcephfs2.
  So, it stopped on 13.2.__8__ in UCA Rocky, there's no 13.2.__9__ in UCA 
Stein, as there's for libcephfs2.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1960065

Title:
  cloud archive: apt upgrade from rocky to stein keeps back some ceph
  packages

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/1960065/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

Reply via email to