[ceph-users] squid 19.2.0 QE validation status
Details of this release are summarized here: https://tracker.ceph.com/issues/67779#note-1 Release Notes - TBD Gibba upgrade -TBD LRC upgrade - TBD It was decided and agreed upon that there would be limited testing for this release, given it is based on 19.1.1 rather than a full rebase. Seeking approvals/reviews for: (some reruns are still in progress) rgw - Eric, Adam E fs - Venky orch - Adam King quincy-x - Laura, Neha reef-x - Laura, Neha Pls let me know if any tests were missed from this list. ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] v19.1.1 Squid RC1 released
This is the second release candidate for Squid. Feature highlights: RGW Fixed a regression in bucket ownership for Keystone users and implicit tenants. The User Accounts feature unlocks several new AWS-compatible IAM APIs for the self-service management of users, keys, groups, roles, policy and more. RADOS BlueStore has been optimized for better performance in snapshot-intensive workloads. BlueStore RocksDB LZ4 compression is now enabled by default to improve average performance and "fast device" space usage. Other improvements include more flexible EC configurations, an OpTracker to help debug mgr module issues, and better scrub scheduling. Dashboard * Rearranged Navigation Layout: The navigation layout has been reorganized for improved usability and easier access to key features. CephFS Improvements * Support for managing CephFS snapshots and clones, as well as snapshot schedule management * Manage authorization capabilities for CephFS resources * Helpers on mounting a CephFS volume RGW Improvements * Support for managing bucket policies * Add/Remove bucket tags * ACL Management * Several UI/UX Improvements to the bucket form Monitoring: Grafana dashboards are now loaded into the container at runtime rather than building a grafana image with the grafana dashboards. Official Ceph grafana images can be found in quay.io/ceph/grafana * Monitoring: RGW S3 Analytics: A new Grafana dashboard is now available, enabling you to visualize per bucket and user analytics data, including total GETs, PUTs, Deletes, Copies, and list metrics. Crimson/Seastore Crimson's first tech preview release! Supporting RBD workloads on Replicated pools. For more information please visit: https://ceph.io/en/news/crimson If any of our community members would like to help us with performance investigations or regression testing of the Squid release candidate, please feel free to provide feedback via email or in https://pad.ceph.com/p/squid_scale_testing. For more active discussions, please use the #ceph-at-scale slack channel in ceph-storage.slack.com. * Git at git://github.com/ceph/ceph.git * Tarball at https://download.ceph.com/tarballs/ceph-19.1.1.tar.gz * Containers at https://quay.io/repository/ceph/ceph * For packages, see https://docs.ceph.com/en/latest/install/get-packages/ * Release git sha1: 1d9f35852eef16b81614e38a05cf88b505cc142b ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: squid 19.1.1 RC QE validation status
We need approval from Guillaume Laura, and gibba upgrade. On Mon, Aug 19, 2024 at 7:31 AM Laura Flores wrote: > Thanks @Adam King ! > > @Yuri Weinstein the upgrade suites are approved. > > On Mon, Aug 19, 2024 at 9:28 AM Adam King wrote: > >> https://tracker.ceph.com/issues/67583 didn't reproduce across 10 reruns >> https://pulpito.ceph.com/lflores-2024-08-16_00:04:51-upgrade:quincy-x-squid-release-distro-default-smithi/. >> Given the original failure was just "Unable to find image ' >> quay.io/ceph/grafana:9.4.12' locally" which doesn't look very serious >> anyway, I don't think there's any reason for the failure to hold up the >> release >> >> On Thu, Aug 15, 2024 at 6:53 PM Laura Flores wrote: >> >>> The upgrade suites look mostly good to me, except for one tracker I >>> think would be in @Adam King 's realm to look at. If >>> the new grafana issue below is deemed okay, then we can proceed with >>> approving the upgrade suite. >>> >>> *This issue stood out to me, where the cluster had trouble pulling the >>> grafana image locally to redeploy it. *@Adam King * can >>> you take a look?* >>> >>>- *https://tracker.ceph.com/issues/67583 >>><https://tracker.ceph.com/issues/67583> - upgrade:quincy-x/stress-split: >>>Cluster fails to redeploy grafana daemon after image is unable to be >>> found >>>locally* >>> >>> >>> Otherwise, tests failed from cluster log warnings that are expected >>> during upgrade tests. Many of these warnings have already been fixed and >>> are in the stages of getting backported. >>> I checked for each test that the cluster had upgraded all daemons to >>> 19.1.1, and that was the case. >>> >>>- https://tracker.ceph.com/issues/66602 - rados/upgrade: Health >>>check failed: 1 pool(s) do not have an application enabled >>>(POOL_APP_NOT_ENABLED) >>>- https://tracker.ceph.com/issues/65422 - upgrade/quincy-x: "1 pg >>>degraded (PG_DEGRADED)" in cluster log >>>- https://tracker.ceph.com/issues/67584 - upgrade:quincy-x: cluster >>>[WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log >>>- https://tracker.ceph.com/issues/64460 - rados/upgrade: "[WRN] >>>MON_DOWN: 1/3 mons down, quorum a,b" in cluster log >>>- https://tracker.ceph.com/issues/66809 - upgrade/quincy-x; >>>upgrade/reef-x: Health check failed: Reduced data availability: 1 pg >>>peering (PG_AVAILABILITY)" in cluster log >>> >>> >>> >>> On Thu, Aug 15, 2024 at 11:55 AM Laura Flores >>> wrote: >>> >>>> Rados approved. Failures tracked here: >>>> https://tracker.ceph.com/projects/rados/wiki/SQUID#v1911-httpstrackercephcomissues67340 >>>> >>>> On Thu, Aug 15, 2024 at 11:30 AM Yuri Weinstein >>>> wrote: >>>> >>>>> Laura, >>>>> >>>>> The PR was cherry-picked and the `squid-release` branch was built. >>>>> Please review the run results in the tracker. >>>>> >>>>> On Wed, Aug 14, 2024 at 2:18 PM Laura Flores >>>>> wrote: >>>>> > >>>>> > Hey @Yuri Weinstein , >>>>> > >>>>> > We've fixed a couple of issues and now need a few things rerun. >>>>> > >>>>> > >>>>> >1. *Can you please rerun upgrade/reef-x and upgrade/quincy-x? * >>>>> > - Reasoning: Many jobs in those suites died due to >>>>> > https://tracker.ceph.com/issues/66883, which we deduced was a >>>>> recent >>>>> > merge to teuthology. Now that the affecting commit was >>>>> reverted, we are >>>>> > ready to have those rerun. >>>>> >2. *Can you please cherry-pick >>>>> https://github.com/ceph/ceph/pull/58607 >>>>> ><https://github.com/ceph/ceph/pull/58607> to squid-release and >>>>> reschedule >>>>> >rados:thrash-old-clients?* >>>>> > - Reasoning: Since we stopped building focal for squid, we can >>>>> no >>>>> > longer test squid against pacific clients. >>>>> > - For this second RC, we had to make the decision to drop >>>>> pacific >>>>> >
[ceph-users] Re: squid 19.1.1 RC QE validation status
Laura, The PR was cherry-picked and the `squid-release` branch was built. Please review the run results in the tracker. On Wed, Aug 14, 2024 at 2:18 PM Laura Flores wrote: > > Hey @Yuri Weinstein , > > We've fixed a couple of issues and now need a few things rerun. > > >1. *Can you please rerun upgrade/reef-x and upgrade/quincy-x? * > - Reasoning: Many jobs in those suites died due to > https://tracker.ceph.com/issues/66883, which we deduced was a recent > merge to teuthology. Now that the affecting commit was reverted, we are > ready to have those rerun. >2. *Can you please cherry-pick https://github.com/ceph/ceph/pull/58607 ><https://github.com/ceph/ceph/pull/58607> to squid-release and reschedule >rados:thrash-old-clients?* > - Reasoning: Since we stopped building focal for squid, we can no > longer test squid against pacific clients. > - For this second RC, we had to make the decision to drop pacific > from the *rados:thrash-old-clients* tests, which will now use centos > 9 stream packages to test against only reef and quincy clients ( > https://github.com/ceph/ceph/pull/58607). > - We have raised https://tracker.ceph.com/issues/67469 to track the > implementation of a containerized solution for older clients that don't > have centos 9 stream packages, so that we can reincorporate > pacific in the > future. > > After these two things are rescheduled, we can proceed with a rados suite > approval and an upgrade suite approval. > > Thanks, > Laura > > On Wed, Aug 14, 2024 at 12:49 PM Adam Emerson wrote: > > > On 14/08/2024, Yuri Weinstein wrote: > > > Still waiting to hear back: > > > > > > rgw - Eric, Adam E > > > > Approved. > > > > (Sorry, I thought we were supposed to reply on the tracker.) > > ___ > > Dev mailing list -- d...@ceph.io > > To unsubscribe send an email to dev-le...@ceph.io > > > > > > -- > > Laura Flores > > She/Her/Hers > > Software Engineer, Ceph Storage <https://ceph.io> > > Chicago, IL > > lflo...@ibm.com | lflo...@redhat.com > M: +17087388804 > ___ > ceph-users mailing list -- ceph-users@ceph.io > To unsubscribe send an email to ceph-users-le...@ceph.io ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: squid 19.1.1 RC QE validation status
Still waiting to hear back: rgw - Eric, Adam E quincy-x, reef-x - Laura, Neha powercycle - Brad crimson-rados - Matan, Samuel ceph-volume - Guillaume On Tue, Aug 13, 2024 at 9:27 PM Venky Shankar wrote: > > Hi Yuri, > > On Tue, Aug 6, 2024 at 2:03 AM Yuri Weinstein wrote: > > > > Details of this release are summarized here: > > > > https://tracker.ceph.com/issues/67340#note-1 > > > > Release Notes - N/A > > LRC upgrade - N/A > > Gibba upgrade -TBD > > > > Seeking approvals/reviews for: > > > > rados - Radek, Laura (https://github.com/ceph/ceph/pull/59020 is being > > tested and will be cherry-picked when ready) > > > > rgw - Eric, Adam E > > fs - Venky > > There are a couple of new bugs seen in this run, but those are not > blockers for this RC. > > Failures are noted here > > > https://tracker.ceph.com/projects/cephfs/wiki/Squid#2024-Aug-13-RC-1911 > > Consider this run as "fs approved". > > > orch - Adam King > > rbd, krbd - Ilya > > > > quincy-x, reef-x - Laura, Neha > > > > powercycle - Brad > > crimson-rados - Matan, Samuel > > > > ceph-volume - Guillaume > > > > Pls let me know if any tests were missed from this list. > > ___ > > ceph-users mailing list -- ceph-users@ceph.io > > To unsubscribe send an email to ceph-users-le...@ceph.io > > > > > -- > Cheers, > Venky > ___ > ceph-users mailing list -- ceph-users@ceph.io > To unsubscribe send an email to ceph-users-le...@ceph.io ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: squid 19.1.1 RC QE validation status
The PR from the core team https://github.com/ceph/ceph/pull/59020 was cherry-picked and rados tests are running. Still seeking reviews and approvals for other suites. On Mon, Aug 5, 2024 at 1:53 PM Ilya Dryomov wrote: > > On Mon, Aug 5, 2024 at 10:32 PM Yuri Weinstein wrote: > > > > Details of this release are summarized here: > > > > https://tracker.ceph.com/issues/67340#note-1 > > > > Release Notes - N/A > > LRC upgrade - N/A > > Gibba upgrade -TBD > > > > Seeking approvals/reviews for: > > > > rados - Radek, Laura (https://github.com/ceph/ceph/pull/59020 is being > > tested and will be cherry-picked when ready) > > > > rgw - Eric, Adam E > > fs - Venky > > orch - Adam King > > rbd, krbd - Ilya > > rbd and krbd approved. > > (For krbd, https://tracker.ceph.com/issues/67353 popped up, but it's > not blocker.) > > Thanks, > > Ilya > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] squid 19.1.1 RC QE validation status
Details of this release are summarized here: https://tracker.ceph.com/issues/67340#note-1 Release Notes - N/A LRC upgrade - N/A Gibba upgrade -TBD Seeking approvals/reviews for: rados - Radek, Laura (https://github.com/ceph/ceph/pull/59020 is being tested and will be cherry-picked when ready) rgw - Eric, Adam E fs - Venky orch - Adam King rbd, krbd - Ilya quincy-x, reef-x - Laura, Neha powercycle - Brad crimson-rados - Matan, Samuel ceph-volume - Guillaume Pls let me know if any tests were missed from this list. ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: [Ceph-announce] v18.2.4 Reef released
Use https://download.ceph.com/rpm-reef/el9/x86_64/ On Fri, Jul 26, 2024 at 1:37 AM Amardeep Singh wrote: > > Hi, > > I have tried running simple update on Rocky 8.9 running reef 18.2.2, it's > failing straight away. > > dnf update > Ceph x86_64 > 84 B/s | 146 B >00:01 > Errors during downloading metadata for repository 'Ceph': > - Status code: 404 for > https://download.ceph.com/rpm-reef/el8/x86_64/repodata/repomd.xml (IP: > 158.69.68.124) > Error: Failed to download metadata for repo 'Ceph': Cannot download > repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried > > Can someone please suggest? > > Thanks, > > Amar > > > On 25/07/24 09:57, Konstantin Shalygin wrote: > > EXTERNAL: Do not click links or open attachments if you do not recognize the > sender. > > Hi, > > > > On 25 Jul 2024, at 00:12, Yuri Weinstein > <mailto:ywein...@redhat.com> wrote: > > We're happy to announce the 4th release in the Reef series. > > > > The repo of reef now returns 404 > > > > GET /rpm-reef/el8/SRPMS/ HTTP/1.1 > Host: download.ceph.com > > > > < HTTP/1.1 404 Not Found > > If change the repo to previous version, the answer 200 as expected > > > > GET /rpm-18.2.2/el8/SRPMS/ HTTP/1.1 > Host: download.ceph.com > > > > < HTTP/1.1 200 OK > > > > Seems something wrong with packages > k > ___ > ceph-users mailing list -- ceph-users@ceph.io<mailto:ceph-users@ceph.io> > To unsubscribe send an email to > ceph-users-le...@ceph.io<mailto:ceph-users-le...@ceph.io> > > > -- > > > DISCLAIMER: This email and any files transmitted with it are confidential and > intended solely for the use of the individual or entity to whom they are > addressed. If you have received this email in error, please notify the > sender. This message contains confidential information and is intended only > for the individual named. If you are not the named addressee, you should not > disseminate, distribute or copy this email. Please notify the sender > immediately by email if you have received this email by mistake and delete > this email from your system. > > If you are not the intended recipient, you are notified that disclosing, > copying, distributing or taking any action in reliance on the contents of > this information is strictly prohibited. Thanks for your cooperation. > ___ > ceph-users mailing list -- ceph-users@ceph.io > To unsubscribe send an email to ceph-users-le...@ceph.io > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: v18.2.4 Reef released - blog release note missing issue 61948
Robin, thx We will fix the typo On Wed, Jul 24, 2024 at 5:18 PM Robin H. Johnson wrote: > > Hi Yuri et al, > > The email announcement includes the fix for 61948, but the linked blog > page omits it entirely. > > Suggest adding that note to the blog page. > > The language used also differs slightly between the two announcements. > > email: > > We're happy to announce the 4th release in the Reef series. > blog: > | This is the third backport release in the Reef series. We recommend > | that all users update to this release. > > > > On Wed, Jul 24, 2024 at 02:12:25PM -0700, Yuri Weinstein wrote: > > We're happy to announce the 4th release in the Reef series. > ... > > Notable Changes > > --- > > * RADOS: This release fixes a bug (https://tracker.ceph.com/issues/61948) > > where > > pre-reef clients were allowed to connect to the `pg-upmap-primary` > > (https://docs.ceph.com/en/reef/rados/operations/read-balancer/) > > interface despite users having set `require-min-compat-client=reef`, > > leading to an assert in the osds and mons. You are susceptible to this > > bug in reef versions prior to 18.2.3 if 1) you are using an osdmap > > generated via the offline osdmaptool with the `--read` option or 2) > > you have explicitly generated pg-upmap-primary mappings with the CLI > > command. Please note that the fix is minimal and does not address corner > > cases such as adding a mapping in the middle of an upgrade or in a > > partially > > upgraded cluster (related trackers linked in > > https://tracker.ceph.com/issues/61948). > > As such, we recommend removing any existing pg-upmap-primary > > mappings until remaining > > issues are addressed in future point releases. > > See https://tracker.ceph.com/issues/61948#note-32 for instructions > > on how to remove > > existing pg-upmap-primary mappings. > This is the missing item on the webpage. > > -- > Robin Hugh Johnson > Gentoo Linux: Dev, Infra Lead, Foundation President & Treasurer > E-Mail : robb...@gentoo.org > GnuPG FP : 11ACBA4F 4778E3F6 E4EDF38E B27B944E 34884E85 > GnuPG FP : 7D0B3CEB E9B85B1F 825BCECF EE05E6F6 A48F6136 > ___ > Dev mailing list -- d...@ceph.io > To unsubscribe send an email to dev-le...@ceph.io ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] v18.2.4 Reef released
We're happy to announce the 4th release in the Reef series. An early build of this release was accidentally exposed and packaged as 18.2.3 by the Debian project in April. That 18.2.3 release should not be used. The official release was re-tagged as v18.2.4 to avoid further confusion. v18.2.4 container images, now based on CentOS 9, may be incompatible on older kernels (e.g., Ubuntu 18.04) due to differences in thread creation methods. Users upgrading to v18.2.4 container images with older OS versions may encounter crashes during `pthread_create`. For workarounds, refer to the related tracker. However, we recommend upgrading your OS to avoid this unsupported combination. Related tracker: https://tracker.ceph.com/issues/66989 We recommend users to update to this release. For detailed release notes with links & changelog please refer to the official blog entry at https://ceph.io/en/news/blog/2024/v18-2-4-reef-released/ Notable Changes --- * RADOS: This release fixes a bug (https://tracker.ceph.com/issues/61948) where pre-reef clients were allowed to connect to the `pg-upmap-primary` (https://docs.ceph.com/en/reef/rados/operations/read-balancer/) interface despite users having set `require-min-compat-client=reef`, leading to an assert in the osds and mons. You are susceptible to this bug in reef versions prior to 18.2.3 if 1) you are using an osdmap generated via the offline osdmaptool with the `--read` option or 2) you have explicitly generated pg-upmap-primary mappings with the CLI command. Please note that the fix is minimal and does not address corner cases such as adding a mapping in the middle of an upgrade or in a partially upgraded cluster (related trackers linked in https://tracker.ceph.com/issues/61948). As such, we recommend removing any existing pg-upmap-primary mappings until remaining issues are addressed in future point releases. See https://tracker.ceph.com/issues/61948#note-32 for instructions on how to remove existing pg-upmap-primary mappings. * RBD: When diffing against the beginning of time (`fromsnapname == NULL`) in fast-diff mode (`whole_object == true` with `fast-diff` image feature enabled and valid), diff-iterate is now guaranteed to execute locally if exclusive lock is available. This brings a dramatic performance improvement for QEMU live disk synchronization and backup use cases. * RADOS: `get_pool_is_selfmanaged_snaps_mode` C++ API has been deprecated due to being prone to false negative results. It's safer replacement is `pool_is_in_selfmanaged_snaps_mode`. * RBD: The option ``--image-id`` has been added to `rbd children` CLI command, so it can be run for images in the trash. Related tracker: https://tracker.ceph.com/issues/65393 Getting Ceph * Git at git://github.com/ceph/ceph.git * Tarball at https://download.ceph.com/tarballs/ceph_18.2.4.orig.tar.gz * Containers at https://quay.io/repository/ceph/ceph * For packages, see https://docs.ceph.com/en/latest/install/get-packages/ * Release git sha1: e7ad5345525c7aa95470c26863873b581076945d ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] v19.1.0 Squid RC0 released
This is the first release candidate for Squid. Feature highlights: RGW The User Accounts feature unlocks several new AWS-compatible IAM APIs for the self-service management of users, keys, groups, roles, policy and more. RADOS BlueStore has been optimized for better performance in snapshot-intensive workloads. BlueStore RocksDB LZ4 compression is now enabled by default to improve average performance and "fast device" space usage. Other improvements include more flexible EC configurations, an OpTracker to help debug mgr module issues, and better scrub scheduling. Dashboard * Rearranged Navigation Layout: The navigation layout has been reorganized for improved usability and easier access to key features. CephFS Improvements * Support for managing CephFS snapshots and clones, as well as snapshot schedule management * Manage authorization capabilities for CephFS resources * Helpers on mounting a CephFS volume RGW Improvements * Support for managing bucket policies * Add/Remove bucket tags * ACL Management * Several UI/UX Improvements to the bucket form Monitoring: Grafana dashboards are now loaded into the container at runtime rather than building a grafana image with the grafana dashboards. Official Ceph grafana images can be found in quay.io/ceph/grafana * Monitoring: RGW S3 Analytics: A new Grafana dashboard is now available, enabling you to visualize per bucket and user analytics data, including total GETs, PUTs, Deletes, Copies, and list metrics. Crimson/Seastore Crimson's first tech preview release! Supporting RBD workloads on Replicated pools. For more information please visit: https://ceph.io/en/news/crimson If any of our community members would like to help us with performance investigations or regression testing of the Squid release candidate, please feel free to provide feedback via email or in https://pad.ceph.com/p/squid_scale_testing. For more active discussions, please use the #ceph-at-scale slack channel in ceph-storage.slack.com. * Git at git://github.com/ceph/ceph.git * Tarball at https://download.ceph.com/tarballs/ceph-19.1.0.tar.gz * Containers at https://quay.io/repository/ceph/ceph * For packages, see https://docs.ceph.com/en/latest/install/get-packages/ * Release git sha1: 9025b9024baf597d63005552b5ee004013630404 ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: reef 18.2.3 QE validation status
We built a new branch with all the cherry-picks on top (https://pad.ceph.com/p/release-cherry-pick-coordination). I am rerunning fs:upgrade: https://pulpito.ceph.com/yuriw-2024-07-10_13:47:23-fs:upgrade-reef-release-distro-default-smithi/ Venky, pls review it after it's done. Neha, do you want to upgrade gibba/LRC to this build? (note there is no pre-release 18.2.4 built yet) On Tue, Jul 9, 2024 at 6:41 AM Casey Bodley wrote: > > this was discussed in the ceph leadership team meeting yesterday, and > we've agreed to re-number this release to 18.2.4 > > On Wed, Jul 3, 2024 at 1:08 PM wrote: > > > > > > On Jul 3, 2024 5:59 PM, Kaleb Keithley wrote: > > > > > > > > > > > > > > Replacing the tar file is problematic too, if only because it's a > > > potential source of confusion for people who aren't paying attention. > > > > It'd be really the worst thing to do. > > > > > I'm not sure I believe that making this next release 18.2.4 really solves > > > anything > > > > It solves *my* problem that the old version of the file is already in the > > Debian archive and cannot be replaced there. By all means, please find a > > better solution for long term. In the mean time, do *not* re-release an > > already released tarball. > > > > Cheers, > > > > Thomas Goirand (zigo) > > > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: squid 19.1.0 RC QE validation status
Neha, and Josh pls do a final review and approval. Pls confirm that the Gibba/LRC upgrade is out of scope for this We will still need to promote files to the release location and build production containers. On Wed, Jul 3, 2024 at 12:53 PM Yuri Weinstein wrote: > > Dev leads concluded that we have reached the approval level needed for > the RC0 an will start release process > > On Wed, Jul 3, 2024 at 10:11 AM Guillaume ABRIOUX wrote: > > > > Hi Yuri, > > > > ceph-volume approved - > > https://pulpito.ceph.com/gabrioux-2024-07-03_14:50:01-orch:cephadm-squid-release-distro-default-smithi/ > > (the few failures are known issues) > > > > Thanks! > > > > -- > > Guillaume Abrioux > > Software Engineer > > > > From: Yuri Weinstein > > Sent: 01 July 2024 16:22 > > To: dev ; ceph-users > > Subject: [EXTERNAL] [ceph-users] squid 19.1.0 RC QE validation status > > > > Details of this release are summarized here: > > > > https://tracker.ceph.com/issues/66756#note-1 > > > > Release Notes - TBD > > LRC upgrade - TBD > > > > (Reruns were not done yet.) > > > > Seeking approvals/reviews for: > > > > smoke > > rados - Radek, Laura > > rgw- Casey > > fs - Venky > > orch - Adam King > > rbd, krbd - Ilya > > quincy-x, reef-x - Laura, Neha > > powercycle - Brad > > perf-basic - Yaarit, Laura > > crimson-rados - Samuel > > ceph-volume - Guillaume > > > > Pls let me know if any tests were missed from this list. > > ___ > > ceph-users mailing list -- ceph-users@ceph.io > > To unsubscribe send an email to ceph-users-le...@ceph.io > > Unless otherwise stated above: > > > > Compagnie IBM France > > Siège Social : 17, avenue de l'Europe, 92275 Bois-Colombes Cedex > > RCS Nanterre 552 118 465 > > Forme Sociale : S.A.S. > > Capital Social : 664 069 390,60 € > > SIRET : 552 118 465 03644 - Code NAF 6203Z ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: squid 19.1.0 RC QE validation status
Dev leads concluded that we have reached the approval level needed for the RC0 an will start release process On Wed, Jul 3, 2024 at 10:11 AM Guillaume ABRIOUX wrote: > > Hi Yuri, > > ceph-volume approved - > https://pulpito.ceph.com/gabrioux-2024-07-03_14:50:01-orch:cephadm-squid-release-distro-default-smithi/ > (the few failures are known issues) > > Thanks! > > -- > Guillaume Abrioux > Software Engineer > ____ > From: Yuri Weinstein > Sent: 01 July 2024 16:22 > To: dev ; ceph-users > Subject: [EXTERNAL] [ceph-users] squid 19.1.0 RC QE validation status > > Details of this release are summarized here: > > https://tracker.ceph.com/issues/66756#note-1 > > Release Notes - TBD > LRC upgrade - TBD > > (Reruns were not done yet.) > > Seeking approvals/reviews for: > > smoke > rados - Radek, Laura > rgw- Casey > fs - Venky > orch - Adam King > rbd, krbd - Ilya > quincy-x, reef-x - Laura, Neha > powercycle - Brad > perf-basic - Yaarit, Laura > crimson-rados - Samuel > ceph-volume - Guillaume > > Pls let me know if any tests were missed from this list. > ___ > ceph-users mailing list -- ceph-users@ceph.io > To unsubscribe send an email to ceph-users-le...@ceph.io > Unless otherwise stated above: > > Compagnie IBM France > Siège Social : 17, avenue de l'Europe, 92275 Bois-Colombes Cedex > RCS Nanterre 552 118 465 > Forme Sociale : S.A.S. > Capital Social : 664 069 390,60 € > SIRET : 552 118 465 03644 - Code NAF 6203Z ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: squid 19.1.0 RC QE validation status
Status updated => https://tracker.ceph.com/issues/66756#note-1 Still seeking approvals: smoke - n/a? orch - Adam King krbd - Ilya quincy-x, reef-x - Laura, Neha perf-basic - n/a crimson-rados - n/a ceph-volume - Guillaume Neha, Laura - I assume we don't plan gibba/LRC upgrade, pls confirm On Wed, Jul 3, 2024 at 5:55 AM Venky Shankar wrote: > > Hi Yuri, > > On Mon, Jul 1, 2024 at 7:53 PM Yuri Weinstein wrote: > > > > Details of this release are summarized here: > > > > https://tracker.ceph.com/issues/66756#note-1 > > > > Release Notes - TBD > > LRC upgrade - TBD > > > > (Reruns were not done yet.) > > > > Seeking approvals/reviews for: > > > > smoke > > rados - Radek, Laura > > rgw- Casey > > fs - Venky > > fs approved. Failures are: > https://tracker.ceph.com/projects/cephfs/wiki/Squid#Squid-release-rc-1910 > > > orch - Adam King > > rbd, krbd - Ilya > > quincy-x, reef-x - Laura, Neha > > powercycle - Brad > > perf-basic - Yaarit, Laura > > crimson-rados - Samuel > > ceph-volume - Guillaume > > > > Pls let me know if any tests were missed from this list. > > ___ > > ceph-users mailing list -- ceph-users@ceph.io > > To unsubscribe send an email to ceph-users-le...@ceph.io > > > > > -- > Cheers, > Venky > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: reef 18.2.3 QE validation status
After fixing the issues identified below we cherry-picked all PRs from this list for 18.2.3 https://pad.ceph.com/p/release-cherry-pick-coordination. The question to the dev leads: do you think we can proceed with the release without rerunning suites, as they were already approved? Please reply with your recommendations. On Thu, Jun 6, 2024 at 4:59 PM Yuri Weinstein wrote: > Please see the update from Laura below for the status of this release. > > Dev Leads help is appreciated to expedite fixes necessary to publish it > soon. > > "Hi all, we have hit another blocker with this release. > > Due to centos 8 stream going end of life, we only have the option of > releasing centos 9 stream containers. > > However, we did not test the efficacy of centos 9 stream containers > against the orch and upgrade suites during the initial 18.2.3 release cycle. > > This problem is tracked here: https://tracker.ceph.com/issues/66334 > > What needs to happen now is: > > 1. The orch team needs to fix all references to centos 8 stream in the > orch suite > 2. fs, rados, etc. need to fix their relative jobs the same way in the > upgrade suite > > The easiest way to tackle that is to raise a PR against main and backport > to stable releases since this problem actually affects main and all other > releases. > > Then, we will: > > 1. Rerun orch and upgrade with these fixes > 2. Re-approve orch and upgrade > 3. Re-upgrade gibba and LRC > > Then the release will be unblocked." > > On Tue, Jun 4, 2024 at 3:26 PM Laura Flores wrote: > >> Rados results were approved, and we successfully upgraded the gibba >> cluster. >> >> Now waiting on @Dan Mick to upgrade the LRC. >> >> On Thu, May 30, 2024 at 8:32 PM Yuri Weinstein >> wrote: >> >>> I reran rados on the fix https://github.com/ceph/ceph/pull/57794/commits >>> and seeking approvals from Radek and Laure >>> >>> https://tracker.ceph.com/issues/65393#note-1 >>> >>> On Tue, May 28, 2024 at 2:12 PM Yuri Weinstein >>> wrote: >>> > >>> > We have discovered some issues (#1 and #2) during the final stages of >>> > testing that require considering a delay in this point release until >>> > all options and risks are assessed and resolved. >>> > >>> > We will keep you all updated on the progress. >>> > >>> > Thank you for your patience! >>> > >>> > #1 https://tracker.ceph.com/issues/66260 >>> > #2 https://tracker.ceph.com/issues/61948#note-21 >>> > >>> > On Wed, May 1, 2024 at 3:41 PM Yuri Weinstein >>> wrote: >>> > > >>> > > We've run into a problem during the last verification steps before >>> > > publishing this release after upgrading the LRC to it => >>> > > https://tracker.ceph.com/issues/65733 >>> > > >>> > > After this issue is resolved, we will continue testing and publishing >>> > > this point release. >>> > > >>> > > Thanks for your patience! >>> > > >>> > > On Thu, Apr 18, 2024 at 11:29 PM Christian Rohmann >>> > > wrote: >>> > > > >>> > > > On 18.04.24 8:13 PM, Laura Flores wrote: >>> > > > > Thanks for bringing this to our attention. The leads have >>> decided that >>> > > > > since this PR hasn't been merged to main yet and isn't approved, >>> it >>> > > > > will not go in v18.2.3, but it will be prioritized for v18.2.4. >>> > > > > I've already added the PR to the v18.2.4 milestone so it's sure >>> to be >>> > > > > picked up. >>> > > > >>> > > > Thanks a bunch. If you miss the train, you miss the train - fair >>> enough. >>> > > > Nice to know there is another one going soon and that bug is going >>> to be >>> > > > on it ! >>> > > > >>> > > > >>> > > > Regards >>> > > > >>> > > > Christian >>> > > > ___ >>> > > > ceph-users mailing list -- ceph-users@ceph.io >>> > > > To unsubscribe send an email to ceph-users-le...@ceph.io >>> > > > >>> ___ >>> ceph-users mailing list -- ceph-users@ceph.io >>> To unsubscribe send an email to ceph-users-le...@ceph.io >>> >> >> >> -- >> >> Laura Flores >> >> She/Her/Hers >> >> Software Engineer, Ceph Storage <https://ceph.io> >> >> Chicago, IL >> >> lflo...@ibm.com | lflo...@redhat.com >> M: +17087388804 >> >> >> ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] squid 19.1.0 RC QE validation status
Details of this release are summarized here: https://tracker.ceph.com/issues/66756#note-1 Release Notes - TBD LRC upgrade - TBD (Reruns were not done yet.) Seeking approvals/reviews for: smoke rados - Radek, Laura rgw- Casey fs - Venky orch - Adam King rbd, krbd - Ilya quincy-x, reef-x - Laura, Neha powercycle - Brad perf-basic - Yaarit, Laura crimson-rados - Samuel ceph-volume - Guillaume Pls let me know if any tests were missed from this list. ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: reef 18.2.3 QE validation status
Please see the update from Laura below for the status of this release. Dev Leads help is appreciated to expedite fixes necessary to publish it soon. "Hi all, we have hit another blocker with this release. Due to centos 8 stream going end of life, we only have the option of releasing centos 9 stream containers. However, we did not test the efficacy of centos 9 stream containers against the orch and upgrade suites during the initial 18.2.3 release cycle. This problem is tracked here: https://tracker.ceph.com/issues/66334 What needs to happen now is: 1. The orch team needs to fix all references to centos 8 stream in the orch suite 2. fs, rados, etc. need to fix their relative jobs the same way in the upgrade suite The easiest way to tackle that is to raise a PR against main and backport to stable releases since this problem actually affects main and all other releases. Then, we will: 1. Rerun orch and upgrade with these fixes 2. Re-approve orch and upgrade 3. Re-upgrade gibba and LRC Then the release will be unblocked." On Tue, Jun 4, 2024 at 3:26 PM Laura Flores wrote: > Rados results were approved, and we successfully upgraded the gibba > cluster. > > Now waiting on @Dan Mick to upgrade the LRC. > > On Thu, May 30, 2024 at 8:32 PM Yuri Weinstein > wrote: > >> I reran rados on the fix https://github.com/ceph/ceph/pull/57794/commits >> and seeking approvals from Radek and Laure >> >> https://tracker.ceph.com/issues/65393#note-1 >> >> On Tue, May 28, 2024 at 2:12 PM Yuri Weinstein >> wrote: >> > >> > We have discovered some issues (#1 and #2) during the final stages of >> > testing that require considering a delay in this point release until >> > all options and risks are assessed and resolved. >> > >> > We will keep you all updated on the progress. >> > >> > Thank you for your patience! >> > >> > #1 https://tracker.ceph.com/issues/66260 >> > #2 https://tracker.ceph.com/issues/61948#note-21 >> > >> > On Wed, May 1, 2024 at 3:41 PM Yuri Weinstein >> wrote: >> > > >> > > We've run into a problem during the last verification steps before >> > > publishing this release after upgrading the LRC to it => >> > > https://tracker.ceph.com/issues/65733 >> > > >> > > After this issue is resolved, we will continue testing and publishing >> > > this point release. >> > > >> > > Thanks for your patience! >> > > >> > > On Thu, Apr 18, 2024 at 11:29 PM Christian Rohmann >> > > wrote: >> > > > >> > > > On 18.04.24 8:13 PM, Laura Flores wrote: >> > > > > Thanks for bringing this to our attention. The leads have decided >> that >> > > > > since this PR hasn't been merged to main yet and isn't approved, >> it >> > > > > will not go in v18.2.3, but it will be prioritized for v18.2.4. >> > > > > I've already added the PR to the v18.2.4 milestone so it's sure >> to be >> > > > > picked up. >> > > > >> > > > Thanks a bunch. If you miss the train, you miss the train - fair >> enough. >> > > > Nice to know there is another one going soon and that bug is going >> to be >> > > > on it ! >> > > > >> > > > >> > > > Regards >> > > > >> > > > Christian >> > > > ___ >> > > > ceph-users mailing list -- ceph-users@ceph.io >> > > > To unsubscribe send an email to ceph-users-le...@ceph.io >> > > > >> ___ >> ceph-users mailing list -- ceph-users@ceph.io >> To unsubscribe send an email to ceph-users-le...@ceph.io >> > > > -- > > Laura Flores > > She/Her/Hers > > Software Engineer, Ceph Storage <https://ceph.io> > > Chicago, IL > > lflo...@ibm.com | lflo...@redhat.com > M: +17087388804 > > > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: reef 18.2.3 QE validation status
I reran rados on the fix https://github.com/ceph/ceph/pull/57794/commits and seeking approvals from Radek and Laure https://tracker.ceph.com/issues/65393#note-1 On Tue, May 28, 2024 at 2:12 PM Yuri Weinstein wrote: > > We have discovered some issues (#1 and #2) during the final stages of > testing that require considering a delay in this point release until > all options and risks are assessed and resolved. > > We will keep you all updated on the progress. > > Thank you for your patience! > > #1 https://tracker.ceph.com/issues/66260 > #2 https://tracker.ceph.com/issues/61948#note-21 > > On Wed, May 1, 2024 at 3:41 PM Yuri Weinstein wrote: > > > > We've run into a problem during the last verification steps before > > publishing this release after upgrading the LRC to it => > > https://tracker.ceph.com/issues/65733 > > > > After this issue is resolved, we will continue testing and publishing > > this point release. > > > > Thanks for your patience! > > > > On Thu, Apr 18, 2024 at 11:29 PM Christian Rohmann > > wrote: > > > > > > On 18.04.24 8:13 PM, Laura Flores wrote: > > > > Thanks for bringing this to our attention. The leads have decided that > > > > since this PR hasn't been merged to main yet and isn't approved, it > > > > will not go in v18.2.3, but it will be prioritized for v18.2.4. > > > > I've already added the PR to the v18.2.4 milestone so it's sure to be > > > > picked up. > > > > > > Thanks a bunch. If you miss the train, you miss the train - fair enough. > > > Nice to know there is another one going soon and that bug is going to be > > > on it ! > > > > > > > > > Regards > > > > > > Christian > > > ___ > > > ceph-users mailing list -- ceph-users@ceph.io > > > To unsubscribe send an email to ceph-users-le...@ceph.io > > > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: reef 18.2.3 QE validation status
We have discovered some issues (#1 and #2) during the final stages of testing that require considering a delay in this point release until all options and risks are assessed and resolved. We will keep you all updated on the progress. Thank you for your patience! #1 https://tracker.ceph.com/issues/66260 #2 https://tracker.ceph.com/issues/61948#note-21 On Wed, May 1, 2024 at 3:41 PM Yuri Weinstein wrote: > > We've run into a problem during the last verification steps before > publishing this release after upgrading the LRC to it => > https://tracker.ceph.com/issues/65733 > > After this issue is resolved, we will continue testing and publishing > this point release. > > Thanks for your patience! > > On Thu, Apr 18, 2024 at 11:29 PM Christian Rohmann > wrote: > > > > On 18.04.24 8:13 PM, Laura Flores wrote: > > > Thanks for bringing this to our attention. The leads have decided that > > > since this PR hasn't been merged to main yet and isn't approved, it > > > will not go in v18.2.3, but it will be prioritized for v18.2.4. > > > I've already added the PR to the v18.2.4 milestone so it's sure to be > > > picked up. > > > > Thanks a bunch. If you miss the train, you miss the train - fair enough. > > Nice to know there is another one going soon and that bug is going to be > > on it ! > > > > > > Regards > > > > Christian > > ___ > > ceph-users mailing list -- ceph-users@ceph.io > > To unsubscribe send an email to ceph-users-le...@ceph.io > > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: Status of 18.2.3
We are still working on the last-minute fixes, see this for details https://ceph-storage.slack.com/archives/C054Q1NUBQT/p1711041666180929 Regards YuriW On Thu, May 23, 2024 at 6:22 AM Sake Ceph wrote: > > I was wondering what happened to the release of 18.2.3? Validation started on > April 13th and as far as I know there have been a couple of builds and some > extra bug fixes. Is there a way to follow a release or what is holding it > back? > > Normally I wouldn't ask about a release and just wait, but I really need some > fixes of this release. > > Kind regards, > Sake > ___ > ceph-users mailing list -- ceph-users@ceph.io > To unsubscribe send an email to ceph-users-le...@ceph.io > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: reef 18.2.3 QE validation status
We've run into a problem during the last verification steps before publishing this release after upgrading the LRC to it => https://tracker.ceph.com/issues/65733 After this issue is resolved, we will continue testing and publishing this point release. Thanks for your patience! On Thu, Apr 18, 2024 at 11:29 PM Christian Rohmann wrote: > > On 18.04.24 8:13 PM, Laura Flores wrote: > > Thanks for bringing this to our attention. The leads have decided that > > since this PR hasn't been merged to main yet and isn't approved, it > > will not go in v18.2.3, but it will be prioritized for v18.2.4. > > I've already added the PR to the v18.2.4 milestone so it's sure to be > > picked up. > > Thanks a bunch. If you miss the train, you miss the train - fair enough. > Nice to know there is another one going soon and that bug is going to be > on it ! > > > Regards > > Christian > ___ > ceph-users mailing list -- ceph-users@ceph.io > To unsubscribe send an email to ceph-users-le...@ceph.io > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: reef 18.2.3 QE validation status
And approval is needed for: fs - Venky approved? powercycle - seems fs related, Venky, Brad PTL On Mon, Apr 15, 2024 at 5:55 PM Yuri Weinstein wrote: > > Still waiting for approvals: > > rados - Radek, Laura approved? Travis? Nizamudeen? > > ceph-volume issue was fixed by https://github.com/ceph/ceph/pull/56857 > > We plan not to upgrade the LRC to 18.2.3 as we are very close to the > first squid RC and will be using it for this purpose. > Please speak up if this may present any issues. > > Thx > > On Fri, Apr 12, 2024 at 11:37 AM Yuri Weinstein wrote: > > > > Details of this release are summarized here: > > > > https://tracker.ceph.com/issues/65393#note-1 > > Release Notes - TBD > > LRC upgrade - TBD > > > > Seeking approvals/reviews for: > > > > smoke - infra issues, still trying, Laura PTL > > > > rados - Radek, Laura approved? Travis? Nizamudeen? > > > > rgw - Casey approved? > > fs - Venky approved? > > orch - Adam King approved? > > > > krbd - Ilya approved > > powercycle - seems fs related, Venky, Brad PTL > > > > ceph-volume - will require > > https://github.com/ceph/ceph/pull/56857/commits/63fe3921638f1fb7fc065907a9e1a64700f8a600 > > Guillaume is fixing it. > > > > TIA ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: reef 18.2.3 QE validation status
Still waiting for approvals: rados - Radek, Laura approved? Travis? Nizamudeen? ceph-volume issue was fixed by https://github.com/ceph/ceph/pull/56857 We plan not to upgrade the LRC to 18.2.3 as we are very close to the first squid RC and will be using it for this purpose. Please speak up if this may present any issues. Thx On Fri, Apr 12, 2024 at 11:37 AM Yuri Weinstein wrote: > > Details of this release are summarized here: > > https://tracker.ceph.com/issues/65393#note-1 > Release Notes - TBD > LRC upgrade - TBD > > Seeking approvals/reviews for: > > smoke - infra issues, still trying, Laura PTL > > rados - Radek, Laura approved? Travis? Nizamudeen? > > rgw - Casey approved? > fs - Venky approved? > orch - Adam King approved? > > krbd - Ilya approved > powercycle - seems fs related, Venky, Brad PTL > > ceph-volume - will require > https://github.com/ceph/ceph/pull/56857/commits/63fe3921638f1fb7fc065907a9e1a64700f8a600 > Guillaume is fixing it. > > TIA ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] reef 18.2.3 QE validation status
Details of this release are summarized here: https://tracker.ceph.com/issues/65393#note-1 Release Notes - TBD LRC upgrade - TBD Seeking approvals/reviews for: smoke - infra issues, still trying, Laura PTL rados - Radek, Laura approved? Travis? Nizamudeen? rgw - Casey approved? fs - Venky approved? orch - Adam King approved? krbd - Ilya approved powercycle - seems fs related, Venky, Brad PTL ceph-volume - will require https://github.com/ceph/ceph/pull/56857/commits/63fe3921638f1fb7fc065907a9e1a64700f8a600 Guillaume is fixing it. TIA ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] v18.2.2 Reef (hot-fix) released
We're happy to announce the 2nd hotfix release in the Reef series. We recommend users to update to this release. For detailed release notes with links & changelog please refer to the official blog entry at https://ceph.io/en/news/blog/2024/v18-2-2-reef-released/ Notable Changes --- * mgr/Prometheus: refine the orchestrator availability check to prevent against crashes in the prometheus module during startup. Introduce additional checks to handle daemon_ids generated within the Rook environment, thus preventing potential issues during RGW metrics metadata generation. Related tracker: https://tracker.ceph.com/issues/64721 Getting Ceph * Git at git://github.com/ceph/ceph.git * Tarball at https://download.ceph.com/tarballs/ceph_18.2.2.orig.tar.gz * Containers at https://quay.io/repository/ceph/ceph * For packages, see https://docs.ceph.com/en/latest/install/get-packages/ * Release git sha1: 531c0d11a1c5d39fbfe6aa8a521f023abf3bf3e2 ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: reef 18.2.2 (hot-fix) QE validation status
Only suits below need approval: smoke - Radek, Laura? rados - Radek, Laura? We are also in the process of upgrading gibba and then LRC into 18.2.2 RC On Tue, Mar 5, 2024 at 7:47 AM Yuri Weinstein wrote: > > Details of this release are summarized here: > > https://tracker.ceph.com/issues/64721#note-1 > Release Notes - TBD > LRC upgrade - TBD > > Seeking approvals/reviews for: > > smoke - in progress > rados - Radek, Laura? > quincy-x - in progress > > Also need approval from Travis, Redouane for Prometheus fix testing. ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] reef 18.2.2 (hot-fix) QE validation status
Details of this release are summarized here: https://tracker.ceph.com/issues/64721#note-1 Release Notes - TBD LRC upgrade - TBD Seeking approvals/reviews for: smoke - in progress rados - Radek, Laura? quincy-x - in progress Also need approval from Travis, Redouane for Prometheus fix testing. ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] v16.2.15 Pacific released
We're happy to announce the 15th, and expected to be the last, backport release in the Pacific series. https://ceph.io/en/news/blog/2024/v16-2-15-pacific-released/ Notable Changes --- * `ceph config dump --format ` output will display the localized option names instead of their normalized version. For example, "mgr/prometheus/x/server_port" will be displayed instead of "mgr/prometheus/server_port". This matches the output of the non pretty-print formatted version of the command. * CephFS: MDS evicts clients who are not advancing their request tids, which causes a large buildup of session metadata, resulting in the MDS going read-only due to the RADOS operation exceeding the size threshold. The `mds_session_metadata_threshold` config controls the maximum size that an (encoded) session metadata can grow. * RADOS: The `get_pool_is_selfmanaged_snaps_mode` C++ API has been deprecated due to its susceptibility to false negative results. Its safer replacement is `pool_is_in_selfmanaged_snaps_mode`. * RBD: When diffing against the beginning of time (`fromsnapname == NULL`) in fast-diff mode (`whole_object == true` with `fast-diff` image feature enabled and valid), diff-iterate is now guaranteed to execute locally if exclusive lock is available. This brings a dramatic performance improvement for QEMU live disk synchronization and backup use cases. Getting Ceph * Git at git://github.com/ceph/ceph.git * Tarball at https://download.ceph.com/tarballs/ceph-16.2.15.tar.gz * Containers at https://quay.io/repository/ceph/ceph * For packages, see https://docs.ceph.com/en/latest/install/get-packages/ * Release git sha1: 618f440892089921c3e944a991122ddc44e60516 ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: pacific 16.2.15 QE validation status
Thank you all! We want to merge the PR with whitelisting added https://github.com/ceph/ceph/pull/55717 and will start the 16.2.15 build/release afterward. On Mon, Feb 26, 2024 at 8:25 AM Laura Flores wrote: > Thank you Junior for your thorough review of the RADOS suite. Aside from a > few remaining warnings in the final run that could benefit from > whitelisting, these are not blockers. > > Rados-approved. > > On Mon, Feb 26, 2024 at 9:29 AM Kamoltat Sirivadhna > wrote: > >> details of RADOS run analysis: >> >> yuriw-2024-02-19_19:25:49-rados-pacific-release-distro-default-smithi >> < >> https://pulpito.ceph.com/yuriw-2024-02-19_19:25:49-rados-pacific-release-distro-default-smithi/#collapseOne >> > >> >> >> >>1. https://tracker.ceph.com/issues/64455 task/test_orch_cli: Health >>check failed: cephadm background work is paused (CEPHADM_PAUSED)" in >>cluster log (White list) >>2. https://tracker.ceph.com/issues/64454 >> rados/cephadm/mgr-nfs-upgrade: >>Health check failed: 1 stray daemon(s) not managed by cephadm >>(CEPHADM_STRAY_DAEMON)" in cluster log (whitelist) >>3. https://tracker.ceph.com/issues/63887: Starting alertmanager fails >>from missing container (happens in Pacific) >>4. Failed to reconnect to smithi155 [7566763 >>< >> https://pulpito.ceph.com/yuriw-2024-02-19_19:25:49-rados-pacific-release-distro-default-smithi/7566763 >> > >>] >>5. https://tracker.ceph.com/issues/64278 Unable to update caps for >>client.iscsi.iscsi.a (known failures) >>6. https://tracker.ceph.com/issues/64452 Teuthology runs into >>"TypeError: expected string or bytes-like object" during log scraping >>(teuthology failure) >>7. https://tracker.ceph.com/issues/64343 Expected warnings that need >> to >>be whitelisted cause rados/cephadm tests to fail for 7566717 >>< >> https://pulpito.ceph.com/yuriw-2024-02-19_19:25:49-rados-pacific-release-distro-default-smithi/7566717 >> > >>we neeed to add (ERR|WRN|SEC) >>8. https://tracker.ceph.com/issues/58145 orch/cephadm: nfs tests >> failing >>to mount exports (mount -t nfs 10.0.31.120:/fake /mnt/foo' fails) >>7566724 (resolved issue re-opened) >>9. https://tracker.ceph.com/issues/63577 cephadm: >>docker.io/library/haproxy: toomanyrequests: You have reached your pull >>rate limit. >>10. https://tracker.ceph.com/issues/54071 rdos/cephadm/osds: Invalid >>command: missing required parameter hostname() 756674 >>< >> https://pulpito.ceph.com/yuriw-2024-02-19_19:25:49-rados-pacific-release-distro-default-smithi/7566747 >> > >> >> >> Note: >> >>1. Although 7566762 seems like a different failure from what is >>displayed in pulpito, in the teuth log it failed because of >>https://tracker.ceph.com/issues/64278. >>2. rados/cephadm/thrash/ … failed a lot because of >>https://tracker.ceph.com/issues/64452 >>3. 7566717 >>< >> https://pulpito.ceph.com/yuriw-2024-02-19_19:25:49-rados-pacific-release-distro-default-smithi/7566717 >> >. >>failed because we didn’t whitelist (ERR|WRN|SEC) >> :tasks.cephadm:Checking >>cluster log for badness... >>4. 7566724 https://tracker.ceph.com/issues/58145 ganesha seems >> resolved >>1 year ago, but popped up again so re-opened tracker and ping Adam King >>(resolved) >> >> 7566777, 7566781, 7566796 are due to >> https://tracker.ceph.com/issues/63577 >> >> >> >> White List and re-ran: >> >> yuriw-2024-02-22_21:39:39-rados-pacific-release-distro-default-smithi/ >> < >> https://pulpito.ceph.com/yuriw-2024-02-22_21:39:39-rados-pacific-release-distro-default-smithi/ >> > >> >> rados/cephadm/mds_upgrade_sequence/ —> failed to shutdown mon (known >> failure discussed with A.King) >> >> rados/cephadm/mgr-nfs-upgrade —> failed to shutdown mon (known failure >> discussed with A.King) >> >> rados/cephadm/osds —> zap disk error (known failure) >> >> rados/cephadm/smoke-roleless —> toomanyrequests: You have reached your >> pull rate limit. https://www.docker.com/increase-rate-limit. (known >> failures) >> >> rados/cephadm/thrash —> Just needs to whitelist (CACHE_POOL_NEAR_FULL) >> (known failures) >> >> rados/cephadm/upgrade —> CEPHADM_FAILED_DAEMON (WRN) node-exporter >> (known >> failure discussed with A.King) >> >
[ceph-users] Re: pacific 16.2.15 QE validation status
Still seeking approvals: rados - Radek, Junior, Travis, Adam King All other product areas have been approved and are ready for the release step. Pls also review the Release Notes: https://github.com/ceph/ceph/pull/55694 On Tue, Feb 20, 2024 at 7:58 AM Yuri Weinstein wrote: > > We have restarted QE validation after fixing issues and merging several PRs. > The new Build 3 (rebase of pacific) tests are summarized in the same > note (see Build 3 runs) https://tracker.ceph.com/issues/64151#note-1 > > Seeking approvals: > > rados - Radek, Junior, Travis, Ernesto, Adam King > rgw - Casey > fs - Venky > rbd - Ilya > krbd - Ilya > > upgrade/octopus-x (pacific) - Adam King, Casey PTL > > upgrade/pacific-p2p - Casey PTL > > ceph-volume - Guillaume, fixed by > https://github.com/ceph/ceph/pull/55658 retesting > > On Thu, Feb 8, 2024 at 8:43 AM Casey Bodley wrote: > > > > thanks, i've created https://tracker.ceph.com/issues/64360 to track > > these backports to pacific/quincy/reef > > > > On Thu, Feb 8, 2024 at 7:50 AM Stefan Kooman wrote: > > > > > > Hi, > > > > > > Is this PR: https://github.com/ceph/ceph/pull/54918 included as well? > > > > > > You definitely want to build the Ubuntu / debian packages with the > > > proper CMAKE_CXX_FLAGS. The performance impact on RocksDB is _HUGE_. > > > > > > Thanks, > > > > > > Gr. Stefan > > > > > > P.s. Kudos to Mark Nelson for figuring it out / testing. > > > ___ > > > ceph-users mailing list -- ceph-users@ceph.io > > > To unsubscribe send an email to ceph-users-le...@ceph.io > > > > > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: pacific 16.2.15 QE validation status
We have restarted QE validation after fixing issues and merging several PRs. The new Build 3 (rebase of pacific) tests are summarized in the same note (see Build 3 runs) https://tracker.ceph.com/issues/64151#note-1 Seeking approvals: rados - Radek, Junior, Travis, Ernesto, Adam King rgw - Casey fs - Venky rbd - Ilya krbd - Ilya upgrade/octopus-x (pacific) - Adam King, Casey PTL upgrade/pacific-p2p - Casey PTL ceph-volume - Guillaume, fixed by https://github.com/ceph/ceph/pull/55658 retesting On Thu, Feb 8, 2024 at 8:43 AM Casey Bodley wrote: > > thanks, i've created https://tracker.ceph.com/issues/64360 to track > these backports to pacific/quincy/reef > > On Thu, Feb 8, 2024 at 7:50 AM Stefan Kooman wrote: > > > > Hi, > > > > Is this PR: https://github.com/ceph/ceph/pull/54918 included as well? > > > > You definitely want to build the Ubuntu / debian packages with the > > proper CMAKE_CXX_FLAGS. The performance impact on RocksDB is _HUGE_. > > > > Thanks, > > > > Gr. Stefan > > > > P.s. Kudos to Mark Nelson for figuring it out / testing. > > ___ > > ceph-users mailing list -- ceph-users@ceph.io > > To unsubscribe send an email to ceph-users-le...@ceph.io > > > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: pacific 16.2.15 QE validation status
We are still working through the remaining issues and will do a full cycle of testing soon. Adam, the issues mentioned by Ilya below require some response and resolution, pls take a look > rbd looks good overall but we are missing iSCSI coverage due to > https://tracker.ceph.com/issues/64126 On Wed, Jan 31, 2024 at 6:40 AM Ilya Dryomov wrote: > > On Tue, Jan 30, 2024 at 9:24 PM Yuri Weinstein wrote: > > > > Update. > > Seeking approvals/reviews for: > > > > rados - Radek, Laura, Travis, Ernesto, Adam King > > rgw - Casey > > fs - Venky > > rbd - Ilya > > Hi Yuri, > > rbd looks good overall but we are missing iSCSI coverage due to > https://tracker.ceph.com/issues/64126: > > https://pulpito.ceph.com/yuriw-2024-01-25_17:27:10-rbd-pacific-release-distro-default-smithi/7532167 > https://pulpito.ceph.com/yuriw-2024-01-26_17:05:20-rbd-pacific-release-distro-default-smithi/7535193 > > Adam, did you get a chance to look into it? > > > krbd - Ilya > > Please do another rerun for krbd -- I want to see one of those > remaining jobs pass. > > Thanks, > > Ilya > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: pacific 16.2.15 QE validation status
Update. Seeking approvals/reviews for: rados - Radek, Laura, Travis, Adam King (see Laura's comments below) rgw - Casey approved fs - Venky approved rbd - Ilya krbd - Ilya upgrade/nautilus-x (pacific) - fixed by Casey upgrade/octopus-x (pacific) - Adam King is looking https://tracker.ceph.com/issues/64279 upgrade/pacific-x (quincy) - blocked by https://tracker.ceph.com/issues/64256 (Laura, Dan, Adam pls take a look) upgrade/pacific-p2p - Ilya PTL (maybe rbd related?) ceph-volume - Guillaume is fixing https://tracker.ceph.com/issues/64248 https://github.com/ceph/ceph/pull/55376 In addition to all these issues, we are considering adding a fix for https://tracker.ceph.com/issues/63425 (https://github.com/ceph/ceph/pull/54312). Adam King and Ilya are looking into this. ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: pacific 16.2.15 QE validation status
Update. Seeking approvals/reviews for: rados - Radek, Laura, Travis, Ernesto, Adam King rgw - Casey fs - Venky rbd - Ilya krbd - Ilya upgrade/nautilus-x (pacific) - Casey PTL (regweed tests failed) upgrade/octopus-x (pacific) - Casey PTL (regweed tests failed) upgrade/pacific-x (quincy) - blocked by https://tracker.ceph.com/issues/64256 (Laura, Dan, Adam pls take a look) upgrade/pacific-p2p - Ilya PTL (maybe rbd related?) ceph-volume - Guillaume is fixing On Mon, Jan 29, 2024 at 1:38 PM Yuri Weinstein wrote: > > Details of this release are summarized here: > > https://tracker.ceph.com/issues/64151#note-1 > > Seeking approvals/reviews for: > > rados - Radek, Laura, Travis, Ernesto, Adam King > rgw - Casey > fs - Venky > rbd - Ilya > krbd - in progress > > upgrade/nautilus-x (pacific) - Casey PTL (regweed tests failed) > upgrade/octopus-x (pacific) - Casey PTL (regweed tests failed) > > upgrade/pacific-x (quincy) - in progress > upgrade/pacific-p2p - Ilya PTL (maybe rbd related?) > > ceph-volume - Guillaume > > TIA > YuriW ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] pacific 16.2.15 QE validation status
Details of this release are summarized here: https://tracker.ceph.com/issues/64151#note-1 Seeking approvals/reviews for: rados - Radek, Laura, Travis, Ernesto, Adam King rgw - Casey fs - Venky rbd - Ilya krbd - in progress upgrade/nautilus-x (pacific) - Casey PTL (regweed tests failed) upgrade/octopus-x (pacific) - Casey PTL (regweed tests failed) upgrade/pacific-x (quincy) - in progress upgrade/pacific-p2p - Ilya PTL (maybe rbd related?) ceph-volume - Guillaume TIA YuriW ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] v18.2.1 Reef released
We're happy to announce the 1st backport release in the Reef series. This is the first backport release in the Reef series, and the first with Debian packages, for Debian Bookworm. We recommend all users update to this release. https://ceph.io/en/news/blog/2023/v18-2-1-reef-released/ Notable Changes --- * RGW: S3 multipart uploads using Server-Side Encryption now replicate correctly in multi-site. Previously, the replicas of such objects were corrupted on decryption. A new tool, ``radosgw-admin bucket resync encrypted multipart``, can be used to identify these original multipart uploads. The ``LastModified`` timestamp of any identified object is incremented by 1ns to cause peer zones to replicate it again. For multi-site deployments that make any use of Server-Side Encryption, we recommended running this command against every bucket in every zone after all zones have upgraded. * CEPHFS: MDS evicts clients which are not advancing their request tids which causes a large buildup of session metadata resulting in the MDS going read-only due to the RADOS operation exceeding the size threshold. `mds_session_metadata_threshold` config controls the maximum size that a (encoded) session metadata can grow. * RGW: New tools have been added to radosgw-admin for identifying and correcting issues with versioned bucket indexes. Historical bugs with the versioned bucket index transaction workflow made it possible for the index to accumulate extraneous "book-keeping" olh entries and plain placeholder entries. In some specific scenarios where clients made concurrent requests referencing the same object key, it was likely that a lot of extra index entries would accumulate. When a significant number of these entries are present in a single bucket index shard, they can cause high bucket listing latencies and lifecycle processing failures. To check whether a versioned bucket has unnecessary olh entries, users can now run ``radosgw-admin bucket check olh``. If the ``--fix`` flag is used, the extra entries will be safely removed. A distinct issue from the one described thus far, it is also possible that some versioned buckets are maintaining extra unlinked objects that are not listable from the S3/ Swift APIs. These extra objects are typically a result of PUT requests that exited abnormally, in the middle of a bucket index transaction - so the client would not have received a successful response. Bugs in prior releases made these unlinked objects easy to reproduce with any PUT request that was made on a bucket that was actively resharding. Besides the extra space that these hidden, unlinked objects consume, there can be another side effect in certain scenarios, caused by the nature of the failure mode that produced them, where a client of a bucket that was a victim of this bug may find the object associated with the key to7fe91d5d5842e04be3b4f514d6dd990c54b29c76 be in an inconsistent state. To check whether a versioned bucket has unlinked entries, users can now run ``radosgw-admin bucket check unlinked``. If the ``--fix`` flag is used, the unlinked objects will be safely removed. Finally, a third issue made it possible for versioned bucket index stats to be accounted inaccurately. The tooling for recalculating versioned bucket stats also had a bug, and was not previously capable of fixing these inaccuracies. This release resolves those issues and users can now expect that the existing ``radosgw-admin bucket check`` command will produce correct results. We recommend that users with versioned buckets, especially those that existed on prior releases, use these new tools to check whether their buckets are affected and to clean them up accordingly. * mgr/snap-schedule: For clusters with multiple CephFS file systems, all the snap-schedule commands now expect the '--fs' argument. * RADOS: A POOL_APP_NOT_ENABLED health warning will now be reported if the application is not enabled for the pool irrespective of whether the pool is in use or not. Always add ``application`` label to a pool to avoid reporting of POOL_APP_NOT_ENABLED health warning for that pool. The user might temporarilty mute this warning using ``ceph health mute POOL_APP_NOT_ENABLED``. Getting Ceph * Git at git://github.com/ceph/ceph.git * Tarball at https://download.ceph.com/tarballs/ceph-18.2.1.tar.gz * Containers at https://quay.io/repository/ceph/ceph * For packages, see https://docs.ceph.com/en/latest/install/get-packages/ * Release git sha1: 7fe91d5d5842e04be3b4f514d6dd990c54b29c76 ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: reef 18.2.1 QE Validation status
Per Guillaume it was tested and does not have any impact on other areas. So I will cherry-pick it for the release Thx On Mon, Dec 11, 2023 at 7:53 AM Guillaume Abrioux wrote: > > Hi Yuri, > > > > Any chance we can include [1] ? This patch fixes mpath devices deployments, > the PR has missed a merge and was backported onto reef this morning only. > > > > Thanks, > > > > [1] > https://github.com/ceph/ceph/pull/53539/commits/1e7223281fa044c9653633e305c0b344e4c9b3a4 > > > > -- > > Guillaume Abrioux > > Software Engineer > > > > From: Venky Shankar > Date: Tuesday, 28 November 2023 at 05:09 > To: Yuri Weinstein > Cc: dev , ceph-users > Subject: [EXTERNAL] [ceph-users] Re: reef 18.2.1 QE Validation status > > On Tue, Nov 21, 2023 at 10:35 PM Venky Shankar wrote: > > > > Hi Yuri, > > > > On Fri, Nov 10, 2023 at 1:22 PM Venky Shankar wrote: > > > > > > Hi Yuri, > > > > > > On Fri, Nov 10, 2023 at 4:55 AM Yuri Weinstein > > > wrote: > > > > > > > > I've updated all approvals and merged PRs in the tracker and it looks > > > > like we are ready for gibba, LRC upgrades pending approval/update from > > > > Venky. > > > > > > The smoke test failure is caused by missing (kclient) patches in > > > Ubuntu 20.04 that certain parts of the fs suite (via smoke tests) rely > > > on. More details here > > > > > > https://tracker.ceph.com/issues/63488#note-8 > > > > > > The kclient tests in smoke pass with other distro's and the fs suite > > > tests have been reviewed and look good. Run details are here > > > > > > https://tracker.ceph.com/projects/cephfs/wiki/Reef#07-Nov-2023 > > > > > > The smoke failure is noted as a known issue for now. Consider this run > > > as "fs approved". > > > > We need an additional change to be tested for inclusion into this reef > > release. This one > > > > https://github.com/ceph/ceph/pull/54407 > > > > The issue showed up when upgrading the LRC. > > This was discussed in the CLT meeting last week and the overall > agreement was to be able to extend our tests to validate the fix which > showed up in quincy run (smoke suite) but not in reef. I've sent a > change regarding the same: > > https://github.com/ceph/ceph/pull/54677 > > I'll update when it's ready to be included for testing. > > > > > > > > > > > > > > On Thu, Nov 9, 2023 at 1:31 PM Radoslaw Zarzynski > > > > wrote: > > > > > > > > > > rados approved! > > > > > > > > > > Details are here: > > > > > https://tracker.ceph.com/projects/rados/wiki/REEF#1821-Review . > > > > > > > > > > On Mon, Nov 6, 2023 at 10:33 PM Yuri Weinstein > > > > > wrote: > > > > > > > > > > > > Details of this release are summarized here: > > > > > > > > > > > > https://tracker.ceph.com/issues/63443#note-1 > > > > > > > > > > > > Seeking approvals/reviews for: > > > > > > > > > > > > smoke - Laura, Radek, Prashant, Venky (POOL_APP_NOT_ENABLE failures) > > > > > > rados - Neha, Radek, Travis, Ernesto, Adam King > > > > > > rgw - Casey > > > > > > fs - Venky > > > > > > orch - Adam King > > > > > > rbd - Ilya > > > > > > krbd - Ilya > > > > > > upgrade/quincy-x (reef) - Laura PTL > > > > > > powercycle - Brad > > > > > > perf-basic - Laura, Prashant (POOL_APP_NOT_ENABLE failures) > > > > > > > > > > > > Please reply to this email with approval and/or trackers of known > > > > > > issues/PRs to address them. > > > > > > > > > > > > TIA > > > > > > YuriW > > > > > > ___ > > > > > > Dev mailing list -- d...@ceph.io > > > > > > To unsubscribe send an email to dev-le...@ceph.io > > > > > > > > > > > > > > > ___ > > > > ceph-users mailing list -- ceph-users@ceph.io > > > > To unsubscribe send an email to ceph-users-le...@ceph.io > > > > > > > > > > > > -- > > > Cheers, > > > Venky > > > > > > > > -- > > Cheers, > > Venky > > > > -- > Cheers, > Venky > ___ > ceph-users mailing list -- ceph-users@ceph.io > To unsubscribe send an email to ceph-users-le...@ceph.io > > Unless otherwise stated above: > > Compagnie IBM France > Siège Social : 17, avenue de l'Europe, 92275 Bois-Colombes Cedex > RCS Nanterre 552 118 465 > Forme Sociale : S.A.S. > Capital Social : 664 069 390,60 € > SIRET : 552 118 465 03644 - Code NAF 6203Z ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: reef 18.2.1 QE Validation status
The issue https://github.com/ceph/ceph/pull/54772 was resolved and we continue with the 18.2.1 release On Fri, Dec 1, 2023 at 11:12 AM Igor Fedotov wrote: > > Hi Yuri, > > Looks like that's not THAT critical and complicated as it's been thought > originally. User has to change bluefs_shared_alloc_size to be exposed to > the issue. So hopefully I'll submit a patch on Monday to close this gap > and we'll be able to proceed. > > > Thanks, > > Igor > > On 01/12/2023 18:16, Yuri Weinstein wrote: > > Venky, pls review the test results for smoke and fs after the PRs were > > merged. > > > > Radek, Igor, Adam - any updates on https://tracker.ceph.com/issues/63618? > > > > Thx > > > > On Thu, Nov 30, 2023 at 8:08 AM Yuri Weinstein wrote: > >> The fs PRs: > >> https://github.com/ceph/ceph/pull/54407 > >> https://github.com/ceph/ceph/pull/54677 > >> were approved/tested and ready for merge. > >> > >> What is the status/plan for https://tracker.ceph.com/issues/63618? > >> > >> On Wed, Nov 29, 2023 at 10:51 AM Igor Fedotov > >> wrote: > >>> https://tracker.ceph.com/issues/63618 to be considered as a blocker for > >>> the next Reef release. > >>> > >>> On 07/11/2023 00:30, Yuri Weinstein wrote: > >>>> Details of this release are summarized here: > >>>> > >>>> https://tracker.ceph.com/issues/63443#note-1 > >>>> > >>>> Seeking approvals/reviews for: > >>>> > >>>> smoke - Laura, Radek, Prashant, Venky (POOL_APP_NOT_ENABLE failures) > >>>> rados - Neha, Radek, Travis, Ernesto, Adam King > >>>> rgw - Casey > >>>> fs - Venky > >>>> orch - Adam King > >>>> rbd - Ilya > >>>> krbd - Ilya > >>>> upgrade/quincy-x (reef) - Laura PTL > >>>> powercycle - Brad > >>>> perf-basic - Laura, Prashant (POOL_APP_NOT_ENABLE failures) > >>>> > >>>> Please reply to this email with approval and/or trackers of known > >>>> issues/PRs to address them. > >>>> > >>>> TIA > >>>> YuriW > >>>> ___ > >>>> ceph-users mailing list -- ceph-users@ceph.io > >>>> To unsubscribe send an email to ceph-users-le...@ceph.io > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: reef 18.2.1 QE Validation status
Venky, pls review the test results for smoke and fs after the PRs were merged. Radek, Igor, Adam - any updates on https://tracker.ceph.com/issues/63618? Thx On Thu, Nov 30, 2023 at 8:08 AM Yuri Weinstein wrote: > > The fs PRs: > https://github.com/ceph/ceph/pull/54407 > https://github.com/ceph/ceph/pull/54677 > were approved/tested and ready for merge. > > What is the status/plan for https://tracker.ceph.com/issues/63618? > > On Wed, Nov 29, 2023 at 10:51 AM Igor Fedotov wrote: > > > > https://tracker.ceph.com/issues/63618 to be considered as a blocker for > > the next Reef release. > > > > On 07/11/2023 00:30, Yuri Weinstein wrote: > > > Details of this release are summarized here: > > > > > > https://tracker.ceph.com/issues/63443#note-1 > > > > > > Seeking approvals/reviews for: > > > > > > smoke - Laura, Radek, Prashant, Venky (POOL_APP_NOT_ENABLE failures) > > > rados - Neha, Radek, Travis, Ernesto, Adam King > > > rgw - Casey > > > fs - Venky > > > orch - Adam King > > > rbd - Ilya > > > krbd - Ilya > > > upgrade/quincy-x (reef) - Laura PTL > > > powercycle - Brad > > > perf-basic - Laura, Prashant (POOL_APP_NOT_ENABLE failures) > > > > > > Please reply to this email with approval and/or trackers of known > > > issues/PRs to address them. > > > > > > TIA > > > YuriW > > > ___ > > > ceph-users mailing list -- ceph-users@ceph.io > > > To unsubscribe send an email to ceph-users-le...@ceph.io > > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: reef 18.2.1 QE Validation status
The fs PRs: https://github.com/ceph/ceph/pull/54407 https://github.com/ceph/ceph/pull/54677 were approved/tested and ready for merge. What is the status/plan for https://tracker.ceph.com/issues/63618? On Wed, Nov 29, 2023 at 10:51 AM Igor Fedotov wrote: > > https://tracker.ceph.com/issues/63618 to be considered as a blocker for > the next Reef release. > > On 07/11/2023 00:30, Yuri Weinstein wrote: > > Details of this release are summarized here: > > > > https://tracker.ceph.com/issues/63443#note-1 > > > > Seeking approvals/reviews for: > > > > smoke - Laura, Radek, Prashant, Venky (POOL_APP_NOT_ENABLE failures) > > rados - Neha, Radek, Travis, Ernesto, Adam King > > rgw - Casey > > fs - Venky > > orch - Adam King > > rbd - Ilya > > krbd - Ilya > > upgrade/quincy-x (reef) - Laura PTL > > powercycle - Brad > > perf-basic - Laura, Prashant (POOL_APP_NOT_ENABLE failures) > > > > Please reply to this email with approval and/or trackers of known > > issues/PRs to address them. > > > > TIA > > YuriW > > ___ > > ceph-users mailing list -- ceph-users@ceph.io > > To unsubscribe send an email to ceph-users-le...@ceph.io > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: reef 18.2.1 QE Validation status
Dev Lead, pls review/edit/approve the release notes: https://github.com/ceph/ceph/pull/54506 TIA On Thu, Nov 16, 2023 at 10:03 AM Travis Nielsen wrote: > > Rook already ran the tests against Guillaume's change directly, it looks good > to us. I don't see a new latest-reef-devel image tag yet, but will plan on > rerunning the tests when that tag is updated. > > Thanks, > Travis > > On Thu, Nov 16, 2023 at 8:27 AM Adam King wrote: >> >> Guillaume ran that patch through the orch suite earlier today before >> merging. I think we should be okay on that front. The issue it's fixing was >> also particular to rook iirc, which teuthology doesn't cover. >> >> On Thu, Nov 16, 2023 at 10:18 AM Yuri Weinstein wrote: >>> >>> OK I will start building. >>> >>> Travis, Adam King - any need to rerun any suites? >>> >>> On Thu, Nov 16, 2023 at 7:14 AM Guillaume Abrioux wrote: >>> > >>> > Hi Yuri, >>> > >>> > >>> > >>> > Backport PR [2] for reef has been merged. >>> > >>> > >>> > >>> > Thanks, >>> > >>> > >>> > >>> > [2] https://github.com/ceph/ceph/pull/54514/files >>> > >>> > >>> > >>> > -- >>> > >>> > Guillaume Abrioux >>> > >>> > Software Engineer >>> > >>> > >>> > >>> > From: Guillaume Abrioux >>> > Date: Wednesday, 15 November 2023 at 21:02 >>> > To: Yuri Weinstein , Nizamudeen A , >>> > Guillaume Abrioux , Travis Nielsen >>> > >>> > Cc: Adam King , Redouane Kachach >>> > , dev , ceph-users >>> > Subject: Re: [EXTERNAL] [ceph-users] Re: reef 18.2.1 QE Validation status >>> > >>> > Hi Yuri, (thanks) >>> > >>> > >>> > >>> > Indeed, we had a regression in ceph-volume impacting rook scenarios which >>> > was supposed to be fixed by [1]. >>> > >>> > It turns out rook's CI didn't catch that fix wasn't enough for some >>> > reason (I believe the CI run wasn't using the right image, Travis might >>> > confirm or give more details). >>> > >>> > Another patch [2] is needed in order to fix this regression. >>> > >>> > >>> > >>> > Let me know if more details are needed. >>> > >>> > >>> > >>> > Thanks, >>> > >>> > >>> > >>> > [1] >>> > https://github.com/ceph/ceph/pull/54429/commits/ee26074a5e7e90b4026659bf3adb1bc973595e91 >>> > >>> > [2] https://github.com/ceph/ceph/pull/54514/files >>> > >>> > >>> > >>> > >>> > >>> > -- >>> > >>> > Guillaume Abrioux >>> > >>> > Software Engineer >>> > >>> > >>> > >>> > >>> > >>> > From: Yuri Weinstein >>> > Sent: 15 November 2023 20:23 >>> > To: Nizamudeen A ; Guillaume Abrioux >>> > ; Travis Nielsen >>> > Cc: Adam King ; Redouane Kachach >>> > ; dev ; ceph-users >>> > Subject: [EXTERNAL] [ceph-users] Re: reef 18.2.1 QE Validation status >>> > >>> > >>> > >>> > This is on behalf of Guillaume. >>> > >>> > We have one more last mites issue that may have to be included >>> > https://tracker.ceph.com/issues/63545 >>> > https://github.com/ceph/ceph/pull/54514 >>> > >>> > Travis, Redo, Guillaume will provide more context and details. >>> > >>> > We are assessing the situation as 18.2.1 has been built and signed. >>> > >>> > On Tue, Nov 14, 2023 at 11:07 AM Yuri Weinstein >>> > wrote: >>> > > >>> > > OK thx! >>> > > >>> > > We have completed the approvals. >>> > > >>> > > On Tue, Nov 14, 2023 at 9:13 AM Nizamudeen A wrote: >>> > > > >>> > > > dashboard approved. Failure known and unrelated! >>> > > > >>> > > > On Tue, Nov 14, 2023, 22:34 Adam King wrote: >>> > > >> >>> > > >> orch approved. After reruns, orch/cephadm was just
[ceph-users] Re: reef 18.2.1 QE Validation status
OK I will start building. Travis, Adam King - any need to rerun any suites? On Thu, Nov 16, 2023 at 7:14 AM Guillaume Abrioux wrote: > > Hi Yuri, > > > > Backport PR [2] for reef has been merged. > > > > Thanks, > > > > [2] https://github.com/ceph/ceph/pull/54514/files > > > > -- > > Guillaume Abrioux > > Software Engineer > > > > From: Guillaume Abrioux > Date: Wednesday, 15 November 2023 at 21:02 > To: Yuri Weinstein , Nizamudeen A , > Guillaume Abrioux , Travis Nielsen > Cc: Adam King , Redouane Kachach , > dev , ceph-users > Subject: Re: [EXTERNAL] [ceph-users] Re: reef 18.2.1 QE Validation status > > Hi Yuri, (thanks) > > > > Indeed, we had a regression in ceph-volume impacting rook scenarios which was > supposed to be fixed by [1]. > > It turns out rook's CI didn't catch that fix wasn't enough for some reason (I > believe the CI run wasn't using the right image, Travis might confirm or give > more details). > > Another patch [2] is needed in order to fix this regression. > > > > Let me know if more details are needed. > > > > Thanks, > > > > [1] > https://github.com/ceph/ceph/pull/54429/commits/ee26074a5e7e90b4026659bf3adb1bc973595e91 > > [2] https://github.com/ceph/ceph/pull/54514/files > > > > > > -- > > Guillaume Abrioux > > Software Engineer > > > > > > From: Yuri Weinstein > Sent: 15 November 2023 20:23 > To: Nizamudeen A ; Guillaume Abrioux ; > Travis Nielsen > Cc: Adam King ; Redouane Kachach ; > dev ; ceph-users > Subject: [EXTERNAL] [ceph-users] Re: reef 18.2.1 QE Validation status > > > > This is on behalf of Guillaume. > > We have one more last mites issue that may have to be included > https://tracker.ceph.com/issues/63545 https://github.com/ceph/ceph/pull/54514 > > Travis, Redo, Guillaume will provide more context and details. > > We are assessing the situation as 18.2.1 has been built and signed. > > On Tue, Nov 14, 2023 at 11:07 AM Yuri Weinstein wrote: > > > > OK thx! > > > > We have completed the approvals. > > > > On Tue, Nov 14, 2023 at 9:13 AM Nizamudeen A wrote: > > > > > > dashboard approved. Failure known and unrelated! > > > > > > On Tue, Nov 14, 2023, 22:34 Adam King wrote: > > >> > > >> orch approved. After reruns, orch/cephadm was just hitting two known > > >> (nonblocker) issues and orch/rook teuthology suite is known to not be > > >> functional currently. > > >> > > >> On Tue, Nov 14, 2023 at 10:33 AM Yuri Weinstein > > >> wrote: > > >>> > > >>> Build 4 with https://github.com/ceph/ceph/pull/54224 was built and I > > >>> ran the tests below and asking for approvals: > > >>> > > >>> smoke - Laura > > >>> rados/mgr - PASSED > > >>> rados/dashboard - Nizamudeen > > >>> orch - Adam King > > >>> > > >>> See Build 4 runs - https://tracker.ceph.com/issues/63443#note-1 > > >>> > > >>> On Tue, Nov 14, 2023 at 12:21 AM Redouane Kachach > > >>> wrote: > > >>> > > > >>> > Yes, cephadm has some tests for monitoring that should be enough to > > >>> > ensure basic functionality is working properly. The rest of the > > >>> > changes in the PR are for rook orchestrator. > > >>> > > > >>> > On Tue, Nov 14, 2023 at 5:04 AM Nizamudeen A wrote: > > >>> >> > > >>> >> dashboard changes are minimal and approved. and since the dashboard > > >>> >> change is related to the > > >>> >> monitoring stack (prometheus..) which is something not covered in > > >>> >> the dashboard test suites, I don't think running it is necessary. > > >>> >> But maybe the cephadm suite has some monitoring stack related > > >>> >> testings written? > > >>> >> > > >>> >> On Tue, Nov 14, 2023 at 1:10 AM Yuri Weinstein > > >>> >> wrote: > > >>> >>> > > >>> >>> Ack Travis. > > >>> >>> > > >>> >>> Since it touches a dashboard, Nizam - please reply/approve. > > >>> >>> > > >>> >>> I assume that rados/dashboard tests will be suff
[ceph-users] Re: reef 18.2.1 QE Validation status
Sounds like it's a must to be added. When the reef backport PR can be merged? On Wed, Nov 15, 2023 at 12:13 PM Travis Nielsen wrote: > > Thanks Guiilaume and Redo for tracking down this issue. After talking more > with Guillaume I now realized that not all the tests were using the expected > latest-reef-devel label so Rook tests were incorrectly showing green for > Reef. :( > Now that I ran the tests again in the test PR with all tests using the > latest-reef-devel label, all the tests with OSDs on PVCs are failing that use > ceph-volume raw mode. So this is a blocker for Rook scenarios, we really need > to fix to avoid breaking OSDs. > > Thanks, > Travis > > On Wed, Nov 15, 2023 at 1:03 PM Guillaume Abrioux wrote: >> >> Hi Yuri, (thanks) >> >> Indeed, we had a regression in ceph-volume impacting rook scenarios which >> was supposed to be fixed by [1]. >> It turns out rook's CI didn't catch that fix wasn't enough for some reason >> (I believe the CI run wasn't using the right image, Travis might confirm or >> give more details). >> Another patch [2] is needed in order to fix this regression. >> >> Let me know if more details are needed. >> >> Thanks, >> >> [1] >> https://github.com/ceph/ceph/pull/54429/commits/ee26074a5e7e90b4026659bf3adb1bc973595e91 >> [2] https://github.com/ceph/ceph/pull/54514/files >> >> >> -- >> Guillaume Abrioux >> Software Engineer >> >> >> From: Yuri Weinstein >> Sent: 15 November 2023 20:23 >> To: Nizamudeen A ; Guillaume Abrioux ; >> Travis Nielsen >> Cc: Adam King ; Redouane Kachach ; >> dev ; ceph-users >> Subject: [EXTERNAL] [ceph-users] Re: reef 18.2.1 QE Validation status >> >> This is on behalf of Guillaume. >> >> We have one more last mites issue that may have to be included >> https://tracker.ceph.com/issues/63545 >> https://github.com/ceph/ceph/pull/54514 >> >> Travis, Redo, Guillaume will provide more context and details. >> >> We are assessing the situation as 18.2.1 has been built and signed. >> >> On Tue, Nov 14, 2023 at 11:07 AM Yuri Weinstein wrote: >> > >> > OK thx! >> > >> > We have completed the approvals. >> > >> > On Tue, Nov 14, 2023 at 9:13 AM Nizamudeen A wrote: >> > > >> > > dashboard approved. Failure known and unrelated! >> > > >> > > On Tue, Nov 14, 2023, 22:34 Adam King wrote: >> > >> >> > >> orch approved. After reruns, orch/cephadm was just hitting two known >> > >> (nonblocker) issues and orch/rook teuthology suite is known to not be >> > >> functional currently. >> > >> >> > >> On Tue, Nov 14, 2023 at 10:33 AM Yuri Weinstein >> > >> wrote: >> > >>> >> > >>> Build 4 with https://github.com/ceph/ceph/pull/54224 was built and I >> > >>> ran the tests below and asking for approvals: >> > >>> >> > >>> smoke - Laura >> > >>> rados/mgr - PASSED >> > >>> rados/dashboard - Nizamudeen >> > >>> orch - Adam King >> > >>> >> > >>> See Build 4 runs - https://tracker.ceph.com/issues/63443#note-1 >> > >>> >> > >>> On Tue, Nov 14, 2023 at 12:21 AM Redouane Kachach >> > >>> wrote: >> > >>> > >> > >>> > Yes, cephadm has some tests for monitoring that should be enough to >> > >>> > ensure basic functionality is working properly. The rest of the >> > >>> > changes in the PR are for rook orchestrator. >> > >>> > >> > >>> > On Tue, Nov 14, 2023 at 5:04 AM Nizamudeen A wrote: >> > >>> >> >> > >>> >> dashboard changes are minimal and approved. and since the dashboard >> > >>> >> change is related to the >> > >>> >> monitoring stack (prometheus..) which is something not covered in >> > >>> >> the dashboard test suites, I don't think running it is necessary. >> > >>> >> But maybe the cephadm suite has some monitoring stack related >> > >>> >> testings written? >> > >>> >> >> > >>> >> On Tue, Nov 14, 2023 at 1:10 AM Yuri Weinstein >> > >>> >> wrote: >> > >>> >>>
[ceph-users] Re: reef 18.2.1 QE Validation status
This is on behalf of Guillaume. We have one more last mites issue that may have to be included https://tracker.ceph.com/issues/63545 https://github.com/ceph/ceph/pull/54514 Travis, Redo, Guillaume will provide more context and details. We are assessing the situation as 18.2.1 has been built and signed. On Tue, Nov 14, 2023 at 11:07 AM Yuri Weinstein wrote: > > OK thx! > > We have completed the approvals. > > On Tue, Nov 14, 2023 at 9:13 AM Nizamudeen A wrote: > > > > dashboard approved. Failure known and unrelated! > > > > On Tue, Nov 14, 2023, 22:34 Adam King wrote: > >> > >> orch approved. After reruns, orch/cephadm was just hitting two known > >> (nonblocker) issues and orch/rook teuthology suite is known to not be > >> functional currently. > >> > >> On Tue, Nov 14, 2023 at 10:33 AM Yuri Weinstein > >> wrote: > >>> > >>> Build 4 with https://github.com/ceph/ceph/pull/54224 was built and I > >>> ran the tests below and asking for approvals: > >>> > >>> smoke - Laura > >>> rados/mgr - PASSED > >>> rados/dashboard - Nizamudeen > >>> orch - Adam King > >>> > >>> See Build 4 runs - https://tracker.ceph.com/issues/63443#note-1 > >>> > >>> On Tue, Nov 14, 2023 at 12:21 AM Redouane Kachach > >>> wrote: > >>> > > >>> > Yes, cephadm has some tests for monitoring that should be enough to > >>> > ensure basic functionality is working properly. The rest of the changes > >>> > in the PR are for rook orchestrator. > >>> > > >>> > On Tue, Nov 14, 2023 at 5:04 AM Nizamudeen A wrote: > >>> >> > >>> >> dashboard changes are minimal and approved. and since the dashboard > >>> >> change is related to the > >>> >> monitoring stack (prometheus..) which is something not covered in the > >>> >> dashboard test suites, I don't think running it is necessary. > >>> >> But maybe the cephadm suite has some monitoring stack related testings > >>> >> written? > >>> >> > >>> >> On Tue, Nov 14, 2023 at 1:10 AM Yuri Weinstein > >>> >> wrote: > >>> >>> > >>> >>> Ack Travis. > >>> >>> > >>> >>> Since it touches a dashboard, Nizam - please reply/approve. > >>> >>> > >>> >>> I assume that rados/dashboard tests will be sufficient, but expecting > >>> >>> your recommendations. > >>> >>> > >>> >>> This addition will make the final release likely to be pushed. > >>> >>> > >>> >>> On Mon, Nov 13, 2023 at 11:30 AM Travis Nielsen > >>> >>> wrote: > >>> >>> > > >>> >>> > I'd like to see these changes for much improved dashboard > >>> >>> > integration with Rook. The changes are to the rook mgr orchestrator > >>> >>> > module, and supporting test changes. Thus, this should be very low > >>> >>> > risk to the ceph release. I don't know the details of the tautology > >>> >>> > suites, but I would think suites involving the mgr modules would > >>> >>> > only be necessary. > >>> >>> > > >>> >>> > Travis > >>> >>> > > >>> >>> > On Mon, Nov 13, 2023 at 12:14 PM Yuri Weinstein > >>> >>> > wrote: > >>> >>> >> > >>> >>> >> Redouane > >>> >>> >> > >>> >>> >> What would be a sufficient level of testing (tautology suite(s)) > >>> >>> >> assuming this PR is approved to be added? > >>> >>> >> > >>> >>> >> On Mon, Nov 13, 2023 at 9:13 AM Redouane Kachach > >>> >>> >> wrote: > >>> >>> >> > > >>> >>> >> > Hi Yuri, > >>> >>> >> > > >>> >>> >> > I've just backported to reef several fixes that I introduced in > >>> >>> >> > the last months for the rook orchestrator. Most of them are > >>> >>> >> > fixes for dashboard issues/crashes that only happen on Rook > >>&g
[ceph-users] Re: reef 18.2.1 QE Validation status
OK thx! We have completed the approvals. On Tue, Nov 14, 2023 at 9:13 AM Nizamudeen A wrote: > > dashboard approved. Failure known and unrelated! > > On Tue, Nov 14, 2023, 22:34 Adam King wrote: >> >> orch approved. After reruns, orch/cephadm was just hitting two known >> (nonblocker) issues and orch/rook teuthology suite is known to not be >> functional currently. >> >> On Tue, Nov 14, 2023 at 10:33 AM Yuri Weinstein wrote: >>> >>> Build 4 with https://github.com/ceph/ceph/pull/54224 was built and I >>> ran the tests below and asking for approvals: >>> >>> smoke - Laura >>> rados/mgr - PASSED >>> rados/dashboard - Nizamudeen >>> orch - Adam King >>> >>> See Build 4 runs - https://tracker.ceph.com/issues/63443#note-1 >>> >>> On Tue, Nov 14, 2023 at 12:21 AM Redouane Kachach >>> wrote: >>> > >>> > Yes, cephadm has some tests for monitoring that should be enough to >>> > ensure basic functionality is working properly. The rest of the changes >>> > in the PR are for rook orchestrator. >>> > >>> > On Tue, Nov 14, 2023 at 5:04 AM Nizamudeen A wrote: >>> >> >>> >> dashboard changes are minimal and approved. and since the dashboard >>> >> change is related to the >>> >> monitoring stack (prometheus..) which is something not covered in the >>> >> dashboard test suites, I don't think running it is necessary. >>> >> But maybe the cephadm suite has some monitoring stack related testings >>> >> written? >>> >> >>> >> On Tue, Nov 14, 2023 at 1:10 AM Yuri Weinstein >>> >> wrote: >>> >>> >>> >>> Ack Travis. >>> >>> >>> >>> Since it touches a dashboard, Nizam - please reply/approve. >>> >>> >>> >>> I assume that rados/dashboard tests will be sufficient, but expecting >>> >>> your recommendations. >>> >>> >>> >>> This addition will make the final release likely to be pushed. >>> >>> >>> >>> On Mon, Nov 13, 2023 at 11:30 AM Travis Nielsen >>> >>> wrote: >>> >>> > >>> >>> > I'd like to see these changes for much improved dashboard integration >>> >>> > with Rook. The changes are to the rook mgr orchestrator module, and >>> >>> > supporting test changes. Thus, this should be very low risk to the >>> >>> > ceph release. I don't know the details of the tautology suites, but I >>> >>> > would think suites involving the mgr modules would only be necessary. >>> >>> > >>> >>> > Travis >>> >>> > >>> >>> > On Mon, Nov 13, 2023 at 12:14 PM Yuri Weinstein >>> >>> > wrote: >>> >>> >> >>> >>> >> Redouane >>> >>> >> >>> >>> >> What would be a sufficient level of testing (tautology suite(s)) >>> >>> >> assuming this PR is approved to be added? >>> >>> >> >>> >>> >> On Mon, Nov 13, 2023 at 9:13 AM Redouane Kachach >>> >>> >> wrote: >>> >>> >> > >>> >>> >> > Hi Yuri, >>> >>> >> > >>> >>> >> > I've just backported to reef several fixes that I introduced in >>> >>> >> > the last months for the rook orchestrator. Most of them are fixes >>> >>> >> > for dashboard issues/crashes that only happen on Rook >>> >>> >> > environments. The PR [1] has all the changes and it was merged >>> >>> >> > into reef this morning. We really need these changes to be part of >>> >>> >> > the next reef release as the upcoming Rook stable version will be >>> >>> >> > based on it. >>> >>> >> > >>> >>> >> > Please, can you include those changes in the upcoming reef 18.2.1 >>> >>> >> > release? >>> >>> >> > >>> >>> >> > [1] https://github.com/ceph/ceph/pull/54224 >>> >>> >> > >>> >>> >> > Thanks a lot, >>> >>> >> > Red
[ceph-users] Re: reef 18.2.1 QE Validation status
Build 4 with https://github.com/ceph/ceph/pull/54224 was built and I ran the tests below and asking for approvals: smoke - Laura rados/mgr - PASSED rados/dashboard - Nizamudeen orch - Adam King See Build 4 runs - https://tracker.ceph.com/issues/63443#note-1 On Tue, Nov 14, 2023 at 12:21 AM Redouane Kachach wrote: > > Yes, cephadm has some tests for monitoring that should be enough to ensure > basic functionality is working properly. The rest of the changes in the PR > are for rook orchestrator. > > On Tue, Nov 14, 2023 at 5:04 AM Nizamudeen A wrote: >> >> dashboard changes are minimal and approved. and since the dashboard change >> is related to the >> monitoring stack (prometheus..) which is something not covered in the >> dashboard test suites, I don't think running it is necessary. >> But maybe the cephadm suite has some monitoring stack related testings >> written? >> >> On Tue, Nov 14, 2023 at 1:10 AM Yuri Weinstein wrote: >>> >>> Ack Travis. >>> >>> Since it touches a dashboard, Nizam - please reply/approve. >>> >>> I assume that rados/dashboard tests will be sufficient, but expecting >>> your recommendations. >>> >>> This addition will make the final release likely to be pushed. >>> >>> On Mon, Nov 13, 2023 at 11:30 AM Travis Nielsen wrote: >>> > >>> > I'd like to see these changes for much improved dashboard integration >>> > with Rook. The changes are to the rook mgr orchestrator module, and >>> > supporting test changes. Thus, this should be very low risk to the ceph >>> > release. I don't know the details of the tautology suites, but I would >>> > think suites involving the mgr modules would only be necessary. >>> > >>> > Travis >>> > >>> > On Mon, Nov 13, 2023 at 12:14 PM Yuri Weinstein >>> > wrote: >>> >> >>> >> Redouane >>> >> >>> >> What would be a sufficient level of testing (tautology suite(s)) >>> >> assuming this PR is approved to be added? >>> >> >>> >> On Mon, Nov 13, 2023 at 9:13 AM Redouane Kachach >>> >> wrote: >>> >> > >>> >> > Hi Yuri, >>> >> > >>> >> > I've just backported to reef several fixes that I introduced in the >>> >> > last months for the rook orchestrator. Most of them are fixes for >>> >> > dashboard issues/crashes that only happen on Rook environments. The PR >>> >> > [1] has all the changes and it was merged into reef this morning. We >>> >> > really need these changes to be part of the next reef release as the >>> >> > upcoming Rook stable version will be based on it. >>> >> > >>> >> > Please, can you include those changes in the upcoming reef 18.2.1 >>> >> > release? >>> >> > >>> >> > [1] https://github.com/ceph/ceph/pull/54224 >>> >> > >>> >> > Thanks a lot, >>> >> > Redouane. >>> >> > >>> >> > >>> >> > On Mon, Nov 13, 2023 at 6:03 PM Yuri Weinstein >>> >> > wrote: >>> >> >> >>> >> >> -- Forwarded message - >>> >> >> From: Venky Shankar >>> >> >> Date: Thu, Nov 9, 2023 at 11:52 PM >>> >> >> Subject: Re: [ceph-users] Re: reef 18.2.1 QE Validation status >>> >> >> To: Yuri Weinstein >>> >> >> Cc: dev , ceph-users >>> >> >> >>> >> >> >>> >> >> Hi Yuri, >>> >> >> >>> >> >> On Fri, Nov 10, 2023 at 4:55 AM Yuri Weinstein >>> >> >> wrote: >>> >> >> > >>> >> >> > I've updated all approvals and merged PRs in the tracker and it >>> >> >> > looks >>> >> >> > like we are ready for gibba, LRC upgrades pending approval/update >>> >> >> > from >>> >> >> > Venky. >>> >> >> >>> >> >> The smoke test failure is caused by missing (kclient) patches in >>> >> >> Ubuntu 20.04 that certain parts of the fs suite (via smoke tests) rely >>> >> >> on. More details here >>> >> >> >>> >> >>
[ceph-users] Re: reef 18.2.1 QE Validation status
Ack Travis. Since it touches a dashboard, Nizam - please reply/approve. I assume that rados/dashboard tests will be sufficient, but expecting your recommendations. This addition will make the final release likely to be pushed. On Mon, Nov 13, 2023 at 11:30 AM Travis Nielsen wrote: > > I'd like to see these changes for much improved dashboard integration with > Rook. The changes are to the rook mgr orchestrator module, and supporting > test changes. Thus, this should be very low risk to the ceph release. I don't > know the details of the tautology suites, but I would think suites involving > the mgr modules would only be necessary. > > Travis > > On Mon, Nov 13, 2023 at 12:14 PM Yuri Weinstein wrote: >> >> Redouane >> >> What would be a sufficient level of testing (tautology suite(s)) >> assuming this PR is approved to be added? >> >> On Mon, Nov 13, 2023 at 9:13 AM Redouane Kachach wrote: >> > >> > Hi Yuri, >> > >> > I've just backported to reef several fixes that I introduced in the last >> > months for the rook orchestrator. Most of them are fixes for dashboard >> > issues/crashes that only happen on Rook environments. The PR [1] has all >> > the changes and it was merged into reef this morning. We really need these >> > changes to be part of the next reef release as the upcoming Rook stable >> > version will be based on it. >> > >> > Please, can you include those changes in the upcoming reef 18.2.1 release? >> > >> > [1] https://github.com/ceph/ceph/pull/54224 >> > >> > Thanks a lot, >> > Redouane. >> > >> > >> > On Mon, Nov 13, 2023 at 6:03 PM Yuri Weinstein wrote: >> >> >> >> -- Forwarded message - >> >> From: Venky Shankar >> >> Date: Thu, Nov 9, 2023 at 11:52 PM >> >> Subject: Re: [ceph-users] Re: reef 18.2.1 QE Validation status >> >> To: Yuri Weinstein >> >> Cc: dev , ceph-users >> >> >> >> >> >> Hi Yuri, >> >> >> >> On Fri, Nov 10, 2023 at 4:55 AM Yuri Weinstein >> >> wrote: >> >> > >> >> > I've updated all approvals and merged PRs in the tracker and it looks >> >> > like we are ready for gibba, LRC upgrades pending approval/update from >> >> > Venky. >> >> >> >> The smoke test failure is caused by missing (kclient) patches in >> >> Ubuntu 20.04 that certain parts of the fs suite (via smoke tests) rely >> >> on. More details here >> >> >> >> https://tracker.ceph.com/issues/63488#note-8 >> >> >> >> The kclient tests in smoke pass with other distro's and the fs suite >> >> tests have been reviewed and look good. Run details are here >> >> >> >> https://tracker.ceph.com/projects/cephfs/wiki/Reef#07-Nov-2023 >> >> >> >> The smoke failure is noted as a known issue for now. Consider this run >> >> as "fs approved". >> >> >> >> > >> >> > On Thu, Nov 9, 2023 at 1:31 PM Radoslaw Zarzynski >> >> > wrote: >> >> > > >> >> > > rados approved! >> >> > > >> >> > > Details are here: >> >> > > https://tracker.ceph.com/projects/rados/wiki/REEF#1821-Review. >> >> > > >> >> > > On Mon, Nov 6, 2023 at 10:33 PM Yuri Weinstein >> >> > > wrote: >> >> > > > >> >> > > > Details of this release are summarized here: >> >> > > > >> >> > > > https://tracker.ceph.com/issues/63443#note-1 >> >> > > > >> >> > > > Seeking approvals/reviews for: >> >> > > > >> >> > > > smoke - Laura, Radek, Prashant, Venky (POOL_APP_NOT_ENABLE failures) >> >> > > > rados - Neha, Radek, Travis, Ernesto, Adam King >> >> > > > rgw - Casey >> >> > > > fs - Venky >> >> > > > orch - Adam King >> >> > > > rbd - Ilya >> >> > > > krbd - Ilya >> >> > > > upgrade/quincy-x (reef) - Laura PTL >> >> > > > powercycle - Brad >> >> > > > perf-basic - Laura, Prashant (POOL_APP_NOT_ENABLE failures) >> >> > > > >> >> > > > Please reply to this email with approval and/or trackers of known >> >> > > > issues/PRs to address them. >> >> > > > >> >> > > > TIA >> >> > > > YuriW >> >> > > > ___ >> >> > > > Dev mailing list -- d...@ceph.io >> >> > > > To unsubscribe send an email to dev-le...@ceph.io >> >> > > > >> >> > > >> >> > ___ >> >> > ceph-users mailing list -- ceph-users@ceph.io >> >> > To unsubscribe send an email to ceph-users-le...@ceph.io >> >> >> >> >> >> >> >> -- >> >> Cheers, >> >> Venky >> >> >> ___ >> ceph-users mailing list -- ceph-users@ceph.io >> To unsubscribe send an email to ceph-users-le...@ceph.io ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: reef 18.2.1 QE Validation status
Redouane What would be a sufficient level of testing (tautology suite(s)) assuming this PR is approved to be added? On Mon, Nov 13, 2023 at 9:13 AM Redouane Kachach wrote: > > Hi Yuri, > > I've just backported to reef several fixes that I introduced in the last > months for the rook orchestrator. Most of them are fixes for dashboard > issues/crashes that only happen on Rook environments. The PR [1] has all the > changes and it was merged into reef this morning. We really need these > changes to be part of the next reef release as the upcoming Rook stable > version will be based on it. > > Please, can you include those changes in the upcoming reef 18.2.1 release? > > [1] https://github.com/ceph/ceph/pull/54224 > > Thanks a lot, > Redouane. > > > On Mon, Nov 13, 2023 at 6:03 PM Yuri Weinstein wrote: >> >> -- Forwarded message - >> From: Venky Shankar >> Date: Thu, Nov 9, 2023 at 11:52 PM >> Subject: Re: [ceph-users] Re: reef 18.2.1 QE Validation status >> To: Yuri Weinstein >> Cc: dev , ceph-users >> >> >> Hi Yuri, >> >> On Fri, Nov 10, 2023 at 4:55 AM Yuri Weinstein wrote: >> > >> > I've updated all approvals and merged PRs in the tracker and it looks >> > like we are ready for gibba, LRC upgrades pending approval/update from >> > Venky. >> >> The smoke test failure is caused by missing (kclient) patches in >> Ubuntu 20.04 that certain parts of the fs suite (via smoke tests) rely >> on. More details here >> >> https://tracker.ceph.com/issues/63488#note-8 >> >> The kclient tests in smoke pass with other distro's and the fs suite >> tests have been reviewed and look good. Run details are here >> >> https://tracker.ceph.com/projects/cephfs/wiki/Reef#07-Nov-2023 >> >> The smoke failure is noted as a known issue for now. Consider this run >> as "fs approved". >> >> > >> > On Thu, Nov 9, 2023 at 1:31 PM Radoslaw Zarzynski >> > wrote: >> > > >> > > rados approved! >> > > >> > > Details are here: >> > > https://tracker.ceph.com/projects/rados/wiki/REEF#1821-Review. >> > > >> > > On Mon, Nov 6, 2023 at 10:33 PM Yuri Weinstein >> > > wrote: >> > > > >> > > > Details of this release are summarized here: >> > > > >> > > > https://tracker.ceph.com/issues/63443#note-1 >> > > > >> > > > Seeking approvals/reviews for: >> > > > >> > > > smoke - Laura, Radek, Prashant, Venky (POOL_APP_NOT_ENABLE failures) >> > > > rados - Neha, Radek, Travis, Ernesto, Adam King >> > > > rgw - Casey >> > > > fs - Venky >> > > > orch - Adam King >> > > > rbd - Ilya >> > > > krbd - Ilya >> > > > upgrade/quincy-x (reef) - Laura PTL >> > > > powercycle - Brad >> > > > perf-basic - Laura, Prashant (POOL_APP_NOT_ENABLE failures) >> > > > >> > > > Please reply to this email with approval and/or trackers of known >> > > > issues/PRs to address them. >> > > > >> > > > TIA >> > > > YuriW >> > > > ___ >> > > > Dev mailing list -- d...@ceph.io >> > > > To unsubscribe send an email to dev-le...@ceph.io >> > > > >> > > >> > ___ >> > ceph-users mailing list -- ceph-users@ceph.io >> > To unsubscribe send an email to ceph-users-le...@ceph.io >> >> >> >> -- >> Cheers, >> Venky >> ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: reef 18.2.1 QE Validation status
Josh, Travis, Neha - I can't accept this change without your approval. Please reply. On Mon, Nov 13, 2023 at 9:13 AM Redouane Kachach wrote: > > Hi Yuri, > > I've just backported to reef several fixes that I introduced in the last > months for the rook orchestrator. Most of them are fixes for dashboard > issues/crashes that only happen on Rook environments. The PR [1] has all the > changes and it was merged into reef this morning. We really need these > changes to be part of the next reef release as the upcoming Rook stable > version will be based on it. > > Please, can you include those changes in the upcoming reef 18.2.1 release? > > [1] https://github.com/ceph/ceph/pull/54224 > > Thanks a lot, > Redouane. > > > On Mon, Nov 13, 2023 at 6:03 PM Yuri Weinstein wrote: >> >> -- Forwarded message - >> From: Venky Shankar >> Date: Thu, Nov 9, 2023 at 11:52 PM >> Subject: Re: [ceph-users] Re: reef 18.2.1 QE Validation status >> To: Yuri Weinstein >> Cc: dev , ceph-users >> >> >> Hi Yuri, >> >> On Fri, Nov 10, 2023 at 4:55 AM Yuri Weinstein wrote: >> > >> > I've updated all approvals and merged PRs in the tracker and it looks >> > like we are ready for gibba, LRC upgrades pending approval/update from >> > Venky. >> >> The smoke test failure is caused by missing (kclient) patches in >> Ubuntu 20.04 that certain parts of the fs suite (via smoke tests) rely >> on. More details here >> >> https://tracker.ceph.com/issues/63488#note-8 >> >> The kclient tests in smoke pass with other distro's and the fs suite >> tests have been reviewed and look good. Run details are here >> >> https://tracker.ceph.com/projects/cephfs/wiki/Reef#07-Nov-2023 >> >> The smoke failure is noted as a known issue for now. Consider this run >> as "fs approved". >> >> > >> > On Thu, Nov 9, 2023 at 1:31 PM Radoslaw Zarzynski >> > wrote: >> > > >> > > rados approved! >> > > >> > > Details are here: >> > > https://tracker.ceph.com/projects/rados/wiki/REEF#1821-Review. >> > > >> > > On Mon, Nov 6, 2023 at 10:33 PM Yuri Weinstein >> > > wrote: >> > > > >> > > > Details of this release are summarized here: >> > > > >> > > > https://tracker.ceph.com/issues/63443#note-1 >> > > > >> > > > Seeking approvals/reviews for: >> > > > >> > > > smoke - Laura, Radek, Prashant, Venky (POOL_APP_NOT_ENABLE failures) >> > > > rados - Neha, Radek, Travis, Ernesto, Adam King >> > > > rgw - Casey >> > > > fs - Venky >> > > > orch - Adam King >> > > > rbd - Ilya >> > > > krbd - Ilya >> > > > upgrade/quincy-x (reef) - Laura PTL >> > > > powercycle - Brad >> > > > perf-basic - Laura, Prashant (POOL_APP_NOT_ENABLE failures) >> > > > >> > > > Please reply to this email with approval and/or trackers of known >> > > > issues/PRs to address them. >> > > > >> > > > TIA >> > > > YuriW >> > > > ___ >> > > > Dev mailing list -- d...@ceph.io >> > > > To unsubscribe send an email to dev-le...@ceph.io >> > > > >> > > >> > ___ >> > ceph-users mailing list -- ceph-users@ceph.io >> > To unsubscribe send an email to ceph-users-le...@ceph.io >> >> >> >> -- >> Cheers, >> Venky >> ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: reef 18.2.1 QE Validation status
I've updated all approvals and merged PRs in the tracker and it looks like we are ready for gibba, LRC upgrades pending approval/update from Venky. On Thu, Nov 9, 2023 at 1:31 PM Radoslaw Zarzynski wrote: > > rados approved! > > Details are here: > https://tracker.ceph.com/projects/rados/wiki/REEF#1821-Review. > > On Mon, Nov 6, 2023 at 10:33 PM Yuri Weinstein wrote: > > > > Details of this release are summarized here: > > > > https://tracker.ceph.com/issues/63443#note-1 > > > > Seeking approvals/reviews for: > > > > smoke - Laura, Radek, Prashant, Venky (POOL_APP_NOT_ENABLE failures) > > rados - Neha, Radek, Travis, Ernesto, Adam King > > rgw - Casey > > fs - Venky > > orch - Adam King > > rbd - Ilya > > krbd - Ilya > > upgrade/quincy-x (reef) - Laura PTL > > powercycle - Brad > > perf-basic - Laura, Prashant (POOL_APP_NOT_ENABLE failures) > > > > Please reply to this email with approval and/or trackers of known > > issues/PRs to address them. > > > > TIA > > YuriW > > ___ > > Dev mailing list -- d...@ceph.io > > To unsubscribe send an email to dev-le...@ceph.io > > > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: reef 18.2.1 QE Validation status
On Wed, Nov 8, 2023 at 6:33 AM Travis Nielsen wrote: > > Yuri, we need to add this issue as a blocker for 18.2.1. We discovered this > issue after the release of 17.2.7, and don't want to hit the same blocker in > 18.2.1 where some types of OSDs are failing to be created in new clusters, or > failing to start in upgraded clusters. > https://tracker.ceph.com/issues/63391 https://tracker.ceph.com/issues/63391 was resolved and https://github.com/ceph/ceph/pull/54395/ merged > > Thanks! > Travis > > On Wed, Nov 8, 2023 at 4:41 AM Venky Shankar wrote: >> >> Hi Yuri, >> >> On Wed, Nov 8, 2023 at 2:32 AM Yuri Weinstein wrote: >> > >> > 3 PRs above mentioned were merged and I am returning some tests: >> > https://pulpito.ceph.com/?sha1=55e3239498650453ff76a9b06a37f1a6f488c8fd >> > >> > Still seeing approvals. >> > smoke - Laura, Radek, Prashant, Venky in progress >> > rados - Neha, Radek, Travis, Ernesto, Adam King >> > rgw - Casey in progress >> > fs - Venky >> >> There's a failure in the fs suite >> >> >> https://pulpito.ceph.com/vshankar-2023-11-07_05:14:36-fs-reef-release-distro-default-smithi/7450325/ >> >> Seems to be related to nfs-ganesha. I've reached out to Frank Filz >> (#cephfs on ceph slack) to have a look. WIll update as soon as >> possible. >> >> > orch - Adam King >> > rbd - Ilya approved >> > krbd - Ilya approved >> > upgrade/quincy-x (reef) - Laura PTL >> > powercycle - Brad >> > perf-basic - in progress >> > >> > >> > On Tue, Nov 7, 2023 at 8:38 AM Casey Bodley wrote: >> > > >> > > On Mon, Nov 6, 2023 at 4:31 PM Yuri Weinstein >> > > wrote: >> > > > >> > > > Details of this release are summarized here: >> > > > >> > > > https://tracker.ceph.com/issues/63443#note-1 >> > > > >> > > > Seeking approvals/reviews for: >> > > > >> > > > smoke - Laura, Radek, Prashant, Venky (POOL_APP_NOT_ENABLE failures) >> > > > rados - Neha, Radek, Travis, Ernesto, Adam King >> > > > rgw - Casey >> > > >> > > rgw results are approved. https://github.com/ceph/ceph/pull/54371 >> > > merged to reef but is needed on reef-release >> > > >> > > > fs - Venky >> > > > orch - Adam King >> > > > rbd - Ilya >> > > > krbd - Ilya >> > > > upgrade/quincy-x (reef) - Laura PTL >> > > > powercycle - Brad >> > > > perf-basic - Laura, Prashant (POOL_APP_NOT_ENABLE failures) >> > > > >> > > > Please reply to this email with approval and/or trackers of known >> > > > issues/PRs to address them. >> > > > >> > > > TIA >> > > > YuriW >> > > > ___ >> > > > ceph-users mailing list -- ceph-users@ceph.io >> > > > To unsubscribe send an email to ceph-users-le...@ceph.io >> > > > >> > > >> > ___ >> > ceph-users mailing list -- ceph-users@ceph.io >> > To unsubscribe send an email to ceph-users-le...@ceph.io >> >> >> >> -- >> Cheers, >> Venky >> ___ >> Dev mailing list -- d...@ceph.io >> To unsubscribe send an email to dev-le...@ceph.io ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: reef 18.2.1 QE Validation status
We merged 3 PRs and rebuilt "reef-release" (Build 2) Seeking approvals/reviews for: smoke - Laura, Radek 2 jobs failed in "objectstore/bluestore" tests (see Build 2) rados - Neha, Radek, Travis, Ernesto, Adam King rgw - Casey reapprove on Build 2 fs - Venky, approve on Build 2 orch - Adam King upgrade/quincy-x (reef) - Laura PTL powercycle - Brad (known issues) We need to close https://tracker.ceph.com/issues/63391 (https://github.com/ceph/ceph/pull/54392) - Travis, Guillaume https://tracker.ceph.com/issues/63151 - Adam King do we need anything for this? On Wed, Nov 8, 2023 at 6:33 AM Travis Nielsen wrote: > > Yuri, we need to add this issue as a blocker for 18.2.1. We discovered this > issue after the release of 17.2.7, and don't want to hit the same blocker in > 18.2.1 where some types of OSDs are failing to be created in new clusters, or > failing to start in upgraded clusters. > https://tracker.ceph.com/issues/63391 > > Thanks! > Travis > > On Wed, Nov 8, 2023 at 4:41 AM Venky Shankar wrote: >> >> Hi Yuri, >> >> On Wed, Nov 8, 2023 at 2:32 AM Yuri Weinstein wrote: >> > >> > 3 PRs above mentioned were merged and I am returning some tests: >> > https://pulpito.ceph.com/?sha1=55e3239498650453ff76a9b06a37f1a6f488c8fd >> > >> > Still seeing approvals. >> > smoke - Laura, Radek, Prashant, Venky in progress >> > rados - Neha, Radek, Travis, Ernesto, Adam King >> > rgw - Casey in progress >> > fs - Venky >> >> There's a failure in the fs suite >> >> >> https://pulpito.ceph.com/vshankar-2023-11-07_05:14:36-fs-reef-release-distro-default-smithi/7450325/ >> >> Seems to be related to nfs-ganesha. I've reached out to Frank Filz >> (#cephfs on ceph slack) to have a look. WIll update as soon as >> possible. >> >> > orch - Adam King >> > rbd - Ilya approved >> > krbd - Ilya approved >> > upgrade/quincy-x (reef) - Laura PTL >> > powercycle - Brad >> > perf-basic - in progress >> > >> > >> > On Tue, Nov 7, 2023 at 8:38 AM Casey Bodley wrote: >> > > >> > > On Mon, Nov 6, 2023 at 4:31 PM Yuri Weinstein >> > > wrote: >> > > > >> > > > Details of this release are summarized here: >> > > > >> > > > https://tracker.ceph.com/issues/63443#note-1 >> > > > >> > > > Seeking approvals/reviews for: >> > > > >> > > > smoke - Laura, Radek, Prashant, Venky (POOL_APP_NOT_ENABLE failures) >> > > > rados - Neha, Radek, Travis, Ernesto, Adam King >> > > > rgw - Casey >> > > >> > > rgw results are approved. https://github.com/ceph/ceph/pull/54371 >> > > merged to reef but is needed on reef-release >> > > >> > > > fs - Venky >> > > > orch - Adam King >> > > > rbd - Ilya >> > > > krbd - Ilya >> > > > upgrade/quincy-x (reef) - Laura PTL >> > > > powercycle - Brad >> > > > perf-basic - Laura, Prashant (POOL_APP_NOT_ENABLE failures) >> > > > >> > > > Please reply to this email with approval and/or trackers of known >> > > > issues/PRs to address them. >> > > > >> > > > TIA >> > > > YuriW >> > > > ___ >> > > > ceph-users mailing list -- ceph-users@ceph.io >> > > > To unsubscribe send an email to ceph-users-le...@ceph.io >> > > > >> > > >> > ___ >> > ceph-users mailing list -- ceph-users@ceph.io >> > To unsubscribe send an email to ceph-users-le...@ceph.io >> >> >> >> -- >> Cheers, >> Venky >> ___ >> Dev mailing list -- d...@ceph.io >> To unsubscribe send an email to dev-le...@ceph.io ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: reef 18.2.1 QE Validation status
3 PRs above mentioned were merged and I am returning some tests: https://pulpito.ceph.com/?sha1=55e3239498650453ff76a9b06a37f1a6f488c8fd Still seeing approvals. smoke - Laura, Radek, Prashant, Venky in progress rados - Neha, Radek, Travis, Ernesto, Adam King rgw - Casey in progress fs - Venky orch - Adam King rbd - Ilya approved krbd - Ilya approved upgrade/quincy-x (reef) - Laura PTL powercycle - Brad perf-basic - in progress On Tue, Nov 7, 2023 at 8:38 AM Casey Bodley wrote: > > On Mon, Nov 6, 2023 at 4:31 PM Yuri Weinstein wrote: > > > > Details of this release are summarized here: > > > > https://tracker.ceph.com/issues/63443#note-1 > > > > Seeking approvals/reviews for: > > > > smoke - Laura, Radek, Prashant, Venky (POOL_APP_NOT_ENABLE failures) > > rados - Neha, Radek, Travis, Ernesto, Adam King > > rgw - Casey > > rgw results are approved. https://github.com/ceph/ceph/pull/54371 > merged to reef but is needed on reef-release > > > fs - Venky > > orch - Adam King > > rbd - Ilya > > krbd - Ilya > > upgrade/quincy-x (reef) - Laura PTL > > powercycle - Brad > > perf-basic - Laura, Prashant (POOL_APP_NOT_ENABLE failures) > > > > Please reply to this email with approval and/or trackers of known > > issues/PRs to address them. > > > > TIA > > YuriW > > ___ > > ceph-users mailing list -- ceph-users@ceph.io > > To unsubscribe send an email to ceph-users-le...@ceph.io > > > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] reef 18.2.1 QE Validation status
Details of this release are summarized here: https://tracker.ceph.com/issues/63443#note-1 Seeking approvals/reviews for: smoke - Laura, Radek, Prashant, Venky (POOL_APP_NOT_ENABLE failures) rados - Neha, Radek, Travis, Ernesto, Adam King rgw - Casey fs - Venky orch - Adam King rbd - Ilya krbd - Ilya upgrade/quincy-x (reef) - Laura PTL powercycle - Brad perf-basic - Laura, Prashant (POOL_APP_NOT_ENABLE failures) Please reply to this email with approval and/or trackers of known issues/PRs to address them. TIA YuriW ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] v17.2.7 Quincy released
We're happy to announce the 7th backport release in the Quincy series. https://ceph.io/en/news/blog/2023/v17-2-7-quincy-released/ Notable Changes --- * `ceph mgr dump` command now displays the name of the Manager module that registered a RADOS client in the `name` field added to elements of the `active_clients` array. Previously, only the address of a module's RADOS client was shown in the `active_clients` array. * mClock Scheduler: The mClock scheduler (default scheduler in Quincy) has undergone significant usability and design improvements to address the slow backfill issue. Some important changes are: * The 'balanced' profile is set as the default mClock profile because it represents a compromise between prioritizing client IO or recovery IO. Users can then choose either the 'high_client_ops' profile to prioritize client IO or the 'high_recovery_ops' profile to prioritize recovery IO. * QoS parameters including reservation and limit are now specified in terms of a fraction (range: 0.0 to 1.0) of the OSD's IOPS capacity. * The cost parameters (osd_mclock_cost_per_io_usec_* and osd_mclock_cost_per_byte_usec_*) have been removed. The cost of an operation is now determined using the random IOPS and maximum sequential bandwidth capability of the OSD's underlying device. * Degraded object recovery is given higher priority when compared to misplaced object recovery because degraded objects present a data safety issue not present with objects that are merely misplaced. Therefore, backfilling operations with the 'balanced' and 'high_client_ops' mClock profiles may progress slower than what was seen with the 'WeightedPriorityQueue' (WPQ) scheduler. * The QoS allocations in all mClock profiles are optimized based on the above fixes and enhancements. * For more detailed information see: https://docs.ceph.com/en/quincy/rados/configuration/mclock-config-ref/ * RGW: S3 multipart uploads using Server-Side Encryption now replicate correctly in multi-site. Previously, the replicas of such objects were corrupted on decryption. A new tool, ``radosgw-admin bucket resync encrypted multipart``, can be used to identify these original multipart uploads. The ``LastModified`` timestamp of any identified object is incremented by 1 nanosecond to cause peer zones to replicate it again. For multi-site deployments that make any use of Server-Side Encryption, we recommended running this command against every bucket in every zone after all zones have upgraded. * CephFS: MDS evicts clients which are not advancing their request tids which causes a large buildup of session metadata resulting in the MDS going read-only due to the RADOS operation exceeding the size threshold. `mds_session_metadata_threshold` config controls the maximum size that a (encoded) session metadata can grow. * CephFS: After recovering a Ceph File System post following the disaster recovery procedure, the recovered files under `lost+found` directory can now be deleted. Getting Ceph * Git at git://github.com/ceph/ceph.git * Tarball at https://download.ceph.com/tarballs/ceph-17.2.7.tar.gz * Containers at https://quay.io/repository/ceph/ceph * For packages, see https://docs.ceph.com/en/latest/install/get-packages/ * Release git sha1: b12291d110049b2f35e32e0de30d70e9a4c060d2 ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: quincy v17.2.7 QE Validation status
If no one has anything else left, we have all issues resolved and ready for the 17.2.7 release On Mon, Oct 23, 2023 at 8:12 AM Laura Flores wrote: > > Regarding the crash in quincy-p2p (tracked in > https://tracker.ceph.com/issues/63257), @Prashant Dhange > and I evaluated it, and we've concluded it isn't a > blocker for 17.2.7. > > So, quincy-p2p is approved. > > Thanks, > Laura > > > > On Sat, Oct 21, 2023 at 12:27 AM Venky Shankar wrote: > > > Hi Yuri, > > > > On Fri, Oct 20, 2023 at 9:44 AM Venky Shankar wrote: > > > > > > Hi Yuri, > > > > > > On Thu, Oct 19, 2023 at 10:48 PM Venky Shankar > > wrote: > > > > > > > > Hi Yuri, > > > > > > > > On Thu, Oct 19, 2023 at 9:32 PM Yuri Weinstein > > wrote: > > > > > > > > > > We are still finishing off: > > > > > > > > > > - revert PR https://github.com/ceph/ceph/pull/54085, needs smoke > > suite rerun > > > > > - removed s3tests https://github.com/ceph/ceph/pull/54078 merged > > > > > > > > > > Venky, Casey FYI > > > > > > > > https://github.com/ceph/ceph/pull/53139 is causing a smoke test > > > > failure. Details: > > > > https://github.com/ceph/ceph/pull/53139#issuecomment-1771388202 > > > > > > > > I've sent a revert for that change - > > > > https://github.com/ceph/ceph/pull/54108 - will let you know when it's > > > > ready for testing. > > > > > > smoke passes with this revert > > > > > > > > https://pulpito.ceph.com/vshankar-2023-10-19_20:24:36-smoke-wip-vshankar-testing-quincy-20231019.172112-testing-default-smithi/ > > > > > > fs suite running now... > > > > Test results are here - > > https://tracker.ceph.com/projects/cephfs/wiki/Quincy#2023-October-19 > > > > Yuri, please merge change - https://github.com/ceph/ceph/pull/54108 > > > > and consider this as "fs approved". > > > > > > > > > > > > > > > > > > > On Wed, Oct 18, 2023 at 9:07 PM Venky Shankar > > wrote: > > > > > > > > > > > > On Tue, Oct 17, 2023 at 12:23 AM Yuri Weinstein < > > ywein...@redhat.com> wrote: > > > > > > > > > > > > > > Details of this release are summarized here: > > > > > > > > > > > > > > https://tracker.ceph.com/issues/63219#note-2 > > > > > > > Release Notes - TBD > > > > > > > > > > > > > > Issue https://tracker.ceph.com/issues/63192 appears to be > > failing several runs. > > > > > > > Should it be fixed for this release? > > > > > > > > > > > > > > Seeking approvals/reviews for: > > > > > > > > > > > > > > smoke - Laura > > > > > > > > > > > > There's one failure in the smoke tests > > > > > > > > > > > > > > https://pulpito.ceph.com/yuriw-2023-10-18_14:58:31-smoke-quincy-release-distro-default-smithi/ > > > > > > > > > > > > caused by > > > > > > > > > > > > https://github.com/ceph/ceph/pull/53647 > > > > > > > > > > > > (which was marked DNM but got merged). However, it's a test case > > thing > > > > > > and we can live with it. > > > > > > > > > > > > Yuri mention in slack that he might do another round of > > build/tests, > > > > > > so, Yuri, here's the reverted change: > > > > > > > > > > > >https://github.com/ceph/ceph/pull/54085 > > > > > > > > > > > > > rados - Laura, Radek, Travis, Ernesto, Adam King > > > > > > > > > > > > > > rgw - Casey > > > > > > > fs - Venky > > > > > > > orch - Adam King > > > > > > > > > > > > > > rbd - Ilya > > > > > > > krbd - Ilya > > > > > > > > > > > > > > upgrade/quincy-p2p - Known issue IIRC, Casey pls confirm/approve > > > > > > > > > > > > > > client-upgrade-quincy-reef - Laura > > > > > > > > > > > > > > powercycle - Brad pls confirm > > > > > > > > > > > > > > ceph-volume - Guillaume pls take a look > > > > > > > > > > > > > > Please reply to this email with approval and/or trackers of known > > > > > > > issues/PRs to address them. > > > > > > > > > > > > > > Josh, Neha - gibba and LRC upgrades -- N/A for quincy now after > > reef release. > > > > > > > > > > > > > > Thx > > > > > > > YuriW > > > > > > > ___ > > > > > > > ceph-users mailing list -- ceph-users@ceph.io > > > > > > > To unsubscribe send an email to ceph-users-le...@ceph.io > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > Cheers, > > > > > > Venky > > > > > > > > > > > > > > > > > > > > > > > -- > > > > Cheers, > > > > Venky > > > > > > > > > > > > -- > > > Cheers, > > > Venky > > > > > > > > -- > > Cheers, > > Venky > > ___ > > ceph-users mailing list -- ceph-users@ceph.io > > To unsubscribe send an email to ceph-users-le...@ceph.io > > > > > -- > > Laura Flores > > She/Her/Hers > > Software Engineer, Ceph Storage <https://ceph.io> > > Chicago, IL > > lflo...@ibm.com | lflo...@redhat.com > M: +17087388804 > ___ > ceph-users mailing list -- ceph-users@ceph.io > To unsubscribe send an email to ceph-users-le...@ceph.io ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: quincy v17.2.7 QE Validation status
We are still finishing off: - revert PR https://github.com/ceph/ceph/pull/54085, needs smoke suite rerun - removed s3tests https://github.com/ceph/ceph/pull/54078 merged Venky, Casey FYI On Wed, Oct 18, 2023 at 9:07 PM Venky Shankar wrote: > > On Tue, Oct 17, 2023 at 12:23 AM Yuri Weinstein wrote: > > > > Details of this release are summarized here: > > > > https://tracker.ceph.com/issues/63219#note-2 > > Release Notes - TBD > > > > Issue https://tracker.ceph.com/issues/63192 appears to be failing several > > runs. > > Should it be fixed for this release? > > > > Seeking approvals/reviews for: > > > > smoke - Laura > > There's one failure in the smoke tests > > > https://pulpito.ceph.com/yuriw-2023-10-18_14:58:31-smoke-quincy-release-distro-default-smithi/ > > caused by > > https://github.com/ceph/ceph/pull/53647 > > (which was marked DNM but got merged). However, it's a test case thing > and we can live with it. > > Yuri mention in slack that he might do another round of build/tests, > so, Yuri, here's the reverted change: > >https://github.com/ceph/ceph/pull/54085 > > > rados - Laura, Radek, Travis, Ernesto, Adam King > > > > rgw - Casey > > fs - Venky > > orch - Adam King > > > > rbd - Ilya > > krbd - Ilya > > > > upgrade/quincy-p2p - Known issue IIRC, Casey pls confirm/approve > > > > client-upgrade-quincy-reef - Laura > > > > powercycle - Brad pls confirm > > > > ceph-volume - Guillaume pls take a look > > > > Please reply to this email with approval and/or trackers of known > > issues/PRs to address them. > > > > Josh, Neha - gibba and LRC upgrades -- N/A for quincy now after reef > > release. > > > > Thx > > YuriW > > ___ > > ceph-users mailing list -- ceph-users@ceph.io > > To unsubscribe send an email to ceph-users-le...@ceph.io > > > > > -- > Cheers, > Venky > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: quincy v17.2.7 QE Validation status
Ok I merged all PRs known to me. If I hear no objections I will start the building (Casey FYI -> and will in parallel run quicny-p2p) On Wed, Oct 18, 2023 at 11:44 AM Yuri Weinstein wrote: > > Per our chat with Casey, we will remove s3tests and include > https://github.com/ceph/ceph/pull/54078 into 17.2.7 > > On Wed, Oct 18, 2023 at 9:30 AM Casey Bodley wrote: > > > > On Mon, Oct 16, 2023 at 2:52 PM Yuri Weinstein wrote: > > > > > > Details of this release are summarized here: > > > > > > https://tracker.ceph.com/issues/63219#note-2 > > > Release Notes - TBD > > > > > > Issue https://tracker.ceph.com/issues/63192 appears to be failing several > > > runs. > > > Should it be fixed for this release? > > > > > > Seeking approvals/reviews for: > > > > > > smoke - Laura > > > rados - Laura, Radek, Travis, Ernesto, Adam King > > > > > > rgw - Casey > > > fs - Venky > > > orch - Adam King > > > > > > rbd - Ilya > > > krbd - Ilya > > > > > > upgrade/quincy-p2p - Known issue IIRC, Casey pls confirm/approve > > > > sorry, missed this part > > > > these point-to-point upgrade tests are failing because they're running > > s3-tests against older quincy releases that don't have fixes for the > > bugs they're testing. we don't maintain separate tests for each point > > release, so we can't expect these upgrade tests to pass in general > > > > specifically: > > test_post_object_wrong_bucket is failing because it requires the > > 17.2.7 fix from https://github.com/ceph/ceph/pull/53757 > > test_set_bucket_tagging is failing because it requires the 17.2.7 fix > > from https://github.com/ceph/ceph/pull/50103 > > > > so the rgw failures are expected, but i can't tell whether they're > > masking other important upgrade test coverage > > > > > > > > client-upgrade-quincy-reef - Laura > > > > > > powercycle - Brad pls confirm > > > > > > ceph-volume - Guillaume pls take a look > > > > > > Please reply to this email with approval and/or trackers of known > > > issues/PRs to address them. > > > > > > Josh, Neha - gibba and LRC upgrades -- N/A for quincy now after reef > > > release. > > > > > > Thx > > > YuriW > > > ___ > > > Dev mailing list -- d...@ceph.io > > > To unsubscribe send an email to dev-le...@ceph.io > > > > > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: quincy v17.2.7 QE Validation status
Per our chat with Casey, we will remove s3tests and include https://github.com/ceph/ceph/pull/54078 into 17.2.7 On Wed, Oct 18, 2023 at 9:30 AM Casey Bodley wrote: > > On Mon, Oct 16, 2023 at 2:52 PM Yuri Weinstein wrote: > > > > Details of this release are summarized here: > > > > https://tracker.ceph.com/issues/63219#note-2 > > Release Notes - TBD > > > > Issue https://tracker.ceph.com/issues/63192 appears to be failing several > > runs. > > Should it be fixed for this release? > > > > Seeking approvals/reviews for: > > > > smoke - Laura > > rados - Laura, Radek, Travis, Ernesto, Adam King > > > > rgw - Casey > > fs - Venky > > orch - Adam King > > > > rbd - Ilya > > krbd - Ilya > > > > upgrade/quincy-p2p - Known issue IIRC, Casey pls confirm/approve > > sorry, missed this part > > these point-to-point upgrade tests are failing because they're running > s3-tests against older quincy releases that don't have fixes for the > bugs they're testing. we don't maintain separate tests for each point > release, so we can't expect these upgrade tests to pass in general > > specifically: > test_post_object_wrong_bucket is failing because it requires the > 17.2.7 fix from https://github.com/ceph/ceph/pull/53757 > test_set_bucket_tagging is failing because it requires the 17.2.7 fix > from https://github.com/ceph/ceph/pull/50103 > > so the rgw failures are expected, but i can't tell whether they're > masking other important upgrade test coverage > > > > > client-upgrade-quincy-reef - Laura > > > > powercycle - Brad pls confirm > > > > ceph-volume - Guillaume pls take a look > > > > Please reply to this email with approval and/or trackers of known > > issues/PRs to address them. > > > > Josh, Neha - gibba and LRC upgrades -- N/A for quincy now after reef > > release. > > > > Thx > > YuriW > > ___ > > Dev mailing list -- d...@ceph.io > > To unsubscribe send an email to dev-le...@ceph.io > > > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] quincy v17.2.7 QE Validation status
Details of this release are summarized here: https://tracker.ceph.com/issues/63219#note-2 Release Notes - TBD Issue https://tracker.ceph.com/issues/63192 appears to be failing several runs. Should it be fixed for this release? Seeking approvals/reviews for: smoke - Laura rados - Laura, Radek, Travis, Ernesto, Adam King rgw - Casey fs - Venky orch - Adam King rbd - Ilya krbd - Ilya upgrade/quincy-p2p - Known issue IIRC, Casey pls confirm/approve client-upgrade-quincy-reef - Laura powercycle - Brad pls confirm ceph-volume - Guillaume pls take a look Please reply to this email with approval and/or trackers of known issues/PRs to address them. Josh, Neha - gibba and LRC upgrades -- N/A for quincy now after reef release. Thx YuriW ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: Next quincy point release 17.2.7
We've merged some PRs, and some are in testing now. At this point, we will not add more PRs to 17.2.7. Thank you for your help! On Wed, Oct 4, 2023 at 1:57 PM Yuri Weinstein wrote: > > Hello > > We are getting very close to the next Quincy point release 17.2.7 > > Here is the list of must-have PRs https://pad.ceph.com/p/quincy_17.2.7_prs > We will start the release testing/review/approval process as soon as > all PRs from this list are merged. > > If you see something missing please speak up and the dev leads will > make a decision on including it in this release. > > TIA ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Next quincy point release 17.2.7
Hello We are getting very close to the next Quincy point release 17.2.7 Here is the list of must-have PRs https://pad.ceph.com/p/quincy_17.2.7_prs We will start the release testing/review/approval process as soon as all PRs from this list are merged. If you see something missing please speak up and the dev leads will make a decision on including it in this release. TIA ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: Pacific 16.2.14 debian Incomplete
We redeployed all packages again. Please confirm that the issue is resolved. Thank you for your help and patience! On Wed, Aug 30, 2023 at 3:44 PM Zakhar Kirpichenko wrote: > > Now the release email comes and the repositories are still missing packages. > What a mess. > > /Z > > On Wed, 30 Aug 2023 at 19:27, Yuri Weinstein wrote: >> >> 16.2.14 has not been released yet. >> >> Please don't do any upgrades before we send an announcement email. >> >> TIA >> >> On Wed, Aug 30, 2023 at 8:45 AM Reed Dier wrote: >> > >> > It looks like 16.2.14 was released, but it looks like in an incomplete way >> > in the debian repo? >> > >> > I first noticed it because my nightly mirror snapshot picked it up, and >> > showed that the majority of packages were removed, and only a handful had >> > a new version. >> > >> > focal-ceph-pacific 230829 to 230830 >> > Arch | Package | Version in A >> > | Version in B >> > - all| ceph-grafana-dashboards | 16.2.13-1focal >> > | - >> > - all| ceph-mgr-cephadm | 16.2.13-1focal >> > | - >> > ! all| ceph-mgr-dashboard | 16.2.13-1focal >> > | 16.2.14-1focal >> > - all| ceph-mgr-diskprediction-local| 16.2.13-1focal >> > | - >> > - all| ceph-mgr-k8sevents | 16.2.13-1focal >> > | - >> > - all| ceph-mgr-modules-core| 16.2.13-1focal >> > | - >> > - all| ceph-mgr-rook| 16.2.13-1focal >> > | - >> > ! all| ceph-prometheus-alerts | 16.2.13-1focal >> > | 16.2.14-1focal >> > - all| cephfs-shell | 16.2.13-1focal >> > | - >> > - all| cephfs-top | 16.2.13-1focal >> > | - >> > - all| libcephfs-java | 16.2.13-1focal >> > | - >> > ! all| python3-ceph-argparse| 16.2.13-1focal >> > | 16.2.14-1focal >> > ! all| python3-ceph-common | 16.2.13-1focal >> > | 16.2.14-1focal >> > - amd64 | ceph | 16.2.13-1focal >> > | - >> > ! amd64 | ceph-base| 16.2.13-1focal >> > | 16.2.14-1focal >> > ! amd64 | ceph-base-dbg| 16.2.13-1focal >> > | 16.2.14-1focal >> > - amd64 | ceph-common | 16.2.13-1focal >> > | - >> > - amd64 | ceph-common-dbg | 16.2.13-1focal >> > | - >> > - amd64 | ceph-fuse| 16.2.13-1focal >> > | - >> > - amd64 | ceph-fuse-dbg| 16.2.13-1focal >> > | - >> > - amd64 | ceph-immutable-object-cache | 16.2.13-1focal >> > | - >> > - amd64 | ceph-immutable-object-cache-dbg | 16.2.13-1focal >> > | - >> > - amd64 | ceph-mds | 16.2.13-1focal >> > | - >> > - amd64 | ceph-mds-dbg | 16.2.13-1focal >> > | - >> > - amd64 | ceph-mgr | 16.2.13-1focal >> > | - >> > - amd64 | ceph-mgr-dbg | 16.2.13-1focal >> > | - >> > - amd64 | ceph-mon | 16.2.13-1focal >> > | - >> > - amd64 | ceph-mon-dbg | 16.2.13-1focal >> > | - >> > - amd64 | ceph-osd | 16.2.13-1focal >> > | - >> > - amd64 | ceph-osd-dbg
[ceph-users] v16.2.14 Pacific released
We're happy to announce the 14th backport release in the Pacific series. https://ceph.io/en/news/blog/2023/v16-2-14-pacific-released/ Notable Changes --- * CEPHFS: After recovering a Ceph File System post following the disaster recovery procedure, the recovered files under lost+found directory can now be deleted. * ceph mgr dump command now displays the name of the mgr module that registered a RADOS client in the name field added to elements of the active_clients array. Previously, only the address of a module's RADOS client was shown in the active_clients array. Getting Ceph * Git at git://github.com/ceph/ceph.git * Tarball at https://download.ceph.com/tarballs/ceph-16.2.14.tar.gz * Containers at https://quay.io/repository/ceph/ceph * For packages, see https://docs.ceph.com/en/latest/install/get-packages/ * Release git sha1: 238ba602515df21ea7ffc75c88db29f9e5ef12c9 ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: Pacific 16.2.14 debian Incomplete
16.2.14 has not been released yet. Please don't do any upgrades before we send an announcement email. TIA On Wed, Aug 30, 2023 at 8:45 AM Reed Dier wrote: > > It looks like 16.2.14 was released, but it looks like in an incomplete way in > the debian repo? > > I first noticed it because my nightly mirror snapshot picked it up, and > showed that the majority of packages were removed, and only a handful had a > new version. > > focal-ceph-pacific 230829 to 230830 > Arch | Package | Version in A > | Version in B > - all| ceph-grafana-dashboards | 16.2.13-1focal > | - > - all| ceph-mgr-cephadm | 16.2.13-1focal > | - > ! all| ceph-mgr-dashboard | 16.2.13-1focal > | 16.2.14-1focal > - all| ceph-mgr-diskprediction-local| 16.2.13-1focal > | - > - all| ceph-mgr-k8sevents | 16.2.13-1focal > | - > - all| ceph-mgr-modules-core| 16.2.13-1focal > | - > - all| ceph-mgr-rook| 16.2.13-1focal > | - > ! all| ceph-prometheus-alerts | 16.2.13-1focal > | 16.2.14-1focal > - all| cephfs-shell | 16.2.13-1focal > | - > - all| cephfs-top | 16.2.13-1focal > | - > - all| libcephfs-java | 16.2.13-1focal > | - > ! all| python3-ceph-argparse| 16.2.13-1focal > | 16.2.14-1focal > ! all| python3-ceph-common | 16.2.13-1focal > | 16.2.14-1focal > - amd64 | ceph | 16.2.13-1focal > | - > ! amd64 | ceph-base| 16.2.13-1focal > | 16.2.14-1focal > ! amd64 | ceph-base-dbg| 16.2.13-1focal > | 16.2.14-1focal > - amd64 | ceph-common | 16.2.13-1focal > | - > - amd64 | ceph-common-dbg | 16.2.13-1focal > | - > - amd64 | ceph-fuse| 16.2.13-1focal > | - > - amd64 | ceph-fuse-dbg| 16.2.13-1focal > | - > - amd64 | ceph-immutable-object-cache | 16.2.13-1focal > | - > - amd64 | ceph-immutable-object-cache-dbg | 16.2.13-1focal > | - > - amd64 | ceph-mds | 16.2.13-1focal > | - > - amd64 | ceph-mds-dbg | 16.2.13-1focal > | - > - amd64 | ceph-mgr | 16.2.13-1focal > | - > - amd64 | ceph-mgr-dbg | 16.2.13-1focal > | - > - amd64 | ceph-mon | 16.2.13-1focal > | - > - amd64 | ceph-mon-dbg | 16.2.13-1focal > | - > - amd64 | ceph-osd | 16.2.13-1focal > | - > - amd64 | ceph-osd-dbg | 16.2.13-1focal > | - > - amd64 | ceph-resource-agents | 16.2.13-1focal > | - > - amd64 | ceph-test| 16.2.13-1focal > | - > - amd64 | ceph-test-dbg| 16.2.13-1focal > | - > - amd64 | cephadm | 16.2.13-1focal > | - > - amd64 | cephfs-mirror| 16.2.13-1focal > | - > - amd64 | cephfs-mirror-dbg| 16.2.13-1focal > | - > - amd64 | libcephfs-dev| 16.2.13-1focal > | - > - amd64 | libcephfs-jni| 16.2.13-1focal > | - > - amd64 | libcephfs2 | 16.2.13-1focal > | - > - amd64 | libcephfs2-dbg | 16.2.13-1focal > | - > - amd64 | libjaeger| 16.2.13-1focal > | - > - amd64 | librados-dev | 16.2.13-1focal
[ceph-users] Re: 16.2.14 pacific QE validation status
I am waiting for checks to pass and will merge one remaining PR https://github.com/ceph/ceph/pull/53157 And will start the build as soon as it is merged. On Mon, Aug 28, 2023 at 4:57 AM Adam King wrote: > cephadm piece of rados can be approved. Failures all look known to me. > > On Fri, Aug 25, 2023 at 4:06 PM Radoslaw Zarzynski > wrote: > >> rados approved >> >> On Thu, Aug 24, 2023 at 12:33 AM Laura Flores wrote: >> >>> Rados summary is here: >>> https://tracker.ceph.com/projects/rados/wiki/PACIFIC#Pacific-v16214-httpstrackercephcomissues62527note-1 >>> >>> Most are known, except for two new trackers I raised: >>> >>>1. https://tracker.ceph.com/issues/62557 - rados/dashboard: >>>Teuthology test failure due to "MDS_CLIENTS_LAGGY" warning - Ceph - RADOS >>>2. https://tracker.ceph.com/issues/62559 - rados/cephadm/dashboard: >>>test times out due to host stuck in maintenance mode - Ceph - >>> Orchestrator >>> >>> #1 is related to a similar issue we saw where the MDS_CLIENTS_LAGGY >>> warning was coming up in the Jenkins api check, where these kinds of >>> conditions are expected. In that case, I would call #1 more of a test >>> issue, and say that the fix is to whitelist the warning for that test. >>> Would be good to have someone from CephFS weigh in though-- @Patrick >>> Donnelly @Dhairya Parmar >>> >>> #2 looks new to me. @Adam King can you take a look >>> and see if it's something to be concerned about? The same test failed for a >>> different reason in the rerun, so the failure did not reproduce. >>> >>> On Wed, Aug 23, 2023 at 1:08 PM Laura Flores wrote: >>> >>>> Thanks Yuri! I will take a look for rados and get back to this thread. >>>> >>>> On Wed, Aug 23, 2023 at 9:41 AM Yuri Weinstein >>>> wrote: >>>> >>>>> Details of this release are summarized here: >>>>> >>>>> https://tracker.ceph.com/issues/62527#note-1 >>>>> Release Notes - TBD >>>>> >>>>> Seeking approvals for: >>>>> >>>>> smoke - Venky >>>>> rados - Radek, Laura >>>>> rook - Sébastien Han >>>>> cephadm - Adam K >>>>> dashboard - Ernesto >>>>> >>>>> rgw - Casey >>>>> rbd - Ilya >>>>> krbd - Ilya >>>>> fs - Venky, Patrick >>>>> >>>>> upgrade/pacific-p2p - Laura >>>>> powercycle - Brad (SELinux denials) >>>>> >>>>> >>>>> Thx >>>>> YuriW >>>>> ___ >>>>> ceph-users mailing list -- ceph-users@ceph.io >>>>> To unsubscribe send an email to ceph-users-le...@ceph.io >>>>> >>>> >>>> >>>> -- >>>> >>>> Laura Flores >>>> >>>> She/Her/Hers >>>> >>>> Software Engineer, Ceph Storage <https://ceph.io> >>>> >>>> Chicago, IL >>>> >>>> lflo...@ibm.com | lflo...@redhat.com >>>> M: +17087388804 >>>> >>>> >>>> >>> >>> -- >>> >>> Laura Flores >>> >>> She/Her/Hers >>> >>> Software Engineer, Ceph Storage <https://ceph.io> >>> >>> Chicago, IL >>> >>> lflo...@ibm.com | lflo...@redhat.com >>> M: +17087388804 >>> >>> >>> ___ >>> Dev mailing list -- d...@ceph.io >>> To unsubscribe send an email to dev-le...@ceph.io >>> >> ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: 16.2.14 pacific QE validation status
Josh, Neha We are looking good but missing some clarifications (see Laura's replies below) If you approve 16.2.14 as is we can start building today. PLMK On Fri, Aug 25, 2023 at 8:37 AM Yuri Weinstein wrote: > Thx Laura > > On the issue related to the smoke suite, pls see > https://tracker.ceph.com/issues/62508 > @Venky Shankar ^ > > On Fri, Aug 25, 2023 at 8:25 AM Laura Flores wrote: > >> All known issues in pacific p2p and smoke. @Ilya Dryomov >> and @Casey Bodley may want to >> double-check that the two for pacific p2p are acceptable, but they are >> known. >> >> pacific p2p: >> - TestClsRbd.mirror_snapshot failure in pacific p2p - Ceph - RBD >>https://tracker.ceph.com/issues/62586 >> - "[ FAILED ] CmpOmap.cmp_vals_u64_invalid_default" in >> upgrade:pacific-p2p-pacific - Ceph - RGW >>https://tracker.ceph.com/issues/52590 >> >> smoke >> - cls/test_cls_sdk.sh: Health check failed: 1 pool(s) do not have an >> application enabled (POOL_APP_NOT_ENABLED) - Ceph - RADOS >> https://tracker.ceph.com/issues/59192 >> >> On Fri, Aug 25, 2023 at 9:41 AM Laura Flores wrote: >> >>> Wanted to bring this tracker to attention: >>> https://tracker.ceph.com/issues/58946 >>> >>> Users have recently reported experiencing this bug in v16.2.13. There is >>> a main fix available, but it's currently undergoing testing. @Adam King >>> what are your thoughts on getting this fix into >>> 16.2.14? >>> >>> On Fri, Aug 25, 2023 at 9:12 AM Travis Nielsen >>> wrote: >>> >>>> Approved for rook. >>>> >>>> For future approvals, Blaine or I could approve, as Seb is on another >>>> project now. >>>> >>>> Thanks, >>>> Travis >>>> >>>> On Fri, Aug 25, 2023 at 7:06 AM Venky Shankar >>>> wrote: >>>> >>>>> On Fri, Aug 25, 2023 at 7:17 AM Patrick Donnelly >>>>> wrote: >>>>> > >>>>> > On Wed, Aug 23, 2023 at 10:41 AM Yuri Weinstein >>>>> wrote: >>>>> > > >>>>> > > Details of this release are summarized here: >>>>> > > >>>>> > > https://tracker.ceph.com/issues/62527#note-1 >>>>> > > Release Notes - TBD >>>>> > > >>>>> > > Seeking approvals for: >>>>> > > >>>>> > > smoke - Venky >>>>> > > rados - Radek, Laura >>>>> > > rook - Sébastien Han >>>>> > > cephadm - Adam K >>>>> > > dashboard - Ernesto >>>>> > > >>>>> > > rgw - Casey >>>>> > > rbd - Ilya >>>>> > > krbd - Ilya >>>>> > > fs - Venky, Patrick >>>>> > >>>>> > approved >>>>> > >>>>> > https://tracker.ceph.com/projects/cephfs/wiki/Pacific#2023-August-22 >>>>> >>>>> You beat me to this. Thanks, Patrick. >>>>> >>>>> > >>>>> > >>>>> > -- >>>>> > Patrick Donnelly, Ph.D. >>>>> > He / Him / His >>>>> > Red Hat Partner Engineer >>>>> > IBM, Inc. >>>>> > GPG: 19F28A586F808C2402351B93C3301A3E258DD79D >>>>> > ___ >>>>> > ceph-users mailing list -- ceph-users@ceph.io >>>>> > To unsubscribe send an email to ceph-users-le...@ceph.io >>>>> >>>>> >>>>> >>>>> -- >>>>> Cheers, >>>>> Venky >>>>> ___ >>>>> Dev mailing list -- d...@ceph.io >>>>> To unsubscribe send an email to dev-le...@ceph.io >>>>> >>>> ___ >>>> Dev mailing list -- d...@ceph.io >>>> To unsubscribe send an email to dev-le...@ceph.io >>>> >>> >>> >>> -- >>> >>> Laura Flores >>> >>> She/Her/Hers >>> >>> Software Engineer, Ceph Storage <https://ceph.io> >>> >>> Chicago, IL >>> >>> lflo...@ibm.com | lflo...@redhat.com >>> M: +17087388804 >>> >>> >>> >> >> -- >> >> Laura Flores >> >> She/Her/Hers >> >> Software Engineer, Ceph Storage <https://ceph.io> >> >> Chicago, IL >> >> lflo...@ibm.com | lflo...@redhat.com >> M: +17087388804 >> >> >> ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: 16.2.14 pacific QE validation status
Thx Laura On the issue related to the smoke suite, pls see https://tracker.ceph.com/issues/62508 @Venky Shankar ^ On Fri, Aug 25, 2023 at 8:25 AM Laura Flores wrote: > All known issues in pacific p2p and smoke. @Ilya Dryomov > and @Casey Bodley may want to > double-check that the two for pacific p2p are acceptable, but they are > known. > > pacific p2p: > - TestClsRbd.mirror_snapshot failure in pacific p2p - Ceph - RBD >https://tracker.ceph.com/issues/62586 > - "[ FAILED ] CmpOmap.cmp_vals_u64_invalid_default" in > upgrade:pacific-p2p-pacific - Ceph - RGW >https://tracker.ceph.com/issues/52590 > > smoke > - cls/test_cls_sdk.sh: Health check failed: 1 pool(s) do not have an > application enabled (POOL_APP_NOT_ENABLED) - Ceph - RADOS > https://tracker.ceph.com/issues/59192 > > On Fri, Aug 25, 2023 at 9:41 AM Laura Flores wrote: > >> Wanted to bring this tracker to attention: >> https://tracker.ceph.com/issues/58946 >> >> Users have recently reported experiencing this bug in v16.2.13. There is >> a main fix available, but it's currently undergoing testing. @Adam King >> what are your thoughts on getting this fix into >> 16.2.14? >> >> On Fri, Aug 25, 2023 at 9:12 AM Travis Nielsen >> wrote: >> >>> Approved for rook. >>> >>> For future approvals, Blaine or I could approve, as Seb is on another >>> project now. >>> >>> Thanks, >>> Travis >>> >>> On Fri, Aug 25, 2023 at 7:06 AM Venky Shankar >>> wrote: >>> >>>> On Fri, Aug 25, 2023 at 7:17 AM Patrick Donnelly >>>> wrote: >>>> > >>>> > On Wed, Aug 23, 2023 at 10:41 AM Yuri Weinstein >>>> wrote: >>>> > > >>>> > > Details of this release are summarized here: >>>> > > >>>> > > https://tracker.ceph.com/issues/62527#note-1 >>>> > > Release Notes - TBD >>>> > > >>>> > > Seeking approvals for: >>>> > > >>>> > > smoke - Venky >>>> > > rados - Radek, Laura >>>> > > rook - Sébastien Han >>>> > > cephadm - Adam K >>>> > > dashboard - Ernesto >>>> > > >>>> > > rgw - Casey >>>> > > rbd - Ilya >>>> > > krbd - Ilya >>>> > > fs - Venky, Patrick >>>> > >>>> > approved >>>> > >>>> > https://tracker.ceph.com/projects/cephfs/wiki/Pacific#2023-August-22 >>>> >>>> You beat me to this. Thanks, Patrick. >>>> >>>> > >>>> > >>>> > -- >>>> > Patrick Donnelly, Ph.D. >>>> > He / Him / His >>>> > Red Hat Partner Engineer >>>> > IBM, Inc. >>>> > GPG: 19F28A586F808C2402351B93C3301A3E258DD79D >>>> > ___ >>>> > ceph-users mailing list -- ceph-users@ceph.io >>>> > To unsubscribe send an email to ceph-users-le...@ceph.io >>>> >>>> >>>> >>>> -- >>>> Cheers, >>>> Venky >>>> ___ >>>> Dev mailing list -- d...@ceph.io >>>> To unsubscribe send an email to dev-le...@ceph.io >>>> >>> ___ >>> Dev mailing list -- d...@ceph.io >>> To unsubscribe send an email to dev-le...@ceph.io >>> >> >> >> -- >> >> Laura Flores >> >> She/Her/Hers >> >> Software Engineer, Ceph Storage <https://ceph.io> >> >> Chicago, IL >> >> lflo...@ibm.com | lflo...@redhat.com >> M: +17087388804 >> >> >> > > -- > > Laura Flores > > She/Her/Hers > > Software Engineer, Ceph Storage <https://ceph.io> > > Chicago, IL > > lflo...@ibm.com | lflo...@redhat.com > M: +17087388804 > > > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: 16.2.14 pacific QE validation status
Pls review and approve the release notes PR https://github.com/ceph/ceph/pull/53107/ And approve the remaining test results. We plan to publish this release early next week. TIA On Wed, Aug 23, 2023 at 7:40 AM Yuri Weinstein wrote: > > Details of this release are summarized here: > > https://tracker.ceph.com/issues/62527#note-1 > Release Notes - TBD > > Seeking approvals for: > > smoke - Venky > rados - Radek, Laura > rook - Sébastien Han > cephadm - Adam K > dashboard - Ernesto > > rgw - Casey > rbd - Ilya > krbd - Ilya > fs - Venky, Patrick > > upgrade/pacific-p2p - Laura > powercycle - Brad (SELinux denials) > > > Thx > YuriW ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] 16.2.14 pacific QE validation status
Details of this release are summarized here: https://tracker.ceph.com/issues/62527#note-1 Release Notes - TBD Seeking approvals for: smoke - Venky rados - Radek, Laura rook - Sébastien Han cephadm - Adam K dashboard - Ernesto rgw - Casey rbd - Ilya krbd - Ilya fs - Venky, Patrick upgrade/pacific-p2p - Laura powercycle - Brad (SELinux denials) Thx YuriW ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] v18.2.0 Reef released
We're very happy to announce the first stable release of the Reef series. We express our gratitude to all members of the Ceph community who contributed by proposing pull requests, testing this release, providing feedback, and offering valuable suggestions. Major Changes from Quincy: - RADOS: RocksDB has been upgraded to version 7.9.2. - RADOS: There have been significant improvements to RocksDB iteration overhead and performance. - RADOS: The perf dump and perf schema commands have been deprecated in favor of the new counter dump and counter schema commands. - RADOS: Cache tiering is now deprecated. - RADOS: A new feature, the "read balancer", is now available, which allows users to balance primary PGs per pool on their clusters. - RGW: Bucket resharding is now supported for multi-site configurations. - RGW: There have been significant improvements to the stability and consistency of multi-site replication. - RGW: Compression is now supported for objects uploaded with Server-Side Encryption. - Dashboard: There is a new Dashboard page with improved layout. Active alerts and some important charts are now displayed inside cards. - RBD: Support for layered client-side encryption has been added. - Telemetry: Users can now opt in to participate in a leaderboard in the telemetry public dashboards. We encourage you to read the full release notes at https://ceph.io/en/news/blog/2023/v18-2-0-reef-released/ Getting Ceph * Git at git://github.com/ceph/ceph.git * Tarball at https://download.ceph.com/tarballs/ceph-18.2.0.tar.gz * Containers at https://quay.io/repository/ceph/ceph * For packages, see https://docs.ceph.com/docs/master/install/get-packages/ * Release git sha1: 5dd24139a1eada541a3bc16b6941c5dde975e26d Did you know? Every Ceph release is built and tested on resources funded directly by the non-profit Ceph Foundation. If you would like to support this and our other efforts, please consider joining now https://ceph.io/en/foundation/. ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: ref v18.2.0 QE Validation status
Updates: 1. bookworm distro build support We will not build bookworm until Debian bug https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1030129 is resolved 2. nfs ganesha fixed (Thanks Guillaume and Kaleb) 3. powercycle failures due to teuthology - fixed (Thanks Brad, Zack, Dan). I am expecting Brad to approve it as the SELinux denials is the known issue. smoke approved. Unless I hear any objections I see no open issues and will start building (jammy focal centos8 centos9 windows) On Wed, Aug 2, 2023 at 7:56 AM Yuri Weinstein wrote: > https://github.com/ceph/ceph/pull/52710 merged > > smoke: > https://tracker.ceph.com/issues/62227 marked resolved > https://tracker.ceph.com/issues/62228 in progress > > Only smoke and prowercycle items are remaining from the test approval > standpoint. > > Here is the quote from Neha's status to the clt summarizing the correct > outstanding issues: > " > 1. bookworm distro build support > action item - Neha and Josh will have a discussion with Dan to figure out > what help he needs and if at all there is a workaround for the first reef > release > > 2. nfs ganesha > action item - figure out with Guillaume and Kaleb if a workaround of > pinning to an older release is possible > > 3. powercycle failures due to teuthology - > https://pulpito.ceph.com/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/ > > action item - open a tracker and get Zack's thoughts on whether this issue > can be classified as infra-only and get powercycle approvals from Brad > " > > On Wed, Aug 2, 2023 at 3:03 AM Radoslaw Zarzynski > wrote: > >> Final ACK for RADOS. >> >> On Tue, Aug 1, 2023 at 6:28 PM Laura Flores wrote: >> >>> Rados failures are summarized here: >>> https://tracker.ceph.com/projects/rados/wiki/REEF#Reef-v1820 >>> >>> All are known. Will let Radek give the final ack. >>> >>> On Tue, Aug 1, 2023 at 9:05 AM Nizamudeen A wrote: >>> >>>> dashboard approved! failure is unrelated and tracked via >>>> https://tracker.ceph.com/issues/58946 >>>> >>>> Regards, >>>> Nizam >>>> >>>> On Sun, Jul 30, 2023 at 9:16 PM Yuri Weinstein >>>> wrote: >>>> >>>> > Details of this release are summarized here: >>>> > >>>> > https://tracker.ceph.com/issues/62231#note-1 >>>> > >>>> > Seeking approvals/reviews for: >>>> > >>>> > smoke - Laura, Radek >>>> > rados - Neha, Radek, Travis, Ernesto, Adam King >>>> > rgw - Casey >>>> > fs - Venky >>>> > orch - Adam King >>>> > rbd - Ilya >>>> > krbd - Ilya >>>> > upgrade-clients:client-upgrade* - in progress >>>> > powercycle - Brad >>>> > >>>> > Please reply to this email with approval and/or trackers of known >>>> > issues/PRs to address them. >>>> > >>>> > bookworm distro support is an outstanding issue. >>>> > >>>> > TIA >>>> > YuriW >>>> > ___ >>>> > ceph-users mailing list -- ceph-users@ceph.io >>>> > To unsubscribe send an email to ceph-users-le...@ceph.io >>>> > >>>> > >>>> ___ >>>> ceph-users mailing list -- ceph-users@ceph.io >>>> To unsubscribe send an email to ceph-users-le...@ceph.io >>>> >>> >>> >>> -- >>> >>> Laura Flores >>> >>> She/Her/Hers >>> >>> Software Engineer, Ceph Storage <https://ceph.io> >>> >>> Chicago, IL >>> >>> lflo...@ibm.com | lflo...@redhat.com >>> M: +17087388804 >>> >>> >>> ___ >>> Dev mailing list -- d...@ceph.io >>> To unsubscribe send an email to dev-le...@ceph.io >>> >> ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: ref v18.2.0 QE Validation status
https://github.com/ceph/ceph/pull/52710 merged smoke: https://tracker.ceph.com/issues/62227 marked resolved https://tracker.ceph.com/issues/62228 in progress Only smoke and prowercycle items are remaining from the test approval standpoint. Here is the quote from Neha's status to the clt summarizing the correct outstanding issues: " 1. bookworm distro build support action item - Neha and Josh will have a discussion with Dan to figure out what help he needs and if at all there is a workaround for the first reef release 2. nfs ganesha action item - figure out with Guillaume and Kaleb if a workaround of pinning to an older release is possible 3. powercycle failures due to teuthology - https://pulpito.ceph.com/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/ action item - open a tracker and get Zack's thoughts on whether this issue can be classified as infra-only and get powercycle approvals from Brad " On Wed, Aug 2, 2023 at 3:03 AM Radoslaw Zarzynski wrote: > Final ACK for RADOS. > > On Tue, Aug 1, 2023 at 6:28 PM Laura Flores wrote: > >> Rados failures are summarized here: >> https://tracker.ceph.com/projects/rados/wiki/REEF#Reef-v1820 >> >> All are known. Will let Radek give the final ack. >> >> On Tue, Aug 1, 2023 at 9:05 AM Nizamudeen A wrote: >> >>> dashboard approved! failure is unrelated and tracked via >>> https://tracker.ceph.com/issues/58946 >>> >>> Regards, >>> Nizam >>> >>> On Sun, Jul 30, 2023 at 9:16 PM Yuri Weinstein >>> wrote: >>> >>> > Details of this release are summarized here: >>> > >>> > https://tracker.ceph.com/issues/62231#note-1 >>> > >>> > Seeking approvals/reviews for: >>> > >>> > smoke - Laura, Radek >>> > rados - Neha, Radek, Travis, Ernesto, Adam King >>> > rgw - Casey >>> > fs - Venky >>> > orch - Adam King >>> > rbd - Ilya >>> > krbd - Ilya >>> > upgrade-clients:client-upgrade* - in progress >>> > powercycle - Brad >>> > >>> > Please reply to this email with approval and/or trackers of known >>> > issues/PRs to address them. >>> > >>> > bookworm distro support is an outstanding issue. >>> > >>> > TIA >>> > YuriW >>> > ___ >>> > ceph-users mailing list -- ceph-users@ceph.io >>> > To unsubscribe send an email to ceph-users-le...@ceph.io >>> > >>> > >>> ___ >>> ceph-users mailing list -- ceph-users@ceph.io >>> To unsubscribe send an email to ceph-users-le...@ceph.io >>> >> >> >> -- >> >> Laura Flores >> >> She/Her/Hers >> >> Software Engineer, Ceph Storage <https://ceph.io> >> >> Chicago, IL >> >> lflo...@ibm.com | lflo...@redhat.com >> M: +17087388804 >> >> >> ___ >> Dev mailing list -- d...@ceph.io >> To unsubscribe send an email to dev-le...@ceph.io >> > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: ref v18.2.0 QE Validation status
Pls see the updated test results and Release Notes PR https://github.com/ceph/ceph/pull/52490 Still seeking approvals: smoke - Laura, Radek, Venky rados - Radek, Laura, Nizamudeen fs - Venky orch - Adam King powercycle - Brad On Sun, Jul 30, 2023 at 8:45 AM Yuri Weinstein wrote: > > Details of this release are summarized here: > > https://tracker.ceph.com/issues/62231#note-1 > > Seeking approvals/reviews for: > > smoke - Laura, Radek > rados - Neha, Radek, Travis, Ernesto, Adam King > rgw - Casey > fs - Venky > orch - Adam King > rbd - Ilya > krbd - Ilya > upgrade-clients:client-upgrade* - in progress > powercycle - Brad > > Please reply to this email with approval and/or trackers of known > issues/PRs to address them. > > bookworm distro support is an outstanding issue. > > TIA > YuriW ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: ref v18.2.0 QE Validation status
Thx Casey If you agree I will merge https://github.com/ceph/ceph/pull/52710 ? On Mon, Jul 31, 2023 at 8:34 AM Casey Bodley wrote: > > On Sun, Jul 30, 2023 at 11:46 AM Yuri Weinstein wrote: > > > > Details of this release are summarized here: > > > > https://tracker.ceph.com/issues/62231#note-1 > > > > Seeking approvals/reviews for: > > > > smoke - Laura, Radek > > rados - Neha, Radek, Travis, Ernesto, Adam King > > rgw - Casey > > the pacific upgrade test failed because it tried to use centos 9 > packages. i reran the upgrade tests using > https://github.com/ceph/ceph/pull/52710 as the suite-branch and they > passed in > https://pulpito.ceph.com/cbodley-2023-07-31_14:53:56-rgw:upgrade-main-distro-default-smithi/ > > rgw approved > > > fs - Venky > > orch - Adam King > > rbd - Ilya > > krbd - Ilya > > upgrade-clients:client-upgrade* - in progress > > powercycle - Brad > > > > Please reply to this email with approval and/or trackers of known > > issues/PRs to address them. > > > > bookworm distro support is an outstanding issue. > > > > TIA > > YuriW > > ___ > > ceph-users mailing list -- ceph-users@ceph.io > > To unsubscribe send an email to ceph-users-le...@ceph.io > > > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] ref v18.2.0 QE Validation status
Details of this release are summarized here: https://tracker.ceph.com/issues/62231#note-1 Seeking approvals/reviews for: smoke - Laura, Radek rados - Neha, Radek, Travis, Ernesto, Adam King rgw - Casey fs - Venky orch - Adam King rbd - Ilya krbd - Ilya upgrade-clients:client-upgrade* - in progress powercycle - Brad Please reply to this email with approval and/or trackers of known issues/PRs to address them. bookworm distro support is an outstanding issue. TIA YuriW ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Reef release candidate - v18.1.3
This is the third and possibly last release candidate for Reef. The Reef release comes with a new RockDB version (7.9.2) [0], which incorporates several performance improvements and features. Our internal testing doesn't show any side effects from the new version, but we are very eager to hear community feedback on it. This is the first release to have the ability to tune RockDB settings per column family [1], which allows for more granular tunings to be applied to different kinds of data stored in RocksDB. A new set of settings has been used in Reef to optimize performance for most kinds of workloads with a slight penalty in some cases, outweighed by large improvements in use cases such as RGW, in terms of compactions and write amplification. We would highly encourage community members to give these a try against their performance benchmarks and use cases. The detailed list of changes in terms of RockDB and BlueStore can be found in https://pad.ceph.com/p/reef-rc-relnotes. If any of our community members would like to help us with performance investigations or regression testing of the Reef release candidate, please feel free to provide feedback via email or in https://pad.ceph.com/p/reef_scale_testing. For more active discussions, please use the #ceph-at-scale slack channel in ceph-storage.slack.com. This RC has gone thru partial testing due to issues we are experiencing in the sepia lab. Please try it out and report any issues you encounter. Happy testing! Thanks, YuriW Get the release from * Git at git://github.com/ceph/ceph.git * Tarball at https://download.ceph.com/tarballs/ceph-18.1.3.tar.gz * Containers at https://quay.io/repository/ceph/ceph * For packages, see https://docs.ceph.com/en/latest/install/get-packages/ * Release git sha1: f594a0802c34733bb06e5993bc4bdb085c9a5f3f ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: Reef release candidate - v18.1.2
Can you elaborate on how you installed cephadm? When I pull from quay.io/ceph/ceph:v18.1.2, I see the version v18.1.2 podman run -it quay.io/ceph/ceph:v18.1.2 Trying to pull quay.io/ceph/ceph:v18.1.2... Getting image source signatures Copying blob f3a0532868dc done Copying blob 9ba8dbcf96c4 done Copying config 3b66ad272b done Writing manifest to image destination Storing signatures [root@66c274be11ab /]# ceph --version ceph version 18.1.2 (a5c951305c2409669162c235d81981bdc60dd9e7) reef (rc) On Wed, Jul 12, 2023 at 2:06 PM Stefan Kooman wrote: > > On 6/30/23 18:36, Yuri Weinstein wrote: > > > This RC has gone thru partial testing due to issues we are > > experiencing in the sepia lab. > > Please try it out and report any issues you encounter. Happy testing! > > If I install cephadm from package, 18.1.2 on ubuntu focal in my case, > cepadm usages the ceph-ci/ceph:main container images: "Pulling container > image quay.ceph.io/ceph-ci/ceph:main". And these container images are > out of date (18.0.0-4869-g05e449f9 > (05e449f9a2a65c297f31628af8f01f63cf36f261) reef (dev)": 1). > > AFAIK there is no way to tell cephadm bootstrap to use a specific > version. Although the help mentions "--allow-mismatched-release", so it > might be possible? > > Gr. Stefan > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Reef release candidate - v18.1.2
Hi everyone, This is the second release candidate for Reef. The Reef release comes with a new RockDB version (7.9.2) [0], which incorporates several performance improvements and features. Our internal testing doesn't show any side effects from the new version, but we are very eager to hear community feedback on it. This is the first release to have the ability to tune RockDB settings per column family [1], which allows for more granular tunings to be applied to different kinds of data stored in RocksDB. A new set of settings has been used in Reef to optimize performance for most kinds of workloads with a slight penalty in some cases, outweighed by large improvements in use cases such as RGW, in terms of compactions and write amplification. We would highly encourage community members to give these a try against their performance benchmarks and use cases. The detailed list of changes in terms of RockDB and BlueStore can be found in https://pad.ceph.com/p/reef-rc-relnotes. If any of our community members would like to help us with performance investigations or regression testing of the Reef release candidate, please feel free to provide feedback via email or in https://pad.ceph.com/p/reef_scale_testing. For more active discussions, please use the #ceph-at-scale slack channel in ceph-storage.slack.com. This RC has gone thru partial testing due to issues we are experiencing in the sepia lab. Please try it out and report any issues you encounter. Happy testing! Thanks, YuriW ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: reef v18.1.0 QE Validation status
Still awaiting for approvals: rados - Radek fs - Kotresh and Patrick upgrade/pacific-x - good as is, Laura? upgrade/quicny-x - good as is, Laura? upgrade/reef-p2p - N/A powercycle - Brad On Tue, May 30, 2023 at 9:50 AM Yuri Weinstein wrote: > > Details of this release are summarized here: > > https://tracker.ceph.com/issues/61515#note-1 > Release Notes - TBD > > Seeking approvals/reviews for: > > rados - Neha, Radek, Travis, Ernesto, Adam King (we still have to > merge https://github.com/ceph/ceph/pull/51788 for > the core) > rgw - Casey > fs - Venky > orch - Adam King > rbd - Ilya > krbd - Ilya > upgrade/octopus-x - deprecated > upgrade/pacific-x - known issues, Ilya, Laura? > upgrade/reef-p2p - N/A > clients upgrades - not run yet > powercycle - Brad > ceph-volume - in progress > > Please reply to this email with approval and/or trackers of known > issues/PRs to address them. > > gibba upgrade was done and will need to be done again this week. > LRC upgrade TBD > > TIA ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: reef v18.1.0 QE Validation status
Casey I will rerun rgw and we will see. Stay tuned. On Wed, May 31, 2023 at 10:27 AM Casey Bodley wrote: > > On Tue, May 30, 2023 at 12:54 PM Yuri Weinstein wrote: > > > > Details of this release are summarized here: > > > > https://tracker.ceph.com/issues/61515#note-1 > > Release Notes - TBD > > > > Seeking approvals/reviews for: > > > > rados - Neha, Radek, Travis, Ernesto, Adam King (we still have to > > merge https://github.com/ceph/ceph/pull/51788 for > > the core) > > rgw - Casey > > the rgw suite had several new test_rgw_throttle.sh failures that i > haven't seen before: > > qa/workunits/rgw/test_rgw_throttle.sh: line 3: ceph_test_rgw_throttle: > command not found > > those only show up on rhel8 jobs, and none of your later reef runs fail this > way > > Yuri, is it possible that the suite-branch was mixed up somehow? the > ceph "sha1: be098f4642e7d4bbdc3f418c5ad703e23d1e9fe0" didn't match the > workunit "sha1: 4a02f3f496d9039326c49bf1fbe140388cd2f619" > > > fs - Venky > > orch - Adam King > > rbd - Ilya > > krbd - Ilya > > upgrade/octopus-x - deprecated > > upgrade/pacific-x - known issues, Ilya, Laura? > > upgrade/reef-p2p - N/A > > clients upgrades - not run yet > > powercycle - Brad > > ceph-volume - in progress > > > > Please reply to this email with approval and/or trackers of known > > issues/PRs to address them. > > > > gibba upgrade was done and will need to be done again this week. > > LRC upgrade TBD > > > > TIA > > ___ > > ceph-users mailing list -- ceph-users@ceph.io > > To unsubscribe send an email to ceph-users-le...@ceph.io > > > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] reef v18.1.0 QE Validation status
Details of this release are summarized here: https://tracker.ceph.com/issues/61515#note-1 Release Notes - TBD Seeking approvals/reviews for: rados - Neha, Radek, Travis, Ernesto, Adam King (we still have to merge https://github.com/ceph/ceph/pull/51788 for the core) rgw - Casey fs - Venky orch - Adam King rbd - Ilya krbd - Ilya upgrade/octopus-x - deprecated upgrade/pacific-x - known issues, Ilya, Laura? upgrade/reef-p2p - N/A clients upgrades - not run yet powercycle - Brad ceph-volume - in progress Please reply to this email with approval and/or trackers of known issues/PRs to address them. gibba upgrade was done and will need to be done again this week. LRC upgrade TBD TIA ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] v16.2.13 Pacific released
We're happy to announce the 13th backport release in the Pacific series. https://ceph.io/en/news/blog/2023/v16-2-13-pacific-released/ Notable Changes --- * CEPHFS: Rename the `mds_max_retries_on_remount_failure` option to `client_max_retries_on_remount_failure` and move it from mds.yaml.in to mds-client.yaml.in because this option was only used by MDS client from its birth. * `ceph mgr dump` command now outputs `last_failure_osd_epoch` and `active_clients` fields at the top level. Previously, these fields were output under `always_on_modules` field. Getting Ceph * Git at git://github.com/ceph/ceph.git * Tarball at https://download.ceph.com/tarballs/ceph-16.2.13.tar.gz * Containers at https://quay.io/repository/ceph/ceph * For packages, see https://docs.ceph.com/en/latest/install/get-packages/ * Release git sha1: 5378749ba6be3a0868b51803968ee9cde4833a3e ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: 16.2.13 pacific QE validation status
Josh, The 16.2.13 RC1 has all approvals and unless I hear any objections, I will start publishing later today. On Mon, May 8, 2023 at 12:09 PM Radoslaw Zarzynski wrote: > > rados approved. > > On Sun, May 7, 2023 at 11:24 PM Yuri Weinstein wrote: > > > > All PRs were cherry-picked and the new RC1 build is: > > > > https://shaman.ceph.com/builds/ceph/pacific-release/8f93a58b82b94b6c9ac48277cc15bd48d4c0a902/ > > > > Rados, fs and rgw were rerun and results are summarized here: > > https://tracker.ceph.com/issues/59542#note-1 > > > > Seeking final approvals: > > > > rados - Radek > > fs - Venky > > rgw - Casey > > > > On Fri, May 5, 2023 at 8:27 AM Yuri Weinstein wrote: > > > > > > I got verbal approvals for the listed PRs: > > > > > > https://github.com/ceph/ceph/pull/51232 -- Venky approved > > > https://github.com/ceph/ceph/pull/51344 -- Venky approved > > > https://github.com/ceph/ceph/pull/51200 -- Casey approved > > > https://github.com/ceph/ceph/pull/50894 -- Radek approved > > > > > > Suites rados and fs will need to be retested on updates pacific-release > > > branch. > > > > > > > > > On Thu, May 4, 2023 at 9:13 AM Yuri Weinstein wrote: > > > > > > > > In summary: > > > > > > > > Release Notes: https://github.com/ceph/ceph/pull/51301 > > > > > > > > We plan to finish this release next week and we have the following PRs > > > > planned to be added: > > > > > > > > https://github.com/ceph/ceph/pull/51232 -- Venky approved > > > > https://github.com/ceph/ceph/pull/51344 -- Venky in progress > > > > https://github.com/ceph/ceph/pull/51200 -- Casey approved > > > > https://github.com/ceph/ceph/pull/50894 -- Radek in progress > > > > > > > > As soon as these PRs are finalized, I will cherry-pick them and > > > > rebuild "pacific-release" and rerun appropriate suites. > > > > > > > > On Thu, May 4, 2023 at 9:07 AM Radoslaw Zarzynski > > > > wrote: > > > > > > > > > > If we get some time, I would like to include: > > > > > > > > > > https://github.com/ceph/ceph/pull/50894. > > > > > > > > > > Regards, > > > > > Radek > > > > > > > > > > On Thu, May 4, 2023 at 5:56 PM Venky Shankar > > > > > wrote: > > > > > > > > > > > > Hi Yuri, > > > > > > > > > > > > On Wed, May 3, 2023 at 7:10 PM Venky Shankar > > > > > > wrote: > > > > > > > > > > > > > > On Tue, May 2, 2023 at 8:25 PM Yuri Weinstein > > > > > > > wrote: > > > > > > > > > > > > > > > > Venky, I did plan to cherry-pick this PR if you approve this > > > > > > > > (this PR > > > > > > > > was used for a rerun) > > > > > > > > > > > > > > OK. The fs suite failure is being looked into > > > > > > > (https://tracker.ceph.com/issues/59626). > > > > > > > > > > > > Fix is being tracked by > > > > > > > > > > > > https://github.com/ceph/ceph/pull/51344 > > > > > > > > > > > > Once ready, it needs to be included in 16.2.13 and would require a > > > > > > fs > > > > > > suite re-run (although re-renning the failed tests should suffice, > > > > > > however, I'm a bit inclined in putting it through the fs suite). > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Tue, May 2, 2023 at 7:51 AM Venky Shankar > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > Hi Yuri, > > > > > > > > > > > > > > > > > > On Fri, Apr 28, 2023 at 2:53 AM Yuri Weinstein > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > Details of this release are summarized here: > > > > > > > > > > > > > > > > > > > > https://tracker.ceph.com/issues/59542#note-1 > > > > > > > > > > Release
[ceph-users] Re: 16.2.13 pacific QE validation status
All PRs were cherry-picked and the new RC1 build is: https://shaman.ceph.com/builds/ceph/pacific-release/8f93a58b82b94b6c9ac48277cc15bd48d4c0a902/ Rados, fs and rgw were rerun and results are summarized here: https://tracker.ceph.com/issues/59542#note-1 Seeking final approvals: rados - Radek fs - Venky rgw - Casey On Fri, May 5, 2023 at 8:27 AM Yuri Weinstein wrote: > > I got verbal approvals for the listed PRs: > > https://github.com/ceph/ceph/pull/51232 -- Venky approved > https://github.com/ceph/ceph/pull/51344 -- Venky approved > https://github.com/ceph/ceph/pull/51200 -- Casey approved > https://github.com/ceph/ceph/pull/50894 -- Radek approved > > Suites rados and fs will need to be retested on updates pacific-release > branch. > > > On Thu, May 4, 2023 at 9:13 AM Yuri Weinstein wrote: > > > > In summary: > > > > Release Notes: https://github.com/ceph/ceph/pull/51301 > > > > We plan to finish this release next week and we have the following PRs > > planned to be added: > > > > https://github.com/ceph/ceph/pull/51232 -- Venky approved > > https://github.com/ceph/ceph/pull/51344 -- Venky in progress > > https://github.com/ceph/ceph/pull/51200 -- Casey approved > > https://github.com/ceph/ceph/pull/50894 -- Radek in progress > > > > As soon as these PRs are finalized, I will cherry-pick them and > > rebuild "pacific-release" and rerun appropriate suites. > > > > On Thu, May 4, 2023 at 9:07 AM Radoslaw Zarzynski > > wrote: > > > > > > If we get some time, I would like to include: > > > > > > https://github.com/ceph/ceph/pull/50894. > > > > > > Regards, > > > Radek > > > > > > On Thu, May 4, 2023 at 5:56 PM Venky Shankar wrote: > > > > > > > > Hi Yuri, > > > > > > > > On Wed, May 3, 2023 at 7:10 PM Venky Shankar > > > > wrote: > > > > > > > > > > On Tue, May 2, 2023 at 8:25 PM Yuri Weinstein > > > > > wrote: > > > > > > > > > > > > Venky, I did plan to cherry-pick this PR if you approve this (this > > > > > > PR > > > > > > was used for a rerun) > > > > > > > > > > OK. The fs suite failure is being looked into > > > > > (https://tracker.ceph.com/issues/59626). > > > > > > > > Fix is being tracked by > > > > > > > > https://github.com/ceph/ceph/pull/51344 > > > > > > > > Once ready, it needs to be included in 16.2.13 and would require a fs > > > > suite re-run (although re-renning the failed tests should suffice, > > > > however, I'm a bit inclined in putting it through the fs suite). > > > > > > > > > > > > > > > > > > > > > On Tue, May 2, 2023 at 7:51 AM Venky Shankar > > > > > > wrote: > > > > > > > > > > > > > > Hi Yuri, > > > > > > > > > > > > > > On Fri, Apr 28, 2023 at 2:53 AM Yuri Weinstein > > > > > > > wrote: > > > > > > > > > > > > > > > > Details of this release are summarized here: > > > > > > > > > > > > > > > > https://tracker.ceph.com/issues/59542#note-1 > > > > > > > > Release Notes - TBD > > > > > > > > > > > > > > > > Seeking approvals for: > > > > > > > > > > > > > > > > smoke - Radek, Laura > > > > > > > > rados - Radek, Laura > > > > > > > > rook - Sébastien Han > > > > > > > > cephadm - Adam K > > > > > > > > dashboard - Ernesto > > > > > > > > > > > > > > > > rgw - Casey > > > > > > > > rbd - Ilya > > > > > > > > krbd - Ilya > > > > > > > > fs - Venky, Patrick > > > > > > > > > > > > > > There are a couple of new failures which are qa/test related - > > > > > > > I'll > > > > > > > have a look at those (they _do not_ look serious). > > > > > > > > > > > > > > Also, Yuri, do you plan to merge > > > > > > > > > > > > > > https://github.com/ceph/ceph/pull/51232 > > > > > > > > > > > > > > into the pacific-release branch although it's tagged with one of > > > > > > > your > > > > > > > other pacific runs? > > > > > > > > > > > > > > > upgrade/octopus-x (pacific) - Laura (look the same as in 16.2.8) > > > > > > > > upgrade/pacific-p2p - Laura > > > > > > > > powercycle - Brad (SELinux denials) > > > > > > > > ceph-volume - Guillaume, Adam K > > > > > > > > > > > > > > > > Thx > > > > > > > > YuriW > > > > > > > > ___ > > > > > > > > ceph-users mailing list -- ceph-users@ceph.io > > > > > > > > To unsubscribe send an email to ceph-users-le...@ceph.io > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > > Cheers, > > > > > > > Venky > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > Cheers, > > > > > Venky > > > > > > > > > > > > > > > > -- > > > > Cheers, > > > > Venky > > > > ___ > > > > Dev mailing list -- d...@ceph.io > > > > To unsubscribe send an email to dev-le...@ceph.io > > > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: 16.2.13 pacific QE validation status
I got verbal approvals for the listed PRs: https://github.com/ceph/ceph/pull/51232 -- Venky approved https://github.com/ceph/ceph/pull/51344 -- Venky approved https://github.com/ceph/ceph/pull/51200 -- Casey approved https://github.com/ceph/ceph/pull/50894 -- Radek approved Suites rados and fs will need to be retested on updates pacific-release branch. On Thu, May 4, 2023 at 9:13 AM Yuri Weinstein wrote: > > In summary: > > Release Notes: https://github.com/ceph/ceph/pull/51301 > > We plan to finish this release next week and we have the following PRs > planned to be added: > > https://github.com/ceph/ceph/pull/51232 -- Venky approved > https://github.com/ceph/ceph/pull/51344 -- Venky in progress > https://github.com/ceph/ceph/pull/51200 -- Casey approved > https://github.com/ceph/ceph/pull/50894 -- Radek in progress > > As soon as these PRs are finalized, I will cherry-pick them and > rebuild "pacific-release" and rerun appropriate suites. > > On Thu, May 4, 2023 at 9:07 AM Radoslaw Zarzynski wrote: > > > > If we get some time, I would like to include: > > > > https://github.com/ceph/ceph/pull/50894. > > > > Regards, > > Radek > > > > On Thu, May 4, 2023 at 5:56 PM Venky Shankar wrote: > > > > > > Hi Yuri, > > > > > > On Wed, May 3, 2023 at 7:10 PM Venky Shankar wrote: > > > > > > > > On Tue, May 2, 2023 at 8:25 PM Yuri Weinstein > > > > wrote: > > > > > > > > > > Venky, I did plan to cherry-pick this PR if you approve this (this PR > > > > > was used for a rerun) > > > > > > > > OK. The fs suite failure is being looked into > > > > (https://tracker.ceph.com/issues/59626). > > > > > > Fix is being tracked by > > > > > > https://github.com/ceph/ceph/pull/51344 > > > > > > Once ready, it needs to be included in 16.2.13 and would require a fs > > > suite re-run (although re-renning the failed tests should suffice, > > > however, I'm a bit inclined in putting it through the fs suite). > > > > > > > > > > > > > > > > > On Tue, May 2, 2023 at 7:51 AM Venky Shankar > > > > > wrote: > > > > > > > > > > > > Hi Yuri, > > > > > > > > > > > > On Fri, Apr 28, 2023 at 2:53 AM Yuri Weinstein > > > > > > wrote: > > > > > > > > > > > > > > Details of this release are summarized here: > > > > > > > > > > > > > > https://tracker.ceph.com/issues/59542#note-1 > > > > > > > Release Notes - TBD > > > > > > > > > > > > > > Seeking approvals for: > > > > > > > > > > > > > > smoke - Radek, Laura > > > > > > > rados - Radek, Laura > > > > > > > rook - Sébastien Han > > > > > > > cephadm - Adam K > > > > > > > dashboard - Ernesto > > > > > > > > > > > > > > rgw - Casey > > > > > > > rbd - Ilya > > > > > > > krbd - Ilya > > > > > > > fs - Venky, Patrick > > > > > > > > > > > > There are a couple of new failures which are qa/test related - I'll > > > > > > have a look at those (they _do not_ look serious). > > > > > > > > > > > > Also, Yuri, do you plan to merge > > > > > > > > > > > > https://github.com/ceph/ceph/pull/51232 > > > > > > > > > > > > into the pacific-release branch although it's tagged with one of > > > > > > your > > > > > > other pacific runs? > > > > > > > > > > > > > upgrade/octopus-x (pacific) - Laura (look the same as in 16.2.8) > > > > > > > upgrade/pacific-p2p - Laura > > > > > > > powercycle - Brad (SELinux denials) > > > > > > > ceph-volume - Guillaume, Adam K > > > > > > > > > > > > > > Thx > > > > > > > YuriW > > > > > > > ___ > > > > > > > ceph-users mailing list -- ceph-users@ceph.io > > > > > > > To unsubscribe send an email to ceph-users-le...@ceph.io > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > Cheers, > > > > > > Venky > > > > > > > > > > > > > > > > > > > > > > > -- > > > > Cheers, > > > > Venky > > > > > > > > > > > > -- > > > Cheers, > > > Venky > > > ___ > > > Dev mailing list -- d...@ceph.io > > > To unsubscribe send an email to dev-le...@ceph.io > > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: 16.2.13 pacific QE validation status
In summary: Release Notes: https://github.com/ceph/ceph/pull/51301 We plan to finish this release next week and we have the following PRs planned to be added: https://github.com/ceph/ceph/pull/51232 -- Venky approved https://github.com/ceph/ceph/pull/51344 -- Venky in progress https://github.com/ceph/ceph/pull/51200 -- Casey approved https://github.com/ceph/ceph/pull/50894 -- Radek in progress As soon as these PRs are finalized, I will cherry-pick them and rebuild "pacific-release" and rerun appropriate suites. On Thu, May 4, 2023 at 9:07 AM Radoslaw Zarzynski wrote: > > If we get some time, I would like to include: > > https://github.com/ceph/ceph/pull/50894. > > Regards, > Radek > > On Thu, May 4, 2023 at 5:56 PM Venky Shankar wrote: > > > > Hi Yuri, > > > > On Wed, May 3, 2023 at 7:10 PM Venky Shankar wrote: > > > > > > On Tue, May 2, 2023 at 8:25 PM Yuri Weinstein wrote: > > > > > > > > Venky, I did plan to cherry-pick this PR if you approve this (this PR > > > > was used for a rerun) > > > > > > OK. The fs suite failure is being looked into > > > (https://tracker.ceph.com/issues/59626). > > > > Fix is being tracked by > > > > https://github.com/ceph/ceph/pull/51344 > > > > Once ready, it needs to be included in 16.2.13 and would require a fs > > suite re-run (although re-renning the failed tests should suffice, > > however, I'm a bit inclined in putting it through the fs suite). > > > > > > > > > > > > > On Tue, May 2, 2023 at 7:51 AM Venky Shankar > > > > wrote: > > > > > > > > > > Hi Yuri, > > > > > > > > > > On Fri, Apr 28, 2023 at 2:53 AM Yuri Weinstein > > > > > wrote: > > > > > > > > > > > > Details of this release are summarized here: > > > > > > > > > > > > https://tracker.ceph.com/issues/59542#note-1 > > > > > > Release Notes - TBD > > > > > > > > > > > > Seeking approvals for: > > > > > > > > > > > > smoke - Radek, Laura > > > > > > rados - Radek, Laura > > > > > > rook - Sébastien Han > > > > > > cephadm - Adam K > > > > > > dashboard - Ernesto > > > > > > > > > > > > rgw - Casey > > > > > > rbd - Ilya > > > > > > krbd - Ilya > > > > > > fs - Venky, Patrick > > > > > > > > > > There are a couple of new failures which are qa/test related - I'll > > > > > have a look at those (they _do not_ look serious). > > > > > > > > > > Also, Yuri, do you plan to merge > > > > > > > > > > https://github.com/ceph/ceph/pull/51232 > > > > > > > > > > into the pacific-release branch although it's tagged with one of your > > > > > other pacific runs? > > > > > > > > > > > upgrade/octopus-x (pacific) - Laura (look the same as in 16.2.8) > > > > > > upgrade/pacific-p2p - Laura > > > > > > powercycle - Brad (SELinux denials) > > > > > > ceph-volume - Guillaume, Adam K > > > > > > > > > > > > Thx > > > > > > YuriW > > > > > > ___ > > > > > > ceph-users mailing list -- ceph-users@ceph.io > > > > > > To unsubscribe send an email to ceph-users-le...@ceph.io > > > > > > > > > > > > > > > > > > > > -- > > > > > Cheers, > > > > > Venky > > > > > > > > > > > > > > > > > > -- > > > Cheers, > > > Venky > > > > > > > > -- > > Cheers, > > Venky > > ___ > > Dev mailing list -- d...@ceph.io > > To unsubscribe send an email to dev-le...@ceph.io > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: 16.2.13 pacific QE validation status
upgrade/octopus-x (pacific) - Laura ceph-volume - Guillaume + 2 PRs are the remaining issues Josh FYI On Wed, May 3, 2023 at 11:50 AM Radoslaw Zarzynski wrote: > > rados approved. > > Big thanks to Laura for helping with this! > > On Thu, Apr 27, 2023 at 11:21 PM Yuri Weinstein wrote: > > > > Details of this release are summarized here: > > > > https://tracker.ceph.com/issues/59542#note-1 > > Release Notes - TBD > > > > Seeking approvals for: > > > > smoke - Radek, Laura > > rados - Radek, Laura > > rook - Sébastien Han > > cephadm - Adam K > > dashboard - Ernesto > > > > rgw - Casey > > rbd - Ilya > > krbd - Ilya > > fs - Venky, Patrick > > upgrade/octopus-x (pacific) - Laura (look the same as in 16.2.8) > > upgrade/pacific-p2p - Laura > > powercycle - Brad (SELinux denials) > > ceph-volume - Guillaume, Adam K > > > > Thx > > YuriW > > ___ > > Dev mailing list -- d...@ceph.io > > To unsubscribe send an email to dev-le...@ceph.io > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: 16.2.13 pacific QE validation status
I know of two PRs that have been requested to be cherry-picked in 16.2.13 https://github.com/ceph/ceph/pull/51232 -- fs https://github.com/ceph/ceph/pull/51200 -- rgw Casey, Venky - would you approve it? On Wed, May 3, 2023 at 6:41 AM Venky Shankar wrote: > > On Tue, May 2, 2023 at 8:25 PM Yuri Weinstein wrote: > > > > Venky, I did plan to cherry-pick this PR if you approve this (this PR > > was used for a rerun) > > OK. The fs suite failure is being looked into > (https://tracker.ceph.com/issues/59626). > > > > > On Tue, May 2, 2023 at 7:51 AM Venky Shankar wrote: > > > > > > Hi Yuri, > > > > > > On Fri, Apr 28, 2023 at 2:53 AM Yuri Weinstein > > > wrote: > > > > > > > > Details of this release are summarized here: > > > > > > > > https://tracker.ceph.com/issues/59542#note-1 > > > > Release Notes - TBD > > > > > > > > Seeking approvals for: > > > > > > > > smoke - Radek, Laura > > > > rados - Radek, Laura > > > > rook - Sébastien Han > > > > cephadm - Adam K > > > > dashboard - Ernesto > > > > > > > > rgw - Casey > > > > rbd - Ilya > > > > krbd - Ilya > > > > fs - Venky, Patrick > > > > > > There are a couple of new failures which are qa/test related - I'll > > > have a look at those (they _do not_ look serious). > > > > > > Also, Yuri, do you plan to merge > > > > > > https://github.com/ceph/ceph/pull/51232 > > > > > > into the pacific-release branch although it's tagged with one of your > > > other pacific runs? > > > > > > > upgrade/octopus-x (pacific) - Laura (look the same as in 16.2.8) > > > > upgrade/pacific-p2p - Laura > > > > powercycle - Brad (SELinux denials) > > > > ceph-volume - Guillaume, Adam K > > > > > > > > Thx > > > > YuriW > > > > ___ > > > > ceph-users mailing list -- ceph-users@ceph.io > > > > To unsubscribe send an email to ceph-users-le...@ceph.io > > > > > > > > > > > > -- > > > Cheers, > > > Venky > > > > > > > > -- > Cheers, > Venky > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: 16.2.13 pacific QE validation status
Please review the Release Notes - https://github.com/ceph/ceph/pull/51301 Still seeking approvals for: rados - Neha, Radek, Laura rook - Sébastien Han dashboard - Ernesto fs - Venky, Patrick (upgrade/octopus-x (pacific) - Laura (look the same as in 16.2.8)) ceph-volume - Guillaume On Tue, May 2, 2023 at 8:00 AM Casey Bodley wrote: > > On Thu, Apr 27, 2023 at 5:21 PM Yuri Weinstein wrote: > > > > Details of this release are summarized here: > > > > https://tracker.ceph.com/issues/59542#note-1 > > Release Notes - TBD > > > > Seeking approvals for: > > > > smoke - Radek, Laura > > rados - Radek, Laura > > rook - Sébastien Han > > cephadm - Adam K > > dashboard - Ernesto > > > > rgw - Casey > > rgw approved > > > rbd - Ilya > > krbd - Ilya > > fs - Venky, Patrick > > upgrade/octopus-x (pacific) - Laura (look the same as in 16.2.8) > > upgrade/pacific-p2p - Laura > > powercycle - Brad (SELinux denials) > > ceph-volume - Guillaume, Adam K > > > > Thx > > YuriW > > ___ > > Dev mailing list -- d...@ceph.io > > To unsubscribe send an email to dev-le...@ceph.io > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: 16.2.13 pacific QE validation status
Venky, I did plan to cherry-pick this PR if you approve this (this PR was used for a rerun) On Tue, May 2, 2023 at 7:51 AM Venky Shankar wrote: > > Hi Yuri, > > On Fri, Apr 28, 2023 at 2:53 AM Yuri Weinstein wrote: > > > > Details of this release are summarized here: > > > > https://tracker.ceph.com/issues/59542#note-1 > > Release Notes - TBD > > > > Seeking approvals for: > > > > smoke - Radek, Laura > > rados - Radek, Laura > > rook - Sébastien Han > > cephadm - Adam K > > dashboard - Ernesto > > > > rgw - Casey > > rbd - Ilya > > krbd - Ilya > > fs - Venky, Patrick > > There are a couple of new failures which are qa/test related - I'll > have a look at those (they _do not_ look serious). > > Also, Yuri, do you plan to merge > > https://github.com/ceph/ceph/pull/51232 > > into the pacific-release branch although it's tagged with one of your > other pacific runs? > > > upgrade/octopus-x (pacific) - Laura (look the same as in 16.2.8) > > upgrade/pacific-p2p - Laura > > powercycle - Brad (SELinux denials) > > ceph-volume - Guillaume, Adam K > > > > Thx > > YuriW > > ___ > > ceph-users mailing list -- ceph-users@ceph.io > > To unsubscribe send an email to ceph-users-le...@ceph.io > > > > -- > Cheers, > Venky > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] 16.2.13 pacific QE validation status
Details of this release are summarized here: https://tracker.ceph.com/issues/59542#note-1 Release Notes - TBD Seeking approvals for: smoke - Radek, Laura rados - Radek, Laura rook - Sébastien Han cephadm - Adam K dashboard - Ernesto rgw - Casey rbd - Ilya krbd - Ilya fs - Venky, Patrick upgrade/octopus-x (pacific) - Laura (look the same as in 16.2.8) upgrade/pacific-p2p - Laura powercycle - Brad (SELinux denials) ceph-volume - Guillaume, Adam K Thx YuriW ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] pacific 16.2.13 point release
We want to do the next urgent point release for pacific 16.2.13 ASAP. The tip of the current pacific branch will be used as a base for this release and we will build it later today. Dev leads - if you have any outstanding PRs that must be included pls merged them now. Thx YuriW ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: v16.2.12 Pacific (hot-fix) released
We are writing to inform you that Pacific v16.2.12, released on April 14th, has many unintended commits in the changelog than listed in the release notes [1]. As these extra commits are not fully tested, we request that all users please refrain from upgrading to v16.2.12 at this time. The current v16.2.12 will be QE validated and released as soon as possible. v16.2.12 was a hotfix release meant to resolve several performance flaws in ceph-volume, particularly during osd activation. The extra commits target v16.2.13. We apologize for the inconvenience. Please reach out to the mailing list with any questions. [1] https://ceph.io/en/news/blog/2023/v16-2-12-pacific-released/ On Fri, Apr 14, 2023 at 9:42 AM Yuri Weinstein wrote: > > We're happy to announce the 12th hot-fix release in the Pacific series. > > https://ceph.io/en/news/blog/2023/v16-2-12-pacific-released/ > > Notable Changes > --- > This is a hotfix release that resolves several performance flaws in > ceph-volume, > particularly during osd activation (https://tracker.ceph.com/issues/57627) > Getting Ceph > > > * Git at git://github.com/ceph/ceph.git > * Tarball at https://download.ceph.com/tarballs/ceph-16.2.12.tar.gz > * Containers at https://quay.io/repository/ceph/ceph > * For packages, see https://docs.ceph.com/en/latest/install/get-packages/ > * Release git sha1: 5a2d516ce4b134bfafc80c4274532ac0d56fc1e2 ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] v16.2.12 Pacific (hot-fix) released
We're happy to announce the 12th hot-fix release in the Pacific series. https://ceph.io/en/news/blog/2023/v16-2-12-pacific-released/ Notable Changes --- This is a hotfix release that resolves several performance flaws in ceph-volume, particularly during osd activation (https://tracker.ceph.com/issues/57627) Getting Ceph * Git at git://github.com/ceph/ceph.git * Tarball at https://download.ceph.com/tarballs/ceph-16.2.12.tar.gz * Containers at https://quay.io/repository/ceph/ceph * For packages, see https://docs.ceph.com/en/latest/install/get-packages/ * Release git sha1: 5a2d516ce4b134bfafc80c4274532ac0d56fc1e2 ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] pacific v16.2.1 (hot-fix) QE Validation status
Details of this release are summarized here: https://tracker.ceph.com/issues/59426#note-3 Release Notes - TBD Seeking approvals/reviews for: smoke - Josh approved? orch - Adam King approved? (there are infrastructure issues in the runs, but we want to release this ASAP) Thx YuriW ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] v17.2.6 Quincy released
We're happy to announce the 6th backport release in the Quincy series. https://ceph.io/en/news/blog/2023/v17-2-6-quincy-released/ Notable Changes --- * `ceph mgr dump` command now outputs `last_failure_osd_epoch` and `active_clients` fields at the top level. Previously, these fields were output under `always_on_modules` field. * telemetry: Added new metrics to the 'basic' channel to report per-pool bluestore compression metrics. See a sample report with `ceph telemetry preview`. Opt-in with `ceph telemetry on`. Getting Ceph * Git at git://github.com/ceph/ceph.git * Tarball at https://download.ceph.com/tarballs/ceph-17.2.6.tar.gz * Containers at https://quay.io/repository/ceph/ceph * For packages, see https://docs.ceph.com/en/latest/install/get-packages/ * Release git sha1: d7ff0d10654d2280e08f1ab989c7cdf3064446a5 ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: quincy v17.2.6 QE Validation status
Update: The release is ready to be published, but we have problems with the signing VM. That VM is being actively fixed as we speak (thank you, Dan, Ken, and Zack!) However, we need to delay the publishing till early next week. Thx and sorry for the delay. YuriW On Wed, Apr 5, 2023 at 7:16 AM Josh Durgin wrote: > The LRC upgraded with no problems, so this release is good to go! > > Josh > > On Mon, Apr 3, 2023 at 3:36 PM Yuri Weinstein wrote: > >> Josh, the release is ready for your review and approval. >> >> Adam, can you please update the LRC upgrade to 17.2.6 RC? >> >> Thx >> >> >> On Wed, Mar 29, 2023 at 3:07 PM Yuri Weinstein >> wrote: >> >>> The release has been approved. >>> >>> And the gibba cluster upgraded. >>> >>> We are awaiting the LRC upgrade and then/or in parallel will publish an >>> RC for testing. >>> >>> ETA for the release publishing is 04/07/23 >>> >>> On Tue, Mar 28, 2023 at 2:59 PM Neha Ojha wrote: >>> >>>> upgrades approved! >>>> >>>> Thanks, >>>> Neha >>>> >>>> On Tue, Mar 28, 2023 at 12:09 PM Radoslaw Zarzynski < >>>> rzarz...@redhat.com> wrote: >>>> >>>>> rados: approved! >>>>> >>>>> On Mon, Mar 27, 2023 at 7:02 PM Laura Flores >>>>> wrote: >>>>> >>>>>> Rados review, second round: >>>>>> >>>>>> Failures: >>>>>> 1. https://tracker.ceph.com/issues/58560 >>>>>> 2. https://tracker.ceph.com/issues/58476 >>>>>> 3. https://tracker.ceph.com/issues/58475 -- pending Q backport >>>>>> 4. https://tracker.ceph.com/issues/49287 >>>>>> 5. https://tracker.ceph.com/issues/58585 >>>>>> >>>>>> Details: >>>>>> 1. test_envlibrados_for_rocksdb.sh failed to subscribe to repo - >>>>>> Infrastructure >>>>>> 2. test_non_existent_cluster: cluster does not exist - Ceph - >>>>>> Orchestrator >>>>>> 3. test_dashboard_e2e.sh: Conflicting peer dependency: >>>>>> postcss@8.4.21 - Ceph - Mgr - Dashboard >>>>>> 4. podman: setting cgroup config for procHooks process caused: >>>>>> Unit libpod-$hash.scope not found - Ceph - Orchestrator >>>>>> 5. rook: failed to pull kubelet image - Ceph - Orchestrator >>>>>> >>>>>> @Radoslaw Zarzynski will give final approval >>>>>> for rados. >>>>>> >>>>>> On Mon, Mar 27, 2023 at 10:02 AM Casey Bodley >>>>>> wrote: >>>>>> >>>>>>> On Fri, Mar 24, 2023 at 3:46 PM Yuri Weinstein >>>>>>> wrote: >>>>>>> > >>>>>>> > Details of this release are updated here: >>>>>>> > >>>>>>> > https://tracker.ceph.com/issues/59070#note-1 >>>>>>> > Release Notes - TBD >>>>>>> > >>>>>>> > The slowness we experienced seemed to be self-cured. >>>>>>> > Neha, Radek, and Laura please provide any findings if you have >>>>>>> them. >>>>>>> > >>>>>>> > Seeking approvals/reviews for: >>>>>>> > >>>>>>> > rados - Neha, Radek, Travis, Ernesto, Adam King (rerun on Build 2 >>>>>>> with >>>>>>> > PRs merged on top of quincy-release) >>>>>>> > rgw - Casey (rerun on Build 2 with PRs merged on top of >>>>>>> quincy-release) >>>>>>> >>>>>>> rgw approved >>>>>>> >>>>>>> > fs - Venky >>>>>>> > >>>>>>> > upgrade/octopus-x - Neha, Laura (package issue Adam Kraitman any >>>>>>> updates?) >>>>>>> > upgrade/pacific-x - Neha, Laura, Ilya see >>>>>>> https://tracker.ceph.com/issues/58914 >>>>>>> > upgrade/quincy-p2p - Neha, Laura >>>>>>> > client-upgrade-octopus-quincy-quincy - Neha, Laura (package issue >>>>>>> Adam >>>>>>> > Kraitman any updates?) >>>>>>> > powercycle - Brad >>>>>>> > >>>
[ceph-users] Re: quincy v17.2.6 QE Validation status
Thx, Josh! We will start releasing now. Release notes - https://github.com/ceph/ceph/pull/50721 On Wed, Apr 5, 2023 at 7:16 AM Josh Durgin wrote: > The LRC upgraded with no problems, so this release is good to go! > > Josh > > On Mon, Apr 3, 2023 at 3:36 PM Yuri Weinstein wrote: > >> Josh, the release is ready for your review and approval. >> >> Adam, can you please update the LRC upgrade to 17.2.6 RC? >> >> Thx >> >> >> On Wed, Mar 29, 2023 at 3:07 PM Yuri Weinstein >> wrote: >> >>> The release has been approved. >>> >>> And the gibba cluster upgraded. >>> >>> We are awaiting the LRC upgrade and then/or in parallel will publish an >>> RC for testing. >>> >>> ETA for the release publishing is 04/07/23 >>> >>> On Tue, Mar 28, 2023 at 2:59 PM Neha Ojha wrote: >>> >>>> upgrades approved! >>>> >>>> Thanks, >>>> Neha >>>> >>>> On Tue, Mar 28, 2023 at 12:09 PM Radoslaw Zarzynski < >>>> rzarz...@redhat.com> wrote: >>>> >>>>> rados: approved! >>>>> >>>>> On Mon, Mar 27, 2023 at 7:02 PM Laura Flores >>>>> wrote: >>>>> >>>>>> Rados review, second round: >>>>>> >>>>>> Failures: >>>>>> 1. https://tracker.ceph.com/issues/58560 >>>>>> 2. https://tracker.ceph.com/issues/58476 >>>>>> 3. https://tracker.ceph.com/issues/58475 -- pending Q backport >>>>>> 4. https://tracker.ceph.com/issues/49287 >>>>>> 5. https://tracker.ceph.com/issues/58585 >>>>>> >>>>>> Details: >>>>>> 1. test_envlibrados_for_rocksdb.sh failed to subscribe to repo - >>>>>> Infrastructure >>>>>> 2. test_non_existent_cluster: cluster does not exist - Ceph - >>>>>> Orchestrator >>>>>> 3. test_dashboard_e2e.sh: Conflicting peer dependency: >>>>>> postcss@8.4.21 - Ceph - Mgr - Dashboard >>>>>> 4. podman: setting cgroup config for procHooks process caused: >>>>>> Unit libpod-$hash.scope not found - Ceph - Orchestrator >>>>>> 5. rook: failed to pull kubelet image - Ceph - Orchestrator >>>>>> >>>>>> @Radoslaw Zarzynski will give final approval >>>>>> for rados. >>>>>> >>>>>> On Mon, Mar 27, 2023 at 10:02 AM Casey Bodley >>>>>> wrote: >>>>>> >>>>>>> On Fri, Mar 24, 2023 at 3:46 PM Yuri Weinstein >>>>>>> wrote: >>>>>>> > >>>>>>> > Details of this release are updated here: >>>>>>> > >>>>>>> > https://tracker.ceph.com/issues/59070#note-1 >>>>>>> > Release Notes - TBD >>>>>>> > >>>>>>> > The slowness we experienced seemed to be self-cured. >>>>>>> > Neha, Radek, and Laura please provide any findings if you have >>>>>>> them. >>>>>>> > >>>>>>> > Seeking approvals/reviews for: >>>>>>> > >>>>>>> > rados - Neha, Radek, Travis, Ernesto, Adam King (rerun on Build 2 >>>>>>> with >>>>>>> > PRs merged on top of quincy-release) >>>>>>> > rgw - Casey (rerun on Build 2 with PRs merged on top of >>>>>>> quincy-release) >>>>>>> >>>>>>> rgw approved >>>>>>> >>>>>>> > fs - Venky >>>>>>> > >>>>>>> > upgrade/octopus-x - Neha, Laura (package issue Adam Kraitman any >>>>>>> updates?) >>>>>>> > upgrade/pacific-x - Neha, Laura, Ilya see >>>>>>> https://tracker.ceph.com/issues/58914 >>>>>>> > upgrade/quincy-p2p - Neha, Laura >>>>>>> > client-upgrade-octopus-quincy-quincy - Neha, Laura (package issue >>>>>>> Adam >>>>>>> > Kraitman any updates?) >>>>>>> > powercycle - Brad >>>>>>> > >>>>>>> > Please reply to this email with approval and/or trackers of known >>>>>>> > issues/PRs to address them. >>>>>&