We will meet with this agenda on August 22, 2023 at 19:00 UTC in #opendev-meeting: == Agenda for next meeting == * Announcements * Actions from last meeting * Specs Review * Topics ** Service Coordinator Election (clarkb 20230822) *** Nomination period ends today (the day of the meeting) ** Bastion host (ianw 20230627) *** https://review.opendev.org/q/topic:prod-bastion-group Remaining changes are part of parallel ansible runs on bridge *** https://review.opendev.org/q/topic:bridge-backups ** Mailman 3 (clarkb 20230627) *** https://etherpad.opendev.org/p/mm3migration *** Need to change site domains ** Gerrit updates (clarkb 20230718) *** Replication task file leaks. **** https://review.opendev.org/c/opendev/system-config/+/880672 Workaround "leaked" replication tasks on disk. **** https://bugs.chromium.org/p/gerrit/issues/detail?id=16867 **** https://bugs.chromium.org/p/gerrit/issues/detail?id=16868 **** https://review.opendev.org/c/opendev/system-config/+/884779 Revert bind mounts for Gerrit plugin data ** Upgrading Bionic servers to Focal/Jammy (clarkb 20230627) *** https://etherpad.opendev.org/p/opendev-bionic-server-upgrades *** Next up mirrors and meetpad. *** Clarkb needs to look into cleaning up the old CI registry node. ** Rax IAD image upload struggles (clarkb 20230822) *** The Rax IAD region has struggled to upload images within the image upload timeout. This seems to get worse the more images you upload **** Almost like images are processed serially and we create a queue that gets backed up. *** No issue has been filed with rax yet, but we're testing incremental unpausing of images to get more data. *** We also have hundreds of leaked images in the other two regions (there were well over a thousand in IAD but those have been cleaned up manually now). ** Fedora cleanup (clarkb 20230627) *** Need changes to remove the label and nodeset from Zuul/Nodepool ** Gitea 1.20 (clarkb 20230627) *** https://review.opendev.org/c/opendev/system-config/+/886993 **** Ready to go if we are happy with the resulting behaviors. *** We disable oauth2 but need to configure multiple oauth2 jwt settings in order to avoid startup errors. **** Need to update prod secrets with the oauth2 jwt settings before merging. *** https://github.com/go-gitea/gitea/issues/25377 ** Zuul changes and updates (clarkb 20230822) *** Ansible 8 now availalble. We should convert the OpenDev tenant. Notify openstack tenant that we will switch them after the upcoming release *** Stdout and stderr to be uncombined in Zuul Ansible. Currently this is a job setting for testing purposes. We'll need to start looking at how this impacts us. *** Early failure detection regexes should arrive soon. This is potentially useful for our users? ** Python container updates (tonyb 20230718) *** Some moderate progress in the first round *** https://review.opendev.org/q/topic:bookworm-python and https://review.opendev.org/q/topic:force-base-image-build *** I noticed that https://opendev.org/openstack/python-openstackclient/src/branch/master/Docke... is using a 3.9 tag which is buster **** We should stick to the explicit debian release + explicit python release versions for things. We can delete the old tags to force errors that indicate people should update the tags they use. *** We should write a tool to find and clean leaked tags on docker hub (and quay.io?) * Open discussion