We will meet on November 25, 2025 at 19:00 UTC in #opendev-meeting with this agenda: == Agenda for next meeting == * Announcements ** Holiday weekend for many of us this weekend. * Actions from last meeting * Specs Review * Topics ** Gerrit 3.11 Upgrade Planning (clarkb 20250401) *** Gerrit 3.13 has been released so we should really try to upgrade to 3.11 and then 3.12 soon. *** https://www.gerritcodereview.com/3.11.html *** Please check this for any concerns with the way we use Gerrit. *** https://etherpad.opendev.org/p/gerrit-upgrade-3.11 Planning Document for the eventual Upgrade *** Held nodes here: **** 3.10: https://217.182.142.186 **** 3.11: https://50.56.159.76/ *** There is discussion about replication and reindexing bugs in 3.11.4/3.12.1 that don't affect us yet due to being on 3.10. We should try to test these problems to see if they affect us. **** Clarkb tested this with held notes on admittedly trivial test data sets but was unable to reproduce the problems *** Shutting down Gerrit can race the indexing of new changes. If this happens we can have new changes created that are not indexed leading to multiple changes with the same changeid later. To mitigate this we can/should reindex changes on Gerrit startup. *** Gerrit shutdown remain plagued by large h2 cache files. Seems removing our long timeout was not enough to prevent shutdowns timing out. *** Proposing December 7 at 2100 UTC for the upgrade itself ** Rename project app-kubernetes-module-manager to app-kernel-module-management (clarkb 20251125) *** Biggest question is when do we want to try and do this? Before or after the 3.11 Upgrade? Also where does it fit with holidays etc. ** Upgrading Old Servers (clarkb 20230627) *** https://etherpad.opendev.org/p/opendev-bionic-server-upgrades *** https://etherpad.opendev.org/p/opendev-focal-server-upgrades *** https://etherpad.opendev.org/p/opendev-server-replacement-sprint **** wiki.openstack.org: https://etherpad.opendev.org/p/opendev-mediawiki-upgrade **** tonyb looking at cacti after wiki *** Next on the list are graphite and backup servers *** Can probably spin up new backup servers alongside the old ones then migrate the old volumes off the old servers to the new ones and finally delete the old servers. Just need to double check borg version support matrix details and also what adding new backup servers will do to our cron job setups for backups. *** Remember to use launch-node's --config-drive flag when booting new Noble nodes in Rax Classic ** Moving OpenDev Synchronous Communication to Matrix (clarkb 20250520) *** https://docs.opendev.org/opendev/infra-specs/latest/specs/matrix_for_opendev... *** The new room exists (thank you tonyb) and updates to statusbot have begun (thank you corvus) *** https://review.opendev.org/q/hashtag:%22opendev-matrix%22+status:open ** Zuul Launcher Updates (clarkb 20251125) *** We found a corrupted image upload in raxflex sjc3 again on November 21. Previous occurrence was discovered on October 6 *** https://review.opendev.org/c/zuul/zuul/+/968090 Will validate the glance checksum against our checksum and reject mismatches **** It isn't clear to clarkb if this is safe as glance may change the checksum value if it does a format conversion on the backend? *** Floating IPs attached to held nodes were deleted in raxflex. Likely due to our leaked fip cleanup routine. Debugging has been added to the launcher to track this down. ** Gitea 1.25.2 Upgrade (clarkb 20251125) *** https://review.opendev.org/c/opendev/system-config/+/968245 Upgrade gitea to 1.25.2 ** December Meeting Planning (clarkb 20251125) *** Holidays are approaching for many of us. Do we want to proactively cancel meetings? *** December 23, 30, and January 6 are the dates most likely to be impacted *** clarkb can likely host a meeting on each of these days if we wish to have them. * Open discussion