We will meet with this agenda on February 25, 2025 at 19:00 UTC in #opendev-meeting: == Agenda for next meeting == * Announcements * Actions from last meeting * Specs Review * Topics ** Zuul-launcher image builds (corvus 20240910) *** We are building Jammy, Noble, and Bullseye images now *** Flavors are in place for 4GB, 8GB, and 16GB test nodes. *** https://review.opendev.org/c/zuul/zuul/+/940824 Somewhat successful dogfooding in this zuul change ** Fixing known_hosts generation on bridge (clarkb 20250225) *** https://review.opendev.org/c/opendev/system-config/+/942307 *** TL;DR is that we weren't updating system-config on bridge before reading the inventory file to generate known_hosts on bridge *** This means that we could fail infra-prod-base trying to ssh to newly added servers *** Sometimes everything just worked because the -lb jobs weren't depending on anything else and if they ran early enough system-config would update by chance. ** Upgrading Old Servers (clarkb 20230627) *** https://etherpad.opendev.org/p/opendev-bionic-server-upgrades **** wiki.openstack.org: https://etherpad.opendev.org/p/opendev-mediawiki-upgrade **** tonyb looking at cacti after wiki *** https://etherpad.opendev.org/p/opendev-focal-server-upgrades ** Sprinting to Upgrade Servers to Focal (clarkb 20250204) *** Managed to upgrade two servers *** Ran into problems with AppArmor on Noble interferring with podman and rsyslogd *** Will try to continue upgrading things as time goes on. *** https://etherpad.opendev.org/p/opendev-server-replacement-sprint ** Redeploying raxflex resources (clarkb 20250225) *** We have access to a new raxflex region. To align with the old region and to correct network MTUs we need to redeploy the old region on the new project/tenant. *** Trying to determine whether or not we are required to use floating IPs before booting new mirrors. ** Running certcheck on bridge (clarkb 20250114) *** Any concern running this service in the bastion? *** Would better match how testing works. *** We would need to disable it on the cacti server. ** Service Coordinator Election (clarkb 20250107) *** Nominations closed and only clarkb was nominated *** Unless someone was missed clarkb is it by default and we don't need an election. *** https://lists.opendev.org/archives/list/service-discuss@lists.opendev.org/th... ** Using more robust Gitea caches (clarkb 20250225) *** Currently gitea uses a default cache setup with a single Go hashmap *** It is theorized that this hashmap grows such that eventually Go GC creates noticeable pause the world behavior impacting service response time *** https://review.opendev.org/c/opendev/system-config/+/942650 Set up gitea with memcached for caching *** As an alternative we could use the twoqueue adapter in gitea but this is compiled into the binary so would still be potentially impacting the GC system. But is one less container image and service. ** Working through our TODO list (clarkb 20250107) *** https://etherpad.opendev.org/p/opendev-january-2025-meetup * Open discussion