I had meant to send one of these every couple of months, but it has been about six months since I sent the last update email. Apologies for the delay. It has been a busy six months; let's dive in.
We bootstrapped the ability to deploy new control plane nodes on Ubuntu Jammy. All newly created servers are built on Jammy unless we have a very good reason to use something older. Additionally, we have updated our base Python Docker images to include support for Python 3.11. Python 3.11 is only a few weeks old, but we are able to deploy software on top of it taking advantage of the performance benefits it provides.
Gerrit has been upgraded to 3.6.3. This release is just behind 3.7.0 which was released about a month ago. I believe this is the closest we've been to the latest Gerrit release in about a decade. We do plan to upgrade to 3.7.x, but this upgrade appears to be a bit more involved than the last few. In particular, the upgrade itself needs offline re-indexing, we need to port our label configs to the new submit requirements system, and the web UI is now based on Lit instead of polymer.
The Gitea cluster is now running 1.17. This update didn't bring any major user facing changes. The next update to 1.18.x should correct a problem with Gitea misidentifying certain files as being "vendored".
Prior to the October PTG event our Meetpad deployment was updated to use the latest stable releases of Jitsi Meet, and we applied a modern configuration to our installation. One major feature this brought is a landing page for meetings where users can configure their name and settings. Importantly, this landing page should prevent browsers' auto mute behavior for auto playing video+audio from breaking calls for our users. We believe this was a major source of users not being able to hear others in calls.
Mailing lists for lists.opendev.org and lists.zuul-ci.org have been migrated to a new Mailman 3 server. We are using these two list domains to work out issues while we prepare for migrating the rest of our mailing lists to the new server. This should give us a much more friendly web interface for browsing archives with built in search capability as well as easier to use moderation tools for list moderators.
Our Zuul deployment has seen a number of improvements. The ZooKeeper cluster backing Zuul has been upgraded to ZooKeeper 3.7 which brings performance improvements. Zuul supports Ansible 6 now, and all of our tenants are running jobs with this version of Ansible. This version of Ansible fixes pipelining which should provide some improvements to job runtime. Finally, we are upgrading Zuul weekly using automated zero downtime rolling restarts. This ensures we're getting the latest and greatest Zuul features and can provide quick and early feedback to Zuul.
Looking ahead to 2023, I expect to see a lot more of what we've done over the last six months. Gerrit will be upgraded to 3.7, Gitea will be upgraded to 1.18, more mailing lists will be migrated to Mailman 3, and more services will be deployed on Jammy running with Python 3.11. See you next year!
We are planning upgrade review.opendev.org to the Gerrit 3.6 release
on 12th December, 2022 at around 20:00UTC.
This will involve an outage of around 1 hour.
There should not be much user-visible change after the upgrade; the
major items do not affect our usage. The full release notes are at
On Monday, December 5 at 20:00 UTC, the OpenDev Collaboratory
systems administrators will be migrating the lists.opendev.org and
lists.zuul-ci.org mailing list sites from their existing Mailman
2.1.29 server to a shiny new Mailman 3.3.7 deployment. This
maintenance window is expected to last no more than one hour. The
key takeaways are as follows:
* There will be a brief outage for the affected sites while DNS is
updated and configuration, subscriber lists and message archives
are imported, but incoming messages should correctly queue at
the sender's end and arrive at the conclusion of our work
* Because this is on a new server, there are new IP addresses from
which list mail will be originating, 188.8.131.52 and
* Moderation queues will not be copied to the new server, so
moderators are encouraged to process any held messages prior to
the migration time in order to avoid losing them
* Anyone wishing to adjust their list subscriptions, or handle
moderation or list configuration after the migration needs to
use the Sign Up button on the Web page to create a new account;
it will be linked to your imported roles as soon as you confirm
by following a URL from an E-mail message the server sends you,
and is global for all sites on the server so you only need to do
* The software providing Web front-ends for list management and
archive browsing is entirely new in Mailman v3 and therefore has
a much different appearance, though we've added appropriate
redirects and frozen copies of old archives in order to
accommodate existing hyperlinks
Once we smooth out any unanticipated rough patches with the new
service, we'll schedule additional maintenance to migrate mailing
list sites for other domains (Airship, Kata, OpenInfra, OpenStack,
StarlingX). If you have any questions or concerns, feel free to
follow up on the service-discuss mailing list or find us in the
#opendev channel on the OFTC IRC network.