- service-discuss - lists.opendev.org

RE: [Starlingx-discuss] Mailman v3 migration for StarlingX mailing lists completed
by Khalil, Ghada 26 Sep '23

26 Sep '23

Hello, Is this link to the starlingx list archives still expected to work? Or is there a new link? https://lists.starlingx.io/pipermail/starlingx-discuss/2023-September/date.… I don't see any new email messages in the archives since the migration was done. Thanks, Ghada -----Original Message----- From: Jeremy Stanley <fungi(a)yuggoth.org> Sent: Thursday, September 21, 2023 12:33 PM To: starlingx-discuss(a)lists.starlingx.io Subject: [Starlingx-discuss] Mailman v3 migration for StarlingX mailing lists completed CAUTION: This email comes from a non Wind River email account! Do not click links or open attachments unless you recognize the sender and know the content is safe. The OpenDev Collaboratory systems administrators have completed migration of the lists.starlingx.io mailing list site to the Mailman 3.3.8 server. Please remember these key takeaways: * Because this is on a new server, there are new IP addresses from which list mail will be originating: 162.209.78.70 and 2001:4800:7813:516:be76:4eff:fe04:5423 * Anyone wishing to adjust their list subscriptions, or handle moderation or list configuration after the migration, needs to use the Sign Up button on the Web page to create a new account; it will be linked to your imported roles as soon as you confirm by following a URL from an E-mail message the server sends you, and is global for all sites on the server so you only need to do this once * The software providing Web front-ends for list management and archive browsing is entirely new in Mailman v3 and therefore has a much different appearance, though we've added appropriate redirects and frozen copies of old archives in order to accommodate existing hyperlinks If you have any questions or concerns, feel free to follow up on the service-discuss mailing list or find us in the #opendev channel on the OFTC IRC network. -- Jeremy Stanley

3 2

Team Meeting Agenda for September 26, 2023
by Clark Boylan 25 Sep '23

25 Sep '23

We will meet with this agenda on September 26, 2023 at 19:00 UTC in #opendev-meeting: == Agenda for next meeting == * Announcements ** OpenStack should publish final RCs this week and complete the Bobcat release next week. * Actions from last meeting * Specs Review * Topics ** Mailman 3 (clarkb 20230627) *** https://etherpad.opendev.org/p/mm3migration *** Need to schedule migrations for list domains in blocks **** lists.openstack.org ** Upgrading Bionic servers to Focal/Jammy (clarkb 20230627) *** https://etherpad.opendev.org/p/opendev-bionic-server-upgrades *** Next up mirrors and meetpad. ** Nodepool image build and upload frequency (clarkb 20230912) *** Image upload timeout increased to 6 hours on September 18. Need to check back in a week or two to see if this is happy. ** Updating the InMotion/OpenMetal Cloud Deployment (clarkb 20230919) *** Heard back from Yuriy. Need to figure out how the OpenMetal update planning impacts our timelines for action. ** Zuul PCRE regex support is deprecated (clarkb 20230905) *** Zuul is moving all regexes to re2 instead of PCRE. We'll need to migrate job configs within OpenDev projects. ** Python container updates (tonyb 20230718) *** https://review.opendev.org/q/(topic:bookworm-python3.11+OR+hashtag:bookworm… Next round of image rebuilds onto bookworm. *** Deferring Gerrit until after the OpenStack release *** Other images queued up for updates. Note zuul-registry depends on openssl 1.something which isn't available on Bookworm. We'll need to figure that out. ** Etherpad 1.9.3 Upgrade (clarkb 20230926) *** https://review.opendev.org/c/opendev/system-config/+/896454 ** Gitea 1.21.0 Upgrade (clarkb 20230926) *** Gitea has released a 1.21.0-rc0. No Changelog yet but we can start preparing for this upgrade whenever we are ready. ** Gerrit replication plugin leaked task files (clarkb 20230926) *** https://gerrit-review.googlesource.com/c/plugins/replication/+/387314 Clarkb wrote and pushed a fix upstream ** PTGBot webserver crashing (clarkb 20230926) *** Frickler noticed that the webserver wasn't responding. Nothing seems to have logged the process crashing but it definitely wasn't running. May need updates to the software to improve logging. * Open discussion

1 0

Zuul regex deprecation [action required]
by James E. Blair 20 Sep '23

20 Sep '23

Hi, Zuul is making a change that may require action from developers on projects hosted in OpenDev. Here is the release note regarding the change: > Regular expressions using Python syntax are deprecated in favor of RE2 > syntax instead, for additional speed and safety. Negative lookahead > assertions may be replaced using the negate keyword. See Regular > Expressions[1] for more information. > > If Zuul detects a regular expression using Python syntax that is not > supported by RE2, it will register a configuration syntax > warning. These may be viewed on the configuration errors page in the > web interface. > > A future version of Zuul will remove Python regex support completely > and these warnings will become errors. [1] https://zuul-ci.org/docs/zuul/latest/project-config.html#regex It's easy to see if your project on OpenDev is affected. Each tenant has a page where the current configuration errors and warnings are displayed. Visit any page in Zuul for your tenant, and if there is a bell icon in the top right, click on that. For example, the configuration error page for the OpenStack tenant is here: https://zuul.opendev.org/t/openstack/config-errors On that page, look for the "Regex Deprecation" warnings. You can expand the warning to see exactly the file and line number where the warning is found. Almost all of the issues identified so far have been due to the fact that RE2 does not support negative lookahead assertions. In the past, we used these a lot to say things like "run this job on any branch except master" with regexes like "(?!master)". Because this is such a common pattern, we added a feature in Zuul to make this easy. A configuration like: branches: "^(?!master).*$" can now be written as: branches: regex: "^master$" negate: true This simply negates the specified regex. It's not an exact translation of the original regex, but is slightly improved and to the point: anything but exactly "master". Please take a moment and check to see if your project has instances of this warning, and go ahead and fix it. Even if there are a lot of instances, they are likely to be very similar and correcting them may take only a few minutes. Here are two changes where we update the central configuration that applies to all projects: https://review.opendev.org/c/openstack/project-config/+/893702 https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/893792 These provide examples of how to make changes for several common cases; you may be able to simply copy what was done in those changes. If you have any trouble adapting existing regexes to the new format, please contact us in #opendev to discuss the issue. We may be able to find a simple solution, or if there is another special case that is difficult to handle, we may be able to add support to Zuul to mitigate the issue. If you use "update-regexes" as a topic name, it will help people keep track of progress and possible issues. The Zuul project has not yet set a date for when support for the old syntax will be removed. I expect it to be on the order of months, which should give folks plenty of time to make the necessary changes. But please do so early so that we have time to deal with any issues. Thanks, Jim (on behalf of the OpenDev team)

1 0

Team Meeting Agenda for September 19, 2023
by Clark Boylan 18 Sep '23

18 Sep '23

We will meet on September 19, 2023 at 19:00 UTC in #opendev-meeting with this agenda: == Agenda for next meeting == * Announcements * Actions from last meeting * Specs Review * Topics ** Bastion host (ianw 20230627) *** https://review.opendev.org/q/topic:prod-bastion-group Remaining changes are part of parallel ansible runs on bridge *** https://review.opendev.org/q/topic:bridge-backups ** Mailman 3 (clarkb 20230627) *** https://etherpad.opendev.org/p/mm3migration *** Need to schedule migrations for list domains in blocks **** lists.openinfra.dev + lists.starlingx.io Thursday September 21, 2023 **** lists.openstack.org ** Upgrading Bionic servers to Focal/Jammy (clarkb 20230627) *** https://etherpad.opendev.org/p/opendev-bionic-server-upgrades *** Next up mirrors and meetpad. ** Nodepool image build and upload frequency (clarkb 20230912) *** Image upload timeout increased to 6 hours on September 18. Need to check back in a week or two to see if this is happy. ** Updating the InMotion/OpenMetal Cloud Deployment (clarkb 20230919) *** Heard back from Yuriy. Need to figure out how the OpenMetal update planning impacts our timelines for action. ** Zuul PCRE regex support is deprecated (clarkb 20230905) *** Zuul is moving all regexes to re2 instead of PCRE. We'll need to migrate job configs within OpenDev projects. *** Draft announcement for OpenDev users (particularly OpenStack) https://etherpad.opendev.org/p/3FbfuhNmIWT33fCFK1oK ** Python container updates (tonyb 20230718) *** https://review.opendev.org/q/hashtag:bookworm+status:open Next round of image rebuilds onto bookworm. *** The Gerrit image is the current outstanding update. There is also an update to Gerrit 3.7.5. Should we bundle all of these updates together or do one at a time and restart Gerrit a couple times? * Open discussion

1 0

Team Meeting Agenda for September 12, 2023
by Clark Boylan 11 Sep '23

11 Sep '23

We will meet with this agenda on September 12, 2023 at 19:00 UTC in #opendev-meeting: == Agenda for next meeting == * Announcements * Actions from last meeting * Specs Review * Topics ** Infra Root Google Account Activity (clarkb 20230905) *** This account is used by zuul to connect to Gerrit's Gerrit. We will want to login to it periodically to refresh the idle state. ** Bastion host (ianw 20230627) *** https://review.opendev.org/q/topic:prod-bastion-group Remaining changes are part of parallel ansible runs on bridge *** https://review.opendev.org/q/topic:bridge-backups ** Mailman 3 (clarkb 20230627) *** https://etherpad.opendev.org/p/mm3migration *** Need to schedule migrations for list domains in blocks **** lists.kata-containers.io + lists.airshipit.org Thursday September 14, 2023 **** lists.openinfra.dev + lists.starlingx.io **** lists.openstack.org ** Upgrading Bionic servers to Focal/Jammy (clarkb 20230627) *** https://etherpad.opendev.org/p/opendev-bionic-server-upgrades *** Next up mirrors and meetpad. ** Nodepool image build and upload frequency (clarkb 20230912) *** Is the new slower pace of updates working for us? *** Nodepool image upload timeout is now configurable. We should set this value to something reasonable for our cloud targets. ** Zuul PCRE regex support is deprecated (clarkb 20230905) *** Zuul is moving all regexes to re2 instead of PCRE. We'll need to migrate job configs within OpenDev projects. ** Python container updates (tonyb 20230718) *** https://review.opendev.org/q/hashtag:bookworm+status:open Next round of image rebuilds onto bookworm. * Open discussion

1 0

Team Meeting Agenda for September 5, 2023
by Clark Boylan 05 Sep '23

05 Sep '23

We will meet with this agenda on September 5, 2023 at 19:00 UTC in #opendev-meeting: == Agenda for next meeting == * Announcements * Actions from last meeting * Specs Review * Topics ** Infra Root Google Account Activity (clarkb 20230905) *** We need to look into what this account was for and decide if we need minimal acitvity on it to keep it alive. ** Bastion host (ianw 20230627) *** https://review.opendev.org/q/topic:prod-bastion-group Remaining changes are part of parallel ansible runs on bridge *** https://review.opendev.org/q/topic:bridge-backups ** Mailman 3 (clarkb 20230627) *** https://etherpad.opendev.org/p/mm3migration *** Need to schedule migrations for list domains in blocks **** lists.kata-containers.io + lists.airshipit.org **** lists.openinfra.dev + lists.starlingx.io **** lists.openstack.org ** Upgrading Bionic servers to Focal/Jammy (clarkb 20230627) *** https://etherpad.opendev.org/p/opendev-bionic-server-upgrades *** Next up mirrors and meetpad. *** Clarkb needs to look into cleaning up the old CI registry node. ** Rax IAD image upload struggles (clarkb 20230822) *** Rax IAD is expected to be slower than other regions. **** In response to this we've reduced the number of upload threads in nodepool-builders and reduced the rebuild interval for most of our images. ** Fedora cleanup (clarkb 20230627) *** I've seen projects like Ironic move towards cleaning things up on their side. Maybe we should announce a nodepool removal date in a week or two and remove it completely at that point. ** Zuul Ansible 8 default *** All tenants are now running Ansible 8 by default in OpenDev's Zuul ** Zuul PCRE regex support is deprecated (clarkb 20230905) *** Zuul is moving all regexes to re2 instead of PCRE. We'll need to migrate job configs within OpenDev projects. ** Python container updates (tonyb 20230718) *** https://review.opendev.org/q/hashtag:bookworm+status:open Next round of image rebuilds onto bookworm. * Open discussion

1 0

Second 2023 Election for OpenDev Service Coordinator
by Clark Boylan 30 Aug '23

30 Aug '23

It is time to elect our OpenDev service coordinator for the next six months. As mentioned during the last weekly team meeting we will open the nomination period from August 8, 2023 to August 22, 2023 using UTC as the timezone. If we have more than one nominee in that time frame we can run an election between the candidates from August 23, 2023 to August 30, 2023 (again using UTC as the timezone). If you are interested in running, feel free to reach out to me for more information or with any questions you may have. The OpenDev governance documentation [0] also has information about the role and its responsibilities. [0] https://docs.opendev.org/opendev/system-config/latest/project.html#governan… Clark

2 2

Team meeting agenda for August 29, 2023
by Clark Boylan 28 Aug '23

28 Aug '23

We will meet with this agenda on August 29, 2023 at 19:00UTC in #opendev-meeting: == Agenda for next meeting == * Announcements * Actions from last meeting * Specs Review * Topics ** Service Coordinator Election (clarkb 20230822) *** clarkb was the only nominee. ** Bastion host (ianw 20230627) *** https://review.opendev.org/q/topic:prod-bastion-group Remaining changes are part of parallel ansible runs on bridge *** https://review.opendev.org/q/topic:bridge-backups ** Mailman 3 (clarkb 20230627) *** https://etherpad.opendev.org/p/mm3migration *** All outstanding changes to fix vhosting, upgrade mailman, and clean up config management have landed. *** Time to schedule some list domain migrations. ** Upgrading Bionic servers to Focal/Jammy (clarkb 20230627) *** https://etherpad.opendev.org/p/opendev-bionic-server-upgrades *** Next up mirrors and meetpad. *** Clarkb needs to look into cleaning up the old CI registry node. ** Rax IAD image upload struggles (clarkb 20230822) *** The Rax IAD region has struggled to upload images within the image upload timeout. This seems to get worse the more images you upload **** Almost like images are processed serially and we create a queue that gets backed up. *** No issue has been filed with rax yet, but we're testing incremental unpausing of images to get more data. *** We also have hundreds of leaked images in the other two regions (there were well over a thousand in IAD but those have been cleaned up manually now). ** Fedora cleanup (clarkb 20230627) *** https://review.opendev.org/c/opendev/base-jobs/+/892380 Remove the fedora-latest nodeset ** Zuul Ansible 8 default *** Email sent to announce the common default updates https://lists.opendev.org/archives/list/service-announce@lists.opendev.org/… *** Every tenant but OpenStack is running Ansible 8 by default now. *** Plan to do OpenStack on September 4 (this date happens to be a US holiday but I can probably be around to shepherd things through). ** Python container updates (tonyb 20230718) *** https://review.opendev.org/q/hashtag:bookworm+status:open Next round of image rebuilds onto bookworm. *** Containers like gitea aren't based on our base image but should be updated too. * Open discussion

1 0

Mailman 3 service upgrades
by Jeremy Stanley 25 Aug '23

25 Aug '23

A few minutes ago we upgraded the production Mailman 3 server (currently hosting this lists.opendev.org domain and also lists.zuul-ci.org) to the latest releases of the various Mailman component applications. If you notice any problems you think might be related to the upgrade, please do let us know here on the service-discuss mailing list or in the #opendev channel of the OFTC IRC network. -- Jeremy Stanley on behalf of the OpenDev Collaboratory sysadmins

1 0

Clarkb's Service Coordinator Self Nomination
by Clark Boylan 22 Aug '23

22 Aug '23

We have just about reached the end of the OpenDev Service Coordination nomination period, and I haven't seen any nominations. I brought this up in our weekly team meeting just now, and it sounds like people are happy for me to continue in the role. Given that feedback I nominate myself to serve another six months as OpenDev Service Coordinator. Expect more of the same direction from me. I'm hoping we'll continue upgrading older servers, move our container images to Bookworm, and maybe eventually get some stuff running on podman so that we can revive quay.io hosting of our images. If you'd like something different your window of opportunity is quickly fading as we said August 22 would be the end of the nomination period. To be clear, I'd be happy to support someone else in the role if they want to give it a go. Thank you for your consideration, Clark

1 0