- Zuul-discuss - lists.opendev.org

New status page for the Zuul UI
by Felix.Edel＠bmw.de 06 Jun '24

06 Jun '24

Hi, I’ve been working on a stack of changes to rework the status view in the Zuul UI: https://review.opendev.org/c/zuul/zuul/+/916284 In our Zuul setup we have some tenants which are quite large and have a lot of pipelines and longer (gate) queues. For those tenants, the status page becomes more and more unusable as too much information is shown on this single page. This makes it hard for the “operators” of this tenant to get a clear picture of what’s going on and for the individual “developers” it’s hard to have a look at their individual changes (or queues). So, we have done surveys with some of our key users and tried to find out how the current status view could be improved and what they would expect from such a view (which information should be shown, which actions/options should be available). Based on this and our own experience with the Zuul UI we came up with some improvements which are implemented in the stack mentioned above. Basically, the idea behind those changes is to provide both a “operator-oriented” view and a “developer-oriented” view without mixing both into a single view (which is kind of what the current status view tries to do). Instead of showing all information on a single page, the new approach splits that information into different “scopes”: 1. Status / pipeline overview 2. Pipeline details 3. Individual change Based on those scopes, the pages that handle those focus only on the relevant information, but don’t show too many details about the other scopes. The stack currently covers 1. and 2., whereby 3. is already existing in form of the “single change panel/view”. I’m planning to do a rework of that as well later. Please note, that this is still an ongoing work and not yet finished, so there might be some flaws. If you are interested in this topic or have any questions, don’t hesitate to contact me, or reply to this email. I’d be happy to get some feedback/reviews on those changes. A preview of the new UI can be found here: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/… Br, Felix

2 2

Submit to the OpenInfra Summit CFP Before May 29, 2024
by Clark Boylan 09 May '24

09 May '24

Hi everyone, The OpenInfra Summit Asia is the first community-led Summit, hosted by the OpenInfra Korea User Group in collaboration with other OpenInfra user groups throughout Asia. I wanted to share that the CFP is currently open and accepting applications until May 29, 2024. The OpenInfra Summit Asia will be co-located with the OCP Regional Summit APAC and will showcase the latest advancements in open source infrastructure software and hardware. I want to encourage the Zuul community to represent the latest advancements with the software by submitting talks to the Summit CFP! If you want to attend and your employer cannot fund your travel, the OpenInfra Foundation is continuing the OpenInfra Travel Support program. You can apply for travel support until May 29. Submit to the CFP: https://openinfrafoundation.formstack.com/forms/openinfra_asia_summit_2024 Apply for the OpenInfra Travel Support Program: https://openinfrafoundation.formstack.com/forms/openinfra_tsp Register for the OpenInfra Summit Asia: https://2024.openinfraasia.org/ If you have any questions, please let me know. Clark

1 0

Gerrit driver and enqueuing items with open / unresolved comments
by Wade Carpenter 04 May '24

04 May '24

While it's not necessarily _required_ with gerrit, it does at least warn in the UI when trying to manually submit a change with open comments. I looked at the docs and could not find a way to have zuul require "no open comments" before enqueueing items into the (gate) pipeline. https://zuul-ci.org/docs/zuul/latest/drivers/gerrit.html#requirements-confi… Did I miss something here? If not, would this be a reasonable thing to request and / or submit a patch to implement?

3 3

"provides" and "requires" no longer supported in dependency cycle?
by A richist 03 May '24

03 May '24

Hello Zuul folk, I have an issue where with ~the following config: - queue: name: Topic allow-circular-dependencies: true dependencies-by-topic: true per-branch: true - job: name: A_build parent: base_build provides: A_build - job: name: B_build parent: base_build requires: - A_build - project: name: A queue: Topic gate: jobs: - A_build - project: name: B queue: Topic gate: jobs: - B_build Having a Gerrit change for both A and B projects, under the same branch and topic, and gate-ing them in the "correct" order, both A_build and B_build start running simultaneously, instead of B_build waiting for A_build's completion. This definitely worked as I expected before upgrading to Zuul 10.0.0 (occurs in 10.1.0 as well). I've also tried changing this to use: - job: name: B_build parent: base_build dependencies: - name: A_build soft: true But got a "job does not exist" error. I assume this is because the branch, where the jobs are defined, is under "always-dynamic-branches" (which is a must in my case). Is this intended behaviour under the new dependency cycle handling? Is there anything else I can try to have B wait for A_build's completion to be able to use A's build artifacts? Regards, Arichist

2 2

MySQL/MariaDB performance problems
by James E. Blair 18 Apr '24

18 Apr '24

Hi, In OpenDev we have noticed some performance problems with Zuul master running with MySQL. I believe we have a path for fixing those, but things may be unstable for the next week or so. If you're running Zuul with MySQL or MariaDB I recommend you avoid upgrading to Zuul master until this is resolved. I'll send an update when it is. -Jim

1 1

OpenInfra Day Sweden Event Schedule is Posted
by Clark Boylan 10 Apr '24

10 Apr '24

I wanted to point out that the OpenInfra Day Sweden [0] event schedule has been posted [1]. There are a number of Zuul talks on the schedule. The event occurs on May 7, 2024 in Gothenburg, Sweden. Registration is free, but required to attend the event. If you find yourself in the area, this is a great opportunity to learn more about Zuul and get in touch with others using Zuul. [0] https://oideurope2024.openinfra.dev/sweden/ [1] https://www.oidsweden2024.se/schedule Clark

1 0

[Diversity] PTG Schedule
by Amy Marrich 06 Apr '24

06 Apr '24

The Diversity and Inclusion working group will hold a session Tuesday, April 9th at 14:00 UTC in the Cactus room. Agenda is available[0], please add any topics. Amy 0 - https://etherpad.opendev.org/p/apr2024-ptg-diversity

1 0

Require correct regular expression for always-dynamic-branches tenant config
by Mithun Mistry 02 Apr '24

02 Apr '24

Hi , We want to apply the tenant configuration always-dynamic-branches for branch names starting with “Feature” and “Release” We have used the following regular expression : gerrit: config-projects: - zuul-config untrusted-projects: - CCB: exclude: - pipeline - project - job - semaphore - nodeset - secret - project-template include-branches: ^((Feature|Release)(\/))?(CCB\d+)(\/.*)?$ always-dynamic-branches: - "^Feature/.*" - "^Release/.*" shadow: zuul-config this does not seem to be working as zuul is still loading zuul configs from these branches. 2024-03-18 09:50:33,208 INFO zuul.TenantParser: Loading configuration from CCB_DTM/zuul.yaml@Release/CCB9/TCL_F8 2024-03-18 09:50:33,225 DEBUG zuul.TenantParser: Waiting for cat job <zuul.zk.event_queues.JobResultFuture object at 0x7f6bc7a326a0> 2024-03-18 09:50:34,007 DEBUG zuul.TenantParser: Cat job <zuul.zk.event_queues.JobResultFuture object at 0x7f6bc7a326a0> got files dict_keys(['.zuul.yaml', 'zuul.yaml']) 2024-03-18 09:50:34,008 INFO zuul.TenantParser: Loading configuration from CCB_DTM/zuul.yaml@Release/CCB9/TCL_F8_1 2024-03-18 09:50:34,024 DEBUG zuul.TenantParser: Waiting for cat job <zuul.zk.event_queues.JobResultFuture object at 0x7f6bc7a3d520> Can you please suggest the correct regular expression for this tenant configuration. We are using zuul version 8.3.1 Regards, Mithun Western Digital

1 0

[PTG] Less than One Month Reminders!
by Kendall Nelson 20 Mar '24

20 Mar '24

Hello Everyone, The April PTG is rapidly approaching and team moderators are signing up for time to meet via the PTGbot. The schedule is filling up and we are excited to see you all! If you have not yet registered, please do so! It's free![1]. Another note about this PTG in particular, Meetpad is the default video conferencing tool. TTeam moderators are able to override the meeting URL if they choose to do so in order to make use of other tools. We do have a few zoom rooms if needed. This is the first PTG we are doing this for, so please give us feedback[2] with as many details as possible if you run into any issues with Meetpad. Open source needs open tools after all! If you have any questions, please let us know via email to ptg(a)openinfra.dev . Thank you! -Kendall Nelson Senior Upstream Developer Advocate The OpenInfra Foundation [1] http://ptg2023.openinfra.dev/ [2] https://etherpad.opendev.org/p/April2024-PTG-Feedback

1 1

Removal of Tests for Older Distro Releases in zuul/zuul-jobs
by Clark Boylan 12 Mar '24

12 Mar '24

Hello, I wanted to give everyone a heads up that we have been removing test jobs for older Linux distro releases in zuul-jobs. So far we've removed testing for OpenSUSE Leap 15.2, Debian Buster, and CentOS 7. We will be removing testing for Ubuntu Xenial in the near future as well. Each of these distro releases is at or very near its end of life. Removing test jobs for these releases will make room for newer distro releases within the OpenDev Zuul deployment which will allow zuul-jobs to run tests against modern distro releases. These removals also mean that zuul-jobs cannot test for compatibility with those older releases. No intentional breakage is planned, but without testing to catch problems we may introduce incompatibilities over time. Clark

1 0

PTG April 2024 Teams List
by Kendall Nelson 23 Feb '24

23 Feb '24

Hello Everyone! The April 2024 Project Teams List is official! Projects + Teams - OpenInfra Foundation Teams - - Diversity & Inclusion Working Group - OpenInfra Edge Computing Group - Kata Containers - OpenDev - StarlingX - OpenStack - - Services - - Blazar - Cinder - CloudKitty - Designate - Glance - Horizon - Ironic - Keystone - Kolla - Magnum - Manila - Neutron - Nova - Octavia - OpenStackAnsible - OpenStack-Helm - OpenStackSDK/CLI - Quality Assurance - Release Management - Tacker - Other OpenStack Teams - - OpenStack Security SIG - OpenStack Technical Committee - PublicCloud SIG - RBAC - VDI If your team was planning to meet and isn’t on this list, please contact ptg(a)openinfra.dev IMMEDIATELY. Soon, I will be contacting moderators to sign up for time via the PTGBot[1] once I have it configured for the teams that are signed up to attend the event. Otherwise, please don't forget to register[2] — it's FREE! As usual, feel free to let us know if you have any questions! Thanks! -Kendall (diablo_rojo) [1] PTGBot Docs: https://github.com/openstack/ptgbot#open-infrastructure-ptg-bot [2] PTG Registration: https://ptg2024.openinfra.dev/ <http://ptg2023.openinfra.dev/>

1 1

AI generated contributions
by James E. Blair 20 Feb '24

20 Feb '24

Hi, AI generated code is kind of a hot topic. The Open Infrastructure Foundation is working on developing some recommendations around how projects should handle contributions that are wholly or in part machine generated. The goal is to be as welcoming as possible of such contributions while avoiding potential pitfalls. In the mean time, I think Zuul contributors and maintainers would be well served to read this statement from the Apache Software Foundation which covers some of the potential issues and makes recommendations about some responsibilities of contributors and how to identify such contributions to make everyone aware of them: https://www.apache.org/legal/generative-tooling.html I think we should consider this a loose framework for the Zuul project to follow until the OIF makes their own recommendations and we evaluate them. -Jim

3 3

PTG April 2024 Team Signup Deadline Approaching!
by Kendall Nelson 11 Feb '24

11 Feb '24

Hello Everyone, This is your *last call *to sign up your team up for the next Project Teams Gathering (PTG)[1], which will be held from Monday, April 8 to Friday, April 12 2024! If you haven't already done so and your team is interested in participating, *you need to complete the survey[2] by February 18, 2024 at 7:00 UTC*. Thanks! -Kendall Nelson (diablo_rojo) [1] PTG Site: https://openinfra.dev/ptg/ [2] Team Survey: https://openinfrafoundation.formstack.com/forms/april2024_ptg_survey

1 0

Using Github checks API
by ldenny＠redhat.com 11 Feb '24

11 Feb '24

Hi, I notice in the documentation [1] that the Github Check API is the recommendation to use. I checked some other projects for an example of this in action but was unable to find one. When you have a PR that triggers multiple jobs and for example, 1 out of 5 fails, is using the Github Check API a way to be able to only retrigger the failed job? Or is there another way to achieve this? We are currently using Github Status. [1] https://zuul-ci.org/docs/zuul/latest/drivers/github.html#attr-pipeline.%3Cr…

1 0

Persist changes to job inventory
by James E. Blair 17 Jan '24

17 Jan '24

Hi, I'm looking into a use case that involves the Nodepool k8s namespace driver. The intent with this driver is to provide a job with a namespace in which it can create its own k8s resources. It might then use those resources directly, or call a nested Ansible to interact with k8s, or add them to the Zuul job's Ansible inventory using add_host. However, that last option doesn't persist across playbooks, and Zuul jobs are typically made up of multiple playbooks which can make some kinds of work difficult (for example, necessitating running add_host at the start of each playbook). The inventory file itself is mounted in bubblewrap read-only, so even direct manipulation of the file is not an option to address persistence. I think we could change that and allow updates to the Zuul job's Ansible inventory file (either through direct manipulation, or via a custom add_host or similar module). Though I don't see any issues now, there may be security implications that I'm not immediately seeing, so I wanted to circulate the idea and get feedback before proceeding. I believe that since any playbook can already use the add_host module to affect the running of that playbook, then any concerns about access to resources using Zuul's ssh keys are moot. Most installations drop the built-in nodepool ssh keys during an early pre-run playbook, so this change would offer no ability to circumvent that. Likewise, project ssh keys are always present at the project level, regardless of which playbook is running. The main potential avenue for mischief that I can see would be the ability to substitute one host for another before a later trusted playbook (eg, a post-run playbook) is run. However, if such a playbook is depending on an *existing* inventory host being present (as opposed to executing its own add_host to, say, add a log server to the inventory), then that is already subject to the ability of users to change the nodeset on jobs just as easily as they might change the playbook of a job. I think such a situation would only be possible in a system where users have no ability to create or edit jobs yet do have the ability to edit playbooks. That seems very unlikely, and even more unlikely that anyone would consider that completely secure from abuse. I'm inclined to think that adding the ability to persist inventory changes across Zuul job playbooks is safe to do. But please let me know if you think that could cause problems. Thanks, Jim

2 1

Is the Zuul Quickstart tutorial abandoned?
by anders.klint＠qamcom.se 10 Jan '24

10 Jan '24

Hi, Way back (several years ago) I worked in a team using Zuul as one of several tools for CI. Running through the quickstart tutorial was a great way to get started and get a feeling for Zuul. I am now looking at Zuul again a potential tool in another setting and planned to run a "refresher" by working through the tutorial again. Sadly i only got part of the way (no results on changes to test1 project) and a _little_ digging shows that both zuul-tutorial-executor-1 and zuul-tutorial-gerritconfig-1 containers fails directly on start. Looking at the bugs list in storyboard, I find at https://storyboard.openstack.org/#!/story/2007325 that was created almost 4 years(!) ago with basically the same symptom(s). I remember the tutorial as a great start and intro to Zuul, but it needs to be solid. With the tutorial as one of the first links on several Zuul-ci.org pages, having it broken (for years??) is not really a great starting experience for a tool with the slogan "Stop merging broken code". Is it abandoned?

2 1

Fwd: Team Signup for April 2024 OpenInfra PTG
by Kendall Nelson 09 Jan '24

09 Jan '24

Hello Everyone, Hopefully, you have seen by now, that the next OpenInfra PTG[1] will take place April 8-12, 2024 virtually! *To sign up your team, you must complete the survey[2] by February 18 at 7:00 UTC.* We NEED accurate contact information (email and IRC nickname ideally) for the moderator of your team’s sessions. This is because the survey information will be used to organize the schedule sign ups which will be done via the PTGBot. If you are not on IRC, please get set up[3] on the OFTC network and join #openinfra-events. You are also encouraged to familiarize yourself with the PTGBot documentation[4] as well. If you have any questions, please reach out! Information about signing up for timeslots will be sent to moderators late February after the team sign up deadline. Continue to visit openinfra.dev/ptg for updates. Registration will open soon! -Kendall Nelson (diablo_rojo) [1] PTG Site: https://openinfra.dev/ptg/ [2] Team Survey: https://openinfrafoundation.formstack.com/forms/april2024_ptg_survey [3] Setup IRC: https://docs.openstack.org/contributors/common/irc.html [4] PTGBot README: https://opendev.org/openstack/ptgbot/src/branch/master/README.rst

1 0

Project lead election
by James E. Blair 08 Jan '24

08 Jan '24

Hi, The position of Zuul Project Lead is an elected position described in our governance document[1]. I currently hold the position, and would be happy to continue in that position for another year. If elected, I plan to continue my current hands-off approach. I believe that all of the Zuul Maintainers are empowered to collectively decide on and execute our vision for the project. My purpose is to help articulate that vision when necessary, drive the process of attaining consensus, and be a point of contact and representative for the project in circumstances where a single person is needed (but in those cases, I promise to share as much of that work as possible with the rest of the team). I have uploaded a change[2] to update the expiration date of my term. If any other Zuul Maintainers would like to nominate themselves for the position, please upload a similar change and send a reply to this message to this list. The nomination period will close on January 15, 2024. If there are other candidates, we will hold a Condorcet election at that time. -Jim [1] https://zuul-ci.org/docs/zuul/governance.html#zuul-project-lead [2] https://review.opendev.org/905001

1 0

Breaking change in Ansible 2.15.7 (Ansible 8)
by James E. Blair 05 Dec '23

05 Dec '23

Hi, I just noticed (via some unit test failures in Zuul) that the Ansible project just released an update of Ansible 8 (ansible-core 2.15.7) that includes a breaking change to address CVE-2023-5764. The release summary: https://github.com/ansible/ansible/blob/stable-2.15/changelogs/CHANGELOG-v2… The porting guide: https://docs.ansible.com/ansible-core/2.15/porting_guides/porting_guide_cor… In particular one of Zuul's unit tests had an assertion with a nested template: assert: that: - zuul.project.name == '{{ (zuul | zuul_legacy_vars).ZUUL_PROJECT }} As you can see from the porting guide, the fix is to remove the nested template since the assertion is already expected to be a jinja template: assert: that: - zuul.project.name == (zuul | zuul_legacy_vars).ZUUL_PROJECT This message is just an FYI for anyone who may encounter this and be surprised by a breaking change at this point. -Jim

1 0

[Diversity] Diversity and Inclusion WG November Meeting Change and New Time
by Amy Marrich 09 Nov '23

09 Nov '23

Due to travel next week we are bumping the D&I WG meeting to November 21st at our new winter time of 15:00 UTC. As always we welcome members of all the OpenInfra projects to join us to discuss diversity and WG related topics. Amy (spotz)

1 0

Call for Writers or OpenInfra Live Participants
by Kristin Barrientos 02 Nov '23

02 Nov '23

Hi everyone, Do you have a topic that you would like to discuss on OpenInfra Live or Superuser? We’d love to hear from you. Please reach out to me via email or IRC if you have any ideas and we can talk next steps. Thanks, Kristin Barrientos IRC: @kbarrientos:matrix.org Marketing Coordinator OpenInfra Foundation

1 0

D&I WG PTG Session - Leadership Shadowing
by Amy Marrich 20 Oct '23

20 Oct '23

The D&I WG will hold a session Monday at 13:00 UTC in the Diablo room. The subject of the session is a Leadership Shadowing program we have been brainstorming[0] to help generate the next generation of Leaders in the OpenInfra Projects. As this program can be used in all projects and at all levels of leadership we are hoping all projects will join us. Thanks, Amy (

1 0

Circular dependencies refactor spec
by James E. Blair 10 Oct '23

10 Oct '23

Hi, I have posted a spec for refactoring the internal implementation of circular dependencies. This should result in few user-visible changes, but I believe it is necessary in order to make the code more maintainable and to ensure Zuul operates correctly. The spec has seen some initial positive review already. Given that, I would like to merge it next Tuesday, October 17, if it looks like we have consensus then, or of course delay it if folks identify problems or need more time to review. Here is the spec: https://review.opendev.org/895988 Thanks, Jim

1 0

[Diversity] Diversity and Inclusion WG Meeting reminder
by Amy Marrich 11 Sep '23

11 Sep '23

This is a reminder that the Diversity and Inclusion WG will be meeting tomorrow at 14:00 UTC in the #openinfra-diversity channel on OFTC. We hope members of all OpenInfra projects join us as we look at the progress on responses to the Foundation-wide diversity survey. Thanks, Amy (spotz) 0 - https://etherpad.opendev.org/p/diversity-wg-agenda

1 0

OpenInfra Live Zuul Deep Dive: Volvo - Sept. 7 at 1400 UTC
by Kristin Barrientos 06 Sep '23

06 Sep '23

Hi everyone, This week’s OpenInfra Live episode is brought to you by the Zuul community! Episode: In this episode, a panel of Zuul operators invites special guests to talk about their deployment and discuss their operations. For this episode, our guests will be Johannes Foufas and Moiz Ahmed, from Volvo. Date and time: Sept. 7, 2023 at 9:00 AM CST (14:00 UTC) You can watch us live on: YouTube: https://www.youtube.com/watch?v=ZjY61I-8mpQ LinkedIn: https://www.linkedin.com/events/7094388406977265664/comments/ WeChat: The recording will be posted on OpenInfra Foundation WeChat after the live stream Speakers: Johannes Foufas, Moiz Ahmed, Clark Boylan, James Blair, Jeremy Stanley and Kristin Barrientos Have an idea for a future episode? Share it now at ideas.openinfra.live. Thanks, Kristin Barrientos Marketing Coordinator OpenInfra Foundation

1 0