- Zuul-discuss - lists.opendev.org

Circular dependencies refactor spec
by James E. Blair 11 Oct '23

11 Oct '23

Hi, I have posted a spec for refactoring the internal implementation of circular dependencies. This should result in few user-visible changes, but I believe it is necessary in order to make the code more maintainable and to ensure Zuul operates correctly. The spec has seen some initial positive review already. Given that, I would like to merge it next Tuesday, October 17, if it looks like we have consensus then, or of course delay it if folks identify problems or need more time to … [View More]

1 0

[Diversity] Diversity and Inclusion WG Meeting reminder
by Amy Marrich 12 Sep '23

12 Sep '23

This is a reminder that the Diversity and Inclusion WG will be meeting tomorrow at 14:00 UTC in the #openinfra-diversity channel on OFTC. We hope members of all OpenInfra projects join us as we look at the progress on responses to the Foundation-wide diversity survey. Thanks, Amy (spotz) 0 - https://etherpad.opendev.org/p/diversity-wg-agenda

1 0

OpenInfra Live Zuul Deep Dive: Volvo - Sept. 7 at 1400 UTC
by Kristin Barrientos 07 Sep '23

07 Sep '23

Hi everyone, This week’s OpenInfra Live episode is brought to you by the Zuul community! Episode: In this episode, a panel of Zuul operators invites special guests to talk about their deployment and discuss their operations. For this episode, our guests will be Johannes Foufas and Moiz Ahmed, from Volvo. Date and time: Sept. 7, 2023 at 9:00 AM CST (14:00 UTC) You can watch us live on: YouTube: https://www.youtube.com/watch?v=ZjY61I-8mpQ LinkedIn: https://www.linkedin.com/events/… [View More]

1 0

Cyber Resilience Act: What Now? Aug 24 at 9 AM (CST) / 14:00 UTC
by Kristin Barrientos 24 Aug '23

24 Aug '23

Hi everyone, This week’s OpenInfra Live episode is brought to you by open source community leaders. Episode: On this episode of OpenInfra Live, we will discuss the EU Cyber Resilience Act's impact on open source software. The OpenInfra Foundation and many other open source organizations have expressed concerns about the proposed text, urging the European lawmakers to take into account the specificity of open source open collaboration in the legislation. Join and engage live with our expert … [View More]

1 0

Fwd: vPTG October 2023 Team Signup Deadline Approaching!
by Kendall Nelson 18 Aug '23

18 Aug '23

Hello Everyone, Sign up your team up for the next virtual Project Teams Gathering (PTG), which will be held from Monday, October 23 to Friday, October 27 2023! If you haven't already done so and your team is interested in participating, you need to complete the survey[1] by August 20, 2023 at 7:00 UTC. Then make sure to register[2] - it’s free :) Thanks! -Kendall (diablo_rojo) [1] Team Survey: https://openinfrafoundation.formstack.com/forms/oct2023_ptg_team_signup [2] PTG Registration: http://ptg2023.openinfra.dev/

1 1

[zuul-jobs] Replacing the haskell ensure-cabal and ensure-stack with ghcup
by Tristan Cacqueray 12 Aug '23

12 Aug '23

Dear Zuulers, I propose to use ghcup to ensure the haskell toolchain with this change: https://review.opendev.org/c/zuul/zuul-jobs/+/847111 This should be transparent for job users, however playbooks using the ensure-cabal or ensure-stack roles directly needs to be modified to use the common ensure-ghc role. Please reply to this mail and/or the cited change if you have objections. With regards, -Tristan

1 0

Issue with websocket authentication for builds log streaming
by Andrei Dmitriev (Nokia) 11 Aug '23

11 Aug '23

Hi Zuul community, At Nokia we are using internal fork of Zuul v2 in production, but we want to update to newer version of Zuul to have all new features and flexibility it gives. So, we are testing it and closing feature parity with fork of Zuul v2 for that. We have a security requirement to allow to reading builds only for developers, working on projects at configured tenant. So, we tested read access authentication feature and found out that log streaming is not working for running builds … [View More]

1 0

Exploring the Intersection of AI and Open Source: Aug. 10 at 15 UTC
by Kristin Barrientos 10 Aug '23

10 Aug '23

Hi everyone, This week’s OpenInfra Live episode is brought to you by open source community leaders. Episode: If you stand at the intersection of AI and open source you’ll find a very active discussion around how each concept can apply to the other but you’ll find few definitive answers. This panel of open source community leaders will discuss the current state of AI & open source, the collaborative efforts underway to improve global understanding of this emerging use case and how open … [View More]

1 0

Fwd: Call for Mentors & Projects - Boston University Students
by Kendall Nelson 09 Aug '23

09 Aug '23

Hello Everyone! As some of you might know, we have had a working relationship with Boston University once a year where students actively participate in our OpenInfra project communities. The semester in which the Fundamentals of Cloud Computing (the course where we collaborate with them)( is approaching. September 5 is when the course begins and it runs until December 21. The course is a senior/graduate-level class that includes a semester-long capstone-like project, with the projects being … [View More]

1 0

Fwd: vPTG October 2023 Team Signup Kickoff
by Kendall Nelson 24 Jul '23

24 Jul '23

Hi Everyone, Hopefully, you have seen by now that the next OpenInfra vPTG[1] which will take place October 23-27, 2023 virtually and registration is open[2]! *To sign up your team, you must complete the survey[3] by August 20th at 7:00 UTC.* We NEED accurate contact information (email and IRC nickname ideally) for the moderator of your team’s sessions. This is because the survey information will be used to organize the schedule sign ups which will be done via the PTGBot. If you are not on … [View More]

1 0

Zuul Python version support
by James E. Blair 20 Jul '23

20 Jul '23

Hi, Currently Zuul supports python 3.8 through 3.11 (with those two versions specifically tested). We're about to upgrade Ansible which requires at least version 3.9. But there are some performance improvements in 3.10. And finally, we build our container images on 3.11. I suspect that many folks are running container images at this point, so this seems like a good opportunity to simplify our support and testing matrix and declare support for a single version of Python: 3.11 -- the … [View More]

3 2

[zuul-jobs] Dropping upstream Ubuntu Bionic testing and support
by Radosław Piliszek 20 Jul '23

20 Jul '23

Dear Zuulers, Ubuntu Bionic is out of standard (aka free) support since June 2023. This is effectively EOL for the general community. I propose to remove upstream testing [1] and support [2] for Bionic to avoid the expected upcoming breakage, already observed with minikube [3]. Please reply to this mail and/or the cited changes [1] [2] if you have objections and are willing to help with remaining possible Bionic support. [1] https://review.opendev.org/c/zuul/zuul-jobs/+/888947 [2] https://… [View More]

1 0

Fwd: vPTG October 2023 Dates & Registration Kickoff
by Kendall Nelson 11 Jul '23

11 Jul '23

Hello Everyone! The next PTG[1] will take place October 23-27, 2023 virtually! Registration is now open[2] and free for all to attend. Keep an eye out in the coming weeks because I will send along the team sign up to collect groups interested in participating. Thanks! -Kendall Nelson(diablo_rojo) [1] https://openinfra.dev/ptg/ [2] http://ptg2023.openinfra.dev/

1 0

To drop support for Helm v2 or not to drop?
by Radosław Piliszek 10 Jun '23

10 Jun '23

Hello Zuulers, I have identified a minor bug in the way that the current helm-template role handles Helm v3 naming of releases: https://storyboard.openstack.org/#!/story/2010783 I would like to propose a fix but I am wondering whether we should strive to keep Helm v2 compatibility at this point as it's very outdated and not supporting modern Kubernetes either. If we can drop Helm v2 support then it makes it really simple to fix and avoids version parsing. Kind regards, Radek -yoctozepto

1 1

Zuul's job requires-provides confusing behaviour
by Radosław Piliszek 07 Jun '23

07 Jun '23

Dear Zuulers, I am confused about the behaviour of requires-provides and wonder whether this is on purpose (and then why?) or by accident. I noticed that the job which *requires* something from another job that *provides* it does **not** wait for this other job if it's run **on the same change** (i.e., in the same buildset), only on earlier changes/buildsets. While this works as explained in the docs [1], I find it confusing. For example, I have a Dockerfile and Helm chart in the same repo … [View More]

2 5

RDO Ice Cream Social at OpenInfra Summit
by Amy Marrich 03 Jun '23

03 Jun '23

Join members of the community for ice cream after the Marketplace Mixer on Wednesday at Soft Peaks in Gastown! Soft Peaks is known for using organic milk and their unique topics! For those with dairy related dietary needs who register we will have an alternative for you so don't feel left out! https://eventyay.com/events/231a963f

1 1

Informal Summit Gathering for Zuul and OpenDev
by Clark Boylan 31 May '23

31 May '23

Hello everyone, I'd like to take advantage of the Summit to get together with those of us work on Zuul and OpenDev if possible. I think less formal is probably a good thing so that people can come and go as they are able. The beer garden in Berlin worked really well for this. Stanley Park Brewing [0] appears to be similar with outdoor patio seating in Stanley Park. This location is just under 3km from the convention center which makes it a long walk or a short ride in $vehicle. Looking at a … [View More]

1 0

apply-helm-charts + buildset registry
by Radosław Piliszek 26 May '23

26 May '23

Hello Zuulers, I am wondering if any of you has any experience with using `apply-helm-charts` job with a buildset registry. What I am looking for is testing the deployment of possibly-rebuilt images on Kubernetes with Helm chart(s), i.e., the apply-helm-charts would need to access the buildset registry and the chart(s) would need to point to the possibly-rebuilt versions of images from the buildset registry. So far, I have established that the `apply-helm-charts` job is *not* doing this … [View More]

1 0

New approach for project update presentations
by Clark Boylan 23 May '23

23 May '23

Hi, I'm reaching out to you about the video recordings that the OpenInfra Foundation has been collecting to capture project updates from each OpenInfra community. These videos were initially collected leading up to the OpenInfra Summits to showcase what each project has accomplished in the past year/release. This year we are implementing a change to the cadence of collecting this video content, to better fit with the communities' timeline, milestones and achievements. It will also help us … [View More]

1 0

Fwd: Extending the Forum
by Kendall Nelson 11 May '23

11 May '23

Hello Everyone, We received feedback that critical Forum conversations were not able to make the schedule due to the intentional work on our part to avoid PTG / Forum overlap which ended up restricting the number of Forum discussion proposals we were able to accept. To mitigate this, we have opened up the Forum room for a third day. We have created a form to collect critical Forum proposals. We will leave the form open for one week to give all timezones fair representation. The deadline to … [View More]

1 0

[Diversity] Diversity and Inclusion WG Meeting reminder
by Amy Marrich 09 May '23

09 May '23

This is a reminder that the Diversity and Inclusion WG will be meeting tomorrow at 14:00 UTC in the #openinfra-diversity channel on OFTC. We hope members of all OpenInfra projects join us as we review the Foundation-wide diversity survey questions for release at Summit. Thanks, Amy (spotz)

1 0

New container image location
by James E. Blair 28 Apr '23

28 Apr '23

Hi, The Zuul project has changed publishing locations for the container images it builds. The new location is "quay.io/zuul-ci". So if you were previously specifying, for example, the zuul-scheduler image as: zuul/zuul-scheduler:latest or docker.io/zuul/zuul-scheduler:latest You should instead use: quay.io/zuul-ci/zuul-scheduler:latest Do note that both the host and the organization part of the reference has changed. It is unfortunate that we were unable to use our preferred … [View More]

1 0

Fwd: Reminder! In Person PTG 2023 Team Signup Deadline
by Kendall Nelson 01 Apr '23

01 Apr '23

Hello Everyone, This is the last call to sign your team up for the *in-person* Project Teams Gathering (PTG) happening in Vancouver at the OpenInfra Summit! If you haven't already done so and your team is interested in participating, please complete the survey[1] by April 2nd, 2023 at 7:00 UTC. Registration for the PTG is included as a part of registration for the OpenInfra Summit in Vancouver. Prices increase May 5th so register soon! Thanks! -Kendall (diablo_rojo) [1] Team Survey: https:/… [View More]

1 0

[Diversity] Diversity and Inclusion at the PTG
by Amy Marrich 25 Mar '23

25 Mar '23

I have blocked off three hours on Monday for the D&I WG to discuss the upcoming Diversity Survey(14:00 UTC) and then ongoing changes to the Code of Conduct(15:00- 16:00 UTC) and then the Summit if there is time. The agenda can be found here[0]. All projects are encouraged to attend these sessions as the WG is at the Foundation level. Thanks, Amy (spotz) 0 - https://etherpad.opendev.org/p/march2023-ptg-diversity

1 0

Container image location
by James E. Blair 23 Mar '23

23 Mar '23

Hi, Recently Docker, Inc. announced a policy change that affects the images currently hosted at docker.io/zuul. Some Zuul and OpenDev maintainers have been working together on a plan for how to proceed, and I believe we have a good one. For a summary of the situation, please see this etherpad: https://etherpad.opendev.org/p/MJTzrNTDMFyEUxi1ReSo We also had a meeting in IRC where we discussed options: https://meetings.opendev.org/meetings/infra/2023/infra.2023-03-16-19.02.log… The … [View More]outcome of all of this is that I believe we should: 1) Move our images from Docker Hub to quay.io 2) Set up a static redirect server to redirect image pull requests to the new location Quay.io seems much more interested in hosting builds of open source projects than Docker Hub. By setting up a redirect server, we can have stable references for our images in case we move in the future (and it means that the organization name on quay.io becomes an implementation detail that isn't important to end users). To this end, I propose that we: 1) Set up registry.zuul-ci.org to redirect to our current images on Docker Hub. Image names would look like: registry.zuul-ci.org/zuul-scheduler:8.2.0 2) Once that is in place, announce that everyone using container images should update their references to those names immediately. 3) Switch our build jobs to publish images to quay.io. Work on the Ansible roles needed to accomplish this is currently in progress. 4) Switch registry.zuul-ci.org to redirect to quay.io instead of Docker Hub. 5) Around the first week of April, delete all of the images from Docker Hub. This is about a week before we will lose access to the "zuul" organization on Docker Hub. This will intentionally break any users who still have references to Docker Hub. Because we are going to lose access to the org, this is our only opportunity to exert any control over these images. If we don't delete them, then anyone not paying attention may forever have stale references to "zuul/zuul-scheduler:latest" and not realize it is not being updated anymore. If anything goes wrong with this process, we will still have an opportunity to roll back to Docker Hub, purchase continued access to the organization, and regroup while we figure out how to proceed. Due to the abbreviated timeline imposed, most of this work is already in progress and proceeding quickly based on both recent discussions and discussions we've had as a community in prior years. I think the general course is probably set at this point, but questions or feedback are welcome. Assuming no showstoppers come up, I expect steps #1 and #2 within the next few days. Thanks, Jim [View Less]

1 1

[Diversity] Diversity and Inclusion WG Meeting reminder
by Amy Marrich 14 Mar '23

14 Mar '23

This is a reminder that the Diversity and Inclusion WG will be meeting tomorrow at 14:00 UTC in the #openinfra-diversity channel on OFTC. We hope members of all OpenInfra projects join us as we look at the Code of Conduct, and continue working on planning for the OpenInfra Summit as well as Foundation-wide diversity surveys. Thanks, Amy (spotz) 0 - https://etherpad.opendev.org/p/diversity-wg-agenda

1 0

Zuul Leadership and Open Infra Foundation Board Meeting
by Clark Boylan 02 Mar '23

02 Mar '23

Hello everyone, I've managed to schedule another meeting between the Zuul Leadership and the Open Infra Foundation Board. We will meet March 1, 2023 at 17:00 UTC. I've put location details and some rough ideas for an agenda in https://etherpad.opendev.org/p/zuul-board-mtg-march-2023. Please feel free to update the rough agenda with topic ideas too. Everyone from our community is welcome to join, this isn't limited to the Zuul maintainers from our side. Hope to see you there. Apologies for … [View More]

2 4

Fwd: June 2023 PTG Team Signup Kickoff
by Kendall Nelson 02 Mar '23

02 Mar '23

Hello Everyone, As you may have seen, we are hosting an abbreviated PTG in conjunction with the Vancouver OpenInfra Summit[0]! To sign your team up, you must complete the survey[1] by April 2nd at 7:00 UTC. We NEED accurate contact information for the moderator of your team’s sessions. This is because the survey information will be used to organize the schedule signups which will be done via the PTGBot. If you are not on IRC, please get setup[2] on the OFTC network and join #openinfra-events.… [View More]

1 0

Docker-in-docker style workloads on Openshift/K8s
by zuul＠anonameow.com 24 Feb '23

24 Feb '23

Hi, We are looking into having docker-in-docker style workloads using the Openshift pods driver and noticed there is some support for that today using the privileged flag[1]. I assume are there some risks in exposing a privileged container towards the end-user, or is there some protection already in place? One alternative I see would be to have a docker-in-docker sidecar container (privileged) that the "primary" container (non-privileged) accesses via DOCKER_HOST=tcp://localhost:2375 for … [View More]

1 0

Fwd: PTG March 2023 Teams List
by Kendall Nelson 22 Feb '23

22 Feb '23

Hello Everyone! The March 2023 Project Teams List is official! *Projects + Teams* - OpenInfra Foundation Teams - Diversity and Inclusion WG - Edge Computing Group - Environmental Sustainability Working Group - Interop WG - StarlingX - OpenStack Teams - Service Teams - Barbican - Blazar - Cinder - CloudKitty - Designate - Glance - Horizon - Ironic - Keystone - Kolla … [View More]

1 0

The OpenInfra Summit Schedule is Live!
by Helena Spease 16 Feb '23

16 Feb '23

Hello everyone, I am really excited to let you know the Schedule [1] for the OpenInfra Summit 2023 is available! The schedule features keynotes and sessions from users like Bloomberg, LINE, Alibaba Cloud, Samsung and Volvo. The event will be held June 13-15, 2023, at the Vancouver Convention Centre overlooking Vancouver Harbor. Other notable speakers include Ant Group, the Australian Research Data Commons (ARDC), China Mobile, SAP, and Viettel, the largest public and private cloud … [View More]

1 1

Fwd: Virtual PTG March 2023 Team Signup Deadline - LAST CALL!
by Kendall Nelson 14 Feb '23

14 Feb '23

Hello Everyone, This is your last call to sign your team up for the next virtual Project Teams Gathering (PTG), which will be held from Monday, March 27th to Friday, March 31st 2023! NOTE: Since we have had the feedback that the Europe+Africa/Americas timeslot is overbooked, we will be extending it beyond the ‘normal’ size of 4 hour blocks to 5 hour blocks. If you haven't already done so and your team is interested in participating, please complete the survey[1] by February 19th, 2023 at 7:… [View More]

1 0

OpenInfra Summit Forum Selection Committee Call for Volunteers
by Kendall Nelson 03 Feb '23

03 Feb '23

Hello Everyone! The Forum at the OpenInfra Summit Vancouver is coming up! We would love 1 volunteer from Zuul for the Forum Selection Committee. Ideally, the volunteer would: - already be serving in some capacity in a governance role for your project - not be planning to submit to the Forum CFP or be willing to abstain from voting on your proposals For information on the OpenInfra Summit in Vancouver: https://openinfra.dev/summit/vancouver-2023/ For more information on the Forum, please … [View More]

1 0

Re: Environment variables passed to a tox job from encrypted secrets leak into the build log, how do I suppress this?
by Florian Haas 02 Feb '23

02 Feb '23

On 26/01/2023 19:26, Clark Boylan wrote: >> I have been unable to pinpoint exactly where and how that specific >> log is generated by the job. If somebody could point me to it, and >> let me know what overrides I need to add to the job to suppress >> this log altogether, or to remove the env variables from it, or >> better still configure it to replace the values of env variables >> matching a glob or regex with "<redacted>" or "*********" or some >&… [View More]gt; such, I'd be most grateful. > > Tox itself produces these log files and writes them to > .tox/$envname/log then the fetch-tox-output role [0] collects them > for you. Looking at this role there doesn't appear to be a flag to > disable it, just flags to modify its behavior. It also doesn't look > like there is a way to stop Tox from logging these files [1]. You > might just want to drop the fetch-tox-output role from your jobs and > not copy the files. Or maybe you can get away with a job task that > truncates the files before they are copied. Thanks for the pointer; that helped a lot. It turns out that {work_dir}/{env_name}/log did already exist in tox 3. However, the logs it contained did *not* dump all the environment variables, and so those never ended up in the Zuul web interface. As of tox 4, they do.[1] This might have security implications for anyone that runs tox from Zuul, hasn't locked down their Zuul web interface, uses sensitive information that is passed into a tox environment via environment variables, and just upgraded from tox 3 to tox 4. They might not be aware that their secrets are now accessible via the web interface, when with tox 3 they were not. Since the fetch-tox-output role looks explicitly in {work_dir}/{env_name}/log to find those logs, an applicable workaround to make those logs not show up in the Zuul build log (though, of course, they still get generated) would be to put envlogdir = {toxinidir}/dummylog into the testenv definition in tox.ini (for any testenvs that might pass sensitive information to tox via environment variables). Then, Zuul's fetch-tox-output role can't find anything in the directory it looks into, and it can only produce the job-output.txt log which — as far as I've been able to tell — does not contain a dump of environment variables. tox will generate envlogdir if it does not exist. It it NOT advisable to use some random existing directory; tox 4 will remove all files contained therein at the start of the run (tox 3 didn't do *that,* either). Again, thanks for the pointer! Cheers, Florian [1] More precisely, I see the new log format when testing with tox 4.4.2; I see the old one with 3.28.0. So the format would have changed at some point between those releases, though I haven't looked into exactly when. [View Less]

2 1

Environment variables passed to a tox job from encrypted secrets leak into the build log, how do I suppress this?
by Florian Haas 27 Jan '23

27 Jan '23

Hi everyone, first post to list, though I know a few folks who are subscribed personally — to those of you, no long time no see! Here's my issue: I want to keep Zuul from leaking secrets into the build logs, and in this specific instance I don't know where to look for the fix. In more detail: I am running a tox job from Zuul that uploads some generated files to a Ceph radosgw service via its S3 API. This is my "upload" testenv as defined in my tox.ini: [testenv:upload] deps = awscli … [View More]passenv = AWS_* setenv = file|build.env commands = aws --endpoint-url={env:S3_ENDPOINT} \ s3 sync \ {toxinidir}/build/ \ s3://{env:S3_BUCKET}/ I set S3_ENDPOINT and S3_BUCKET in my build.env file, and I want to pass AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY from the environment through to the aws s3 sync command, hence the passenv entry. Since I would prefer to not have to maintain a separate job definition in a config project for this, I have the following secret and job definition in my repo's .zuul.yaml: - secret: name: tox_environment_secret data: AWS_ACCESS_KEY_ID: !encrypted/pkcs1-oaep - # encrypted secret redacted AWS_SECRET_ACCESS_KEY: !encrypted/pkcs1-oaep - # encrypted secret redacted - job: name: tox-upload parent: tox secrets: - name: tox_environment secret: tox_environment_secret pass-to-parent: true vars: tox_envlist: "upload" As described in https://zuul-ci.org/docs/zuul/latest/config/job.html#attr-job.secrets, this results in the environment variables AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY being passed into the tox run managed by the tox-upload job (or rather by its parent, the upstream tox job), as environment variables, with their values set to the decrypted secrets. Now, when I check the build log at log/job-output.txt (relative to my build URL), I see no trace of the secrets. So far, so good. But there is another job log at log/tox/upload/1-commands[0].log, which contains *all* the environment variables passed into the tox job, including the decrypted values for AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY: name: upload run_id: commands[0] env LANG: C.UTF-8 env AWS_ACCESS_KEY_ID: <redacted> env AWS_SECRET_ACCESS_KEY: <redacted> [etc.] I'd obviously prefer for those to not leak into the build logs. I have been unable to pinpoint exactly where and how that specific log is generated by the job. If somebody could point me to it, and let me know what overrides I need to add to the job to suppress this log altogether, or to remove the env variables from it, or better still configure it to replace the values of env variables matching a glob or regex with "<redacted>" or "*********" or some such, I'd be most grateful. Thanks! Cheers, Florian [View Less]

2 1

Feedback on Changes to Supported Python Version in Zuul
by Clark Boylan 25 Jan '23

25 Jan '23

Hello everyone, Eventually (hopefully soon), Zuul will add Ansible 7 (Ansible Core 2.14 support). According to the Ansible docs [0] this new version of Ansible drops support for Python 3.8. Currently Zuul is tested on Python 3.8 and 3.11 with the intent of supporting Zuul across Python 3.8, 3.9, 3.10, and 3.11. Unfortunately, Ansible's dropping of Python 3.8 support means that Zuul will also need to drop support for Python 3.8 when Ansible 7 support is added to Zuul. On top of that, Zuul test … [View More]

5 10

The OpenInfra Summit 2023 CFP is closing soon!
by Helena Spease 11 Jan '23

11 Jan '23

Hi Everyone! The CFP for the 2023 OpenInfra Summit (June 13-15, 2023) is closing in just a few days[1]! Check out the full list of tracks and submit a talk on your topic of expertise [2]. The CFP closes January 10, 2023, at 11:59 p.m. PT. See what that is in your timezone [3] We are also now accepting submissions for Forum sessions [4]! Looking for other resources? Find information on registration, sponsorships, travel support and visa requests at https://openinfra.dev/summit/ <https://… [View More]

1 1

Future of the ensure-kubernetes role
by Ian Wienand 10 Jan '23

10 Jan '23

Hello, The ensure-kubernetes role in zuul-jobs sets up a k8s environment on the test node so we can do some API testing against, and run, small containers. I think it's fair to say this isn't aimed at being a production installation, but rather the minimal parts of k8s that basic functional testing can validate against. Currently the ensure-kubernetes role deploys k8s via minikube bionic/focal/jammy with a choice of two backends; cri-o and docker. I worry about this whole toolchain. It … [View More]took some effort to get it working on Jammy, and it's not very elegant. Some of the problems - kubectl installs from a repo called "https://apt.kubernetes.io/ kubernetes-xenial main" [1]. It seems to get updates; and maybe it refers to the lowest version. I don't know, but it's not reassuring. - minikube isn't packaged and we download a blob directly. This is probably neither here-nor-there; but it is less appealing than using something from a distro. - everything is written to use the minikube "none" driver, which avoids having to worry about nesting VM's. - minikube with the "none" driver only supports a CRI compatible backend and has a lot of caveats [2] - cri-o is CRI compatible, but is not upstream packaged for Ubuntu. We rely on packaging of the tools from the SUSE kubic program, which has now been retired and is in a sort of best-effort community maintenance [3]. What prompted me looking at this was an expired GPG key in this project which broke testing. This was fixed, of course bugs happen to everyone. But we are 100% dependent on this repo (I could not get the docker back-end to work without some of the runtime tools from it, so it is not completely independent). - docker is packaged externally, but widely used (by OpenDev in production even). But to use it with minikube, we need to run a CRI api -> dockerd shim that we download as a binary blob [4] - With all these disparate parts, we get conflicts. For example, bits of podman are packaged on Jammy, so now "containernetworking-plugins" comes from the distro. Which of course installs things in a different location to the kubic versions. Which means we have to monkey-patch over the top of patching that minikube does [5]. - I don't think we actually got any of this working for Focal; we just had jobs on bionic and skipped straight to jammy [6]. So we're not keeping up. I think that's probably evidence enough that setting up a test k8s environment with minikube + <cri-o|docker> on Ubuntu is not very compelling. I've personally spent much more time debugging all this than anything to do with actual k8s support in tools. minikube seems to have a docker driver now [7], which I'm sure did not exist when any of this was written and might suit us as it says it does not need nested virt. However, I would propose that we are not making good use of our limited resources by continuing along this path. Ubuntu's preferred method for deploying k8s is via microk8s which they package as snap images [8]. I am not a huge fan of snap images for distribution, but I am a fan of not trying to maintain a bunch of parts that don't really want to work together. I have written changes in https://review.opendev.org/q/topic:ensure-kubernetes-microk8s to setup microk8s in ensure-kubernetes, and to make it so when using use-buildset-repository with microk8s, k8s will pull through the buildset repository. I have converted the nodepool job to use this. What I would propose is that we deprecate the other paths in ensure-kubernetes and focus our efforts on microk8s on jammy (and future distros going forward). This role is not heavily used, I don't see our time well spent supporting multiple installation methods across multiple releases (and it's never been cross-distro -- which I also think is fine). I see this having a greater role in the future as part of the work such as the nodepool->zuul conversion, where it may get a lot more exposure. Thoughts are welcome :) -i [1] https://kubernetes.io/docs/setup/production-environment/tools/kubeadm/insta… [2] https://minikube.sigs.k8s.io/docs/drivers/none/ [3] https://kubic.opensuse.org/blog/2022-06-10-kubic-retired/ [4] https://opendev.org/zuul/zuul-jobs/src/branch/master/roles/ensure-kubernete… [5] https://opendev.org/zuul/zuul-jobs/src/branch/master/roles/ensure-kubernete… [6] https://review.opendev.org/c/zuul/zuul-operator/+/863948/3/.zuul.yaml [7] https://minikube.sigs.k8s.io/docs/drivers/docker/ [8] https://ubuntu.com/tutorials/install-a-local-kubernetes-with-microk8s#1-ove… [View Less]

2 1

Project lead election
by James E. Blair 10 Jan '23

10 Jan '23

Hi, The position of Zuul Project Lead is an elected position described in our governance document[1]. I currently hold the position, and would be happy to continue in that position for another year. If elected, I plan to continue my current hands-off approach. I believe that all of the Zuul Maintainers are empowered to collectively decide on and execute our vision for the project. My purpose is to help articulate that vision when necessary, drive the process of attaining consensus, and be … [View More]

1 0

[Diversity] Diversity and Inclusion WG Meeting reminder
by Amy Marrich 09 Jan '23

09 Jan '23

This is a reminder that the Diversity and Inclusion WG will be meeting tomorrow at 14:00 UTC in the #openinfra-diversity channel on OFTC. We hope members of all OpenInfra projects join us as we continue working on planning for the OpenInfra Summit as well as Foundation-wide surveys. Thanks, Amy (spotz) 0 - https://etherpad.opendev.org/p/diversity-wg-agenda

1 0

Fwd: 2023 PTGs + Virtual Team Signup
by Kendall Nelson 04 Jan '23

04 Jan '23

Hello Everyone! The next PTG on the calendar will be our usual virtual format and it will take place March 27 -31. The project signup survey is already ready to go! If your team is interested in participating, sign them up here[1]! Registration is also open now[2] We have also heard many requests from the contributor community to bring back in person events and also heard that with global travel reduction, it would be better travel wise for the community at large to combine it with the … [View More]

1 1

2022 Zuul Foundation Annual Report
by Clark Boylan 20 Dec '22

20 Dec '22

Hello, At the end of every year the Foundation puts together an Annual Report. Included in this report is a section for each of the Foundation's top level projects. I have been asked to ensure the Zuul portion of the report gets written. I have started with a draft here: https://etherpad.opendev.org/p/2022-zuul-annual-report and would love your input/feedback/content if you have time to help. I want to make sure that this document reflects the Zuul project as a whole and not just my personal … [View More]

1 0

Mailing list update and Zuul user survey
by James E. Blair 07 Dec '22

07 Dec '22

Hi! The OpenDev team has upgraded the software running on lists.zuul-ci.org. I'm sending this email partly to let folks know about that if they aren't aware. There's a new interface for managing options and interacting with the list, and if you create an account, that account will work for all of the OpenDev lists (once the rest are moved over). You can read more about it here: https://lists.opendev.org/archives/list/service-announce@lists.opendev.org/… Here's a link to the site: … [View More]

1 0

Video about Zuul/Gerrit simultaneous dependencies
by James E. Blair 29 Nov '22

29 Nov '22

Hi, I just wanted to share a short video I made showing some of the new features in Zuul that work with Gerrit's submitWholeTopic setting to support testing and merging simultaneous dependencies. Take a look if you haven't seen the new features. https://www.youtube.com/watch?v=B64RbNwkIa4 -Jim

1 0

Zuul German becomes unresponsive
by Mithun Mistry 03 Nov '22

03 Nov '22

Hi Team, We at Western digital IT team , is using Zuul version R4.1.0 . We have come across an issue whereby the gearman becomes unresponsive without any issues with scheduler service . We are using default gearman that comes bundles with zuul scheduler. We have scheduler and executer/merger services running on separate vms. We have come across the issue twice in 3 month’s time. Restarting zuul-scheduler service fixes the issue and zuul works as usual. Please let us know if it is a known … [View More]

3 6

Fwd: Help us plan the next PTG!
by Kendall Nelson 26 Oct '22

26 Oct '22

Hello Everyone! Congratulations on a great virtual PTG last week :) The OpenInfra Foundation is hosting the OpenInfra Summit in Vancouver [1], June 13 -15, 2023. We are trying to determine the level of interest among contributors to OpenInfra projects on attending a co-located PTG in Vancouver. *The exact format and dates are still being determined.* At this time, we are evaluating the level of interest from an attendee and employer perspective. Please complete the following poll so we can … [View More]

1 0

Intermittent bug(?) with dependencies-by-topic Queue
by A richist 25 Oct '22

25 Oct '22

Hello Zuul folk, We have 2 projects using the same Queue defined as: - queue: name: Topic allow-circular-dependencies: true dependencies-by-topic: true per-branch: true With this job and project setup: - job: name: project1-build runs: ... - job: name: project2-build runs: ... dependencies: project1-build - project: name: project1 queue: Topic gate: jobs: - project1-build - project: name: project2 queue: Topic gate: … [View More]

2 2

Track Chair Nominations Close in One Week!
by Helena Spease 22 Oct '22

22 Oct '22

Hey everyone! Track Chair nominations <https://openinfrafoundation.formstack.com/forms/trackchairnominations2023 <https://openinfrafoundation.formstack.com/forms/trackchairnominations2023>> for the 2023 OpenInfra Summit in Vancouver (June 13-15, 2023) are closing soon! Please submit your nominations before they close on October 28, 2022 Track Chairs for each Track will help build the Summit schedule, and are made up of individuals working in open infrastructure. … [View More]

1 0

[Diversity][PTG] Diversity and Inclusion WG session at PTG and meeting changes
by Amy Marrich 15 Oct '22

15 Oct '22

The Diversity and Inclusion WG will be holding its session on Monday at 14:00UTC in the Folsom room. On the agenda[0] are holding a Diversity Survey for the Foundation in 2023 which includes all projects and Community Leadership Mentorship. We have also moved our regular monthly meetings to the Second Tuesday of the month at 14:00UTC and we have also moved back from video to IRC with the meetings taking place in #openinfra-diversity on OFTC. Amy (spotz) 0 - https://etherpad.opendev.org/p/oct2022-ptg-diversity

1 0

Updating the Zuul User Survey
by Clark Boylan 11 Oct '22

11 Oct '22

Hello everyone, We've been asked if we have any feedback for updating the Zuul User Survey. The current survey can be found at https://www.surveymonkey.com/r/K2B2MWL and is linked to from https://zuul-ci.org/users.html. I think the rough high level plan is to move this survey to another platform, and when we do that add an alias redirect under https://zuul-ci.org to make platforms more portable in the future without needing to change URLs. This is a great opportunity to edit the content of the … [View More]

1 0