- Zuul-discuss - lists.opendev.org

Spec for removing Ansible restrictions
by James E. Blair 22 Mar '22

22 Mar '22

Hi, There is a spec for removing the restrictions on Ansible which has received some positive feedback. I would like to merge it before March 30 if there are no significant objections. The spec is here: https://review.opendev.org/834198 Thanks, Jim

1 0

Fwd: Forum Submissions Open for Berlin Summit 2022!
by Kendall Nelson 21 Mar '22

21 Mar '22

Hello Everyone! We are now accepting Forum [1] submissions for the 2022 Open Infrastructure Summit Forum [2]. Please submit your ideas through the Summit CFP tool [3] through April 8th. Don't forget to put your brainstorming etherpad up on the Berlin Forum page [4]. This is not a classic conference track with speakers and presentations. OpenInfra community members (participants in development teams, operators, working groups, SIGs, and other interested individuals) discuss the topics they want to cover and get alignment on and we welcome your participation. The Forum is your opportunity to help shape the development of future project releases. More information about the Forum [1]. The timeline for submissions is as follows: March 21st | Formal topic submission tool opens: https://cfp.openstack.org. April 8th | Deadline for proposing Forum topics. Scheduling committee meeting to make draft agenda. April 15th | Draft Forum schedule published. Crowd sourced session conflict detection. Forum promotion begins. April 22nd | Forum schedule final June 20th | Forum begins! If you have questions or concerns, please reach out to speakersupport(a)openinfra.dev. Cheers, - Kendall Nelson (diablo_rojo) [1] https://wiki.openstack.org/wiki/Forum [2] https://openinfra.dev/summit [3] https://cfp.openstack.org [4] https://wiki.openstack.org/wiki/Forum/Berlin2022

1 1

Early Bird Sales for the OpenInfra Summit Berlin End TODAY!
by helena＠openstack.org 17 Mar '22

17 Mar '22

Hi everyone, We are so excited to be getting the OpenInfra community back together in-person again for the OpenInfra Summit in Berlin, June 7-9! In case you missed it, the Schedule for the Summit went live last week and featured an exciting lineup of speakers from the Zuul community <[ https://openinfra.dev/summit-schedule#tags=4624&view=calendar ]( https://openinfra.dev/summit-schedule#tags=4624&view=calendar )>! Now what? Today is the last day to get early bird pricing, so make sure you buy your ticket ASAP. Register before prices increase on March 17 at 11:59 PM PT (March 18 at 6:59 UTC) <[ https://www.eventbrite.com/e/211374997307 ]( https://www.eventbrite.com/e/211374997307 )> Thank you to our Summit Headline, Premier and Spotlight sponsors: Canonical, Mirantis, VEXXHOST, Red Hat, and OVHcloud. Event sponsors gain visibility with a wide array of open source infrastructure developers, operators and decision makers. Learn more about how your organization can be a Summit sponsor too <[ https://openinfra.dev/summit-sponsor ]( https://openinfra.dev/summit-sponsor )> See you in June! Thanks, Helena __________________________________ Marketing & Community Associate The OpenInfra Foundation Helena(a)openinfra.dev

1 0

Fwd: [PTG] April 2022 Teams List
by Kendall Nelson 15 Mar '22

15 Mar '22

Hello Everyone! The April 2022 Project Teams List is official! Ansible OpenStack modules Barbican Blazar Cinder CloudKitty Cyborg Designate Diversity & Inclusion WG First Contact SIG Glance Horizon Interop Ironic Keystone Kolla Kuryr Large Scale SIG Manila Neutron Nova/Placement Octavia OpenInfra Edge Computing Group OpenStack Charms OpenStack Technical Committee OpenStack-Ansible OpenStack-Helm QA Release Management SDK Security SIG StarlingX Swift Tacker TripleO If your team was planning to meet and isn’t in this list, please contact ptg(a)openinfra.dev IMMEDIATELY. Otherwise, please don't forget to register[1] because that's how you'll receive event details, passwords, and other relevant information about the PTG. Please let us know if you have any questions! Thanks! -Kendall (diablo_rojo) [1] PTG Registration: https://openinfra-ptg.eventbrite.com

1 0

Fwd: Forum Brainstorming
by Kendall Nelson 15 Mar '22

15 Mar '22

Hello Everyone! The Virtual Forum is approaching. We would love 1 volunteer from the community for the Forum Selection Committee. Ideally, the volunteer would already be serving in some capacity in a governance role for your project. In addition to calling for volunteers for the Forum selection committee, this email kicks off the brainstorming period before the CFP tool opens for formal Forum submissions. The categories for brainstorming etherpads have already been setup here[1]. Please add your etherpads and ideas there! The CFP tool will open on August 31st and will close September 14th. For information on the upcoming virtual Summit[2]. For more information on the Forum[3]. Please reach out to jimmy(a)openstack.org or knelson(a)openstack.org if you're interested. Volunteers should respond on or before August 31, 2020. Thanks! Kendall (diablo_rojo) [1] Virtual Forum 2020 Wiki: https://wiki.openstack.org/wiki/Forum/Virtual2020 [2] Virtual Open Infra Summit Site: https://www.openstack.org/summit/2020 [3] General Forum Wiki: https://wiki.openstack.org/wiki/Forum

1 1

Welcome new Zuul Maintainers!
by James E. Blair 09 Mar '22

09 Mar '22

I would like to welcome Felix Edel and Simon Westphahl as Zuul maintainers. The Zuul Maintainers approved their addition in https://review.opendev.org/832384 and https://review.opendev.org/832388 respectively. The current list of maintainers (along with a description of the role and other general project governance information) is at https://zuul-ci.org/docs/zuul/latest/governance.html -Jim

1 0

Fwd: Reminder! PTG April 2022 Team Signup Deadline
by Kendall Nelson 07 Mar '22

07 Mar '22

Hello Everyone, Don't forget to sign your team up for the next Project Teams Gathering (PTG), which will be held virtually from Monday, April 4 to Friday, April 8, 2022! If you haven't already done so and your team is interested in participating, please complete BOTH the survey[1] AND reserve time in the ethercalc[2] by end of day March 11. Then make sure to register[3] for the PTG because that's how you'll receive event details, passwords, and other relevant information about the PTG. Thanks! -Kendall (diablo_rojo) [1] Team Survey: https://openinfrafoundation.formstack.com/forms/april2022_vptg_survey [2] Ethercalc Signup: https://ethercalc.openstack.org/7yxdas7suqnd [3] PTG Registration: https://openinfra-ptg.eventbrite.com

1 0

[Diversity] Diversity and Inclusion Meeting -change - short notice
by Amy Marrich 23 Feb '22

23 Feb '22

Due to a conflict from another member and my decision to take PTO to play with the dogs, we are moving the March meeting to this Friday, February 25th at 16:00 UTC. The meeting will be held on video at https://meetpad.opendev.org/osf- diversity-and-inclusion as recently voted on and the agenda can be found at https://etherpad.openstack.org/p/diversity-wg-agenda. Please join us! Thanks, Amy (spotz)

1 0

Reminder: cdCon CFP closes in one day
by Jeremy Stanley 17 Feb '22

17 Feb '22

If anyone's interested in presenting Zuul concepts at cdCon, it seems like it could be a great audience for what we're doing (I can't personally since it's the same dates as the OpenInfra Summit). If someone is interested in going to Austin, Texas in the USA on June 7-8, be aware that the call for proposals ends at 11:59 PM PST 2022-02-18 (that's 07:59 UTC 2022-02-19). See details here: https://events.linuxfoundation.org/cdcon/program/cfp/ -- Jeremy Stanley

1 0

project configuration from config project is not reloaded on push to gerrit
by Vasyl Vavrychuk 11 Feb '22

11 Feb '22

Hello, I am trying to learn Zuul by configuring it step by step from scratch. I have noticed that configuration from my config project is not reloaded when I push change to gerrit, even so I see in Scheduler logs 2022-02-05 02:21:30,127 DEBUG zuul.zk.event_queues.ConnectionEventQueue: Submitting connection event to queue /zuul/events/connection/gerrit/events/queue: {'timestamp': 1644020490.1274238, 'payload': {'submitter': {'name': 'Administrator', 'email': 'admin(a)example.com', 'username': 'admin'}, 'refUpdate': {'oldRev': '6c0377e50f7327ee7d272c79ccbdf9d12cadf048', 'newRev': 'ca3ecef3a501db2143e32fa628158fbdfaf9377a', 'refName': 'refs/heads/master', 'project': 'zuul-config'}, 'type': 'ref-updated', 'eventCreatedOn': 1644020490}} Moreover, configuration from config project is not reloaded even after Zuul Scheduler restart. It is only reloaded after 1. Stop Scheduler. 2. Stop ZooKeeper. 3. Remove ZooKeeper data directory (/tmp/zookeeper in my case). 4. Start ZooKeeper. 5. Start Scheduler. I check if my config project is reloaded by introducing some error, committing it and pushing directly to master. I see that during restart Scheduler keeps saying 2022-02-05 13:12:05,769 DEBUG zuul.TenantParser: Using files from cache for project localhost/zuul-config @master: ['zuul.d/jobs.yaml', 'zuul.d/pipelines.yaml', 'zuul.d/projects.yaml'] so my changes are being ignored. Kind regards, Vasyl

3 2

PTG April 2022 Team Signup
by Kendall Nelson 03 Feb '22

03 Feb '22

Hello! Last week, we announced the next virtual PTG will be held virtually from Monday, April 4th to Friday, April 8th, 2022. We will have the same schedule set up available as last time with three windows of time spread across the day to cover all timezones with breaks in between. To signup your team, you must complete BOTH the survey[1] AND reserve time in the ethercalc[2] by end of day March 11th. We ask that the PTL/SIG Chair/Team lead sign up for time to have their discussions with 3 rules/guidelines: 1. Cross project discussions (like SIGs or support project teams) should be scheduled towards the start of the week so that any discussions that might shape those of other teams happen first. 2. No team should sign up for more than 4 hours per UTC day to help keep participants actively engaged. 3. No team should sign up for more than 16 hours across all time slots to avoid burning out our contributors and to enable participation in multiple teams discussions. Again, you need to fill out BOTH the ethercalc AND the survey to complete your team's sign up. If you have any issues with signing up your team, due to conflict or otherwise, please let me know! While we are trying to empower you to make your own decisions as to when you meet and for how long (after all, you know your needs and teams timezones better than we do), we are here to help! Once your team is signed up, please register[3]! And remind your team to register! Registration is free, but it's important that you sign up to let us know you'll be attending because that's how you'll receive event details, passwords, and other relevant information about the PTG. Continue to visit openinfra.dev/ptg for updates. -Kendall (diablo_rojo) [1] Team Survey: https://openinfrafoundation.formstack.com/forms/april2022_vptg_survey [2] Ethercalc Signup: https://ethercalc.openstack.org/7yxdas7suqnd [3] PTG Registration: https://openinfra-ptg.eventbrite.com/

1 0

[Diversity] Diversity and Inclusion Meeting Reminder - New Day, Time and Location
by Amy Marrich 01 Feb '22

01 Feb '22

The Diversity & Inclusion WG invites members of all OIF projects to attend our next meeting Friday February 4th, at 15:00 UTC on https://meetpad.opendev.org/osf-diversity-and-inclusion. The agenda can be found at https://etherpad.openstack.org/p/diversity-wg-agenda. Please feel free to add any topics you wish to discuss at the meeting. Thanks, Amy (apotz)

1 0

Cross-project dependencies + build artifacts?
by A richist 01 Feb '22

01 Feb '22

Hello Zuul folk, I'm trying to integrate Zuul pipelines for a set of products set up in a way where each project's build job creates a build artifact, and dependent projects consume that artifact during their own build job. I can't seem to get Zuul to do what I want it to do, and was wondering if I made some wrong assumptions. In the use-case I'm simulating, I have 2 projects: - project1 which builds into a library exposing an API. - project2 which consumes/links with that library at build time and uses said API. The setup I have for these projects boils down to: - job: name: project1-build runs:... provides: lib - job: name: project2-build runs:... requires: lib - project: name: project1 queue: product gate: jobs: - project1-build - project: name: project2 queue: product gate: jobs: - project2-build There are some other jobs defined in project2's gate, which consume project2-build's artifact to further test it before merging, but this works as I expect using "job.dependencies" so I'm excluding them above. In my use-case, a developer makes code changes to the API in project1, the referencing API usage in project2, and wants Zuul to test these code changes together, so they add to their commit message in project2: Depends-On: <URL for the Gerrit change for project1> Once the changes are approved they are enqueued in gate as expected, with project2-build job waiting for the completion of project1-build. Following project1-build's successful completion, this is what I naively expected would happen: - Zuul would wait for project2-build's successful completion before merging the change for project1. - project1-build's artifacts would be made available during project2-build's runtime via {{ zuul.artifacts }}. - In case project2-build fails, Zuul would prevent both changes from merging. What actually happens: - The code change for project1 is immediately merged, with potentially "bad" code that was not tested along with the developer's other change. - In the Zuul web UI the connection between the two changes seems to be severed / no longer there. - During project2-build, {{ zuul.artifacts }} is not set. I've tried setting as project1-build's last task: - zuul_return: data: zuul: pause: true But it didn't seem to have any effect. So I guess my question is how can I prevent Zuul from merging a change until depending changes complete testing along with its build artifacts, and how can artifacts be accessed for cross-project dependencies? Regards, Arichist

2 1

About removing periodic zuul-jobs testing
by Tristan Cacqueray 01 Feb '22

01 Feb '22

Hello Zuul folks, Here is a change to remove the periodic zuul-jobs testing to save resources: https://review.opendev.org/c/zuul/zuul-jobs/+/827369 Are these jobs being used? Regards, -Tristan

1 0

2021 OpenInfra Foundation Annual Report Now Available
by Jeremy Stanley 26 Jan '22

26 Jan '22

The 2021 Annual Report from the Open Infrastructure Foundation is now available here: https://openinfra.dev/annual-report/2021 It includes a year in review for all OpenInfra projects, including a section on Zuul, but also updates on the foundation itself, growth in the open infrastructure ecosystem, and event news. Enjoy! -- Jeremy Stanley

1 0

Missing READY static nodes in zuul web from 4.9.0
by Vitaliy Lotorev 25 Jan '22

25 Jan '22

After upgrading Zuul 4.7.0 -> 4.9.0 all idle static nodes have gone from zuul web Nodes tab, i.e. READY, BUILDING are not shown on web anymore. This causes inconvenience in analyzing the state of static nodes (what are available). Is this change/behaviour intentional and won't be fixed or this is a regression that might be fixed in future? It seems this change modified web filtering https://review.opendev.org/c/zuul/zuul/+/807406. Regards, Vitaliy

1 0

April 2022 Virtual PTG Dates & Registration
by Kendall Nelson 24 Jan '22

24 Jan '22

Hello Everyone! We're happy to announce the next virtual PTG[1] will take place April 4-8, 2022! Registration is now open[2]. The virtual PTG is free to attend, but make sure to register so you receive important communications like schedules, passwords, and other relevant updates. Next week, keep an eye out for info regarding team sign-ups. Can't wait to see you all there! -Kendall (diablo_rojo) [1] https://www.openstack.org/ptg/ [2] https://openinfra-ptg.eventbrite.com/

1 0

About zuul's performance
by Xie, Zhiqi (NSB - CN/Hangzhou) 24 Jan '22

24 Jan '22

Hi, Our teams are using zuul based on openstack zuul 2.x. We have hundreds of users and we had performance impact during rush hour. There are many connections synced in zuul's main loop, including gerrit query/review/git-upload-pack and gearman task sending. In rush hour our gerrit will be slow to response (at most it will take 2 secs to response the query and 1 min to response git-upload-pack), and we have hundreds of jobs per gerrit change and thus we have too many job-launch task and job-set-description task. These connection make the zuul rather slow in the rush hours. In the worst situation, zuul will go through a loop in 30 mins. We have to make modification to solve this locally, to make all the connections asynced. Now the performance impact is eased. And recently we are planning to go up to zuul version 4.x or 5.x, so we have some quick peek of current zuul v4. We find that gearman connection is gone but zookeeper connections comes instead. And zookeeper connection are still synced. And gerrit support http rest api, but the query is still synced. Therefore we are worried about performance in our environment. We want to keep pace with community so we would like some answers: 1. How will zuul v4/5 solve the slowness when gerrit is not that fast. We will encounter gerrit connection lasting for seconds in rush hour and don't want zuul's main thread go slow. 2. If zookeeper's connection is not fast, the zuul's main thread will cost too much time in getting response from zookeeper. How to prevent this to happen? Will adding more nodes of zookeeper in a cluster help? 3. Does zuul have plan to make the network I/O asynced to improve performance? Best regards

3 2

[Diversity] Diversity and Inclusion WG new meeting time
by Amy Marrich 20 Jan '22

20 Jan '22

Thank you to those who responded to the Doodle for our meeting time. The day and time selected was Friday at 15:00 UTC so we will move to that in February with our first meeting being on 2/4. As usual, should we need to cancel the first Friday of the month we have the backup date of the third week. Should we end up having to do that too frequently ,as Fridays are popular for holidays and vacations, we'll readdress the meeting time again. Also chosen was to switch to a video platform and we will work on choosing one before the meeting reminder goes out Thanks, Amy (spotz)

1 0

Project lead election
by James E. Blair 10 Jan '22

10 Jan '22

Hi, The position of Zuul Project Lead is an elected position described in our governance document[1]. I currently hold the position, and would be happy to continue in that position for another year. If elected, I plan to continue my current hands-off approach. I believe that all of the Zuul Maintainers are empowered to collectively decide on and execute our vision for the project. My purpose is to help articulate that vision when necessary, drive the process of attaining consensus, and be a point of contact and representative for the project in circumstances where a single person is needed (but in those cases, I promise to share as much of that work as possible with the rest of the team). I have uploaded a change[2] to update the expiration date of my term. If any other Zuul Maintainers would like to nominate themselves for the position, please upload a similar change and send a reply to this message to this list. The nomination period will close on January 14, 2022. If there are other candidates, we will hold a Condorcet election at that time. -Jim [1] https://zuul-ci.org/docs/zuul/governance.html#zuul-project-lead [2] https://review.opendev.org/824043

1 0

[Diversity] D&I WG Meeting Cancellation and Poll Reminder
by Amy Marrich 02 Jan '22

02 Jan '22

Just a reminder that tomorrow's meeting is canceled and to participate in the Meeting Time and IRC vs Video Poll! https://doodle.com/poll/mnzxkauzwf2isssm?utm_source=poll&utm_medium=link Thanks, Amy (spotz)

1 0

Re: Zuul 4.11.0 released
by James E. Blair 16 Dec '21

16 Dec '21

On 12/16/21 1:12 PM, James E. Blair wrote: > The Zuul team is pleased to announce the release of Zuul 4.11.0. > > Download it from PyPI: https://pypi.org/project/zuul > > Find container images at: https://hub.docker.com/u/zuul > > The release notes, included below, are also available in the > documentation with hyperlink references: > > https://zuul-ci.org/docs/zuul/4.11.0/reference/releasenotes.html > > New Features > ============ > > * The new variable zuul.playbook_context as well as new variables under > zuul.projects have been added to help debug or audit the playbooks and > roles used by Ansible when running jobs. > > * These variables describe the repo configuration used for the playbooks > and roles of each Ansible execution. These repos may have a different > state than the workspace repos. > > * It is now possible to disable connection pooling in the Gitlab driver > with <gitlab connection>.disable_connection_pool. This option may be > useful under adverse network conditions. > > * The optional prometheus service now also includes endpoints for > readiness and liveness checks. See Liveness Probes for details. > > * Allow an authorized user to dequeue changes from the Web UI's status > page. > > * Add authentication in the web UI. Zuul's web UI can be configured to > authenticate users against an Identity Provider supporting the OpenID > Connect protocol. > > Upgrade Notes > ============= > > * Users upgrading from previous versions of zuul will need to run zuul > delete-state to delete Zuul's ephemeral state from Zookeeper. The > ephemeral state produced by older versions of zuul is not compatible > with this release. This command should be run while all Zuul services > are stopped to prevent writes to the Zookeeper database. More > information on this command can be found in the documentation: > https://zuul-ci.org/docs/zuul/reference/client.html#delete-state > > * The prometheus endpoint would previously serve metrics at any URI. It > now only returns metrics on the / and /metrics URI. The latter is > recommended. > I encourage folks to consider this a release candidate for Zuul v5. At this point the multi-scheduler functionality is complete but has seen limited production use. Please try it out and look for problems. If you do find problems, run "zuul delete-state" and roll back to 4.10.4. Additionally, between now and the v5 release, we will be removing the long-deprecated gearman RPC system, which means that if you use "zuul enqueue" and similar commands, you should switch to using zuul-client with a self-generated authentication token. This and all recent version 4.x releases support both, which makes this an excellent time to switch. -Jim

2 1

[Diversity] D&I WG Meeting Time and IRC vs Video Poll
by Amy Marrich 14 Dec '21

14 Dec '21

Hi everyone, The Diversity and Inclusion WG is holding a poll to see if there would be interest in attending if it were on another day and time as well as if IRC vs Video would be preferred. We currently meet the first Monday of the month at 17:00 UTC. And hope to have a planning meeting as our first meeting of the year. Our first meeting of the new year is slated for January 3rd at 17:00 UTC and for IRC. We will take the poll results into consideration and may cancel the January meeting to allow folks to plan on attending in which case February's meeting would be the first of the year. Please vote for your preferred days and times AND also for IRC and/or Video. https://doodle.com/poll/mnzxkauzwf2isssm?utm_source=poll&utm_medium=link We are keeping to morning hours to encourage participation from EMEA but not overly early for PST folks to attend. We will keep the poll up through the end of the year. Please feel free to reach out with any questions or concerns and remember the Diversity and Inclusion WG is for ALL projects under the Open Infra Foundation! Thanks, Amy (spotz)

1 1

Additional zuul comments apart from warnings
by Muhia Nyambura 13 Dec '21

13 Dec '21

Hello all, Is it possible to return other "Generic" comments apart from Warnings and File Comments <https://zuul-ci.org/docs/zuul/reference/jobs.html?highlight=zuul_success#le…> ? We would like to return some additional information (URLs) together with the Build URL in our Gerrit comments without having to go to the Zuul instance to access these links - like how we have it for artifact URLs <https://zuul-ci.org/docs/zuul/reference/jobs.html?highlight=zuul_success#re…> . Do you have suggestions on how I can achieve this? Or is this something that you could possibly look into adding? BR, Nyambura.

1 0

zuul admin GUI - what now?
by Matthieu Huin 24 Nov '21

24 Nov '21

(Bringing this to the ML as the BOAF session ran out of time) Hey folks, I'd like some guidance and opinions on how to go forward with the Zuul Admin GUI changes [0]. My main concern is how to ensure reviews can be done in the easiest way for everyone. I took some steps in that direction: * I have provided a test docker compose based on the demo compose in the documentation [1]. This compose lives on top of the patch chain, so all the changes can be tested at once. It is also possible to cherry-pick the change on top of any specific patch you'd like to test in particular. It is not perfect, but it does set up authentication via OpenID Connect for zuul and gerrit, allowing to experiment further with the new features. Is there anything I should do to improve this ? Or should I leave this as is, as it is not intended to get merged (it's meant for demo purposes only) ? * I have reorganized the patch chain so that the python and the JS changes are strictly separated. Furthermore, the changes to the python components are at the beginning of the patch chain. I think it'd be great to get these reviewed and merged ASAP (they're not big changes), because one big downside of the compose mentioned above is that it requires rebuilding the zuul containers locally before it can run. Once these changes are integrated, the compose can run on the latest published containers. * I've added various screenshots and video captures to the reviews, so that reviewers can get an idea of what the changes would look like without having to deploy. * I am currently working on deploying a public test instance based on the demo compose. Is there anything else I can do to get this moving forward ? Cheers, MHU [0] https://review.opendev.org/q/topic:%22GUI_admin%22+(status:open%20OR%20stat… [1] https://review.opendev.org/c/zuul/zuul/+/769943 -- Matthieu Huin Senior Software Developer Red Hat <https://www.redhat.com> <https://red.ht/sig>

3 7