January 2022 - Zuul-discuss - lists.opendev.org

Cross-project dependencies + build artifacts?
by A richist 02 Feb '22

02 Feb '22

Hello Zuul folk, I'm trying to integrate Zuul pipelines for a set of products set up in a way where each project's build job creates a build artifact, and dependent projects consume that artifact during their own build job. I can't seem to get Zuul to do what I want it to do, and was wondering if I made some wrong assumptions. In the use-case I'm simulating, I have 2 projects: - project1 which builds into a library exposing an API. - project2 which consumes/links with that library at build time and uses said API. The setup I have for these projects boils down to: - job: name: project1-build runs:... provides: lib - job: name: project2-build runs:... requires: lib - project: name: project1 queue: product gate: jobs: - project1-build - project: name: project2 queue: product gate: jobs: - project2-build There are some other jobs defined in project2's gate, which consume project2-build's artifact to further test it before merging, but this works as I expect using "job.dependencies" so I'm excluding them above. In my use-case, a developer makes code changes to the API in project1, the referencing API usage in project2, and wants Zuul to test these code changes together, so they add to their commit message in project2: Depends-On: <URL for the Gerrit change for project1> Once the changes are approved they are enqueued in gate as expected, with project2-build job waiting for the completion of project1-build. Following project1-build's successful completion, this is what I naively expected would happen: - Zuul would wait for project2-build's successful completion before merging the change for project1. - project1-build's artifacts would be made available during project2-build's runtime via {{ zuul.artifacts }}. - In case project2-build fails, Zuul would prevent both changes from merging. What actually happens: - The code change for project1 is immediately merged, with potentially "bad" code that was not tested along with the developer's other change. - In the Zuul web UI the connection between the two changes seems to be severed / no longer there. - During project2-build, {{ zuul.artifacts }} is not set. I've tried setting as project1-build's last task: - zuul_return: data: zuul: pause: true But it didn't seem to have any effect. So I guess my question is how can I prevent Zuul from merging a change until depending changes complete testing along with its build artifacts, and how can artifacts be accessed for cross-project dependencies? Regards, Arichist

2 1

2021 OpenInfra Foundation Annual Report Now Available
by Jeremy Stanley 26 Jan '22

26 Jan '22

The 2021 Annual Report from the Open Infrastructure Foundation is now available here: https://openinfra.dev/annual-report/2021 It includes a year in review for all OpenInfra projects, including a section on Zuul, but also updates on the foundation itself, growth in the open infrastructure ecosystem, and event news. Enjoy! -- Jeremy Stanley

1 0

Missing READY static nodes in zuul web from 4.9.0
by Vitaliy Lotorev 26 Jan '22

26 Jan '22

After upgrading Zuul 4.7.0 -> 4.9.0 all idle static nodes have gone from zuul web Nodes tab, i.e. READY, BUILDING are not shown on web anymore. This causes inconvenience in analyzing the state of static nodes (what are available). Is this change/behaviour intentional and won't be fixed or this is a regression that might be fixed in future? It seems this change modified web filtering https://review.opendev.org/c/zuul/zuul/+/807406. Regards, Vitaliy

1 0

April 2022 Virtual PTG Dates & Registration
by Kendall Nelson 24 Jan '22

24 Jan '22

Hello Everyone! We're happy to announce the next virtual PTG[1] will take place April 4-8, 2022! Registration is now open[2]. The virtual PTG is free to attend, but make sure to register so you receive important communications like schedules, passwords, and other relevant updates. Next week, keep an eye out for info regarding team sign-ups. Can't wait to see you all there! -Kendall (diablo_rojo) [1] https://www.openstack.org/ptg/ [2] https://openinfra-ptg.eventbrite.com/

1 0

About zuul's performance
by Xie, Zhiqi (NSB - CN/Hangzhou) 24 Jan '22

24 Jan '22

Hi, Our teams are using zuul based on openstack zuul 2.x. We have hundreds of users and we had performance impact during rush hour. There are many connections synced in zuul's main loop, including gerrit query/review/git-upload-pack and gearman task sending. In rush hour our gerrit will be slow to response (at most it will take 2 secs to response the query and 1 min to response git-upload-pack), and we have hundreds of jobs per gerrit change and thus we have too many job-launch task and job-set-description task. These connection make the zuul rather slow in the rush hours. In the worst situation, zuul will go through a loop in 30 mins. We have to make modification to solve this locally, to make all the connections asynced. Now the performance impact is eased. And recently we are planning to go up to zuul version 4.x or 5.x, so we have some quick peek of current zuul v4. We find that gearman connection is gone but zookeeper connections comes instead. And zookeeper connection are still synced. And gerrit support http rest api, but the query is still synced. Therefore we are worried about performance in our environment. We want to keep pace with community so we would like some answers: 1. How will zuul v4/5 solve the slowness when gerrit is not that fast. We will encounter gerrit connection lasting for seconds in rush hour and don't want zuul's main thread go slow. 2. If zookeeper's connection is not fast, the zuul's main thread will cost too much time in getting response from zookeeper. How to prevent this to happen? Will adding more nodes of zookeeper in a cluster help? 3. Does zuul have plan to make the network I/O asynced to improve performance? Best regards

3 2

[Diversity] Diversity and Inclusion WG new meeting time
by Amy Marrich 20 Jan '22

20 Jan '22

Thank you to those who responded to the Doodle for our meeting time. The day and time selected was Friday at 15:00 UTC so we will move to that in February with our first meeting being on 2/4. As usual, should we need to cancel the first Friday of the month we have the backup date of the third week. Should we end up having to do that too frequently ,as Fridays are popular for holidays and vacations, we'll readdress the meeting time again. Also chosen was to switch to a video platform and we will work on choosing one before the meeting reminder goes out Thanks, Amy (spotz)

1 0

Project lead election
by James E. Blair 10 Jan '22

10 Jan '22

Hi, The position of Zuul Project Lead is an elected position described in our governance document[1]. I currently hold the position, and would be happy to continue in that position for another year. If elected, I plan to continue my current hands-off approach. I believe that all of the Zuul Maintainers are empowered to collectively decide on and execute our vision for the project. My purpose is to help articulate that vision when necessary, drive the process of attaining consensus, and be a point of contact and representative for the project in circumstances where a single person is needed (but in those cases, I promise to share as much of that work as possible with the rest of the team). I have uploaded a change[2] to update the expiration date of my term. If any other Zuul Maintainers would like to nominate themselves for the position, please upload a similar change and send a reply to this message to this list. The nomination period will close on January 14, 2022. If there are other candidates, we will hold a Condorcet election at that time. -Jim [1] https://zuul-ci.org/docs/zuul/governance.html#zuul-project-lead [2] https://review.opendev.org/824043

1 0

[Diversity] D&I WG Meeting Cancellation and Poll Reminder
by Amy Marrich 03 Jan '22

03 Jan '22

Just a reminder that tomorrow's meeting is canceled and to participate in the Meeting Time and IRC vs Video Poll! https://doodle.com/poll/mnzxkauzwf2isssm?utm_source=poll&utm_medium=link Thanks, Amy (spotz)

1 0