November 2021 - Zuul-discuss - lists.opendev.org

zuul admin GUI - what now?
by Matthieu Huin 25 Nov '21

25 Nov '21

(Bringing this to the ML as the BOAF session ran out of time) Hey folks, I'd like some guidance and opinions on how to go forward with the Zuul Admin GUI changes [0]. My main concern is how to ensure reviews can be done in the easiest way for everyone. I took some steps in that direction: * I have provided a test docker compose based on the demo compose in the documentation [1]. This compose lives on top of the patch chain, so all the changes can be tested at once. It is also possible to cherry-pick the change on top of any specific patch you'd like to test in particular. It is not perfect, but it does set up authentication via OpenID Connect for zuul and gerrit, allowing to experiment further with the new features. Is there anything I should do to improve this ? Or should I leave this as is, as it is not intended to get merged (it's meant for demo purposes only) ? * I have reorganized the patch chain so that the python and the JS changes are strictly separated. Furthermore, the changes to the python components are at the beginning of the patch chain. I think it'd be great to get these reviewed and merged ASAP (they're not big changes), because one big downside of the compose mentioned above is that it requires rebuilding the zuul containers locally before it can run. Once these changes are integrated, the compose can run on the latest published containers. * I've added various screenshots and video captures to the reviews, so that reviewers can get an idea of what the changes would look like without having to deploy. * I am currently working on deploying a public test instance based on the demo compose. Is there anything else I can do to get this moving forward ? Cheers, MHU [0] https://review.opendev.org/q/topic:%22GUI_admin%22+(status:open%20OR%20stat… [1] https://review.opendev.org/c/zuul/zuul/+/769943 -- Matthieu Huin Senior Software Developer Red Hat <https://www.redhat.com> <https://red.ht/sig>

3 7

install and use ansible collections in zuul v3 ansible native job?
by Marios Andreou 24 Nov '21

24 Nov '21

hi folks long story short: can we install and use ansible collections in a zuul v3/ansible native job? In the tripleo-ci squad we are trying to use the tripleo_overcloud_image_build role from the tripleo-operator-ansible collection [1]. We are already using other roles from this collection - e.g. there [2]. This is possible because in that case we have zuul calling bash calling ansible... which means we get to configure collections in the bash bit setting ANSIBLE_COLLECTIONS_PATHS [3] before invoking ansible. For the case I'm having trouble with - what i refer to as ansible native - here https://review.opendev.org/#/c/733818/33/roles/oooci-build-images/tasks/mai… we have a zuul job playbook directly trying to install and use a collection. Currently it fails because instead of collections: (doesn't work " 'collections' is not a valid attribute? [4] ) I am trying to use include_role but then it can't find the collection's modules "ERROR! no action detected in task" [5]. I tried to set it in ansible.cfg but that won't work and anyway it is surely the wrong approach. The one thing left to try is to explicitly require ansible 2.9 for the job - but wanted to reach out and see if anyone else has any problems trying to install and use ansible collections (with modules importantly) as part of a zuul v3/ansible native job. thanks for reading and for any comments, marios [1] https://github.com/openstack/tripleo-operator-ansible/tree/master/roles/tri… [2] https://opendev.org/openstack/tripleo-quickstart-extras/src/commit/55e74bb8… [3] https://opendev.org/openstack/tripleo-quickstart/src/commit/299131bcc6dca86… [4] https://23fd78c0f6b01b9c4209-59c294b8f46eb75cda2bd004e2a1c97f.ssl.cf1.rackc… [5] https://2063b7e2bb67f86f8ec5-87fe67c942382c6ee875c514bffa4f21.ssl.cf2.rackc…

3 8

dynamic job list
by Åsmund Østvold 19 Nov '21

19 Nov '21

Hi All, We are looking into optimizing what jobs need to run. After building we know what artifacts that did change. Knowing this we know what tests that need to be executed. Is there a way to feed that back to the zuul buildset? A change only changes artifacts used by testx and testy compared to what has already been tested. So the static project: project: check: jobs: - build Is at runtime converted into: pipeline- project: check: jobs: - build - testx - testz Cheers, Åsmund

2 1

Indexing Zuul build logs
by Tristan Cacqueray 06 Nov '21

06 Nov '21

Hi, I would like to discuss the best practices for build logs processing. The goal is to improve the user experience when debugging a job that produces a lot of logs (e.g. >10MB) and to help discover failures that are transients and unrelated to a particular build. The existing options are (please reply with your own solutions): - opendev/puppet-log_processor : a gearman service that can be notified through a post job task to trigger build log indexing in logstash. This also provides a classify-log.crm function to annotate log with a score. - openstack/ci-log-processing : a work in progress service to replace the post job task and use the log_processor through the builds api. - opendev/log-classify : an import of my logreduce tool that runs as a post task to provide an html report directly along the build log. https://softwarefactory-project.io/cgit/logreduce/tree/README.rst (The initial opendev reviewes are still in open). - github.com/bmwcarit/zubbi : a service to index jobs and roles in elasticsearch. This is not exactly related to the goal, but it is worth mentioning it. I am wondering if Zuul shouldn't support elasticsearch directly, by providing a `upload-logstash` role in zuul-jobs, and by supporting browsing the elasticsearch api directly from zuul-web. This would remove the need for an extra service to do the indexing, and we wouldn't have to process and store the logs twice. Am I missing something, how do you process build logs? Regards, -Tristan

3 4

[Diversity] Diversity and Inclusion Meeting Reminder
by Amy Marrich 01 Nov '21

01 Nov '21

The Diversity & Inclusion WG invites members of all OIF projects to attend our next meeting Monday November 1st, at 17:00 UTC in the #openinfra- diversity channel on OFTC. The agenda can be found at https://etherpad.openstack.org/p/diversity-wg-agenda. Please feel free to add any topics you wish to discuss at the meeting. Thanks, Amy (apotz)

1 0